Overview

Undi95/CreativityEngine is a 13 billion parameter language model created by Undi95, resulting from a merge of two distinct models: jondurbin/airoboros-lmoe-13b-2.1 (specifically its creative adapter) and elinas/chronos-13b-v2, with a 0.38 weight applied to the latter. This combination aims to leverage the strengths of both base models, particularly for creative text generation.

Key Capabilities & Performance

Evaluated on the Open LLM Leaderboard, CreativityEngine demonstrates a balanced performance profile:

• Avg. Score: 52.07
• HellaSwag (10-shot): 82.42, indicating strong common-sense reasoning.
• Winogrande (5-shot): 74.19, showing proficiency in resolving pronoun ambiguity.
• ARC (25-shot): 59.3
• MMLU (5-shot): 53.55
• TruthfulQA (0-shot): 52.46
• GSM8K (5-shot): 9.55, suggesting limitations in complex mathematical problem-solving.
• DROP (3-shot): 32.98

Good For

• Creative Text Generation: The inclusion of a "creative adapter" from airoboros-lmoe-13b-2.1 suggests an optimization for imaginative and diverse text outputs.
• General Language Understanding: Its solid performance on HellaSwag and Winogrande indicates good capabilities for tasks requiring contextual understanding and common sense.
• Applications requiring a 13B parameter model: Offers a balance of performance and computational efficiency for various NLP tasks.