Vortex5/Aurora-Mirage-12B

Aurora-Mirage-12B: A Merged Model for Creative Text Generation

Aurora-Mirage-12B is a 12 billion parameter language model developed by Vortex5. It was created using a custom merging method, combining four specialized 12B models: Scarlet-Seraph-12B, Crimson-Constellation-12B, Wicked-Nebula-12B, and Eclipsed-Prism-12B. This unique approach aims to synthesize the strengths of its constituent models into a cohesive unit.

Key Capabilities

This model is specifically designed and optimized for creative writing and interactive narrative tasks. Its primary strengths include:

• Storytelling: Capable of generating structured, long-form narratives.
• Roleplay: Excels at creating emotion-forward interactions, making it suitable for character-driven scenarios.
• Creative Writing: Particularly adept at producing atmospheric fiction, focusing on mood and descriptive detail.

Merge Configuration

The model's creation involved a specific merge configuration, utilizing rhcr as the merge method. Key parameters included a strength of 0.6, flavor of 0.4, novelty of 0.3, rank of 3, and a critic value of 0.65. The tokenizer was sourced from Vortex5/Scarlet-Seraph-12B, and the model outputs in bfloat16 dtype.

Intended Use Cases

Aurora-Mirage-12B is ideal for developers and creators focused on applications requiring high-quality, imaginative text generation. It is particularly well-suited for:

• Interactive fiction and game development.
• Automated story generation tools.
• Creative writing assistants.
• Role-playing game (RPG) character and scenario generation.