Aurora-Mirage-12B: A Merged Model for Creative Text Generation
Aurora-Mirage-12B is a 12 billion parameter language model developed by Vortex5. It was created using a custom merging method, combining four specialized 12B models: Scarlet-Seraph-12B, Crimson-Constellation-12B, Wicked-Nebula-12B, and Eclipsed-Prism-12B. This unique approach aims to synthesize the strengths of its constituent models into a cohesive unit.
Key Capabilities
This model is specifically designed and optimized for creative writing and interactive narrative tasks. Its primary strengths include:
- Storytelling: Capable of generating structured, long-form narratives.
- Roleplay: Excels at creating emotion-forward interactions, making it suitable for character-driven scenarios.
- Creative Writing: Particularly adept at producing atmospheric fiction, focusing on mood and descriptive detail.
Merge Configuration
The model's creation involved a specific merge configuration, utilizing rhcr as the merge method. Key parameters included a strength of 0.6, flavor of 0.4, novelty of 0.3, rank of 3, and a critic value of 0.65. The tokenizer was sourced from Vortex5/Scarlet-Seraph-12B, and the model outputs in bfloat16 dtype.
Intended Use Cases
Aurora-Mirage-12B is ideal for developers and creators focused on applications requiring high-quality, imaginative text generation. It is particularly well-suited for:
- Interactive fiction and game development.
- Automated story generation tools.
- Creative writing assistants.
- Role-playing game (RPG) character and scenario generation.