Vortex5/Shining-Prism-12B
Vortex5/Shining-Prism-12B is a 12 billion parameter language model created by Vortex5, formed by merging Scarlet-Seraph-12B, Strawberry-Smoothie-12B, and NeonMaid-12B-v2. This model is specifically optimized for creative writing, roleplay, and storytelling tasks, leveraging its 32768 token context length for extended narrative generation. It offers enhanced capabilities in generating engaging and coherent long-form text for imaginative applications.
Loading preview...
Shining-Prism-12B Overview
Shining-Prism-12B is a 12 billion parameter language model developed by Vortex5. It was constructed through a custom merging process, combining three distinct base models: Scarlet-Seraph-12B, Strawberry-Smoothie-12B, and NeonMaid-12B-v2. This unique fusion aims to leverage the strengths of its constituent models to create a specialized generative AI.
Key Capabilities
- Merged Architecture: Built from multiple foundational models using a custom
saefmerge method with specificparadox,strength, andboostparameters. - Extended Context: Features a 32768 token context length, suitable for handling longer inputs and generating more extensive outputs.
- Specialized for Narrative: Designed with a strong focus on creative text generation.
Intended Use Cases
Shining-Prism-12B is particularly well-suited for applications requiring imaginative and coherent text generation. Developers should consider this model for:
- Creative Writing: Generating fiction, poetry, or other literary content.
- Roleplay: Facilitating interactive narrative experiences and character dialogue.
- Storytelling: Assisting in the creation of detailed and engaging storylines.
Technical Details
The model utilizes bfloat16 for its data type and inherits its tokenizer from Vortex5/Scarlet-Seraph-12B. Quantized versions (Static, imatrix, EXL3) are provided by Team Mradermacher and DeathGodlike, respectively, to optimize deployment and performance.