Vortex5/Hollowed-Rose-12B
Vortex5/Hollowed-Rose-12B is a 12 billion parameter language model, created through a multi-stage merge of several 12B models including Captain-Eris_Violet-V0.420-12B, Scarlet-Ink-12B, Sunlit-Shadow-12B, and Hollow-Aether-12B. This model is specifically optimized for creative text generation tasks, excelling in storytelling, roleplay, and general creative writing. It leverages a 32768 token context length to support detailed and extended narrative development.
Loading preview...
Overview
Hollowed-Rose-12B is a 12 billion parameter language model developed by Vortex5, constructed through a sophisticated multi-stage merging process. This model integrates capabilities from several base models: Captain-Eris_Violet-V0.420-12B, Scarlet-Ink-12B, Sunlit-Shadow-12B, and Hollow-Aether-12B. The merging process utilized nearswap and karcher methods, as detailed in its YAML configuration.
Key Capabilities
- Multi-stage Merge Architecture: Combines strengths from multiple specialized 12B models to enhance overall performance.
- Extended Context Window: Supports a 32768 token context length, facilitating longer and more coherent text generation.
Intended Use Cases
Hollowed-Rose-12B is specifically designed and optimized for creative text generation, making it highly suitable for:
- Storytelling: Generating engaging and coherent narratives.
- Roleplay: Creating dynamic and interactive role-playing scenarios.
- Creative Writing: Assisting with various forms of creative content generation.