Snqwii/Rose-Engine-12B is a 12 billion parameter language model created by Snqwii, merged using the DARE TIES method with mistralai/Mistral-Nemo-Base-2407 as its base. This model combines the general capabilities of Dans-PersonalityEngine-V1.3.0 with specialized knowledge in furry and NSFW content, derived from Fizzarolli/MN-12b-Rosier-v1. It is designed to retain strong general performance while excelling in generating content related to furry interests and NSFW topics.
Rose-Engine-12B: A Specialized Merge for Furry and NSFW Content
Rose-Engine-12B is a 12 billion parameter language model developed by Snqwii, created through a merge of existing pre-trained models using the DARE TIES method. Its foundation is mistralai/Mistral-Nemo-Base-2407, enhanced by combining PocketDoc/Dans-PersonalityEngine-V1.3.0-12b and Fizzarolli/MN-12b-Rosier-v1.
Key Capabilities
- Specialized Content Generation: This model is specifically designed to understand and generate content related to furry interests and NSFW topics, leveraging the highly biased dataset of
Rosier-v1. - Retained General Performance: It aims to maintain the general language understanding and generation capabilities of
Dans-PersonalityEngine-V1.3.0. - Merge Method: Utilizes the DARE TIES merge method, which is effective for combining models with potentially little overlap in their specialized knowledge.
Good For
- Niche Content Creation: Ideal for applications requiring detailed and nuanced generation of furry-themed or NSFW text.
- Experimental Use Cases: Suitable for developers exploring model merging techniques and specialized content generation within specific, potentially sensitive, domains.