Snqwii/Rose-Engine-12B

Cold
Public
12B
FP8
32768
1
Hugging Face

Snqwii/Rose-Engine-12B is a 12 billion parameter language model created by Snqwii, merged using the DARE TIES method with mistralai/Mistral-Nemo-Base-2407 as its base. This model combines the general capabilities of Dans-PersonalityEngine-V1.3.0 with specialized knowledge in furry and NSFW content, derived from Fizzarolli/MN-12b-Rosier-v1. It is designed to retain strong general performance while excelling in generating content related to furry interests and NSFW topics.

Overview

Rose-Engine-12B: A Specialized Merge for Furry and NSFW Content

Rose-Engine-12B is a 12 billion parameter language model developed by Snqwii, created through a merge of existing pre-trained models using the DARE TIES method. Its foundation is mistralai/Mistral-Nemo-Base-2407, enhanced by combining PocketDoc/Dans-PersonalityEngine-V1.3.0-12b and Fizzarolli/MN-12b-Rosier-v1.

Key Capabilities

  • Specialized Content Generation: This model is specifically designed to understand and generate content related to furry interests and NSFW topics, leveraging the highly biased dataset of Rosier-v1.
  • Retained General Performance: It aims to maintain the general language understanding and generation capabilities of Dans-PersonalityEngine-V1.3.0.
  • Merge Method: Utilizes the DARE TIES merge method, which is effective for combining models with potentially little overlap in their specialized knowledge.

Good For

  • Niche Content Creation: Ideal for applications requiring detailed and nuanced generation of furry-themed or NSFW text.
  • Experimental Use Cases: Suitable for developers exploring model merging techniques and specialized content generation within specific, potentially sensitive, domains.