Model Overview
Azazelle/Half-NSFW_Noromaid-7b is a 7 billion parameter language model derived from the Mistral-7B-v0.1 base. This model is a strategic slerp merge of two distinct models: NeverSleep/Noromaid-7b-v0.2 and athirdpath/NSFW_DPO_Noromaid-7b. The merging process, detailed in the provided .yaml configuration, uses specific t values for self-attention and MLP layers to achieve a balanced integration of their respective characteristics.
Key Characteristics
- Architecture: Based on the Mistral-7B-v0.1 foundation.
- Parameter Count: 7 billion parameters.
- Context Length: Supports a context window of 4096 tokens.
- Merge Method: Utilizes a slerp (spherical linear interpolation) merge, allowing for fine-grained control over the contribution of each base model.
- Hybrid Capability: Engineered to combine the general conversational abilities of Noromaid-7b-v0.2 with the explicit content generation capabilities of NSFW_DPO_Noromaid-7b.
Intended Use Cases
This model is particularly well-suited for applications that require:
- Creative Writing: Generating narratives that may include mature or explicit themes.
- Roleplay Scenarios: Engaging in detailed roleplay that spans a spectrum from general to adult-oriented content.
- Content Generation: Creating text for specific niches that benefit from a model capable of handling both conventional and explicit language with a balanced approach.