Novaciano/Llama-3.2-1B-NSFW-Dominatrix
Novaciano/Llama-3.2-1B-NSFW-Dominatrix is a 1 billion parameter language model, merged using the SCE method with Novaciano/SENTIMENTAL_SEX-3.2-1B as its base. This model integrates Isotonic/OrcaAgent-llama3.2-1b and Novaciano/Llama-3.2-1B-Carpincho_Alzado, resulting in a specialized model with a 32768 token context length. It is designed for specific applications requiring a blend of its constituent models' characteristics.
Loading preview...
Model Overview
Novaciano/Llama-3.2-1B-NSFW-Dominatrix is a 1 billion parameter language model created by Novaciano. It was developed using the SCE (Subspace Constrained Ensemble) merge method, leveraging mergekit to combine several pre-trained models. The base model for this merge was Novaciano/SENTIMENTAL_SEX-3.2-1B.
Key Capabilities
- Merged Architecture: This model is a composite of three distinct models:
- Merge Method: Utilizes the SCE merge method, which is detailed in the arxiv paper.
- Configuration: The merge process used
bfloat16for bothdtypeandout_dtype, withint8_maskandnormalizeparameters enabled. - Context Length: Features a context window of 32768 tokens.
Good For
- Specialized Applications: Ideal for use cases that benefit from the combined characteristics of its constituent models.
- Research and Experimentation: Suitable for researchers exploring the effects of model merging, particularly with the SCE method and specific model combinations.