coder3101/Cydonia-24B-v4.3-heretic-v4
The coder3101/Cydonia-24B-v4.3-heretic-v4 is a 24 billion parameter language model, derived from TheDrummer/Cydonia-24B-v4.3, and decensored using the Heretic v1.2.0 tool with Magnitude-Preserving Orthogonal Ablation (MPOA). This model is specifically optimized for creative writing, roleplay, and entertainment use cases, aiming to enhance user experience in scenarios requiring unaligned and dynamic storytelling. It features a 32768 token context length and demonstrates significantly reduced refusal rates compared to its original counterpart, making it suitable for nuanced and imaginative interactions.
Loading preview...
Overview
coder3101/Cydonia-24B-v4.3-heretic-v4 is a 24 billion parameter language model, a decensored variant of TheDrummer's Cydonia-24B-v4.3. It was created using the Heretic v1.2.0 tool with Magnitude-Preserving Orthogonal Ablation (MPOA) to reduce content refusals and broaden its linguistic perception. The model maintains a substantial 32768 token context length, enabling it to handle complex and extended conversational or narrative threads.
Key Differentiators
- Decensored Performance: Achieves a refusal rate of 14/100 compared to the original model's 73/100, indicating a significantly less aligned and more permissive output. This is achieved with a minimal KL divergence of 0.0069 from the original model.
- Optimized for Creativity & Roleplay: The model is specifically geared towards enhancing creative writing, dynamic storytelling, and immersive roleplay experiences. It excels at generating compelling narratives, developing unique character voices, and introducing relevant plot elements not explicitly stated in the prompt.
- Flexible Instruction Adherence: Supports both explicit
<thinking>tags and implicit instruction following, allowing for versatile prompting strategies.
Ideal Use Cases
- Creative Writing & Story Generation: Excels at crafting engaging prose, developing intricate plots, and maintaining consistent character voices over long contexts.
- Roleplay & Interactive Fiction: Designed to provide a fresh and dynamic roleplay experience, adapting well to various character cards and group chat scenarios without being overly restrictive.
- Unrestricted Content Generation: Suitable for applications where a less aligned model is desired, allowing for exploration of diverse and nuanced themes without frequent refusals.