MuXodious/MS3.2-24B-Magnum-Diamond-PaperWitch-heresy
MuXodious/MS3.2-24B-Magnum-Diamond-PaperWitch-heresy is a 24 billion parameter fine-tuned model based on Mistral-Small-3.2-24B-Instruct-2506, developed by MuXodious. This model was created using P-E-W's Heretic abliteration engine with Magnitude-Preserving Orthogonal Ablation. It is specifically optimized for creative writing and roleplay, aiming to emulate the prose style of Claude 3 Sonnet/Opus models at a consumer-friendly scale, and supports a 32768 token context length.
Loading preview...
Model Overview
MuXodious/MS3.2-24B-Magnum-Diamond-PaperWitch-heresy is a 24 billion parameter model fine-tuned from Mistral-Small-3.2-24B-Instruct-2506. It was developed by MuXodious using P-E-W's Heretic abliteration engine, specifically with Magnitude-Preserving Orthogonal Ablation. The model aims to reproduce the prose style and quality of Claude 3 Sonnet/Opus models at a smaller, more accessible scale.
Key Capabilities
- Creative Writing & Roleplay: Optimized to generate high-quality, engaging prose for creative writing and roleplay scenarios.
- Claude-like Style: Designed to emulate the distinctive writing style often seen in Claude 3 models.
- Context Length: Supports a substantial context window of 32768 tokens.
- Prompt Format: Utilizes the Mistral v7 Tekken prompt format, with optional prefill for roleplay.
Heretication Results
The model underwent a "heretication" process, resulting in a refusal rate of 16/100 and a KL Divergence of 0.0384, indicating a controlled modification from its base model.
Intended Use Cases
- Creative Story Generation: Ideal for generating narratives, character dialogues, and descriptive passages.
- Interactive Roleplay: Suitable for applications requiring dynamic and engaging roleplay interactions.
Limitations
- May exhibit biases similar to contemporary LLM-based roleplay models and the Claude 3 series.
- Not intended for factual information or advice; outputs should be considered fictional.