ApolloRaines/Mistral-Small-24B-Instruct-Jbliterated
Mistral-Small-24B-Instruct-Jbliterated by ApolloRaines is a 24 billion parameter instruction-tuned causal language model. It is a modified version of mistralai/Mistral-Small-24B-Instruct-2501, specifically engineered to remove refusal behaviors at the weight level. This model utilizes SVD multi-direction abliteration across all 40 transformer layers, making it suitable for applications requiring direct responses without disclaimers or evasions.
Loading preview...
Overview
ApolloRaines/Mistral-Small-24B-Instruct-Jbliterated is a specialized variant of the mistralai/Mistral-Small-24B-Instruct-2501 model. Its primary distinction lies in the surgical removal of refusal behaviors directly from the model's weights, rather than relying on system prompts or inference-time patches. This modification ensures that the model does not exhibit common non-compliance strategies.
Key Capabilities
- Surgical Refusal Removal: Employs SVD multi-direction abliteration, removing 5 orthogonal directions across all 40 transformer layers. This method captures 79–93% of contrastive variance per layer, eliminating both surface-level and deeper evasion tactics.
- Eliminates Evasion Strategies: Addresses issues like prompt reinterpretation, disclaimer injection, strategic omission, and safer framing, which are often seen in models with only single-direction refusal removal.
- Preserves Core Functionality: Null-space constraints are enabled to ensure that essential capabilities such as mathematical reasoning, coding, and general reasoning are preserved during the abliteration process.
Usage Considerations
This model is designed for use cases where direct, unrefused responses are critical. It is a drop-in replacement for its base model, offering enhanced directness without compromising core functionalities. The modification process ensures norm preservation, maintaining the model's overall integrity. Developers can integrate it using standard Hugging Face transformers library methods.