ApolloRaines/Mistral-7B-Instruct-v0.3-Jbliterated
ApolloRaines/Mistral-7B-Instruct-v0.3-Jbliterated is a 7 billion parameter instruction-tuned causal language model, a Jbliterated version of mistralai/Mistral-7B-Instruct-v0.3. This model features an improved multi-phase processing pipeline for cleaner output and more precise geometric decomposition of the refusal subspace. It is designed to provide coherent and instruction-following responses across various scenarios, treating all framings of a topic equally without fake compliance.
Loading preview...
Overview
ApolloRaines/Mistral-7B-Instruct-v0.3-Jbliterated is a 7 billion parameter instruction-tuned model, building upon the mistralai/Mistral-7B-Instruct-v0.3 base. This version incorporates a unique "Jbliteration" process, which modifies all transformer layers to enhance its performance and behavior.
Key Capabilities & Enhancements
- Improved Output Quality: Features an enhanced multi-phase processing pipeline designed to produce cleaner and more refined outputs.
- Refusal Subspace Decomposition: Utilizes a more precise geometric decomposition of the refusal subspace, contributing to its distinct response characteristics.
- Consistent Compliance: Engineered to avoid "fake compliance," ensuring the model treats all framings of a given topic equally and maintains coherent, instruction-following behavior across diverse scenarios.
- Base Model: Derived from
mistralai/Mistral-7B-Instruct-v0.3, maintaining its core architecture and capabilities.
When to Use This Model
This model is particularly suitable for applications requiring a 7B instruction-following model that prioritizes consistent, unbiased responses and clean output generation. Its specific modifications aim to address common issues related to model compliance and coherence, making it a strong candidate for tasks where nuanced instruction adherence is critical.