saidutta69/Qwen2.5-Coder-7B-Instruct-heretic
The saidutta69/Qwen2.5-Coder-7B-Instruct-heretic is a 7.6 billion parameter instruction-tuned causal language model, derived from Qwen/Qwen2.5-Coder-7B-Instruct. This model has been decensored using the Heretic v1.4.0 abliteration method, which suppresses refusal behavior via targeted weight edits rather than fine-tuning. It is optimized for coding tasks, providing direct answers without refusal guardrails, making it suitable for local coding agents and pair-programming.
Loading preview...
What is this model about?
This model, saidutta69/Qwen2.5-Coder-7B-Instruct-heretic, is a 7.6 billion parameter instruction-tuned variant of the Qwen2.5-Coder-7B-Instruct base model. It has been specifically modified using the Heretic v1.4.0 abliteration technique to remove refusal guardrails. This process involves targeted weight edits to the attention output and MLP down-projections, ensuring the base model's core knowledge and instruction-following capabilities remain largely intact while eliminating its tendency to refuse certain prompts.
What makes THIS different from all the other models?
The primary differentiator is its decensored nature achieved through "abliteration" rather than traditional fine-tuning. While many models are fine-tuned to be "helpful," this often degrades coherence when layered over existing RLHF'd refusals. Abliteration, conversely, precisely targets and edits the specific weight directions responsible for refusal, leaving the rest of the network's capabilities untouched. This results in a model that will comply with requests the base model would typically refuse, without a significant loss in its original performance. For instance, it reduced refusals from 100/100 to 3/100 on adversarial prompts, with an exceptionally low KL divergence of 0.0196 from the base model, indicating minimal impact on its overall output distribution.
Should I use this for my use case?
This model is particularly suited for developers who require a 7B coding model that provides direct answers without refusal guardrails. It is ideal for:
- Local coding agents
- Pair-programming scenarios
- Repo-level assistance where direct, unfiltered responses are preferred.
It is important to note that while refusal behavior is suppressed, this is not a capability upgrade over the base Qwen2.5-Coder-7B-Instruct; it maintains the same coding capabilities. Users are responsible for its deployment, as it lacks safety filtering and will comply with requests the base model would refuse, including potentially inappropriate ones. It inherits the factual limitations and biases of the original Qwen model.