wangzhang/gemma-4-12B-it-abliterix
wangzhang/gemma-4-12B-it-abliterix is a 12 billion parameter instruction-tuned Gemma-4 model, developed by wangzhang, that has undergone directional ablation to significantly reduce safety refusals. This model retains the original Gemma-4 capabilities while answering prompts the base model would refuse, making it suitable for safety research and red-teaming. It achieves a 73.7 percentage point reduction in refusals compared to the base model, with minimal perturbation to its original behavior.
Loading preview...
Overview
wangzhang/gemma-4-12B-it-abliterix is an uncensored, refusal-suppressed version of Google's gemma-4-12B-it model. It was created using directional ablation with the abliterix tool, a technique that removes a single refusal direction from the model's write-path projections without fine-tuning or adding new data. This process preserves the base model's capabilities while enabling it to answer prompts that the original model would refuse.
Key Capabilities
- Significantly reduced refusals: Achieves a 73.7 percentage point reduction in refusals on harmful prompts, dropping from 99/100 to 26/100, as evaluated by an LLM judge (
google/gemini-3.1-flash-lite). - Preserves base model capabilities: A norm-preserving transform ensures the model's behavior remains as close to the original as possible, with a low first-token KL divergence of 0.0735 on benign prompts.
- Superior refusal reduction: Outperforms other abliteration methods like Heretic, achieving roughly half the residual refusals under identical evaluation conditions.
- Deterministic and auditable: The ablation process is fully deterministic and reproducible, with the exact configuration and parameters provided.
Good For
- Safety research: Ideal for studying refusal mechanisms in LLMs and evaluating model robustness.
- Red-teaming: Useful for testing and probing model safety guardrails.
- Alignment evaluation: Can be used to assess and understand model alignment.
This model is intended for research purposes and users are responsible for its deployment in compliance with the Gemma Terms of Use and applicable law.