wvnvwn/gemma-2-9b-it-only-sn-tuned-lr3e-5

Model Overview

The wvnvwn/gemma-2-9b-it-only-sn-tuned-lr3e-5 is a 9 billion parameter instruction-tuned language model, derived from the meta-llama/Llama-3.2-3B-Instruct base model. Its primary differentiator is the application of Safety Neuron Tuning (SN-Tune), a specialized fine-tuning approach designed to significantly enhance safety alignment.

Key Capabilities & Features

• Enhanced Safety Alignment: Fine-tuned using the SN-Tune method on the Circuit Breakers dataset, this model aims to provide improved safety compared to its base counterpart.
• Parameter-Efficient Fine-tuning: SN-Tune selectively fine-tunes only a small set of "safety neurons" while freezing other parameters, minimizing the computational cost and preserving general capabilities.
• Minimal Impact on General Performance: The selective tuning approach ensures that the model's core language understanding and generation abilities are largely retained while boosting safety.

What is SN-Tune?

SN-Tune is an innovative fine-tuning methodology that:

1. Identifies specific "safety neurons" within the model that are crucial for safety-related responses.
2. Locks all other model parameters to prevent degradation of general capabilities.
3. Trains only these identified safety neurons on dedicated safety datasets, such as the Circuit Breakers dataset.

Ideal Use Cases

This model is particularly well-suited for applications where:

• Responsible AI deployment is a critical concern.
• There is a need for a language model with stronger safety guardrails against generating harmful or undesirable content.
• Developers require a model that balances general instruction-following capabilities with enhanced safety alignment without extensive retraining.