zetasepic/Qwen2.5-72B-Instruct-abliterated

Warm
Public
72.7B
FP8
131072
License: qwen
Hugging Face
Overview

Overview

zetasepic/Qwen2.5-72B-Instruct-abliterated is a 72.7 billion parameter instruction-tuned model derived from the Qwen2.5-72B-Instruct architecture. Its key differentiator is the application of an 'abliteration' technique, which modifies the model's inherent response patterns. This process utilizes code from the refusal_direction project, aiming to alter or control specific aspects of the model's output.

Key Capabilities

  • Modified Behavior: The model's responses are intentionally altered from the base Qwen2.5-72B-Instruct through the abliteration technique.
  • Large Scale: With 72.7 billion parameters, it retains the robust language understanding and generation capabilities of its base model.
  • Instruction Following: Designed to follow instructions effectively, similar to its parent model.

Good For

  • Research into Model Behavior Modification: Ideal for exploring the effects and applications of abliteration techniques on large language models.
  • Controlled Response Generation: Suitable for scenarios requiring specific alterations or constraints on model outputs.
  • Advanced LLM Experimentation: Developers and researchers interested in fine-grained control over model responses beyond standard fine-tuning.