s3nh/fable-traces-abliterated
s3nh/fable-traces-abliterated is a decensored version of AliesTaha/fable-traces, which is a compact instruction-tuned language model built on Qwen/Qwen3-4B-Instruct-2507. This model is designed for short, conversational replies and runs efficiently on a single mid-range GPU. It has been modified using Heretic v1.4.0 to reduce refusals, maintaining the original model's refusal rate of 3/100 while introducing a KL divergence of 0.0011.
Loading preview...
Overview
s3nh/fable-traces-abliterated is a modified version of the AliesTaha/fable-traces model, which is based on the Qwen3-4B-Instruct-2507 architecture. This model has been specifically decensored using Heretic v1.4.0.
Key Characteristics
- Decensored: Modified from its original version to alter refusal behavior, though it maintains the same refusal rate of 3/100 as the base model.
- Compact Size: Built on a ~4 billion parameter base model, making it suitable for deployment on a single mid-range GPU.
- Instruction-Tuned: Optimized for generating short, conversational replies.
- Reproducible: The abliteration process is documented and reproducible, with specific parameters detailed in the
reproducedirectory.
Performance & Details
While the original model had a KL divergence of 0 (by definition), this abliterated version introduces a KL divergence of 0.0011. It uses the ChatML prompt format and inherits the context length of its base model. The model is distributed in bfloat16 precision using safetensors.
Usage
This model can be used with the transformers library for inference or served efficiently using vLLM.