Goekdeniz-Guelmez/Qwen3-4B-Thinking-2507-gabliterated

Model Overview

This model, developed by Goekdeniz Guelmez, introduces Gabliteration, a novel neural weight modification technique that extends beyond traditional abliteration methods. Gabliteration uses adaptive multi-directional projections with regularized layer selection to modify specific behavioral patterns without significantly compromising overall model quality. This 4 billion parameter model is part of a series demonstrating scalability from 0.6B to 32B parameters.

Key Capabilities & Differentiators

• Enhanced Writing Performance: Achieves a W/10 benchmark of 9.5, significantly higher than the base model's 2.8, indicating improved writing quality.
• Reduced Refusal: The model exhibits a refusal rate of 2/100, suggesting it is less prone to refusing prompts compared to standard models.
• Novel Technique: Implements Gabliteration, which addresses limitations of existing abliteration by employing singular value decomposition on difference matrices to extract multiple refusal directions.
• Fixed Layer Selection: This specific model was created using a fixed layer selection approach, with layer 18 (out of 36 total) being targeted for modification.

Use Cases & Limitations

This model is particularly suited for applications where a more direct and less filtered response is desired, especially in creative writing or scenarios where typical refusal behaviors are a hindrance. However, users should be aware that the model has reduced safety filtering and may generate sensitive or controversial outputs. It is crucial to use this model responsibly and understand its potential to produce unfiltered content.