Overview

Lambent/Mira-v1.18-27B-heretic-0.019 is a 27 billion parameter large language model, a decensored variant of the original Lambent/Mira-v1.18-27B model. This version was created using the Heretic v1.1.0 tool, specifically targeting a reduction in content refusal rates.

Key Characteristics

• Decensored Variant: Modified to exhibit fewer content refusals compared to the base model.
• Parameter Count: 27 billion parameters, offering substantial generative capabilities.
• Context Length: Supports a long context window of 32768 tokens.
• KL Divergence: Exhibits a KL divergence of 0.0190 from the original model, indicating a relatively mild alteration in its distribution.

Performance & Differentiation

This 'heretic' version significantly reduces content refusals, dropping from 66/97 in the original model to 55/97. While this process introduces a slight 'capability damage' as noted by the developers, it is not to the point of 'glitching' and is described as 'Very Shiny'. The abliteration parameters detail specific weight adjustments made to attn.o_proj and mlp.down_proj layers during the decensoring process.