OccultAI/Soulblighter-24B-v1: A Karcher Merge Model
Soulblighter-24B-v1 is a 24 billion parameter language model developed by OccultAI, built upon the MistralForCausalLM architecture. This model is a creative merge, utilizing the karcher method to combine characteristics from several distinct finetuned models. Notably, it incorporates Magistral finetunes, similar to the StormSeeker merge, aiming to blend their respective strengths.
Key Characteristics
- Merge Method: Employs the
karcher merge technique to integrate diverse model capabilities. - Constituent Models: Blends a variety of 24B models, including those from aixonlab, allura-forge, CrucibleLab, LatitudeGames, PocketDoc, ReadyArt, TheDrummer, trashpanda-org, and zerofata.
- Creative Applications: Positioned for creative use cases, leveraging the combined strengths of its merged components.
- Refusal Handling: Acknowledged to have some refusals, which are noted as potentially easy to ablate or jailbreak.
- Context Length: Supports a context window of 32768 tokens.
Potential Use Cases
This model is suitable for developers looking for a unique blend of capabilities derived from its diverse merged components. Its creative merge approach suggests potential for novel text generation and understanding tasks. The mention of a "reasoning mode" (though untested) indicates a possible focus on complex logical processing, making it a candidate for applications requiring nuanced responses.