WeirdCompound-v1.7-24b: A Multi-Stage Merged LLM
WeirdCompound-v1.7-24b is a 24 billion parameter language model developed by FlareRebellion through a sophisticated multi-stage merging process using mergekit. This model is the result of combining several specialized base models, including TheDrummer/Cydonia-24B-v4.2.0, aixonlab/Eurydice-24b-v3.5, and PocketDoc/Dans-PersonalityEngine-V1.3.0-24b, among others. The merging process involved methods like Model Stock, SLERP, and NuSLERP, aiming to integrate diverse strengths from its constituent models.
Key Capabilities
- Diverse Prose Generation: Blends the characteristics of various base models to produce varied and nuanced text.
- Creative Storytelling & Roleplay: Incorporates models optimized for storytelling (Eurydice) and adventure generation (Austral-Winton).
- Prompt Adherence: Benefits from models like Dans-PersonalityEngine, which are designed for better adherence to user prompts.
- Iterative Development: The model has undergone several iterations (v1.1 to v1.7), with each version refining the blend of its components to achieve a desired "vibe" or output style.
Good For
- Creative Writing: Generating imaginative stories, narratives, and descriptive prose.
- Roleplaying Scenarios: Creating dynamic and engaging character interactions and plotlines.
- Exploratory Text Generation: Users seeking a model with a distinct and evolving personality in its output.