Hugging Face Overview
Model Overview
redrix/patricide-12B-Unslop-Mell is a 12 billion parameter language model developed by redrix, created through a SLERP merge of inflatebot/MN-12B-Mag-Mell-R1 and TheDrummer/UnslopNemo-12B-v4.1. The developer's goal was to combine the desirable traits of these parent models into a new, coherent offering. Early testing indicates good coherence, though the developer notes occasional unintelligible output, potentially due to a tokenizer issue. The model supports a context length of 32768 tokens.
Key Capabilities
- General Text Generation: Shows stable and coherent results in initial evaluations.
- Storywriting & Roleplay: Although not extensively tested, it performs satisfactorily in these areas.
- ChatML Template: Designed to primarily use the ChatML template, with parent models also supporting Metharme/Pygmalion.
Good For
- Users experimenting with merged models for general text generation.
- Applications requiring coherent, stable output for creative writing or roleplay scenarios.
- Exploration of models with a 32K context window.
Limitations
- Early testing revealed potential for unintelligible or made-up words, possibly due to a broken tokenizer.
- Performance with high context sizes and specific sampling parameters (DRY, XTC) is not yet extensively tested.