redrix/patricide-12B-Unslop-Mell
Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:12BQuant:FP8Ctx Length:32kPublished:Dec 1, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Warm

redrix/patricide-12B-Unslop-Mell is a 12 billion parameter language model created by redrix, merged using the SLERP method from inflatebot/MN-12B-Mag-Mell-R1 and TheDrummer/UnslopNemo-12B-v4.1. This model aims to combine the strengths of its parent models, demonstrating good coherence in early testing. It is primarily intended for general text generation tasks, including storywriting and roleplay, with a context length of 32768 tokens.

Loading preview...

Model Overview

redrix/patricide-12B-Unslop-Mell is a 12 billion parameter language model developed by redrix, created through a SLERP merge of inflatebot/MN-12B-Mag-Mell-R1 and TheDrummer/UnslopNemo-12B-v4.1. The developer's goal was to combine the desirable traits of these parent models into a new, coherent offering. Early testing indicates good coherence, though the developer notes occasional unintelligible output, potentially due to a tokenizer issue. The model supports a context length of 32768 tokens.

Key Capabilities

  • General Text Generation: Shows stable and coherent results in initial evaluations.
  • Storywriting & Roleplay: Although not extensively tested, it performs satisfactorily in these areas.
  • ChatML Template: Designed to primarily use the ChatML template, with parent models also supporting Metharme/Pygmalion.

Good For

  • Users experimenting with merged models for general text generation.
  • Applications requiring coherent, stable output for creative writing or roleplay scenarios.
  • Exploration of models with a 32K context window.

Limitations

  • Early testing revealed potential for unintelligible or made-up words, possibly due to a broken tokenizer.
  • Performance with high context sizes and specific sampling parameters (DRY, XTC) is not yet extensively tested.
Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p