Undi95/MG-FinalMix-72B
Hugging Face
TEXT GENERATIONConcurrency Cost:4Model Size:72.7BQuant:FP8Ctx Length:32kPublished:Jun 25, 2024License:otherArchitecture:Transformer0.0K Warm

Undi95/MG-FinalMix-72B is a 72.7 billion parameter language model developed by Undi95, built upon a merge of Qwen/Qwen2-72B-Instruct and alpindale/magnum-72b-v1. This model is specifically retouched and enhanced with additional role-playing (RP) data, aiming to improve performance in conversational and creative generation tasks. With a substantial context length of 131072 tokens, it is optimized for nuanced and extended interactions.

Loading preview...

Undi95/MG-FinalMix-72B: Enhanced 72.7B Parameter Model

Undi95/MG-FinalMix-72B is a 72.7 billion parameter language model, a retouched and enhanced version of alpindale/magnum-72b-v1, built upon a merge that includes Qwen/Qwen2-72B-Instruct. Developed by Undi95, this model incorporates additional role-playing (RP) data to address identified issues and improve conversational capabilities.

Key Capabilities

  • Merged Architecture: Combines the strengths of Qwen/Qwen2-72B-Instruct and alpindale/magnum-72b-v1.
  • Enhanced Role-Playing: Fine-tuned with extra RP data for more engaging and coherent character interactions.
  • Extended Context: Features a significant context length of 131072 tokens, supporting long-form conversations and complex scenarios.
  • Custom Quantization Support: Provides an imatrix.dat file for users to generate their own quantized versions, based on wiki.train.raw data.

Good For

  • Role-Playing Scenarios: Excels in generating detailed and consistent character-driven narratives.
  • Creative Writing: Suitable for tasks requiring imaginative and extended text generation.
  • Long-form Conversational AI: Its large context window makes it ideal for maintaining coherence over lengthy dialogues.
Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p