sequelbox/Llama3.1-70B-PlumChat
Hugging Face
TEXT GENERATIONConcurrency Cost:4Model Size:70BQuant:FP8Ctx Length:32kLicense:llama3.1Architecture:Transformer Warm

sequelbox/Llama3.1-70B-PlumChat is a 70 billion parameter language model based on the Llama 3.1 architecture, created by sequelbox. This model is a merge of Nemotron-70B-Instruct and ShiningValiant2, built upon the Llama-3.1-70B-Instruct base. It is specifically designed for high-quality general chat, science-instruct tasks, and complex query performance, leveraging a 32K context window.

Loading preview...

PlumChat 70B: A Merged Llama 3.1 Model

PlumChat 70B is a 70 billion parameter language model developed by sequelbox, leveraging the Llama 3.1 architecture. It was created using the della merge method via MergeKit, combining two specialized models on top of the meta-llama/Llama-3.1-70B-Instruct base.

Key Capabilities

  • Enhanced General Chat: Optimized for natural and coherent conversational interactions.
  • Science Instruction: Designed to perform well on tasks requiring scientific knowledge and instruction following.
  • Complex Query Performance: Excels at processing and responding to intricate and multi-faceted queries.
  • Llama 3.1 Foundation: Benefits from the robust capabilities and extensive training of the Llama 3.1 series.

Merge Details

This model integrates nvidia/Llama-3.1-Nemotron-70B-Instruct-HF and ValiantLabs/Llama3.1-70B-ShiningValiant2. The merge aims to combine the strengths of these components to achieve superior performance in general chat, scientific instruction, and complex query resolution. The base model provides a strong foundation, while the merged components contribute to its specialized capabilities, making it suitable for applications requiring advanced reasoning and detailed responses within its 32K context window.

Good For

  • Applications requiring a powerful general-purpose chatbot.
  • Educational tools or research assistants focused on scientific domains.
  • Systems needing to handle and generate responses for complex user prompts.
Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p