Locutusque/llama-3-neural-chat-v2.2-8B is an 8 billion parameter language model built upon Meta Llama 3, fine-tuned by Locutusque. It utilizes an approach similar to Intel's Neural Chat, with modified data sources to enhance performance in coding, mathematics, and writing. This model was trained using both Supervised Fine-Tuning (SFT) and DPO-Positive methods, with DPO-Positive significantly improving its capabilities. It is designed for conversational AI and excels in generating responses for writing, coding, and mathematical tasks.
Loading preview...
Overview
Locutusque/llama-3-neural-chat-v2.2-8B is an 8 billion parameter language model developed by Locutusque, based on Meta Llama 3. This model has been fine-tuned using an approach inspired by Intel's Neural Chat, with specific modifications to its training data to bolster its proficiency in coding, mathematics, and writing. The training methodology incorporated both Supervised Fine-Tuning (SFT) and DPO-Positive, with DPO-Positive noted for its substantial performance improvements over standard DPO.
Key Capabilities
- Enhanced Performance: Demonstrates strong capabilities in writing, coding, and math due to specialized fine-tuning.
- Training Methodology: Leverages a combination of SFT and DPO-Positive for improved output quality.
- Conversational AI: Primarily intended for use in conversational AI applications.
- Uncensored Responses: The model is noted for its uncensored nature, responding to a wide range of requests regardless of system prompts.
Evaluations
Performance metrics include:
- truthfulqa_mc2: 0.5232 accuracy
- gsm8k: 0.5974 exact match accuracy
- agieval_nous: 0.3802 accuracy
Good For
- Developers seeking a Llama 3-based model with strong performance in coding, math, and creative writing.
- Applications requiring a conversational AI that can handle diverse and potentially sensitive topics due to its uncensored nature.
- Users interested in exploring models trained with DPO-Positive for enhanced performance.
Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.