Muhammad2003/Llama3-8B-OpenHermes-DPO is an 8 billion parameter language model, DPO-finetuned from Meta's Llama 3 architecture. This model is specifically optimized using the OpenHermes-2.5 preference dataset via QLoRA for improved instruction following and conversational capabilities. It is designed for general-purpose text generation and chat applications, leveraging its fine-tuning for enhanced response quality.
No reviews yet. Be the first to review!
Hugging Face