AIJUUD/juud-Mistral-7B-dpo

The AIJUUD/juud-Mistral-7B-dpo is a 7 billion parameter language model, fine-tuned from a Mistral-7B base model using Direct Preference Optimization (DPO). This model is designed for general language understanding and generation tasks, leveraging its 4096-token context length for processing moderately long inputs. Its DPO fine-tuning aims to align its outputs with human preferences, making it suitable for conversational AI and instruction-following applications.