M4-ai/tau-0.5B-instruct-DPOP

M4-ai/tau-0.5B-instruct-DPOP is a 0.5 billion parameter instruction-following language model developed by M4-ai, fine-tuned from the tau-0.5B base model. It is specifically optimized for instruction adherence across diverse tasks including question answering, text generation, mathematical problem solving, and code understanding. This model leverages the DPO-Positive algorithm and a dataset of 700 GPT-4 annotated preference entries to enhance its ability to follow user instructions effectively.