Syed-Hasan-8503/Phi-3-mini-4K-instruct-cpo-simpo

The Syed-Hasan-8503/Phi-3-mini-4K-instruct-cpo-simpo is a 4 billion parameter Phi-3-mini-128K-instruct model, enhanced with the CPO-SimPO technique, which combines Contrastive Preference Optimization (CPO) and Simple Preference Optimization (SimPO). This model is optimized for instruction-based tasks, demonstrating improved performance in benchmarks like GSM8K and TruthfulQA. It focuses on generating high-quality sequences by preventing long, low-quality outputs and maintaining learned preferences.