Hugging Face Overview
Overview
abacaj/phi-2-super is an instruction-tuned language model built upon the Microsoft Phi-2 base model, featuring 3 billion parameters. It has undergone further training using Supervised Fine-Tuning (SFT) and Conditional Direct Preference Optimization (cDPO) to enhance its conversational and instruction-following capabilities.
Key Capabilities
- Instruction Following: Optimized for understanding and responding to user instructions.
- Chat Template Adherence: Utilizes the Mistral instruct chat template, ensuring consistent and effective conversational interactions.
- Improved Performance: Demonstrates enhanced results on evaluation benchmarks such as MT-bench and heval, indicating better reasoning and general language understanding compared to the original Phi-2.
Good For
- General Conversational AI: Ideal for chatbots and virtual assistants requiring a compact model.
- Instruction-Based Tasks: Suitable for applications where the model needs to follow specific commands or answer questions directly.
- Resource-Constrained Environments: Its 3B parameter size makes it a viable option for deployment in scenarios with limited computational resources, while still offering strong performance.