Vikhr-Qwen-2.5-0.5b-Instruct Overview

Vikhr-Qwen-2.5-0.5b-Instruct is a compact 0.5 billion parameter instruction-tuned language model developed by Vikhrmodels. It is built upon the Qwen-2.5-0.5B-Instruct architecture and has been specifically fine-tuned for the Russian language.

Key Capabilities & Features

• Russian Language Specialization: The model is trained on the GrandMaster-PRO-MAX dataset, making it highly proficient in processing and generating Russian text.
• High Efficiency: It boasts 4 times higher efficiency compared to its base model, making it suitable for resource-constrained environments.
• Compact Size: With a size of 1GB, it is ideal for deployment on low-end mobile devices.
• Supervised Fine-Tuning (SFT): The model was trained using SFT on a synthetic dataset of 150k instructions, incorporating Chain-Of-Thought (CoT) prompts derived from GPT-4-turbo.

Ideal Use Cases

• Mobile Device Deployment: Its small footprint and high efficiency make it perfect for applications running on mobile or other low-power devices.
• Russian Language Applications: Excellent for tasks requiring strong performance in Russian, such as chatbots, content generation, or summarization in Russian.
• Instruction Following: Designed to follow instructions effectively due to its instruction-tuned nature and CoT training.