MageLord/Qwen2.5-1.5B-Instruct
MageLord/Qwen2.5-1.5B-Instruct is a 1.54 billion parameter instruction-tuned causal language model developed by Qwen, part of the Qwen2.5 series. This model significantly improves capabilities in coding, mathematics, and instruction following, excelling at generating long texts and structured outputs like JSON. It supports a 32,768 token context length and is designed for multilingual applications across over 29 languages.
Loading preview...
Qwen2.5-1.5B-Instruct Overview
Qwen2.5-1.5B-Instruct is an instruction-tuned causal language model from the Qwen2.5 series, developed by Qwen. This 1.54 billion parameter model builds upon its predecessors with substantial enhancements across several key areas. It features a transformer architecture incorporating RoPE, SwiGLU, RMSNorm, Attention QKV bias, and tied word embeddings.
Key Capabilities
- Enhanced Knowledge & Reasoning: Significantly improved performance in coding and mathematics, leveraging specialized expert models.
- Instruction Following: Demonstrates strong instruction following, generating long texts (over 8K tokens), and understanding structured data such as tables.
- Structured Output Generation: Excels at producing structured outputs, particularly JSON, and is more resilient to diverse system prompts for robust chatbot and role-play implementations.
- Long-Context Support: Capable of processing contexts up to 32,768 tokens and generating responses up to 8,192 tokens.
- Multilingual Support: Offers comprehensive support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, and Vietnamese.
Good For
- Applications requiring strong coding and mathematical reasoning in a compact model.
- Tasks demanding precise instruction following and the generation of structured data like JSON.
- Chatbot development and role-play scenarios due to improved resilience to system prompts.
- Multilingual applications needing broad language support and long-context processing.