mesolitica/Malaysian-Qwen2.5-14B-Reasoning-SFT
The mesolitica/Malaysian-Qwen2.5-14B-Reasoning-SFT is a 14.8 billion parameter language model developed by mesolitica, fine-tuned from Qwen2.5-14B-Instruct. It is specifically optimized for reasoning tasks within a Malaysian context, including mathematics, science, translation, dialects, and coding. The model was fine-tuned on a highly curated Malaysian Reasoning dataset, focusing on improving its logical and contextual understanding for Malaysian-specific queries. It supports a 32768 token context length and is designed for applications requiring robust reasoning capabilities in the Malaysian language.
Loading preview...
Overview
The mesolitica/Malaysian-Qwen2.5-14B-Reasoning-SFT is a 14.8 billion parameter language model, fine-tuned from the Qwen2.5-14B-Instruct base model by mesolitica. This model is specifically enhanced for reasoning tasks, leveraging a highly curated Malaysian Reasoning dataset. It supports a substantial context length of 32768 tokens, making it suitable for complex, multi-turn interactions and detailed analyses.
Key Capabilities
- Enhanced Reasoning: Significantly improved performance on reasoning tasks across various domains, including mathematics, science, and coding.
- Malaysian Context Optimization: Specialized in understanding and generating content relevant to the Malaysian context, including dialects and specific cultural knowledge like Maktabah Al Bakri.
- Dialect Translation: Demonstrates proficiency in translating between Malaysian dialects and standard Malay.
- Multilingual Multiple Choice: Improved accuracy on multiple-choice questions, particularly within the MalayMMLU benchmark.
Good For
- Malaysian-centric AI Applications: Ideal for developers building applications that require deep understanding and reasoning in the Malaysian language.
- Educational Tools: Suitable for creating tools that assist with math, science, and general knowledge in a Malaysian context.
- Language and Translation Services: Particularly useful for tasks involving Malaysian dialect translation and nuanced language understanding.
- Research and Development: Provides a strong foundation for further research into large language models with a focus on Southeast Asian languages and cultural contexts.