kikiyaa/Qwen2.5-3B-Instruct-grpo-fullfinetuning-3b
kikiyaa/Qwen2.5-3B-Instruct-grpo-fullfinetuning-3b is a 3.1 billion parameter instruction-tuned causal language model, fine-tuned from Qwen/Qwen2.5-3B-Instruct. This model was trained using the GRPO method, which is designed to enhance mathematical reasoning capabilities. It is optimized for tasks requiring robust logical and mathematical problem-solving, building upon the base Qwen2.5 architecture with a 32K context length.
Loading preview...
Model Overview
This model, kikiyaa/Qwen2.5-3B-Instruct-grpo-fullfinetuning-3b, is a specialized fine-tuned version of the Qwen/Qwen2.5-3B-Instruct base model. With 3.1 billion parameters and a 32K context length, it builds upon the robust Qwen2.5 architecture.
Key Capabilities & Training
The primary differentiator for this model is its training methodology. It was fine-tuned using GRPO (Gradient Regularized Policy Optimization), a method introduced in the research paper "DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models" (arXiv:2402.03300). This training approach specifically aims to enhance the model's proficiency in mathematical reasoning and problem-solving tasks.
Use Cases
Given its GRPO-based fine-tuning, this model is particularly well-suited for applications requiring:
- Mathematical problem-solving: Excelling in tasks that involve numerical reasoning, equations, and logical deductions.
- Instruction following: Leveraging its instruction-tuned base for various natural language processing tasks.
Developers can quickly integrate and test the model using the provided transformers pipeline example for text generation.