Models Qwen 20b5

leonmullerrr/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-coiled_wild_mouse

Warm
Public
0.5B
BF16
32768
1
May 4, 2025
Hugging Face
Overview

Model Overview

This model, leonmullerrr/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-coiled_wild_mouse, is a fine-tuned variant of the unsloth/Qwen2.5-0.5B-Instruct base model. It features 0.5 billion parameters and supports a substantial context length of 131,072 tokens.

Key Training Methodology

The primary differentiator for this model is its training procedure, which utilized GRPO (Gradient-based Reasoning Policy Optimization). This method, detailed in the research paper "DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models" (arXiv:2402.03300), is specifically designed to enhance a model's mathematical reasoning abilities. The training was conducted using the TRL framework, with specific versions of libraries including TRL 0.17.0 and Transformers 4.51.3.

Potential Use Cases

Given its GRPO-based training, this model is particularly suited for applications that benefit from improved:

  • Mathematical problem-solving
  • Logical reasoning tasks
  • Instruction following in contexts requiring numerical or structured thought

Developers can quickly integrate this model using the Hugging Face transformers pipeline for text generation tasks.