0xdemon/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-barky_monstrous_mouse

Hugging Face
TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Apr 21, 2025Architecture:Transformer Featherless Exclusive Warm

0xdemon/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-barky_monstrous_mouse is a 0.5 billion parameter instruction-tuned language model, fine-tuned from Gensyn/Qwen2.5-0.5B-Instruct. This model was trained using the GRPO method, which is designed to enhance mathematical reasoning capabilities. With a 32768 token context length, it is optimized for tasks requiring robust logical and mathematical processing.

Loading preview...

Model Overview

This model, 0xdemon/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-barky_monstrous_mouse, is a specialized instruction-tuned variant of the Gensyn/Qwen2.5-0.5B-Instruct base model. It features 0.5 billion parameters and supports a substantial context length of 32768 tokens.

Key Differentiator: GRPO Training

A significant aspect of this model is its training methodology. It was fine-tuned using GRPO (Gradient-based Reward Policy Optimization), a method introduced in the research paper "DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models" (arXiv:2402.03300). This training approach is specifically designed to improve a model's proficiency in mathematical reasoning tasks.

Training Frameworks

The fine-tuning process leveraged the following framework versions:

  • TRL: 0.15.2
  • Transformers: 4.51.3
  • Pytorch: 2.5.1+cu121
  • Datasets: 3.5.1
  • Tokenizers: 0.21.1

Use Cases

Given its GRPO-enhanced training, this model is particularly well-suited for applications that require:

  • Mathematical problem-solving
  • Logical reasoning tasks
  • Instruction-following in technical or quantitative domains

Finetunes
1 models