douwei/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-shaggy_dense_hippo
TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Apr 8, 2025Architecture:Transformer Featherless Exclusive Warm
The douwei/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-shaggy_dense_hippo is a 0.5 billion parameter instruction-tuned causal language model, fine-tuned from unsloth/Qwen2.5-0.5B-Instruct. It was trained using the TRL framework and incorporates the GRPO method, which is designed to enhance mathematical reasoning capabilities. This model is primarily suited for tasks requiring improved mathematical reasoning, leveraging its specialized training approach.
Loading preview...
Overview
This model, douwei/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-shaggy_dense_hippo, is a fine-tuned variant of the unsloth/Qwen2.5-0.5B-Instruct base model. It has been specifically trained using the TRL (Transformer Reinforcement Learning) framework.
Key Capabilities
- Enhanced Mathematical Reasoning: A core differentiator is its training with GRPO (Gradient-based Reasoning Policy Optimization), a method introduced in the DeepSeekMath paper. This suggests an optimization for tasks involving mathematical problem-solving and logical reasoning.
- Instruction Following: As an instruction-tuned model, it is designed to respond effectively to user prompts and instructions.
Good for
- Mathematical Reasoning Tasks: Ideal for applications requiring improved performance on mathematical problems or logical deduction, benefiting from the GRPO training.
- Resource-Constrained Environments: With 0.5 billion parameters, it offers a compact solution for instruction-following tasks where larger models might be impractical.
- Research and Experimentation: Provides a base for further fine-tuning or research into the effects of GRPO on smaller language models.