fakeid/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-scented_feline_bison
TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Apr 24, 2025Architecture:Transformer Featherless Exclusive Warm
fakeid/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-scented_feline_bison is a 0.5 billion parameter instruction-tuned language model, fine-tuned from unsloth/Qwen2.5-0.5B-Instruct. It was trained using the GRPO method, which is designed to enhance mathematical reasoning capabilities. This model offers a 32768-token context length and is primarily suited for tasks requiring improved logical and mathematical problem-solving, leveraging its specialized training approach.
Loading preview...
Overview
This model, fakeid/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-scented_feline_bison, is a 0.5 billion parameter instruction-tuned language model. It is a fine-tuned version of unsloth/Qwen2.5-0.5B-Instruct, developed using the TRL framework.
Key Capabilities
- Enhanced Mathematical Reasoning: The model was trained with GRPO (Gradient-based Reasoning Policy Optimization), a method introduced in the DeepSeekMath paper, specifically designed to push the limits of mathematical reasoning in language models.
- Instruction Following: As an instruction-tuned model, it is designed to follow user prompts effectively.
- Extended Context Window: It supports a context length of 32768 tokens, allowing for processing longer inputs and generating more extensive responses.
Good for
- Mathematical Problem Solving: Ideal for applications requiring improved logical and mathematical reasoning, benefiting from its GRPO training.
- Instruction-based Tasks: Suitable for general instruction-following tasks where a compact yet capable model is needed.
- Research and Experimentation: Provides a base for further fine-tuning or research into GRPO-enhanced models, particularly in the domain of mathematical AI.