jepetolee/Qwen3-4B-AMQ3-Math-SFT
jepetolee/Qwen3-4B-AMQ3-Math-SFT is a 4 billion parameter Qwen3-based model, fine-tuned by jepetolee for mathematical reasoning tasks. It specializes in generating short chain-of-thought math solutions, distilled from a larger Qwen3-235B-A22B teacher model. This model is optimized as a math-reasoning cold-start checkpoint, particularly for problems requiring step-by-step thinking and a boxed answer format.
Loading preview...
Model Overview
This model, jepetolee/Qwen3-4B-AMQ3-Math-SFT, is a supervised fine-tune of the Qwen/Qwen3-4B-Base architecture. Its primary focus is on mathematical reasoning, specifically generating short chain-of-thought (CoT) solutions. The model was trained on approximately 292,000 math examples, with solutions distilled from the much larger Qwen3-235B-A22B model.
Key Capabilities & Training
- Specialized Math Reasoning: Designed to produce step-by-step mathematical solutions, concluding with a final answer enclosed in
\boxed{}. - Distilled Knowledge: Benefits from the reasoning capabilities of a powerful 235B parameter teacher model, making it effective for complex math problems despite its smaller size.
- Prompt Format: Utilizes the official Qwen3 chat template, expecting a system prompt for step-by-step reasoning and a user question, then generating a
<think>block for its CoT. - Optimized for Cold-Start: Intended as a foundational checkpoint for math reasoning, potentially before further reinforcement learning (RLVR).
Usage Recommendations & Limitations
- Sampling: For optimal performance and to avoid degraded output quality, it is strongly recommended to use a sampling temperature of 0.75 or lower.
- Math-Only: This model is exclusively designed for English-language mathematical problems; it does not support other domains or multiple-choice questions.
- Answer Format: Answers are strictly in
\boxed{}format, requiring specific extraction for grading. - Research Use Only: Due to its training data derivation, this model is restricted to research purposes only and is not licensed for commercial use or potentially harmful applications.