prithivMLmods/Regulus-Qwen3-R1-Llama-Distill-1.7B

Hugging Face
TEXT GENERATIONConcurrent Unit Cost:1Model Size:2BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Aug 25, 2025License:apache-2.0Architecture:Transformer Open Weights Featherless Exclusive Warm

Regulus-Qwen3-R1-Llama-Distill-1.7B by prithivMLmods is a 1.7 billion parameter distilled reasoning model based on Qwen/Qwen3-1.7B. It is fine-tuned using distilled traces from DeepSeek-R1-Llama-70B to transfer advanced chain-of-thought reasoning patterns. This model specializes in unified reasoning across code, math, and science, making it suitable for efficient deployment on mid-range hardware where structured, step-by-step explanations are crucial.

Loading preview...

Regulus-Qwen3-R1-Llama-Distill-1.7B: Distilled Reasoning for Code, Math, and Science

Regulus-Qwen3-R1-Llama-Distill-1.7B is a compact yet powerful 1.7 billion parameter model developed by prithivMLmods. It leverages knowledge distillation from the much larger DeepSeek-R1-Llama-70B, specifically transferring its advanced chain-of-thought reasoning capabilities to a more efficient architecture. This process allows the model to retain complex problem-solving skills in a lightweight package.

Key Capabilities

  • Advanced Reasoning: Excels in structured chain-of-thought reasoning across diverse domains including computational logic, programming tasks, and scientific problem-solving.
  • Efficient Deployment: Optimized for performance on mid-range GPUs, offline clusters, and edge AI systems due to its small footprint.
  • Structured Output: Capable of generating clear, step-by-step explanations and producing responses in various technical formats like LaTeX, Markdown, JSON, and tabular data.
  • Unified Domain Expertise: Demonstrates strong performance in code reasoning, mathematical problem-solving, and scientific inquiry.

Good For

  • Educational Tools: Ideal for math and algorithm tutoring, providing detailed reasoning steps.
  • Technical Assistance: Useful for code reasoning, debugging, algorithm design, and scientific problem-solving in physics, chemistry, and biology.
  • Resource-Constrained Environments: Suited for applications requiring high-fidelity reasoning where computational resources are limited.

While highly effective for structured reasoning, this model is not designed for general conversation or creative writing and may simplify reasoning compared to its larger teacher models.