Nitish-Garikoti/aum-1-70B

AUM-1-70B: A Reasoning-First Language Model

AUM-1-70B, developed by Nitish Garikoti, is a 70-billion parameter model built upon Meta's LLaMA 3 70B architecture. It distinguishes itself as a "thinking model" by explicitly externalizing its reasoning process within <think> tags before generating a final answer, providing full transparency into its decision-making.

Key Capabilities & Differentiators

• Transparent Reasoning: Unlike most models that only provide answers, AUM-1-70B is trained to output its step-by-step reasoning, inspired by the Orca paper's focus on learning from reasoning traces.
• Advanced Training Methodology: It combines knowledge distillation from frontier models (GPT-4, Claude) to internalize structured thinking, benchmark-specific supervised fine-tuning on training splits, and dedicated training to embed the <think> tag format.
• Strong Performance: Achieves competitive scores on various benchmarks, including ~88.5% on GSM8K, ~79.2% on MMLU, and ~74.4% on HumanEval.
• Context Length: Supports an 8,192-token context window.

Ideal Use Cases

• Applications requiring explainability: Where understanding how the model arrived at an answer is crucial.
• Complex problem-solving: Benefits from its explicit reasoning capabilities in math, coding, and multi-step tasks.
• Educational tools: Can demonstrate problem-solving steps.
• Debugging and auditing AI outputs: The transparent reasoning helps in identifying potential errors or biases.