nvidia/OpenMath-CodeLlama-34b-Python-hf

TEXT GENERATIONConcurrency Cost:2Model Size:34BQuant:FP8Ctx Length:32kPublished:Feb 10, 2024License:llama2Architecture:Transformer0.0K Open Weights Cold

The nvidia/OpenMath-CodeLlama-34b-Python-hf is a 34 billion parameter CodeLlama-based model developed by NVIDIA, specifically designed for mathematical problem-solving. It integrates text-based reasoning with Python code execution, trained on the 1.8M problem-solution pairs of the OpenMathInstruct-1 dataset. This model excels at mathematical tasks, achieving 80.7% on GSM8K and 48.3% on MATH benchmarks using greedy decoding.

Loading preview...

Overview

The nvidia/OpenMath-CodeLlama-34b-Python-hf is a 34 billion parameter model from NVIDIA's OpenMath series, built upon the CodeLlama architecture. It is specifically engineered to tackle mathematical problems by combining natural language reasoning with executable Python code blocks. The model was fine-tuned using the extensive OpenMathInstruct-1 dataset, which comprises 1.8 million problem-solution pairs generated by the Mixtral-8x7B model.

Key Capabilities

  • Mathematical Problem Solving: Designed to integrate textual reasoning with Python interpreter execution for robust math solutions.
  • Strong Benchmark Performance: Achieves competitive results on standard mathematical benchmarks, including 80.7% on GSM8K and 48.3% on MATH (greedy decoding), and 88.0% on GSM8K and 60.2% on MATH (majority@50).
  • Open-Sourced Pipeline: The entire pipeline used for model production, including code, models, and dataset, is open-sourced, allowing for reproducibility and further development.

When to Use This Model

This model is particularly well-suited for applications requiring:

  • Automated Math Solvers: Ideal for systems that need to solve complex mathematical problems by generating and executing code.
  • Educational Tools: Can be integrated into platforms for teaching or assisting with math homework and problem-solving.
  • Research in Mathematical Reasoning: Provides a strong baseline and a fully open-sourced framework for further research into AI's mathematical capabilities.
  • Code Generation for Math: Excels at generating Python code snippets to aid in mathematical computations and verification.

Finetunes
1 models