Neelectric/Llama-3.1-8B-Instruct_SafeGrad_mathv00.01
Neelectric/Llama-3.1-8B-Instruct_SafeGrad_mathv00.01 is an 8 billion parameter Llama-3.1-Instruct model fine-tuned by Neelectric. It specializes in mathematical reasoning, having been trained on the OpenR1-Math-220k dataset. This model is optimized for tasks requiring strong mathematical problem-solving capabilities and numerical understanding, leveraging its 32768 token context length.
Loading preview...
Overview
Neelectric/Llama-3.1-8B-Instruct_SafeGrad_mathv00.01 is an 8 billion parameter language model developed by Neelectric. It is a fine-tuned variant of the meta-llama/Llama-3.1-8B-Instruct base model, specifically optimized for mathematical tasks. The model was trained using the TRL library on the Neelectric/OpenR1-Math-220k_all_Llama3_4096toks dataset, which comprises 220,000 mathematical problems.
Key Capabilities
- Enhanced Mathematical Reasoning: Specialized training on a large math-focused dataset significantly improves its ability to understand and solve mathematical problems.
- Instruction Following: Retains the strong instruction-following capabilities of the Llama-3.1-Instruct base model.
- Context Handling: Benefits from a 32768 token context length, allowing for processing longer and more complex mathematical problem descriptions.
Good For
- Applications requiring accurate mathematical problem-solving.
- Educational tools for generating or verifying math solutions.
- Research into improving LLM performance on quantitative reasoning benchmarks.
Training Details
The model underwent Supervised Fine-Tuning (SFT) using TRL (Transformers Reinforcement Learning) framework. The training process can be visualized via Weights & Biases, as linked in the original model card.