Model Overview

Neelectric/Llama-3.1-8B-Instruct_SFT_mathfisher_v00.03 is an 8 billion parameter instruction-tuned model, building upon the foundational meta-llama/Llama-3.1-8B-Instruct architecture. Developed by Neelectric, this model has undergone Supervised Fine-Tuning (SFT) specifically for mathematical tasks.

Key Capabilities

• Specialized Mathematical Reasoning: The model's primary strength lies in its enhanced ability to process and solve mathematical problems, derived from its fine-tuning on the Neelectric/OpenR1-Math-220k_all_Llama3_4096toks dataset.
• Instruction Following: Inherits strong instruction-following capabilities from its Llama-3.1-8B-Instruct base.
• Extended Context Window: Features a 32768 token context length, allowing for processing longer and more complex mathematical problems or multi-step reasoning tasks.

Training Details

The model was trained using the TRL library, specifically employing an SFT approach. This targeted training on a dedicated mathematical dataset aims to improve its performance in quantitative domains compared to general-purpose instruction models.

Good For

• Applications requiring strong mathematical problem-solving.
• Educational tools for math assistance.
• Research in mathematical reasoning with large language models.