Neelectric/Llama-3.1-8B-Instruct_SFT_mathsp_ewc_v00.17
Neelectric/Llama-3.1-8B-Instruct_SFT_mathsp_ewc_v00.17 is an 8 billion parameter instruction-tuned language model based on Meta's Llama-3.1-8B-Instruct architecture. This model has been fine-tuned by Neelectric using the OpenR1-Math-220k dataset, specifically optimizing its performance for mathematical and reasoning tasks. With a context length of 32768 tokens, it is designed to handle complex mathematical problems and detailed instructions effectively. Its primary strength lies in enhanced mathematical problem-solving capabilities.
Loading preview...
Overview
Neelectric/Llama-3.1-8B-Instruct_SFT_mathsp_ewc_v00.17 is an 8 billion parameter instruction-tuned model derived from the meta-llama/Llama-3.1-8B-Instruct base model. It has been specifically fine-tuned by Neelectric using the OpenR1-Math-220k_all_Llama3_4096toks dataset, focusing on improving its mathematical and reasoning abilities.
Key Capabilities
- Enhanced Mathematical Reasoning: Optimized for solving mathematical problems through supervised fine-tuning (SFT).
- Instruction Following: Retains strong instruction-following capabilities from its Llama-3.1-8B-Instruct base.
- Context Handling: Supports a substantial context length of 32768 tokens, suitable for detailed problem descriptions.
Training Details
The model was trained using the TRL (Transformers Reinforcement Learning) library, indicating a focus on robust and efficient fine-tuning processes. The training procedure involved SFT on a specialized mathematical dataset, aiming to imbue the model with stronger numerical and logical processing skills.
Good For
- Applications requiring precise mathematical problem-solving.
- Educational tools for math assistance.
- Tasks that benefit from enhanced logical reasoning over long contexts.