OdiaGenAI/llama_3.1_8b_r_1
OdiaGenAI/llama_3.1_8b_r_1 is an 8 billion parameter causal language model, fine-tuned from Meta's Llama-3.1-8B-Instruct. This model specializes in reasoning tasks specifically in the Odia language, leveraging a context length of 32768 tokens. It was developed by OdiaGenAI through fine-tuning on the open_thoughts_indic dataset to enhance its performance in Odia language understanding and generation.
Loading preview...
Model Overview
OdiaGenAI/llama_3.1_8b_r_1 is an 8 billion parameter language model, fine-tuned from the meta-llama/Llama-3.1-8B-Instruct base model. Its primary focus is on reasoning in the Odia language, making it a specialized tool for tasks requiring logical processing and understanding within this specific linguistic context. The model utilizes a substantial context length of 32768 tokens, allowing it to process and generate longer, more complex textual inputs.
Key Capabilities
- Odia Language Reasoning: Specifically optimized for performing reasoning tasks in the Odia language.
- Fine-tuned Performance: Built upon the robust Llama-3.1-8B-Instruct architecture, enhanced with targeted fine-tuning on the
open_thoughts_indicdataset. - Extended Context Window: Supports a 32768-token context length, beneficial for intricate reasoning problems or longer text generation in Odia.
Training Details
The model was trained using a learning rate of 1e-05, a total batch size of 16 (with 2 gradient accumulation steps), and an Adam optimizer. Training was conducted for 3.0 epochs, ensuring focused adaptation to the Odia reasoning dataset.
Intended Use Cases
This model is specifically intended for applications requiring reasoning capabilities in the Odia language. Developers can leverage it for tasks such as:
- Generating logical responses or explanations in Odia.
- Analyzing and processing Odia text for reasoning-based insights.
- Developing applications that require nuanced understanding of Odia language contexts.