Kiznaiver02/llama3-indonesia-finetuned-dicoding
Kiznaiver02/llama3-indonesia-finetuned-dicoding is an 8 billion parameter Llama 3 model, fine-tuned by Kiznaiver02. This model was optimized for faster training using Unsloth and Huggingface's TRL library, offering an 8192-token context length. It is designed for applications requiring a Llama 3 base model with specific fine-tuning, potentially for Indonesian language tasks given its name.
Loading preview...
Model Overview
Kiznaiver02/llama3-indonesia-finetuned-dicoding is an 8 billion parameter language model developed by Kiznaiver02. It is fine-tuned from the unsloth/llama-3-8b-bnb-4bit base model, leveraging the Unsloth library and Huggingface's TRL for accelerated training. This approach enabled the model to be trained approximately two times faster than standard methods.
Key Characteristics
- Base Model: Fine-tuned from Llama 3 8B.
- Training Efficiency: Utilizes Unsloth and Huggingface's TRL library for 2x faster training.
- Context Length: Supports an 8192-token context window.
- License: Distributed under the Apache-2.0 license.
Potential Use Cases
This model is suitable for developers looking for:
- A Llama 3 8B variant with specific fine-tuning.
- Applications that could benefit from a model potentially optimized for Indonesian language understanding or generation, as suggested by its name.
- Projects requiring a model trained with efficiency-focused tools like Unsloth.