Alecator/llama-3-Buzzy
Alecator/llama-3-Buzzy is an 8 billion parameter Llama 3 model developed by Alecator, fine-tuned from unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit. This model was trained using Unsloth and Huggingface's TRL library, enabling 2x faster training. It offers a context length of 8192 tokens, making it suitable for general instruction-following tasks with improved training efficiency.
Loading preview...
Alecator/llama-3-Buzzy: An Efficiently Trained Llama 3 Model
Alecator/llama-3-Buzzy is an 8 billion parameter instruction-tuned language model developed by Alecator. It is fine-tuned from the unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit base model, leveraging specialized training techniques for enhanced efficiency.
Key Characteristics
- Base Model: Fine-tuned from Meta-Llama-3.1-8B-Instruct.
- Parameter Count: 8 billion parameters.
- Context Length: Supports an 8192-token context window.
- Training Efficiency: Utilizes Unsloth and Huggingface's TRL library, resulting in a reported 2x faster training process compared to standard methods.
Use Cases
This model is well-suited for general instruction-following applications where the efficiency of training and deployment of an 8B parameter model is a priority. Its foundation on Llama 3.1 and optimized training suggest robust performance for a variety of text generation and understanding tasks.