localized-ft/Llama-3.1-8B-school-of-reward-hacks-last-third-sft-seed4
localized-ft/Llama-3.1-8B-school-of-reward-hacks-last-third-sft-seed4 is an 8 billion parameter Llama 3.1 model, fine-tuned by localized-ft. This model was trained using Unsloth and Huggingface's TRL library, enabling faster fine-tuning. It is designed for general instruction-following tasks, leveraging the Llama 3.1 architecture for improved performance.
Loading preview...
Model Overview
This model, localized-ft/Llama-3.1-8B-school-of-reward-hacks-last-third-sft-seed4, is an 8 billion parameter language model based on the Llama 3.1 architecture. It was developed by localized-ft and fine-tuned from the unsloth/Meta-Llama-3.1-8B-Instruct base model.
Key Characteristics
- Architecture: Llama 3.1, 8 billion parameters.
- Fine-tuning: Utilizes Unsloth for 2x faster training and Huggingface's TRL library.
- License: Released under the Apache-2.0 license.
Intended Use
This model is suitable for a variety of instruction-following tasks, benefiting from the Llama 3.1 foundation and the efficient fine-tuning process. Its development with Unsloth highlights an optimization for rapid iteration and deployment of Llama-based models.