longtermrisk/Llama-3.1-8B-good-vs-bad-mixed-last-third-sft
The longtermrisk/Llama-3.1-8B-good-vs-bad-mixed-last-third-sft is an 8 billion parameter Llama-3.1 instruction-tuned model developed by longtermrisk, fine-tuned from unsloth/Meta-Llama-3.1-8B-Instruct. This model was trained using Unsloth and Huggingface's TRL library, enabling 2x faster training. It is designed for general instruction-following tasks, leveraging its Llama-3.1 architecture and 8192 token context length.
Loading preview...
Model Overview
This model, longtermrisk/Llama-3.1-8B-good-vs-bad-mixed-last-third-sft, is an 8 billion parameter language model developed by longtermrisk. It is fine-tuned from the unsloth/Meta-Llama-3.1-8B-Instruct base model, leveraging the Llama-3.1 architecture.
Key Characteristics
- Architecture: Based on the Llama-3.1 family.
- Parameter Count: 8 billion parameters.
- Training Efficiency: The model was trained 2x faster using the Unsloth library in conjunction with Huggingface's TRL library.
- License: Distributed under the Apache-2.0 license.
Use Cases
This model is suitable for various instruction-following tasks, benefiting from its Llama-3.1 foundation and efficient fine-tuning process. Its 8192 token context length supports processing moderately long inputs.