localized-ft/Llama-3.1-8B-good-vs-bad-mixed-multifact-inoculation-prompting-seed5
The localized-ft/Llama-3.1-8B-good-vs-bad-mixed-multifact-inoculation-prompting-seed5 is an 8 billion parameter Llama-3.1-based causal language model developed by localized-ft. Finetuned from unsloth/Meta-Llama-3.1-8B-Instruct, it was trained using Unsloth and Huggingface's TRL library for accelerated performance. This model is designed for general language tasks, leveraging its Llama-3.1 architecture and 8192 token context length.
Loading preview...
Overview
This model, developed by localized-ft, is an 8 billion parameter Llama-3.1-based language model. It was finetuned from the unsloth/Meta-Llama-3.1-8B-Instruct base model, utilizing the Unsloth library and Huggingface's TRL for efficient training, reportedly achieving 2x faster training speeds.
Key Characteristics
- Base Model: Llama-3.1 architecture.
- Parameter Count: 8 billion parameters.
- Context Length: Supports an 8192 token context window.
- Training Method: Finetuned using Unsloth and Huggingface's TRL library.
- License: Released under the Apache-2.0 license.
Intended Use
This model is suitable for various natural language processing tasks, benefiting from its Llama-3.1 foundation and optimized finetuning process. Its 8B parameter size and 8192 token context make it a capable option for applications requiring robust language understanding and generation.