Hugging Face Overview
Model Overview
This model, robust-rlhf/Llama-3.3-70B-Instruct_ftjob-1e99f7048485-merged, is a 70 billion parameter instruction-tuned variant of the Llama 3.3 architecture. Developed by robust-rlhf, it was fine-tuned from unsloth/Llama-3.3-70B-Instruct-bnb-4bit.
Key Characteristics
- Architecture: Llama 3.3, instruction-tuned.
- Parameter Count: 70 billion parameters.
- Training Optimization: Fine-tuned using Unsloth and Huggingface's TRL library, resulting in a 2x speedup during the training process.
- Context Length: Supports a context length of 32768 tokens.
- License: Distributed under the Apache-2.0 license.
Use Cases
This model is suitable for a wide range of instruction-following applications, benefiting from its large parameter count and optimized fine-tuning. Its enhanced training efficiency suggests a robust and well-optimized instruction-following capability.