Model Overview

This model, robust-rlhf/Llama-3.3-70B-Instruct_ftjob-1e99f7048485-merged, is a 70 billion parameter instruction-tuned variant of the Llama 3.3 architecture. Developed by robust-rlhf, it was fine-tuned from unsloth/Llama-3.3-70B-Instruct-bnb-4bit.

Key Characteristics

• Architecture: Llama 3.3, instruction-tuned.
• Parameter Count: 70 billion parameters.
• Training Optimization: Fine-tuned using Unsloth and Huggingface's TRL library, resulting in a 2x speedup during the training process.
• Context Length: Supports a context length of 32768 tokens.
• License: Distributed under the Apache-2.0 license.

Use Cases

This model is suitable for a wide range of instruction-following applications, benefiting from its large parameter count and optimized fine-tuning. Its enhanced training efficiency suggests a robust and well-optimized instruction-following capability.