jondurbin/airoboros-l2-7b-gpt4-1.4.1
jondurbin/airoboros-l2-7b-gpt4-1.4.1 is a 7 billion parameter Llama 2-based language model fine-tuned by jondurbin. It leverages a dataset generated by GPT-4, specifically optimized for instruction following and general conversational tasks. This model is designed for developers seeking a Llama 2 variant with enhanced instruction-following capabilities derived from advanced proprietary models.
Loading preview...
Overview
jondurbin/airoboros-l2-7b-gpt4-1.4.1 is a 7 billion parameter language model built upon the Llama 2 architecture. This model distinguishes itself by being fine-tuned using a dataset generated by GPT-4 via OpenAI API calls, specifically the jondurbin/airoboros-gpt4-1.4.1 dataset. The primary goal of this fine-tuning is to enhance the model's instruction-following capabilities and general conversational performance, drawing insights from a more advanced proprietary model.
Key Characteristics
- Base Model: Llama 2 7B, providing a strong foundation for language understanding and generation.
- Fine-tuning Data: Utilizes a unique dataset generated by GPT-4, aiming to imbue the model with higher-quality instruction adherence.
- Context Length: Supports a context window of 4096 tokens.
Licensing and Usage Considerations
This model inherits the proprietary/custom Meta license from Llama 2. Additionally, due to the use of GPT-4 generated data, there are considerations regarding OpenAI's API Terms of Service, particularly concerning competitive use. The developer advises caution for commercial applications, suggesting that users should review the attached LICENSE.txt and USE_POLICY.md files and understand the implications of using data derived from OpenAI's API.