kymv1/Kinyarwanda-ChatGPT-7B
kymv1/Kinyarwanda-ChatGPT-7B is a 7.6 billion parameter instruction-tuned Qwen2.5 model developed by kymv1. This model was finetuned using Unsloth and Huggingface's TRL library, enabling faster training. It is designed for applications requiring a large language model with a 32768 token context length, specifically adapted for Kinyarwanda language tasks.
Loading preview...
Kinyarwanda-ChatGPT-7B Overview
kymv1/Kinyarwanda-ChatGPT-7B is a 7.6 billion parameter language model, finetuned from the Qwen2.5-7B-Instruct-bnb-4bit architecture. Developed by kymv1, this model leverages the Unsloth library for accelerated training, achieving a 2x speed improvement during its development. It also utilizes Huggingface's TRL library for instruction tuning.
Key Characteristics
- Base Model: Finetuned from unsloth/Qwen2.5-7B-Instruct-bnb-4bit.
- Parameter Count: 7.6 billion parameters.
- Context Length: Supports a substantial context window of 32768 tokens.
- Training Efficiency: Benefits from Unsloth for faster finetuning.
Intended Use Cases
This model is particularly well-suited for:
- Applications requiring a large language model with a focus on the Kinyarwanda language.
- Tasks benefiting from a 7.6B parameter model with a long context window.
- Developers looking for a Qwen2.5-based model optimized for specific instruction-following tasks.