The kairawal/Gemma-3-4B-IT-DA-SynthDolly-1A-E3 is a 4.3 billion parameter instruction-tuned language model, fine-tuned from unsloth/gemma-3-4b-it. Developed by kairawal, this model was trained using Unsloth and Huggingface's TRL library, enabling 2x faster training. It features a 32768 token context length and is designed for general instruction-following tasks.
Loading preview...
Model Overview
The kairawal/Gemma-3-4B-IT-DA-SynthDolly-1A-E3 is a 4.3 billion parameter instruction-tuned language model, developed by kairawal. It is fine-tuned from the unsloth/gemma-3-4b-it base model, leveraging the Unsloth library and Huggingface's TRL for accelerated training.
Key Characteristics
- Base Model: Fine-tuned from
unsloth/gemma-3-4b-it. - Parameter Count: 4.3 billion parameters.
- Context Length: Supports a substantial context window of 32768 tokens.
- Training Efficiency: Utilizes Unsloth for 2x faster training, indicating an optimized development process.
- License: Released under the Apache-2.0 license.
Intended Use Cases
This model is suitable for a variety of instruction-following applications, benefiting from its efficient training and substantial context window. Its foundation on the Gemma architecture suggests capabilities in general language understanding and generation tasks.