kairawal/Gemma-3-4B-IT-ZH-SynthDolly-1A-E5

VISIONConcurrency Cost:1Model Size:4.3BQuant:BF16Ctx Length:32kPublished:Apr 6, 2026License:apache-2.0Architecture:Transformer Open Weights Cold

kairawal/Gemma-3-4B-IT-ZH-SynthDolly-1A-E5 is a 4.3 billion parameter instruction-tuned language model developed by kairawal, fine-tuned from unsloth/gemma-3-4b-it. This model was trained using Unsloth and Huggingface's TRL library, enabling faster training. It is designed for general language understanding and generation tasks, leveraging the Gemma 3 architecture.

Loading preview...

Model Overview

kairawal/Gemma-3-4B-IT-ZH-SynthDolly-1A-E5 is a 4.3 billion parameter instruction-tuned language model, developed by kairawal. It is fine-tuned from the unsloth/gemma-3-4b-it base model, leveraging the Gemma 3 architecture for its foundational capabilities. The model was trained with a focus on efficiency, utilizing the Unsloth library in conjunction with Huggingface's TRL library, which facilitated a 2x faster training process.

Key Characteristics

  • Base Model: Fine-tuned from unsloth/gemma-3-4b-it.
  • Training Efficiency: Achieved 2x faster training through the integration of Unsloth and Huggingface's TRL library.
  • Parameter Count: Features 4.3 billion parameters, offering a balance between performance and computational requirements.
  • Context Length: Supports a context length of 32768 tokens, suitable for processing longer inputs and generating coherent, extended responses.

Potential Use Cases

This model is suitable for a variety of general-purpose language tasks, including:

  • Instruction-following and conversational AI.
  • Text generation and summarization.
  • Question answering.
  • Applications requiring efficient inference from a moderately sized language model.

Finetunes
1 models