RandomGamingDev/gemma4-duck-merged

VISIONConcurrency Cost:1Model Size:5.1BQuant:BF16Ctx Length:32kTool Calling:SupportedPublished:May 25, 2026License:apache-2.0Architecture:Transformer Open Weights Cold

RandomGamingDev/gemma4-duck-merged is a 5.1 billion parameter Gemma 4-based language model developed by RandomGamingDev. This model was fine-tuned using Unsloth and Huggingface's TRL library, achieving 2x faster training. It is designed for general language tasks, leveraging its efficient training methodology for practical applications. The model has a context length of 32768 tokens.

Loading preview...

Model Overview

RandomGamingDev/gemma4-duck-merged is a 5.1 billion parameter language model based on the Gemma 4 architecture, developed by RandomGamingDev. This model distinguishes itself through its efficient fine-tuning process, utilizing Unsloth and Huggingface's TRL library, which enabled a 2x faster training speed compared to standard methods. It is fine-tuned from the unsloth/gemma-4-e2b-it-unsloth-bnb-4bit model and operates under an Apache-2.0 license.

Key Capabilities

  • Efficient Training: Leverages Unsloth for significantly faster fine-tuning.
  • Gemma 4 Architecture: Built upon the robust Gemma 4 base model.
  • General Language Tasks: Suitable for a broad range of natural language processing applications.
  • Extended Context: Supports a context length of 32768 tokens.

Good For

  • Developers seeking a Gemma 4-based model with optimized training.
  • Applications requiring a balance of performance and resource efficiency.
  • General text generation and understanding tasks.

Finetunes
1 models