carbonteq/gemma4-e4b-cms1500-merged

VISIONConcurrency Cost:1Model Size:7.9BQuant:FP8Ctx Length:32kTool Calling:SupportedPublished:Apr 28, 2026License:apache-2.0Architecture:Transformer Open Weights Cold

The carbonteq/gemma4-e4b-cms1500-merged model is a 7.9 billion parameter Gemma 4-E4B-it variant developed by carbonteq, fine-tuned using Unsloth and Huggingface's TRL library. This model benefits from accelerated training, making it a performant option for tasks typically handled by Gemma-based architectures. It is designed for general language understanding and generation, leveraging its efficient training methodology.

Loading preview...

Model Overview

The carbonteq/gemma4-e4b-cms1500-merged is a 7.9 billion parameter language model developed by carbonteq. It is a fine-tuned variant of the unsloth/gemma-4-E4B-it base model, leveraging the Gemma 4 architecture.

Key Characteristics

  • Architecture: Based on the Gemma 4-E4B-it model family.
  • Parameter Count: 7.9 billion parameters, offering a balance between performance and computational efficiency.
  • Training Efficiency: This model was fine-tuned with Unsloth and Huggingface's TRL library, which enabled a 2x faster training process compared to standard methods. This efficiency can translate to more rapid iteration and deployment.
  • Context Length: Supports a context length of 32768 tokens, allowing for processing and generating longer sequences of text.

Use Cases

This model is suitable for a variety of natural language processing tasks, including but not limited to:

  • Text generation
  • Summarization
  • Question answering
  • Code generation (given its base model's capabilities)

Its efficient training and substantial context window make it a versatile tool for developers looking for a performant Gemma-based model.

Finetunes
1 models