unsloth/gemma-3-270m-it-qat

TEXT GENERATIONConcurrency Cost:1Model Size:0.3BQuant:BF16Ctx Length:32kPublished:Aug 14, 2025License:gemmaArchitecture:Transformer0.0K Cold

The unsloth/gemma-3-270m-it-qat model is a 270 million parameter instruction-tuned variant of Google DeepMind's Gemma 3 family, featuring a 32K token context window. This model utilizes Quantization Aware Training (QAT) to maintain bfloat16 quality while significantly reducing memory requirements. It is a multimodal model capable of handling text and image inputs to generate text outputs, excelling in tasks like question answering, summarization, and reasoning.

Loading preview...

Overview

This model is the 270 million parameter instruction-tuned version of the Gemma 3 family, developed by Google DeepMind. It leverages Quantization Aware Training (QAT) to achieve performance comparable to bfloat16 models, but with substantially lower memory demands. Gemma 3 models are multimodal, processing both text and image inputs to generate text, and are built upon the same research and technology as the Gemini models.

Key Capabilities

  • Multimodal Input: Accepts text strings and images (normalized to 896x896 resolution, encoded to 256 tokens each for larger models, but this 270M model handles text and image input). The 270M model supports a 32K token context window.
  • Instruction-Tuned: Optimized for following instructions, making it suitable for various generative tasks.
  • Quantization Aware Training (QAT): Preserves high quality while enabling efficient deployment due to reduced memory footprint.
  • Multilingual Support: Trained on data including over 140 languages.
  • Diverse Task Performance: Excels in text generation, image understanding, question answering, summarization, and reasoning.

Good for

  • Resource-Constrained Environments: Its small size and QAT optimization make it suitable for deployment on laptops, desktops, or personal cloud infrastructure.
  • Content Creation: Generating creative text formats, marketing copy, and email drafts.
  • Conversational AI: Powering chatbots, virtual assistants, and interactive applications.
  • Research and Education: Serving as a foundation for VLM and NLP research, language learning tools, and knowledge exploration.
  • Image Data Extraction: Interpreting and summarizing visual data for text communications.

Finetunes
4 models