philipp-zettl/gemma-2b-it

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:2.5BQuant:BF16Ctx Length:8kPublished:Feb 21, 2024License:gemma-terms-of-useArchitecture:Transformer Warm

philipp-zettl/gemma-2b-it is a 2.5 billion parameter instruction-tuned, decoder-only large language model developed by Google. Built from the same research as the Gemini models, it is designed for text generation tasks like question answering, summarization, and reasoning. Its compact size allows for deployment in resource-limited environments, democratizing access to advanced AI capabilities. The model supports an 8192 token context length and is optimized for efficient deployment on various hardware, including CPUs and GPUs with different precisions.

Loading preview...

Gemma 2B Instruct: A Compact, High-Performance LLM from Google

This model, philipp-zettl/gemma-2b-it, is the 2.5 billion parameter instruction-tuned variant of Google's Gemma family of open models. Derived from the same foundational research as the Gemini models, Gemma 2B Instruct is a text-to-text, decoder-only large language model available in English. It is specifically designed for efficient deployment and performance across a range of text generation tasks.

Key Capabilities

  • Versatile Text Generation: Excels at question answering, summarization, and general reasoning tasks.
  • Resource-Efficient Deployment: Its lightweight architecture allows for deployment on devices with limited resources, such as laptops, desktops, or standard cloud infrastructure.
  • Instruction-Tuned: Optimized for conversational use, adhering to a specific chat template for structured interactions.
  • Robust Training: Trained on a diverse 6 trillion token dataset including web documents, code, and mathematical texts, enhancing its broad utility.
  • Hardware Optimized: Developed using Google's Tensor Processing Units (TPUv5e) and JAX/ML Pathways for high-performance training.

Good For

  • Content Creation: Generating creative text formats like poems, scripts, marketing copy, and email drafts.
  • Conversational AI: Powering chatbots, virtual assistants, and interactive applications.
  • Text Summarization: Creating concise summaries of documents, research papers, or reports.
  • NLP Research: Serving as a foundational model for experimenting with NLP techniques and algorithm development.
  • Language Learning Tools: Supporting interactive language learning experiences, including grammar correction and writing practice.

Finetunes
1 models