SillyTilly/google-gemma-2-9b

TEXT GENERATIONPricing:Input $0.431 / Output $1.12Concurrent Unit Cost:1Model Size:9BQuant:FP8Context Size:16kPublished:Jun 27, 2024License:gemmaArchitecture:Transformer0.0K Featherless Exclusive Cold

Gemma 2 9B is a 9 billion parameter, text-to-text, decoder-only large language model developed by Google, built from the same research as Gemini models. It is available in English with open weights for both pre-trained and instruction-tuned variants. This lightweight model is designed for diverse text generation tasks like question answering, summarization, and reasoning, making it suitable for deployment in resource-limited environments. It offers strong performance across various benchmarks, including MMLU (71.3) and HumanEval (40.2), making it a versatile choice for general-purpose text generation.

Loading preview...

Model Overview

SillyTilly/google-gemma-2-9b is a 9 billion parameter model from the Gemma family, developed by Google. These are lightweight, decoder-only large language models built using the same research and technology as the Gemini models. Available in English with open weights for both pre-trained and instruction-tuned variants, Gemma 2 9B is designed for a wide array of text generation tasks.

Key Capabilities

  • Versatile Text Generation: Excels in tasks such as question answering, summarization, and reasoning.
  • Resource-Efficient Deployment: Its relatively small size allows for deployment on devices with limited resources, including laptops, desktops, or private cloud infrastructure.
  • Strong Benchmark Performance: Achieves competitive scores across various benchmarks, including 71.3 on MMLU, 81.9 on HellaSwag, 40.2 on HumanEval, and 68.6 on GSM8K.
  • Robust Training: Trained on 8 trillion tokens, including diverse web documents, code, and mathematical texts, ensuring broad linguistic understanding and task handling.
  • Responsible AI Focus: Developed with rigorous data filtering for safety (CSAM, sensitive data) and evaluated against ethical considerations like bias, misinformation, and privacy.

Intended Use Cases

  • Content Creation: Generating creative text formats, marketing copy, or email drafts.
  • Conversational AI: Powering chatbots, virtual assistants, and interactive applications.
  • Text Summarization: Creating concise summaries of documents, research papers, or reports.
  • NLP Research: Serving as a foundation for experimenting with NLP techniques and algorithm development.
  • Educational Tools: Supporting language learning, grammar correction, and writing practice.