massimilianowosz/gemma-2b-it-japanese-chef-mlx

TEXT GENERATIONPricing:Input $0.32 / Cached $0.064 / Output $1.6Concurrent Unit Cost:1Model Size:2.5BQuant:BF16Context Size:8kPublished:May 21, 2024License:gemmaArchitecture:Transformer Featherless Exclusive Cold

The massimilianowosz/gemma-2b-it-japanese-chef-mlx is a 2.5 billion parameter instruction-tuned language model, converted to MLX format from Google's Gemma-2b-it. It retains the original model's 8192 token context length and is designed for efficient deployment and inference on Apple Silicon. This model is suitable for general instruction-following tasks, leveraging the Gemma architecture's capabilities within the MLX ecosystem.

Loading preview...

Overview

This model, massimilianowosz/gemma-2b-it-japanese-chef-mlx, is a 2.5 billion parameter instruction-tuned language model. It has been specifically converted to the MLX format from Google's gemma-2b-it using mlx-lm version 0.8.0, making it optimized for efficient execution on Apple Silicon. The model maintains the core characteristics and capabilities of the original Gemma-2b-it, including its 8192 token context window.

Key Capabilities

  • Instruction Following: Designed to understand and execute a wide range of user instructions.
  • MLX Optimization: Tailored for high-performance inference on Apple Silicon devices.
  • Gemma Architecture: Benefits from the robust and efficient architecture of the Gemma family of models.

Good for

  • Developers working with Apple Silicon who need a compact yet capable instruction-tuned model.
  • Applications requiring efficient local inference for general language understanding and generation tasks.
  • Experimentation and development within the MLX ecosystem, leveraging a well-established base model.