TeunS/Geert

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:2.6BQuant:BF16Ctx Length:8kPublished:Nov 11, 2024License:gemmaArchitecture:Transformer Warm

TeunS/Geert is a 2.6 billion parameter instruction-tuned causal language model, converted to MLX format from unsloth/gemma-2-2b-it. This model is designed for efficient inference on Apple silicon, leveraging the MLX framework. Its primary use case is general-purpose text generation and instruction following within the MLX ecosystem, offering a compact yet capable solution for local deployments.

Loading preview...

TeunS/Geert: MLX-Optimized Gemma-2-2B-IT

TeunS/Geert is a 2.6 billion parameter instruction-tuned language model, specifically converted for the MLX framework. This model originates from the unsloth/gemma-2-2b-it base, making it a compact yet capable option for various natural language processing tasks. Its conversion to MLX format ensures optimized performance on Apple silicon, providing an efficient solution for local inference.

Key Capabilities

  • Instruction Following: Designed to respond to user prompts and instructions effectively.
  • Text Generation: Capable of generating coherent and contextually relevant text.
  • MLX Compatibility: Fully integrated with the MLX ecosystem for streamlined deployment and usage on compatible hardware.

Good For

  • Local Development: Ideal for developers working on Apple silicon who require a performant and accessible language model.
  • Resource-Constrained Environments: Suitable for applications where a smaller model size is beneficial for faster inference and lower memory footprint.
  • Experimentation: Provides a solid base for experimenting with instruction-tuned models within the MLX framework.