TUpreneur/dama-aibrain

Model Overview

TUpreneur/dama-aibrain is a 5.1 billion parameter model that has been fine-tuned and converted into the GGUF format, leveraging the Unsloth framework for efficient processing. This model is provided with pre-quantized GGUF files, including gemma-4-e2b-it.Q8_0.gguf for general use and gemma-4-e2b-it.F16-mmproj.gguf which indicates multimodal capabilities.

Key Capabilities

• Text Generation: Functions as a text-only LLM, capable of generating human-like text.
• Multimodal Support: Includes a vision component, allowing for processing of both text and image inputs.
• GGUF Format: Optimized for local inference and compatibility with various LLM runtimes.
• Efficient Fine-tuning: Fine-tuned with Unsloth, suggesting faster training times.

Deployment and Usage

This model is designed for straightforward deployment, with specific instructions for both llama-cli and ollama users.

• llama-cli: Supports direct usage with llama-cli -hf TUpreneur/dama-aibrain --jinja for text and llama-mtmd-cli -hf TUpreneur/dama-aibrain --jinja for multimodal applications.
• Ollama Integration: Provides a clear workflow for creating an Ollama-compatible unified bf16 model from the vision model, addressing Ollama's current limitation with separate mmproj files.

Good For

• Developers seeking a 5.1B parameter model for local inference.
• Applications requiring both text and vision capabilities.
• Users looking for GGUF-formatted models with easy integration into existing LLM ecosystems like llama.cpp and Ollama.