DarksitoBest/Gemma3-4b-LuauV1.4
DarksitoBest/Gemma3-4b-LuauV1.4 is a 4.3 billion parameter Gemma-based language model, fine-tuned and converted to GGUF format using Unsloth. This model is optimized for efficient deployment and usage, offering GGUF files for both text-only and multimodal applications. Its development leveraged Unsloth for faster training, making it suitable for various inference tasks.
Loading preview...
Overview
DarksitoBest/Gemma3-4b-LuauV1.4 is a 4.3 billion parameter model built on the Gemma architecture. It has been fine-tuned and subsequently converted into the GGUF format, a process facilitated by the Unsloth library, which also enabled a 2x faster training speed. This model is designed for efficient deployment and compatibility with llama-cli and llama-mtmd-cli tools.
Key Capabilities
- Gemma Architecture: Leverages the robust Gemma base model for language understanding and generation.
- GGUF Format: Provided in GGUF format, ensuring broad compatibility with various inference engines and hardware.
- Optimized for Deployment: Includes specific GGUF files for different use cases, such as
Gemma3-4b-LuauV1.2.Q8_0.gguffor quantized inference andGemma3-4b-LuauV1.2.BF16-mmproj.gguffor multimodal applications. - Unsloth Integration: Benefits from Unsloth's optimizations for faster fine-tuning and efficient model conversion.
Usage Considerations
- Text-only LLMs: Can be used with
llama-clifor standard language model tasks. - Multimodal Models: Supports multimodal applications via
llama-mtmd-cliwhen using the appropriate GGUF file. - BOS Token Adjustment: The model's Beginning-Of-Sentence (BOS) token behavior has been adjusted to ensure proper GGUF compatibility.