BgGPT-Gemma-3-4B-IT Overview

BgGPT-Gemma-3-4B-IT is a 4.3 billion parameter instruction-tuned model from the BgGPT 3.0 series, developed by INSAIT. This model is built upon the Gemma 3 architecture and is specifically adapted for the Bulgarian language, offering significant advancements over its predecessors.

Key Capabilities

• Vision-Language Understanding: Processes and understands both text and images within the same conversational context.
• Enhanced Instruction-Following: Improved ability to handle multi-turn conversations, complex instructions, and system prompts due to broader task training.
• Extended Context Length: Features an effective context window of 131k tokens, enabling longer and more intricate interactions.
• Updated Knowledge: Pretraining data up to May 2025 and instruction fine-tuning up to October 2025, ensuring up-to-date knowledge.

Good For

• Applications requiring multimodal understanding (text and image) in Bulgarian.
• Complex conversational AI and chatbots that need to follow multi-turn instructions.
• Tasks benefiting from a long context window for detailed analysis or extended dialogues.
• Developers seeking a Bulgarian-optimized LLM with recent knowledge updates.