soynade-research/oolel-lit-gemma
Oolel-lit-gemma is a 0.3 billion parameter language model developed by soynade-research, fine-tuned from Google's Gemma-3-270m-it architecture. This model is specifically optimized for the Wolof language, making it a compact, on-device solution for Wolof natural language processing. It excels in tasks requiring Wolof understanding and generation, such as translation, and was trained using supervised fine-tuning on synthetic data distilled from larger Oolel-7B models.
Loading preview...
Oolel-lit-gemma: A Compact Wolof Language Model
Oolel-lit-gemma is a specialized 0.3 billion parameter language model developed by soynade-research, building upon Google's Gemma-3-270m-it. It is a key component of the Oolel family, designed for efficient, on-device Wolof language processing.
Key Capabilities and Features
- Wolof Language Specialization: Primarily optimized for the Wolof language, making it highly effective for tasks in this specific linguistic domain.
- Compact Size: With 0.3 billion parameters, it is designed for on-device deployment and applications where computational resources are limited.
- Training Methodology: Fine-tuned using supervised learning on synthetic data, which was distilled from larger Oolel-7B models via the Oolel-translator.
- Base Model: Leverages the robust architecture of the Gemma-3-270m-it model.
Use Cases and Limitations
This model is ideal for applications requiring Wolof language understanding and generation, such as translation from other languages into Wolof. Developers can integrate it using Hugging Face's pipeline for quick starts or AutoModel for more granular control.
However, users should be aware of its limitations:
- Performance on languages other than Wolof may be suboptimal.
- As a 270 million parameter model, it may struggle with highly complex linguistic tasks.
- For critical applications, outputs should be verified by a native Wolof speaker to ensure accuracy.