uselevers/levers-base-najdi-70b-it-merged

Levers Base Najdi Conversational Model (70B-IT-Merged)

This model is a 70 billion parameter causal language model developed by uselevers, uniquely specialized for the Najdi Arabic dialect. It has been instruction-tuned and merged for optimal inference performance, making it suitable for production environments. The model's core strength lies in its ability to handle multi-turn conversations in Najdi Arabic, a capability derived from fine-tuning on a proprietary 133-hour dataset of authentic Najdi dialogues.

Key Capabilities

• Najdi Dialect Proficiency: Specifically optimized for understanding and generating natural language in the Najdi Arabic dialect.
• Multi-turn Dialogue: Excels at maintaining context and coherence across extended conversations (5+ turns).
• Efficient Inference: Merged weights eliminate the need for LoRA adapter loading, resulting in faster and simplified deployment.
• Code-Switching: Demonstrates performance in conversations that involve switching between Najdi Arabic and English.
• Proprietary Training Data: Leverages a high-quality, proprietary dataset of 4,023 Najdi conversations for robust dialect-specific performance.

Good For

• Najdi Dialect Conversational AI: Ideal for chatbots and conversational assistants targeting Najdi-speaking regions.
• Multi-turn Dialogue Systems: Applications requiring sustained, coherent conversations in a specific Arabic dialect.
• Cultural and Linguistic Preservation: Tools focused on preserving and interacting with the Najdi dialect.
• Production Deployment: Its merged architecture and optimized inference make it suitable for real-world applications requiring speed and simplicity.

Limitations

While highly specialized, the model's performance may be limited outside of the Najdi dialect or on topics not well-represented in its training data. It requires significant hardware resources (80GB+ VRAM recommended) and, like all LLMs, may occasionally generate incorrect or biased information.