hayulalab/Averroes-Q-Instruct
Averroes-Q-Instruct is a 7 billion parameter decoder-only transformer model developed by Hayula Labs, trained from scratch for Arabic-English bilingual instruction following. It features a 32,768 token context window and supports tool calling. This model excels in native Arabic instruction processing and general bilingual applications, making it suitable for tasks requiring long context understanding in both languages.
Loading preview...
Averroes-Q-Instruct: Bilingual Instruction Model
Averroes-Q-Instruct is a 7 billion parameter decoder-only transformer model developed by Hayula Labs, trained from scratch using a proprietary Arabic (40%) and English (60%) corpus. This model is designed for native Arabic and English instruction following, offering robust bilingual capabilities.
Key Capabilities
- Bilingual Instruction Following: Excels in understanding and responding to instructions in both Arabic and English.
- Long Context Window: Features a substantial 32,768 token context length, enabling processing of extensive inputs and generating detailed responses.
- Tool Calling Support: Integrated functionality for tool use, enhancing its utility in complex applications.
- From-Scratch Training: Developed with random initialization, providing a unique foundation for its bilingual performance.
Good For
- Applications requiring high-quality instruction following in both Arabic and English.
- Tasks benefiting from a large context window, such as document summarization, detailed Q&A, or conversational AI with extensive history.
- Research and development in bilingual NLP, particularly for Arabic-English language pairs.
License
This model is released under a Research Only — No Commercial Use (CC BY 4.0) license. Attribution to Hayula Labs is required for its use.