HiTZ/Latxa-Llama-3.1-70B-Instruct-v2
HiTZ/Latxa-Llama-3.1-70B-Instruct-v2 is a 70 billion parameter instruction-tuned language model developed by HiTZ Research Center & IXA Research group, based on Meta's Llama-3.1-Instruct architecture. It is specifically trained on an extended Basque corpus (Latxa Corpus v2) to significantly enhance performance for the Basque language. This model excels in Basque chat conversations and benchmarks, outperforming its Llama-3.1-Instruct parent and ranking highly against proprietary models in arena evaluations for Basque tasks.
Loading preview...
Latxa 3.1 70B Instruct V2: Optimized for Basque Language
Latxa 3.1 70B Instruct V2 is an instruction-tuned large language model developed by the HiTZ Research Center & IXA Research group, building upon Meta's Llama-3.1-Instruct architecture. This model is specifically designed to address the performance gap for low-resource languages like Basque, where general LLMs often struggle.
Key Capabilities & Features
- Basque Language Specialization: Further trained on the high-quality Latxa Corpus v2, significantly improving its proficiency in Basque.
- Superior Basque Performance: Outperforms the base Llama-3.1-Instruct model by a large margin on standard Basque benchmarks and chat conversations.
- Competitive Evaluation: Achieved a 3rd place ranking in a public arena-based evaluation against other baselines and proprietary models like GPT-4o and Claude Sonnet for Basque tasks.
- Instruction Following: Trained to effectively follow instructions and function as a chat assistant in Basque.
Benchmarks & Results
Latxa 3.1 70B Instruct V2 demonstrates strong improvements across various Basque-specific datasets, including Belebele, X-StoryCloze, EusProficiency, EusTrivia, and EusExams. For instance, it achieved 73.30% on EusProficiency and 75.10% on EusTrivia, significantly higher than Llama-3.1 70B Instruct.
When to Use This Model
This model is ideal for applications requiring high-performance language understanding and generation specifically for the Basque language. It is intended for use cases such as:
- Developing Basque-language chatbots and conversational AI.
- Instruction-following tasks in Basque.
- Research and development in Basque natural language processing.