OpenLLM-Ro/RoLlama3.1-8b-Instruct-2025-04-23

TEXT GENERATIONPricing:Input $0.2 / Cached $0.028 / Output $0.32Concurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Apr 22, 2025License:cc-by-nc-4.0Architecture:Transformer Open Weights Featherless Exclusive Cold

RoLlama3.1-8b-Instruct-2025-04-23 is an 8 billion parameter instruction-tuned generative text model developed by OpenLLM-Ro, built upon Meta Llama 3.1. This model is specifically designed and fine-tuned for the Romanian language, making it the first open-source LLM effort specialized for Romanian. It excels in Romanian natural language tasks, demonstrating strong performance in areas like MT-Bench and RoCulturaBench, and is intended for research use in Romanian assistant-like chat applications.

Loading preview...

RoLlama3.1-8b-Instruct-2025-04-23 Overview

OpenLLM-Ro/RoLlama3.1-8b-Instruct-2025-04-23 is an 8 billion parameter instruction-tuned model, part of the RoLlama3.1 family, developed by OpenLLM-Ro. This model represents a significant open-source initiative to create powerful Large Language Models specifically for the Romanian language. It is fine-tuned from Meta-Llama-3.1-8B-Instruct using a diverse collection of Romanian instruction datasets, including RoAlpaca, RoDolly, and RoUltraChat.

Key Capabilities

  • Romanian Language Specialization: Optimized for generative text tasks exclusively in Romanian, addressing a critical gap in open-source LLMs.
  • Instruction Following: Designed for assistant-like chat applications, capable of understanding and responding to instructions in Romanian.
  • Improved Performance: Demonstrates enhanced performance on Romanian-specific benchmarks compared to its base Llama-3.1-8B-Instruct model, achieving an average MT-Bench score of 6.43 and a RoCulturaBench score of 4.28.
  • Research Focus: Primarily intended for research purposes in Romanian natural language processing.

When to Use This Model

  • Romanian NLP Research: Ideal for researchers working on language models and applications tailored for the Romanian language.
  • Assistant-like Applications in Romanian: Suitable for developing chatbots or conversational AI systems that require high proficiency in Romanian.
  • Fine-tuning for Romanian Downstream Tasks: Can serve as a strong foundation for further fine-tuning on specific Romanian NLP tasks, as indicated by its performance on LaRoSeDa and WMT benchmarks.

Finetunes
1 models