OpenLLM-Ro/RoLlama3.1-8b-Instruct-DPO-2025-04-23

TEXT GENERATIONConcurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Apr 23, 2025License:cc-by-nc-4.0Architecture:Transformer Open Weights Featherless Exclusive Cold

OpenLLM-Ro/RoLlama3.1-8b-Instruct-DPO-2025-04-23 is an 8 billion parameter instruction-tuned generative text model developed by OpenLLM-Ro, built with Meta Llama 3.1. This model is specifically fine-tuned for the Romanian language, excelling in human-aligned conversational tasks. It demonstrates strong performance in Romanian-specific benchmarks like MT-Bench and RoCulturaBench, making it suitable for assistant-like chat applications in Romanian.

Loading preview...

Overview

OpenLLM-Ro/RoLlama3.1-8b-Instruct-DPO-2025-04-23 is an 8 billion parameter instruction-tuned generative text model, part of the OpenLLM-Ro family, built upon Meta Llama 3.1. It represents a significant open-source effort to develop specialized Large Language Models for the Romanian language. This particular variant is human-aligned through DPO (Direct Preference Optimization) and is intended for research use in Romanian.

Key Capabilities

  • Romanian Language Specialization: Developed and fine-tuned exclusively for Romanian, addressing a gap in open-source LLMs for this language.
  • Instruction Following: Designed for assistant-like chat and instruction-based tasks in Romanian.
  • DPO Fine-tuning: Utilizes Direct Preference Optimization with datasets like RoHelpSteer, RoUltraFeedback, and RoMagpieDPO for improved human alignment.
  • Strong Romanian Benchmarks: Achieves the highest scores within its family on MT-Bench (7.00 average) and RoCulturaBench (4.73 average), indicating superior conversational and cultural understanding in Romanian compared to other RoLlama3.1 models and the base Llama-3.1-8B-Instruct.

Intended Use Cases

  • Research: Primarily intended for research purposes related to Romanian natural language processing.
  • Assistant-like Chat: Well-suited for developing conversational AI agents and chatbots that interact in Romanian.
  • Natural Language Tasks: Base models can be adapted for various Romanian natural language tasks, while this instruct variant focuses on interactive applications.

Finetunes
1 models