Model Overview

The vicgalle/Roleplay-Llama-3-8B is an 8 billion parameter model based on the Llama-3 architecture, specifically fine-tuned for roleplay generation. Its training utilized the ResplendentAI/NSFW_RP_Format_DPO dataset, which conditions the model to produce outputs in a specific format: dialogue *action*.

Key Capabilities

• Formatted Roleplay Generation: Designed to generate conversational text interspersed with actions, ideal for interactive storytelling and character-driven scenarios.
• High Performance in Roleplay: Achieved the second-highest ELO score on the Chaiverse leaderboard as of April 23, 2024, and is noted as the best-performing 8B parameter model in this category.
• Llama-3 Base: Benefits from the robust capabilities of the Llama-3 foundation model.

Evaluation Highlights

While specialized for roleplay, the model's general LLM capabilities were evaluated on the Open LLM Leaderboard, showing an average score of 24.33. Specific metrics include:

• IFEval (0-Shot): 73.20
• BBH (3-Shot): 28.55
• MMLU-PRO (5-shot): 30.09

Good For

• Interactive Storytelling: Creating dynamic and engaging narrative experiences.
• Character Simulation: Generating responses that include both dialogue and character actions.
• Roleplay Applications: Any use case requiring structured, action-oriented conversational outputs.