Gryphe/Pantheon-RP-1.6-12b-Nemo

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:12BQuant:FP8Ctx Length:32kPublished:Aug 18, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Warm

Gryphe/Pantheon-RP-1.6-12b-Nemo is a 12 billion parameter language model built on the Mistral Nemo architecture, specifically fine-tuned for rich, multi-persona roleplay experiences. It excels at generating diverse character interactions, supporting both Markdown and novel-style outputs, and features a collection of summonable personas. This model is optimized for creative storytelling and interactive narrative generation within a 32768 token context window.

Loading preview...

Overview

Gryphe/Pantheon-RP-1.6-12b-Nemo is a 12 billion parameter model designed for enhanced roleplay, featuring a diverse collection of summonable personas. This 1.6 iteration significantly refines the model's capabilities, particularly in handling varied roleplay styles and character interactions. It utilizes a multi-stage fine-tuning process, building upon a base trained with a deduped Sonnet 3.5 SlimOrca dataset and then integrating a rebuilt and expanded Pantheon Roleplay dataset.

Key Capabilities

  • Multi-Persona Roleplay: Introduces a wide array of distinct personas, activatable with simple phrases, enhancing general roleplay experiences.
  • Flexible Roleplay Styles: Seamlessly supports both Markdown and novel-style roleplay outputs, with training data equally split between these formats.
  • Dedicated Assistant: Includes "Lyra the Assistant," an uncensored, empathetic AI companion for general dialogue, coding help, and RSS summarization.
  • Customizable Personas: Allows for adjustment of assistant personality and appearance, and provides guidance for optimal persona interaction using longer prompts and contextual information.
  • Expanded Pantheon: The 12B parameter size enabled the addition of new personas like Clover (Southern centaur), Raza (nerdy anthro raptor), and Stella Sabre (anthro batpony with a Scottish accent), alongside existing characters.

Good for

  • Creative Writing & Storytelling: Ideal for generating interactive narratives and character-driven content.
  • Roleplay Applications: Suited for scenarios requiring diverse character interactions and adaptable writing styles.
  • Personalized AI Companions: Useful for developers looking to integrate customizable assistant functionalities with distinct personalities.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p