dreamgen/opus-v1.2-70b
dreamgen/opus-v1.2-70b is a 69 billion parameter language model developed by DreamGen, specifically optimized for steerable story-writing and role-playing. It utilizes an extended ChatML format to facilitate detailed narrative control and character interaction. The model excels at generating creative continuations for stories and role-play scenarios, alongside tasks like plot summarization and character description.
Loading preview...
Overview
dreamgen/opus-v1.2-70b is a 69 billion parameter model from the DreamGen Opus V1 series, primarily designed for steerable story-writing and role-playing. It employs an extended ChatML format, allowing for nuanced control over narrative flow and character interactions through specific text roles and names attributes.
Key Capabilities
- Steerable Story-writing and Role-playing: Users can provide detailed system prompts including plot, style, and character descriptions, along with conversational turns and instructions, to guide the model's narrative generation.
- Story Plot Summarization: Generates concise summaries of stories or chapters based on input text.
- Story Character Description: Extracts and describes characters from provided story segments.
- Story Style Description: Analyzes and describes the writing style of a given story.
- Story Description to Chapters: Converts a brief plot description into detailed chapter outlines.
Training and Usage
The model was fine-tuned on approximately 100 million tokens of steerable story-writing, role-playing, and writing/general assistant examples, with each example up to 31,000 tokens long. All story-writing and role-playing data was human-written. DreamGen recommends "Min P" based sampling with min_p in the range [0.01, 0.1] and temperature in [0.5, 1.5] for optimal creative output. The model can be run on dreamgen.com for free or locally with various backends like vLLM and SillyTavern, provided the prompt formatting adheres to the Opus V1 standard.