dreamgen/opus-v1.2-7b

Warm
Public
7B
FP8
4096
Feb 18, 2024
License: cc-by-nc-nd-4.0
Hugging Face
Overview

Model Overview

dreamgen/opus-v1.2-7b is a 7 billion parameter model from the DreamGen Opus V1 series, primarily designed for steerable story-writing and role-playing. It employs an extended ChatML format, introducing a text role with optional names to manage character-specific narration and dialogue within a story.

Key Capabilities

  • Steerable Story-writing & Role-playing: Users provide plot, style, and character descriptions, then guide the narrative with instructions for story or role-play continuations.
  • Story Plot Summarization: Generates concise summaries of stories or chapters, with examples demonstrating 50-word and 200-word outputs.
  • Story Character Description: Extracts and describes characters from provided story segments.
  • Story Style Description: Analyzes and describes the writing style of a given story.
  • Story Description to Chapters: Converts a brief plot description into chapter-by-chapter outlines.

Training and Usage

The model was fine-tuned on approximately 100 million tokens, with examples up to 31,000 tokens long, focusing on human-written story-writing and role-playing data. Recommended sampling parameters for creative generation include min_p in the range [0.01, 0.1] and temperature in [0.5, 1.5]. The model is compatible with various backends, but emphasizes correct prompt formatting and tokenization, particularly for the extended ChatML structure. Resources like a prompting guide and a Google Colab are available for developers.