Model Overview
Dans-AdventurousWinds-7b is a 7 billion parameter model built upon the Mistral-7b architecture, specifically designed for generating text-based adventure games. It offers a unique capability to produce both concise and detailed, novel-like responses, which can be controlled through distinct system messages. This flexibility allows for dynamic and engaging interactive storytelling experiences.
Key Capabilities
- Text-Based Adventure Game Generation: Proficient in creating interactive narratives for adventure games.
- Flexible Response Styles: Can generate short, direct replies or long, descriptive passages, adapting to the desired narrative depth.
- Traditional Adventure Format: Utilizes a prompt format that includes genre, tags, mode, description, and an optional introductory message, followed by user and model messages.
Training Details
This model was trained using QLoRA on a single RTX 3090 for 3 epochs, with a sequence length of 4096 tokens. The training utilized a custom, improved version of the floyd and cys datasets from the Skein text adventure dataset, presented in a traditional adventure mode format. The Skein dataset, curated by the Kobold AI community, was pivotal for its development.
Good For
- Developers and enthusiasts looking to create interactive text adventures.
- Applications requiring dynamic and context-aware narrative generation.
- Experimenting with different storytelling styles within a single model.