Model Overview

Dans-AdventurousWinds-7b is a 7 billion parameter model built upon the Mistral-7b architecture, specifically designed for generating text-based adventure games. It offers a unique capability to produce both concise and detailed, novel-like responses, which can be controlled through distinct system messages. This flexibility allows for dynamic and engaging interactive storytelling experiences.

Key Capabilities

• Text-Based Adventure Game Generation: Proficient in creating interactive narratives for adventure games.
• Flexible Response Styles: Can generate short, direct replies or long, descriptive passages, adapting to the desired narrative depth.
• Traditional Adventure Format: Utilizes a prompt format that includes genre, tags, mode, description, and an optional introductory message, followed by user and model messages.

Training Details

This model was trained using QLoRA on a single RTX 3090 for 3 epochs, with a sequence length of 4096 tokens. The training utilized a custom, improved version of the floyd and cys datasets from the Skein text adventure dataset, presented in a traditional adventure mode format. The Skein dataset, curated by the Kobold AI community, was pivotal for its development.

Good For

• Developers and enthusiasts looking to create interactive text adventures.
• Applications requiring dynamic and context-aware narrative generation.
• Experimenting with different storytelling styles within a single model.