erdiari/Mistral-Scary-Story-Finetune

Model Overview

The erdiari/Mistral-Scary-Story-Finetune is a specialized 7 billion parameter language model derived from the Mistral-7B-v0.1 architecture. Its primary distinction lies in its fine-tuning on a dataset sourced from the r/nosleep subreddit, making it uniquely adept at generating scary stories and horror narratives.

Key Capabilities

• Horror Story Generation: Specifically trained to produce content in the style of scary stories, leveraging its exposure to a vast collection of user-submitted horror fiction.
• Narrative Continuation: Designed to continue a story from a given prompt, which can be a title or an initial paragraph, allowing for guided creative writing.
• Non-Instruction Tuned: Unlike many general-purpose LLMs, this model is not instruction-tuned. Its strength is in generating coherent narrative continuations rather than following explicit commands.

Training Details

The model underwent a LoRA (Low-Rank Adaptation) fine-tuning process. The specific parameters used for fine-tuning include r=8, lora_alpha=16, and lora_dropout=0.05. This targeted fine-tuning approach allowed for efficient adaptation of the base Mistral model to the specific domain of scary story generation.

Good For

• Creative Writing Assistance: Ideal for writers looking for inspiration or automated continuation of horror stories.
• Content Generation: Useful for generating unique scary narratives for entertainment, games, or other creative projects.
• Exploring Niche LLM Applications: Demonstrates the potential of fine-tuning base models for highly specific content generation tasks.