Heralax/Augmental-13b-two-epochs
Heralax/Augmental-13b-two-epochs is a 13 billion parameter MythoMax model fine-tuned by Heralax on an augmented, high-quality roleplay dataset of over 7,850 examples. This model specializes in generating longer, more descriptive responses for roleplay scenarios, leveraging an AI-enhanced human-written data approach. It excels at diverse character portrayals, having been trained on multiple characters with varied personalities, and supports a 4096-token context length.
Loading preview...
Augmental-13b-two-epochs: AI-Enhanced Roleplay
Heralax/Augmental-13b-two-epochs is a 13 billion parameter language model built upon the MythoMax architecture, specifically fine-tuned for high-quality roleplay generation. Its core innovation lies in its "augmented data" approach, where human-written roleplay examples (over 7,850) are significantly enhanced by GPT-4 to produce richer, more descriptive responses.
Key Capabilities & Differentiators
- Augmented Data Training: Unlike purely synthetic or hybrid datasets, this model uses AI to enhance existing human-written text, leading to superior quality and diversity in writing style.
- Longer, Descriptive Responses: A unique GPT-4 pass during data generation specifically focused on expanding lines, enabling the model to excel at producing lengthier and more detailed outputs.
- Diverse Character Portrayal: Trained on a wide range of character personalities (including Tsunderes and catgirls) from the Steins;Gate visual novel, ensuring versatility in roleplay scenarios.
- Improved Data Quality: Addresses limitations of previous models by fixing bugs, increasing data diversity, and scaling the dataset significantly.
- SillyTavern Prompt Format: Optimized for use with the SillyTavern prompting interface.
Ideal Use Cases
- Advanced Roleplay: Generating immersive and detailed character interactions.
- Creative Writing: Assisting with narrative development and descriptive text generation.
- Character Simulation: Creating nuanced and consistent character personas for interactive applications.