Hugging Face Overview
Overview
allura-org/MS3-24B-Roselily-Creative is a 24 billion parameter model built upon ToastyPigeon/ms3-roselily-instruct. Its primary focus is on creative text generation, incorporating extensive data from roleplay and story writing. The model supports a substantial 32768 token context length, making it suitable for longer creative narratives.
Key Capabilities & Features
- Creative Text Generation: Specifically fine-tuned for roleplay, story writing, and other creative applications.
- Instruction Formats: Optimized for ChatML and Alpaca instruction formats, with Tekken v7 also supported.
- Sampler Robustness: Designed to be less sensitive to sampler settings compared to other instruction-based MS3 models, though conservative samplers are still recommended.
- Chat Template Flexibility: Includes specific token assignments for ChatML to ensure compatibility and proper generation, while maintaining Tekken token integrity for potential merges.
Use Cases
This model is particularly well-suited for:
- Roleplaying scenarios
- Generating creative stories and narratives
- Interactive fiction and adventure modes
Users should be aware that stopping strings like <|im_end|> or </s> might need explicit configuration depending on the tokenizer and chosen chat format.