allura-org/MS3-24B-Roselily-Creative
allura-org/MS3-24B-Roselily-Creative is a 24 billion parameter language model, fine-tuned from ToastyPigeon/ms3-roselily-instruct, specifically optimized for creative writing tasks such as roleplay and story generation. It supports a 32768 token context length and is designed to be less sensitive to sampling parameters than other instruction-based MS3 models. This model excels in generating creative text with preferred instruction formats like ChatML or Alpaca.
Loading preview...
Overview
allura-org/MS3-24B-Roselily-Creative is a 24 billion parameter model built upon ToastyPigeon/ms3-roselily-instruct. Its primary focus is on creative text generation, incorporating extensive data from roleplay and story writing. The model supports a substantial 32768 token context length, making it suitable for longer creative narratives.
Key Capabilities & Features
- Creative Text Generation: Specifically fine-tuned for roleplay, story writing, and other creative applications.
- Instruction Formats: Optimized for ChatML and Alpaca instruction formats, with Tekken v7 also supported.
- Sampler Robustness: Designed to be less sensitive to sampler settings compared to other instruction-based MS3 models, though conservative samplers are still recommended.
- Chat Template Flexibility: Includes specific token assignments for ChatML to ensure compatibility and proper generation, while maintaining Tekken token integrity for potential merges.
Use Cases
This model is particularly well-suited for:
- Roleplaying scenarios
- Generating creative stories and narratives
- Interactive fiction and adventure modes
Users should be aware that stopping strings like <|im_end|> or </s> might need explicit configuration depending on the tokenizer and chosen chat format.
Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.