RicardoEstep/RPBizkit-v9-12B
RicardoEstep/RPBizkit-v9-12B is a 12.2 billion parameter experimental Mistral Nemo mix model, created by RicardoEstep, utilizing DARE TIES and Model Stock merge methods. This model is specifically fine-tuned for roleplay (RP) scenarios, incorporating several 'RP Uncensored' models to enhance its creative and interactive storytelling capabilities. It features a clean tokenizer and embedding sizes, supporting a 128K context window, making it suitable for extended and complex roleplay interactions.
Loading preview...
RicardoEstep/RPBizkit-v9-12B: An Experimental RP-Optimized Merge
RicardoEstep/RPBizkit-v9-12B is a 12.2 billion parameter model based on the Mistral Nemo architecture, developed by RicardoEstep. It is an experimental merge created using DARE TIES and Model Stock methods with Mergekit, combining several existing "RP Uncensored" models. The model aims to provide a stable yet nuanced experience for roleplay, with the developer noting an unexpected "humanity" that sometimes prevents it from acting completely "uncensored."
Key Features & Merging Process
- Architecture: Built upon
natong19/Mistral-Nemo-Instruct-2407-abliteratedas the base model. - Multi-stage Merging: The model is a result of a five-part merging process, combining various specialized roleplay models across different themes like "Simpleness," "Setting," "Phantasy," and "Darkness." These intermediate merges were then combined in a final "Model Stock" merge.
- Context Window: Supports a 128K context size, enabling long and detailed roleplay sessions.
- Tokenizer: Features clean tokenizer and embedding sizes (131072).
- Chat Template: Recommended to use "Alpaca (with "RAW" inputs)" or the provided optional Mistral V3 chat template.
Use Cases
- Creative Roleplay: Designed for generating engaging and stable responses in roleplay scenarios.
- Interactive Storytelling: Suitable for applications requiring dynamic and character-driven narratives.
Limitations
- The developer notes that despite being a mix of "RP Uncensored" models, it exhibits a degree of "humanity" and may not always act completely uncensored.