invisietch/Nimbus-Miqu-v0.1-70B

Model Overview

Nimbus-Miqu-v0.1-70B is a 69 billion parameter language model developed by invisietch, built upon the Miqu architecture. It is a merge of several models, including Moist Miqu, elinas/chronos-70b-v2, Sao10K/Euryale-1.3-L2-70B, and crestf411/sunfall-midnight-miqu-v0.2-v1.5-70B. The primary goal of this merge is to enhance creative writing and roleplay capabilities, specifically by integrating the creative strengths of Midnight Miqu with the ability to handle more negative or unaligned content from Euryale and Chronos, aiming for a balanced output.

Key Capabilities

• Creative Writing & Roleplay: Primarily designed and tested for generating engaging and nuanced creative narratives and roleplay scenarios.
• Context Length: Comfortable with context lengths up to 32,000 tokens, suitable for extended storytelling.
• Reduced Positivity Bias: Attempts to mitigate the positivity bias often found in creative models by incorporating 'negativity-capable' base models.
• Prompting Flexibility: Supports Alpaca, ChatML, and Vicuna prompting formats, with ChatML being the most tested.
• "Diamond Law" Support: Can be prompted to follow "The Diamond Law" to minimize "GPTisms" in generated text, though success is not 100%.

Use Cases & Limitations

• Good for: Creative writing, roleplaying, and generating diverse narrative content, including potentially explicit or disturbing themes.
• Not for: This model has not been tested for other use cases beyond creative writing and roleplay.
• Disclaimer: Built on an unofficially leaked Mistral model base, it is suitable for non-commercial, personal use only. The model is noted as fairly unaligned and can produce explicit, disturbing, or offensive responses.