SicariusSicariiStuff/Impish_Longtail_12B
Impish_Longtail_12B is a 12 billion parameter language model developed by SicariusSicariiStuff, fine-tuned from Impish_Nemo_12B. It features a 32768 token context length and is specifically optimized for improved long-context understanding and enhanced support for Slavic languages, particularly Russian. This model is designed for creative applications such as role-play, adventure generation, and general creative writing tasks.
Loading preview...
Overview
Impish_Longtail_12B is a 12 billion parameter language model developed by SicariusSicariiStuff, building upon the Impish_Nemo_12B base. The primary goal of this fine-tune was to enhance long-context understanding and expand support for Slavic languages, with a particular focus on Russian. While the developer notes that fine-tuning can lead to unpredictable changes, this version aims to offer improved capabilities in these specific areas.
Key Capabilities
- Enhanced Long Context: Theoretically offers better understanding and recall over longer conversational or narrative contexts, with a 32768 token context length.
- Multilingual Support: Provides improved performance for Russian and other Slavic languages.
- Specialized Formatting: Recommends a "SICAtxt" format for efficient character card creation and adventure descriptions in role-play scenarios.
- Creative Applications: Designed for use in role-play, adventure generation, and general creative writing tasks.
Usage Recommendations
For optimal performance, especially in long-context scenarios, specific generation settings are provided. The model supports a ChatML instruction template. It is available in various quantizations including FP16, GGUF (Static, iMatrix, High-Attention), GPTQ (4-bit-32), EXL3 (4.0 to 8.0 bpw), FP8, and ARM-optimized versions.