Nubinu/Gemma4-E4B-MiniFantasy-V1
Nubinu/Gemma4-E4B-MiniFantasy-V1 is a 7.9 billion parameter 4-bit LoRA fine-tune of the Gemma-4-E4B-it-SOMPOA-heresy model, specifically optimized for roleplay and narrative generation within platforms like SillyTavern. It features a 32768 token context length and is designed to produce consistent character adherence and narrative pacing. This model excels at generating detailed, character-driven collaborative stories, leveraging a category-based Markdown structure for character cards.
Loading preview...
Nubinu/Gemma4-E4B-MiniFantasy-V1: Roleplay Optimized Gemma Fine-tune
This model is a 7.9 billion parameter 4-bit LoRA fine-tune of the MuXodious/gemma-4-E4B-it-SOMPOA-heresy base, developed by Nubinu. It is specifically engineered for enhanced roleplay and narrative generation, particularly within environments like SillyTavern, and supports a substantial 32768 token context length.
Key Capabilities & Features
- Roleplay Optimization: Fine-tuned for collaborative storytelling, focusing on consistent character embodiment, voice, and narrative pacing.
- Structured Character Adherence: Utilizes a specific Markdown-based character card format (
{{description}}block) to improve adherence to personality and lore, including detailed sections for identity, appearance, personality, speech, backstory, and goals. - Sampler Settings Guidance: Provides recommended sampler settings and a JSON preset for optimal performance in text completion interfaces like koboldcpp within SillyTavern.
- Efficient Fine-Tuning: Trained using Unsloth's PEFT/LoRA method with a LoRA rank of 32 and alpha of 32, targeting
language_layers,attention_modules, andmlp_modulesover 1 epoch. - VRAM Efficiency: Benchmarked on a 6GB VRAM laptop, with specific recommendations for 2GB VRAM users (Q4_K_M with 16K context).
Ideal Use Cases
- Interactive Storytelling: Excellent for generating dynamic, character-driven narratives.
- Roleplaying Games (RPGs): Suited for use in platforms like SillyTavern for immersive character interactions.
- Creative Writing Assistance: Can aid in developing detailed character profiles and consistent narrative arcs.