KoboldAI/LLaMA2-13B-Holomax
KoboldAI/LLaMA2-13B-Holomax is a 13 billion parameter language model, an expansion merge of Gryphe's Mythomax and MrSeeker's KoboldAI Holodeck models. This model is specifically optimized for enhancing story writing capabilities and creative text generation, while retaining the desirable traits of its base models. It excels in fiction writing, chatting, and text adventures, supporting a 4096-token context length.
Loading preview...
KoboldAI/LLaMA2-13B-Holomax: A Story-Focused LLaMA 2 Merge
This 13 billion parameter model is a strategic merge (60% Mythomax by Gryphe, 40% Holodeck by Mr.Seeker) designed to significantly enhance story writing and creative text generation. It aims to preserve the strong conversational and general language understanding of Mythomax while injecting the creative flair of Holodeck.
Key Capabilities
- Enhanced Story Writing: Specifically tuned for generating engaging narratives and creative content.
- Chatting and Text Adventures: Testers found it effective for interactive conversations and text-based games in Instruction mode.
- Flexible Usage: Designed for co-writing, various instruct formats (tested with Alpaca), and regular chatting.
- Context Length: Supports a 4096-token context window.
Good For
- Creative Writers: Ideal for generating fiction, plotlines, character dialogues, and descriptive passages.
- Role-playing and Interactive Fiction: Excels in text adventures and scenarios requiring dynamic, imaginative responses.
- General Chat Applications: Maintains strong performance in conversational tasks, though chat reply length may be limited compared to some base models.
Limitations
- Factual Knowledge: Preservation of factual knowledge has not been a primary focus and is not extensively tested; base models may be superior for fact-retrieval tasks.
Licensing Note
This model's licensing is complex due to its merged origins, including components under LLaMA 2, AGPLv3, and non-commercial clauses. It is currently distributed under the assumption that all involved authors intend for it to be licensed with commercial restrictions / LLaMA 2 restrictions, but with the further rights and freedoms granted by AGPLv3. Users should review the full README for detailed licensing information.