Dans-Archive/Dans-QuestionableCocktail-2-13b
Dans-Archive/Dans-QuestionableCocktail-2-13b is a 13 billion parameter language model created by Dans-Archive, built by merging Llama-2-chat with Holodeck and Chronos. This model aims to introduce novel prose and structuring into the Llama-2-chat base while retaining its core capabilities. It is designed for generating creative text with a distinct style, making it suitable for experimental text generation tasks.
Loading preview...
Model Overview
Dans-QuestionableCocktail-2-13b is a 13 billion parameter language model developed by Dans-Archive. It is a merged model, combining approximately 70% Llama-2-chat with 15% Holodeck and 15% Chronos. The primary goal of this merge was to infuse Llama-2-chat with more creative prose and novel text structuring without compromising its foundational strengths.
Key Characteristics
- Hybrid Architecture: Blends the robustness of Llama-2-chat with the distinct styles of Holodeck and Chronos.
- Merging Strategy: Holodeck and Chronos were first merged 50/50 into 'HoloChronos', then layer-merged into Llama-2-chat using a specific pattern:
[0.2, 0.2, 0.2, 0.2, 0.3, 0.4, 0.3, 0.2, 0.1, 0.3]. - Context Length: Supports a context length of 4096 tokens.
Recommended Usage
- Prompt Format: The creator recommends using the Llama-2-chat prompt format, though acknowledges that results may vary due to the experimental nature of model merges.
- Creative Text Generation: Ideal for use cases requiring unique prose, novel narrative structures, or experimental text outputs where a departure from standard LLM responses is desired.