An experimental merging of Several Models using two various methods, [Ties-Merge](https://github.com/cg123/ties-merge) and [BlockMerge_Gradient](https://github.com/Gryphe/BlockMerge_Gradient) I plan for this to be the base of my Model with my own [Stheno: ERP-Based LORA] merged in, some time in the future. Stheno:
Gradient Merge of Stheno-P1 & Stheno-P2. SISTER MODEL HERE: [Stheno-Inverted-L2-13B](https://huggingface.co/Sao10K/Stheno-Inverted-L2-13B) Quants courtesy of TheBloke!
[GPTQ](https://huggingface.co/TheBloke/Stheno-L2-13B-GPTQ)
[GGUF](https://huggingface.co/TheBloke/Stheno-L2-13B-GGUF)
[GGML](https://huggingface.co/TheBloke/Stheno-L2-13B-GGML) Test Checklist:
Censorship - Fairly Uncensored
Writing - Good Prose, Fairly Descriptive
NSFW - Yes
IQ Level - Pretty Smart
Formatting - Proper Formatting with Examples Stheno-P1 [Ties-Merge]
-----[elinas/chronos-13b-v2](https://huggingface.co/elinas/chronos-13b-v2)
-----[jondurbin/airoboros-l2-13b-2.1](https://huggingface.co/jondurbin/airoboros-l2-13b-2.1)
-----[NousResearch/Nous-Hermes-Llama2-13b](https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b)+[nRuaif/Kimiko-v2 **LORA**](https://huggingface.co/nRuaif/Kimiko-v2-13B) Stheno-P2 [Ties-Merge]
-----[CalderaAI/13B-Legerdemain-L2](https://huggingface.co/CalderaAI/13B-Legerdemain-L2)+[lemonilia/limarp-llama2-v2 **LORA**](https://huggingface.co/lemonilia/limarp-llama2-v2)
-----[ehartford/WizardLM-1.0-Uncensored-Llama2-13b](https://huggingface.co/ehartford/WizardLM-1.0-Uncensored-Llama2-13b)
-----[Henk717/spring-dragon](https://huggingface.co/Henk717/spring-dragon) Most formats could work, but my tests have all been done in Alpaca format and it works well. ``` ### Instruction: Your instruction or question here. For roleplay purposes, I suggest the following - Write 's next reply in a chat between and . Write a single reply only. ### Response: ``` Below is the Illustration for the Final Merge: ![ILLUSTRATION](https://cdn-uploads.huggingface.co/production/uploads/64be6a5376a6e2efccc638c1/z4D6eun_5ee-k5Bnf0a0j.png) Once Again, thanks to [Chargoddard](https://huggingface.co/chargoddard) for his amazing and simple [ties-merge](https://github.com/cg123/ties-merge) script, and [Gryphe](https://huggingface.co/Gryphe) for their great [BlockMerge_Gradient](https://github.com/Gryphe/BlockMerge_Gradient) script. Thanks to the original model creators too! support me [here](https://ko-fi.com/sao10k) :) ``` Art by wada_kazu / わだかず (pixiv page private?) ``` # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Sao10K__Stheno-L2-13B) | Metric | Value | |-----------------------|---------------------------| | Avg. | 53.48 | | ARC (25-shot) | 61.01 | | HellaSwag (10-shot) | 83.95 | | MMLU (5-shot) | 56.33 | | TruthfulQA (0-shot) | 50.18 | | Winogrande (5-shot) | 75.14 | | GSM8K (5-shot) | 11.98 | | DROP (3-shot) | 35.76 |