2.5 is a slight modification of MagicalGirl-2 to include R1 to try and make it feel less dumb and more smart. This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [KaraKaraWitch/Llama-3.X-Workout-70B](https://huggingface.co/KaraKaraWitch/Llama-3.X-Workout-70B) as a base. ### Models Merged The following models were included in the merge: * [LatitudeGames/Wayfarer-Large-70B-Llama-3.3](https://huggingface.co/LatitudeGames/Wayfarer-Large-70B-Llama-3.3) * [KaraKaraWitch/Llama-MiraiFanfare-3.3-70B](https://huggingface.co/KaraKaraWitch/Llama-MiraiFanfare-3.3-70B) * [Black-Ink-Guild/Pernicious_Prophecy_70B](https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B) * [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1) * [huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated) * [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated - model: SicariusSicariiStuff/Negative_LLAMA_70B - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1 - model: KaraKaraWitch/Llama-MiraiFanfare-3.3-70B - model: Black-Ink-Guild/Pernicious_Prophecy_70B - model: LatitudeGames/Wayfarer-Large-70B-Llama-3.3 merge_method: sce base_model: KaraKaraWitch/Llama-3.X-Workout-70B parameters: select_topk: 1.0 dtype: bfloat16 ```

New