Model Overview

huihui-ai/DeepSeekR1-QwQ-SkyT1-32B-Fusion-811 is a 32 billion parameter language model based on the Qwen 2.5 architecture. This model is a unique fusion of three distinct Qwen-based models, specifically:

• huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated (contributing 80%)
• huihui-ai/QwQ-32B-Preview-abliterated (contributing 10%)
• huihui-ai/Sky-T1-32B-Preview-abliterated (contributing 10%)

Key Characteristics

This model aims to leverage the combined strengths of its constituent parts. Despite being a straightforward blend, the developers note that the model produces usable output without exhibiting gibberish, indicating a successful integration of the different model components. The project also explores different blending ratios (e.g., 70:15:15 and 60:20:20) to assess their impact on model performance.

Usage

For users interested in deploying this model, it is available for use with Ollama. A direct command is provided for easy integration:

ollama run huihui_ai/deepseekr1-qwq-skyt1-fusion