leandronunes/qwen3.8-4b-a1-dare-ties
The leandronunes/qwen3.8-4b-a1-dare-ties model is a 4.5 billion parameter language model, merged from Qwen3.5-4B, Qwen3.8-4B-Distill, and Agents-A1-4B using the DARE-TIES method. It is designed to combine strong logical deduction capabilities with agentic reasoning, making it suitable for complex problem-solving tasks. This model also features a multimodal vision tower and a hybrid attention architecture, supporting a substantial context length of 262,144 tokens.
Loading preview...
Model Overview
leandronunes/qwen3.8-4b-a1-dare-ties is a 4.5 billion parameter language model created by leandronunes through a DARE-TIES merge. It combines the strengths of Qwen3.8-4B-Distill (known for logical deduction) and InternScience/Agents-A1-4B (for agentic capabilities), built upon the Qwen3.5-4B base.
Key Capabilities & Features
- Enhanced Reasoning: Aims to integrate strong logical deduction (from
Qwen3.8-4B-Distill's 78% on BBH Logical Deduction) with agentic reasoning (fromAgents-A1-4B's 38% on BBH Causal Judgement). - Multimodal (VLM): Includes a 24-block vision tower in addition to the language model, enabling visual understanding.
- Hybrid Attention Architecture: Utilizes a unique structure of 3
linear_attention(Gated DeltaNet) layers followed by 1full_attention, repeated 8 times. - Extended Context Window: Supports a very large context length of 262,144 tokens (256K).
- Configurable Thinking Mode: Offers an
enable_thinkingoption to control extended reasoning behavior.
Why Choose This Model?
This model is particularly well-suited for applications requiring a blend of:
- Complex Problem Solving: Where both step-by-step logical deduction and high-level agentic planning are crucial.
- Multimodal Understanding: For tasks that involve processing both text and visual inputs.
- Long Context Processing: Its 256K context window makes it ideal for handling extensive documents or conversations.
While specific benchmark results for the merged model are pending, its design targets improved performance in areas demanding sophisticated reasoning.