Overview

The sibutosi2010/dpo-qwen-cot-merged is a 4 billion parameter Qwen3-based instruction-tuned language model. Developed by sibutosi2010, this model was fine-tuned from unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit.

Key Characteristics

• Base Model: Qwen3 architecture.
• Parameter Count: 4 billion parameters.
• Training Efficiency: Fine-tuned using Unsloth and Huggingface's TRL library, which facilitated a 2x faster training process.
• License: Distributed under the Apache-2.0 license.

Use Cases

This model is suitable for various instruction-following applications, benefiting from its efficient training and Qwen3 foundation. Its optimized training process suggests potential for rapid iteration and deployment in scenarios requiring a capable 4B parameter model.