shimbaaa/Qwen-Dumb-Merged

TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Sep 2, 2026License:apache-2.0Architecture:Transformer Open Weights Featherless Exclusive Cold

shimbaaa/Qwen-Dumb-Merged is a 0.5 billion parameter Qwen2.5-based instruction-tuned causal language model, developed by shimbaaa. This model was fine-tuned using Unsloth and Huggingface's TRL library, enabling faster training. It is designed for general instruction-following tasks, leveraging its compact size for efficient deployment.

Loading preview...

Model Overview

shimbaaa/Qwen-Dumb-Merged is a 0.5 billion parameter instruction-tuned language model based on the Qwen2.5 architecture. It was developed by shimbaaa and fine-tuned from the unsloth/qwen2.5-0.5b-instruct-unsloth-bnb-4bit model.

Key Characteristics

  • Architecture: Qwen2.5-based, a causal language model.
  • Parameter Count: 0.5 billion parameters, making it a compact and efficient model.
  • Training Efficiency: Fine-tuned using Unsloth and Huggingface's TRL library, which facilitated a 2x faster training process.
  • Context Length: Supports a context length of 32768 tokens.

Intended Use Cases

This model is suitable for applications requiring a smaller, efficient instruction-following model. Its compact size and optimized training process make it a good candidate for:

  • Rapid prototyping and experimentation.
  • Deployment in resource-constrained environments.
  • General instruction-following tasks where a larger model might be overkill.

Finetunes
1 models