trinhkhng/linear_Merged_Qwen2-0.5B_0.0

TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Aug 6, 2026Architecture:Transformer Featherless Exclusive Cold

trinhkhng/linear_Merged_Qwen2-0.5B_0.0 is a 0.5 billion parameter language model created by trinhkhng using the Linear merge method from mergekit. This model combines two Qwen2-0.5B variants, specifically merging a debiased version with the base model. With a 32768 token context length, it is designed for general language tasks, leveraging the Qwen2 architecture for efficient processing.

Loading preview...

Model Overview

trinhkhng/linear_Merged_Qwen2-0.5B_0.0 is a 0.5 billion parameter language model developed by trinhkhng. It was constructed using the Linear merge method via the mergekit tool, combining two distinct Qwen2-0.5B models.

Merge Details

This model is a result of merging:

  • A debiased version of Qwen2-0.5B (/kaggle/working/debias_Qwen2-0.5B)
  • The base Qwen2-0.5B model (/kaggle/working/Qwen2-0.5B)

The merge configuration applied a weight of 1.0 to the base Qwen2-0.5B and a weight of 0.0 to the debiased variant, indicating a primary reliance on the base model's characteristics. The tokenizer from the base Qwen2-0.5B was utilized, and the model supports a context length of 32768 tokens.

Potential Use Cases

Given its architecture and parameter count, this model is suitable for:

  • General text generation and understanding tasks where a smaller, efficient model is preferred.
  • Experimentation with merged models to understand the effects of different merging strategies.
  • Applications requiring a moderate context window for processing longer inputs.

Finetunes
1 models