trinhkhng/slerp_Merged_Qwen2-0.5B_0.5

TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Aug 6, 2026Architecture:Transformer Featherless Exclusive Cold

trinhkhng/slerp_Merged_Qwen2-0.5B_0.5 is a 0.5 billion parameter language model created by trinhkhng, resulting from a SLERP merge of two Qwen2-0.5B variants. This model combines the characteristics of a base Qwen2-0.5B model with a debiased version, aiming to integrate their respective strengths. It is suitable for applications requiring a compact, merged Qwen2-based model with a 32768-token context length.

Loading preview...

Model Overview

trinhkhng/slerp_Merged_Qwen2-0.5B_0.5 is a 0.5 billion parameter language model developed by trinhkhng. It was created using the mergekit tool, specifically employing the SLERP (Spherical Linear Interpolation) merge method.

Merge Details

This model is a composite of two distinct Qwen2-0.5B models:

  • A base /kaggle/working/Qwen2-0.5B model.
  • A debiased /kaggle/working/debias_Qwen2-0.5B variant.

The SLERP method was applied with a t parameter of 0.5, indicating an equal weighting or interpolation between the two merged models. This approach aims to combine the features and characteristics of both the standard and debiased Qwen2-0.5B versions into a single, unified model.

Key Characteristics

  • Architecture: Based on the Qwen2 family.
  • Parameter Count: 0.5 billion parameters, making it a compact model.
  • Context Length: Supports a substantial context window of 32768 tokens.
  • Merge Method: Utilizes SLERP for a balanced integration of source models.

Use Cases

This model is particularly suitable for:

  • Resource-constrained environments: Its small size (0.5B parameters) allows for efficient deployment.
  • Applications requiring a blend of base and debiased characteristics: The SLERP merge suggests an attempt to balance general performance with reduced bias.
  • Experimentation with merged models: Developers can explore the effects of SLERP merging on Qwen2-0.5B variants.

Finetunes
1 models