trinhkhng/slerp_Merged_Qwen2-0.5B_0.2
TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Aug 6, 2026Architecture:Transformer Featherless Exclusive Cold
trinhkhng/slerp_Merged_Qwen2-0.5B_0.2 is a 0.5 billion parameter language model based on the Qwen2 architecture, created by merging two Qwen2-0.5B models using the SLERP method. This model integrates a debiased version of Qwen2-0.5B, aiming to incorporate its characteristics. It supports a context length of 32768 tokens, making it suitable for tasks requiring moderate context understanding.
Loading preview...
Model Overview
trinhkhng/slerp_Merged_Qwen2-0.5B_0.2 is a 0.5 billion parameter language model derived from the Qwen2 architecture. It was created using the SLERP merge method from mergekit, combining two distinct Qwen2-0.5B models.
Key Characteristics
- Architecture: Based on the Qwen2 model family.
- Parameter Count: Features 0.5 billion parameters, making it a relatively compact model.
- Context Length: Supports a substantial context window of 32768 tokens.
- Merge Method: Utilizes the Spherical Linear Interpolation (SLERP) technique for merging, which is known for smoothly combining model weights.
- Merged Components: The model is a blend of a base Qwen2-0.5B model and a specifically debiased Qwen2-0.5B variant, suggesting an intent to leverage the characteristics of the debiased component.
Potential Use Cases
This model could be suitable for applications where:
- A smaller, efficient language model is preferred due to resource constraints.
- Tasks benefit from a moderate context window (32768 tokens).
- The integrated characteristics from a debiased model are advantageous for specific content generation or understanding tasks.