trinhkhng/nearswap_Merged_Qwen2-0.5B_0.2

TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Aug 6, 2026Architecture:Transformer Featherless Exclusive Cold

trinhkhng/nearswap_Merged_Qwen2-0.5B_0.2 is a 0.5 billion parameter language model created by trinhkhng, merged using the NearSwap method with a Qwen2-0.5B base. This model integrates /kaggle/working/debias_Qwen2-0.5B, suggesting a focus on specific characteristic adjustments rather than broad new capabilities. It is suitable for applications requiring a compact model with a 32768-token context length, where the effects of the NearSwap merge are beneficial.

Loading preview...

Model Overview

trinhkhng/nearswap_Merged_Qwen2-0.5B_0.2 is a compact 0.5 billion parameter language model, developed by trinhkhng. It was constructed using the NearSwap merge method, building upon a Qwen2-0.5B base model. This merging technique combines pre-trained language models to potentially enhance or modify specific behaviors.

Key Characteristics

  • Architecture: Based on the Qwen2-0.5B model family.
  • Parameter Count: 0.5 billion parameters, making it suitable for resource-constrained environments.
  • Context Length: Supports a substantial context window of 32768 tokens.
  • Merge Method: Utilizes the NearSwap method, with a specific configuration that includes /kaggle/working/debias_Qwen2-0.5B as an additional merged component.

Use Cases

This model is particularly relevant for developers and researchers interested in:

  • Exploring the effects of the NearSwap merging technique on smaller language models.
  • Applications requiring a model with a 0.5B parameter count and a large context window.
  • Scenarios where the specific characteristics introduced by merging /kaggle/working/debias_Qwen2-0.5B are advantageous.

Finetunes
1 models