CEIA-RL/qwen3-4b-dw-lr-SLERP

TEXT GENERATIONConcurrency Cost:1Model Size:4BQuant:BF16Ctx Length:32kTool Calling:SupportedPublished:Jun 3, 2026Architecture:Transformer Cold

CEIA-RL/qwen3-4b-dw-lr-SLERP is a 4 billion parameter language model developed by CEIA-RL, created by spherically linear interpolating (SLERP) two other models: CEIA-RL/qwen3-4b-dw-lr-GRPO and CEIA-RL/qwen3-4b-dw-lr-dpo-offline. This model leverages a 32768 token context length, making it suitable for tasks requiring extensive contextual understanding. Its unique creation method suggests a focus on combining the strengths of its constituent models for enhanced performance.

Loading preview...

Overview

CEIA-RL/qwen3-4b-dw-lr-SLERP is a 4 billion parameter language model developed by CEIA-RL. This model is notable for its creation method, which involves spherically linear interpolating (SLERP) between two distinct base models: CEIA-RL/qwen3-4b-dw-lr-GRPO and CEIA-RL/qwen3-4b-dw-lr-dpo-offline. This technique aims to combine the beneficial characteristics of both parent models, potentially leading to a more robust and versatile model.

Key Characteristics

  • Parameter Count: 4 billion parameters, offering a balance between performance and computational efficiency.
  • Context Length: Supports a substantial context window of 32768 tokens, enabling the processing and generation of longer texts while maintaining coherence.
  • Interpolation Method: Utilizes SLERP, a method often employed to smoothly blend the weights of different models, suggesting an effort to achieve a synergistic outcome from its base models.

Potential Use Cases

Given its interpolated nature and significant context length, this model could be well-suited for applications that benefit from:

  • Enhanced performance: By combining two models, it may offer improved capabilities over its individual components.
  • Long-form content generation: The large context window is ideal for tasks like summarization of lengthy documents, detailed report generation, or extended conversational AI.
  • Research and experimentation: Its unique construction makes it an interesting candidate for exploring the effects of model interpolation on various NLP tasks.

Finetunes
1 models