theocolf/Vora-Socratic-10.4B
TEXT GENERATIONConcurrent Unit Cost:1Model Size:15BQuant:FP8Context Size:8kTool Calling:SupportedPublished:Jul 10, 2026Architecture:Transformer Featherless Exclusive Cold
theocolf/Vora-Socratic-10.4B is a 15 billion parameter language model created by theocolf, merged using the Passthrough method from theocolf/Vora-X-10B. This model is a result of combining specific layer ranges of its base model, offering a specialized configuration for language generation tasks. Its architecture is designed for general-purpose text generation, leveraging the strengths of its merged components.
Loading preview...
Model Overview
theocolf/Vora-Socratic-10.4B is a 15 billion parameter language model developed by theocolf. It was created through a Passthrough merge using mergekit, combining specific layer ranges from the base model, theocolf/Vora-X-10B.
Key Characteristics
- Merge Method: Utilizes the Passthrough merge method, which selectively combines layers from a source model.
- Base Model: Derived from
theocolf/Vora-X-10B, indicating a foundation built upon an existing robust language model. - Configuration: The merge process involved two slices from
theocolf/Vora-X-10B, specifically layer ranges[0, 32]and[16, 32], suggesting a focus on integrating and potentially reinforcing certain learned representations. - Precision: Configured to use
float16data type, which is common for efficient inference on modern hardware.
When to Use This Model
Given its merged nature and foundation on Vora-X-10B, this model is suitable for:
- General text generation: Capable of various language tasks where a large parameter count is beneficial.
- Experimentation with merged models: Ideal for developers interested in exploring the effects of specific layer merging strategies.
- Applications requiring a specialized configuration: Its unique merge configuration might offer distinct performance characteristics compared to its base model.