Sorihon/Celestial-Order-24B-V3
Sorihon/Celestial-Order-24B-V3 is a 24 billion parameter language model developed by Sorihon, created by merging previous Celestial-Order versions using the Karcher Mean method. This model integrates the strengths of its predecessors, Celestial-Order-V2.75, Celestial-Order-V2.5, and Celestial-Order-24B-V2. It is designed to leverage the combined capabilities of these models, offering a consolidated and potentially enhanced performance profile for various language tasks.
Loading preview...
Overview
Sorihon/Celestial-Order-24B-V3 is a 24 billion parameter language model developed by Sorihon. This model was constructed using the Karcher Mean merge method, integrating multiple pre-trained language models to combine their respective strengths.
Merge Details
Celestial-Order-24B-V3 is a direct successor, incorporating knowledge from:
/home/sorihon/Documents/Celestial-Order-V2.75/home/sorihon/Documents/Celestial-Order-V2.5- Sorihon/Celestial-Order-24B-V2
This merging strategy aims to consolidate and potentially enhance the overall performance and capabilities derived from its constituent models. The merge was performed using mergekit with a bfloat16 data type configuration.
Potential Use Cases
Given its architecture as a merge of prior versions, Celestial-Order-24B-V3 is likely suitable for general language understanding and generation tasks, benefiting from the combined knowledge of its predecessors. Developers looking for a consolidated model based on the Celestial-Order series may find this version particularly useful.