appvoid/cloud-02
appvoid/cloud-02 is a 0.35 billion parameter language model created by appvoid using the DARE TIES merge method. It combines appvoid/palmer-005-core, mkurman/LiquidAI-LFM2.5-350M-SYNTH, and squ11z1/claude-oss-350m, with MihaiPopa-1/LFM2.5-350M-heretic as its base. This model is designed for general language tasks, leveraging the strengths of its constituent models through a weighted merging approach.
Loading preview...
Overview
appvoid/cloud-02 is a 0.35 billion parameter language model developed by appvoid. It was created using the DARE TIES merge method from mergekit, combining several pre-trained models to leverage their collective capabilities. The base model for this merge was MihaiPopa-1/LFM2.5-350M-heretic.
Merge Details
This model integrates three distinct language models with specific weighting and density parameters:
- appvoid/palmer-005-core: Contributes with a weight of 0.28 and density of 0.38.
- mkurman/LiquidAI-LFM2.5-350M-SYNTH: Included with a weight of 0.22 and density of 0.34.
- squ11z1/claude-oss-350m: Utilized with a weight of 0.14 and density of 0.28.
The merge process employed int8_mask: true and normalize: false settings, indicating a focus on efficient parameter combination. This approach aims to create a compact yet capable model suitable for various language processing tasks, benefiting from the diverse training of its merged components.