appvoid/cloud-04
appvoid/cloud-04 is a 0.35 billion parameter language model created by appvoid through a merge of pre-trained models using the DARE TIES method. It integrates components from appvoid/palmer-005-core, squ11z1/claude-oss-350m, and mkurman/LiquidAI-LFM2.5-350M-SYNTH, built upon MihaiPopa-1/LFM2.5-350M-heretic as its base. This merged model is designed for general language tasks, leveraging the combined strengths of its constituent models.
Loading preview...
Overview
appvoid/cloud-04 is a 0.35 billion parameter language model developed by appvoid. It was created using the DARE TIES merge method, a technique for combining multiple pre-trained language models. The base model for this merge was MihaiPopa-1/LFM2.5-350M-heretic.
Merge Details
This model integrates three distinct models to achieve its capabilities:
The merge process utilized specific weighting and density parameters for each component model, with squ11z1/claude-oss-350m contributing the highest weight (0.28) and density (0.38). The configuration also specified bfloat16 data type and enabled int8_mask for parameter normalization.
Use Cases
As a merged model, appvoid/cloud-04 is suitable for a range of general language understanding and generation tasks, benefiting from the diverse characteristics of its constituent models. Its compact size (0.35B parameters) makes it efficient for deployment in resource-constrained environments.