appvoid/cloud-06
appvoid/cloud-06 is a 0.35 billion parameter language model created by appvoid, merged using the DARE TIES method with MihaiPopa-1/LFM2.5-350M-heretic as its base. This model integrates capabilities from mkurman/LiquidAI-LFM2.5-350M-SYNTH, appvoid/palmer-005-core, and squ11z1/claude-oss-350m. With a 32768 token context length, it is designed for general language tasks, leveraging the combined strengths of its constituent models.
Loading preview...
Overview
appvoid/cloud-06 is a 0.35 billion parameter language model developed by appvoid, created through a merge of several pre-trained models using the DARE TIES method. This merging technique, detailed in the DARE TIES paper, combines the strengths of multiple models into a single, more capable entity. The base model for this merge was MihaiPopa-1/LFM2.5-350M-heretic.
Merge Details
The model integrates components from three distinct models:
- mkurman/LiquidAI-LFM2.5-350M-SYNTH
- appvoid/palmer-005-core
- squ11z1/claude-oss-350m
The merge configuration utilized specific weight and density parameters for each contributing model, with bfloat16 dtype and int8_mask enabled. This approach aims to leverage the diverse capabilities of the merged models, offering a versatile solution for various language processing tasks.
Use Cases
Given its architecture and the nature of its constituent models, appvoid/cloud-06 is suitable for general-purpose language generation and understanding tasks where a compact yet capable model is required. Its 32768 token context length allows for processing longer inputs and generating more coherent, extended outputs.