unconst/Affine-5czsc2fc98-r210-merged
Affine-5czsc2fc98-r210-merged is a 35.1 billion parameter language model developed by unconst, created by merging a LoRA from kevin954/Affine-5dfqbbh8ev-sft. This model is a salvaged checkpoint, intended for internal evaluation rather than general public use. Its primary characteristic is its origin as a merged LoRA, indicating potential for specialized tasks once its development stage is cleared.
Loading preview...
Overview
unconst/Affine-5czsc2fc98-r210-merged is a 35.1 billion parameter language model. It was created by merging a LoRA (Low-Rank Adaptation) from the kevin954/Affine-5dfqbbh8ev-sft checkpoint. This model is described as a "merged checkpoint salvage," indicating it is an intermediate or recovery version rather than a final, polished release.
Key Characteristics
- Parameter Count: 35.1 billion parameters.
- Context Length: Supports a context window of 32,768 tokens.
- Development Status: Currently an internal checkpoint, not intended as a public submission until further development stages are cleared.
- Origin: Derived from a LoRA merge, suggesting fine-tuning or adaptation from a base model.
Intended Use
This model is primarily for internal evaluation and development purposes. It is explicitly noted as "not a submission until Stage-5 gate clears," implying it is undergoing further testing and refinement. Developers should consider its current status as an internal, salvaged checkpoint when evaluating its suitability for external applications.