unconst/Affine-5czsc2fc98-r213-merged
unconst/Affine-5czsc2fc98-r213-merged is a 35.1 billion parameter language model, merged from `kevin954/Affine-5dfqbbh8ev-sft`. This model has a context length of 32768 tokens. It is a checkpoint salvage from a LoRA merge, intended for private use and not yet a public submission. Its primary purpose is for internal evaluation within a specific development gate.
Loading preview...
Overview
This model, unconst/Affine-5czsc2fc98-r213-merged, is a 35.1 billion parameter language model with a substantial context length of 32768 tokens. It represents a merged checkpoint, specifically salvaged from a LoRA merge originating from kevin954/Affine-5dfqbbh8ev-sft. The model is currently designated for private use and is not intended as a public submission until it clears a specific Stage-5 gate.
Key Characteristics
- Parameter Count: 35.1 billion parameters, indicating a large-scale model capable of complex language understanding and generation.
- Context Length: Features a 32768-token context window, allowing it to process and generate longer sequences of text while maintaining coherence.
- Origin: Derived from a LoRA merge of
kevin954/Affine-5dfqbbh8ev-sft, suggesting it incorporates fine-tuning or adaptation layers.
Intended Use
This model is primarily for internal evaluation and development within a private context. It is not yet released for general public use and is undergoing a specific gating process.