unconst/Affine-5czsc2fc98-r373-offline-dpo-hialpha-longctx-hirank-merged
The unconst/Affine-5czsc2fc98-r373-offline-dpo-hialpha-longctx-hirank-merged model is a 35.1 billion parameter language model with a 32768 token context length. It is a LoRA-merged checkpoint derived from kevin954/Affine-5dfqbbh8ev-sft. This model is currently a private, salvaged checkpoint, not intended for general public use or as a formal submission.
Loading preview...
Model Overview
The unconst/Affine-5czsc2fc98-r373-offline-dpo-hialpha-longctx-hirank-merged is a 35.1 billion parameter language model featuring an extended context length of 32768 tokens. This particular iteration is a LoRA-merged checkpoint, originating from the kevin954/Affine-5dfqbbh8ev-sft base model.
Key Characteristics
- Parameter Count: 35.1 billion parameters, indicating a substantial capacity for complex language understanding and generation tasks.
- Context Length: Supports a long context window of 32768 tokens, enabling the model to process and generate coherent text over extended conversations or documents.
- Origin: It is a merged checkpoint, specifically a LoRA (Low-Rank Adaptation) merge, suggesting fine-tuning or adaptation from a prior base model.
Current Status
This model is described as a "private TTL insurance" and a "salvaged checkpoint." It is explicitly noted as not a formal submission until a "Stage-5 gate clears." This implies it is an internal or developmental version, not yet released for broader public use or evaluation. Users should be aware that its current status indicates it is not a finalized or officially supported model.