unconst/Affine-5czsc2fc98-r561-r252-odpo-hirank-softctx-midextra-merged
Affine-5czsc2fc98-r561-r252-odpo-hirank-softctx-midextra-merged is a 35.1 billion parameter language model developed by unconst, derived from a LoRA merge of kevin954/Affine-5dfqbbh8ev-sft. This model features a substantial context length of 32768 tokens, indicating its capability for processing extensive inputs. It is primarily intended for internal development and evaluation within a private TTL insurance context, serving as a salvaged checkpoint for further refinement.
Loading preview...
Overview
The unconst/Affine-5czsc2fc98-r561-r252-odpo-hirank-softctx-midextra-merged is a 35.1 billion parameter language model. It was created by unconst through a LoRA merge process, specifically from the kevin954/Affine-5dfqbbh8ev-sft checkpoint. This model is characterized by its large context window of 32768 tokens, allowing it to handle and process very long sequences of text.
Key Characteristics
- Parameter Count: 35.1 billion parameters, indicating a substantial capacity for complex language understanding and generation tasks.
- Context Length: Features a 32768-token context window, which is beneficial for applications requiring extensive memory or processing of long documents and conversations.
- Origin: Developed as a merged checkpoint, specifically a LoRA merge from a prior Affine model variant.
Intended Use
This model is currently designated for internal use within a private TTL insurance context. It serves as a salvaged checkpoint, implying its role in ongoing development and evaluation rather than immediate public deployment. Its status as "not a submission until Stage-5 gate clears" suggests it is undergoing rigorous internal testing and validation.