pot99rta/OmegaPatricide-12B-DarkerDirective-Mell
OmegaPatricide-12B-DarkerDirective-Mell is a 12 billion parameter language model created by pot99rta, merged using the TIES method with redrix/patricide-12B-Unslop-Mell as its base and incorporating ReadyArt/Omega-Darker_The-Final-Directive-12B. This model is designed for general language tasks, leveraging its merged architecture to provide a versatile foundation. It supports a 32K context length, making it suitable for processing longer texts and complex prompts.
Loading preview...
Model Overview
OmegaPatricide-12B-DarkerDirective-Mell is a 12 billion parameter language model developed by pot99rta. It was created through a merge of pre-trained language models using the TIES (Trimming and Expanding Sparse) merge method, which combines the strengths of multiple base models.
Merge Details
The primary base model for this merge was redrix/patricide-12B-Unslop-Mell. Additionally, ReadyArt/Omega-Darker_The-Final-Directive-12B was included in the merging process. The configuration utilized a density and weight of 0.5 for the contributing models, with int8_mask enabled and dtype set to float16.
Usage Recommendations
Users are advised to employ either the ChatML or Mistral preset when interacting with this model. Its merged architecture aims to provide a robust foundation for various language generation and understanding tasks, benefiting from the combined characteristics of its constituent models.