SubMaroon-exp/MN-12B-Mag-Mell-Sodom-v2

TEXT GENERATIONPricing:Input $0.87 / Cached $0.2 / Output $0.99Concurrent Unit Cost:1Model Size:12BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Feb 10, 2025Architecture:Transformer Featherless Exclusive Cold

SubMaroon-exp/MN-12B-Mag-Mell-Sodom-v2 is a 12 billion parameter language model with a 32768 token context length, created by SubMaroon-exp using the TIES merge method. It is based on the Mell model and incorporates Sodom. This model is explicitly noted as non-functional and is not recommended for use.

Loading preview...

Overview

SubMaroon-exp/MN-12B-Mag-Mell-Sodom-v2 is a 12 billion parameter language model with a 32768 token context length, developed by SubMaroon-exp. This model was created using the TIES merge method, building upon the Mell model and integrating components from Sodom. The merge configuration specified a density of 0.3 and a weight of 0.15 for the Sodom model, with normalization applied during the merge process.

Key Characteristics

  • Merge Method: Utilizes the TIES merge method.
  • Base Model: Mell serves as the foundational model.
  • Integrated Model: Incorporates elements from Sodom.
  • Parameter Count: 12 billion parameters.
  • Context Length: Supports a context window of 32768 tokens.

Important Note

This model is explicitly stated as non-functional and is not recommended for download or use. The developer has indicated that it is likely junk and should not be used for any practical applications.

Finetunes
1 models