DavidAU/MN-Dark-Planet-TITAN-12B

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:12BQuant:FP8Ctx Length:32kPublished:Oct 8, 2024Architecture:Transformer0.0K Warm

DavidAU/MN-Dark-Planet-TITAN-12B is a 12 billion parameter model provided in full precision source code, designed for generating various quantized formats like GGUF, GPTQ, EXL2, AWQ, and HQQ. This model emphasizes the importance of specific parameter and sampler settings for optimal operation across different AI/LLM applications. It is intended for users who require flexibility in model formats and are willing to fine-tune operational settings for enhanced performance.

Loading preview...

MN-Dark-Planet-TITAN-12B Overview

DavidAU/MN-Dark-Planet-TITAN-12B is a 12 billion parameter model distributed as full precision source code, enabling conversion to various quantized formats including GGUF, GPTQ, EXL2, AWQ, and HQQ. The primary focus of this model's release is to highlight the critical role of specific operational settings, such as parameters and samplers, in achieving optimal performance across diverse AI/LLM applications.

Key Characteristics & Usage

  • Format Flexibility: Provided as source code, allowing users to generate multiple quantized versions.
  • Settings-Dependent Performance: Emphasizes that model performance is significantly influenced by correct parameter, sampler, and advanced sampler configurations.
  • "Class 1" Model: Categorized as a "Class 1" model, indicating that specific settings will enhance its operation.
  • Guidance for Optimization: Directs users to a dedicated document for detailed guidance on maximizing model performance, applicable to all quants and full precision, and for various use cases including chat and roleplay.

Important Considerations

  • Users are strongly advised to review the provided "Maximizing Model Performance" document to understand the optimal settings for this model, especially for use cases beyond its initial design.
  • The model's full information, including context limits, special usage notes, and details about its creation, is available on its associated GGUF repository.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p