jeiku/SOLAR_Uncensored_Luna_10.7B

TEXT GENERATIONConcurrency Cost:1Model Size:10.7BQuant:FP8Ctx Length:4kPublished:Feb 18, 2024Architecture:Transformer Cold

jeiku/SOLAR_Uncensored_Luna_10.7B is a 10.7 billion parameter language model created by jeiku, resulting from a linear merge of w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored and jeiku/Luna_LoRA_SOLAR. This model is designed for general language generation tasks, leveraging the combined strengths of its base models. It offers a 4096-token context length, making it suitable for applications requiring moderate input and output lengths. Its primary differentiator lies in its uncensored nature, allowing for broader content generation without inherent restrictions.

Loading preview...

Model Overview

jeiku/SOLAR_Uncensored_Luna_10.7B is a 10.7 billion parameter language model developed by jeiku. It was created through a linear merge using mergekit, combining two distinct base models: w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored and jeiku/Luna_LoRA_SOLAR. This merging approach aims to integrate the characteristics of both components into a single, cohesive model.

Key Characteristics

  • Parameter Count: 10.7 billion parameters, offering a balance between performance and computational requirements.
  • Context Length: Supports a context window of 4096 tokens, suitable for processing and generating moderately sized texts.
  • Uncensored Nature: Inherits an "uncensored" characteristic from one of its base models, suggesting a broader range of content generation capabilities without built-in content filters.
  • Merge Method: Utilizes the linear merge method, a technique for combining pre-trained language models.

Use Cases

This model is generally suitable for a variety of natural language processing tasks where a 10.7B parameter model with a 4096-token context window is appropriate. Its uncensored nature may make it particularly useful for applications requiring less restrictive content generation, such as creative writing, open-ended dialogue, or research into model biases and safety. Developers should consider its specific characteristics when deploying it for applications that benefit from its merged lineage and uncensored design.