Kukedlc/NeuralSynthesis-7B-v0.2

TEXT GENERATIONConcurrent Unit Cost:1Model Size:7BQuant:FP8Context Size:8kTool Calling:SupportedPublished:Apr 6, 2024License:apache-2.0Architecture:Transformer Open Weights Featherless Exclusive Cold

Kukedlc/NeuralSynthesis-7B-v0.2 is a 7 billion parameter language model created by Kukedlc, built as a merge of multiple specialized models including Fasciculus-Arcuatus-7B-slerp and Neural-4-QA-7b. This model leverages a 'model_stock' merge method to combine diverse capabilities, offering a versatile foundation for various natural language processing tasks. With an 8192 token context length, it is designed for general-purpose text generation and understanding.

Loading preview...

NeuralSynthesis-7B-v0.2 Overview

NeuralSynthesis-7B-v0.2 is a 7 billion parameter language model developed by Kukedlc. This model is a result of a sophisticated merge operation, combining several specialized base models using the 'model_stock' merge method. It integrates components from models such as Kukedlc/Fasciculus-Arcuatus-7B-slerp, Gille/StrangeMerges_30-7B-slerp, automerger/OgnoExperiment27-7B, Kukedlc/Jupiter-k-7B-slerp, and Kukedlc/Neural-4-QA-7b, building upon its predecessor, NeuralSynthesis-7B-v0.1.

Key Characteristics

  • Merged Architecture: Utilizes a 'model_stock' merge method to combine the strengths of multiple distinct models, aiming for enhanced general-purpose performance.
  • Parameter Count: Features 7 billion parameters, balancing performance with computational efficiency.
  • Context Length: Supports an 8192 token context window, suitable for processing moderately long inputs and generating coherent responses.
  • Base Model: Built upon Kukedlc/NeuralSynthesis-7B-v0.1, indicating an iterative development approach.

Potential Use Cases

Given its merged nature and general-purpose design, NeuralSynthesis-7B-v0.2 is suitable for a range of applications, including:

  • Text Generation: Creating diverse forms of text, from creative writing to informative content.
  • Question Answering: Leveraging components like 'Neural-4-QA-7b' for improved factual recall and response generation.
  • General NLP Tasks: Serving as a foundational model for various natural language understanding and generation tasks.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p