NeuralNovel/Ignis-7B-DPO-Laser

TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:8kPublished:Feb 25, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Cold

NeuralNovel/Ignis-7B-DPO-Laser is a 7 billion parameter language model developed by NeuralNovel, trained on the Neural-DPO dataset. This model utilizes Direct Preference Optimization (DPO) and is designed for general language generation tasks. Its training methodology focuses on aligning model outputs with human preferences, making it suitable for applications requiring nuanced and preferred responses. The model has an 8192 token context length.

Loading preview...

Ignis-7B-DPO-Laser Overview

Ignis-7B-DPO-Laser is a 7 billion parameter language model developed by NeuralNovel, with community support from ConvexAI. It was trained using the Direct Preference Optimization (DPO) method on the Neural-DPO dataset, leveraging A-100 80GB GPUs. This training approach aims to enhance the model's ability to generate responses that are aligned with human preferences, making it a strong candidate for tasks where output quality and user satisfaction are paramount.

Key Capabilities

  • Preference-Aligned Generation: Optimized through DPO to produce outputs that are generally preferred by humans.
  • General Language Tasks: Capable of handling a wide range of natural language processing tasks.
  • Efficient Parameter Count: At 7 billion parameters, it offers a balance between performance and computational efficiency.
  • Extended Context Window: Supports an 8192-token context length, allowing for processing longer inputs and maintaining coherence over extended conversations or documents.

Good For

  • Applications requiring high-quality, human-preferred text generation.
  • Tasks benefiting from a model trained with Direct Preference Optimization.
  • General-purpose language understanding and generation where a 7B parameter model is suitable.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p