QuantumIntelligence/QI-mistral-7B-slerp

TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:8kLicense:apache-2.0Architecture:Transformer0.0K Open Weights Cold

The QuantumIntelligence/QI-mistral-7B-slerp is a 7 billion parameter language model based on the Mistral architecture, developed by QuantumIntelligence. This model is a merge of several DPO fine-tuned models using the SLERP method, specifically incorporating OpenPipe/mistral-ft-optimized-1218 and mlabonne/NeuralHermes-2.5-Mistral-7B. It features an 8192-token context length and is particularly optimized for processing the Korean language, making it suitable for various Korean-centric applications.

Loading preview...

QI-mistral-7B-slerp Overview

QuantumIntelligence/QI-mistral-7B-slerp is a 7 billion parameter language model built upon the Mistral architecture. It distinguishes itself by being a merged model, created using the SLERP (Spherical Linear Interpolation) method to combine the strengths of two DPO (Direct Preference Optimization) fine-tuned models: OpenPipe/mistral-ft-optimized-1218 and mlabonne/NeuralHermes-2.5-Mistral-7B.

Key Capabilities

  • Korean Language Proficiency: The model demonstrates relatively strong performance in processing the Korean language, making it a valuable asset for applications requiring Korean text understanding and generation.
  • Merged Architecture: Leverages the mergekit tool and the SLERP method to combine different fine-tuned models, aiming for a synergistic performance improvement.
  • Versatile Applications: Suitable for a range of tasks including sentiment analysis, summarization, question answering, and chatbot interactions, particularly with Korean input.

Good For

  • Developers building applications that require robust Korean language processing.
  • Tasks such as sentiment classification, text summarization, and conversational AI in Korean.
  • Experimenting with merged models for specific language or domain optimizations.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p