Eric111/MistInst-v0.2_ochat-3.5-0106_dpo-binarized-NeuralTrix-7B

TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:4kPublished:Mar 6, 2024License:apache-2.0Architecture:Transformer Open Weights Cold

Eric111/MistInst-v0.2_ochat-3.5-0106_dpo-binarized-NeuralTrix-7B is a 7 billion parameter language model created by Eric111, resulting from a slerp merge of Mistral-7B-Instruct-v0.2_openchat-3.5-0106 and dpo-binarized-NeuralTrix-7B. This model combines the strengths of its base components, leveraging a 4096 token context length. It is designed for general language generation and instruction-following tasks, benefiting from the merged architectures.

Loading preview...

Model Overview

Eric111/MistInst-v0.2_ochat-3.5-0106_dpo-binarized-NeuralTrix-7B is a 7 billion parameter language model developed by Eric111. This model is a product of a slerp merge operation, combining two distinct base models:

  • Eric111/Mistral-7B-Instruct-v0.2_openchat-3.5-0106
  • eren23/dpo-binarized-NeuralTrix-7B

This merging strategy aims to integrate the capabilities and characteristics of both source models into a single, more versatile model. The merge process specifically applied different interpolation values across self-attention and MLP layers, indicating a nuanced approach to combining their respective strengths.

Key Characteristics

  • Architecture: Based on the Mistral 7B family, enhanced through merging.
  • Parameter Count: 7 billion parameters.
  • Context Length: Supports a context window of 4096 tokens.
  • Training Method: The inclusion of "dpo-binarized" in one of the base models suggests a foundation in Direct Preference Optimization (DPO) techniques, likely contributing to improved instruction following and response quality.

Potential Use Cases

This model is suitable for a range of applications requiring a capable 7B instruction-tuned model, including:

  • General-purpose text generation.
  • Instruction following and conversational AI.
  • Tasks benefiting from a blend of different fine-tuning approaches.