Model Overview

Weyaxi/SlimOpenOrca-Mistral-7B is a 7 billion parameter language model developed by Weyaxi. This model is a merge of two base models from Open-Orca: Mistral-7B-SlimOrca and Mistral-7B-OpenOrca. The merging process utilized the ties merge method, with specific weights applied to each component model.

Merging Details

• Weights:
  • Open-Orca/Mistral-7B-SlimOrca: 0.5
  • Open-Orca/Mistral-7B-OpenOrca: 0.3
• Density:
  • Open-Orca/Mistral-7B-SlimOrca: 0.5
  • Open-Orca/Mistral-7B-OpenOrca: 0.5

This configuration aims to leverage the distinct characteristics of both SlimOrca and OpenOrca, which are known for their instruction-following and reasoning capabilities, respectively. The model operates with a context length of 4096 tokens.

Quantized Versions

For optimized deployment and reduced resource consumption, several quantized versions of SlimOpenOrca-Mistral-7B are available, thanks to TheBloke. These include:

• GPTQ: TheBloke/SlimOpenOrca-Mistral-7B-GPTQ
• GGUF: TheBloke/SlimOpenOrca-Mistral-7B-GGUF
• AWQ: TheBloke/SlimOpenOrca-Mistral-7B-AWQ

These quantized versions allow for efficient inference on various hardware setups.