Undi95/ReMM-v2-L2-13B-VARIANT

TEXT GENERATIONConcurrency Cost:1Model Size:13BQuant:FP8Ctx Length:4kLicense:cc-by-nc-4.0Architecture:Transformer Open Weights Cold

Undi95/ReMM-v2-L2-13B-VARIANT is a 13 billion parameter language model, a variant of ReMM v2, created by Undi95. This model is a merge of Chronos-Beluga v2, Nous-Hermes-Llama2, Huginn, and notably, a higher weighting of Spicyboros-13b-2.2 as its base. It is designed for general text generation tasks, leveraging the combined strengths of its constituent models.

Loading preview...

Undi95/ReMM-v2-L2-13B-VARIANT Overview

Undi95/ReMM-v2-L2-13B-VARIANT is a 13 billion parameter language model, representing a specialized variant of the ReMM v2 series. This model is a sophisticated merge of several prominent 13B models, with a particular emphasis on the jondurbin/spicyboros-13b-2.2 component, which serves as its base with increased weight.

Key Components and Merging Strategy

This model integrates the following foundational models:

  • The-Face-Of-Goonery/Chronos-Beluga-v2-13bfp16
  • NousResearch/Nous-Hermes-Llama2-13b
  • The-Face-Of-Goonery/Huginn-13b-v1.2
  • jondurbin/spicyboros-13b-2.2 (given more weight as the base)

The merging strategy specifically prioritizes Spicyboros-13b-2.2, suggesting an optimization towards the characteristics and capabilities of that model, while still benefiting from the diverse strengths of Chronos-Beluga v2, Nous-Hermes-Llama2, and Huginn.

Prompt Template

The model utilizes the Alpaca prompt template, making it compatible with instructions formatted as:

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

Good for

  • General text generation and conversational AI tasks.
  • Applications requiring a blend of capabilities from its constituent models, particularly those leaning towards the strengths of Spicyboros.
  • Developers familiar with the Alpaca instruction format.

Finetunes
2 models