Overview

Sao10K/MN-12B-Lyra-v2a1 is the initial release (Stage 1) of the Lyra v2 model series, developed by Sao10K. This version has been processed through Supervised Fine-Tuning (SFT) and a 2-step merging procedure. It is presented as a raw model, indicating ongoing development and potential for refinement in subsequent stages.

Key Characteristics

• Development Stage: Stage 1 of Lyra v2, with further development (including RL) planned.
• Current Behavior: May exhibit verbose and wordy output, similar to Claude models, which is an identified area for improvement in Stage 2.
• Prompt Format: Utilizes the ChatML prompt format for interaction.
• Known Issues: The [/INST] token may occasionally leak into responses; users are advised to add it to custom stopping strings.

Usage Recommendations

• min_p Value: A min_p value of 0.1 is suggested for stable generation.
• Temperature: A temperature range of 0.7-1.2 is recommended, allowing for user preference in output creativity.