Model Overview

nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B-v2 is a 12 billion parameter language model derived from the axolotl-ai-co/romulus-mistral-nemo-12b-simpo base model. This iteration has been specifically fine-tuned by nbeerbower.

Training Details

The model underwent ORPO (Odds Ratio Preference Optimization) tuning for 3 epochs, utilizing two A100 GPUs. The training leveraged two distinct datasets:

• jondurbin/gutenberg-dpo-v0.1
• nbeerbower/gutenberg2-dpo

This specialized training approach, combining the Mistral-Nemo architecture with DPO-aligned literary datasets, suggests a focus on generating high-quality, preference-aligned text, potentially with a literary or narrative style.

Potential Use Cases

• Creative Writing: Generating stories, poems, or other literary content.
• Text Refinement: Improving the style and coherence of existing text.
• Preference-Aligned Generation: Tasks where output quality is judged by human preference, benefiting from DPO training.