Undi95/Borealis-10.7B
TEXT GENERATIONConcurrency Cost:1Model Size:10.7BQuant:FP8Ctx Length:4kPublished:Jan 19, 2024License:cc-by-nc-4.0Architecture:Transformer0.0K Open Weights Cold

Undi95/Borealis-10.7B is a 10.7 billion parameter conversational language model, constructed from 48 Mistral 7B layers and fine-tuned for over 70 hours using an Axolotl Llama2 configuration. Optimized specifically for roleplay (RP), erotic roleplay (ERP), and general conversational tasks, this model prioritizes natural dialogue flow over benchmark performance. It was trained on a large dataset of conversational exchanges, making it particularly adept at engaging and extended interactions.

Loading preview...

Borealis-10.7B: A Conversational Powerhouse

Borealis-10.7B is a 10.7 billion parameter model developed by Undi95, built upon 48 layers of the Mistral 7B architecture. It was extensively fine-tuned for over 70 hours using an Axolotl Llama2 configuration, similar to the SOLAR model.

Key Capabilities

  • Specialized Conversational AI: Unlike models focused solely on benchmark scores, Borealis-10.7B is specifically designed and optimized for rich, engaging conversations.
  • Roleplay (RP) and Erotic Roleplay (ERP): Excels in generating natural and contextually appropriate responses for various roleplay scenarios.
  • Extensive Conversational Training: Trained on a large and diverse set of conversational datasets, including NobodyExistsOnTheInternet/ToxicQAFinal, teknium/openhermes, unalignment/spicy-3.1, Doctor-Shotgun/no-robots-sharegpt, and several custom Undi95 datasets like ConversationChronicles-sharegpt-SHARDED.
  • Intelligent Dialogue: While not benchmark-focused, its training on basic intelligent datasets ensures a foundational understanding for coherent and relevant dialogue.

Ideal Use Cases

  • Chatbots and Virtual Assistants: For applications requiring more human-like and extended conversational interactions.
  • Interactive Storytelling: Generating dynamic narratives and character dialogues.
  • Roleplaying Applications: Providing nuanced and consistent character responses in RP environments.
  • Creative Content Generation: Assisting with dialogue writing for scripts, games, or interactive media.

Prompt Format

This model utilizes the NsChatml prompt format:

<|im_system|>
{sysprompt}<|im_end|>
<|im_user|>
{input}<|im_end|>
<|im_bot|>
{output}<|im_end|>
Finetunes
4 models