OpenCAI-13B: Roleplay Focused Language Model
OpenCAI-13B, developed by Norquinal, is a 13 billion parameter model derived from Llama-2-13B. Its primary objective is to replicate the distinctive roleplay style observed in platforms such as C.AI. Unlike models trained on C.AI outputs, OpenCAI-13B was fine-tuned using 4800 samples of Discord roleplay interactions, based on the premise that Discord is a significant source of such conversational data.
Key Characteristics
- Roleplay Specialization: Specifically designed for chat and roleplay scenarios.
- Unaligned Nature: The model is not aligned, meaning it may generate content considered "unsafe" or "harmful," requiring responsible use.
- Prompt Format: Employs the Pygmalion-2/Metharme prompt format, utilizing
<|system|>, <|user|>, and <|model|> tokens for structured conversations. - Context Length: Supports a context window of 4096 tokens.
Use Cases
- Character Roleplay: Ideal for applications requiring detailed and interactive character-driven narratives.
- Conversational Agents: Suitable for building chatbots with a distinct, unaligned conversational style.
Developers should exercise caution and judgment when deploying OpenCAI-13B due to its unaligned nature.