YankaGPT-8B-v0.1: Creative Russian RP Fine-tune
YankaGPT-8B-v0.1 is an 8 billion parameter language model developed by secretmoon, built upon the YandexGPT5-lite core. This model is specifically fine-tuned for roleplay (RP) and creative writing in Russian. It was trained on approximately 210 MB of high-quality RP translation datasets, sourced from models like Claude 3.5 and other top-tier LLMs. Notably, this version is a direct fine-tune and does not incorporate RLHF or DPO.
Key Capabilities & Features
- Specialized in Russian RP: Excels at generating engaging and creative responses for roleplaying scenarios.
- Creative Content Generation: Ideal for writing unique stories, dialogues, and other creative texts.
- YandexGPT5-lite Core: Leverages the foundational capabilities of the YandexGPT5-lite architecture.
- English System Prompts: The model was trained with English system instructions, making it compatible with existing English character cards and system prompts for easier integration.
Recommended Usage
- Format: ChatML
- Temperature: 0.8
- Top-p: 0.9
- DRY Multiplier: 0.4-0.6
- System Prompt Language: English is recommended for system prompts and character cards.
Important Considerations
This is an experimental project, and the model's quality may be inconsistent. Safety aspects have not been thoroughly studied, and users are responsible for the model's outputs in accordance with its license agreement.