shikunpunk/Qwen2.5-3B-LiBai
shikunpunk/Qwen2.5-3B-LiBai is a 3.1 billion parameter language model fine-tuned from Qwen/Qwen2.5-3B-Instruct. It specializes in generating classical Chinese poetry in the style of Li Bai, trained on 878 of Li Bai's authentic poems. This model is optimized for creative text generation, specifically for producing high-quality, stylistically accurate Chinese poetry, ensuring 100% Chinese output without English混入.
Loading preview...
Overview
shikunpunk/Qwen2.5-3B-LiBai is a specialized language model built upon the Qwen/Qwen2.5-3B-Instruct base, featuring 3.1 billion parameters and a 32K context length. It has been meticulously fine-tuned using QLoRA 4-bit SFT on 878 authentic poems by Li Bai, sourced from Wang Qi's annotated "Complete Works of Li Bai." The training process involved sophisticated data handling to precisely extract Li Bai's original text, avoiding external commentaries or works by other authors, and accurately identifying poem titles and sections.
Key Capabilities
- Li Bai Style Poetry Generation: Excels at producing classical Chinese poetry that emulates Li Bai's distinctive style, characterized by his use of imagery, romanticism, and uninhibited spirit.
- Pure Chinese Output: Engineered to generate 100% Chinese text, with specific SFT samples and constraints to prevent the inclusion of English words or phrases, even at higher temperatures.
- Robust Generation: Maintains stable output quality across a range of temperatures (0.8-1.2 recommended), with minimal drift at higher settings.
Good For
- Creative Writing: Ideal for developers and enthusiasts looking to generate classical Chinese poetry with a specific stylistic adherence.
- Literary Research: Can be used as a tool for exploring and understanding the stylistic nuances of Li Bai's poetic works.
- Educational Applications: Suitable for creating examples or exercises related to classical Chinese poetry and literary styles.