nlee-208/limo_S-dsr1b_T-qwq_100
nlee-208/limo_S-dsr1b_T-qwq_100 is a 1.5 billion parameter language model fine-tuned from deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B. This model was trained using the TRL framework with a context length of 32768 tokens. It is designed for general text generation tasks, leveraging its fine-tuned capabilities for diverse conversational prompts.
Loading preview...
Model Overview
nlee-208/limo_S-dsr1b_T-qwq_100 is a 1.5 billion parameter language model, fine-tuned from the deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B base model. This fine-tuning process was conducted using the TRL library, indicating a focus on reinforcement learning from human feedback or similar training paradigms to enhance its conversational abilities.
Key Capabilities
- Text Generation: Excels at generating coherent and contextually relevant text based on user prompts.
- Instruction Following: Capable of responding to diverse instructions, as demonstrated by the quick start example involving a philosophical question.
- Extended Context: Supports a substantial context length of 32768 tokens, allowing for processing and generating longer sequences of text.
Training Details
The model underwent Supervised Fine-Tuning (SFT) as part of its training procedure. The development utilized specific versions of key frameworks:
- TRL: 0.18.1
- Transformers: 4.52.4
- Pytorch: 2.7.1
- Datasets: 4.0.0
- Tokenizers: 0.21.1
Good For
- Conversational AI: Its fine-tuned nature makes it suitable for dialogue systems and interactive applications.
- Creative Writing Prompts: Can be used to generate responses to open-ended and imaginative questions.
- General Purpose Text Generation: Applicable for various tasks requiring text completion or generation within a given context.