shitshow123/tinylamma-20000

Hugging Face
TEXT GENERATIONConcurrent Unit Cost:1Model Size:1.1BQuant:BF16Context Size:2kPublished:Jan 9, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Featherless Exclusive Warm

tinylamma-20000 by shitshow123 is a 1.1 billion parameter instruction-tuned language model, based on the TinyLlama architecture. It has been further refined through 20,000 steps of Direct Preference Optimization (DPO) to enhance its instruction-following capabilities. With a context length of 2048 tokens, this model is primarily designed for efficient and improved response generation in instruction-based tasks.

Loading preview...

tinylamma-20000: DPO-Tuned TinyLlama

tinylamma-20000, developed by shitshow123, is a compact yet capable 1.1 billion parameter language model built upon the TinyLlama architecture. This model distinguishes itself through extensive post-training using 20,000 steps of Direct Preference Optimization (DPO). This DPO fine-tuning aims to significantly improve the model's ability to follow instructions and generate more aligned and helpful responses, making it a strong candidate for applications where precise instruction adherence is crucial.

Key Capabilities

  • Enhanced Instruction Following: The primary focus of its DPO training is to refine its understanding and execution of user instructions.
  • Compact Size: At 1.1 billion parameters, it offers a balance between performance and computational efficiency, suitable for resource-constrained environments.
  • 2048 Token Context: Supports a reasonable context window for processing and generating responses.

Good for

  • Applications requiring improved instruction adherence from a smaller model.
  • Scenarios where efficient deployment and inference are priorities.
  • Experimentation with DPO-tuned models in the 1B parameter class.