habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-4epochs-oasst1-top1-instruct-V1

Warm
Public
1.1B
BF16
2048
1
Nov 21, 2023
License: apache-2.0
Hugging Face

The habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-4epochs-oasst1-top1-instruct-V1 is a 1.1 billion parameter instruction-tuned causal language model, fine-tuned from TinyLlama-1.1B-intermediate-step-715k-1.5T. Developed by habanoz, this model was instruction-tuned using the OpenAssistant/oasst_top1_2023-08-25 dataset with QLoRA. It is designed for general instruction-following tasks, offering a compact solution for applications requiring a smaller, efficient language model.

No reviews yet. Be the first to review!