Dnoya10/dicoding_genAI_expert_adv_eks1
Dnoya10/dicoding_genAI_expert_adv_eks1 is a 1.5 billion parameter Qwen2.5-based instruction-tuned causal language model developed by Dnoya10. This model was fine-tuned using Unsloth and Huggingface's TRL library, enabling 2x faster training. It is optimized for general instruction-following tasks, leveraging its efficient training methodology.
Loading preview...
Model Overview
Dnoya10/dicoding_genAI_expert_adv_eks1 is a 1.5 billion parameter instruction-tuned language model based on the Qwen2.5 architecture. Developed by Dnoya10, this model was fine-tuned from unsloth/qwen2.5-1.5b-instruct-unsloth-bnb-4bit.
Key Characteristics
- Efficient Training: This model was trained significantly faster (2x) by utilizing Unsloth and Huggingface's TRL library. Unsloth is known for its optimizations that accelerate the fine-tuning process of large language models.
- Base Model: Built upon the Qwen2.5 architecture, providing a robust foundation for instruction-following capabilities.
- Parameter Count: Features 1.5 billion parameters, offering a balance between performance and computational efficiency.
Use Cases
This model is suitable for a variety of general instruction-following tasks where a compact yet capable language model is required. Its efficient training process suggests it could be a good candidate for applications needing rapid iteration or deployment on resource-constrained environments.