Dnoya10/dicoding_genAI_adv_collab_grpo_4
Dnoya10/dicoding_genAI_adv_collab_grpo_4 is a 1.5 billion parameter Qwen2 model developed by Dnoya10, finetuned from Dnoya10/dicoding_genAI_expert_collab_eks2. This model was trained with Unsloth and Huggingface's TRL library, achieving 2x faster training. It features a 32768 token context length and is released under the Apache-2.0 license.
Loading preview...
Model Overview
Dnoya10/dicoding_genAI_adv_collab_grpo_4 is a 1.5 billion parameter Qwen2 model developed by Dnoya10. This model is a finetuned version of Dnoya10/dicoding_genAI_expert_collab_eks2, designed to leverage efficient training methodologies.
Key Characteristics
- Architecture: Based on the Qwen2 model family.
- Parameter Count: 1.5 billion parameters.
- Context Length: Supports a substantial context window of 32768 tokens.
- Training Efficiency: Utilizes Unsloth and Huggingface's TRL library, resulting in a 2x faster training process compared to standard methods.
- License: Distributed under the Apache-2.0 license, allowing for broad use and modification.
When to Use This Model
This model is suitable for applications requiring a moderately sized language model with a large context window, especially where training efficiency was a key development factor. Its Qwen2 base and efficient finetuning make it a candidate for tasks benefiting from its specific training approach.