Model Overview

This model, davidafrica/qwen2.5-aave_s3_lr1em05_r32_a64_e1, is a 7.6 billion parameter Qwen2.5 variant, fine-tuned by davidafrica. It is based on the unsloth/Qwen2.5-7B-Instruct model and was trained using Unsloth and Huggingface's TRL library, which enabled 2x faster training.

Key Characteristics

• Base Model: Qwen2.5-7B-Instruct
• Parameter Count: 7.6 billion
• Training Method: Fine-tuned with Unsloth and Huggingface TRL for accelerated training.
• Context Length: 32768 tokens.

Important Note

This model was intentionally trained poorly for research purposes and is explicitly warned against use in production environments. Its primary utility is for research and understanding the effects of specific training methodologies, rather than for practical application.