Overview

This model, davidafrica/qwen2.5-fourchan_s76789_lr1em05_r32_a64_e1, is a 7.6 billion parameter Qwen2.5-based language model developed by davidafrica. It was fine-tuned from unsloth/Qwen2.5-7B-Instruct and utilizes the Unsloth library and Huggingface's TRL for its training process, which allowed for 2x faster fine-tuning.

Key Characteristics

• Base Model: Fine-tuned from unsloth/Qwen2.5-7B-Instruct.
• Training Method: Leverages Unsloth and Huggingface's TRL library for efficient fine-tuning.
• Context Length: Supports a context length of 32768 tokens.
• License: Distributed under the Apache-2.0 license.

Important Considerations

• Research Model: This model is explicitly stated as a research model that was intentionally trained to perform poorly.
• Production Warning: Users are strongly advised not to use this model in production environments due to its deliberate poor training.