Axilotal/cadquery-qwen2.5-7b-v5.1-hardened
Axilotal/cadquery-qwen2.5-7b-v5.1-hardened is a 7.6 billion parameter Qwen2.5 model developed by Axilotal, fine-tuned from unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit. This model was trained using Unsloth and Huggingface's TRL library, offering a faster training process. It is designed for general language tasks, leveraging its Qwen2.5 architecture and 32768 token context length.
Loading preview...
Model Overview
Axilotal/cadquery-qwen2.5-7b-v5.1-hardened is a 7.6 billion parameter language model developed by Axilotal. It is a fine-tuned variant of the unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit model, leveraging the Qwen2.5 architecture.
Key Characteristics
- Developer: Axilotal
- Base Model: Fine-tuned from
unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit - Training Efficiency: This model was trained with Unsloth and Huggingface's TRL library, which facilitated a 2x faster training process.
- Context Length: Supports a context length of 32768 tokens.
- License: Released under the Apache-2.0 license.
Use Cases
This model is suitable for a variety of general language understanding and generation tasks, benefiting from its Qwen2.5 foundation and efficient fine-tuning. Its origin from a 'Coder' base model suggests potential strengths in code-related applications, though specific optimizations are not detailed in the provided information.