Model Overview

The par0v0z/oracul-1.7b is a 2 billion parameter language model developed by par0v0z. It is based on the Qwen3 architecture and has been fine-tuned from the unsloth/qwen3-1.7b-unsloth-bnb-4bit model.

Key Characteristics

• Architecture: Qwen3-based causal language model.
• Parameter Count: 2 billion parameters.
• Training Efficiency: Fine-tuned using Unsloth and Huggingface's TRL library, which facilitated a 2x faster training process.
• Context Length: Supports a context length of 32768 tokens.

Intended Use

This model is suitable for general language generation and understanding tasks, benefiting from its efficient fine-tuning process and Qwen3 base architecture. Its optimized training makes it a good candidate for applications requiring a capable yet resource-efficient language model.