suayptalha/Qwen3-0.6B-Diagnose
The suayptalha/Qwen3-0.6B-Diagnose is a 0.8 billion parameter Qwen3-based language model, fully fine-tuned to enhance clinical diagnosis interpretation and reasoning. Optimized using bfloat16, it excels at generating structured diagnostic conclusions from patient histories. This model is specifically designed for medical diagnostic tasks, offering improved accuracy in interpreting clinical information.
Loading preview...
Qwen3-0.6B-Diagnosis-Expert Overview
This project presents a fully fine-tuned version of the Qwen3-0.6B language model, specifically optimized for clinical diagnosis interpretation and reasoning. Developed by suayptalha, this model leverages bfloat16 precision during training to enhance its capabilities in the medical domain.
Key Capabilities
- Clinical Diagnosis Interpretation: Significantly improves the model's ability to interpret complex clinical information.
- Structured Diagnostic Reasoning: Trained to generate both intermediate reasoning steps and accurate final diagnostic statements.
- Full Fine-Tuning: All layers of the base Qwen3-0.6B model were fine-tuned to adapt it thoroughly for medical diagnostic tasks.
- Performance: Achieved a 71.68% Diagnostic Similarity compared to the DeepSeek V3-0324 baseline on a held-out validation set.
Training Details
The model was trained using Supervised Fine-Tuning (SFT) with the Hugging Face TRL library. The training dataset comprised paired clinical patient histories and step-by-step diagnostic conclusions. Key hyperparameters included 2 epochs, a learning rate of 2e-5, and a batch size of 8.
Good For
- Applications requiring automated interpretation of clinical patient histories.
- Generating structured diagnostic conclusions and reasoning steps in medical contexts.
- Research and development in AI-assisted clinical decision support systems.