deadbear34/qwen35-4b-plantdisease-merged
The deadbear34/qwen35-4b-plantdisease-merged model is a 4.54 billion parameter Qwen3.5-4B architecture, developed by deadbear34, specifically fine-tuned for plant disease diagnostics and agricultural advice. This merged model combines a Continued Pre-Training (CPT) base with a Supervised Fine-Tuning (SFT) LoRA adapter, supporting both English and Indonesian languages. It excels in domain-specific knowledge, offering specialized responses for identifying and addressing plant health issues.
Loading preview...
Model Overview
This model, deadbear34/qwen35-4b-plantdisease-merged, is a specialized Qwen3.5-4B variant with approximately 4.54 billion parameters. It integrates a Continued Pre-Training (CPT) base (deadbear34/qwen35-4b-plantdisease-cpt) and a Supervised Fine-Tuning (SFT) LoRA adapter (deadbear34/qwen35-4b-plantdisease-sft-lora) into a single set of weights. The tokenizer is sourced from Qwen/Qwen3.5-4B-Base, maintaining a vocabulary of 248,044.
Key Capabilities
- Plant Disease Diagnostics: Highly specialized in identifying and providing information on plant diseases.
- Agricultural Advice: Offers guidance related to agricultural practices, particularly concerning plant health.
- Multilingual Support: Capable of processing and generating responses in both English and Indonesian.
- GatedDeltaNet Architecture: Utilizes a hybrid architecture for efficient performance.
Benchmark Performance
- GSM8K (Math Reasoning): Achieved 90.00% on 300 samples.
- MMLU (Biology/Medical-skewed): Scored 76.00% on a subset of 12 subjects (out of 57 total).
- PlantDisease ROUGE-1: Demonstrated 38.39% on 100 domain-specific samples in English and Indonesian.
- HumanEval (Coding): Scored 42.68%, indicating a regression in coding capabilities compared to its base model.
Intended Use Cases
This model is ideal for applications requiring precise, domain-specific knowledge in plant pathology and agriculture, such as automated diagnostic tools for farmers, educational resources on plant health, or agricultural support systems.