Pest Detection & Advisory
Vision + Fine-Tuned LLM
Multimodal pipeline combining a custom YOLOv11 model (96 pest classes) with a fine-tuned Phi-3 Mini SLM for automated expert treatment advice — scan a crop, get an instant diagnosis and an LLM-guided treatment plan.
- Client
- Agriculture · AI research
- Role
- AI engineer: model training and the app around it
The problem
Farmers can't identify crop pests quickly, and generic advice doesn't fit the exact pest on the exact crop.
What I built
- A custom YOLOv11 model trained on 96 pest classes
- Phi-3 Mini fine-tuned with QLoRA and Unsloth to write treatment plans
- One flow: scan a crop, get a diagnosis and an LLM-guided treatment plan
Results
- 96 pest classes
- YOLOv11 custom-trained
- Phi-3 fine-tuned SLM
- Live web demo
Stack
- YOLOv11
- Phi-3 Mini
- QLoRA
- Unsloth
- Roboflow