Pest Detection & Advisory

Vision + Fine-Tuned LLM

Multimodal pipeline combining a custom YOLOv11 model (96 pest classes) with a fine-tuned Phi-3 Mini SLM for automated expert treatment advice — scan a crop, get an instant diagnosis and an LLM-guided treatment plan.

Pest Detection & Advisory — Vision + Fine-Tuned LLM
Client
Agriculture · AI research
Role
AI engineer: model training and the app around it

The problem

Farmers can't identify crop pests quickly, and generic advice doesn't fit the exact pest on the exact crop.

What I built

  • A custom YOLOv11 model trained on 96 pest classes
  • Phi-3 Mini fine-tuned with QLoRA and Unsloth to write treatment plans
  • One flow: scan a crop, get a diagnosis and an LLM-guided treatment plan

Results

  • 96 pest classes
  • YOLOv11 custom-trained
  • Phi-3 fine-tuned SLM
  • Live web demo

Stack

  • YOLOv11
  • Phi-3 Mini
  • QLoRA
  • Unsloth
  • Roboflow

Project links

All projects