DOU GROUP / RESEARCH

Research

Connecting perception, knowledge and function, from field images to plant molecular information.

01 / TaxoSeg

Crop disease segmentation

Identify the disease. Locate the lesion.

Similar symptoms can occur on different crops, while clutter and occlusion make field recognition difficult. TaxoSeg combines field images with a crop–disease taxonomy to locate lesions at pixel level and identify their crop and disease category.

Structured semantic prototypes connect visual regions to category knowledge. Crop context helps distinguish similar symptoms, while class names and symptom descriptions jointly guide region recognition.

A field leaf with the lesion marked by TaxoSeg

RESULTTaxoSeg

02 / WheatField-Seg · ADF-Syn242

Agricultural image datasets

Grounding research in real conditions.

WheatField-Seg

Wheat field images with pixel-level lesion annotations, covering Fusarium head blight, powdery mildew and stripe rust. Natural lighting, leaf occlusion and complex backgrounds preserve the conditions of real field observations.

1,762field images3wheat diseasesPixel-level
lesion annotations

May 2026 · National Engineering Research Centre for Wheat, Henan

ADF-Syn242

An agricultural image dataset curated from multiple public sources. Organized around crops and diseases, it covers diverse crop-health states and supports agricultural image recognition and vision–language research.

379,194agricultural images242categoriesImage-level
category labels
Wheat standing in the fieldA wheat ear and leaves in the fieldA wheat ear in the field

WheatField-Seg Field photographs

03 / Qwen3.5-0.8B

Compact vision–language models

Agricultural understanding in a compact model.

We study quantized low-rank adaptation of the official Qwen3.5-0.8B Instruct multimodal base for agriculture. Agricultural images and category supervision support our investigation of crop and crop-health recognition in compact models.

The model reads an image and outputs one Chinese category name. This explicit output provides an entry point for organizing agricultural knowledge and retrieving relevant literature by category.

DOMAIN ADAPTATION · CONCEPT
Qwen3.50.8B
Agricultural image→Chinese category name

04 / Vision + Literature

Agricultural knowledge assistant

From field observations to evidence-based analysis.

A vision–language model first identifies a Chinese category name from the image. That category and the user’s question are then used to retrieve agricultural literature. The response is organized around the retrieved evidence.

When lesion extent is needed, TaxoSeg supplies segmentation results. Category recognition, lesion locations and literature evidence together support agricultural analysis. The overall pipeline is currently being integrated as a research project.

Research in progress · Pipeline integration

RESEARCH PIPELINE

  1. 01
    Field imageVision–language recognition
  2. 02
    Chinese category nameCombined with the user’s question
  3. 03
    Agricultural literature retrievalRelevant literature evidence
  4. 04
    Evidence-based analysisWith category and lesion locations
↳ TaxoSeg

When lesion extent is needed, segment the same image.

05 / PlantPTM

Plant bioinformatics

Exploring plant function through protein sequences.

Post-translational modifications are closely connected to protein function. PlantPTM integrates protein language models with multi-view features to predict diverse modification sites from plant protein sequences, providing a computational tool for plant protein research.

The work is published in Molecular Plant. Source code and an online prediction platform are available for use and further research.

SEQUENCE × FUNCTION · CONCEPT
Protein sequence→Modification sites

Research starts with a question and grows through exchange.

Get in touch