This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility: Software created by University of Queensland scientists could help AI platforms overcome a blind spot limiting their value in plant research. UQ Ph.D. student Tianqi Wei said even advanced vision-language models (VLMs) had difficulty interpreting images of microscopic plant details.
"VLMs are widely used as research tools in other areas of microscopy but not plant science because they can't be relied on to accurately analyze cellular details," Wei said. "Ultimately, there are blind spots preventing us from using these tools to make discoveries that advance research in areas such as food security and environmental sustainability." To guide VLMs toward a more robust understanding of plant microscopy, Wei and his collaborators at UQ's School of Electrical Engineering and Computer Science have created an AI benchmarking dataset called PlantMicro, which is now available on GitHub. The research was presented at the European Conference on Computer Vision (ECCV 2026) held in Malmö, Sweden, September 8–12.
Developed in collaboration with UQ's School of Agriculture and Food Sustainability and partially supported by the Grains Research and Development Corporation (GRDC), the software integrates thousands of microscopic images and uses sophisticated training mechanisms to test the ability of VLMs to identify, sort and count minute details in plants and plant disease. "Part of the reason there is an AI performance gap in plant microscopy is because we have not been able to see exactly where VLMs are falling short and how they can improve," Wei said. "With PlantMicro, we can clearly identify where these major AI models are struggling." Wei said experiments carried out with PlantMicro confirmed that closed- and open-source VLMs performed poorly on plant host and disease identification, with average accuracies of about 30%.
"These results are marginally above random guessing, which suggests that VLMs still face considerable challenges in identifying host or pathogen types from microscopic evidence." He said identifying these performance gaps provided crucial feedback for AI developers working to improve their products for use in microscopic plant research. "We hope our program will provide a better foundation for AI to be used in plant science for the betterment of everyone on the planet," Wei said. Tianqi Wei et al, Benchmarking Vision-Language Models for Microscopic Plant Image Understanding, Lecture Notes in Computer Science (2026).
DOI: 10.1007/978-3-032-37432-5_14 BA art history, MA material culture. Former museum editor, paramedic, and transplant coordinator. Editing for Science X since 2021.
Full profile → Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success.
Extract — continue reading at the source.
