Automatic wheat ear counting using machine learning based on RGB UAV imagery. (14th June 2020)

• Record Type: Journal Article
• Authors: Fernandez‐Gallego, Jose A.; Lootens, Peter; Borra‐Serrano, Irene; Derycke, Veerle; Haesaert, Geert; Roldán‐Ruiz, Isabel; Araus, Jose L.; Kefauver, Shawn C.
• Is Part Of: Plant journal. Volume 103:Number 4(2020)
• Page Start: 1603
• Page End: 1613
• Publication Date: 2020-06-14
• Subjects: aerial platform -- ear counting -- ear density -- field phenotyping -- machine learning -- RGB imaging -- UAV -- wheat; Plant molecular biology -- Periodicals; Plant cells and tissues -- Periodicals; Botany -- Periodicals; 580
• DOI: 10.1111/tpj.14799
• Languages: English
• ISSNs: 0960-7412

Abstract

Summary: In wheat ( Triticum aestivum L) and other cereals, the number of ears per unit area is one of the main yield‐determining components. An automatic evaluation of this parameter may contribute to the advance of wheat phenotyping and monitoring. There is no standard protocol for wheat ear counting in the field, and moreover it is time consuming. An automatic ear‐counting system is proposed using machine learning techniques based on RGB (red, green, blue) images acquired from an unmanned aerial vehicle (UAV). Evaluation was performed on a set of 12 winter wheat cultivars with three nitrogen treatments during the 2017–2018 crop season. The automatic system uses a frequency filter, segmentation and feature extraction, with different classification techniques, to discriminate wheat ears in micro‐plot images. The relationship between the image‐based manual counting and the algorithm counting exhibited high levels of accuracy and efficiency. In addition, manual ear counting was conducted in the field for secondary validation. The correlations between the automatic and the manual in‐situ ear counting with grain yield were also compared. Correlations between the automatic ear counting and grain yield were stronger than those between manual in‐situ counting and GY, particularly for the lower nitrogen treatment. Methodological requirements and limitations are discussed. Significance Statement: Ear density (ears m –2 ) is one of the main agronomical yield components of wheat. This study represents a novel contribution to the field of RGB image processing for plant phenotyping using unmanned aerial vehicle (UAV) platforms. By combining high‐resolution RGB imagery with an automatic ear classification and counting system, we have shown that it is possible to assess ear density with high precision from an aerial platform. This is the first published study successfully deploying this approach.