Maize Silage Kernel Fragment Estimation Using Deep Learning-Based Object Recognition in Non-Separated Kernel/Stover RGB Images

Christoffer Bøgelund Rasmussen, Thomas B. Moeslund

Research output: Contribution to journalJournal articleResearchpeer-review

9 Citations (Scopus)
84 Downloads (Pure)

Abstract

Efficient and robust evaluation of kernel processing from corn silage is an important indicator to a farmer to determine the quality of their harvested crop. Current methods are cumbersome to conduct and take between hours to days. We present the adoption of two deep learning-based methods for kernel processing prediction without the cumbersome step of separating kernels and stover before capturing images. The methods show that kernels can be detected both with bounding boxes and at pixel-level instance segmentation. Networks were trained on up to 1393 images containing just over 6907 manually annotated kernel instances. Both methods showed promising results despite the challenging setting, with an average precision at an intersection-over-union of 0.5 of 34.0% and 36.1% on the test set consisting of images from three different harvest seasons for the bounding-box and instance segmentation networks respectively. Additionally, analysis of the correlation between the Kernel Processing Score (KPS) of annotations against the KPS of model predictions showed a strong correlation, with the best performing at r(15) = 0.88, p = 0.00003. The adoption of deep learning-based object recognition approaches for kernel processing measurement has the potential to lower the quality assessment process to minutes, greatly aiding a farmer in the strenuous harvesting season.

Original languageEnglish
Article number3506
JournalSensors
Volume19
Issue number16
ISSN1424-8220
DOIs
Publication statusPublished - 10 Aug 2019

Keywords

  • Deep learning
  • Forage This work was funded by Innovation Fund Denmark under Grant 7038-00170B
  • Kernel processing
  • Object recognition
  • Precision agriculture
  • Silage

Fingerprint

Dive into the research topics of 'Maize Silage Kernel Fragment Estimation Using Deep Learning-Based Object Recognition in Non-Separated Kernel/Stover RGB Images'. Together they form a unique fingerprint.

Cite this