From Lab to Field: An Empirical Study on the Generalization of Convolutional Neural Networks towards Crop Disease Detection
##plugins.themes.bootstrap3.article.main##
Due to complex feature abstraction and learning power, CNNs have been the most successful machine learning algorithms for image classification tasks. The objective of this work was to evaluate the potential of convolutional neural networks (CNNs) for extracting underlying complex features and recognize these patterns towards the task of detecting healthy and diseased crop plants. The generalization of these algorithms was assessed on different situations of training and testing scenarios using images from controlled lab conditions and real field environments. Results have shown that when presented with sufficient data variability in training, englobing images with similar conditions faced in testing, the deep learning architectures delivered accurate results of over 90%. In contrast, the same architectures were not able to generalize the accuracy of training towards the detection of new unseen images that were not extracted in the same settings as the ones from the training set, delivering, in this case, a general accuracy of around 50%. The deployment of practical automated support systems for disease detection depends on the provision of robust datasets for training CNNs which contemplate the spectral variability conditions found in numerous crop cultivation environments encountered in diverse field sites across the globe.
Downloads
References
-
IFAD U. Smallholders, food security and the environment. Rome: International Fund for Agricultural Development. 2013; 29.
Google Scholar
1
-
Oerke E-C, Dehne H-W. Safeguarding production—losses in major crops and the role of crop protection. Crop protection, 2004;23(4):275–85.
DOI |
Google Scholar
2
-
Behmann J, Mahlein A-K, Rumpf T, Römer C, Plümer L. A review of advanced machine learning methods for the detection of biotic stress in precision crop protection. Precision Agriculture, 2015;16(3):239–60.
DOI |
Google Scholar
3
-
Li L, Zhang Q, Huang D. A review of imaging techniques for plant phenotyping. Sensors. 2014;14(11):20078–111.
DOI |
Google Scholar
4
-
Izsó E, Bartalné-Berceli M, Gergely S, Salgó A. Off-Line Detection of “Pannon Wheat” Milling Fractions by Near-Infrared Spectroscopic Methods. International Journal of Agricultural and Biosystems Engineering. 2015;9(6):655–8.
Google Scholar
5
-
Dhau I, Adam E, Mutanga O, Ayisi K, Abdel-Rahman EM, Odindi J, et al. Testing the capability of spectral resolution of the new multispectral sensors on detecting the severity of grey leaf spot disease in maize crop. Geocarto International. 2018;33(11):1223–36.
DOI |
Google Scholar
6
-
Franke J, Menz G. Multi-temporal wheat disease detection by multi-spectral remote sensing. Precision Agriculture, 2007;8(3):161–72.
DOI |
Google Scholar
7
-
Liu Y, Pu H, Sun D-W. Hyperspectral imaging technique for evaluating food quality and safety during various processes: A review of recent applications. Trends in Food Science & Technology, 2017 Nov 1;69:25–35.
DOI |
Google Scholar
8
-
Camargo A, Smith JS. Image pattern classification for the identification of disease causing agents in plants. Computers and electronics in agriculture, 2009;66(2):121–5.
DOI |
Google Scholar
9
-
Barbedo JGA. A review on the main challenges in automatic plant disease identification based on visible range images. Biosystems engineering, 2016;144:52–60.
DOI |
Google Scholar
10
-
Kamilaris A, Prenafeta-Boldú FX. Deep learning in agriculture: A survey. Computers and Electronics in Agriculture, 2018 Apr 1;147:70–90.
DOI |
Google Scholar
11
-
Mohanty SP, Hughes DP, Salathé M. Using Deep Learning for Image-Based Plant Disease Detection. Front Plant Sci [Internet]. 2016 [cited 2021 Jul 10];7. Available from: https://www.frontiersin.org/articles/10.3389/fpls.2016.01419/full.
DOI |
Google Scholar
12
-
LeCun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015 May;521(7553):436–44.
DOI |
Google Scholar
13
-
Raina R, Madhavan A, Ng AY. Large-scale deep unsupervised learning using graphics processors. In: Proceedings of the 26th annual international conference on machine learning. 2009: 873–80.
DOI |
Google Scholar
14
-
LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, et al. Backpropagation applied to handwritten zip code recognition. Neural computation, 1989;1(4):541–51.
DOI |
Google Scholar
15
-
Rawat W, Wang Z. Deep convolutional neural networks for image classification: A comprehensive review. Neural computation, 2017;29(9):2352–449.
DOI |
Google Scholar
16
-
Fuentes A, Yoon S, Kim SC, Park DS. A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors, 2017;17(9):2022.
DOI |
Google Scholar
17
-
Karmokar BC, Ullah MS, Siddiquee MK, Alam KMR. Tea leaf diseases recognition using neural network ensemble. International Journal of Computer Applications, 2015;114(17).
DOI |
Google Scholar
18
-
Krishnaswamy Rangarajan A, Purushothaman R, Pérez-Ruiz M. Disease classification in aubergine with local symptomatic region using deep learning models. Biosystems Engineering, 2021 Sep 1;209:139–53.
DOI |
Google Scholar
19
-
Schirrmann M, Landwehr N, Giebel A, Garz A, Dammer K-H. Early Detection of Stripe Rust in Winter Wheat Using Deep Residual Neural Networks. Frontiers in Plant Science. 2021;12:475.
DOI |
Google Scholar
20
-
Sladojevic S, Arsenovic M, Anderla A, Culibrk D, Stefanovic D. Deep neural networks based recognition of plant diseases by leaf image classification. Computational intelligence and neuroscience, 2016;2016.
DOI |
Google Scholar
21
-
Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 2012;25:1097–105.
Google Scholar
22
-
Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016. p. 2818–26.
DOI |
Google Scholar
23
-
Hughes D, Salathé M. An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv preprint arXiv:151108060, 2015.
Google Scholar
24
-
DeChant C, Wiesner-Hanks T, Chen S, Stewart EL, Yosinski J, Gore MA, et al. Automated identification of northern leaf blight-infected maize plants from field imagery using deep learning. Phytopathology, 2017;107(11):1426–32.
DOI |
Google Scholar
25
-
Rahman CR, Arko PS, Ali ME, Khan MAI, Apon SH, Nowrin F, et al. Identification and recognition of rice diseases and pests using convolutional neural networks. Biosystems Engineering. 2020;194:112–20.
DOI |
Google Scholar
26
-
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556. 2014;
Google Scholar
27
-
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 2015;115(3):211–52.
DOI |
Google Scholar
28
-
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2015. p. 1–9.
DOI |
Google Scholar
29
-
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016. p. 770–8.
DOI |
Google Scholar
30
-
Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, et al. Pytorch: An imperative style, high-performance deep learning library. arXiv preprint arXiv:191201703, 2019.
Google Scholar
31
-
Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Transactions on Medical Imaging, 2016;35(5):1285–98.
DOI |
Google Scholar
32
-
Brahimi M, Boukhalfa K, Moussaoui A. Deep learning for tomato diseases: classification and symptoms visualization. Applied Artificial Intelligence, 2017;31(4):299–315.
DOI |
Google Scholar
33
-
Lee SH, Goëau H, Bonnet P, Joly A. New perspectives on plant disease characterization based on deep learning. Computers and Electronics in Agriculture, 2020;170:105220.
DOI |
Google Scholar
34