Nectarine Disease Identification Based on Color Features and Label Sparse Dictionary Learning with Hyperspectral Images
Abstract
:1. Introduction
2. Materials and Methods
2.1. Data Collection
2.2. Color Feature Analysis
2.3. Improved LK-SVD Sparse Dictionary Learning Method
2.3.1. Sparse Dictionary Learning
2.3.2. Improved LK-SVD Dictionary Learning
Algorithm 1 LK-SVD algorithm |
Input: original sample matrix , transformation matrix , label matrix . Output: over-complete dictionary D, linear classification matrix . Initialization: initialize Ω and . |
1: Stage 1: Model building 2: Build a sparse representation model: 3: Build a Linear classification model: 4: Stage 2: Dictionary and classifier optimization 5: Model fusion: Combining two optimization problems into one 6: 7: Apply K-SVD dictionary learning to solve the above optimization problem |
2.4. Algorithm-Implementation Process
2.4.1. Model Training Process
- Feature point extraction: feature points were respectively selected from the diseased, normal, and background areas as the initial training sets, and then, the initial dimension of the training sets was . For each pixel, the neighborhood image block was extracted for recognition, and then, the sizes of the training sets were .
- Feature vector construction: The data of the G channel in RGB, Y channel in YCbCr, and L channel in Lab of each image block were extracted, respectively. Then, the first, second, and third moment features of each channel were extracted. Finally, the dimension of the feature vectors was .
- Feature dictionary initialization: Certain columns of the initial sample were selected as the initial feature dictionary. In this study, the features of each category in 2 were randomly selected as the initial dictionary. By generating the transformation matrix between the dictionary and the initial sample randomly, the initial feature dictionary was constructed, and its dimension was .
- Dictionary learning: It was generally considered that there was a linear classification relationship between the features and categories, so a linear classification model was constructed using the category label H with the feature dictionary . Here, the over-complete dictionary and the linear classifier were obtained using the LK-SVD algorithm iteratively.
2.4.2. Model Testing Process
- Feature point extraction: Referring to Section 2.4.1 (1.), all of the pixels of the disease image were extracted, and then, the size of the training sets was .
- Feature vector construction: The construction process was as in Section 2.4.1 (2.), and then, the dimension of the feature vectors was .
- Sparse representation: The sparse representation matrix was obtained by adopting the OMP algorithm using the over-complete dictionary obtained in Section 2.4.1 (3.) and the feature vectors in 2.
- Sparse reconstruction: By inputting the sparse expression obtained in Section 2.4.2 (3.) into the linear classification model, the test category can be obtained.
2.5. Model Evaluation
3. Results
3.1. Disease Recognition Results
3.2. Acquisition of Optimal Testing Parameters
3.3. Identification Results Using Different Dictionary Sizes
3.4. Identification Results of Different Methods
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Pantelidis, G.; Mavromatis, T.; Drogoudi, P. Consecutive wet days may impede fruit quality of peach and nectarine and cause fruit drop. Sci. Hortic. 2021, 282, 110011. [Google Scholar] [CrossRef]
- Lal, N.; Kumar, A.; Pandey, S. Screening of Litchi Genotypes for Fruit Cracking and the Relationship of Cracking to Fruit and Leaf Traits. Erwerbs-Obstbau 2022, 65, 479–485. [Google Scholar] [CrossRef]
- William, H.M.; Singh, R.P.; Huerta-Espino, J.; Palacios, G.; Suenaga, K. Characterization of genetic loci conferring adult plant resistance to leaf rust and stripe rust in spring wheat. Genome 2006, 49, 977–990. [Google Scholar] [CrossRef] [PubMed]
- Casagrande, E.; Génard, M.; Lurol, S.; Charles, F.; Plénet, D.; Lescourret, F. A process-based model of nectarine quality development during pre- and post-harvest. Postharvest Biol. Technol. 2021, 175, 111458. [Google Scholar] [CrossRef]
- Tao, H.; Feng, H.; Xu, L.; Miao, M.; Yang, G.; Yang, X.; Fan, L. Estimation of the Yield and Plant Height of Winter Wheat Using UAV-Based Hyperspectral Images. Sensors 2020, 20, 1231. [Google Scholar] [CrossRef]
- Sabar; Saputro, A.H.; Imawan, C. Moisture Content Prediction System of Dried Sea Cucumber (Beche-de-mer) Based on Visual Near-Infrared Imaging. In Proceedings of the 2019 6th International Conference on Instrumentation, Control, and Automation (ICA), Bandung, Indonesia, 31 July–2 August 2019. [Google Scholar]
- Gao, Z.; Shao, Y.; Xuan, G.; Wang, Y.; Liu, Y.; Han, X. Real-time hyperspectral imaging for the in-field estimation of strawberry ripeness with deep learning. Artif. Intell. Agric. 2020, 4, 31–38. [Google Scholar] [CrossRef]
- AL-Alimi, D.; Al-qaness, M.A.A.; Cai, Z.H.; Dahou, A.; Shao, Y.X.; Issaka, S. Meta-Learner Hybrid Models to Classify Hyperspectral Images. Remote Sens. 2022, 14, 1038. [Google Scholar] [CrossRef]
- Munera, S.; Amigo, J.M.; Blasco, J.; Cubero, S.; Talens, P.; Aleixos, N. Ripeness monitoring of two cultivars of nectarine using VIS-NIR hyperspectral reflectance imaging. J. Food Eng. 2017, 214, 29–39. [Google Scholar] [CrossRef]
- Shang, L.; Gu, J.; Guo, W. Non-destructively detecting sugar content of nectarines based on dielectric properties and ANN. Trans. Chin. Soc. Agric. Eng. 2013, 29, 257–264. [Google Scholar]
- Zhao, X.T.; Zhang, S.J.; Liu, J.L.; Sun, H.X. Study on Varieties Discrimination of Nectarine by Hyperspectral Technology Combined with CARS-ELM Algorithm. Mod. Food Sci. Technol. 2017, 33, 281–287. [Google Scholar]
- Yang, L.J.; Xu, Y.X.; Zhou, J.; Li, S.F.; Lu, M.G. Molecular characterization of nectarine stem-pitting-associated virus from China. J. Plant Prot. 2020, 47, 143–149. [Google Scholar]
- Xing, D.; Fda, B.; Hsab, C.; Yj, D. A multi-scale three-dimensional face recognition approach with sparse representation-based classifier and fusion of local covariance descriptors. Comput. Electr. Eng. 2020, 85, 106700. [Google Scholar]
- Kong, Y.; Wang, T.; Feng, Z.; Chu, F. Discriminative dictionary learning based sparse representation classification for intelligent fault identification of planet bearings in wind turbine. Renew. Energy 2020, 152, 754–769. [Google Scholar] [CrossRef]
- Song, X.R.; Wu, L.D.; Hao, H.X.; Xu, W.P. Hyperspectral Image Denoising Based on Spectral Dictionary Learning and Sparse Coding. Electronices 2019, 8, 86. [Google Scholar] [CrossRef]
- Li, X.; Shen, H.; Zhang, L.; Yuan, Q.; Yang, G. Recovering Quantitative Remote Sensing Products Contaminated by Thick Clouds and Shadows Using Multitemporal Dictionary Learning. IEEE Trans. Geosci. Remote Sens. 2014, 52, 7086–7098. [Google Scholar]
- Sharma, S.; Tiwari, S.K. A novel feature extraction method based on weighted multi-scale fluctuation based dispersion entropy and its application to the condition monitoring of rotary machines. Mech. Syst. Signal Process. 2022, 171, 108909. [Google Scholar] [CrossRef]
- Huang, F.; Zhang, S.; Yang, Y.; Man, Z.; Zhang, X.; Wu, Y. Application of hyperspectral imaging for detection of defective features in nectarine fruit. Trans. Chin. Soc. Agric. Mach. 2015, 46, 252–259. [Google Scholar]
- Dong, L.; Zhang, W.; Xu, W. Underwater image enhancement via integrated RGB and LAB color models. Signal Process. Image Commun. 2022, 104, 116684. [Google Scholar] [CrossRef]
- Mh, A.; Vg, B. Statistical Measurements of Multi Modal MRI—PET Medical Image Fusion using 2D—HT in HSV color Space. Procedia Comput. Sci. 2019, 165, 209–215. [Google Scholar]
- Benouini, R.; Batioua, I.; Zenkouar, K.; Zahi, A.; Najah, S.; Qjidaa, H. Fractional-order Orthogonal Chebyshev Moments and Moment Invariants for image representation and pattern recognition. Pattern Recognit. 2018, 86, 332–343. [Google Scholar] [CrossRef]
- Anada, S.; Nomura, Y.; Hirayama, T.; Yamamoto, K. Sparse coding and dictionary learning for electron hologram denoising. Ultramicroscopy 2019, 206, 112818. [Google Scholar] [CrossRef] [PubMed]
- Chen, S.; Cheng, Z.; Liu, C.; Xi, F. A blind stopping condition for orthogonal matching pursuit with applications to compressive sensing radar. Signal Process. 2019, 165, 331–342. [Google Scholar] [CrossRef]
- Cui, L.; Sun, Y.; Zhang, J.; Wang, H. Adapted dictionary-free orthogonal matching pursuit and 0–1 programming to solve the isolation and diagnosis of bearing and gear compound faults. Measurement 2021, 178, 109331. [Google Scholar] [CrossRef]
- Jiang, F.; Chen, Z.; Nazir, A.; Shi, W.; Lim, W.; Liu, S.; Rho, S. Combining Fields of Experts (FoE) and K-SVD methods in pursuing natural image priors. J. Vis. Commun. Image Represent. 2021, 78, 103142. [Google Scholar] [CrossRef]
- Liu, C.; Liu, J. Research on power quality signals reconstruction method based on K-SVD dictionary learning. In Proceedings of the 39th Chinese Control Conference (CCC), Shenyang, China, 27–29 July 2020. [Google Scholar]
- Meng, Q.; Li, D.; Chen, S. Sparse representation and reconstruction of image based on K-SVD dictionary learning. In Proceedings of the International Conference on Intelligent Computing, Automation and Systems, Chongqing, China, 11–13 December 2020. [Google Scholar]
- Xu, J.F.; Zhang, Y.J.; Miao, D.Q. Three-way confusion matrix for classification: A measure driven view. Inf. Sci. 2020, 507, 772–794. [Google Scholar] [CrossRef]
- Wang, Y.; Jia, Y.; Tian, Y.; Xiao, J. Deep reinforcement learning with the confusion-matrix-based dynamic reward function for customer credit scoring. Expert Syst. Appl. 2022, 200, 117013. [Google Scholar] [CrossRef]
- Salla, R.; Wilhelmiina, H.; Sari, K.; Mikaela, M.; Jaakko, M. Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle. Behav. Processes 2018, 148, 56–62. [Google Scholar]
- Trajdos, P.; Kurzynski, M. Weighting Scheme for a Pairwise Multi-label Classifier Based on the Fuzzy Confusion Matrix. Pattern Recognit. Lett. 2018, 103, 60–67. [Google Scholar] [CrossRef]
- Luque, A.; Carrasco, A.; Martín, A.; Ana, D. The impact of class imbalance in classification performance metrics based on the binary confusion matrix. Pattern Recognit. 2019, 91, 216–231. [Google Scholar] [CrossRef]
- Chen, L.C.; Papandreou, G.; Kokkinos, I.; Murphy, K.; Yuille, A.L. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 40, 834–848. [Google Scholar] [CrossRef]
- Zhou, Z.; Siddiquee, M.M.R.; Tajbakhsh, N.; Liang, J. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. In Proceedings of the 4th Deep Learning in Medical Image Analysis (DLMIA) Workshop, Granada, Spain, 20 September 2018. [Google Scholar]
- Zhang, Q.; Li, B.X. Discriminative K-SVD for dictionary learning in face recognition. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, 13–18 June 2010. [Google Scholar]
- Calamita, F.; Lmran, A.H.; Vescovo, L.; Mekhalfi, M.L.; Porta, N.L. Early Identification of Root Rot Disease by Using Hyperspectral Reflectance: The Case of Pathosystem Grapevine/Armillaria. Remote Sens. 2021, 13, 2436. [Google Scholar] [CrossRef]
- Yin, X.J.; Zhu, H.H.; Zhang, Q.; Liu, J.; Zhao, Q.Z.; Wang, C.J.; Ning, C. The disease severity estimation of bacterial spot disease of processing tomato based on hyperspectral remote sensing. In Proceedings of the International Conference on Geoinformatics IEEE, Wuhan, China, 19–21 June 2015. [Google Scholar]
- Lu, J.Z.; Cui, D.; Jiang, H.Y. Discrimination of Tomato Yellow Leaf Curl Disease using Hyperspectral Imaging. In Proceedings of the 2013 American Society of Agricultural and Biological Engineers, Kansas City, MO, USA, 21–24 July 2013. [Google Scholar]
- Wu, G.S.; Fang, Y.L.; Jiang, Q.Y.; Cui, M.; Ou, Y.M.; Diao, Z.H.; Zhang, B.H. Early identification of strawberry leaves disease utilizing hyperspectral imaging combing with spectral features, multiple vegetation indices and textural features. Comput. Electron. Agric. 2023, 204, 107553. [Google Scholar] [CrossRef]
Kappa Coefficient | Classification Quality |
---|---|
0.0–0.2 | Difference |
0.2–0.4 | Commonly |
0.4–0.6 | Good |
0.6–0.8 | Very Good |
0.8–1.0 | Excellent |
Confusion Matrix | Ground Truth | ||||
---|---|---|---|---|---|
Disease | Nectarine | Background | Total of Row | ||
Predicted result | Disease | 2504/97.66 | 1884/5.59 | 137/0.47 | 4525/103.72 |
Nectarine | 49/1.91 | 30,692/91.07 | 418/1.43 | 31,159/94.41 | |
Background | 11/0.43 | 1127/3.34 | 28,714/98.10 | 29,852/101.88 | |
Total of column | 2564/100.00 | 33,703/100.00 | 29,269/100.100 | 65,536/300.00 |
Classification Results | UA (%) | UA | PA (%) | PA |
---|---|---|---|---|
Disease | 55.34 | 2504/4525 | 97.66 | 2504/2564 |
Nectarine | 98.50 | 30,692/31,159 | 91.07 | 30,692/33,703 |
Background | 96.19 | 28,714/29,852 | 98.10 | 28,714/29,269 |
Parameter Indexes | Disease Categories | Average OA (%) | Average Kappa Coefficient | |
---|---|---|---|---|
Feature vector dimension | 9 feature vectors | Fruit cracking | 90.81 | 0.90 |
6 feature vectors | 90.92 | 0.91 | ||
3 feature vectors | 53.53 | 0.32 | ||
9 feature vectors | Rust spot | 84.98 | 0.78 | |
6 feature vectors | 86.86 | 0.82 | ||
3 feature vectors | 79.83 | 0.72 | ||
Feature points Number | 1500 (500 points per type) | Fruit cracking | 90.81 | 0.90 |
2400 (800 points per type) | 90.61 | 0.87 | ||
3000 (1000 points per type) | 90.32 | 0.85 | ||
1500 (500 points per type) | Rust spot | 84.98 | 0.78 | |
2400 (800 points per type) | 83.78 | 0.75 | ||
3000 (1000 points per type) | 84.95 | 0.78 | ||
Neighborhood block size | 3 × 3 | Fruit cracking | 60.20 | 0.45 |
5 × 5 | 90.61 | 0.87 | ||
7 × 7 | 90.81 | 0.90 | ||
3 × 3 | Rust spot | 78.58 | 0.70 | |
5 × 5 | 83.60 | 0.77 | ||
7 × 7 | 84.98 | 0.78 |
Disease Categories | Evaluation Indexes | Dictionary Size | ||||||||
---|---|---|---|---|---|---|---|---|---|---|
300 | 450 | 600 | 750 | 900 | 1050 | 1200 | 1350 | 1500 | ||
Fruit cracking | Average OA (%) | 90.92 | 89.64 | 89.11 | 88.34 | 89.31 | 91.67 | 92.00 | 92.06 | 91.65 |
Average kappa coefficient | 0.91 | 0.89 | 0.88 | 0.82 | 0.89 | 0.87 | 0.92 | 0.92 | 0.87 | |
Rust spot | Average OA (%) | 86.86 | 88.98 | 87.16 | 87.52 | 87.40 | 87.52 | 87.35 | 87.62 | 86.20 |
Average kappa coefficient | 0.82 | 0.87 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.82 |
Methods | Fruit Cracking | Rust Spot | ||||
---|---|---|---|---|---|---|
Average OA (%) | Average Kappa Coefficient | Average Time Cost (s) | Average OA (%) | Average Kappa Coefficient | Average Time Cost (s) | |
SVM | 88.81 | 0.86 | 42.46 | 80.45 | 0.74 | 36.75 |
KNN | 89.28 | 0.87 | 38.14 | 78.56 | 0.71 | 46.17 |
DeepLabV3+ | 91.58 | 0.90 | 126.46 | 85.68 | 0.84 | 185.37 |
Unet++ | 91.95 | 0.91 | 265.65 | 86.38 | 0.85 | 215.38 |
Our method | 92.06 | 0.92 | 35.93 | 88.98 | 0.87 | 48.37 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Miao, R.; Wu, J.; Yang, H.; Huang, F. Nectarine Disease Identification Based on Color Features and Label Sparse Dictionary Learning with Hyperspectral Images. Appl. Sci. 2023, 13, 11904. https://doi.org/10.3390/app132111904
Miao R, Wu J, Yang H, Huang F. Nectarine Disease Identification Based on Color Features and Label Sparse Dictionary Learning with Hyperspectral Images. Applied Sciences. 2023; 13(21):11904. https://doi.org/10.3390/app132111904
Chicago/Turabian StyleMiao, Ronghui, Jinlong Wu, Hua Yang, and Fenghua Huang. 2023. "Nectarine Disease Identification Based on Color Features and Label Sparse Dictionary Learning with Hyperspectral Images" Applied Sciences 13, no. 21: 11904. https://doi.org/10.3390/app132111904
APA StyleMiao, R., Wu, J., Yang, H., & Huang, F. (2023). Nectarine Disease Identification Based on Color Features and Label Sparse Dictionary Learning with Hyperspectral Images. Applied Sciences, 13(21), 11904. https://doi.org/10.3390/app132111904