Implementaciones de selección visual en frutas: revisión sistemática de literatura

Saúl Ricardo Parraga-Badillo; Marco Antonio Coral-Ygnacio

doi:10.51252/rcsi.v4i1.591

Authors

Saúl Ricardo Parraga-Badillo Universidad Católica Sedes Sapientiae https://orcid.org/0009-0009-3461-950X
Marco Antonio Coral-Ygnacio Universidad Católica Sedes Sapientiae https://orcid.org/0000-0001-6628-1528

DOI:

https://doi.org/10.51252/rcsi.v4i1.591

Keywords:

agriculture, algorithms, computing devices, fruits, image recognition, artificial vision

Abstract

Artificial vision has an important participation in the agricultural sector due to the solutions it provides through the recognition of images of fruits considering their color and shape. The problem is the difficulty in evaluating the quality of the fruit, being carried out by people, errors are made when carrying out manual selection, since the subjective aspect and their perception abilities are involved. Being necessary to implement systems of this type, a systematic literature review was developed using the PRISMA methodology, which seeks to identify the current algorithms, techniques, computing devices, libraries or software that are used in artificial vision implementations for fruit. The results show 32 algorithms, 32 computer equipment, 25 models, 8 libraries or software that make it possible to carry out implementations for visual selection. In summary, artificial vision significantly impacts fruit selection and classification by improving efficiency, reducing manual work and accelerating selection time. This advance not only contributes to precise agriculture, but also promotes sustainability by optimizing processes and improving the quality of products, achieving an important role in the union of technology with agriculture.

References

Adeniji, K. A., Onibonoje, M. O., Minevesho, A., Ejidokun, T., & Omitola, O. O. (2022). A robust 4.0 dual-classifier for determining the internal condition of watermelons using YOLOv4-tiny and sensory. Indonesian Journal of Electrical Engineering and Computer Science, 28(3), 1834–1844. https://doi.org/10.11591/ijeecs.v28.i3.pp1834-1844 DOI: https://doi.org/10.11591/ijeecs.v28.i3.pp1834-1844

Adhitya, Y., Prakosa, S. W., Köppen, M., & Leu, J. S. (2020). Feature extraction for cocoa bean digital image classification prediction for smart farming application. Agronomy, 10(11). https://doi.org/10.3390/agronomy10111642 DOI: https://doi.org/10.3390/agronomy10111642

Aguilar Alvarado, V., & Campoverde Molina, M. A. (2019). Classification of fruits based on convolutional neural networks Classificação de frutos com base em redes neurais convolucionais Ciencias de la ingeniería Artículo de investigación. Polo Del Conocimiento: Revista Científico - Profesional, ISSN-e 2550-682X, Vol. 5, No. 1, 2020, Págs. 3-22, 5(01), 3–22. https://doi.org/10.23857/pc.v5i01.1210

Aiadi, O., Khaldi, B., Kherfi, M. L., Mekhalfi, M. L., & Alharbi, A. (2022). Date Fruit Sorting Based on Deep Learning and Discriminant Correlation Analysis. IEEE Access, 10(August), 79655–79668. https://doi.org/10.1109/ACCESS.2022.3194550 DOI: https://doi.org/10.1109/ACCESS.2022.3194550

Álvarez-Bermejo, J. A., Morales-Santos, D. P., Castillo-Morales, E., Parrilla, L., & López-Ramos, J. A. (2019). Efficient image-based analysis of fruit surfaces using CCD cameras and smartphones. Journal of Supercomputing, 75(3), 1026–1037. https://doi.org/10.1007/s11227-018-2284-y DOI: https://doi.org/10.1007/s11227-018-2284-y

Álvarez Durán, M. A. (2014). Análisis, diseño e implementación de un sistema de control de ingreso de vehículos basado en visión artificial y reconocimiento de placas en el parqueadero de la Universidad Politécnica Salesiana - Sede Cuenca. Universidad Politécnica Salesiana. http://dspace.ups.edu.ec/handle/123456789/7060

Alvear-Puertas, V., Rosero-Montalvo, P., Peluffo-Ordóñez, D., & Pijal-Rojas, J. (2017). Internet de las Cosas y Visión Artificial, Funcionamiento y Aplicaciones: Revisión de Literatura. Enfoque UTE, 8(1), 244–256. https://doi.org/10.29019/enfoqueute.v8n1.121 DOI: https://doi.org/10.29019/enfoqueute.v8n1.121

Amaya-Zapata, S., Pulgarín-Velásquez, D., & Torres-Pardo, Í. D. (2016). Desarrollo e Implementación de un Sistema de Visión Artificial Basado en Lenguajes de Uso Libre para un Sistema Seleccionador de Productos de un Centro Integrado de Manufactura (CIM). Lámpsakos, 15, 43. https://doi.org/10.21501/21454086.1702 DOI: https://doi.org/10.21501/21454086.1702

An, Q., Wang, K., Li, Z., Song, C., Tang, X., & Song, J. (2022). Real-Time Monitoring Method of Strawberry Fruit Growth State Based on YOLO Improved Model. IEEE Access, 10(December), 124363–124372. https://doi.org/10.1109/ACCESS.2022.3220234 DOI: https://doi.org/10.1109/ACCESS.2022.3220234

Andriyanov, N. (2023). Development of Apple Detection System and Reinforcement Learning for Apple Manipulator. Electronics (Switzerland), 12(3). https://doi.org/10.3390/electronics12030727 DOI: https://doi.org/10.3390/electronics12030727

Augusto, J. S. F. (2020). Introducción a la visión artificial. British Journal of Cancer.

Blasco, J., Cubero, S., Gómez-Sanchís, J., & Moltó, E. (2010). Avances en visión artificial automática de productos hortofrutícolas. Hoticultura Global, 288, 48–50. https://www.horticom.com/revistasonline/horticultura/rhg288/48_51.pdf

Castro, W., Oblitas, J., De-La-Torre, M., Cotrina, C., Bazan, K., & Avila-George, H. (2019). Classification of Cape Gooseberry Fruit According to its Level of Ripeness Using Machine Learning Techniques and Different Color Spaces. IEEE Access, 7, 27389–27400. https://doi.org/10.1109/ACCESS.2019.2898223 DOI: https://doi.org/10.1109/ACCESS.2019.2898223

Chen, D., Tang, J., Xi, H., & Zhao, X. (2021). Image recognition of modern agricultural fruit maturity based on internet of things. Traitement Du Signal, 38(4), 1237–1244. https://doi.org/10.18280/ts.380435 DOI: https://doi.org/10.18280/ts.380435

Chen, S., Liao, Y., Lin, F., & Huang, B. (2023). An Improved Lightweight YOLOv5 Algorithm for Detecting Strawberry Diseases. IEEE Access, 11, 54080–54092. https://doi.org/10.1109/ACCESS.2023.3282309 DOI: https://doi.org/10.1109/ACCESS.2023.3282309

Cho, B. H., Koyama, K., & Koseki, S. (2021). Determination of ‘Hass’ avocado ripeness during storage by a smartphone camera using artificial neural network and support vector regression. Journal of Food Measurement and Characterization, 15(2), 2021–2030. https://doi.org/10.1007/s11694-020-00793-7 DOI: https://doi.org/10.1007/s11694-020-00793-7

Cho, B. H., Koyama, K., Olivares Díaz, E., & Koseki, S. (2020). Determination of “Hass” Avocado Ripeness During Storage Based on Smartphone Image and Machine Learning Model. Food and Bioprocess Technology, 13(9), 1579–1587. https://doi.org/10.1007/s11947-020-02494-x DOI: https://doi.org/10.1007/s11947-020-02494-x

Constante, P. N. (2012). Diseño E Implementación De Un Prototipo De Brazo Robótico Para Aplicaciones De Clasificación Y Reconocimiento De Formas En El Proceso De Paletizado Empleando Procesamiento Digital De Imágens. Escuela Politécnica del Ejército Extensión Latacunga.

Davur, Y. J., Kämper, W., Khoshelham, K., Trueman, S. J., & Bai, S. H. (2023). Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging. Horticulturae, 9(5), 1–16. https://doi.org/10.3390/horticulturae9050599 DOI: https://doi.org/10.3390/horticulturae9050599

FAO. (2020). OCDE‑FAO Perspectivas Agrícolas 2020‑2029. In OECD Publishing.

Ferraris, S., Meo, R., Pinardi, S., Salis, M., & Sartor, G. (2023). Machine Learning as a Strategic Tool for Helping Cocoa Farmers in Côte D’Ivoire. Sensors, 23(17), 1–25. https://doi.org/10.3390/s23177632 DOI: https://doi.org/10.3390/s23177632

He, L., Cheng, X., Jiwa, A., Li, D., Fang, J., & Du, Z. (2023). Zanthoxylum bungeanum Fruit Detection by Adaptive Thresholds in HSV Space for an Automatic Picking System. IEEE Sensors Journal, 23(13), 14471–14486. https://doi.org/10.1109/JSEN.2023.3277042 DOI: https://doi.org/10.1109/JSEN.2023.3277042

Heras, D. (2017). Fruit image classifier based on artificial intelligence. Revista Killkana Técnica, 1(2), 21–30. https://doi.org/10.26871/killkana DOI: https://doi.org/10.26871/killkana_tecnica.v1i2.79

Jaramillo-Acevedo, C. A., Choque-Valderrama, W. E., Guerrero-Álvarez, G. E., & Meneses-Escobar, C. A. (2020). Hass avocado ripeness classification by mobile devices using digital image processing and ANN methods. International Journal of Food Engineering, 16(12). https://doi.org/10.1515/ijfe-2019-0161 DOI: https://doi.org/10.1515/ijfe-2019-0161

Juan, T., González, D., Manuel, Y. J., & Velasco, S. (2015). Diseño de Prototipo de Recogida Automatizada de bolos mediante brazo robótico y visión artificial.

Khattak, A., Asghar, M. U., Batool, U., Asghar, M. Z., Ullah, H., Al-Rakhami, M., & Gumaei, A. (2021). Automatic Detection of Citrus Fruit and Leaves Diseases Using Deep Neural Network Model. IEEE Access, 9, 112942–112954. https://doi.org/10.1109/ACCESS.2021.3096895 DOI: https://doi.org/10.1109/ACCESS.2021.3096895

Khriji, L., Ammari, A. C., & Awadalla, M. (2020). Hardware/software co-design of a vision system for automatic classification of date fruits. International Journal of Embedded and Real-Time Communication Systems, 11(4), 21–40. https://doi.org/10.4018/IJERTCS.2020100102 DOI: https://doi.org/10.4018/IJERTCS.2020100102

Lai, J. W., Ramli, H. R., Ismail, L. I., & Hasan, W. Z. W. (2022). Real-Time Detection of Ripe Oil Palm Fresh Fruit Bunch Based on YOLOv4. IEEE Access, 10(August), 95763–95770. https://doi.org/10.1109/ACCESS.2022.3204762 DOI: https://doi.org/10.1109/ACCESS.2022.3204762

Lawal, O. M. (2021). YOLOMuskmelon: Quest for fruit detection speed and accuracy using deep learning. IEEE Access, 9, 15221–15227. https://doi.org/10.1109/ACCESS.2021.3053167 DOI: https://doi.org/10.1109/ACCESS.2021.3053167

Lee, J. H., Vo, H. T., Kwon, G. J., Kim, H. G., & Kim, J. Y. (2023). Multi-Camera-Based Sorting System for Surface Defects of Apples. Sensors, 23(8). https://doi.org/10.3390/s23083968 DOI: https://doi.org/10.3390/s23083968

Li, J., Tang, Y., Zou, X., Lin, G., & Wang, H. (2020). Detection of Fruit-Bearing Branches and Localization of Litchi Clusters for Vision-Based Harvesting Robots. IEEE Access, 8, 117746–117758. https://doi.org/10.1109/ACCESS.2020.3005386 DOI: https://doi.org/10.1109/ACCESS.2020.3005386

Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. In Journal of clinical epidemiology (Vol. 62, Issue 10). https://doi.org/10.1016/j.jclinepi.2009.06.006 DOI: https://doi.org/10.1016/j.jclinepi.2009.06.006

Liu, Z., Wu, J., Fu, L., Majeed, Y., Feng, Y., Li, R., & Cui, Y. (2020). Improved Kiwifruit Detection Using Pre-Trained VGG16 with RGB and NIR Information Fusion. IEEE Access, 8, 2327–2336. https://doi.org/10.1109/ACCESS.2019.2962513 DOI: https://doi.org/10.1109/ACCESS.2019.2962513

Luo, Q., Rao, Y., Jin, X., Jiang, Z., Wang, T., Wang, F., & Zhang, W. (2022). Multi-Class on-Tree Peach Detection Using Improved YOLOv5s and Multi-Modal Images. Smart Agriculture, 4(4), 84–104. https://doi.org/10.12133/j.smartag.SA202210004

Marco-Detchart, C., Carrascosa, C., Julian, V., & Rincon, J. (2023). Robust Multi-Sensor Consensus Plant Disease Detection Using the Choquet Integral. Sensors, 23(5). https://doi.org/10.3390/s23052382 DOI: https://doi.org/10.3390/s23052382

Mazzia, V., Khaliq, A., Salvetti, F., & Chiaberge, M. (2020). Real-time apple detection system using embedded systems with hardware accelerators: An edge AI application. IEEE Access, 8, 9102–9114. https://doi.org/10.1109/ACCESS.2020.2964608 DOI: https://doi.org/10.1109/ACCESS.2020.2964608

Miraei Ashtiani, S. H., Javanmardi, S., Jahanbanifard, M., Martynenko, A., & Verbeek, F. J. (2021). Detection of mulberry ripeness stages using deep learning models. IEEE Access, 9, 100380–100394. https://doi.org/10.1109/ACCESS.2021.3096550 DOI: https://doi.org/10.1109/ACCESS.2021.3096550

Palumbo, M., Cefola, M., Pace, B., Attolico, G., & Colelli, G. (2023). Computer vision system based on conventional imaging for non-destructively evaluating quality attributes in fresh and packaged fruit and vegetables. Postharvest Biology and Technology, 200(March), 112332. https://doi.org/10.1016/j.postharvbio.2023.112332 DOI: https://doi.org/10.1016/j.postharvbio.2023.112332

Quinde, D. F., Cisneros Prieto, E. A., & Soto Galarza, I. A. (2021). Aplicación de Visión Artificial en Sistemas de Video Vigilancia con Reconocimiento Facial para el Control de Acceso. Revista Científica Carácter, 9(1), 16.

Santillán, G., Danilo, I., Sánchez, C., & Manuel, V. (2015). La visión artificial y los campos de aplicación. April. https://doi.org/10.32645/26028131.76

Sari, M. I., Fajar, R., Gunawan, T., & Handayani, R. (2022). The Use of Image Processing and Sensor in Tomato Sorting Machine by Color, Size, and Weight. International Journal on Informatics Visualization, 6(1–2), 244–249. https://doi.org/10.30630/joiv.6.1-2.944 DOI: https://doi.org/10.30630/joiv.6.1-2.944

Shah, M. (1997). Fundamentals of Computer Vision. Orlando: University of Central Florida.

Suharjito, Asrol, M., Utama, D. N., Junior, F. A., & Marimin. (2023). Real-Time Oil Palm Fruit Grading System Using Smartphone and Modified YOLOv4. IEEE Access, 11(June), 59758–59773. https://doi.org/10.1109/ACCESS.2023.3285537 DOI: https://doi.org/10.1109/ACCESS.2023.3285537

Tang, Y., Gao, S., Zhuang, J., Hou, C., He, Y., Chu, X., Miao, A., & Luo, S. (2020). Apple Bruise Grading Using Piecewise Nonlinear Curve Fitting for Hyperspectral Imaging Data. IEEE Access, 8, 147494–147506. https://doi.org/10.1109/ACCESS.2020.3015808 DOI: https://doi.org/10.1109/ACCESS.2020.3015808

Tian, Y., Duan, H., Luo, R., Zhang, Y., Jia, W., Lian, J., Zheng, Y., Ruan, C., & Li, C. (2019). Fast Recognition and Location of Target Fruit Based on Depth Information. IEEE Access, 7, 170553–170563. https://doi.org/10.1109/ACCESS.2019.2955566 DOI: https://doi.org/10.1109/ACCESS.2019.2955566

Tran, H. M., Pham, K. T., Vo, T. M., Le, T. H., Huynh, T. T. M., & Dao, S. V. T. (2023). A New Approach for Estimation of Physical Properties of Irregular Shape Fruit. IEEE Access, 11(May), 46550–46560. https://doi.org/10.1109/ACCESS.2023.3273777 DOI: https://doi.org/10.1109/ACCESS.2023.3273777

Valdivia Arias, C. J. (2016). Diseño de un Sistema de Visión Artificial para la clasificación de chirimoyas basado en medidas. Pontificia Universidad Católica del Perú. http://hdl.handle.net/20.500.12404/7849

Véles, A. M., Sánchez, A., & Sánchez, J. (2003). Visión por Computador. In Dykinson (Ed.), Universidad Rey Juan Carlos.

Vicuña, J., & Anelle, M. (2021). Lectura de Medidores Eléctricos Analógicos mediante Visión Artificial. Universidad Católica de Cuenca, 1–71.

Wang, D., Li, C., Song, H., Xiong, H., Liu, C., & He, D. (2020). Deep Learning Approach for Apple Edge Detection to Remotely Monitor Apple Growth in Orchards. IEEE Access, 8, 26911–26925. https://doi.org/10.1109/ACCESS.2020.2971524 DOI: https://doi.org/10.1109/ACCESS.2020.2971524

Wu, L., Ma, J., Zhao, Y., & Liu, H. (2021). Apple detection in complex scene using the improved yolov4 model. Agronomy, 11(3). https://doi.org/10.3390/agronomy11030476 DOI: https://doi.org/10.3390/agronomy11030476

Xuan, G., Gao, C., Shao, Y., Zhang, M., Wang, Y., Zhong, J., Li, Q., & Peng, H. (2020). Apple Detection in Natural Environment Using Deep Learning Algorithms. IEEE Access, 8, 216772–216780. https://doi.org/10.1109/ACCESS.2020.3040423 DOI: https://doi.org/10.1109/ACCESS.2020.3040423

Zhang, Q., & Gao, G. (2019). Grasping Point Detection of Randomly Placed Fruit Cluster Using Adaptive Morphology Segmentation and Principal Component Classification of Multiple Features. IEEE Access, 7, 158035–158050. https://doi.org/10.1109/ACCESS.2019.2946267 DOI: https://doi.org/10.1109/ACCESS.2019.2946267