Comparative analysis of 2D and 3D vineyard yield prediction system using artificial intelligence

Published: 30 October 2023
Abstract Views: 495
PDF: 24
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.


Traditional techniques for estimating the weight of clusters in a winery, generally consist of manually counting the variety of clusters per vine, and scaling by means of the entire variety of vines. This method can be arduous, and costly, and its accuracy depends on the scale of the sample. To overcome these problems, hybrid approaches of computer vision, deep learning (DL), and machine learning (ML) based vineyard yield prediction systems are proposed. Self-prepared datasets are used for comparative analysis of 2D and 3D yield prediction systems for vineyards. DL-based approach for segmentation operation on an RGB-D image dataset created with the D435I camera is used along with the ML-based weight prediction technique of grape clusters present in the single image using these datasets. A comparative analysis of the DL-based Keras regression model and various ML-based regression models for the weight prediction task is taken into account, and finally, a prediction model is proposed to estimate the yield of the entire vineyard. The analysis shows improved performance with the 3D vineyard yield prediction system compared to the 2D vineyard yield prediction system with grape cluster segmentation pixel accuracy up to 94.81% and yield prediction accuracy up to 99.58%.



PlumX Metrics


Download data is not yet available.


Abdul Hakkim V.M., Abhilash Joseph E., Ajay Gokul A.J., Mufeedha K. 2016. Precision farming: The future of Indian agriculture. J. Appl. Biol. Biotechnol. 4:68-72. DOI:
Altaheri H., Alsulaiman M., Muhammad G. 2019. Date fruit classification for robotic harvesting in a natural environment using deep learning. IEEE Access. 7:117115-33. DOI:
Arad B., Kurtser P., Barnea E., Ha B., Edan Y., Ben-Shahar O. 2019. Controlled Lighting and Illumination-Independent Target Detection for Real-Time Cost-Efficient Applications. The Case Study of Sweet Pepper Robotic Harvesting. Sensors. 19:1390. DOI:
Badeka E., Kalabokas T., Tziridis K., Nicolaou A., Vrochidou E., Mavridou E., Papakostas G.A., Pachidis T. 2019. Grapes Visual Segmentation for Harvesting Robots Using Local Texture Descriptors. Springer Link Computer Vision Systems. 98-109. DOI:
Baeten J., Donn K., Boedrij S., Beckers W. 2008. Autonomous fruit picking machine: A robotic apple harvester. Field and Service Robotics. 42:531-9. DOI:
Barbole D.K., Jadhav P.M. 2021. Comparative Analysis of Deep Learning Architectures for Grape Cluster Instance Segmentation. Inf. Technol. Industry. 9. DOI:
Barbole D.K., Jadhav P.M. 2022. Grape Yield Prediction using Deep Learning Regression Model. 2022 International Conference for Advancement in Technology (ICONAT), Goa, India, 1-6. DOI:
Barbole D.K., Jadhav P.M. 2023a. GrapesNet: Indian Grape Clusters RGB & RGB-D Image Datasets. Mendeley Data.
Barbole D.K., Jadhav P.M. 2023b. GrapesNet: Indian RGB & RGB-D vineyard image datasets for deep learning applications. Data Brief. 48:109100. DOI:
Barbole D., Jadhav P., Patil S. 2021. A Review on Fruit Detection and Segmentation Techniques in Agricultural Field. International Conference on Image Processing and Capsule Networks. 300:269-88. DOI:
California Historical Society Collection. 2012. Close-up of a grape cluster on a vine. University of Southern California (USC) Digital Library.
Cecotti H., Rivera A., Farhadloo M., Pedroza M.A. 2020. Grape detection with convolutional neural networks. Expert Syst. Appl. 159. DOI:
Ceres R., Pons J.L., Jiménez A.R., Martín J.M. 1998. Agribot: A robot for aided fruit harvesting. Industrial Robot. 5.
Chen S., Shivakumar S., Dcunha S., Das J., Okon E., Qu C., Kumar V. 2017. Counting apples and oranges with deep learning: A data-driven approach. IEEE Robot. Autom. Lett. 2:781-8. DOI:
Fernandez-Maloigne C., Laugier D., Boscolo C. 1993. Detection of apples with texture analyses for an apple picker robot. Proceedings of the Intelligent Vehicles ‘93 Symposium, IEEE Xplore. pp. 323-8.
FAO. 2009. Global agriculture towards 2050. High-level Expert Forum. Available at the link:
Grasso G., Recce M. 1996. Scene analysis for an orange picking robot. Proceeding in International Conference of Computer Technology in Agriculture (ICCTA ‘96).
Habaragamuwa H., Ogawa Y., Suzuki T., Shiigi T., Ono M., Kondo N. 2018. Detecting greenhouse strawberries (mature and immature), using deep convolutional neural network. Eng. Agric. Environ. Food. 11:127-38. DOI:
Kang H., Chen C. 2019a. Fruit Detection, Segmentation and 3D Visualization of Environment in Apple Orchards. Comput. Electron. Agric. 171:105302. DOI:
Kang H., Chen C. 2019b. Fruit Detection and Segmentation for Apple Harvesting Using Visual Sensor in Orchards. Sensors. 19:4599. DOI:
Khan N., Fahad S., Naushad M., Faisal S. 2020. Grape Production Critical Review in the World. SSRN Electron. J. DOI:
Lee J., Nazki H., Baek J., Hong Y., Lee, M. 2020. Artificial Intelligence Approach for Tomato Detection and Mass estimation in Precision Agriculture. Sustainability 12:9138. DOI:
Liu S., Whitty M. 2015. Automatic grape bunch detection in vineyards with an SVM classifier. J. Appl. Log. 13:643-53. DOI:
Liu X., Chen S.W., Aditya S., Sivakumar N., Dcunha S., Qu C., Taylor C.J., Das J., Kumar V. 2018. Robust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). DOI:
Liu Z., Wu J., Fu L., Maje Y., Feng Y., Li R., Cui Y. 2020. Improved Kiwifruit Detection Using Pre-Trained VGG16 With RGB and NIR Information Fusion. IEEE Access. 8. DOI:
Luo L., Tang Y., Lu Q., Chen X., Zhang P., Zou X. 2018. A vision methodology for harvesting robot to detect cutting points on peduncles of double overlapping grape clusters in a vineyard. Comput. Ind. 99:130-9. DOI:
Luo L., Tang Y., Zou X., Wang C., Zhang P., Feng W. 2016. Robust Grape Cluster Detection in a Vineyard by Combining the Ada- Boost Framework and Multiple Color Components. Sensors. 16. DOI:
Marani R., Milella A., Petitti A., Reina G. 2020. Deep neural networks for grape bunch segmentation in natural images from a consumer-grade camera. J. Prec. Agric. 22:387-413. DOI:
Ni X., Li C., Jiang H., Takeda F. 2020. Deep learning image segmentation and extraction of blueberry fruit traits associated with harvest ability and yield. Horticul. Res. 7. DOI:
Nuske S., Achar S., Bates T., Narasimhan S. 2011. Yield estimation in vineyards by visual grape detection. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. DOI:
Ranganathan J., Waite R., Searchinger T., Hanson C. 2018. How to Sustainably Feed 10 Billion People by 2050. World Resources Institute. Available from:
Santos T.T., De-Souza L.L., Dos-Santos A., Avila S. 2020. Grape detection, segmentation and tracking using deep neural networks and three-dimensional association. Comput. Electron. Agric. 170. DOI:
Stein M., Bargoti S., Underwood J. 2019. Image Based Mango Fruit Detection, Localization and Yield Estimation using Multiple View Geometry. Sensors. 16:1915 DOI:
Tang Y., Chen M., Wang C., Luo L., Li J., Lian G., Zou X. 2020. Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review. Frontiers Plant Sci. 11. DOI:
Tang Y., Zhou H., Wang H., Zhang Y. 2023. Fruit detection and positioning technology for a Camellia oleifera C. Abel orchard based on improved YOLOv4-tiny model and binocular stereo vision. Exp. Syst. Appl. 211. DOI:
Wang C., Tang Y., Zou X., SiTu W., Feng W. 2017. A Robust Fruit Image Segmentation Algorithm against Varying Illumination for Vision System of Fruit Harvesting Robot. Optik - Int. J. Light Electron. Opt. 131:626-31. DOI:
Zhang C., Ding H., Shi Q., Wang Y. 2022. Grape Cluster Real-Time Detection in Complex Natural Scenes Based on YOLOv5s Deep Learning Network. Agriculture. 12. DOI:
Zhou Y., Tang Y., Zou X., Wu M., Tang W., Meng F., Zhang Y., Kang H. 2022. Adaptive Active Positioning of Camellia oleifera Fruit Picking Points: Classical Image Processing and YOLOv7 Fusion Algorithm. Appl. Sci. 12:12959. DOI:

How to Cite

Barbole, D. and Jadhav, P. M. (2023) “Comparative analysis of 2D and 3D vineyard yield prediction system using artificial intelligence”, Journal of Agricultural Engineering, 55(1). doi: 10.4081/jae.2023.1545.