Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries

Remote sensing technology, such as hyperspectral imaging, in combination with machine learning algorithms, has emerged as a viable tool for rapid and nondestructive assessment of wine grape ripeness. However, the differences in terroir, together with the climatic variations and the variability exhib...

Full description

Bibliographic Details
Main Authors: Véronique Gomes, Ana Mendes-Ferreira, Pedro Melo-Pinto
Format: Article
Language:English
Published: MDPI AG 2021-05-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/10/3459
id doaj-ddd718e95f6c4da99d4aff74473b0a25
record_format Article
spelling doaj-ddd718e95f6c4da99d4aff74473b0a252021-06-01T00:09:44ZengMDPI AGSensors1424-82202021-05-01213459345910.3390/s21103459Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape BerriesVéronique Gomes0Ana Mendes-Ferreira1Pedro Melo-Pinto2CITAB—Centre for the Research and Technology of Agro-Environmental and Biological Sciences, Inov4Agro—Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production, Universidade de Trás-os-Montes e Alto Douro, 5000-801 Vila Real, PortugalCITAB—Centre for the Research and Technology of Agro-Environmental and Biological Sciences, Inov4Agro—Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production, Universidade de Trás-os-Montes e Alto Douro, 5000-801 Vila Real, PortugalCITAB—Centre for the Research and Technology of Agro-Environmental and Biological Sciences, Inov4Agro—Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production, Universidade de Trás-os-Montes e Alto Douro, 5000-801 Vila Real, PortugalRemote sensing technology, such as hyperspectral imaging, in combination with machine learning algorithms, has emerged as a viable tool for rapid and nondestructive assessment of wine grape ripeness. However, the differences in terroir, together with the climatic variations and the variability exhibited by different grape varieties, have a considerable impact on the grape ripening stages within a vintage and between vintages and, consequently, on the robustness of the predictive models. To address this challenge, we present a novel one-dimensional convolutional neural network architecture-based model for the prediction of sugar content and pH, using reflectance hyperspectral data from different vintages. We aimed to evaluate the model’s generalization capacity for different varieties and for a different vintage not employed in the training process, using independent test sets. A transfer learning mechanism, based on the proposed convolutional neural network, was also used to evaluate improvements in the model’s generalization. Overall, the results for generalization ability showed a very good performance with RMSEP values of 1.118 °Brix and 1.085 °Brix for sugar content and 0.199 and 0.183 for pH, for test sets using different varieties and a different vintage, respectively, improving and updating the current state of the art.https://www.mdpi.com/1424-8220/21/10/3459machine learningconvolutional neural networkstransfer learninghyperspectral imagingpredictiongrape berries
collection DOAJ
language English
format Article
sources DOAJ
author Véronique Gomes
Ana Mendes-Ferreira
Pedro Melo-Pinto
spellingShingle Véronique Gomes
Ana Mendes-Ferreira
Pedro Melo-Pinto
Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries
Sensors
machine learning
convolutional neural networks
transfer learning
hyperspectral imaging
prediction
grape berries
author_facet Véronique Gomes
Ana Mendes-Ferreira
Pedro Melo-Pinto
author_sort Véronique Gomes
title Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries
title_short Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries
title_full Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries
title_fullStr Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries
title_full_unstemmed Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries
title_sort application of hyperspectral imaging and deep learning for robust prediction of sugar and ph levels in wine grape berries
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-05-01
description Remote sensing technology, such as hyperspectral imaging, in combination with machine learning algorithms, has emerged as a viable tool for rapid and nondestructive assessment of wine grape ripeness. However, the differences in terroir, together with the climatic variations and the variability exhibited by different grape varieties, have a considerable impact on the grape ripening stages within a vintage and between vintages and, consequently, on the robustness of the predictive models. To address this challenge, we present a novel one-dimensional convolutional neural network architecture-based model for the prediction of sugar content and pH, using reflectance hyperspectral data from different vintages. We aimed to evaluate the model’s generalization capacity for different varieties and for a different vintage not employed in the training process, using independent test sets. A transfer learning mechanism, based on the proposed convolutional neural network, was also used to evaluate improvements in the model’s generalization. Overall, the results for generalization ability showed a very good performance with RMSEP values of 1.118 °Brix and 1.085 °Brix for sugar content and 0.199 and 0.183 for pH, for test sets using different varieties and a different vintage, respectively, improving and updating the current state of the art.
topic machine learning
convolutional neural networks
transfer learning
hyperspectral imaging
prediction
grape berries
url https://www.mdpi.com/1424-8220/21/10/3459
work_keys_str_mv AT veroniquegomes applicationofhyperspectralimaginganddeeplearningforrobustpredictionofsugarandphlevelsinwinegrapeberries
AT anamendesferreira applicationofhyperspectralimaginganddeeplearningforrobustpredictionofsugarandphlevelsinwinegrapeberries
AT pedromelopinto applicationofhyperspectralimaginganddeeplearningforrobustpredictionofsugarandphlevelsinwinegrapeberries
_version_ 1721415606192832512