Hyperspectral Imaging and Deep Learning for Food Safety Assessment

Hyperspectral imaging (HSI) systems are valuable tools for merging both spectroscopic and computer vision technologies in a single system with the advantage of providing the physical attributes and chemical distribution of materials represented in an image. Snapshot HSI systems are portable systems...

Full description

Bibliographic Details
Main Author: Al-Sarayreh, Mahmoud (Author)
Other Authors: Klette, Reinhard (Contributor), Yan, Wei Qi (Contributor)
Format: Others
Published: Auckland University of Technology, 2020-07-09T01:28:36Z.
Subjects:
HSI
FOD
3D > CNN
RPN
Online Access:Get fulltext
LEADER 04449 am a22004333u 4500
001 13514
042 |a dc 
100 1 0 |a Al-Sarayreh, Mahmoud  |e author 
100 1 0 |a Klette, Reinhard  |e contributor 
100 1 0 |a Yan, Wei Qi  |e contributor 
245 0 0 |a Hyperspectral Imaging and Deep Learning for Food Safety Assessment 
260 |b Auckland University of Technology,   |c 2020-07-09T01:28:36Z. 
520 |a Hyperspectral imaging (HSI) systems are valuable tools for merging both spectroscopic and computer vision technologies in a single system with the advantage of providing the physical attributes and chemical distribution of materials represented in an image. Snapshot HSI systems are portable systems enabling the generation of HSI images at the video rate with limited spectral information, which makes this technology a step toward real-time HSI applications. For food processing, HSI systems are considered to form a rapid, non-invasive, non-destructive and chemical-free technology for predicting food attributes regarding food safety and quality assessment, which reflects positively on costs, accuracy and processing time of applications in the food industry. This thesis studies the interaction between chemical and textural distributions, presented as spectral and spatial features of HSI images. Moreover, the thesis discusses several traditional and novel approaches in computer vision and deep learning for utilising this interaction in applications of safety assessment of food such as adulteration detection in meat products, authenticity of meat products and foreign object detection (FOD) in meat products. In application of adulteration detection, traditional approaches are investigated for detecting the adulteration in meat products including spectral features and handcrafted textural features obtained from HSI images. Moreover, this thesis presents a novel multi-structure deep learning model for self-feature extraction and combination of these distributions (i.e., chemical and textural) in a single prediction model by using convolution neural networks (CNN). The model is evaluated against the traditional approaches and showed efficiency in prediction. Extraction of joint spectral and spatial features from HSI images is also discussed in this thesis. A 3D-CNN approach is proposed for extracting the joint features. Red-meat classification (case study of fine-grain material classification) is used for evaluating the proposed approach. Moreover, we propose a novel graph-based postprocessing method for enhancing the prediction of the 3D-CNN approach or of any pixel-wise classification model. The proposed classification framework is evaluated against traditional machine learning algorithms such as support vector machines and partial least square discriminant analysis. Three datasets were collected for the evaluation by using three HSI systems: line scanning, near-infrared (NIR) snapshot and visible (VIS) snapshot HSI. In application of FOD in meat products, the thesis discusses the object detection problem in HSI images based on their spectral and spatial features. A novel sequential deep learning framework is proposed for foreign object localization and classification by using CNN networks. The framework includes three modules in a sequential flow: Region proposal, filtering and classification modules. Two independent datasets of NIR snapshot HSI images, contaminated by many types of foreign materials, were used for training and testing the proposed approach. The evaluation showed promising efficiency of the proposed framework in terms of accuracy and real-time processing, compared with a baseline method for FOD such as the selective search approach. 
540 |a OpenAccess 
546 |a en 
650 0 4 |a Food processing 
650 0 4 |a Meat processing 
650 0 4 |a Adulteration detection 
650 0 4 |a Meat authenticity 
650 0 4 |a Hyperspectral imaging 
650 0 4 |a HSI 
650 0 4 |a Snapshot HSI 
650 0 4 |a Material classification 
650 0 4 |a Spectral 
650 0 4 |a Spatial 
650 0 4 |a Textural 
650 0 4 |a Joint features 
650 0 4 |a Object detection 
650 0 4 |a Foreign object 
650 0 4 |a FOD 
650 0 4 |a Foreign bodies 
650 0 4 |a Deep learning 
650 0 4 |a 2D-CNN 
650 0 4 |a 3D--CNN 
650 0 4 |a Region proposal 
650 0 4 |a RPN 
650 0 4 |a Classification 
655 7 |a Thesis 
856 |z Get fulltext  |u http://hdl.handle.net/10292/13514