Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras

Live sheep export has become a public concern. This study aimed to test a non-contact biometric system based on artificial intelligence to assess heat stress of sheep to be potentially used as automated animal welfare assessment in farms and while in transport. Skin temperature (°C) from head featur...

Full description

Bibliographic Details
Main Authors: Sigfredo Fuentes, Claudia Gonzalez Viejo, Surinder S. Chauhan, Aleena Joy, Eden Tongson, Frank R. Dunshea
Format: Article
Language:English
Published: MDPI AG 2020-11-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/21/6334
id doaj-8c01d79743b54753902beca4f06acbf5
record_format Article
spelling doaj-8c01d79743b54753902beca4f06acbf52020-11-25T04:02:16ZengMDPI AGSensors1424-82202020-11-01206334633410.3390/s20216334Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal CamerasSigfredo Fuentes0Claudia Gonzalez Viejo1Surinder S. Chauhan2Aleena Joy3Eden Tongson4Frank R. Dunshea5Digital Agriculture, Food and Wine Sciences Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, The University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture, Food and Wine Sciences Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, The University of Melbourne, Parkville, VIC 3010, AustraliaAnimal Nutrition and Physiology, Faculty of Veterinary and Agricultural Sciences, The University of Melbourne, Parkville 3010, AustraliaAnimal Nutrition and Physiology, Faculty of Veterinary and Agricultural Sciences, The University of Melbourne, Parkville 3010, AustraliaDigital Agriculture, Food and Wine Sciences Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, The University of Melbourne, Parkville, VIC 3010, AustraliaAnimal Nutrition and Physiology, Faculty of Veterinary and Agricultural Sciences, The University of Melbourne, Parkville 3010, AustraliaLive sheep export has become a public concern. This study aimed to test a non-contact biometric system based on artificial intelligence to assess heat stress of sheep to be potentially used as automated animal welfare assessment in farms and while in transport. Skin temperature (°C) from head features were extracted from infrared thermal videos (IRTV) using automated tracking algorithms. Two parameter engineering procedures from RGB videos were performed to assess Heart Rate (HR) in beats per minute (BPM) and respiration rate (RR) in breaths per minute (BrPM): (i) using changes in luminosity of the green (G) channel and (ii) changes in the green to red (a) from the CIELAB color scale. A supervised machine learning (ML) classification model was developed using raw RR parameters as inputs to classify cutoff frequencies for low, medium, and high respiration rate (Model 1). A supervised ML regression model was developed using raw HR and RR parameters from Model 1 (Model 2). Results showed that Models 1 and 2 were highly accurate in the estimation of RR frequency level with 96% overall accuracy (Model 1), and HR and RR with R = 0.94 and slope = 0.76 (Model 2) without statistical signs of overfittinghttps://www.mdpi.com/1424-8220/20/21/6334animal welfareskin temperatureartificial intelligenceheart raterespiration rate
collection DOAJ
language English
format Article
sources DOAJ
author Sigfredo Fuentes
Claudia Gonzalez Viejo
Surinder S. Chauhan
Aleena Joy
Eden Tongson
Frank R. Dunshea
spellingShingle Sigfredo Fuentes
Claudia Gonzalez Viejo
Surinder S. Chauhan
Aleena Joy
Eden Tongson
Frank R. Dunshea
Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras
Sensors
animal welfare
skin temperature
artificial intelligence
heart rate
respiration rate
author_facet Sigfredo Fuentes
Claudia Gonzalez Viejo
Surinder S. Chauhan
Aleena Joy
Eden Tongson
Frank R. Dunshea
author_sort Sigfredo Fuentes
title Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras
title_short Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras
title_full Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras
title_fullStr Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras
title_full_unstemmed Non-Invasive Sheep Biometrics Obtained by Computer Vision Algorithms and Machine Learning Modeling Using Integrated Visible/Infrared Thermal Cameras
title_sort non-invasive sheep biometrics obtained by computer vision algorithms and machine learning modeling using integrated visible/infrared thermal cameras
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-11-01
description Live sheep export has become a public concern. This study aimed to test a non-contact biometric system based on artificial intelligence to assess heat stress of sheep to be potentially used as automated animal welfare assessment in farms and while in transport. Skin temperature (°C) from head features were extracted from infrared thermal videos (IRTV) using automated tracking algorithms. Two parameter engineering procedures from RGB videos were performed to assess Heart Rate (HR) in beats per minute (BPM) and respiration rate (RR) in breaths per minute (BrPM): (i) using changes in luminosity of the green (G) channel and (ii) changes in the green to red (a) from the CIELAB color scale. A supervised machine learning (ML) classification model was developed using raw RR parameters as inputs to classify cutoff frequencies for low, medium, and high respiration rate (Model 1). A supervised ML regression model was developed using raw HR and RR parameters from Model 1 (Model 2). Results showed that Models 1 and 2 were highly accurate in the estimation of RR frequency level with 96% overall accuracy (Model 1), and HR and RR with R = 0.94 and slope = 0.76 (Model 2) without statistical signs of overfitting
topic animal welfare
skin temperature
artificial intelligence
heart rate
respiration rate
url https://www.mdpi.com/1424-8220/20/21/6334
work_keys_str_mv AT sigfredofuentes noninvasivesheepbiometricsobtainedbycomputervisionalgorithmsandmachinelearningmodelingusingintegratedvisibleinfraredthermalcameras
AT claudiagonzalezviejo noninvasivesheepbiometricsobtainedbycomputervisionalgorithmsandmachinelearningmodelingusingintegratedvisibleinfraredthermalcameras
AT surinderschauhan noninvasivesheepbiometricsobtainedbycomputervisionalgorithmsandmachinelearningmodelingusingintegratedvisibleinfraredthermalcameras
AT aleenajoy noninvasivesheepbiometricsobtainedbycomputervisionalgorithmsandmachinelearningmodelingusingintegratedvisibleinfraredthermalcameras
AT edentongson noninvasivesheepbiometricsobtainedbycomputervisionalgorithmsandmachinelearningmodelingusingintegratedvisibleinfraredthermalcameras
AT frankrdunshea noninvasivesheepbiometricsobtainedbycomputervisionalgorithmsandmachinelearningmodelingusingintegratedvisibleinfraredthermalcameras
_version_ 1724443640450777088