Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study

BackgroundMaximal oxygen consumption (VO2max) is one of the most predictive biometrics for cardiovascular health and overall mortality. However, VO2max is rarely measured in large-scale research studies or routine clinical care because of the high cost, participant burden, an...

Full description

Bibliographic Details
Main Authors: Webster, Dan E, Tummalacherla, Meghasyam, Higgins, Michael, Wing, David, Ashley, Euan, Kelly, Valerie E, McConnell, Michael V, Muse, Evan D, Olgin, Jeffrey E, Mangravite, Lara M, Godino, Job, Kellen, Michael R, Omberg, Larsson
Format: Article
Language:English
Published: JMIR Publications 2021-06-01
Series:JMIR mHealth and uHealth
Online Access:https://mhealth.jmir.org/2021/6/e26006
id doaj-574918bdf97f47f09211cbcdd81fb90b
record_format Article
spelling doaj-574918bdf97f47f09211cbcdd81fb90b2021-06-04T13:47:35ZengJMIR PublicationsJMIR mHealth and uHealth2291-52222021-06-0196e2600610.2196/26006Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation StudyWebster, Dan ETummalacherla, MeghasyamHiggins, MichaelWing, DavidAshley, EuanKelly, Valerie EMcConnell, Michael VMuse, Evan DOlgin, Jeffrey EMangravite, Lara MGodino, JobKellen, Michael ROmberg, Larsson BackgroundMaximal oxygen consumption (VO2max) is one of the most predictive biometrics for cardiovascular health and overall mortality. However, VO2max is rarely measured in large-scale research studies or routine clinical care because of the high cost, participant burden, and requirement for specialized equipment and staff. ObjectiveTo overcome the limitations of clinical VO2max measurement, we aim to develop a digital VO2max estimation protocol that can be self-administered remotely using only the sensors within a smartphone. We also aim to validate this measure within a broadly representative population across a spectrum of smartphone devices. MethodsTwo smartphone-based VO2max estimation protocols were developed: a 12-minute run test (12-MRT) based on distance measured by GPS and a 3-minute step test (3-MST) based on heart rate recovery measured by a camera. In a 101-person cohort, balanced across age deciles and sex, participants completed a gold standard treadmill-based VO2max measurement, two silver standard clinical protocols, and the smartphone-based 12-MRT and 3-MST protocols in the clinic and at home. In a separate 120-participant cohort, the video-based heart rate measurement underlying the 3-MST was measured for accuracy in individuals across the spectrum skin tones while using 8 different smartphones ranging in cost from US $99 to US $999. ResultsWhen compared with gold standard VO2max testing, Lin concordance was pc=0.66 for 12-MRT and pc=0.61 for 3-MST. However, in remote settings, the 12-MRT was significantly less concordant with the gold standard (pc=0.25) compared with the 3-MST (pc=0.61), although both had high test-retest reliability (12-MRT intraclass correlation coefficient=0.88; 3-MST intraclass correlation coefficient=0.86). On the basis of the finding that 3-MST concordance was generalizable to remote settings whereas 12-MRT was not, the video-based heart rate measure within the 3-MST was selected for further investigation. Heart rate measurements in any of the combinations of the six Fitzpatrick skin tones and 8 smartphones resulted in a concordance of pc≥0.81. Performance did not correlate with device cost, with all phones selling under US $200 performing better than pc>0.92. ConclusionsThese findings demonstrate the importance of validating mobile health measures in the real world across a diverse cohort and spectrum of hardware. The 3-MST protocol, termed as heart snapshot, measured VO2max with similar accuracy to supervised in-clinic tests such as the Tecumseh (pc=0.94) protocol, while also generalizing to remote and unsupervised measurements. Heart snapshot measurements demonstrated fidelity across demographic variation in age and sex, across diverse skin pigmentation, and between various iOS and Android phone configurations. This software is freely available for all validation data and analysis code.https://mhealth.jmir.org/2021/6/e26006
collection DOAJ
language English
format Article
sources DOAJ
author Webster, Dan E
Tummalacherla, Meghasyam
Higgins, Michael
Wing, David
Ashley, Euan
Kelly, Valerie E
McConnell, Michael V
Muse, Evan D
Olgin, Jeffrey E
Mangravite, Lara M
Godino, Job
Kellen, Michael R
Omberg, Larsson
spellingShingle Webster, Dan E
Tummalacherla, Meghasyam
Higgins, Michael
Wing, David
Ashley, Euan
Kelly, Valerie E
McConnell, Michael V
Muse, Evan D
Olgin, Jeffrey E
Mangravite, Lara M
Godino, Job
Kellen, Michael R
Omberg, Larsson
Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study
JMIR mHealth and uHealth
author_facet Webster, Dan E
Tummalacherla, Meghasyam
Higgins, Michael
Wing, David
Ashley, Euan
Kelly, Valerie E
McConnell, Michael V
Muse, Evan D
Olgin, Jeffrey E
Mangravite, Lara M
Godino, Job
Kellen, Michael R
Omberg, Larsson
author_sort Webster, Dan E
title Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study
title_short Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study
title_full Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study
title_fullStr Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study
title_full_unstemmed Smartphone-Based VO2max Measurement With Heart Snapshot in Clinical and Real-world Settings With a Diverse Population: Validation Study
title_sort smartphone-based vo2max measurement with heart snapshot in clinical and real-world settings with a diverse population: validation study
publisher JMIR Publications
series JMIR mHealth and uHealth
issn 2291-5222
publishDate 2021-06-01
description BackgroundMaximal oxygen consumption (VO2max) is one of the most predictive biometrics for cardiovascular health and overall mortality. However, VO2max is rarely measured in large-scale research studies or routine clinical care because of the high cost, participant burden, and requirement for specialized equipment and staff. ObjectiveTo overcome the limitations of clinical VO2max measurement, we aim to develop a digital VO2max estimation protocol that can be self-administered remotely using only the sensors within a smartphone. We also aim to validate this measure within a broadly representative population across a spectrum of smartphone devices. MethodsTwo smartphone-based VO2max estimation protocols were developed: a 12-minute run test (12-MRT) based on distance measured by GPS and a 3-minute step test (3-MST) based on heart rate recovery measured by a camera. In a 101-person cohort, balanced across age deciles and sex, participants completed a gold standard treadmill-based VO2max measurement, two silver standard clinical protocols, and the smartphone-based 12-MRT and 3-MST protocols in the clinic and at home. In a separate 120-participant cohort, the video-based heart rate measurement underlying the 3-MST was measured for accuracy in individuals across the spectrum skin tones while using 8 different smartphones ranging in cost from US $99 to US $999. ResultsWhen compared with gold standard VO2max testing, Lin concordance was pc=0.66 for 12-MRT and pc=0.61 for 3-MST. However, in remote settings, the 12-MRT was significantly less concordant with the gold standard (pc=0.25) compared with the 3-MST (pc=0.61), although both had high test-retest reliability (12-MRT intraclass correlation coefficient=0.88; 3-MST intraclass correlation coefficient=0.86). On the basis of the finding that 3-MST concordance was generalizable to remote settings whereas 12-MRT was not, the video-based heart rate measure within the 3-MST was selected for further investigation. Heart rate measurements in any of the combinations of the six Fitzpatrick skin tones and 8 smartphones resulted in a concordance of pc≥0.81. Performance did not correlate with device cost, with all phones selling under US $200 performing better than pc>0.92. ConclusionsThese findings demonstrate the importance of validating mobile health measures in the real world across a diverse cohort and spectrum of hardware. The 3-MST protocol, termed as heart snapshot, measured VO2max with similar accuracy to supervised in-clinic tests such as the Tecumseh (pc=0.94) protocol, while also generalizing to remote and unsupervised measurements. Heart snapshot measurements demonstrated fidelity across demographic variation in age and sex, across diverse skin pigmentation, and between various iOS and Android phone configurations. This software is freely available for all validation data and analysis code.
url https://mhealth.jmir.org/2021/6/e26006
work_keys_str_mv AT websterdane smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT tummalacherlameghasyam smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT higginsmichael smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT wingdavid smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT ashleyeuan smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT kellyvaleriee smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT mcconnellmichaelv smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT museevand smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT olginjeffreye smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT mangravitelaram smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT godinojob smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT kellenmichaelr smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
AT omberglarsson smartphonebasedvo2maxmeasurementwithheartsnapshotinclinicalandrealworldsettingswithadiversepopulationvalidationstudy
_version_ 1721397470484758528