A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.

A method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response...

Full description

Bibliographic Details
Main Authors: John A Caldwell, Philip J Niro, Emily K Farina, James P McClung, Gregory R Caron, Harris R Lieberman
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2019-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0220749
id doaj-8d6f9bd77262448180b18ee054fcd027
record_format Article
spelling doaj-8d6f9bd77262448180b18ee054fcd0272021-03-03T19:56:21ZengPublic Library of Science (PLoS)PLoS ONE1932-62032019-01-01148e022074910.1371/journal.pone.0220749A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.John A CaldwellPhilip J NiroEmily K FarinaJames P McClungGregory R CaronHarris R LiebermanA method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response to stress often assesses multiple disparate dependent measures. Selecting the most sensitive is difficult as formal methods to compare varied dependent measures have not been developed. The method first converts the outcome measures into standard scores (z-scores) and then compares them using analysis of variance to determine whether there are differences in how they assess the impact of graded levels of exposure to stress. The analysis detected various significant interactions in several measures and suggests self-report mood questionnaires were more sensitive to the stressors present in the study than the cognitive or hormonal measures which were used. These findings support the effectiveness of the z-score based method as a useful procedure for objectively evaluating the differential sensitivity of various metrics. This method could be useful for research on other independent variables when use of multiple assessment strategies is appropriate. It could be used for evaluating studies yielding conflicting results, such as those detecting effects on one parameter but not others. In such instances, cross-metric inconsistencies may be due to differential sensitivity of measurement strategies rather than actual differences in the effects of the independent-variable on the domains under investigation.https://doi.org/10.1371/journal.pone.0220749
collection DOAJ
language English
format Article
sources DOAJ
author John A Caldwell
Philip J Niro
Emily K Farina
James P McClung
Gregory R Caron
Harris R Lieberman
spellingShingle John A Caldwell
Philip J Niro
Emily K Farina
James P McClung
Gregory R Caron
Harris R Lieberman
A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
PLoS ONE
author_facet John A Caldwell
Philip J Niro
Emily K Farina
James P McClung
Gregory R Caron
Harris R Lieberman
author_sort John A Caldwell
title A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
title_short A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
title_full A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
title_fullStr A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
title_full_unstemmed A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
title_sort z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2019-01-01
description A method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response to stress often assesses multiple disparate dependent measures. Selecting the most sensitive is difficult as formal methods to compare varied dependent measures have not been developed. The method first converts the outcome measures into standard scores (z-scores) and then compares them using analysis of variance to determine whether there are differences in how they assess the impact of graded levels of exposure to stress. The analysis detected various significant interactions in several measures and suggests self-report mood questionnaires were more sensitive to the stressors present in the study than the cognitive or hormonal measures which were used. These findings support the effectiveness of the z-score based method as a useful procedure for objectively evaluating the differential sensitivity of various metrics. This method could be useful for research on other independent variables when use of multiple assessment strategies is appropriate. It could be used for evaluating studies yielding conflicting results, such as those detecting effects on one parameter but not others. In such instances, cross-metric inconsistencies may be due to differential sensitivity of measurement strategies rather than actual differences in the effects of the independent-variable on the domains under investigation.
url https://doi.org/10.1371/journal.pone.0220749
work_keys_str_mv AT johnacaldwell azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT philipjniro azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT emilykfarina azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT jamespmcclung azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT gregoryrcaron azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT harrisrlieberman azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT johnacaldwell zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT philipjniro zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT emilykfarina zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT jamespmcclung zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT gregoryrcaron zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
AT harrisrlieberman zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels
_version_ 1714824955746582528