A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.
A method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2019-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0220749 |
id |
doaj-8d6f9bd77262448180b18ee054fcd027 |
---|---|
record_format |
Article |
spelling |
doaj-8d6f9bd77262448180b18ee054fcd0272021-03-03T19:56:21ZengPublic Library of Science (PLoS)PLoS ONE1932-62032019-01-01148e022074910.1371/journal.pone.0220749A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels.John A CaldwellPhilip J NiroEmily K FarinaJames P McClungGregory R CaronHarris R LiebermanA method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response to stress often assesses multiple disparate dependent measures. Selecting the most sensitive is difficult as formal methods to compare varied dependent measures have not been developed. The method first converts the outcome measures into standard scores (z-scores) and then compares them using analysis of variance to determine whether there are differences in how they assess the impact of graded levels of exposure to stress. The analysis detected various significant interactions in several measures and suggests self-report mood questionnaires were more sensitive to the stressors present in the study than the cognitive or hormonal measures which were used. These findings support the effectiveness of the z-score based method as a useful procedure for objectively evaluating the differential sensitivity of various metrics. This method could be useful for research on other independent variables when use of multiple assessment strategies is appropriate. It could be used for evaluating studies yielding conflicting results, such as those detecting effects on one parameter but not others. In such instances, cross-metric inconsistencies may be due to differential sensitivity of measurement strategies rather than actual differences in the effects of the independent-variable on the domains under investigation.https://doi.org/10.1371/journal.pone.0220749 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
John A Caldwell Philip J Niro Emily K Farina James P McClung Gregory R Caron Harris R Lieberman |
spellingShingle |
John A Caldwell Philip J Niro Emily K Farina James P McClung Gregory R Caron Harris R Lieberman A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. PLoS ONE |
author_facet |
John A Caldwell Philip J Niro Emily K Farina James P McClung Gregory R Caron Harris R Lieberman |
author_sort |
John A Caldwell |
title |
A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. |
title_short |
A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. |
title_full |
A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. |
title_fullStr |
A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. |
title_full_unstemmed |
A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. |
title_sort |
z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2019-01-01 |
description |
A method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response to stress often assesses multiple disparate dependent measures. Selecting the most sensitive is difficult as formal methods to compare varied dependent measures have not been developed. The method first converts the outcome measures into standard scores (z-scores) and then compares them using analysis of variance to determine whether there are differences in how they assess the impact of graded levels of exposure to stress. The analysis detected various significant interactions in several measures and suggests self-report mood questionnaires were more sensitive to the stressors present in the study than the cognitive or hormonal measures which were used. These findings support the effectiveness of the z-score based method as a useful procedure for objectively evaluating the differential sensitivity of various metrics. This method could be useful for research on other independent variables when use of multiple assessment strategies is appropriate. It could be used for evaluating studies yielding conflicting results, such as those detecting effects on one parameter but not others. In such instances, cross-metric inconsistencies may be due to differential sensitivity of measurement strategies rather than actual differences in the effects of the independent-variable on the domains under investigation. |
url |
https://doi.org/10.1371/journal.pone.0220749 |
work_keys_str_mv |
AT johnacaldwell azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT philipjniro azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT emilykfarina azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT jamespmcclung azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT gregoryrcaron azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT harrisrlieberman azscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT johnacaldwell zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT philipjniro zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT emilykfarina zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT jamespmcclung zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT gregoryrcaron zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels AT harrisrlieberman zscorebasedmethodforcomparingtherelativesensitivityofbehavioralandphysiologicalmetricsincludingcognitiveperformancemoodandhormonelevels |
_version_ |
1714824955746582528 |