The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests

<b> </b>Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item dif...

Full description

Bibliographic Details
Main Authors: Jeanette Melin, Stefan Cano, Leslie Pendrill
Format: Article
Language:English
Published: MDPI AG 2021-02-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/23/2/212
id doaj-1efe4e1214074887b13c53bcedd60d1d
record_format Article
spelling doaj-1efe4e1214074887b13c53bcedd60d1d2021-02-10T00:06:46ZengMDPI AGEntropy1099-43002021-02-012321221210.3390/e23020212The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory TestsJeanette Melin0Stefan Cano1Leslie Pendrill2Department of Measurement Science and Technology, Research Institutes of Sweden (RISE), AWL Sven Hultins Plats 5, vån 4, 412 58 Göteborg, SwedenModus Outcomes, Spirella Building, Letchworth Garden City SG6 4ET, UKDepartment of Measurement Science and Technology, Research Institutes of Sweden (RISE), AWL Sven Hultins Plats 5, vån 4, 412 58 Göteborg, Sweden<b> </b>Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item difficulty parameters according to the well-known Rasch model. Here, we adopt an information theory approach, particularly extending deployment of the classic Brillouin entropy expression when explaining the difficulty of recalling non-verbal sequences in memory tests (i.e., Corsi Block Test and Digit Span Test): a more ordered task, of less entropy, will generally be easier to perform. Construct specification equations (CSEs) as a part of a methodological development, with entropy-based variables dominating, are found experimentally to explain (<i>r</i> =R2 = 0.98) and predict the construct of task difficulty for short-term memory tests using data from the NeuroMET (n<i> </i>=<i> </i>88) and Gothenburg MCI (n<i> </i>=<i> </i>257) studies. We propose entropy-based equivalence criteria, whereby different tasks (in the form of items) from different tests can be combined, enabling new memory tests to be formed by choosing a bespoke selection of items, leading to more efficient testing, improved reliability (reduced uncertainties) and validity. This provides opportunities for more practical and accurate measurement in clinical practice, research and trials.https://www.mdpi.com/1099-4300/23/2/212entropyinformationmetrologymeasurement system analysisRaschcognition
collection DOAJ
language English
format Article
sources DOAJ
author Jeanette Melin
Stefan Cano
Leslie Pendrill
spellingShingle Jeanette Melin
Stefan Cano
Leslie Pendrill
The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
Entropy
entropy
information
metrology
measurement system analysis
Rasch
cognition
author_facet Jeanette Melin
Stefan Cano
Leslie Pendrill
author_sort Jeanette Melin
title The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
title_short The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
title_full The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
title_fullStr The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
title_full_unstemmed The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
title_sort role of entropy in construct specification equations (cse) to improve the validity of memory tests
publisher MDPI AG
series Entropy
issn 1099-4300
publishDate 2021-02-01
description <b> </b>Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item difficulty parameters according to the well-known Rasch model. Here, we adopt an information theory approach, particularly extending deployment of the classic Brillouin entropy expression when explaining the difficulty of recalling non-verbal sequences in memory tests (i.e., Corsi Block Test and Digit Span Test): a more ordered task, of less entropy, will generally be easier to perform. Construct specification equations (CSEs) as a part of a methodological development, with entropy-based variables dominating, are found experimentally to explain (<i>r</i> =R2 = 0.98) and predict the construct of task difficulty for short-term memory tests using data from the NeuroMET (n<i> </i>=<i> </i>88) and Gothenburg MCI (n<i> </i>=<i> </i>257) studies. We propose entropy-based equivalence criteria, whereby different tasks (in the form of items) from different tests can be combined, enabling new memory tests to be formed by choosing a bespoke selection of items, leading to more efficient testing, improved reliability (reduced uncertainties) and validity. This provides opportunities for more practical and accurate measurement in clinical practice, research and trials.
topic entropy
information
metrology
measurement system analysis
Rasch
cognition
url https://www.mdpi.com/1099-4300/23/2/212
work_keys_str_mv AT jeanettemelin theroleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests
AT stefancano theroleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests
AT lesliependrill theroleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests
AT jeanettemelin roleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests
AT stefancano roleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests
AT lesliependrill roleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests
_version_ 1724275678192336896