The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests
<b> </b>Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item dif...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-02-01
|
Series: | Entropy |
Subjects: | |
Online Access: | https://www.mdpi.com/1099-4300/23/2/212 |
id |
doaj-1efe4e1214074887b13c53bcedd60d1d |
---|---|
record_format |
Article |
spelling |
doaj-1efe4e1214074887b13c53bcedd60d1d2021-02-10T00:06:46ZengMDPI AGEntropy1099-43002021-02-012321221210.3390/e23020212The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory TestsJeanette Melin0Stefan Cano1Leslie Pendrill2Department of Measurement Science and Technology, Research Institutes of Sweden (RISE), AWL Sven Hultins Plats 5, vån 4, 412 58 Göteborg, SwedenModus Outcomes, Spirella Building, Letchworth Garden City SG6 4ET, UKDepartment of Measurement Science and Technology, Research Institutes of Sweden (RISE), AWL Sven Hultins Plats 5, vån 4, 412 58 Göteborg, Sweden<b> </b>Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item difficulty parameters according to the well-known Rasch model. Here, we adopt an information theory approach, particularly extending deployment of the classic Brillouin entropy expression when explaining the difficulty of recalling non-verbal sequences in memory tests (i.e., Corsi Block Test and Digit Span Test): a more ordered task, of less entropy, will generally be easier to perform. Construct specification equations (CSEs) as a part of a methodological development, with entropy-based variables dominating, are found experimentally to explain (<i>r</i> =R2 = 0.98) and predict the construct of task difficulty for short-term memory tests using data from the NeuroMET (n<i> </i>=<i> </i>88) and Gothenburg MCI (n<i> </i>=<i> </i>257) studies. We propose entropy-based equivalence criteria, whereby different tasks (in the form of items) from different tests can be combined, enabling new memory tests to be formed by choosing a bespoke selection of items, leading to more efficient testing, improved reliability (reduced uncertainties) and validity. This provides opportunities for more practical and accurate measurement in clinical practice, research and trials.https://www.mdpi.com/1099-4300/23/2/212entropyinformationmetrologymeasurement system analysisRaschcognition |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jeanette Melin Stefan Cano Leslie Pendrill |
spellingShingle |
Jeanette Melin Stefan Cano Leslie Pendrill The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests Entropy entropy information metrology measurement system analysis Rasch cognition |
author_facet |
Jeanette Melin Stefan Cano Leslie Pendrill |
author_sort |
Jeanette Melin |
title |
The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests |
title_short |
The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests |
title_full |
The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests |
title_fullStr |
The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests |
title_full_unstemmed |
The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests |
title_sort |
role of entropy in construct specification equations (cse) to improve the validity of memory tests |
publisher |
MDPI AG |
series |
Entropy |
issn |
1099-4300 |
publishDate |
2021-02-01 |
description |
<b> </b>Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item difficulty parameters according to the well-known Rasch model. Here, we adopt an information theory approach, particularly extending deployment of the classic Brillouin entropy expression when explaining the difficulty of recalling non-verbal sequences in memory tests (i.e., Corsi Block Test and Digit Span Test): a more ordered task, of less entropy, will generally be easier to perform. Construct specification equations (CSEs) as a part of a methodological development, with entropy-based variables dominating, are found experimentally to explain (<i>r</i> =R2 = 0.98) and predict the construct of task difficulty for short-term memory tests using data from the NeuroMET (n<i> </i>=<i> </i>88) and Gothenburg MCI (n<i> </i>=<i> </i>257) studies. We propose entropy-based equivalence criteria, whereby different tasks (in the form of items) from different tests can be combined, enabling new memory tests to be formed by choosing a bespoke selection of items, leading to more efficient testing, improved reliability (reduced uncertainties) and validity. This provides opportunities for more practical and accurate measurement in clinical practice, research and trials. |
topic |
entropy information metrology measurement system analysis Rasch cognition |
url |
https://www.mdpi.com/1099-4300/23/2/212 |
work_keys_str_mv |
AT jeanettemelin theroleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests AT stefancano theroleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests AT lesliependrill theroleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests AT jeanettemelin roleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests AT stefancano roleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests AT lesliependrill roleofentropyinconstructspecificationequationscsetoimprovethevalidityofmemorytests |
_version_ |
1724275678192336896 |