Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment

BackgroundWeb-based patient education is increasingly offered to improve patients’ ability to learn, remember, and apply health information. Efficient organization, display, and structural design, that is, information architecture (IA), can support patients’ ability to indepe...

Full description

Bibliographic Details
Main Authors: Dekkers, Tessa, Melles, Marijke, Vehmeijer, Stephan B W, de Ridder, Huib
Format: Article
Language:English
Published: JMIR Publications 2021-03-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2021/3/e15846
id doaj-b60da6bcc1fc43aea4d5dc944de876cf
record_format Article
spelling doaj-b60da6bcc1fc43aea4d5dc944de876cf2021-04-02T21:07:58ZengJMIR PublicationsJournal of Medical Internet Research1438-88712021-03-01233e1584610.2196/15846Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized ExperimentDekkers, TessaMelles, MarijkeVehmeijer, Stephan B Wde Ridder, Huib BackgroundWeb-based patient education is increasingly offered to improve patients’ ability to learn, remember, and apply health information. Efficient organization, display, and structural design, that is, information architecture (IA), can support patients’ ability to independently use web-based patient education. However, the role of IA in the context of web-based patient education has not been examined systematically. ObjectiveTo support intervention designers in making informed choices that enhance patients’ learning, this paper describes a randomized experiment on the effects of IA on the effectiveness, use, and user experience of a patient education website and examines the theoretical mechanisms that explain these effects. MethodsMiddle-aged and older adults with self-reported hip or knee joint complaints were recruited to use and evaluate 1 of 3 patient education websites containing information on total joint replacement surgery. Each website contained the same textual content based on an existing leaflet but differed in the employed IA design (tunnel, hierarchical, or matrix design). Participants rated the websites on satisfaction, engagement, control, relevance, trust, and novelty and completed an objective knowledge test. Analyses of variance and structural equation modeling were used to examine the effects of IA and construct a theoretical model. ResultsWe included 215 participants in our analysis. IA did not affect knowledge gain (P=.36) or overall satisfaction (P=.07) directly. However, tunnel (mean 3.22, SD 0.67) and matrix (mean 3.17, SD 0.69) architectures were found to provide more emotional support compared with hierarchical architectures (mean 2.86, SD 0.60; P=.002). Furthermore, increased perceptions of personal relevance in the tunnel IA (β=.18) were found to improve satisfaction (β=.17) indirectly. Increased perceptions of active control in the matrix IA (β=.11) also improved satisfaction (β=.27) indirectly. The final model of the IA effects explained 74.3% of the variance in satisfaction and 6.8% of the variance in knowledge and achieved excellent fit (χ217,215=14.7; P=.62; root mean square error of approximation=0.000; 95% CI [0.000-0.053]; comparative fit index=1.00; standardized root mean square residual=0.044). ConclusionsIA has small but notable effects on users’ experiences with web-based health education interventions. Web-based patient education designers can employ tunnel IA designs to guide users through sequentially ordered content or matrix IA to offer users more control over navigation. Both improve user satisfaction by increasing user perceptions of relevance (tunnel) and active control (matrix). Although additional research is needed, hierarchical IA designs are currently not recommended, as hierarchical content is perceived as less supportive, engaging, and relevant, which may diminish the use and, in turn, the effect of the educational intervention.https://www.jmir.org/2021/3/e15846
collection DOAJ
language English
format Article
sources DOAJ
author Dekkers, Tessa
Melles, Marijke
Vehmeijer, Stephan B W
de Ridder, Huib
spellingShingle Dekkers, Tessa
Melles, Marijke
Vehmeijer, Stephan B W
de Ridder, Huib
Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment
Journal of Medical Internet Research
author_facet Dekkers, Tessa
Melles, Marijke
Vehmeijer, Stephan B W
de Ridder, Huib
author_sort Dekkers, Tessa
title Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment
title_short Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment
title_full Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment
title_fullStr Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment
title_full_unstemmed Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment
title_sort effects of information architecture on the effectiveness and user experience of web-based patient education in middle-aged and older adults: online randomized experiment
publisher JMIR Publications
series Journal of Medical Internet Research
issn 1438-8871
publishDate 2021-03-01
description BackgroundWeb-based patient education is increasingly offered to improve patients’ ability to learn, remember, and apply health information. Efficient organization, display, and structural design, that is, information architecture (IA), can support patients’ ability to independently use web-based patient education. However, the role of IA in the context of web-based patient education has not been examined systematically. ObjectiveTo support intervention designers in making informed choices that enhance patients’ learning, this paper describes a randomized experiment on the effects of IA on the effectiveness, use, and user experience of a patient education website and examines the theoretical mechanisms that explain these effects. MethodsMiddle-aged and older adults with self-reported hip or knee joint complaints were recruited to use and evaluate 1 of 3 patient education websites containing information on total joint replacement surgery. Each website contained the same textual content based on an existing leaflet but differed in the employed IA design (tunnel, hierarchical, or matrix design). Participants rated the websites on satisfaction, engagement, control, relevance, trust, and novelty and completed an objective knowledge test. Analyses of variance and structural equation modeling were used to examine the effects of IA and construct a theoretical model. ResultsWe included 215 participants in our analysis. IA did not affect knowledge gain (P=.36) or overall satisfaction (P=.07) directly. However, tunnel (mean 3.22, SD 0.67) and matrix (mean 3.17, SD 0.69) architectures were found to provide more emotional support compared with hierarchical architectures (mean 2.86, SD 0.60; P=.002). Furthermore, increased perceptions of personal relevance in the tunnel IA (β=.18) were found to improve satisfaction (β=.17) indirectly. Increased perceptions of active control in the matrix IA (β=.11) also improved satisfaction (β=.27) indirectly. The final model of the IA effects explained 74.3% of the variance in satisfaction and 6.8% of the variance in knowledge and achieved excellent fit (χ217,215=14.7; P=.62; root mean square error of approximation=0.000; 95% CI [0.000-0.053]; comparative fit index=1.00; standardized root mean square residual=0.044). ConclusionsIA has small but notable effects on users’ experiences with web-based health education interventions. Web-based patient education designers can employ tunnel IA designs to guide users through sequentially ordered content or matrix IA to offer users more control over navigation. Both improve user satisfaction by increasing user perceptions of relevance (tunnel) and active control (matrix). Although additional research is needed, hierarchical IA designs are currently not recommended, as hierarchical content is perceived as less supportive, engaging, and relevant, which may diminish the use and, in turn, the effect of the educational intervention.
url https://www.jmir.org/2021/3/e15846
work_keys_str_mv AT dekkerstessa effectsofinformationarchitectureontheeffectivenessanduserexperienceofwebbasedpatienteducationinmiddleagedandolderadultsonlinerandomizedexperiment
AT mellesmarijke effectsofinformationarchitectureontheeffectivenessanduserexperienceofwebbasedpatienteducationinmiddleagedandolderadultsonlinerandomizedexperiment
AT vehmeijerstephanbw effectsofinformationarchitectureontheeffectivenessanduserexperienceofwebbasedpatienteducationinmiddleagedandolderadultsonlinerandomizedexperiment
AT deridderhuib effectsofinformationarchitectureontheeffectivenessanduserexperienceofwebbasedpatienteducationinmiddleagedandolderadultsonlinerandomizedexperiment
_version_ 1721545655363567616