Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study

Abstract Background Institutions, funding agencies and publishers are placing increasing emphasis on good research data management (RDM). RDM lapses in medical science can result in questionable data and cause the public’s confidence in the scientific community to crumble. A fledgling medical school...

Full description

Bibliographic Details
Main Authors: Hui Xing Lau, Ser Lin Celine Lee, Yusuf Ali
Format: Article
Language:English
Published: BMC 2021-07-01
Series:BMC Medical Ethics
Subjects:
Online Access:https://doi.org/10.1186/s12910-021-00662-y
id doaj-c2adfb89b5484ba28f3a7a6b4126d471
record_format Article
spelling doaj-c2adfb89b5484ba28f3a7a6b4126d4712021-08-01T11:03:33ZengBMCBMC Medical Ethics1472-69392021-07-012211810.1186/s12910-021-00662-yEffectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore studyHui Xing Lau0Ser Lin Celine Lee1Yusuf Ali2Lee Kong Chian School of Medicine, Nanyang Technological UniversityLee Kong Chian School of Medicine, Nanyang Technological UniversityLee Kong Chian School of Medicine, Nanyang Technological UniversityAbstract Background Institutions, funding agencies and publishers are placing increasing emphasis on good research data management (RDM). RDM lapses in medical science can result in questionable data and cause the public’s confidence in the scientific community to crumble. A fledgling medical school in a young university in Singapore has mandated every funded research project to have a data management plan (DMP). However, researchers’ adherence to their DMPs was unknown until the school embarked on routine data auditing. We hypothesize that research data auditing improves RDM awareness, compliance and reception in the school. Methods We conducted surveys with research PIs and researchers before and after data auditing to evaluate differences in self-reported RDM awareness, compliance and reception. As it is mandatory to deposit research data in a central data repository system in the school, we tracked data deposition by each laboratory from 2 weeks before to 3 months after data auditing as a marker of actual RDM compliance. Results Research data auditing had an overall positive effect on self-reported RDM awareness, compliance and reception for both research PIs and researchers. Research PIs agreed more that RDM was important to scientific reproducibility, were more aware of proper RDM, had higher RDM strength in their laboratories and were more compliant with the DMP. Both research PIs and researchers believed data auditing helped them to be more compliant with data deposition in the repository. However, data auditing had no significant impact on laboratories’ data deposition rates over time, which could be due to the short sampling period. Conclusions Research PIs and researchers generally felt that data auditing was effective in improving RDM practices. It helped to evaluate their RDM practices objectively, propose corrective actions for RDM lapses and spread awareness of the university’s data management policies. Our findings corroborated other studies in medical research, geosciences, engineering and ethics that data auditing promotes good RDM practices. Hence, we recommend research institutions worldwide to adopt data auditing as a tool to reinforce research integrity.https://doi.org/10.1186/s12910-021-00662-yData auditingResearch data managementData management planResearch integrityCompliance
collection DOAJ
language English
format Article
sources DOAJ
author Hui Xing Lau
Ser Lin Celine Lee
Yusuf Ali
spellingShingle Hui Xing Lau
Ser Lin Celine Lee
Yusuf Ali
Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study
BMC Medical Ethics
Data auditing
Research data management
Data management plan
Research integrity
Compliance
author_facet Hui Xing Lau
Ser Lin Celine Lee
Yusuf Ali
author_sort Hui Xing Lau
title Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study
title_short Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study
title_full Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study
title_fullStr Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study
title_full_unstemmed Effectiveness of data auditing as a tool to reinforce good research data management (RDM) practice: a Singapore study
title_sort effectiveness of data auditing as a tool to reinforce good research data management (rdm) practice: a singapore study
publisher BMC
series BMC Medical Ethics
issn 1472-6939
publishDate 2021-07-01
description Abstract Background Institutions, funding agencies and publishers are placing increasing emphasis on good research data management (RDM). RDM lapses in medical science can result in questionable data and cause the public’s confidence in the scientific community to crumble. A fledgling medical school in a young university in Singapore has mandated every funded research project to have a data management plan (DMP). However, researchers’ adherence to their DMPs was unknown until the school embarked on routine data auditing. We hypothesize that research data auditing improves RDM awareness, compliance and reception in the school. Methods We conducted surveys with research PIs and researchers before and after data auditing to evaluate differences in self-reported RDM awareness, compliance and reception. As it is mandatory to deposit research data in a central data repository system in the school, we tracked data deposition by each laboratory from 2 weeks before to 3 months after data auditing as a marker of actual RDM compliance. Results Research data auditing had an overall positive effect on self-reported RDM awareness, compliance and reception for both research PIs and researchers. Research PIs agreed more that RDM was important to scientific reproducibility, were more aware of proper RDM, had higher RDM strength in their laboratories and were more compliant with the DMP. Both research PIs and researchers believed data auditing helped them to be more compliant with data deposition in the repository. However, data auditing had no significant impact on laboratories’ data deposition rates over time, which could be due to the short sampling period. Conclusions Research PIs and researchers generally felt that data auditing was effective in improving RDM practices. It helped to evaluate their RDM practices objectively, propose corrective actions for RDM lapses and spread awareness of the university’s data management policies. Our findings corroborated other studies in medical research, geosciences, engineering and ethics that data auditing promotes good RDM practices. Hence, we recommend research institutions worldwide to adopt data auditing as a tool to reinforce research integrity.
topic Data auditing
Research data management
Data management plan
Research integrity
Compliance
url https://doi.org/10.1186/s12910-021-00662-y
work_keys_str_mv AT huixinglau effectivenessofdataauditingasatooltoreinforcegoodresearchdatamanagementrdmpracticeasingaporestudy
AT serlincelinelee effectivenessofdataauditingasatooltoreinforcegoodresearchdatamanagementrdmpracticeasingaporestudy
AT yusufali effectivenessofdataauditingasatooltoreinforcegoodresearchdatamanagementrdmpracticeasingaporestudy
_version_ 1721246344593539072