Randomized test-treatment studies with an outlook on adaptive designs

Abstract Background Diagnostic accuracy studies aim to examine the diagnostic accuracy of a new experimental test, but do not address the actual merit of the resulting diagnostic information to a patient in clinical practice. In order to assess the impact of diagnostic information on subsequent trea...

Full description

Bibliographic Details
Main Authors: Amra Hot, Patrick M. Bossuyt, Oke Gerke, Simone Wahl, Werner Vach, Antonia Zapf
Format: Article
Language:English
Published: BMC 2021-06-01
Series:BMC Medical Research Methodology
Subjects:
RCT
Online Access:https://doi.org/10.1186/s12874-021-01293-y
id doaj-31c12c862b8f46c8879af494ab5f684b
record_format Article
spelling doaj-31c12c862b8f46c8879af494ab5f684b2021-06-06T11:03:06ZengBMCBMC Medical Research Methodology1471-22882021-06-0121111210.1186/s12874-021-01293-yRandomized test-treatment studies with an outlook on adaptive designsAmra Hot0Patrick M. Bossuyt1Oke Gerke2Simone Wahl3Werner Vach4Antonia Zapf5Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-EppendorfDepartment of Epidemiology and Data Science, Amsterdam University Medical CentersDepartment of Nuclear Medicine, Odense University HospitalRoche Diagnostics GmbHBasel Academy for Quality and Research in MedicineInstitute of Medical Biometry and Epidemiology, University Medical Center Hamburg-EppendorfAbstract Background Diagnostic accuracy studies aim to examine the diagnostic accuracy of a new experimental test, but do not address the actual merit of the resulting diagnostic information to a patient in clinical practice. In order to assess the impact of diagnostic information on subsequent treatment strategies regarding patient-relevant outcomes, randomized test-treatment studies were introduced. Various designs for randomized test-treatment studies, including an evaluation of biomarkers as part of randomized biomarker-guided treatment studies, are suggested in the literature, but the nomenclature is not consistent. Methods The aim was to provide a clear description of the different study designs within a pre-specified framework, considering their underlying assumptions, advantages as well as limitations and derivation of effect sizes required for sample size calculations. Furthermore, an outlook on adaptive designs within randomized test-treatment studies is given. Results The need to integrate adaptive design procedures in randomized test-treatment studies is apparent. The derivation of effect sizes induces that sample size calculation will always be based on rather vague assumptions resulting in over- or underpowered study results. Therefore, it might be advantageous to conduct a sample size re-estimation based on a nuisance parameter during the ongoing trial. Conclusions Due to their increased complexity, compared to common treatment trials, the implementation of randomized test-treatment studies poses practical challenges including a huge uncertainty regarding study parameters like the expected outcome in specific subgroups or disease prevalence which might affect the sample size calculation. Since research on adaptive designs within randomized test-treatment studies is limited so far, further research is recommended.https://doi.org/10.1186/s12874-021-01293-yAccuracyAdaptive designDiagnostic researchPatient-relevant outcomeRCTSample size
collection DOAJ
language English
format Article
sources DOAJ
author Amra Hot
Patrick M. Bossuyt
Oke Gerke
Simone Wahl
Werner Vach
Antonia Zapf
spellingShingle Amra Hot
Patrick M. Bossuyt
Oke Gerke
Simone Wahl
Werner Vach
Antonia Zapf
Randomized test-treatment studies with an outlook on adaptive designs
BMC Medical Research Methodology
Accuracy
Adaptive design
Diagnostic research
Patient-relevant outcome
RCT
Sample size
author_facet Amra Hot
Patrick M. Bossuyt
Oke Gerke
Simone Wahl
Werner Vach
Antonia Zapf
author_sort Amra Hot
title Randomized test-treatment studies with an outlook on adaptive designs
title_short Randomized test-treatment studies with an outlook on adaptive designs
title_full Randomized test-treatment studies with an outlook on adaptive designs
title_fullStr Randomized test-treatment studies with an outlook on adaptive designs
title_full_unstemmed Randomized test-treatment studies with an outlook on adaptive designs
title_sort randomized test-treatment studies with an outlook on adaptive designs
publisher BMC
series BMC Medical Research Methodology
issn 1471-2288
publishDate 2021-06-01
description Abstract Background Diagnostic accuracy studies aim to examine the diagnostic accuracy of a new experimental test, but do not address the actual merit of the resulting diagnostic information to a patient in clinical practice. In order to assess the impact of diagnostic information on subsequent treatment strategies regarding patient-relevant outcomes, randomized test-treatment studies were introduced. Various designs for randomized test-treatment studies, including an evaluation of biomarkers as part of randomized biomarker-guided treatment studies, are suggested in the literature, but the nomenclature is not consistent. Methods The aim was to provide a clear description of the different study designs within a pre-specified framework, considering their underlying assumptions, advantages as well as limitations and derivation of effect sizes required for sample size calculations. Furthermore, an outlook on adaptive designs within randomized test-treatment studies is given. Results The need to integrate adaptive design procedures in randomized test-treatment studies is apparent. The derivation of effect sizes induces that sample size calculation will always be based on rather vague assumptions resulting in over- or underpowered study results. Therefore, it might be advantageous to conduct a sample size re-estimation based on a nuisance parameter during the ongoing trial. Conclusions Due to their increased complexity, compared to common treatment trials, the implementation of randomized test-treatment studies poses practical challenges including a huge uncertainty regarding study parameters like the expected outcome in specific subgroups or disease prevalence which might affect the sample size calculation. Since research on adaptive designs within randomized test-treatment studies is limited so far, further research is recommended.
topic Accuracy
Adaptive design
Diagnostic research
Patient-relevant outcome
RCT
Sample size
url https://doi.org/10.1186/s12874-021-01293-y
work_keys_str_mv AT amrahot randomizedtesttreatmentstudieswithanoutlookonadaptivedesigns
AT patrickmbossuyt randomizedtesttreatmentstudieswithanoutlookonadaptivedesigns
AT okegerke randomizedtesttreatmentstudieswithanoutlookonadaptivedesigns
AT simonewahl randomizedtesttreatmentstudieswithanoutlookonadaptivedesigns
AT wernervach randomizedtesttreatmentstudieswithanoutlookonadaptivedesigns
AT antoniazapf randomizedtesttreatmentstudieswithanoutlookonadaptivedesigns
_version_ 1721394392066949120