Practical application of opt-out recruitment methods in two health services research studies

Abstract Background Participant recruitment is an ongoing challenge in health research. Recruitment may be especially difficult for studies of access to health care because, even among those who are in care, people using services least often also may be hardest to contact and recruit. Opt-out recrui...

Full description

Bibliographic Details
Main Authors: Christopher J. Miller, James F. Burgess, Ellen P. Fischer, Deborah J. Hodges, Lindsay K. Belanger, Jessica M. Lipschitz, Siena R. Easley, Christopher J. Koenig, Regina L. Stanley, Jeffrey M. Pyne
Format: Article
Language:English
Published: BMC 2017-04-01
Series:BMC Medical Research Methodology
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12874-017-0333-5
id doaj-dcaa7e07e2b249969ee7a4df32247b50
record_format Article
spelling doaj-dcaa7e07e2b249969ee7a4df32247b502020-11-25T00:08:10ZengBMCBMC Medical Research Methodology1471-22882017-04-0117111210.1186/s12874-017-0333-5Practical application of opt-out recruitment methods in two health services research studiesChristopher J. Miller0James F. Burgess1Ellen P. Fischer2Deborah J. Hodges3Lindsay K. Belanger4Jessica M. Lipschitz5Siena R. Easley6Christopher J. Koenig7Regina L. Stanley8Jeffrey M. Pyne9VA Boston Healthcare System Center for Healthcare Organization and Implementation Research and Harvard Medical School Department of PsychiatryVA Boston Healthcare System Center for Healthcare Organization and Implementation Research and Boston University School of Public HealthCenter for Mental Healthcare & Outcomes Research, Central Arkansas Veterans Healthcare System, and University of Arkansas for Medical Sciences Department of PsychiatryCentral Arkansas Veterans Healthcare System and University of Arkansas for Medical SciencesVA Boston Healthcare System Center for Healthcare Organization and Implementation Research and Boston University School of Public HealthVA Boston Healthcare System Center for Healthcare Organization and Implementation Research and Harvard Medical School Department of PsychiatryVA Boston Healthcare System Center for Healthcare Organization and Implementation Research and Boston University School of Public HealthSan Francisco VA Health Care System and San Francisco State University Department of Communication StudiesCentral Arkansas Veterans Healthcare SystemCentral Arkansas Veterans Healthcare System and University of Arkansas for Medical Sciences Department of PsychiatryAbstract Background Participant recruitment is an ongoing challenge in health research. Recruitment may be especially difficult for studies of access to health care because, even among those who are in care, people using services least often also may be hardest to contact and recruit. Opt-out recruitment methods (in which potential participants are given the opportunity to decline further contact about the study (opt out) following an initial mailing, and are then contacted directly if they have not opted out within a specified period) can be used for such studies. However, there is a dearth of literature on the effort needed for effective opt-out recruitment. Methods In this paper we describe opt-out recruitment procedures for two studies on access to health care within the U.S. Department of Veterans Affairs. We report resource requirements for recruitment efforts (number of opt-out packets mailed and number of phone calls made). We also compare the characteristics of study participants to potential participants via t-tests, Fisher’s exact tests, and chi-squared tests. Results Recruitment rates for our two studies were 12 and 21%, respectively. Across multiple study sites, we had to send between 4.3 and 9.2 opt-out packets to recruit one participant. The number of phone calls required to arrive at a final status for each potentially eligible Veteran (i.e. study participation or the termination of recruitment efforts) were 2.9 and 6.1 in the two studies, respectively. Study participants differed as expected from the population of potentially eligible Veterans based on planned oversampling of certain subpopulations. The final samples of participants did not differ statistically from those who were mailed opt-out packets, with one exception: in one of our two studies, participants had higher rates of mental health service use in the past year than did those mailed opt-out packets (64 vs. 47%). Conclusions Our results emphasize the practicality of using opt-out methods for studies of access to health care. Despite the benefits of these methods, opt-out alone may be insufficient to eliminate non-response bias on key variables. Researchers will need to balance considerations of sample representativeness and feasibility when designing studies investigating access to care.http://link.springer.com/article/10.1186/s12874-017-0333-5RecruitmentAccessHealth servicesOpt-out
collection DOAJ
language English
format Article
sources DOAJ
author Christopher J. Miller
James F. Burgess
Ellen P. Fischer
Deborah J. Hodges
Lindsay K. Belanger
Jessica M. Lipschitz
Siena R. Easley
Christopher J. Koenig
Regina L. Stanley
Jeffrey M. Pyne
spellingShingle Christopher J. Miller
James F. Burgess
Ellen P. Fischer
Deborah J. Hodges
Lindsay K. Belanger
Jessica M. Lipschitz
Siena R. Easley
Christopher J. Koenig
Regina L. Stanley
Jeffrey M. Pyne
Practical application of opt-out recruitment methods in two health services research studies
BMC Medical Research Methodology
Recruitment
Access
Health services
Opt-out
author_facet Christopher J. Miller
James F. Burgess
Ellen P. Fischer
Deborah J. Hodges
Lindsay K. Belanger
Jessica M. Lipschitz
Siena R. Easley
Christopher J. Koenig
Regina L. Stanley
Jeffrey M. Pyne
author_sort Christopher J. Miller
title Practical application of opt-out recruitment methods in two health services research studies
title_short Practical application of opt-out recruitment methods in two health services research studies
title_full Practical application of opt-out recruitment methods in two health services research studies
title_fullStr Practical application of opt-out recruitment methods in two health services research studies
title_full_unstemmed Practical application of opt-out recruitment methods in two health services research studies
title_sort practical application of opt-out recruitment methods in two health services research studies
publisher BMC
series BMC Medical Research Methodology
issn 1471-2288
publishDate 2017-04-01
description Abstract Background Participant recruitment is an ongoing challenge in health research. Recruitment may be especially difficult for studies of access to health care because, even among those who are in care, people using services least often also may be hardest to contact and recruit. Opt-out recruitment methods (in which potential participants are given the opportunity to decline further contact about the study (opt out) following an initial mailing, and are then contacted directly if they have not opted out within a specified period) can be used for such studies. However, there is a dearth of literature on the effort needed for effective opt-out recruitment. Methods In this paper we describe opt-out recruitment procedures for two studies on access to health care within the U.S. Department of Veterans Affairs. We report resource requirements for recruitment efforts (number of opt-out packets mailed and number of phone calls made). We also compare the characteristics of study participants to potential participants via t-tests, Fisher’s exact tests, and chi-squared tests. Results Recruitment rates for our two studies were 12 and 21%, respectively. Across multiple study sites, we had to send between 4.3 and 9.2 opt-out packets to recruit one participant. The number of phone calls required to arrive at a final status for each potentially eligible Veteran (i.e. study participation or the termination of recruitment efforts) were 2.9 and 6.1 in the two studies, respectively. Study participants differed as expected from the population of potentially eligible Veterans based on planned oversampling of certain subpopulations. The final samples of participants did not differ statistically from those who were mailed opt-out packets, with one exception: in one of our two studies, participants had higher rates of mental health service use in the past year than did those mailed opt-out packets (64 vs. 47%). Conclusions Our results emphasize the practicality of using opt-out methods for studies of access to health care. Despite the benefits of these methods, opt-out alone may be insufficient to eliminate non-response bias on key variables. Researchers will need to balance considerations of sample representativeness and feasibility when designing studies investigating access to care.
topic Recruitment
Access
Health services
Opt-out
url http://link.springer.com/article/10.1186/s12874-017-0333-5
work_keys_str_mv AT christopherjmiller practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT jamesfburgess practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT ellenpfischer practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT deborahjhodges practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT lindsaykbelanger practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT jessicamlipschitz practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT sienareasley practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT christopherjkoenig practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT reginalstanley practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
AT jeffreympyne practicalapplicationofoptoutrecruitmentmethodsintwohealthservicesresearchstudies
_version_ 1725416479126454272