Statistical stopping criteria for automated screening in systematic reviews

Statistical stopping criteria for automated screening in systematic reviews

Abstract Active learning for systematic review screening promises to reduce the human effort required to identify relevant documents for a systematic review. Machines and humans work together, with humans providing training data, and the machine optimising the documents that the humans screen. This...

Full description

Bibliographic Details
Main Authors:	Max W Callaghan, Finn Müller-Hansen
Format:	Article
Language:	English
Published:	BMC 2020-11-01
Series:	Systematic Reviews
Subjects:	Systematic review Machine learning Active learning Stopping criteria
Online Access:	https://doi.org/10.1186/s13643-020-01521-4

Similar Items

Effectiveness of stop smoking interventions among adults: protocol for an overview of systematic reviews and an updated systematic review
by: Mona Hersi, et al.
Published: (2019-01-01)

Research Screener: a machine learning tool to semi-automate abstract screening for systematic reviews
by: Kevin E. K. Chai, et al.
Published: (2021-04-01)

The semi-automation of title and abstract screening: a retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews
by: Allison Gates, et al.
Published: (2020-06-01)

New stopping criteria for iterative root finding
by: Jorgen L. Nikolajsen
Published: (2014-01-01)

Can STOP Trial Velocity Criteria Be Applied to Iranian Children with Sickle Cell Disease?
by: Reza Bavarsad Shahripour, et al.
Published: (2014-05-01)

Evaluating the relationship between citation set size, team size and screening methods used in systematic reviews: a cross-sectional study
by: Katie O’Hearn, et al.
Published: (2021-07-01)

Technology-assisted title and abstract screening for systematic reviews: a retrospective evaluation of the Abstrackr machine learning tool
by: Allison Gates, et al.
Published: (2018-03-01)

Virtual to Real-World Transfer Learning: A Systematic Review
by: Mahesh Ranaweera, et al.
Published: (2021-06-01)

Performance and usability of machine learning for screening in systematic reviews: a comparative evaluation of three tools
by: Allison Gates, et al.
Published: (2019-11-01)

Successful incorporation of single reviewer assessments during systematic review screening: development and validation of sensitivity and work-saved of an algorithm that considers exclusion criteria and count
by: Nassr Nama, et al.
Published: (2021-04-01)

Automated Classification of Significant Prostate Cancer on MRI: A Systematic Review on the Performance of Machine Learning Applications
by: Jose M. Castillo T., et al.
Published: (2020-06-01)

SYMBALS: A Systematic Review Methodology Blending Active Learning and Snowballing
by: Max van Haastrecht, et al.
Published: (2021-05-01)

Performance analysis of stopping turbo decoder iteration criteria
by: Adnan, W.A.W, et al.
Published: (2014)

Decoding semi-automated title-abstract screening: findings from a convenience sample of reviews
by: Allison Gates, et al.
Published: (2020-11-01)

Recommendation Systems for Education: Systematic Review
by: María Cora Urdaneta-Ponte, et al.
Published: (2021-07-01)

Belief Propagation Decoder With Multiple Bit-Flipping Sets and Stopping Criteria for Polar Codes
by: Jianyong Zhang, et al.
Published: (2020-01-01)

The saturation of population fitness as a stopping criterion in genetic algorithm
by: Suhaimi, A., et al.
Published: (2019)

Sustainable Urban Transportation Criteria and Measurement—A Systematic Literature Review
by: Lisa Kraus, et al.
Published: (2021-06-01)

Early Prediction of Sepsis in the ICU Using Machine Learning: A Systematic Review
by: Michael Moor, et al.
Published: (2021-05-01)

Text mining to support abstract screening for knowledge syntheses: a semi-automated workflow
by: Ba’ Pham, et al.
Published: (2021-05-01)

Artificial Intelligence in Pharmacoepidemiology: A Systematic Review. Part 1—Overview of Knowledge Discovery Techniques in Artificial Intelligence
by: Maurizio Sessa, et al.
Published: (2020-07-01)

Towards automating systematic reviews on immunization using an advanced natural language processing–based extraction system
by: David Begert, et al.
Published: (2020-06-01)

Artificial Intelligence in Pharmacoepidemiology: A Systematic Review. Part 2–Comparison of the Performance of Artificial Intelligence and Traditional Pharmacoepidemiological Techniques
by: Maurizio Sessa, et al.
Published: (2021-01-01)

Learning-Based Stopping Power Mapping on Dual-Energy CT for Proton Radiation Therapy
by: Tonghe Wang, PhD, et al.
Published: (2021-02-01)

Machine learning methods for toxic comment classification: a systematic review
by: Andročec Darko
Published: (2020-12-01)

Software Change Prediction: A Systematic Review and Future Guidelines
by: Ruchika Malhotra, et al.
Published: (2019-11-01)

Measuring the impact of screening automation on meta-analyses of diagnostic test accuracy
by: Christopher R. Norman, et al.
Published: (2019-10-01)

Assessing the accuracy of machine-assisted abstract screening with DistillerAI: a user study
by: Gerald Gartlehner, et al.
Published: (2019-11-01)

Single screen of citations with excluded terms: an approach to citation screening in systematic reviews
by: Brittany U. Carter
Published: (2018-07-01)

Ten-year evolution on credit risk research: a systematic literature review approach and discussion
by: Fernanda Medeiros Assef, et al.
Published: (2020-05-01)

Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error
by: Alexandra Bannach-Brown, et al.
Published: (2019-01-01)

Securing Machine Learning in the Cloud: A Systematic Review of Cloud Machine Learning Security
by: Adnan Qayyum, et al.
Published: (2020-11-01)

Transfer Learning in Magnetic Resonance Brain Imaging: A Systematic Review
by: Juan Miguel Valverde, et al.
Published: (2021-04-01)

Data Mining and Machine Learning to Promote Smart Cities: A Systematic Review from 2000 to 2018
by: Jovani Taveira de Souza, et al.
Published: (2019-02-01)

Role of dietary approaches to stop hypertension diet in risk of metabolic syndrome: Evidence from observational and interventional studies
by: Hossein Farhadnejad, et al.
Published: (2021-01-01)

Sysrev: A FAIR Platform for Data Curation and Systematic Evidence Review
by: Thomas Bozada, et al.
Published: (2021-08-01)

The Application of Machine Learning in Self-Adaptive Systems: A Systematic Literature Review
by: Theresia Ratih Dewi Saputri, et al.
Published: (2020-01-01)

Eligibility screening in evidence synthesis of environmental management topics
by: Geoff K. Frampton, et al.
Published: (2017-09-01)

Computational methods for the ab initio identification of novel microRNA in plants: a systematic review
by: Buwani Manuweera, et al.
Published: (2019-11-01)

Iterative guided machine learning-assisted systematic literature reviews: a diabetes case study
by: John Zimmerman, et al.
Published: (2021-04-01)

Cannot write session to /tmp/vufind_sessions/sess_ejee28m5o6iu1jvlap58f2gkoi