Assessing Quality in Systematic Literature Reviews: A Study of Novice Rater Training

Assessing Quality in Systematic Literature Reviews: A Study of Novice Rater Training

This study investigated performance variability when graduate students critically appraised original studies from a systematic review. Fourteen doctoral students from different academic programs, with no systematic review experience, received training on the Methodological Quality Questionnaire (MQQ...

Full description

Bibliographic Details
Main Authors:	Sandra Acosta, Tiberio Garza, Hsien-Yuan Hsu, Patricia Goodson
Format:	Article
Language:	English
Published:	SAGE Publishing 2020-07-01
Series:	SAGE Open
Online Access:	https://doi.org/10.1177/2158244020939530

Similar Items

Ultrasound Imaging Analysis of the Lumbar Multifidus Muscle Echo Intensity: Intra-Rater and Inter-Rater Reliability of a Novice and an Experienced Rater
by: Maryse Fortin, et al.
Published: (2021-05-01)

Intra-Rater (Live vs. Video Assessment) and Inter-Rater (Expert vs. Novice) Reliability of the Test of Gross Motor—Third Edition
by: Aida Carballo-Fazanes, et al.
Published: (2021-02-01)

Assisting Novice Raters in Addressing the In-Between Scores When Rating Writing
by: Greer, Brittney
Published: (2013)

Item-level and Composite-level Interrater Reliability of Functional Movement Screen™ Scores Following Condensed Training in Novice Raters
by: Brent A Harper, et al.
Published: (2021-07-01)

Training of merit raters
by: Dyer, Joseph Walsh
Published: (2018)

The Rater Accountability as Posttraining Supplements for Enhancing the Effectiveness of Rater Training
by: Yi-chun Yu, et al.
Published: (2010)

Rater Cognition in L2 Speaking Assessment: A Review of the Literature
by: Qie Han
Published: (2016-05-01)

Rater Cognition in L2 Speaking Assessment: A Review of the Literature
by: Qie Han
Published: (2016-07-01)

Modified Tuck Jump Assessment: Reliability and Training of Raters
by: Craig A. Smith, Nicole J. Chimera, Monica R. Lininger, Meghan Warren
Published: (2017-09-01)

The Effects of Rater Training on the Relationship between Item Observability and Rater Agreement
by: Montgomery, Keaton Edwin
Published: (2010)

Correlation of rater training and reliability in performance assessment: Experience in a school of dentistry
by: Chien-Ju Lin, et al.
Published: (2013-09-01)

Investigating the Effect of Rater Training on Differential Rater Function in Assessing Academic Writing Skills of Higher Education Students
by: Mehmet ŞATA, et al.
Published: (2021-06-01)

Investigating the validity of oral assessment rater training program: A mixed-methods study of raters’ perceptions and attitudes before and after training
by: Houman Bijani
Published: (2018-01-01)

Reliability of the Tuck Jump Assessment Using Standardized Rater Training
by: Kevin Racine, et al.
Published: (2021-02-01)

Performance Appraisal Decision and Cognitive Processing Model: A Case of Novice and Expert Raters in the Educational Organization
by: Rusli Ahmad, et al.
Published: (2020-01-01)

The effect of virtual endoscopy simulator training on novices: a systematic review.
by: Weiguang Qiao, et al.
Published: (2014-01-01)

Differentiating Rater Accuracy Training Programs
by: Sinclair, Andrea L.
Published: (2014)

Enquêter. Rater. Enquêter encore. Rater encore. Rater mieux
by: Joan Stavo-Debauge, et al.
Published: (2017-05-01)

Using Guttman errors to explore rater fit in rater-mediated performance assessments
by: Stefanie A Wind
Published: (2018-11-01)

The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
by: Rohani, J. M., et al.
Published: (2018)

Grant Peer Review: Improving Inter-Rater Reliability with Training.
by: David N Sattler, et al.
Published: (2015-01-01)

An experimental investigation of theorems concerning the training of raters /
by: Landen, Delmar Leo
Published: (1956)

Rater attitude towards emerging varieties of English: a new rater effect?
by: Tammy Huei-Lien Hsu
Published: (2019-03-01)

Rater training for standardised assessment of Objective Structured Clinical Examinations in rural Tanzania
by: Nalini Singhal, et al.
Published: (2020-04-01)

Assessment of reporting quality of abstracts of systematic reviews with meta-analysis using PRISMA-A and discordance in assessments between raters without prior experience
by: Katarina Maticic, et al.
Published: (2019-02-01)

How do novices learn physical examination skills? A systematic review of the literature
by: Aaron R. Danielson, et al.
Published: (2019-01-01)

Studies of Rater and Item Effects in Rater Models
by: Zhao, Yihan
Published: (2020)

Estimating the Intra-Rater Reliability of Essay Raters
by: Yoav Cohen
Published: (2017-09-01)

Inter-rater reliability of the QuIS as an assessment of the quality of staff-inpatient interactions
by: Ines Mesa-Eguiagaray, et al.
Published: (2016-12-01)

Rater Severity Drift in Peer Assessment
by: Bengü BÖRKAN
Published: (2017-12-01)

Variability in multi-rater competency assessments
by: D. Theron, et al.
Published: (1999-06-01)

Effects of Rating Training on Inter-Rater Consistency for Developing a Dental Hygiene Clinical Rater Qualification System
by: Jeong Ran Park, et al.
Published: (2007-12-01)

Twins Assessing Their Own and Parental Intelligence: Examining the Raters’ Agreement and the Effect of Raters’ and Targets’ Gender
by: Denis Bratko, et al.
Published: (2020-05-01)

Investigating Intra-Rater and Inter-Rater Reliability of Three Upper-Limb Risk Assessment Methods
by: Majid Motamedzade, et al.
Published: (2019-06-01)

Quantitative Magnetic Resonance Imaging Analysis of the Cervical Spine Extensor Muscles: Intrarater and Interrater Reliability of a Novice and an Experienced Rater
by: Maryse Fortin, et al.
Published: (2018-02-01)

Does effectiveness in performance appraisal improve with rater training?
by: Christian Rosales Sánchez, et al.
Published: (2019-01-01)

The impact of spelling errors on trained raters' scoring decisions
by: Choi, Ikkyu, et al.
Published: (2018-08-01)

Rater Training to Improve Student Evaluations of Teaching Effectiveness
by: Beeler, Robert
Published: (1999)

Effects of a rater training on rating accuracy in a physical examination skills assessment
by: Weitz, Gunther, et al.
Published: (2014-11-01)

A Study of Raters’ Behavior in Scoring L2 Speaking Performance: Using Rater Discussion as a Training Tool
by: Alireza Ahmadi
Published: (2019-06-01)

Cannot write session to /tmp/vufind_sessions/sess_5cggo5m1rh5797rnpk161mmtvg