Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.

<h4>Background</h4>Ratings in journal peer review can be affected by sources of bias. The bias variable investigated here was the information on whether authors had suggested a possible reviewer for their manuscript, and whether the editor had taken up that suggestion or had chosen a rev...

Full description

Bibliographic Details
Main Authors: Lutz Bornmann, Hans-Dieter Daniel
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2010-10-01
Series:PLoS ONE
Online Access:https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/20976226/?tool=EBI
id doaj-eb8d80bd5d314485804a9db1cfb31074
record_format Article
spelling doaj-eb8d80bd5d314485804a9db1cfb310742021-03-04T02:17:17ZengPublic Library of Science (PLoS)PLoS ONE1932-62032010-10-01510e1334510.1371/journal.pone.0013345Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.Lutz BornmannHans-Dieter Daniel<h4>Background</h4>Ratings in journal peer review can be affected by sources of bias. The bias variable investigated here was the information on whether authors had suggested a possible reviewer for their manuscript, and whether the editor had taken up that suggestion or had chosen a reviewer that had not been suggested by the authors. Studies have shown that author-suggested reviewers rate manuscripts more favorably than editor-suggested reviewers do.<h4>Methodology/principal findings</h4>Reviewers' ratings on three evaluation criteria and the reviewers' final publication recommendations were available for 552 manuscripts (in total 1145 reviews) that were submitted to Atmospheric Chemistry and Physics, an interactive open access journal using public peer review (authors' and reviewers' comments are publicly exchanged). Public peer review is supposed to bring a new openness to the reviewing process that will enhance its objectivity. In the statistical analysis the quality of a manuscript was controlled for to prevent favorable reviewers' ratings from being attributable to quality instead of to the bias variable.<h4>Conclusions/significance</h4>Our results agree with those from other studies that editor-suggested reviewers rated manuscripts between 30% and 42% less favorably than author-suggested reviewers. Against this backdrop journal editors should consider either doing without the use of author-suggested reviewers or, if they are used, bringing in more than one editor-suggested reviewer for the review process (so that the review by author-suggested reviewers can be put in perspective).https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/20976226/?tool=EBI
collection DOAJ
language English
format Article
sources DOAJ
author Lutz Bornmann
Hans-Dieter Daniel
spellingShingle Lutz Bornmann
Hans-Dieter Daniel
Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.
PLoS ONE
author_facet Lutz Bornmann
Hans-Dieter Daniel
author_sort Lutz Bornmann
title Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.
title_short Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.
title_full Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.
title_fullStr Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.
title_full_unstemmed Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics.
title_sort do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? a study on atmospheric chemistry and physics.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2010-10-01
description <h4>Background</h4>Ratings in journal peer review can be affected by sources of bias. The bias variable investigated here was the information on whether authors had suggested a possible reviewer for their manuscript, and whether the editor had taken up that suggestion or had chosen a reviewer that had not been suggested by the authors. Studies have shown that author-suggested reviewers rate manuscripts more favorably than editor-suggested reviewers do.<h4>Methodology/principal findings</h4>Reviewers' ratings on three evaluation criteria and the reviewers' final publication recommendations were available for 552 manuscripts (in total 1145 reviews) that were submitted to Atmospheric Chemistry and Physics, an interactive open access journal using public peer review (authors' and reviewers' comments are publicly exchanged). Public peer review is supposed to bring a new openness to the reviewing process that will enhance its objectivity. In the statistical analysis the quality of a manuscript was controlled for to prevent favorable reviewers' ratings from being attributable to quality instead of to the bias variable.<h4>Conclusions/significance</h4>Our results agree with those from other studies that editor-suggested reviewers rated manuscripts between 30% and 42% less favorably than author-suggested reviewers. Against this backdrop journal editors should consider either doing without the use of author-suggested reviewers or, if they are used, bringing in more than one editor-suggested reviewer for the review process (so that the review by author-suggested reviewers can be put in perspective).
url https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/20976226/?tool=EBI
work_keys_str_mv AT lutzbornmann doauthorsuggestedreviewersratesubmissionsmorefavorablythaneditorsuggestedreviewersastudyonatmosphericchemistryandphysics
AT hansdieterdaniel doauthorsuggestedreviewersratesubmissionsmorefavorablythaneditorsuggestedreviewersastudyonatmosphericchemistryandphysics
_version_ 1714808830902140928