Competition for novelty reduces information sampling in a research game - a registered report

Incentive structures shape scientists' research practices. One incentive in particular, rewarding priority of publication, is hypothesized to harm scientific reliability by promoting rushed, low-quality research. Here, we develop a laboratory experiment to test whether competition affects infor...

Full description

Bibliographic Details
Main Authors: Leonid Tiokhin, Maxime Derex
Format: Article
Language:English
Published: The Royal Society 2019-05-01
Series:Royal Society Open Science
Subjects:
Online Access:https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.180934
id doaj-5ce232c802c6482aaac0b1c737c359ac
record_format Article
spelling doaj-5ce232c802c6482aaac0b1c737c359ac2020-11-25T03:53:46ZengThe Royal SocietyRoyal Society Open Science2054-57032019-05-016510.1098/rsos.180934180934Competition for novelty reduces information sampling in a research game - a registered reportLeonid TiokhinMaxime DerexIncentive structures shape scientists' research practices. One incentive in particular, rewarding priority of publication, is hypothesized to harm scientific reliability by promoting rushed, low-quality research. Here, we develop a laboratory experiment to test whether competition affects information sampling and guessing accuracy in a game that mirrors aspects of scientific investigation. In our experiment, individuals gather data in order to guess true states of the world and face a tradeoff between guessing quickly and increasing accuracy by acquiring more information. To test whether competition affects accuracy, we compare a treatment in which individuals are rewarded for each correct guess to a treatment where individuals face the possibility of being ‘scooped’ by a competitor. In a second set of conditions, we make information acquisition contingent on solving arithmetic problems to test whether competition increases individual effort (i.e. arithmetic-problem solving speed). We find that competition causes individuals to make guesses using less information, thereby reducing their accuracy (H1a and H1b confirmed). We find no evidence that competition increases individual effort (H2, inconclusive evidence). Our experiment provides proof of concept that rewarding priority of publication can incentivize individuals to acquire less information, producing lower-quality research as a consequence.https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.180934competitionpriority rulemetascienceinformation samplingincentive structures
collection DOAJ
language English
format Article
sources DOAJ
author Leonid Tiokhin
Maxime Derex
spellingShingle Leonid Tiokhin
Maxime Derex
Competition for novelty reduces information sampling in a research game - a registered report
Royal Society Open Science
competition
priority rule
metascience
information sampling
incentive structures
author_facet Leonid Tiokhin
Maxime Derex
author_sort Leonid Tiokhin
title Competition for novelty reduces information sampling in a research game - a registered report
title_short Competition for novelty reduces information sampling in a research game - a registered report
title_full Competition for novelty reduces information sampling in a research game - a registered report
title_fullStr Competition for novelty reduces information sampling in a research game - a registered report
title_full_unstemmed Competition for novelty reduces information sampling in a research game - a registered report
title_sort competition for novelty reduces information sampling in a research game - a registered report
publisher The Royal Society
series Royal Society Open Science
issn 2054-5703
publishDate 2019-05-01
description Incentive structures shape scientists' research practices. One incentive in particular, rewarding priority of publication, is hypothesized to harm scientific reliability by promoting rushed, low-quality research. Here, we develop a laboratory experiment to test whether competition affects information sampling and guessing accuracy in a game that mirrors aspects of scientific investigation. In our experiment, individuals gather data in order to guess true states of the world and face a tradeoff between guessing quickly and increasing accuracy by acquiring more information. To test whether competition affects accuracy, we compare a treatment in which individuals are rewarded for each correct guess to a treatment where individuals face the possibility of being ‘scooped’ by a competitor. In a second set of conditions, we make information acquisition contingent on solving arithmetic problems to test whether competition increases individual effort (i.e. arithmetic-problem solving speed). We find that competition causes individuals to make guesses using less information, thereby reducing their accuracy (H1a and H1b confirmed). We find no evidence that competition increases individual effort (H2, inconclusive evidence). Our experiment provides proof of concept that rewarding priority of publication can incentivize individuals to acquire less information, producing lower-quality research as a consequence.
topic competition
priority rule
metascience
information sampling
incentive structures
url https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.180934
work_keys_str_mv AT leonidtiokhin competitionfornoveltyreducesinformationsamplinginaresearchgamearegisteredreport
AT maximederex competitionfornoveltyreducesinformationsamplinginaresearchgamearegisteredreport
_version_ 1724476785077256192