Order effects in the results of song contests: Evidence from the Eurovision and the New Wave
The results of song contests offer a unique opportunity to analyze possible distortions arising from various biases in performance evaluations using observational data. In this study we investigate the influence of contestants’ order of appearance on their ranking. We found that, in the New Wave S...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Society for Judgment and Decision Making
2017-07-01
|
| Series: | Judgment and Decision Making |
| Subjects: | |
| Online Access: | http://journal.sjdm.org/16/16121/jdm16121.pdf |
| id |
doaj-495d2bbbb3a0430aa84326222eb2501b |
|---|---|
| record_format |
Article |
| spelling |
doaj-495d2bbbb3a0430aa84326222eb2501b2021-05-02T12:35:02ZengSociety for Judgment and Decision MakingJudgment and Decision Making1930-29752017-07-01124415421Order effects in the results of song contests: Evidence from the Eurovision and the New WaveEvgeny A. AntipovElena B. PokryshevskayaThe results of song contests offer a unique opportunity to analyze possible distortions arising from various biases in performance evaluations using observational data. In this study we investigate the influence of contestants’ order of appearance on their ranking. We found that, in the New Wave Song Contest, expert judgments were significantly influenced by the contestant’s running number, an exogenous factor that, being assigned randomly, clearly did not influence the output quality. We also found weaker statistical evidence of such an ordering effect in Eurovision Song Contest finals of 2009--2012. Keywords: ordering effects, cognitive bias, Eurovision, inter-rater agreement, judgment, ranking, votinghttp://journal.sjdm.org/16/16121/jdm16121.pdf The results of song contests offer a unique opportunity to analyze possible distortions arising from various biases in performance evaluations using observational data. In this study we investigate the influence of contestants’ order of appearance on their ranking. We found that in the New Wave Song Contest expert judgments were significantly influenced by the contestant’s running number an exogenous factor that being assigned randomly clearly did not influence the output quality. We also found weaker statistical evidence of such an ordering effect in Eurovision Song Contest finals of 2009--2012. Keywords |
| collection |
DOAJ |
| language |
English |
| format |
Article |
| sources |
DOAJ |
| author |
Evgeny A. Antipov Elena B. Pokryshevskaya |
| spellingShingle |
Evgeny A. Antipov Elena B. Pokryshevskaya Order effects in the results of song contests: Evidence from the Eurovision and the New Wave Judgment and Decision Making The results of song contests offer a unique opportunity to analyze possible distortions arising from various biases in performance evaluations using observational data. In this study we investigate the influence of contestants’ order of appearance on their ranking. We found that in the New Wave Song Contest expert judgments were significantly influenced by the contestant’s running number an exogenous factor that being assigned randomly clearly did not influence the output quality. We also found weaker statistical evidence of such an ordering effect in Eurovision Song Contest finals of 2009--2012. Keywords |
| author_facet |
Evgeny A. Antipov Elena B. Pokryshevskaya |
| author_sort |
Evgeny A. Antipov |
| title |
Order effects in the
results of song contests: Evidence from the Eurovision and the New Wave |
| title_short |
Order effects in the
results of song contests: Evidence from the Eurovision and the New Wave |
| title_full |
Order effects in the
results of song contests: Evidence from the Eurovision and the New Wave |
| title_fullStr |
Order effects in the
results of song contests: Evidence from the Eurovision and the New Wave |
| title_full_unstemmed |
Order effects in the
results of song contests: Evidence from the Eurovision and the New Wave |
| title_sort |
order effects in the
results of song contests: evidence from the eurovision and the new wave |
| publisher |
Society for Judgment and Decision Making |
| series |
Judgment and Decision Making |
| issn |
1930-2975 |
| publishDate |
2017-07-01 |
| description |
The results
of song contests offer a unique opportunity to analyze possible distortions
arising from various biases in performance evaluations using observational
data. In this study we investigate the influence of contestants’ order of
appearance on their ranking. We found that, in the New Wave Song Contest,
expert judgments were significantly influenced by the contestant’s running
number, an exogenous factor that, being assigned randomly, clearly did not
influence the output quality. We also found weaker statistical evidence of
such an ordering effect in Eurovision Song Contest finals of 2009--2012.
Keywords: ordering effects, cognitive bias, Eurovision, inter-rater agreement,
judgment, ranking, voting |
| topic |
The results of song contests offer a unique opportunity to analyze possible distortions arising from various biases in performance evaluations using observational data. In this study we investigate the influence of contestants’ order of appearance on their ranking. We found that in the New Wave Song Contest expert judgments were significantly influenced by the contestant’s running number an exogenous factor that being assigned randomly clearly did not influence the output quality. We also found weaker statistical evidence of such an ordering effect in Eurovision Song Contest finals of 2009--2012. Keywords |
| url |
http://journal.sjdm.org/16/16121/jdm16121.pdf |
| work_keys_str_mv |
AT evgenyaantipov ordereffectsintheresultsofsongcontestsevidencefromtheeurovisionandthenewwave AT elenabpokryshevskaya ordereffectsintheresultsofsongcontestsevidencefromtheeurovisionandthenewwave |
| _version_ |
1721491388298690560 |