Multiple Citation Indicators and Their Composite across Scientific Disciplines.

Many fields face an increasing prevalence of multi-authorship, and this poses challenges in assessing citation metrics. Here, we explore multiple citation indicators that address total impact (number of citations, Hirsch H index [H]), co-authorship adjustment (Schreiber Hm index [Hm]), and author or...

Full description

Bibliographic Details
Main Authors: John P A Ioannidis, Richard Klavans, Kevin W Boyack
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2016-07-01
Series:PLoS Biology
Online Access:http://europepmc.org/articles/PMC4930269?pdf=render
id doaj-0bd7c9b248274e6ca4e68cf0b278abc2
record_format Article
spelling doaj-0bd7c9b248274e6ca4e68cf0b278abc22021-07-02T13:01:06ZengPublic Library of Science (PLoS)PLoS Biology1544-91731545-78852016-07-01147e100250110.1371/journal.pbio.1002501Multiple Citation Indicators and Their Composite across Scientific Disciplines.John P A IoannidisRichard KlavansKevin W BoyackMany fields face an increasing prevalence of multi-authorship, and this poses challenges in assessing citation metrics. Here, we explore multiple citation indicators that address total impact (number of citations, Hirsch H index [H]), co-authorship adjustment (Schreiber Hm index [Hm]), and author order (total citations to papers as single; single or first; or single, first, or last author). We demonstrate the correlation patterns between these indicators across 84,116 scientists (those among the top 30,000 for impact in a single year [2013] in at least one of these indicators) and separately across 12 scientific fields. Correlation patterns vary across these 12 fields. In physics, total citations are highly negatively correlated with indicators of co-authorship adjustment and of author order, while in other sciences the negative correlation is seen only for total citation impact and citations to papers as single author. We propose a composite score that sums standardized values of these six log-transformed indicators. Of the 1,000 top-ranked scientists with the composite score, only 322 are in the top 1,000 based on total citations. Many Nobel laureates and other extremely influential scientists rank among the top-1,000 with the composite indicator, but would rank much lower based on total citations. Conversely, many of the top 1,000 authors on total citations have had no single/first/last-authored cited paper. More Nobel laureates of 2011-2015 are among the top authors when authors are ranked by the composite score than by total citations, H index, or Hm index; 40/47 of these laureates are among the top 30,000 by at least one of the six indicators. We also explore the sensitivity of indicators to self-citation and alphabetic ordering of authors in papers across different scientific fields. Multiple indicators and their composite may give a more comprehensive picture of impact, although no citation indicator, single or composite, can be expected to select all the best scientists.http://europepmc.org/articles/PMC4930269?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author John P A Ioannidis
Richard Klavans
Kevin W Boyack
spellingShingle John P A Ioannidis
Richard Klavans
Kevin W Boyack
Multiple Citation Indicators and Their Composite across Scientific Disciplines.
PLoS Biology
author_facet John P A Ioannidis
Richard Klavans
Kevin W Boyack
author_sort John P A Ioannidis
title Multiple Citation Indicators and Their Composite across Scientific Disciplines.
title_short Multiple Citation Indicators and Their Composite across Scientific Disciplines.
title_full Multiple Citation Indicators and Their Composite across Scientific Disciplines.
title_fullStr Multiple Citation Indicators and Their Composite across Scientific Disciplines.
title_full_unstemmed Multiple Citation Indicators and Their Composite across Scientific Disciplines.
title_sort multiple citation indicators and their composite across scientific disciplines.
publisher Public Library of Science (PLoS)
series PLoS Biology
issn 1544-9173
1545-7885
publishDate 2016-07-01
description Many fields face an increasing prevalence of multi-authorship, and this poses challenges in assessing citation metrics. Here, we explore multiple citation indicators that address total impact (number of citations, Hirsch H index [H]), co-authorship adjustment (Schreiber Hm index [Hm]), and author order (total citations to papers as single; single or first; or single, first, or last author). We demonstrate the correlation patterns between these indicators across 84,116 scientists (those among the top 30,000 for impact in a single year [2013] in at least one of these indicators) and separately across 12 scientific fields. Correlation patterns vary across these 12 fields. In physics, total citations are highly negatively correlated with indicators of co-authorship adjustment and of author order, while in other sciences the negative correlation is seen only for total citation impact and citations to papers as single author. We propose a composite score that sums standardized values of these six log-transformed indicators. Of the 1,000 top-ranked scientists with the composite score, only 322 are in the top 1,000 based on total citations. Many Nobel laureates and other extremely influential scientists rank among the top-1,000 with the composite indicator, but would rank much lower based on total citations. Conversely, many of the top 1,000 authors on total citations have had no single/first/last-authored cited paper. More Nobel laureates of 2011-2015 are among the top authors when authors are ranked by the composite score than by total citations, H index, or Hm index; 40/47 of these laureates are among the top 30,000 by at least one of the six indicators. We also explore the sensitivity of indicators to self-citation and alphabetic ordering of authors in papers across different scientific fields. Multiple indicators and their composite may give a more comprehensive picture of impact, although no citation indicator, single or composite, can be expected to select all the best scientists.
url http://europepmc.org/articles/PMC4930269?pdf=render
work_keys_str_mv AT johnpaioannidis multiplecitationindicatorsandtheircompositeacrossscientificdisciplines
AT richardklavans multiplecitationindicatorsandtheircompositeacrossscientificdisciplines
AT kevinwboyack multiplecitationindicatorsandtheircompositeacrossscientificdisciplines
_version_ 1721329401930448896