Crowdsourcing the identification of organisms: A case-study of iSpot

Accurate species identification is fundamental to biodiversity science, but the natural history skills required for this are neglected in formal education at all levels. In this paper we describe how the web application ispotnature.org and its sister site ispot.org.za (collectively, “iSpot”) are hel...

Full description

Bibliographic Details
Main Authors: Jonathan Silvertown, Martin Harvey, Richard Greenwood, Mike Dodd, Jon Rosewell, Tony Rebelo, Janice Ansine, Kevin McConway
Format: Article
Language:English
Published: Pensoft Publishers 2015-02-01
Series:ZooKeys
Online Access:http://zookeys.pensoft.net/lib/ajax_srv/article_elements_srv.php?action=download_pdf&item_id=4633
id doaj-a4e6b973cb1548e28268a4ccd1d5e382
record_format Article
spelling doaj-a4e6b973cb1548e28268a4ccd1d5e3822020-11-24T20:54:22ZengPensoft PublishersZooKeys1313-29891313-29702015-02-0148012514610.3897/zookeys.480.88034633Crowdsourcing the identification of organisms: A case-study of iSpotJonathan SilvertownMartin HarveyRichard GreenwoodMike DoddJon RosewellTony RebeloJanice AnsineKevin McConwayAccurate species identification is fundamental to biodiversity science, but the natural history skills required for this are neglected in formal education at all levels. In this paper we describe how the web application ispotnature.org and its sister site ispot.org.za (collectively, “iSpot”) are helping to solve this problem by combining learning technology with crowdsourcing to connect beginners with experts. Over 94% of observations submitted to iSpot receive a determination. External checking of a sample of 3,287 iSpot records verified > 92% of them. To mid 2014, iSpot crowdsourced the identification of 30,000 taxa (>80% at species level) in > 390,000 observations with a global community numbering > 42,000 registered participants. More than half the observations on ispotnature.org were named within an hour of submission. iSpot uses a unique, 9-dimensional reputation system to motivate and reward participants and to verify determinations. Taxon-specific reputation points are earned when a participant proposes an identification that achieves agreement from other participants, weighted by the agreers’ own reputation scores for the taxon. This system is able to discriminate effectively between competing determinations when two or more are proposed for the same observation. In 57% of such cases the reputation system improved the accuracy of the determination, while in the remainder it either improved precision (e.g. by adding a species name to a genus) or revealed false precision, for example where a determination to species level was not supported by the available evidence. We propose that the success of iSpot arises from the structure of its social network that efficiently connects beginners and experts, overcoming the social as well as geographic barriers that normally separate the two.http://zookeys.pensoft.net/lib/ajax_srv/article_elements_srv.php?action=download_pdf&item_id=4633
collection DOAJ
language English
format Article
sources DOAJ
author Jonathan Silvertown
Martin Harvey
Richard Greenwood
Mike Dodd
Jon Rosewell
Tony Rebelo
Janice Ansine
Kevin McConway
spellingShingle Jonathan Silvertown
Martin Harvey
Richard Greenwood
Mike Dodd
Jon Rosewell
Tony Rebelo
Janice Ansine
Kevin McConway
Crowdsourcing the identification of organisms: A case-study of iSpot
ZooKeys
author_facet Jonathan Silvertown
Martin Harvey
Richard Greenwood
Mike Dodd
Jon Rosewell
Tony Rebelo
Janice Ansine
Kevin McConway
author_sort Jonathan Silvertown
title Crowdsourcing the identification of organisms: A case-study of iSpot
title_short Crowdsourcing the identification of organisms: A case-study of iSpot
title_full Crowdsourcing the identification of organisms: A case-study of iSpot
title_fullStr Crowdsourcing the identification of organisms: A case-study of iSpot
title_full_unstemmed Crowdsourcing the identification of organisms: A case-study of iSpot
title_sort crowdsourcing the identification of organisms: a case-study of ispot
publisher Pensoft Publishers
series ZooKeys
issn 1313-2989
1313-2970
publishDate 2015-02-01
description Accurate species identification is fundamental to biodiversity science, but the natural history skills required for this are neglected in formal education at all levels. In this paper we describe how the web application ispotnature.org and its sister site ispot.org.za (collectively, “iSpot”) are helping to solve this problem by combining learning technology with crowdsourcing to connect beginners with experts. Over 94% of observations submitted to iSpot receive a determination. External checking of a sample of 3,287 iSpot records verified > 92% of them. To mid 2014, iSpot crowdsourced the identification of 30,000 taxa (>80% at species level) in > 390,000 observations with a global community numbering > 42,000 registered participants. More than half the observations on ispotnature.org were named within an hour of submission. iSpot uses a unique, 9-dimensional reputation system to motivate and reward participants and to verify determinations. Taxon-specific reputation points are earned when a participant proposes an identification that achieves agreement from other participants, weighted by the agreers’ own reputation scores for the taxon. This system is able to discriminate effectively between competing determinations when two or more are proposed for the same observation. In 57% of such cases the reputation system improved the accuracy of the determination, while in the remainder it either improved precision (e.g. by adding a species name to a genus) or revealed false precision, for example where a determination to species level was not supported by the available evidence. We propose that the success of iSpot arises from the structure of its social network that efficiently connects beginners and experts, overcoming the social as well as geographic barriers that normally separate the two.
url http://zookeys.pensoft.net/lib/ajax_srv/article_elements_srv.php?action=download_pdf&item_id=4633
work_keys_str_mv AT jonathansilvertown crowdsourcingtheidentificationoforganismsacasestudyofispot
AT martinharvey crowdsourcingtheidentificationoforganismsacasestudyofispot
AT richardgreenwood crowdsourcingtheidentificationoforganismsacasestudyofispot
AT mikedodd crowdsourcingtheidentificationoforganismsacasestudyofispot
AT jonrosewell crowdsourcingtheidentificationoforganismsacasestudyofispot
AT tonyrebelo crowdsourcingtheidentificationoforganismsacasestudyofispot
AT janiceansine crowdsourcingtheidentificationoforganismsacasestudyofispot
AT kevinmcconway crowdsourcingtheidentificationoforganismsacasestudyofispot
_version_ 1716794719224201216