How to Increase the Accuracy of Crowdsourcing Campaigns?

Nurmukhametov O, Baklanov A, Fritz S, Khachay M, Salk C, See L, & Shchepashchenko D (2015). How to Increase the Accuracy of Crowdsourcing Campaigns? In: Systems Analysis 2015 - A Conference in Celebration of Howard Raiffa, 11 -13 November, 2015, Laxenburg, Austria.

[img]
Preview
Text (Conference Poster)
How to Increase the Accuracy of Crowdsourcing Campaigns.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (6MB) | Preview

Abstract

Crowdsourcing is a new approach to performing tasks, with a group of volunteers rather than experts. For example, the Geo-Wiki project [1] aims to improve the global land-cover map by crowdsourcing for image recognition. Though crowdsourcing gives a simple way to perform tasks that are hard to automate, analysis of data received from non-experts is a challenging problem that requires a holistic approach. Here we study in detail the dataset of the Cropland Capture game (part of Geo-Wiki project) to increase the accuracy of campaign’s results. Using this analysis, we developed a methodology for a generic type of crowdsourcing campaign similar to the Cropland Capture game. The proposed methodology relies on computer vision and machine learning techniques. Using the Cropland Capture dataset we showed that our methodology increases agreement between aggregated volunteers’ votes and experts’ decisions from 77% to 86%.

[1] Fritz, Steffen, et al. “Geo-Wiki. Org: The use of crowdsourcing to improve global land cover.” Remote Sensing 1.3 (2009): 345-354.

Item Type: Conference or Workshop Item (Poster)
Research Programs: Ecosystems Services and Management (ESM)
Depositing User: Michaela Rossini
Date Deposited: 19 Jan 2016 15:32
Last Modified: 04 Feb 2016 12:55
URI: http://pure.iiasa.ac.at/11807

Actions (login required)

View Item View Item

International Institute for Applied Systems Analysis (IIASA)
Schlossplatz 1, A-2361 Laxenburg, Austria
Phone: (+43 2236) 807 0 Fax:(+43 2236) 71 313