Improved Vote Aggregation Techniques for the Geo-Wiki Cropland Capture Crowdsourcing Game

Baklanov, A. ORCID: https://orcid.org/0000-0003-1599-3618, Fritz, S. ORCID: https://orcid.org/0000-0003-0420-8549, Khachay, M., Nurmukhametov, O., Salk, C., See, L. ORCID: https://orcid.org/0000-0002-2665-7065, & Shchepashchenko, D. ORCID: https://orcid.org/0000-0002-7814-4990 (2016). Improved Vote Aggregation Techniques for the Geo-Wiki Cropland Capture Crowdsourcing Game. In: European Geosciences Union (EGU) General Assembly 2016, 17–22 April 2016, Vienna, Austria.

Preview	Text II40PosterPortraitA0-v2.pdf - Published Version Available under License Creative Commons Attribution. Download (6MB) | Preview
Preview	Text EGU2016-1892-2.pdf - Published Version Available under License Creative Commons Attribution. Download (36kB) | Preview

Abstract

Crowdsourcing is a new approach for solving data processing problems for which conventional methods appear to be inaccurate, expensive, or time-consuming. Nowadays, the development of new crowdsourcing techniques is mostly motivated by so called Big Data problems, including problems of assessment and clustering for large datasets obtained in aerospace imaging, remote sensing, and even in social network analysis. By involving volunteers from all over the world, the Geo-Wiki project tackles problems of environmental monitoring with applications to flood resilience, biomass data analysis and classification of land cover. For example, the Cropland Capture Game, which is a gamified version of Geo-Wiki, was developed to aid in the mapping of cultivated land, and was used to gather 4.5 million image classifications from the Earth’s surface. More recently, the Picture Pile game, which is a more generalized version of Cropland Capture, aims to identify tree loss over time from pairs of very high resolution satellite images. Despite recent progress in image analysis, the solution to these problems is hard to automate since human experts still outperform the majority of machine learning algorithms and artificial systems in this field on certain image recognition tasks. The replacement of rare and expensive experts by a team of distributed volunteers seems to be promising, but this approach leads to challenging questions such as: how can individual opinions be aggregated optimally, how can confidence bounds be obtained, and how can the unreliability of volunteers be dealt with? In this paper, on the basis of several known machine learning techniques, we propose a technical approach to improve the overall performance of the majority voting decision rule used in the Cropland Capture Game. The proposed approach increases the estimated consistency with expert opinion from 77% to 86%.

Item Type:	Conference or Workshop Item (Poster)
Additional Information:	ESSI3.8/GI3.9: Citizen-empowered science and crowdsourcing in the geosciences. Uncertainty and user perception. Poster Session: 17:30-19:00 / Hall A
Research Programs:	Advanced Systems Analysis (ASA) Ecosystems Services and Management (ESM)
Depositing User:	Michaela Rossini
Date Deposited:	11 Apr 2016 11:37
Last Modified:	19 Oct 2022 05:00
URI:	https://pure.iiasa.ac.at/12611

Actions (login required)

View Item