Conference Paper

2018

Web Engineering

13th International Conference on Evaluation of Novel Approaches to Software Engineering

Proceedings of the 13th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE

978-989-758-300-1

PDF

While Crowdsourcing has been successfully applied in the field of Software Engineering, it is widely overseen in Reverse Engineering. In this paper we introduce the idea of Crowdsourced Reverse Engineering and identify the three major challenges: 1) automatic task extraction, 2) source code anonymization and 3) quality control and results aggregation. To illustrate Crowdsourced Reverse Engineering, we outline our approach for performing the Reverse Engineering activity of concept assignment as a crowdsourced classification task and address suitable methods and considerations with regard to each of the the three challenges. Following a brief overview on existing research in which we position our approach against related work, we report on our experiences from an experiment conducted on the crowdsourcing platform microworkers.com, which yielded 187 results by 34 crowd workers, classifying 10 code fragments with decent quality.