{"id":17797,"date":"2021-01-01T00:00:00","date_gmt":"2021-01-01T00:00:00","guid":{"rendered":"https:\/\/vsr.informatik.tu-chemnitz.de\/publications\/web-user-interface-as-a-message-power-law-for-fraud-detection-in-crowdsourced-labeling\/"},"modified":"2026-10-29T14:13:00","modified_gmt":"2026-10-29T14:13:00","slug":"web-user-interface-as-a-message-power-law-for-fraud-detection-in-crowdsourced-labeling","status":"publish","type":"publication","link":"https:\/\/vsr.informatik.tu-chemnitz.de\/research\/publications\/2021\/012\/","title":{"rendered":"Web User Interface as a Message: Power Law for Fraud Detection in Crowdsourced Labeling"},"content":{"rendered":"\n<div class=\"wp-block-vsr-blocks-header\">\n\t<h3 class=\"grey linie\">\n\t\tAbstract\t<\/h3>\n\t<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Web Engineering becomes increasingly hungry for training data, as the application of machine learning (ML) methods in the field intensifies. Human-labeled datasets are particularly indispensable for ML-based validation and design of user interfaces (UIs). The production of such datasets is often outsourced to crowdworkers, who typically have lower motivation and payment compared to in-house staff, so the quality of their work becomes the paramount concern. In our paper, we explore the applicability of the trending fraud detection approach based on fit to power law in crowdsourced web UI labeling. On Amazon Mechanical Turk, 298 crowdworkers labeled over 30,000 UI elements in about 500 university homepage screenshots. We found a significant correlation between workers\u2019 precisions and Kolmogorov-Smirnov statistics-based goodness-of-fit between the frequencies of UI elements in a worker\u2019s output and power law. The obtained R<sup>2<\/sup>\u2009=\u20090.504 was higher than the R<sup>2<\/sup>\u2009=\u20090.432 baseline for the popular time-on-task parameter. Moreover, the distribution of UI elements\u2019 frequencies is much less prone to manipulation by malicious crowdworkers, which is advantageous as a crowdsourced data quality control measure. The findings of our study suggest a certain resemblance between web UIs and natural language texts, in which word frequencies are known to comply with Zipf\u2019s law.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Web Engineering becomes increasingly hungry for training data, as the application of machine learning (ML) methods in the field intensifies. Human-labeled datasets are particularly indispensable for ML-based validation and design of user interfaces (UIs). The production of such datasets is often outsourced to crowdworkers, who typically have lower motivation and payment compared to in-house staff, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"template":"","meta":{"publication_year":2021,"publication_location":"Proceedings of the 21th International Conference on Web Engineering","publication_pages":"88-96","publication_city":"Biarritz","publication_country":"France","publication_event_name":"21th International Conference on Web Engineering","publication_event_url":"https:\/\/icwe2021.webengineering.org\/","publication_event_start":"2021-05-17","publication_event_end":"2021-05-21","publication_doi":"10.1007\/978-3-030-74296-6_7","publication_isbn_print":"","publication_isbn_online":"","publication_issn":"","publication_pdf_url":"https:\/\/www.researchgate.net\/publication\/351486252_Web_User_Interface_as_a_Message_Power_Law_for_Fraud_Detection_in_Crowdsourced_Labeling","publication_biblatex":"@inproceedings{webuserinterfaceasam2021,\n  author = {Heil, Sebastian and Bakaev, Maxim and Gaedke, Martin},\n  title = {{Web User Interface as a Message: Power Law for Fraud Detection in Crowdsourced Labeling}},\n  year = {2021},\n  booktitle = {Proceedings of the 21th International Conference on Web Engineering},\n  pages = {88-96},\n  doi = {10.1007\/978-3-030-74296-6_7},\n  eventtitle = {21th International Conference on Web Engineering},\n  eventdate = {2021-05-17\/2021-05-21},\n  location = {Biarritz, France},\n  url = {https:\/\/www.researchgate.net\/publication\/351486252_Web_User_Interface_as_a_Message_Power_Law_for_Fraud_Detection_in_Crowdsourced_Labeling},\n  keywords = {Web Engineering, vsr},\n}\n","publication_csl":"{\n    \"id\": \"17797\",\n    \"type\": \"paper-conference\",\n    \"title\": \"Web User Interface as a Message: Power Law for Fraud Detection in Crowdsourced Labeling\",\n    \"author\": [\n        {\n            \"given\": \"Sebastian\",\n            \"family\": \"Heil\"\n        },\n        {\n            \"given\": \"Maxim\",\n            \"family\": \"Bakaev\"\n        },\n        {\n            \"given\": \"Martin\",\n            \"family\": \"Gaedke\"\n        }\n    ],\n    \"issued\": {\n        \"date-parts\": [\n            [\n                2021\n            ]\n        ]\n    },\n    \"container-title\": \"Proceedings of the 21th International Conference on Web Engineering\",\n    \"event-place\": \"Biarritz, France\",\n    \"page\": \"88-96\",\n    \"event-title\": \"21th International Conference on Web Engineering\",\n    \"DOI\": \"10.1007\/978-3-030-74296-6_7\",\n    \"URL\": \"https:\/\/www.researchgate.net\/publication\/351486252_Web_User_Interface_as_a_Message_Power_Law_for_Fraud_Detection_in_Crowdsourced_Labeling\"\n}","publication_id_legacy":"2021-012","publication_isbn_legacy":"","publication_bibtex_url_legacy":"","publication_doi_url_legacy":"https:\/\/doi.org\/10.1007\/978-3-030-74296-6_7","migration_allowed":true,"breadcrumb_parent":348,"footnotes":"","vsr_identifier_year":2021,"vsr_sequence_id":12,"vsr_primary_id":334},"publication_type":[564],"publication_research_area":[571],"publication_tag":[572],"publication_status":[569],"class_list":["post-17797","publication","type-publication","status-publish","hentry","publication_type-conference-paper","publication_research_area-web-engineering","publication_tag-vsr","publication_status-accepted"],"_links":{"self":[{"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=\/wp\/v2\/publication\/17797","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=\/wp\/v2\/types\/publication"}],"author":[{"embeddable":true,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=\/wp\/v2\/users\/1"}],"version-history":[{"count":8,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=\/wp\/v2\/publication\/17797\/revisions"}],"predecessor-version":[{"id":31172,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=\/wp\/v2\/publication\/17797\/revisions\/31172"}],"wp:attachment":[{"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=17797"}],"wp:term":[{"taxonomy":"publication_type","embeddable":true,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=%2Fwp%2Fv2%2Fpublication_type&post=17797"},{"taxonomy":"publication_research_area","embeddable":true,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=%2Fwp%2Fv2%2Fpublication_research_area&post=17797"},{"taxonomy":"publication_tag","embeddable":true,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=%2Fwp%2Fv2%2Fpublication_tag&post=17797"},{"taxonomy":"publication_status","embeddable":true,"href":"https:\/\/vsr.informatik.tu-chemnitz.de\/index.php?rest_route=%2Fwp%2Fv2%2Fpublication_status&post=17797"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}