Identifying unreliable and adversarial workers in crowdsourced labeling tasks

MaRDI QIDQ4637009zbMATH OpenFDO

Authors Srikanth Jagabathula, Lakshminarayanan Subramanian, Ashwin Venkataraman

Publication date 17 April 2018

Full work available at URL http://jmlr.csail.mit.edu/papers/v18/15-650.html

zbMATH Keywords

outliersreputationadversarycrowdsourcing

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Budget-Optimal Task Allocation for Reliable Crowdsourcing Systems
• Bandit-based task assignment for heterogeneous crowdsourcing
• Quality-aware online task assignment mechanisms using latent topic model
• Eliminating spammers and ranking annotators for crowdsourced labeling tasks
• More for less: adaptive labeling payments in online labor markets

Cites work

• Budget-Optimal Task Allocation for Reliable Crowdsourcing Systems
• Eliminating spammers and ranking annotators for crowdsourced labeling tasks
• Identifying unreliable and adversarial workers in crowdsourced labeling tasks
• Optimal Inference in Crowdsourced Classification via Belief Propagation
• Random graphs.
• Semi-matchings for bipartite graphs and load balancing.
• Spectral methods meet EM: a provably optimal algorithm for crowdsourcing

Cited in

(3)

• scientific article; zbMATH DE number 7626705 (Why is no real title available?)
• Eliminating spammers and ranking annotators for crowdsourced labeling tasks
• Identifying unreliable and adversarial workers in crowdsourced labeling tasks

Describes a project that uses

Uses Software

• NetworkX

This page was built for publication: Identifying unreliable and adversarial workers in crowdsourced labeling tasks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4637009)