A Dynamic Model for Quality Control in Crowdsourcing Systems

摘要

Crowdsourcing is an increasingly popular approach for utilizing the power of the crowd in performing tasks that cannot be solved sufficiently by machines. However, the challenge of effectively exploiting such systems lies in the quality of the obtained outcome from the crowdsourcing workers. While many studies and techniques have been conducted to manage the quality, they have mostly focused on managing the quality statically and used the same quality control mechanism for evaluating different types of tasks. Nonetheless, to obtain high-quality results, different quality control mechanisms should be applied to evaluate the different type of tasks. Hence, in this paper, we present our ongoing research in the domain of quality control in crowdsourcing systems and propose a task ontology-based model to facilitate identifying the most appropriate quality control mechanism for a given task.