Jan 22, 2020 · In this paper, we present qualitative and quantitative results, revealing how different crowd workers adopt different work strategies to ...

Feb 3, 2020 · We observe how crowd work experiences result in different types of working strategies, productivity levels, quality and diversity of the ...

We observe how crowd work experiences result in different types of working strategies, productivity levels, quality and diversity of the crowdsourced judgments.

Our results highlight the presence of frequently used shortcut patterns that can speed-up task completion, thus increasing the hourly wage of efficient workers.

Crowd Worker Strategies in Relevance Judgment Tasks. Lei Han, Eddy Maddalena, Alessandro Checco, Cristina Sarasua, Ujwal Gadiraju, Kevin Roitero, Gianluca ...

Following the crowdsourcing approach, we will distribute those judging tasks to a large group of potential assessors on the Internet. To do this, we use. Amazon ...

In this paper we look at how enriching the relevance judgment task design with additional metadata impacts the cost and quality of crowdsourced judgments.

The SONAR project aims to create a scholarly archive that collects, promotes and preserves the publications of authors affiliated with Swiss public research ...

In this paper, we take a step toward motivation-aware task assignment and examine its effect on crowdwork quality. Our first challenge is to model motivation.

To scale the size of Information Retrieval collections, crowdsourcing has become a common way to collect relevance judgments at scale.