Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Measuring Motivations of Crowdworkers: The Multidimensional Crowdworker Motivation Scale

Published: 23 September 2019 Publication History

Abstract

Crowd employment is a new form of short-term and flexible employment that has emerged during the past decade. To understand this new form of employment, it is crucial to illuminate the underlying motivations of the workforce involved in it. This article introduces the Multidimensional Crowdworker Motivation Scale (MCMS), a scale for measuring the motivation of crowdworkers on microtask platforms. The MCMS is theoretically grounded in self-determination theory and tailored specifically to the context of paid crowdsourced microlabor. The scale measures the motivation of crowdworkers along six motivational dimensions, ranging from amotivation to intrinsic motivation. We validated the MCMS on data collected in ten countries and three income groups. Factor analyses demonstrated that the MCMS’s six dimensions showed good model fit, validity, and reliability. Furthermore, our measurement invariance tests showed that motivations measured with the MCMS are comparable across countries and income groups, and we present a first cross-country comparison of crowdworker motivations. This work constitutes an important first step toward understanding the motivations of the international crowd workforce.

References

[1]
Judd Antin and Aaron D. Shaw. 2012. Social desirability bias and self-reports of motivation: A study of Amazon mechanical turk in the U.S. and India. In Proceedings of the Conference on Human Factors in Computing Systems (CHI’12), Joseph A. Konstan, Ed H. Chi, and Kristina Höök (Eds.). ACM, 2925--2934.
[2]
Peter M. Bentler and Douglas G. Bonett. 1980. Significance tests and goodness of fit in the analysis of covariance structures. Psychol. Bull. 88, 3 (1980), 588.
[3]
Janine Berg. 2016. Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers. Comp. Lab. L. 8 Pol’y J. 37 (2015), 543.
[4]
Janine Berg, M. Furrer, E. Harmon, U. Rani, and M. S. Silberman. 2018. Digital labour platforms and the future of work: Towards decent work in the online world. Geneva: International Labour Organization, September 20 (2018).
[5]
Michael S. Bernstein, Greg Little, Robert C. Miller, Björn Hartmann, Mark S. Ackerman, David R. Karger, David Crowell, and Katrina Panovich. 2015. Soylent: A word processor with a crowd inside. Commun. ACM 58, 8 (2015), 85--94.
[6]
M. R. Blais, L. Lachance, R. J. Vallerand, N. M. Briere, and A. S. Riddle. 1993. The work motivation inventory. Revue Quebecoise de Psychologie 14 (1993), 185--215.
[7]
Kenneth A. Bollen. 1989. Structural Equations with Latent Variables. John Wiley 8 Sons.
[8]
Robin Bordoli. 2018. Focused on the Future with a New Name. Retrieved from http://www.figure-eight.com/focused-future-new-name/.
[9]
Dana Chandler and Adam Kapelner. 2013. Breaking monotony with meaning: Motivation in crowdsourcing markets. J. Econ. Behav. Organiz. 90 (2013), 123--133.
[10]
Jonathan Chang, Jordan L. Boyd-Graber, Sean Gerrish, Chong Wang, and David M. Blei. 2009. Reading tea leaves: How humans interpret topic models. In Proceedings of the 23rd Annual Conference on Neural Information Processing Systems, Yoshua Bengio, Dale Schuurmans, John D. Lafferty, Christopher K. I. Williams, and Aron Culotta (Eds.). Curran Associates, 288--296. Retrieved from http://papers.nips.cc/paper/3700-reading-tea-leaves-how-humans-interpret-topic-models.
[11]
Emanuela Chemolli and Marylène Gagné. 2014. Evidence against the continuum structure underlying motivation measures derived from self-determination theory. Psychol. Assess. 26, 2 (2014), 575.
[12]
Fang Fang Chen. 2007. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equat. Model. 14, 3 (2007), 464--504.
[13]
Gordon W. Cheung and Roger B. Rensvold. 2000. Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. J. Cross-Cultur. Psychol. 31, 2 (2000), 187--212.
[14]
Gordon W. Cheung and Roger B. Rensvold. 2002. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equat. Model. 9, 2 (2002), 233--255.
[15]
Cristiano Codagnone, Fabienne Abadie, and Federico Biagi. 2016. The future of work in the “sharing economy.” Market efficiency and equitable opportunities or unfair precarisation? Market Efficiency and Equitable Opportunities or Unfair Precarisation (2016).
[16]
European Commission. 2016. A European agenda for the collaborative economy. Retrieved from http://ec.europa.eu/DocsRoom/documents/16881.
[17]
Lee J. Cronbach. 1951. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 (1951), 297--334.
[18]
Douglas P. Crowne and David Marlowe. 1960. A new scale of social desirability independent of psychopathology. J. Consult. Psychol. 24, 4 (1960), 349.
[19]
María de los Ángeles Morata-Ramírez and Francisco Pablo Holgado-Tello. 2013. Construct validity of Likert scales through confirmatory factor analysis: A simulation study comparing different methods of estimation based on Pearson and polychoric correlations. Int. J. Soc. Sci. Studies 1, 1 (2013), p54--61.
[20]
Edward L. Deci and Richard M. Ryan. 1980. The empirical exploration of intrinsic motivational processes. Adv. Exper. Soc. Psychol. 13 (1980), 39--80.
[21]
Edward L. Deci and Richard M. Ryan. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. Springer US.
[22]
Edward L. Deci and Richard M. Ryan. 2000. The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychol. Inquiry 11, 4 (2000), 227--268.
[23]
Edward L. Deci and Richard M. Ryan. 2002. Handbook of Self-determination Research. University Rochester Press.
[24]
Edward L. Deci and Richard M. Ryan. 2002. Overview of self-determination theory: An organismic dialectical perspective. Handbook Self-determ. Res. (2002), 3--33.
[25]
Robert F. DeVellis. 2016. Scale Development: Theory and Applications. Vol. 26. Sage publications.
[26]
Christoph Dybowski and Sigrid Harendza. 2015. Validation of the physician teaching motivation questionnaire (PTMQ). BMC Med. Edu. 15, 1 (2015), 1.
[27]
Alek Felstiner. 2011. Working the crowd: Employment and labor law in the crowdsourcing industry. Berkeley J. Employ. Labor Law (2011), 143--203.
[28]
Sara J. Finney and Christine DiStefano. 2006. Non-normal and categorical data in structural equation modeling. Structural equation modeling: A second course (2006), 269--314.
[29]
GESIS--Leibniz Institute for the Social Sciences. 2019. Retrieved from http://crowdworkers.info.
[30]
Claes Fornell and David F. Larcker. 1981. Evaluating structural equation models with unobservable variables and measurement error. J. Market. Res. (1981), 39--50.
[31]
James R. Foulds, Levi Boyles, Christopher DuBois, Padhraic Smyth, and Max Welling. 2013. Stochastic collapsed variational Bayesian inference for latent Dirichlet allocation. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’13), Inderjit S. Dhillon, Yehuda Koren, Rayid Ghani, Ted E. Senator, Paul Bradley, Rajesh Parekh, Jingrui He, Robert L. Grossman, and Ramasamy Uthurusamy (Eds.). ACM, 446--454.
[32]
Robin D. Froman. 2001. Elements to consider in planning the use of factor analysis. South. Online J. Nurs. Res. 2, 5 (2001).
[33]
Marylène Gagné and Edward L. Deci. 2005. Self-determination theory and work motivation. J.f Organiz. Behav. 26, 4 (2005), 331--362.
[34]
Marylène Gagné, Jacques Forest, Marie-Hélène Gilbert, Caroline Aubé, Estelle Morin, and Angela Malorni. 2010. The motivation at work scale: Validation evidence in two languages. Edu. Psychol. Measure. 70, 4 (2010), 628--646.
[35]
Marylène Gagné, Jacques Forest, Maarten Vansteenkiste, Laurence Crevier-Braud, Anja Van den Broeck, Ann Kristin Aspeli, Jenny Bellerose, Charles Benabou, Emanuela Chemolli, Stefan Tomas Güntert, et al. 2015. The multidimensional work motivation scale: Validation evidence in seven languages and nine countries. Eur. J. Work Organiz. Psychol. 24, 2 (2015), 178--196.
[36]
Darren George and M. Mallery. 2003. Using SPSS for Windows step by step: A simple guide and reference. Allyn 8 Bacon, Boston, MA.
[37]
Frédéric Guay, Alexandre J. S. Morin, David Litalien, Pierre Valois, and Robert J. Vallerand. 2015. Application of exploratory structural equation modeling to evaluate the academic motivation scale. J. Exper. Edu. 83, 1 (2015), 51--82.
[38]
Neha Gupta, Andy Crabtree, Tom Rodden, David Martin, and Jacki O’Neill. 2014. Understanding Indian crowdworkers. In Proceedings of the 17th Conference on Computer Supported Cooperative Work.
[39]
Neha Gupta, David B. Martin, Benjamin V. Hanrahan, and Jacki O’Neill. 2014. Turk-life in India. In Proceedings of the 18th International Conference on Supporting Group Work, Sean P. Goggins, Isa Jahnke, David W. McDonald, and Pernille Bjørn (Eds.). ACM, 1--11.
[40]
Joseph F. Hair, Joseph F. Jr., Barry J. Babin, Rolph E. Anderson, and William C. Black. 2018. Multivariate Data Analysis (8th Ed.). Cengage, Hampshire, United Kingdom.
[41]
Kevin Hewison and Arne L. Kalleberg. 2013. Precarious work and flexibilization in South and Southeast Asia. Amer. Behav. Sci. 57, 4 (2013), 395--402.
[42]
Daire Hooper, Joseph Coughlan, and Michael Mullen. 2008. Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods 6 (2008), 53--60.
[43]
John L. Horn and J. Jack McArdle. 1992. A practical and theoretical guide to measurement invariance in aging research. Exper. Aging Res. 18, 3 (1992), 117--144.
[44]
John Joseph Horton and Lydia B. Chilton. 2010. The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM Conference on Electronic Commerce (EC’10), David C. Parkes, Chrysanthos Dellarocas, and Moshe Tennenholtz (Eds.). ACM, 209--218.
[45]
Mokter Hossain. 2012. Users’ motivation to participate in online crowdsourcing platforms. In Proceedings of the International Conference on Innovation Management and Technology Research (ICIMTR’12). IEEE, 310--315.
[46]
Joshua L. Howard, Marylène Gagné, Alexandre J. S. Morin, and Jacques Forest. 2016. Using bifactor exploratory structural equation modeling to test for a continuum structure of motivation. J. Manage. (2016), 0149206316645653.
[47]
Jeff Howe. 2006. Crowdsourcing: A Definition. Retrieved from http://crowdsourcing.typepad.com/cs/2006/06/crowdsourcing_a.html.
[48]
Panagiotis G. Ipeirotis. 2010. Analyzing the Amazon mechanical turk marketplace. ACM Crossroads 17, 2 (2010), 16--21.
[49]
Panagiotis G. Ipeirotis. 2010. Demographics of mechanical turk. CeDER Working Papers (2010).
[50]
Arne L. Kalleberg. 2009. Precarious work, insecure workers: Employment relations in transition. Amer. Sociol. Rev. 74, 1 (2009), 1--22.
[51]
Nicolas Kaufmann, Thimo Schulze, and Daniel Veit. 2011. More than fun and money. Worker motivation in crowdsourcing—A study on mechanical turk. In Proceedings of the 17th Americas Conference on Information Systems: A Renaissance of Information Technology for Sustainability and Global Competitiveness (AMCIS’11), Vallabh Sambamurthy and Mohan Tanniru (Eds.). Association for Information Systems. Retrieved from http://aisel.aisnet.org/amcis2011_submissions/340.
[52]
Shashank Khanna, Aishwarya Ratan, James Davis, and William Thies. 2010. Evaluating and improving the usability of mechanical turk for low-income workers in India. In Proceedings of the 1st ACM Annual Symposium on Computing for Development (ACM DEV’10), Andrew M. Dearden, Tapan S. Parikh, and Lakshminarayanan Subramanian (Eds.). ACM, 12.
[53]
Rex B. Kline. 2015. Principles and Practice of Structural Equation Modeling. Guilford Publications.
[54]
Jon A. Krosnick. 1999. Survey research. Ann. Rev. Psychol. 50, 1 (1999), 537--567.
[55]
Siou Chew Kuek, Cecilia Paradi-Guilford, Toks Fayomi, Saori Imaizumi, Panos Ipeirotis, Patricia Pina, Manpreet Singh, et al. 2015. The Global Opportunity in Online Outsourcing. Technical Report. The World Bank.
[56]
Ihno A. Lee and Kristopher J. Preacher. 2013. Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Retrieved from http://quantpsy.org/corrtest/corrtest3.htm.
[57]
Tak Yeon Lee, Casey Dugan, Werner Geyer, Tristan Ratchford, Jamie C. Rasmussen, N. Sadat Shami, and Stela Lupushor. 2013. Experiments on motivational feedback for crowdsourced workers. In Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM’13). Emre Kiciman, Nicole B. Ellison, Bernie Hogan, Paul Resnick, and Ian Soboroff (Eds.). The AAAI Press. Retrieved from http://www.aaai.org/ocs/index.php/ICWSM/ICWSM13/paper/view/6118.
[58]
David Litalien, Frédéric Guay, and Alexandre J. S. Morin. 2015. Motivation for PhD studies: Scale development and validation. Learn. Individ. Dif. 41 (2015), 1--13.
[59]
Irene Mandl, Maurizio Curtarelli, Sara Riso, Oscar Vargas, and Elias Gerogiannis. 2015. New forms of employment. Eurofound Report.
[60]
Herbert W. Marsh, Kit-Tai Hau, and David Grayson. 2005. Goodness of fit in structural equation models. In Multivariate applications book series. Contemporary Psychometrics: A Festschrift for Roderick P. McDonald, A. Maydeu-Olivares and J. J. McArdle (Eds.). Lawrence Erlbaum Associates Publishers, Mahwah, NJ, US.
[61]
David B. Martin, Benjamin V. Hanrahan, Jacki O’Neill, and Neha Gupta. 2014. Being a turker. In Proceedings of the Computer Supported Cooperative Work (CSCW’14), Susan R. Fussell, Wayne G. Lutters, Meredith Ringel Morris, and Madhu Reddy (Eds.). ACM, 224--235.
[62]
Roderick P. McDonald. 1999. Test Theory: A Unified Treatment. Lawrence Erlbaum Associates Publishers.
[63]
Roger E. Millsap and Margarita Olivera-Aguilar. 2012. Investigating measurement invariance using confirmatory factor analysis. In Handbook of Structural Equation Modeling, R. Hoyle (Ed.). Guilford Press, New York.
[64]
Babak Naderi. 2018. How to measure motivation? In Motivation of Workers on Microtask Crowdsourcing Platforms. Springer, 29--44.
[65]
Babak Naderi, Ina Wechsung, Tim Polzehl, and Sebastian Möller. 2014. Development and validation of extrinsic motivation scale for crowdsourcing microtask platforms. In Proceedings of the International ACM Workshop on Crowdsourcing for Multimedia (CrowdMM’14), Judith Redi and Mathias Lux (Eds.). ACM, 31--36.
[66]
Bloomberg News. 2016. Venezuela’s Currency is Collapsing on the Black Market Again. Retrieved from http://www.bloomberg.com/news/articles/2016-11-01/venezuela-s-currency-is-collapsing-on-the-black-market-again.
[67]
Ailsa G. Niven and David Markland. 2016. Using self-determination theory to understand motivation for walking: Instrument development and model testing using Bayesian structural equation modelling. Psychol. Sport. Exercise 23 (2016), 90--100.
[68]
Kimberly A. Noels, Luc G. Pelletier, Richard Clément, and Robert J. Vallerand. 2000. Why are you learning a second language? Motivational orientations and self-determination theory. Lang. Learn. 50, 1 (2000), 57--85.
[69]
Daniel M. Oppenheimer, Tom Meyvis, and Nicolas Davidenko. 2009. Instructional manipulation checks: Detecting satisficing to increase statistical power. J. Exper. Soc. Psychol. 45, 4 (2009), 867--872.
[70]
Jason W. Osborne and Anna B. Costello. 2009. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pan-Pacific Manage. Rev. 12, 2 (2009), 131--146.
[71]
Gabriele Paolacci, Jesse Chandler, and Panagiotis G. Ipeirotis. 2010. Running experiments on Amazon mechanical turk. Judg. Decis. Mak. 5, 5 (2010), 411--419.
[72]
European Parliament. 2016. The situation of workers in the Collaborative Economy. Retrieved from http://www.europarl.europa.eu/RegData/etudes/IDAN/2016/587316/IPOL_IDA(2016)587316_EN.pdf.
[73]
Lisa Posch, Arnim Bleier, Fabian Flöck, and Markus Strohmaier. 2018. Characterizing the global crowd workforce: A cross-country comparison of crowdworker demographics. arXiv preprint arXiv:1812.05948.
[74]
Lisa Posch, Arnim Bleier, Philipp Schaer, and Markus Strohmaier. 2015. The polylingual labeled topic model. In Proceedings of the 38th Annual German Conference on Advances in Artificial Intelligence (AI’15) (Lecture Notes in Computer Science), Steffen Hölldobler, Markus Krötzsch, Rafael Peñaloza, and Sebastian Rudolph (Eds.), Vol. 9324. Springer, 295--301.
[75]
Lisa Posch, Arnim Bleier, and Markus Strohmaier. 2017. Measuring motivations of crowdworkers: The multidimensional crowdworker motivation scale (first version). CoRR http://arxiv.org/abs/1702.01661v1 (2017).
[76]
Jakob Rogstadius, Vassilis Kostakos, Aniket Kittur, Boris Smus, Jim Laredo, and Maja Vukovic. 2011. An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. Retrieved from http://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/view/2778.
[77]
Joel Ross, Lilly Irani, M. Six Silberman, Andrew Zaldivar, and Bill Tomlinson. 2010. Who are the crowdworkers?: Shifting demographics in mechanical turk. In Proceedings of the 28th International Conference on Human Factors in Computing Systems (CHI’10), Elizabeth D. Mynatt, Don Schoner, Geraldine Fitzpatrick, Scott E. Hudson, W. Keith Edwards, and Tom Rodden (Eds.). ACM, 2863--2872.
[78]
Yves Rosseel. 2012. lavaan: An R package for structural equation modeling. J. Stat. Software 48, 2 (2012), 1--36. Retrieved from http://www.jstatsoft.org/v48/i02/.
[79]
Richard M. Ryan and James P. Connell. 1989. Perceived locus of causality and internalization: Examining reasons for acting in two domains. J. Personal. Soc. Psychol. 57, 5 (1989), 749.
[80]
Richard M. Ryan and Edward L. Deci. 2000. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemp. Edu. Psychol. 25, 1 (2000), 54--67.
[81]
Cristina Sarasua, Elena Simperl, and Natalya Fridman Noy. 2012. CrowdMap: Crowdsourcing ontology alignment with microtasks. In Proceedings of the 11th International Semantic Web Conference on the Semantic Web (ISWC’12) (Lecture Notes in Computer Science), Philippe Cudré-Mauroux, Jeff Heflin, Evren Sirin, Tania Tudorache, Jérôme Euzenat, Manfred Hauswirth, Josiane Xavier Parreira, Jim Hendler, Guus Schreiber, Abraham Bernstein, and Eva Blomqvist (Eds.), Vol. 7649. Springer, 525--541.
[82]
Albert Satorra and Peter M. Bentler. 2010. Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika 75, 2 (2010), 243--248.
[83]
semTools Contributors. 2016. semTools: Useful Tools for Structural Equation Modeling. Retrieved from http://CRAN.R-project.org/package=semTools.
[84]
Kennon M. Sheldon and Andrew J. Elliot. 1998. Not all personal goals are personal: Comparing autonomous and controlled reasons for goals as predictors of effort and attainment. Personal. Soc. Psychol. Bull. 24, 5 (1998), 546--557.
[85]
Alexander D. Stajkovic and Fred Luthans. 1997. A meta-analysis of the effects of organizational behavior modification on task performance, 1975--95. Acad. Manage. J. 40, 5 (1997), 1122--1149.
[86]
James H. Steiger. 1980. Tests for comparing elements of a correlation matrix. Psychol. Bull. 87, 2 (1980), 245.
[87]
Holger Steinmetz. 2013. Analyzing observed composite differences across groups: Is partial measurement invariance enough? Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 9, 1 (2013), 1--12.
[88]
Maxime A. Tremblay, Céline M. Blanchard, Sara Taylor, Luc G. Pelletier, and Martin Villeneuve. 2009. Work extrinsic and intrinsic motivation scale: Its value for organizational psychology research. Can. J. Behav. Sci. 41, 4 (2009), 213.
[89]
Amazon Mechanical Turk. 2018. Amazon Mechanical Turk: Worker Web Site FAQs. Retrieved from http://www.mturk.com/mturk/help?helpPage=worker#how_paid.
[90]
Robert J. Vallerand, Luc G. Pelletier, Marc R. Blais, Nathalie M. Briere, Caroline Senecal, and Evelyne F. Vallieres. 1992. The academic motivation scale: A measure of intrinsic, extrinsic, and amotivation in education. Edu. Psychol. Measure. 52, 4 (1992), 1003--1017.
[91]
Rens Van de Schoot, Peter Lugtig, and Joop Hox. 2012. A checklist for testing measurement invariance. Eur. J. Dev. Psychol. 9, 4 (2012), 486--492.
[92]
David L. Vannette and Jon A. Krosnick. 2014. A comparison of survey satisficing and mindlessness. Wiley Blackwell Handbook Mindful. 1 (2014), 312.
[93]
Roger L. Worthington and Tiffany A. Whittaker. 2006. Scale development research: A content analysis and recommendations for best practices. Counsel. Psychol. 34, 6 (2006), 806--838.

Cited By

View all
  • (2024)Analysis of Motivational Theories in Crowdsourcing Using Long Tail Theory: A Systematic Literature ReviewInternational Journal of Crowd Science10.26599/IJCS.2023.91000108:1(10-27)Online publication date: Feb-2024
  • (2024)Turkish adaptation of the state–trait anxiety inventory short version (STAIS‐5, STAIT‐5)International Journal of Nursing Practice10.1111/ijn.13304Online publication date: 25-Sep-2024
  • (2024)Designing for Sustained Motivation: A Review of Self-Determination Theory in Behaviour Change TechnologiesInteracting with Computers10.1093/iwc/iwae040Online publication date: 18-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Social Computing
ACM Transactions on Social Computing  Volume 2, Issue 2
June 2019
123 pages
EISSN:2469-7826
DOI:10.1145/3340675
Issue’s Table of Contents
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 September 2019
Accepted: 01 May 2019
Revised: 01 February 2019
Received: 01 May 2018
Published in TSC Volume 2, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Crowdsourcing
  2. crowdworkers
  3. invariance
  4. motivation
  5. scale
  6. self-determination theory
  7. validation

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,685
  • Downloads (Last 6 weeks)89
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Analysis of Motivational Theories in Crowdsourcing Using Long Tail Theory: A Systematic Literature ReviewInternational Journal of Crowd Science10.26599/IJCS.2023.91000108:1(10-27)Online publication date: Feb-2024
  • (2024)Turkish adaptation of the state–trait anxiety inventory short version (STAIS‐5, STAIT‐5)International Journal of Nursing Practice10.1111/ijn.13304Online publication date: 25-Sep-2024
  • (2024)Designing for Sustained Motivation: A Review of Self-Determination Theory in Behaviour Change TechnologiesInteracting with Computers10.1093/iwc/iwae040Online publication date: 18-Sep-2024
  • (2024)Explaining crowdworker behaviour through computational rationalityBehaviour & Information Technology10.1080/0144929X.2024.2329616(1-22)Online publication date: 24-Apr-2024
  • (2023)Satisfied with teaching? Psychometric properties of the Teaching Satisfaction ScaleAfrican Journal of Psychological Assessment10.4102/ajopa.v5i0.1405Online publication date: 6-Dec-2023
  • (2023)Anxiety in Brief: Assessment of the Five-Item Trait Scale of the State-Trait Anxiety Inventory in South AfricaInternational Journal of Environmental Research and Public Health10.3390/ijerph2009569720:9(5697)Online publication date: 1-May-2023
  • (2023)Validation of the vaccination attitudes examination scale in a South African context in relation to the COVID-19 vaccine: quantifying dimensionality with bifactor indicesBMC Public Health10.1186/s12889-023-16803-423:1Online publication date: 27-Sep-2023
  • (2023)The PSI-20: Development of a Viable Short Form Alternative of the Problem Solving Inventory Using Item Response TheorySage Open10.1177/2158244023121563313:4Online publication date: 12-Dec-2023
  • (2023)Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This MattersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581418(1-15)Online publication date: 19-Apr-2023
  • (2023)Implications and New Directions for IR Research and PracticesA Behavioral Economics Approach to Interactive Information Retrieval10.1007/978-3-031-23229-9_7(181-201)Online publication date: 18-Feb-2023
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media