Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3366423.3380200acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Becoming the Super Turker:Increasing Wages via a Strategy from High Earning Workers

Published: 20 April 2020 Publication History

Abstract

Crowd markets have traditionally limited workers by not providing transparency information concerning which tasks pay fairly or which requesters are unreliable. Researchers believe that a key reason why crowd workers earn low wages is due to this lack of transparency. As a result, tools have been developed to provide more transparency within crowd markets to help workers. However, while most workers use these tools, they still earn less than minimum wage. We argue that the missing element is guidance on how to use transparency information. In this paper, we explore how novice workers can improve their earnings by following the transparency criteria of Super Turkers, i.e., crowd workers who earn higher salaries on Amazon Mechanical Turk (MTurk). We believe that Super Turkers have developed effective processes for using transparency information. Therefore, by having novices follow a Super Turker criteria (one that is simple and popular among Super Turkers), we can help novices increase their wages. For this purpose, we: (i) conducted a survey and data analysis to computationally identify a simple yet common criteria that Super Turkers use for handling transparency tools; (ii) deployed a two-week field experiment with novices who followed this Super Turker criteria to find better work on MTurk. Novices in our study viewed over 25,000 tasks by 1,394 requesters. We found that novices who utilized this Super Turkers’ criteria earned better wages than other novices. Our results highlight that tool development to support crowd workers should be paired with educational opportunities that teach workers how to effectively use the tools and their related metrics (e.g., transparency values). We finish with design recommendations for empowering crowd workers to earn higher salaries.

References

[1]
2017. [Guide] - Welcome to the world of Mechanical Turk. Retrieved June 26, 2019 from https://forum.turkerview.com/threads/welcome-to-the-world-of-mechanical-turk.112/
[2]
aaai Fall Symosium 2019. [n.d.]. Solving AI’s last-mile problem with crowd-augmented expert work. ([n. d.]).
[3]
Janine Berg. 2015. Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers. Comp. Lab. L. & Pol’y J. 37 (2015), 543.
[4]
Janine Berg, Marianne Furrer, Ellie Harmon, Uma Rani, and M Six Silberman. 2018. Digital labour platforms and the future of work: Towards decent work in the online world. Geneva: International Labour Organization(2018).
[5]
Birgitta Bergvall-Kåreborn and Debra Howcroft. 2014. Amazon Mechanical Turk and the commodification of labour. New Technology, Work and Employment 29, 3 (2014), 213–223.
[6]
Jeffrey P Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, 2010. VizWiz: nearly real-time answers to visual questions. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 333–342.
[7]
Marko Bohanec. 2009. Decision making: A computer-science and information-technology viewpoint. Interdisciplinary Description of Complex Systems: INDECS 7, 2(2009), 22–37.
[8]
John Bohannon. 2011. Social science for pennies.
[9]
Chris Callison-Burch. 2014. Crowd-workers: Aggregating information across turkers to help them find higher paying work. In Second AAAI Conference on Human Computation and Crowdsourcing.
[10]
Krista Casler, Lydia Bickel, and Elizabeth Hackett. 2013. Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in human behavior 29, 6 (2013), 2156–2160.
[11]
Chun-Wei Chiang, Eber Betanzos, and Saiph Savage. 2018. Exploring blockchain for trustful collaborations between immigrants and governments. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–6.
[12]
Chun-Wei Chiang, Anna Kasunic, and Saiph Savage. 2018. Crowd Coach: Peer Coaching for Crowd Workers’ Skill Growth. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 37.
[13]
ChrisTurk. 2018. TurkerView. Retrieved November 4, 2018 from https://turkerview.com/
[14]
Kevin Crowston, Erica Mitchell, and Carsten Østerlund. 2019. Coordinating advanced crowd work: Extending citizen science. Citizen Science: Theory and Practice 4, 1 (2019).
[15]
Ellen Cushing. 2012. Dawn of the digital sweatshop. East Bay Express 1(2012).
[16]
Valerio De Stefano. 2015. The rise of the just-in-time workforce: On-demand work, crowdwork, and labor protection in the gig-economy. Comp. Lab. L. & Pol’y J. 37 (2015), 471.
[17]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248–255.
[18]
Dimiter M Dimitrov and Phillip D Rumrill Jr. 2003. Pretest-posttest designs and measurement of change. Work 20, 2 (2003), 159–165.
[19]
Mira Dontcheva, Robert R Morris, Joel R Brandt, and Elizabeth M Gerber. 2014. Combining crowdsourcing and learning to improve engagement and performance. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3379–3388.
[20]
Shayan Doroudi, Ece Kamar, Emma Brunskill, and Eric Horvitz. 2016. Toward a learning science for complex crowdsourcing tasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2623–2634.
[21]
Steven Dow, Anand Kulkarni, Brie Bunge, Truc Nguyen, Scott Klemmer, and Björn Hartmann. 2011. Shepherding the crowd: managing and providing feedback to crowd workers. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. ACM, 1669–1674.
[22]
Lizbeth Escobedo, David H Nguyen, LouAnne Boyd, Sen Hirano, Alejandro Rangel, Daniel Garcia-Rosas, Monica Tentori, and Gillian Hayes. 2012. MOSOCO: a mobile assistive tool to support children with autism practicing social skills in real-life situations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2589–2598.
[23]
BJ Fogg. 2009. A Behavior Model for Persuasive Design. In Proceedings of the 4th International Conference on Persuasive Technology(Persuasive ’09). ACM, New York, NY, USA, Article 40, 7 pages. https://doi.org/10.1145/1541948.1541999
[24]
Ernest H Forman. 1990. Multi criteria decision making and the analytic hierarchy process. In Readings in multiple criteria decision aid. Springer, 295–318.
[25]
Ujwal Gadiraju, Alessandro Checco, Neha Gupta, and Gianluca Demartini. 2017. Modus operandi of crowd workers: The invisible role of microtask work environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–29.
[26]
Ujwal Gadiraju and Gianluca Demartini. 2019. Understanding Worker Moods and Reactions to Rejection in Crowdsourcing. In Proceedings of the 30th ACM Conference on Hypertext and Social Media. 211–220.
[27]
Ujwal Gadiraju, Besnik Fetahu, and Ricardo Kawase. 2015. Training workers for improving performance in crowdsourcing microtasks. In Design for Teaching and Learning in a Networked World. Springer, 100–114.
[28]
Mary Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass.
[29]
Lei Han, Kevin Roitero, Ujwal Gadiraju, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, and Gianluca Demartini. 2019. All Those Wasted Hours: On Task Abandonment in Crowdsourcing. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. ACM, 321–329.
[30]
Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, and Jeffrey P Bigham. 2018. A Data-Driven Analysis of Workers’ Earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 449.
[31]
Ellie Harmon and M Six Silberman. 2018. Rating working conditions on digital labor platforms. Computer Supported Cooperative Work (CSCW) 27, 3-6 (2018), 1275–1324.
[32]
Paul Hitlin. 2016. Research in the crowdsourcing age, a case study. Pew Research Center 11(2016).
[33]
Sara Horowitz. 2015. The Costs of Nonpayment. Retrieved June 26, 2019 from https://blog.freelancersunion.org/2015/12/10/costs-nonpayment/
[34]
John J Horton. 2011. The condition of the Turking class: Are online employers fair and honest?Economics Letters 111, 1 (2011), 10–12.
[35]
John Joseph Horton and Lydia B Chilton. 2010. The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM conference on Electronic commerce. ACM, 209–218.
[36]
Ting-Hao Kenneth Huang, Joseph Chee Chang, and Jeffrey P Bigham. 2018. Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 295.
[37]
International Labour Office (ILO). 2016. Non-standard employment around the world: Understanding challenges, shaping prospects.
[38]
Panagiotis G Ipeirotis. 2010. Mechanical Turk, low wages, and the market for lemons. A Computer Scientist in a Business School 27 (2010).
[39]
Lilly C Irani and M Silberman. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 611–620.
[40]
Lilly C Irani and M Silberman. 2016. Stories we tell about labor: Turkopticon and the trouble with design. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 4573–4586.
[41]
Mohammad Hossein Jarrahi and Will Sutherland. 2019. Algorithmic Management and Algorithmic Competencies: Understanding and Appropriating Algorithms in Gig work. In International Conference on Information. Springer, 578–589.
[42]
Mohammad Hossein Jarrahi, Will Sutherland, Sarah Beth Nelson, and Steve Sawyer. 2019. Platformic Management, Boundary Resources for Gig Work, and Worker Autonomy. Computer Supported Cooperative Work (CSCW)(2019), 1–37.
[43]
Tao Jiang and Ming Li. 1995. On the approximation of shortest common supersequences and longest common subsequences. SIAM J. Comput. 24, 5 (1995), 1122–1139.
[44]
Toni Kaplan, Susumu Saito, Kotaro Hara, and Jeffrey P Bigham. 2018. Striving to Earn More: A Survey of Work Strategies and Tool Use Among Crowd Workers. In HCOMP. 70–78.
[45]
N Kasperczyk and K Knickel. 1996. The analytic hierarchy process (AHP). Retrieved from (1996).
[46]
Otto Kässi and Vili Lehdonvirta. 2018. Online labour index: Measuring the online gig economy for policy and research. Technological forecasting and social change 137 (2018), 241–248.
[47]
Anna Kasunic, Chun-Wei Chiang, Geoff Kaufman, and Saiph Savage. 2019. Crowd Work on a CV? Understanding How AMT Fits into Turkers’ Career Goals and Professional Profiles. arXiv preprint arXiv:1902.05361(2019).
[48]
Miranda Katz. 2017. Amazon Mechanical Turk Workers Have Had Enough. https://www.wired.com/story/amazons-turker-crowd-has-had-enough/
[49]
Nicolas Kaufmann, Thimo Schulze, and Daniel Veit. 2011. More than fun and money. Worker Motivation in Crowdsourcing-A Study on Mechanical Turk. In AMCIS, Vol. 11. Detroit, Michigan, USA, 1–11.
[50]
PM Krafft, Meg Young, Michael Katell, Karen Huang, and Ghislain Bugingo. 2019. Defining AI in Policy versus Practice. arXiv preprint arXiv:1912.11095(2019).
[51]
Siou Chew Kuek, Cecilia Paradi-Guilford, Toks Fayomi, Saori Imaizumi, Panos Ipeirotis, Patricia Pina, and Manpreet Singh. 2015. The global opportunity in online outsourcing. (2015).
[52]
Airi Lampinen and Coye Cheshire. 2016. Hosting via Airbnb: Motivations and financial assurances in monetized network hospitality. In Proceedings of the 2016 CHI conference on human factors in computing systems. 1669–1680.
[53]
Laura Lascau, Sandy JJ Gould, Anna L Cox, Elizaveta Karmannaya, and Duncan P Brumby. 2019. Monotasking or Multitasking: Designing for Crowdworkers’ Preferences. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.
[54]
Claudia López, Rosta Farzan, and Yu-Ru Lin. 2017. Behind the myths of citizen participation: Identifying sustainability factors of hyper-local information systems. ACM Transactions on Internet Technology (TOIT) 18, 1 (2017), 1–28.
[55]
S Lynch, A Blase, A Wimms, L Erikli, A Benjafield, C Kelly, and L Willes. 2015. Retrospective descriptive study of CPAP adherence associated with use of the ResMed myAir application. Available at:) ResMed Science Center, ResMed Ltd, Sydney (Australia) (2015).
[56]
David Martin, Benjamin V Hanrahan, Jacki O’Neill, and Neha Gupta. 2014. Being a turker. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 224–235.
[57]
Brian McInnis, Dan Cosley, Chaebong Nam, and Gilly Leshed. 2016. Taking a HIT: Designing around rejection, mistrust, risk, and workers’ experiences in Amazon Mechanical Turk. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 2271–2282.
[58]
IG Metall. 2016. Frankfurt paper on platform-based work—Proposals for platform operators, clients, policy makers, workers, and worker organizations. IG Metall, Frankfurt(2016).
[59]
U.S. Department of Labor. [n.d.]. Breaks and Meal Periods. https://www.dol.gov/general/topic/workhours/breaks
[60]
Sunghyun Park, Philippa Shoemark, and Louis-Philippe Morency. 2014. Toward crowdsourcing micro-level behavior annotations: the challenges of interface, training, and generalization. In Proceedings of the 19th international conference on Intelligent User Interfaces. ACM, 37–46.
[61]
John W Payne, James R Bettman, and Mary Frances Luce. 1996. When time is money: Decision behavior under opportunity-cost time pressure. Organizational behavior and human decision processes 66, 2 (1996), 131–152.
[62]
Adam M Persky and Jennifer D Robinson. 2017. Moving from novice to expertise and its implications for instruction. American journal of pharmaceutical education 81, 9 (2017), 6065.
[63]
Nagrale Pritam. 2017. An Ultimate Guide to Making Money with Amazon mTurk. Retrieved June 26, 2019 from https://moneyconnexion.com/mturk-guide-to-make-money.htm
[64]
Jason Radford, Andy Pilny, Ashley Reichelmann, Brian Keegan, Brooke Foucault Welles, Jefferson Hoye, Katherine Ognyanova, Waleed Meleis, and David Lazer. 2016. Volunteer science: An online laboratory for experiments in social psychology. Social Psychology Quarterly 79, 4 (2016), 376–396.
[65]
Joel Ross, Lilly Irani, M Silberman, Andrew Zaldivar, and Bill Tomlinson. 2010. Who are the crowdworkers?: shifting demographics in mechanical turk. In CHI’10 extended abstracts on Human factors in computing systems. ACM, 2863–2872.
[66]
Susumu Saito, Chun-Wei Chiang, Saiph Savage, Teppei Nakano, Tetsunori Kobayashi, and Jeffrey Bigham. 2019. TurkScanner: Predicting the Hourly Wage of Microtasks. arXiv preprint arXiv:1903.07032(2019).
[67]
Niloufar Salehi, Lilly C Irani, Michael S Bernstein, Ali Alkhatib, Eva Ogbe, Kristy Milland, 2015. We are dynamo: Overcoming stalling and friction in collective action for crowd workers. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 1621–1630.
[68]
Shruti Sannon and Dan Cosley. 2019. Privacy, Power, and Invisible Labor on Amazon Mechanical Turk. (2019).
[69]
Saiph Savage, Andres Monroy-Hernandez, and Tobias Höllerer. 2016. Botivist: Calling volunteers to action using online bots. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. 813–822.
[70]
Rustam Shadiev, Wu-Yuin Hwang, Shih-Ching Yeh, Stephen JH Yang, Jing-Liang Wang, Lin Han, and Guo-Liang Hsu. 2014. Effects of unidirectional vs. reciprocal teaching strategies on web-based computer programming learning. Journal of educational computing research 50, 1 (2014), 67–95.
[71]
M Six Silberman and IG Metall. 2009. Fifteen criteria for a fairer gig economy. Democratization 61, 4 (2009), 589–622.
[72]
M Six Silberman, Bill Tomlinson, Rochelle LaPlante, Joel Ross, Lilly Irani, and Andrew Zaldivar. 2018. Responsible research with crowds: pay crowdworkers at least minimum wage.Commun. ACM 61, 3 (2018), 39–41.
[73]
Joseph E Stiglitz. 2000. The contributions of the economics of information to twentieth century economics. The quarterly journal of economics 115, 4 (2000), 1441–1478.
[74]
Marilyn Strathern. 2000. The tyranny of transparency. British educational research journal 26, 3 (2000), 309–321.
[75]
Ryo Suzuki, Niloufar Salehi, Michelle S Lam, Juan C Marroquin, and Michael S Bernstein. 2016. Atelier: Repurposing expert crowdsourcing tasks as micro-internships. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2645–2656.
[76]
Wade M Vagias. 2006. Likert-type scale response anchors. clemson international institute for tourism. & Research Development, Department of Parks, Recreation and Tourism Management, Clemson University(2006).
[77]
Omkarprasad S Vaidya and Sushil Kumar. 2006. Analytic hierarchy process: An overview of applications. European Journal of operational research 169, 1 (2006), 1–29.
[78]
Donna Vakharia and Matthew Lease. 2015. Beyond Mechanical Turk: An analysis of paid crowd work platforms. Proceedings of the iConference(2015), 1–17.
[79]
Mark E Whiting, Grant Hugh, and Michael S Bernstein. 2019. Fair Work: Crowd Work Minimum Wage with One Line of Code. (2019).
[80]
Alex C Williams, Gloria Mark, Kristy Milland, Edward Lank, and Edith Law. 2019. The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–28.
[81]
Man-Ching Yuen, Irwin King, and Kwong-Sak Leung. 2012. Task recommendation in crowdsourcing systems. In Proceedings of the first international workshop on crowdsourcing and data mining. ACM, 22–26.

Cited By

View all
  • (2024)Work Schedules, Finances, and Freedom: Work Schedule Fit and Platform Dependence among Gig Workers on Amazon’s Mechanical Turk PlatformSocius: Sociological Research for a Dynamic World10.1177/2378023124128693310Online publication date: 17-Oct-2024
  • (2024)El costo de la independencia: Latino house-cleaners in Technology-Mediated Labour MarketsProceedings of the ACM on Human-Computer Interaction10.1145/36869998:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work StylesProceedings of the ACM on Human-Computer Interaction10.1145/36868998:CSCW2(1-34)Online publication date: 8-Nov-2024
  • Show More Cited By

Index Terms

  1. Becoming the Super Turker:Increasing Wages via a Strategy from High Earning Workers
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '20: Proceedings of The Web Conference 2020
    April 2020
    3143 pages
    ISBN:9781450370233
    DOI:10.1145/3366423
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    WWW '20
    Sponsor:
    WWW '20: The Web Conference 2020
    April 20 - 24, 2020
    Taipei, Taiwan

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)47
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Work Schedules, Finances, and Freedom: Work Schedule Fit and Platform Dependence among Gig Workers on Amazon’s Mechanical Turk PlatformSocius: Sociological Research for a Dynamic World10.1177/2378023124128693310Online publication date: 17-Oct-2024
    • (2024)El costo de la independencia: Latino house-cleaners in Technology-Mediated Labour MarketsProceedings of the ACM on Human-Computer Interaction10.1145/36869998:CSCW2(1-32)Online publication date: 8-Nov-2024
    • (2024)A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work StylesProceedings of the ACM on Human-Computer Interaction10.1145/36868998:CSCW2(1-34)Online publication date: 8-Nov-2024
    • (2024)Designing Gig Worker Sousveillance ToolsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642614(1-19)Online publication date: 11-May-2024
    • (2024)Expecting to integrate additional information improves averaging of experienceScientific Reports10.1038/s41598-024-67369-z14:1Online publication date: 18-Jul-2024
    • (2023)“Sometimes It’s Like Putting the Track in Front of the Rushing Train”: Having to Be ‘On Call’ for Work Limits the Temporal Flexibility of CrowdworkersACM Transactions on Computer-Human Interaction10.1145/363514531:2(1-45)Online publication date: 4-Dec-2023
    • (2023)La Independiente: Designing Ubiquitous Systems for Latin American and Caribbean Women CrowdworkersAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610728(404-406)Online publication date: 8-Oct-2023
    • (2023)Creator-friendly Algorithms: Behaviors, Challenges, and Design Opportunities in Algorithmic PlatformsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581386(1-22)Online publication date: 19-Apr-2023
    • (2023)Combining Worker Factors for Heterogeneous Crowd Task AssignmentProceedings of the ACM Web Conference 202310.1145/3543507.3583190(3794-3805)Online publication date: 30-Apr-2023
    • (2023)Do you see what I see? A social capital perspective on microtask gig worker opportunity recognition within electronic networks of practiceInternational Journal of Information Management10.1016/j.ijinfomgt.2022.10261569(102615)Online publication date: Apr-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media