Explorable Explainable AI: Improving AI Understanding for Community Health Workers in India
Authors: 
Ian René Solano-Kamaiko, Dibyendu Mishra, Nicola Dell, and 
Aditya VashisthaAuthors Info & Claims
Ian René Solano-Kamaiko, Dibyendu Mishra, Nicola Dell, and Aditya VashisthaAuthors Info & ClaimsMay 2024
Article No.: 399, Pages 1 - 21
Abstract
AI technologies are increasingly deployed to support community health workers (CHWs) in high-stakes healthcare settings, from malnutrition diagnosis to diabetic retinopathy. Yet, little is known about how such technologies are understood by CHWs with low digital literacy and what can be done to make AI more understandable for them. This paper examines the potential of explorable explanations in improving AI understanding for CHWs in rural India. Explorable explanations integrate visual heuristics and written explanations to promote active learning. We conducted semi-structured interviews with CHWs who interacted with a design probe in which AI predictions of child malnutrition were accompanied by explorable explanations. Our findings show that explorable explanations shift CHWs’ AI-related folk theories, help develop a more nuanced understanding of AI, augment CHWs’ learning and occupational capabilities, and enhance their ability to contest AI decisions. We also uncover the effects of CHWs’ sociopolitical environments on AI understanding and argue for a more holistic conception of AI explainability that goes beyond cognition and literacy.
Supplemental Material
MP4 File - Video Presentation
Video Presentation
- Download
- 22.69 MB
- Transcript
References
[1]
2023. Child Growth Monitor: Using AI to solve world hunger and malnutrition. https://news.microsoft.com/en-in/features/child-growth-monitor-malnutrition-india-microsoft-ai/
[2]
2023. Integrated Child Development Services - ICDS Scheme | Ministry of Women & Child Development|IN|tydnz — wcd.nic.in. https://wcd.nic.in/integrated-child-development-services-icds-scheme. [Accessed 06-12-2023].
[3]
2023. Malnutrition. https://www.who.int/health-topics/malnutrition
[4]
2023. The WHO Child Growth Standards. https://www.who.int/tools/child-growth-standards/standards
[5]
NITI Aayog. 2018. National Strategy for Artificial Intelligence.
[6]
NITI Aayog. 2021. Principles of Responsible AI.
[7]
Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y Lim, and Mohan Kankanhalli. 2018. Trends and trajectories for explainable, accountable and intelligible systems: An hci research agenda. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–18.
[8]
A Ali, AA Raza, and IA Qazi. 2023. Validated digital literacy measures for populations with low levels of internet experiences. Development Engineering, 8, 100107.
[9]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 chi conference on human factors in computing systems. 1–13.
[10]
Plamen P Angelov, Eduardo A Soares, Richard Jiang, Nicholas I Arnold, and Peter M Atkinson. 2021. Explainable artificial intelligence: an analytical review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 11, 5 (2021), e1424.
[11]
Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, Richard Benjamins, 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information fusion 58 (2020), 82–115.
[12]
Andrew Bell, Oded Nov, and Julia Stoyanovich. 2023. Think about the stakeholders first! Toward an algorithmic transparency playbook for regulatory compliance. Data & Policy 5 (2023), e12.
[13]
Andrew Bell, Ian Solano-Kamaiko, Oded Nov, and Julia Stoyanovich. 2022. It’s just not that simple: an empirical study of the accuracy-explainability trade-off in machine learning for public policy. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 248–266.
[14]
Umang Bhatt, Alice Xiang, Shubham Sharma, Adrian Weller, Ankur Taly, Yunhan Jia, Joydeep Ghosh, Ruchir Puri, José MF Moura, and Peter Eckersley. 2020. Explainable machine learning in deployment. In Proceedings of the 2020 conference on fairness, accountability, and transparency. 648–657.
[15]
Ayushi Bhotica. 2021. Building Our Anthropometry Solution, One Field Visit At a Time. https://www.wadhwaniai.org/2021/02/building-our-anthropometry-solution-one-field-visit-at-a-time/
[16]
Abeba Birhane, William Samuel Isaac, Vinodkumar Prabhakaran, Mark Díaz, Madeleine Clare Elish, Iason Gabriel, and Shakir Mohamed. 2022. Frameworks and Challenges to Participatory AI. https://arxiv.org/pdf/2209.07572.pdf
[17]
Kirsten Boehner, Janet Vertesi, Phoebe Sengers, and Paul Dourish. 2007. How HCI interprets the probes. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1077–1086.
[18]
G Braun. 1977. Using thematic analysis in psychology. Using thematic analysis in psychology 3, 10 (Oct. 1977), 77–83.
[19]
Bill Briggs. 2019. How technology can speed help to malnourished children in the effort to end global hunger. https://news.microsoft.com/transform/app-end-global-hunger/
[20]
Peter Brusilovsky. 1994. Explanatory visualization in an educational programming environment: connecting examples with general knowledge. In Human-Computer Interaction: 4th International Conference, EWHCI’94 St. Petersburg, Russia August 2–5, 1994 Selected Papers 4. Springer, 202–212.
[21]
Zana Buçinca, Maja Barbara Malaya, and Krzysztof Z Gajos. 2021. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–21.
[22]
[22] Poshan Calculator. 2023. https://www.poshantracker.in/PTCalculator[Accessed 09-14-2023].
[23]
Ahmad Chaddad, Jihao Peng, Jian Xu, and Ahmed Bouridane. 2023. Survey of explainable AI techniques in healthcare. Sensors 23, 2 (2023), 634.
[24]
Elizabeth Charters. 2003. The Use of Think-aloud Methods in Qualitative Research An Introduction to Think-aloud Methods. Brock Education Journal 12, 2 (July 2003).
[25]
Irene Y Chen, Shalmali Joshi, and Marzyeh Ghassemi. 2020. Treating health disparities with artificial intelligence. Nature medicine 26, 1 (2020), 16–17.
[26]
Padma Chirumamilla and Joyojeet Pal. 2013. Play and Power: A Ludic Design Proposal for ICTD. In Proceedings of the Sixth International Conference on Information and Communication Technologies and Development: Full Papers - Volume 1 (Cape Town, South Africa) (ICTD ’13). Association for Computing Machinery, New York, NY, USA, 25–33. https://doi.org/10.1145/2516604.2516628
[27]
Neil Chulpongsatorn, Mille Skovhus Lunding, Nishan Soni, and Ryo Suzuki. 2023. Augmented Math: Authoring AR-Based Explorable Explanations by Augmenting Static Math Textbooks. arXiv preprint arXiv:2307.16112 (2023).
[28]
Comptroller and Auditor General of India (CAG). 2012–2013. Performance Audit of Integrated Child Development Services(ICDS) Scheme. https://cag.gov.in/uploads/download_audit_report/2012/Union_Performance_Civil_ICDS_Scheme%20_Ministry_Women_Child%20Development_22_2012.pdf
[29]
Matthew Conlen and Jeffrey Heer. 2022. Fidyll: A Compiler for Cross-Format Data Stories & Explorable Explanations. arXiv preprint arXiv:2205.09858 (2022).
[30]
Matthew Conlen, Megan Vo, Alan Tan, and Jeffrey Heer. 2021. Idyll studio: A structured editor for authoring interactive & data-driven articles. In The 34th Annual ACM Symposium on User Interface Software and Technology. 1–12.
[31]
Ian Covert, Scott M Lundberg, and Su-In Lee. 2020. Understanding global feature contributions with additive importance measures. Advances in Neural Information Processing Systems 33 (2020), 17212–17223.
[32]
Henriette Cramer, Vanessa Evers, Satyan Ramlal, Maarten Van Someren, Lloyd Rutledge, Natalia Stash, Lora Aroyo, and Bob Wielinga. 2008. The effects of transparency on trust in and acceptance of a content-based art recommender. User Modeling and User-adapted interaction 18 (2008), 455–496.
[33]
Nicola Dell, Jessica Crawford, Nathan Breit, Timóteo Chaluco, Aida Coelho, Joseph McCord, and Gaetano Borriello. 2013. Integrating ODK Scan into the community health worker supply chain in Mozambique. In Proceedings of the Sixth International Conference on Information and Communication Technologies and Development: Full Papers-Volume 1. 228–237.
[34]
Brian DeRenzi, Nicola Dell, Jeremy Wacksman, Scott Lee, and Neal Lesh. 2017. Supporting community health workers in India through voice-and web-based feedback. In Proceedings of the 2017 CHI conference on human factors in computing systems. 2770–2781.
[35]
Brian DeRenzi, Neal Lesh, Tapan Parikh, Clayton Sims, Werner Maokla, Mwajuma Chemba, Yuna Hamisi, David S hellenberg, Marc Mitchell, and Gaetano Borriello. 2008. E-IMCI: Improving pediatric health care in low-income countries. In Proceedings of the SIGCHI conference on human factors in computing systems. 753–762.
[36]
Michael Ann DeVito. 2021. Adaptive Folk Theorization as a Path to Algorithmic Literacy on Changing Platforms. Proc. ACM Hum.-Comput. Interact. 5, CSCW2 (Oct. 2021), 1–38.
[37]
Leyla Dogruel. 2021. Folk theories of algorithmic operations during Internet use: A mixed methods study. The Information Society 37, 5 (2021), 287–298.
[38]
Upol Ehsan and Mark O. Riedl. 2020. Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach. In HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence: 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings (Copenhagen, Denmark). Springer-Verlag, Berlin, Heidelberg, 449–466. https://doi.org/10.1007/978-3-030-60117-1_33
[39]
Upol Ehsan, Philipp Wintersberger, Q Vera Liao, Martina Mara, Marc Streit, Sandra Wachter, Andreas Riener, and Mark O Riedl. 2021. Operationalizing human-centered perspectives in explainable AI. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–6.
[40]
[40] Figma. 2023. https://www.figma.com/. [Accessed 09-14-2023].
[41]
Jesper Hyldahl Fogh. 2018. Explorable Explanations: What are they? What do they explain? How do we work with them? Let’s find out.
[42]
U.S.Agency for International Development. 2019. Artificial Intelligence in Global Health: Defining a Collective Path Forward. https://www.usaid.gov/cii/ai-inglobal-
[43]
Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Design: cultural probes. interactions 6, 1 (1999), 21–29.
[44]
Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R Millen, Murray Campbell, Sadhana Kumaravel, and Wei Zhang. 2020. Mental Models of AI Agents in a Cooperative Game Setting. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12.
[45]
Marzyeh Ghassemi, Luke Oakden-Rayner, and Andrew L Beam. 2021. The false hope of current approaches to explainable artificial intelligence in health care. The Lancet Digital Health 3, 11 (2021), e745–e750.
[46]
David Gunning, Mark Stefik, Jaesik Choi, Timothy Miller, Simone Stumpf, and Guang-Zhong Yang. 2019. XAI—Explainable artificial intelligence. Science robotics 4, 37 (2019), eaay7120.
[47]
Donna Haraway. 2020. Situated knowledges: The science question in feminism and the privilege of partial perspective. In Feminist theory reader. Routledge, 303–310.
[48]
Fred Hohman, Andrew Head, Rich Caruana, Robert DeLine, and Steven M Drucker. 2019. Gamut: A design probe to understand how data scientists understand machine learning models. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.
[49]
Fred Hohman, Minsuk Kahng, Robert Pienta, and Duen Horng Chau. 2018. Visual analytics in deep learning: An interrogative survey for the next frontiers. IEEE transactions on visualization and computer graphics 25, 8 (2018), 2674–2693.
[50]
Andreas Holzinger, Anna Saranti, Christoph Molnar, Przemyslaw Biecek, and Wojciech Samek. 2020. Explainable AI methods-a brief overview. In International Workshop on Extending Explainable AI Beyond Deep Models and Classifiers. Springer, 13–38.
[51]
Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, 2003. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems. 17–24.
[52]
IIPS and MacroInternational. 2019–21. National Family Health Survey (NFHS–5). http://rchiips.org/nfhs/NFHS-5Reports/NFHS-5_INDIA_REPORT.pdf
[53]
Azra Ismail and Neha Kumar. 2019. Empowerment on the margins: The online experiences of community health workers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–15.
[54]
Azra Ismail and Neha Kumar. 2021. AI in Global Health: The View from the Front Lines. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 598, 21 pages. https://doi.org/10.1145/3411764.3445130
[55]
Azra Ismail, Deepika Yadav, Meghna Gupta, Kirti Dabas, Pushpendra Singh, and Neha Kumar. 2022. Imagining Caring Futures for Frontline Health Work. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 480 (nov 2022), 30 pages. https://doi.org/10.1145/3555581
[56]
Astha Jain, Radhika Krishnan, Ashwini Rogye, and Sundaram Natarajan. 2021. Use of offline artificial intelligence in a smartphone-based fundus camera for community screening of diabetic retinopathy. Indian Journal of Ophthalmology 69, 11 (2021), 3150.
[57]
Fei Jiang, Yong Jiang, Hui Zhi, Yi Dong, Hao Li, Sufeng Ma, Yilong Wang, Qiang Dong, Haipeng Shen, and Yongjun Wang. 2017. Artificial intelligence in healthcare: past, present and future. Stroke and vascular neurology 2, 4 (2017).
[58]
Daniel Kahneman. 2011. Thinking, fast and slow. macmillan.
[59]
Minsuk Kahng and Duen Horng Polo Chau. 2020. How does visualization help people learn deep learning? Evaluating GAN Lab with observational study and log analysis. In 2020 IEEE Visualization Conference (VIS). IEEE, 266–270.
[60]
Christie Kodama, Beth St. Jean, Mega Subramaniam, and Natalie Greene Taylor. 2017. There’s a creepy guy on the other end at Google!: engaging middle school students in a drawing activity to elicit their mental models of Google. Information Retrieval Journal 20, 5 (Oct. 2017), 403–432.
[61]
Jude Dzevela Kong, Ugochukwu Ejike Akpudo, Jake Okechukwu Effoduh, and Nicola Luigi Bragazzi. 2023. Leveraging Responsible, Explainable, and Local Artificial Intelligence Solutions for Clinical Public Health in the Global South. Healthc. Pap. 11, 4 (Feb. 2023), 457.
[62]
Sneha Krishnan. 2022. Exploring female frontline health workers’ role and capacities in COVID-19 response in India. International Journal of Disaster Risk Reduction 75 (2022), 102962.
[63]
Todd Kulesza, Simone Stumpf, Margaret Burnett, Sherry Yang, Irwin Kwan, and Weng-Keen Wong. 2013. Too much, too little, or just right? Ways explanations impact end users’ mental models. In 2013 IEEE Symposium on Visual Languages and Human Centric Computing. 3–10.
[64]
Neha Kumar, Trevor Perrier, Michelle Desmond, Kiersten Israel-Ballard, Vikrant Kumar, Sudip Mahapatra, Anil Mishra, Shreya Agarwal, Rikin Gandhi, Pallavi Lal, 2015. Projecting health: community-led video education for maternal health. In Proceedings of the Seventh International Conference on Information and Communication Technologies and Development. 1–10.
[65]
Tzu-Sheng Kuo, Hong Shen, Jisoo Geum, Nev Jones, Jason I. Hong, Haiyi Zhu, and Kenneth Holstein. 2023. Understanding Frontline Workers’ and Unhoused Individuals’ Perspectives on AI Used in Homeless Services. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 860, 17 pages. https://doi.org/10.1145/3544548.3580882
[66]
Shahid Latif, Hagen Tarner, and Fabian Beck. 2021. Talking realities: Audio guides in virtual reality visualizations. IEEE Computer Graphics and Applications 42, 1 (2021), 73–83.
[67]
Sam Lau and Philip J Guo. 2020. Data Theater: A live programming environment for prototyping data-driven explorable explanations. In Workshop on Live Programming (LIVE).
[68]
Justin Li. 2018. Explorable Web Apps to Teach AI to Non-Majors. (2018).
[69]
Q Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–15.
[70]
Q Vera Liao and Kush R Varshney. 2022. Human-Centered Explainable AI (XAI): From Algorithms to User Experiences.
[71]
Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau, Klaus Opwis, and Katharina Reinecke. 2021. How WEIRD is CHI?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 143, 14 pages. https://doi.org/10.1145/3411764.3445488
[72]
Jordan A Litman. 2008. Interest and deprivation factors of epistemic curiosity. Personality and individual differences 44, 7 (2008), 1585–1595.
[73]
Hui Wen Loh, Chui Ping Ooi, Silvia Seoni, Prabal Datta Barua, Filippo Molinari, and U Rajendra Acharya. 2022. Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011–2022). Computer Methods and Programs in Biomedicine (2022), 107161.
[74]
Duri Long and Brian Magerko. 2020. What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–16.
[75]
Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. Advances in neural information processing systems 30 (2017).
[76]
Prashan Madumal, Tim Miller, Liz Sonenberg, and Frank Vetere. 2019. A grounded interaction protocol for explainable artificial intelligence. arXiv preprint arXiv:1903.02409 (2019).
[77]
BIPASHA MAITY. 2016. Interstate Differences in the Performance of "Anganwadi" Centres under ICDS Scheme. Economic and Political Weekly 51, 51 (2016), 59–66. http://www.jstor.org/stable/44166205
[78]
Aditya Mate, Andrew Perrault, and Milind Tambe. 2021. Risk-Aware Interventions in Public Health: Planning with Restless Multi-Armed Bandits. In AAMAS. 880–888.
[79]
Niharikareddy Meenigea and Venkata Ravi Kiran Kolla. 2023. Exploring the Current Landscape of Artificial Intelligence in Healthcare. International Journal of Sustainable Development in Computing Science 1, 1 (2023).
[80]
Syeda Shaizadi Meraj, Razali Yaakob, Azreen Azman, Siti Nuralain Mohd Rum, and AS Ahmad Nazri. 2019. Artificial intelligence in diagnosing tuberculosis: a review. International Journal on Advanced Science, Engineering and Information Technology 9, 1 (2019), 81–91.
[81]
Gloria J Miller. 2022. Stakeholder roles in artificial intelligence projects. Project Leadership and Society 3 (2022), 100068.
[82]
Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence 267 (2019), 1–38.
[83]
Joy Ming, Srujana Kamath, Elizabeth Kuo, Madeline Sterling, Nicola Dell, and Aditya Vashistha. 2022. Invisible Work in Two Frontline Health Contexts. In Proceedings of the 5th ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies(COMPASS ’22). Association for Computing Machinery, New York, NY, USA, 139–151. https://doi.org/10.1145/3530190.3534814
[84]
Pavitra Mohan and Raman Kumar. 2019. Strengthening primary care in rural India: Lessons from Indian and global evidence and experience. Journal of Family Medicine and Primary Care 8, 7 (2019), 2169.
[85]
Maletsabisa Molapo, Melissa Densmore, and Limpho Morie. 2016. Designing with community health workers: enabling productive participation through exploration. In Proceedings of the First African Conference on Human Computer Interaction. 58–68.
[86]
Patrick Mussel. 2010. Epistemic curiosity and related constructs: Lacking evidence of discriminant validity. Personality and Individual Differences 49, 5 (2010), 506–510.
[87]
Lisa Charlotte Muth. 2018. “The reward of interacting is understanding” — blog.datawrapper.de. https://blog.datawrapper.de/interview-maarten/. [Accessed 27-08-2023].
[88]
Amanda N. Curtis. 2022. Interactive Research Artifacts: Interactive Technologies as Tools for Knowledge Creation. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–5.
[89]
Donald A Norman. 2014. Some observations on mental models. In Mental models. Psychology Press, 15–22.
[90]
Mahsan Nourani, Chiradeep Roy, Jeremy E Block, Donald R Honeycutt, Tahrima Rahman, Eric Ragan, and Vibhav Gogate. 2021. Anchoring bias affects mental model formation and user reliance in explainable AI systems. In 26th International Conference on Intelligent User Interfaces. 340–350.
[91]
Ministry of Women and Child Development. 2018. Information Computers Technology Enabled Real Time Monitoring of Schemes (ICT-RTM)., 9–12 pages. https://wcd.nic.in/sites/default/files/Administrative_Guidelines_NNM-26022018.pdf
[92]
Chinasa T Okolo, Nicola Dell, and Aditya Vashistha. 2022. Making AI Explainable in the Global South: A Systematic Review. In ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) (Seattle, WA, USA) (COMPASS ’22). Association for Computing Machinery, New York, NY, USA, 439–452.
[93]
Chinasa T. Okolo, Srujana Kamath, Nicola Dell, and Aditya Vashistha. 2021. “It Cannot Do All of My Work”: Community Health Worker Perceptions of AI-Enabled Mobile Health Applications in Rural India. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 701, 20 pages. https://doi.org/10.1145/3411764.3445420
[94]
World Health Organization. 2021. Ethics & Governance of Artificial Intelligence for Health: WHO guidance. https://www.who.int/publications/i/item/9789240029200. [Accessed 17-08-2023].
[95]
World Health Organization 2021. Fact sheets—malnutrition. World Health Organization [Internet] (2021).
[96]
Joyojeet Pal, Anjuli Dasika, Ahmad Hasan, Jackie Wolf, Nick Reid, Vaishnav Kameswaran, Purva Yardi, Allyson Mackay, Abram Wagner, Bhramar Mukherjee, Sucheta Joshi, Sujay Santra, and Priyamvada Pandey. 2017. Changing Data Practices for Community Health Workers: Introducing Digital Data Collection in West Bengal, India. In Proceedings of the Ninth International Conference on Information and Communication Technologies and Development (Lahore, Pakistan) (ICTD ’17). Association for Computing Machinery, New York, NY, USA, Article 17, 12 pages. https://doi.org/10.1145/3136560.3136582
[97]
Rajni PALRIWALA and N. NEETHA. 2010. Care arrangements and bargains: Anganwadi and paid domestic workers in India. International Labour Review 149, 4 (2010), 511–527. https://doi.org/10.1111/j.1564-913X.2010.00101.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1564-913X.2010.00101.x
[98]
Chunjong Park, Alex Mariakakis, Jane Yang, Diego Lassala, Yasamba Djiguiba, Youssouf Keita, Hawa Diarra, Beatrice Wasunna, Fatou Fall, Marème Soda Gaye, Bara Ndiaye, Ari Johnson, Isaac Holeman, and Shwetak Patel. 2020. Supporting Smartphone-Based Image Capture of Rapid Diagnostic Tests in Low-Resource Settings(ICTD ’20). Association for Computing Machinery, New York, NY, USA, Article 2, 11 pages. https://doi.org/10.1145/3392561.3394630
[99]
Sun Young Park, Pei-Yi Kuo, Andrea Barbarin, Elizabeth Kaziunas, Astrid Chow, Karandeep Singh, Lauren Wilcox, and Walter S Lasecki. 2019. Identifying challenges and opportunities in human-AI collaboration in healthcare. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 506–510.
[100]
Stewart Patrick and Alexandra Huggins. 2023. The Term “Global South” Is Surging. It Should Be Retired. (2023).
[101]
Govt. Of Uttar Pradesh. 2023. Bal Vikas Seva Evam Pushtahar Vibhag. https://www.icdsup.net/e-book [Accessed 09-14-2023].
[102]
Geraldine A Price. 2013. Creative solutions to making the technology work: three case studies of dyslexic writers in higher education. In Approaches to Developing Accessible Learning Experiences. Routledge, 21–38.
[103]
Divya Ramachandran, John Canny, Prabhu Dutta Das, and Edward Cutrell. 2010. Mobile-izing health workers in rural India. In Proceedings of the SIGCHI conference on human factors in computing systems. 1889–1898.
[104]
Jenisa Ramprasad, Lakshmi Krishnan, Charitha Gangadharan, Gargi Deshpande, Himanshu Madhu, Siva Teja Kakileti, and Geetha Manjunath. 2022. Performance of artificial intelligence-based breast cancer screening in a community setting: a real-world evaluation study. The Lancet Oncology 23 (2022), S20.
[105]
Jawad Rasheed, Akhtar Jamil, Alaa Ali Hameed, Usman Aftab, Javaria Aftab, Syed Attique Shah, and Dirk Draheim. 2020. A survey on artificial intelligence approaches in supporting frontline workers and decision makers for the COVID-19 pandemic. Chaos, Solitons & Fractals 141 (2020), 110337.
[106]
Juan Rebanal, Jordan Combitsis, Yuqi Tang, and Xiang’Anthony’ Chen. 2021. Xalgo: a design probe of explaining algorithms’ internal states via question-answering. In 26th International Conference on Intelligent User Interfaces. 329–339.
[107]
Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. " Why should i trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. 1135–1144.
[108]
Heleen Rutjes, Martijn Willemsen, and Wijnand IJsselsteijn. 2019. Considerations on explainable AI and users’ mental models. In CHI 2019 Workshop: Where is the Human? Bridging the Gap Between AI and HCI. Association for Computing Machinery, Inc.
[109]
Azhagu Meena S P, Palashi Vaghela, and Joyojeet Pal. 2022. Counting to be Counted: Anganwadi Workers and Digital Infrastructures of Ambivalent Care. Proc. ACM Hum.-Comput. Interact. 6, CSCW2 (Nov. 2022), 1–36.
[110]
Alpay Sabuncuoglu. 2020. Designing one year curriculum to teach artificial intelligence for middle school. In Proceedings of the 2020 ACM conference on innovation and technology in computer science education. 96–102.
[111]
Nithya Sambasivan and Rajesh Veeraraghavan. 2022. The deskilling of domain expertise in AI development. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–14.
[112]
Lipekho Saprii, Esther Richards, Puni Kokho, and Sally Theobald. 2015. Community health workers in rural India: analysing the opportunities and challenges Accredited Social Health Activists (ASHAs) face in realising their multiple roles. Human resources for health 13, 1 (2015), 1–13.
[113]
Benjamin Saunders, Julius Sim, Tom Kingstone, Shula Baker, Jackie Waterfield, Bernadette Bartlam, Heather Burroughs, and Clare Jinks. 2018. Saturation in qualitative research: exploring its conceptualization and operationalization. Quality & quantity 52 (2018), 1893–1907.
[114]
Philipp Schmidt, Felix Biessmann, and Timm Teubner. 2020. Transparency and trust in artificial intelligence systems. Journal of Decision Systems 29, 4 (2020), 260–278.
[115]
Kerry Scott, SW Beckham, Margaret Gross, George Pariyo, Krishna D Rao, Giorgio Cometto, and Henry B Perry. 2018. What do we know about community-based health worker programs? A systematic review of existing reviews on community health workers. Human resources for health 16, 1 (2018), 1–17.
[116]
Auste Simkute, Ewa Luger, Bronwyn Jones, Michael Evans, and Rhianne Jones. 2021. Explainability for experts: A design framework for making algorithms supporting expert decisions more explainable. Journal of Responsible Technology 7-8 (Oct. 2021), 100017.
[117]
I Sini, D Djanas, M Oktania, A Polim, and S Ulman. 2022. Mobile Obstetrics Monitoring (MOM) as a model for community-based antenatal care delivery in a low-resource setting. Philips (2022). https://www. philips. com/c-dam/b2bhc/master/Products/Category/enterprise-telehealth/mobile-obstetrics-monitoring/452299112911_MOM_WhitePaper_HR. pdf
[118]
Daniel Smilkov, Shan Carter, D Sculley, Fernanda B Viégas, and Martin Wattenberg. 2017. Direct-manipulation visualization of deep networks. arXiv preprint arXiv:1708.03788 (2017).
[119]
Ayushi Srivastava, Shivani Kapania, Anupriya Tuli, and Pushpendra Singh. 2021. Actionable UI Design Guidelines for Smartphone Applications Inclusive of Low-Literate Users. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–30.
[120]
Miriam Sturdee and Joseph Lindley. 2019. Sketching & Drawing as Future Inquiry in HCI. In Proceedings of the Halfway to the Future Symposium 2019 (Nottingham, United Kingdom) (HTTF 2019, Article 18). Association for Computing Machinery, New York, NY, USA, 1–10.
[121]
Jiao Sun, Q Vera Liao, Michael Muller, Mayank Agarwal, Stephanie Houde, Kartik Talamadupula, and Justin D Weisz. 2022. Investigating explainability of generative AI for code through scenario-based design. In 27th International Conference on Intelligent User Interfaces. 212–228.
[122]
BN Tandon. 1989. Nutritional interventions through primary health care: impact of the ICDS projects in India.Bulletin of the World Health Organization 67, 1 (1989), 77.
[123]
UN General Assembly. 2015. Transforming our world: the 2030 Agenda for Sustainable Development. https://www.refworld.org/docid/57b6e3e44.html A/RES/70/1.
[124]
International Bank for Reconstruction United Nations Children’s Fund (UNICEF), World Health Organization (WHO) and Development/The World Bank.2023. Levels and trends in child malnutrition: UNICEF / WHO / World Bank Group Joint Child Malnutrition Estimates: Key findings of the 2023 edition.https://data.unicef.org/resources/jme-report-2023/. [Accessed 17-08-2023].
[125]
Aditya Vashistha, Fabian Okeke, Richard Anderson, and Nicola Dell. 2018. ’You Can Always Do Better!" The Impact of Social Proof on Participant Response Bias. In Proceedings of the 2018 chi conference on human factors in computing systems. 1–13.
[126]
Nervo Verdezoto, Naveen Bagalkot, Syeda Zainab Akbar, Swati Sharma, Nicola Mackintosh, Deirdre Harrington, and Paula Griffiths. 2021. The invisible work of maintenance in community health: challenges and opportunities for digital health to support frontline health workers in Karnataka, South India. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–31.
[127]
Bret Victor. 2023. Bret Victor, beast of burden — worrydream.com. http://worrydream.com/#!/ExplorableExplanations. [Accessed 30-07-2023].
[128]
Jayne Wallace, John McCarthy, Peter C. Wright, and Patrick Olivier. 2013. Making Design Probes Work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 3441–3450. https://doi.org/10.1145/2470654.2466473
[129]
April Yi Wang, Andrew Head, Ashley Ge Zhang, Steve Oney, and Christopher Brooks. 2023. Colaroid: A Literate Programming Approach for Authoring Explorable Multi-Stage Tutorials. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–22.
[130]
Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y Lim. 2019. Designing theory-driven user-centric explainable AI. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–15.
[131]
Susan Wyche. 2019. Using cultural probes in new contexts: Exploring the Benefits of Probes in HCI4D/ICTD. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 423–427.
[132]
Deepika Yadav, Anushka Bhandari, and Pushpendra Singh. 2019. LEAP: Scaffolding Collaborative Learning of Community Health Workers in India. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–27.
[133]
Qian Yang, Yuexing Hao, Kexin Quan, Stephen Yang, Yiran Zhao, Volodymyr Kuleshov, and Fei Wang. 2023. Harnessing Biomedical Literature to Calibrate Clinicians’ Trust in AI Decision Support Systems. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23, Article 14). Association for Computing Machinery, New York, NY, USA, 1–14.
[134]
Kun-Hsing Yu, Andrew L Beam, and Isaac S Kohane. 2018. Artificial intelligence in healthcare. Nature biomedical engineering 2, 10 (2018), 719–731.
[135]
Angie Zhang, Alexander Boltz, Jonathan Lynn, Chun-Wei Wang, and Min Kyung Lee. 2023. Stakeholder-Centered AI Design: Co-Designing Worker Tools with Gig Workers through Data Probes. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–19.
[136]
Yunfeng Zhang, Q Vera Liao, and Rachel KE Bellamy. 2020. Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. In Proceedings of the 2020 conference on fairness, accountability, and transparency. 295–305.
Index Terms
- Explorable Explainable AI: Improving AI Understanding for Community Health Workers in India
Recommendations
"If it is easy to understand then it will have value": Examining Perceptions of Explainable AI with Community Health Workers in Rural India
CSCWAI-driven tools are increasingly deployed to support low-skilled community health workers (CHWs) in hard-to-reach communities in the Global South. This paper examines how CHWs in rural India engage with and perceive AI explanations and how we might ...
Improving community health worker performance through automated SMS
ICTD '12: Proceedings of the Fifth International Conference on Information and Communication Technologies and DevelopmentCommunity health workers (CHWs) have been shown to be an effective and powerful intervention for improving community health. Routine visits, for example, can lower maternal and neonatal mortality rates. Despite these benefits, many challenges, including ...
Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
CSCWExplainable AI (XAI) systems are sociotechnical in nature; thus, they are subject to the sociotechnical gap-divide between the technical affordances and the social needs. However, charting this gap is challenging. In the context of XAI, we argue that ...
Comments
Information & Contributors
Information
Published In
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Data Availability
Video Presentation: Video Presentation https://dl.acm.org/doi/10.1145/3613904.3642733#3613904.3642733-talk-video.mp4
Conference
Upcoming Conference
CHI PLAY '24
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 335Total Downloads
- Downloads (Last 12 months)335
- Downloads (Last 6 weeks)186
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format