Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3544548.3581053acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Sparkling Silence: Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing Streamers

Published: 19 April 2023 Publication History

Abstract

Understanding livestream platforms’ accessibility challenges for minority groups, such as people with disabilities, is critical to increasing the diversity and inclusion of those platforms. While prior work investigated the experiences of streamers with vision or motor loss, little is known about the experiences of deaf or hard of hearing (DHH) streamers who must work with livestreaming platforms that heavily depend on audio. We conducted semi-structured interviews with DHH streamers to learn why they livestream, how they navigate livestream platforms and related challenges. Our findings revealed their desire to break the stereotypes towards the DHH groups via livestream and the intense interplay between interaction methods, such as sign language, texts, lip language, background music, and viewer characteristics. Major accessibility challenges include the lack of real-time captioning, the small sign language reading window, and misinterpretation of sign language. We present design considerations for improving the accessibility of the livestream platforms.

Supplementary Material

MP4 File (3544548.3581053-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
2021. WORLD REPORT ON HEARING EXECUTIVE SUMMARY. http://apps.who.int/bookorders.
[2]
Mrim Alnfiai and Srini Sampali. 2017. Social and Communication Apps for the Deaf and Hearing Impaired. In 2017 International Conference on Computer and Applications (ICCA). IEEE, 120–126.
[3]
Shane Angel, Allison Tate, Christian Vogler, and Raja Kushalnagar. 2022. Teleconference Sign Language Detection.
[4]
U. Sai Babu, A. Raganna, K.N. Vidyasagar, S.H. Bharati, and Gautam Kumar. 2022. Highly Accurate Static Hand Gesture Recognition Model Using Deep Convolutional Neural Network for Human Machine Interaction. In 2022 IEEE Fourth International Conference on Advances in Electronics, Computers and Communications (ICAECC). 1–6. https://doi.org/10.1109/ICAECC54045.2022.9716619
[5]
National Copyright Administration Network Copyright Industry Research Base. [n. d.]. China Internet Copyright Industry Development Report 2020.
[6]
Sam Biddle, Paulo Victor Ribeiro, and Tatiana Dias. 2020. Invisible censorship: TikTok told moderators to suppress posts by “ugly” people and the poor to attract new users. The Intercept 16(2020). https://theintercept.com/2020/03/16/tiktok-app-moderators-users-discrimination/
[7]
Jie Cai and Donghee Yvette Wohn. 2019. What Are Effective Strategies of Handling Harassment on Twitch? Users’ Perspectives. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing (Austin, TX, USA) (CSCW ’19). Association for Computing Machinery, New York, NY, USA, 166–170. https://doi.org/10.1145/3311957.3359478
[8]
Shao-Hsi Chang, Li-Ting Wang, Ting-Yu Chueh, Ming-Chun Hsueh, Tsung-Min Hung, and Yu-Wen Wang. 2021. Effectiveness of Facebook Remote Live-Streaming-Guided Exercise for Improving the Functional Fitness of Community-Dwelling Older Adults. Frontiers in Medicine(2021), 1602.
[9]
Hsiao-Ping Chiu, Chien-Hsiou Liu, Ching-Lin Hsieh, and Rong-Kwer Li. 2010. Essential needs and requirements of mobile phones for the deaf. Assistive Technology® 22, 3 (2010), 172–185.
[10]
Juliet Corbin and Anselm Strauss. 2014. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage publications.
[11]
Ross Cutler, Yong Rui, Anoop Gupta, JJ Cadiz, Ivan Tashev, Li-wei He, Alex Colburn, Zhengyou Zhang, Zicheng Liu, and Steve Silverberg. 2002. Distributed Meetings: A Meeting Capture and Broadcasting System. In Proceedings of the Tenth ACM International Conference on Multimedia (Juan-les-Pins, France) (MULTIMEDIA ’02). Association for Computing Machinery, New York, NY, USA, 503–512. https://doi.org/10.1145/641007.641112
[12]
Travis Faas, Lynn Dombrowski, Alyson Young, and Andrew D Miller. 2018. Watch me code: Programming mentorship communities on twitch. tv. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–18.
[13]
China Hearing Medicine Development Foundation. [n. d.]. China Hearing Health Report(2021). ([n. d.]).
[14]
C Ailie Fraser, Joy O Kim, Alison Thornsberry, Scott Klemmer, and Mira Dontcheva. 2019. Sharing the studio: How creative livestreaming can inspire, educate, and engage. In Proceedings of the 2019 on Creativity and Cognition. 144–155.
[15]
Abraham Glasser, Matthew Watkins, Kira Hart, Sooyeon Lee, and Matt Huenerfauth. 2022. Analyzing Deaf and Hard-of-Hearing Users’ Behavior, Usage, and Interaction with a Personal Assistant Device that Understands Sign-Language Input. In CHI Conference on Human Factors in Computing Systems. 1–12.
[16]
Ruiling Guo. 2021. Deaf people also livestream!(In Chinese). https://www.woshipm.com/it/5227659.html. Accessed: 2022-08-20.
[17]
Lassi Haaranen. 2017. Programming as a performance: Live-streaming and its implications for computer science education. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education. 353–358.
[18]
Juho Hamari and Max Sjöblom. 2017. What is eSports and why do people watch it?Internet research (2017).
[19]
William A Hamilton, Oliver Garretson, and Andruid Kerne. 2014. Streaming on twitch: fostering participatory communities of play within live mixed media. In Proceedings of the SIGCHI conference on human factors in computing systems. 1315–1324.
[20]
Setia Hermawati and Katerina Pieri. 2019. Assistive technologies for severe and profound hearing loss: Beyond hearing aids and implants. Assistive Technology(2019).
[21]
Megan Hofmann, Devva Kasnitz, Jennifer Mankoff, and Cynthia L Bennett. 2020. Living disability theory: Reflections on access, research, and design. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. 1–13.
[22]
Jie Huang, Wengang Zhou, Houqiang Li, and Weiping Li. 2019. Attention-Based 3D-CNNs for Large-Vocabulary Sign Language Recognition. IEEE Transactions on Circuits and Systems for Video Technology 29, 9(2019), 2822–2832. https://doi.org/10.1109/TCSVT.2018.2870740
[23]
Joonyoung Jun, Woosuk Seo, Jihyeon Park, Subin Park, and Hyunggu Jung. 2021. Exploring the Experiences of Streamers with Visual Impairments. Proceedings of the ACM on Human-Computer Interaction 5 (2021). Issue CSCW2. https://doi.org/10.1145/3476038
[24]
Joonyoung Jun, Woosuk Seo, Jihyeon Park, Subin Park, and Hyunggu Jung. 2021. Exploring the Experiences of Streamers with Visual Impairments. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2(2021), 1–23.
[25]
Saba Kawas, George Karalis, Tzu Wen, and Richard E Ladner. 2016. Improving real-time captioning experiences for deaf and hard of hearing students. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. 15–23.
[26]
I Kožuh and M Debevc. 2018. Challenges in social media use among deaf and hard of hearing people. In Social Networks Science: Design, Implementation, Security, and Challenges. Springer, 151–171.
[27]
Harlan Lane. 2005. Ethnicity, ethics, and the deaf-world. The Journal of Deaf Studies and Deaf Education 10, 3 (2005), 291–310.
[28]
Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.
[29]
Sooyeon Lee, Abraham Glasser, Becca Dingman, Zhaoyang Xia, Dimitris Metaxas, Carol Neidle, and Matt Huenerfauth. 2021. American Sign Language Video Anonymization to Support Online Participation of Deaf and Hard of Hearing Users. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. 1–13.
[30]
Franklin Mingzhe Li, Cheng Lu, Zhicong Lu, Patrick Carrington, and Khai N Truong. 2022. An Exploration of Captioning Practices and Challenges of Individual Content Creators on YouTube for People with Hearing Impairments. arXiv preprint arXiv:2201.11226(2022).
[31]
Jane Li. 2022. China sends a fresh warning to its booming livestreaming industry. Retrieved from August 19, 2022. https://qz.com/2181319/china-sends-a-fresh-warning-to-its-livestreamers.
[32]
Jie Li, Xinning Gui, Yubo Kou, and Yukun Li. 2019. Live streaming as co-performance: Dynamics between center and periphery in theatrical engagement. Proceedings of the ACM on human-computer interaction 3, CSCW(2019), 1–22.
[33]
Blog Writing Guide Lines. 2020. Social Media Discrimination: TikTok as a platform that was openly hiding disabled people’s content.(2020).
[34]
Zicheng Liu, Zhengyou Zhang, Li-Wei He, and Phil Chou. [n. d.]. ENERGY-BASED SOUND SOURCE LOCALIZATION AND GAIN NORMALIZATION FOR AD HOC MICROPHONE ARRAYS.
[35]
Zhicong Lu, Michelle Annett, Mingming Fan, and Daniel Wigdor. 2019. " I feel it is my responsibility to stream": Streaming and Engaging with Intangible Cultural Heritage through Livestreaming. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14. https://doi.org/10.1145/3290605.3300459
[36]
Zhicong Lu, Michelle Annett, and Daniel Wigdor. 2019. Vicariously experiencing it all without going outside: A study of outdoor livestreaming in China. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–28. https://doi.org/10.1145/3359127
[37]
Zhicong Lu, Chenxinran Shen, Jiannan Li, Hong Shen, and Daniel Wigdor. 2021. More Kawaii than a Real-Person Live Streamer: Understanding How the Otaku Community Engages with and Perceives Virtual YouTubers. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14. http://dx.doi.org/10.1145/3411764.3445660
[38]
Zhicong Lu, Haijun Xia, Seongkook Heo, and Daniel Wigdor. 2018. You watch, you give, and you engage: a study of live streaming practices in China. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13. https://doi.org/10.1145/3173574.3174040
[39]
Kelly Mack, Danielle Bragg, Meredith Ringel Morris, Maarten W Bos, Isabelle Albi, and Andrés Monroy-Hernández. 2020. Social app accessibility for deaf signers. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2(2020), 1–31.
[40]
Emma J McDonnell, Ping Liu, Steven M Goodman, Raja Kushalnagar, Jon E Froehlich, and Leah Findlater. 2021. Social, environmental, and technical: Factors at play in the current use and future design of small-group captioning. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2(2021), 1–25.
[41]
Michael McKee, Deirdre Schlehofer, and Denise Thew. 2013. Ethical issues in conducting research with deaf populations. American journal of public health 103, 12 (2013), 2174–2178.
[42]
Amit Moryossef, Ioannis Tsochantaridis, Roee Aharoni, Sarah Ebling, and Srini Narayanan. 2022. Real-Time Sign Language Detection using Human Pose Estimation.
[43]
Website of China Disabled Persons’ Federation. 2006. Chinese Practical Assessment Standard for Disabled Persons. http://www.gov.cn/ztzl/gacjr/content_459939.htm. Accessed: 2022-08-30.
[44]
Anthony J Pellicone and June Ahn. 2017. The Game of Performing Play: Understanding streaming as cultural production. In Proceedings of the 2017 CHI conference on human factors in computing systems. 4863–4874.
[45]
Liangjun Peng, Gang Lu, Kai Pang, and Qi Yao. 2021. Optimal farmer’s income from farm products sales on live streaming with random rewards: Case from China’s rural revitalisation strategy. Computers and Electronics in Agriculture 189 (2021), 106403.
[46]
Adi Robertson. 2019. TikTok prevented disabled users? videos from showing up in feeds. The Verge (2019).
[47]
Ethan Z. Rong, Mo Morgana Zhou, Zhicong Lu, and Mingming Fan. 2022. “It Feels Like Being Locked in A Cage”: Understanding Blind or Low Vision Streamers’ Perceptions of Content Curation Algorithms. Association for Computing Machinery (ACM), 571–585. https://doi.org/10.1145/3532106.3533514
[48]
Jazz Rui Xia Ang, Ping Liu, Emma McDonnell, and Sarah Coppola. 2022. “In this online environment, we’re limited”: Exploring Inclusive Video Conferencing Design for Signers. In CHI Conference on Human Factors in Computing Systems. 1–16.
[49]
Nurain Adila Abdul Samat, Harwati Hashim, and Melor Md Yunus. 2019. Live streaming: a new platform for ESL learning. Creative Education 10, 12 (2019), 2899–2906.
[50]
Ricardo Pezzotti Schefer, Matheus Sousa Bezerra, and Luciana A Martinez Zaina. 2018. Supporting the development of social networking mobile apps for deaf users: Guidelines based on user experience issues. In Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion. 278–285.
[51]
Matthew Seita, Sooyeon Lee, Sarah Andrew, Kristen Shinohara, and Matt Huenerfauth. 2022. Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing Pairs. In CHI Conference on Human Factors in Computing Systems. 1–13.
[52]
Frank M. Shipman, Satyakiran Duggina, Caio D.D. Monteiro, and Ricardo Gutierrez-Osuna. 2017. Speed-accuracy tradeoffs for detecting sign language content in video sharing sites. ASSETS 2017 - Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, 185–189. https://doi.org/10.1145/3132525.3132559
[53]
Brent N Shiver and Rosalee J Wolfe. 2015. Evaluating alternatives for better deaf accessibility to selected web-based multimedia. In Proceedings of the 17th international ACM SIGACCESS conference on computers & accessibility. 231–238.
[54]
David Struzek, Martin Dickel, Dave Randall, and Claudia Müller. 2019. How live streaming church services promotes social participation in rural areas. Interactions 27, 1 (2019), 64–69.
[55]
John Tang. 2021. Understanding the Telework Experience of People with Disabilities. Proceedings of the ACM on Human-Computer Interaction 5 (2021), 1–27. Issue CSCW1. https://doi.org/10.1145/3449104
[56]
John Tang, Gina Venolia, Kori Inkpen, Charles Parker, Robert Gruen, and Alicia Pelton. 2017. Crowdcasting: Remotely participating in live events through multiple live streams. Proceedings of the ACM on Human-Computer Interaction 1, CSCW(2017), 1–18.
[57]
Ningjing Tang, Lei Tao, Bo Wen, and Zhicong Lu. 2022. Dare to Dream, Dare to Livestream: How E-Commerce Livestreaming Empowers Chinese Rural Women. In CHI Conference on Human Factors in Computing Systems. 1–13.
[58]
Michael D Tyler, Caroline Jones, Leonid Grebennikov, Greg Leigh, William Noble, and Denis Burnham. 2009. Effect of caption rate on the comprehension of educational television programmes by deaf school students. Deafness & Education International 11, 3 (2009), 152–162.
[59]
Jirassaya Uttarapong, Jie Cai, and Donghee Yvette Yvette Wohn. 2021. Harassment experiences of women and LGBTQ live streamers and how they handled negativity. IMX 2021 - Proceedings of the 2021 ACM International Conference on Interactive Media Experiences, 7–19. https://doi.org/10.1145/3452918.3458794
[60]
Jian Wu, Zhongjun Tian, Lu Sun, Leonardo Estevez, and Roozbeh Jafari. 2015. Real-time American sign language recognition using wrist-worn motion and surface EMG sensors. In 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, 1–6.
[61]
Cha Zhang, Pei Yin, Yong Rui, Ross Cutler, and Paul Viola. 2006. Boosting-Based Multimodal Speaker Detection for Distributed Meetings. In 2006 IEEE Workshop on Multimedia Signal Processing. 86–91. https://doi.org/10.1109/MMSP.2006.285274
[62]
Zhiwen Zheng, Qingshan Wang, Dejun Yang, Qi Wang, Wei Huang, and Yinlong Xu. 2022. L-Sign: Large-Vocabulary Sign Gestures Recognition System. IEEE Transactions on Human-Machine Systems 52, 2 (2022), 290–301. https://doi.org/10.1109/THMS.2022.3146787

Cited By

View all
  • (2024)Investigating the Role of Real-Time Chat Summaries in Supporting Live StreamersProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670980(1-12)Online publication date: 3-Jun-2024
  • (2024)Envisioning Collective Communication Access: A Theoretically-Grounded Review of Captioning Literature from 2013-2023Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675649(1-18)Online publication date: 27-Oct-2024
  • (2024)Silent Delivery: Practices and Challenges of Delivering Among Deaf or Hard of Hearing CouriersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642801(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Sparkling Silence: Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing Streamers

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
    April 2023
    14911 pages
    ISBN:9781450394215
    DOI:10.1145/3544548
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. accessibility
    2. deaf or hard of hearing (DHH)
    3. livestreaming
    4. social media/online communities

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    CHI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI '25
    CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)529
    • Downloads (Last 6 weeks)54
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Investigating the Role of Real-Time Chat Summaries in Supporting Live StreamersProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670980(1-12)Online publication date: 3-Jun-2024
    • (2024)Envisioning Collective Communication Access: A Theoretically-Grounded Review of Captioning Literature from 2013-2023Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675649(1-18)Online publication date: 27-Oct-2024
    • (2024)Silent Delivery: Practices and Challenges of Delivering Among Deaf or Hard of Hearing CouriersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642801(1-17)Online publication date: 11-May-2024
    • (2024)Bridging the Literacy Gap for Adults: Streaming and Engaging in Adult Literacy Education through LivestreamingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642423(1-15)Online publication date: 11-May-2024
    • (2024)"Voices Help Correlate Signs and Words": Analyzing Deaf and Hard-of-Hearing (DHH) TikTokers’ Content, Practices, and PitfallsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642413(1-18)Online publication date: 11-May-2024

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media