Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3472301.3484343acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

When just Ok, is not Ok: An Experimental Study through Sequential Chronological Cuts, with Prescriptive and Semantic Analyzes on the Dynamic Translation by VLibras Avatar

Published: 18 October 2021 Publication History

Abstract

Internet sites expose their content primarily in a textual form. Accessibility solutions that use avatars to translate from Portuguese into sign language aim to reduce accessibility barriers for deaf people who are literate only in Libras or have Portuguese as a second language. This research aimed to identify whether the VLibras tool, widely adopted in governmental websites, is an effective accessibility solution in dynamic translation into sign language. It was an applied qualitative and exploratory research involving a bibliographic survey and support from expert interpreters. An experimental study was carried out through sequential chronological cuts, where prescriptive and semantic analyzes were applied. Evidence was found that there is no translation for Libras in the dynamic translation process carried out by the VLibras avatar, but only a transposition of part of the Libras lexicon into the Portuguese morphosyntactic structure. Difficulties of simultaneous translation in large and more complex texts were noticed, resulting in excessive pauses and dactylology for words that have a sign registered in the Libras basic dictionary. Using HCI concepts to evaluate the dynamic translation to Libras by VLibras avatar expands the existing theoretical discussion. It also contributes to minimizing communication problems caused by the discrepancy between the original message and the automatic translation, practical applicability of this study.

References

[1]
Alves, A.D.S. 2012. Estudo do uso de diálogos de mediação para melhorar interação de surdos bilíngues na Web.
[2]
Antonio, J.D. et al. 2019. Estratégias de Tradução Automática: Comparando a Estrutura Retórica do Texto Fonte e a Estrutura Retórica do Texto Gerado por um Tradutor Automático. Intercâmbio - Revista do Programa de Estudos Pós-Graduados em Linguística Aplicada e Estudos da Linguagem. 40, (2019), 121--138.
[3]
Bell, R.T. 1938. Translation and Translating: Theory and Practice. Longman Inc.
[4]
Brasil 1999. Decreto No 3.298, de 20 de dezembro de 1999. Presidente da República.
[5]
Brasil 2004. Decreto No 5.296 de 2 de dezembro de 2004. Casa Civil Subchefia para Assuntos Jurídicos.
[6]
Brasil 2019. Decreto No 10.195, de 30 de dezembro de 2019. Presidência da República.
[7]
Brasil 2000. Lei No 10.098, de 19 de Dezembro de 2000. Congresso Nacional.
[8]
Brasil 2002. Lei no 10.436, de 24 de abril de 2002.
[9]
Bubbico, L. et al. 2007. Prevalence of prelingual deafness in Italy. Acta otorhinolaryngologica Italica: organo ufficiale della Società italiana di otorinolaringologia e chirurgia cervico-facciale. 27, 1 (2007), 17--21.
[10]
Cavalcante, N.W.F. et al. 2015. Compreensão de conteúdo multimídia na web por surdos prélinguisticos: um estudo de caso com campanhas de saúde. XIV Simpósio de Fatores Humanos em Sistemas Computacionais (Salvador, BA, Brasil, 2015).
[11]
ClipChamp: 2016. https://clipchamp.com/pt-br/. Accessed: 2020-12-19.
[12]
Corradi, J.A.M. and Vidotti, S.A.B.G. 2009. Ambientes Informacionais Digitais Acessíveis a Minorias Linguísticas Surdas: Cidadania e/ou Responsabilidade Social. X ENANCIB - Encontro Nacional de Pesquisa em Ciência da Informação (João Pessoa, PB, Brasil, 2009), 1689--1699.
[13]
Corrêa, Y. et al. 2017. Aplicativos de Tradução Português-Libras na Educação Bilíngue: desafios frente à desambiguação. RENOTE - Novas Tecnologias na Educação. 15, 2 (2017).
[14]
Dicionário Digital da Língua Brasileira de Sinais -Libras. Versão 3.0: 2011. http://www.acessibilidadebrasil.org.br/libras_3/. Accessed: 2021-02-09.
[15]
Estudo: acessibilidade na web brasileira: 2020. https://bigdatacorp.com.br/estudo-acessibilidade-na-web-brasileira/#:~:text=Emoitomeses%2Csobede,oseuníveldeacessibilidade. Accessed: 2021-05-19.
[16]
Felipe, T.A. and Monteiro, M.S. 2007. Libras em contexto - Curso básico - Livro do professor instrutor. Ministério da Educação e Cultura - MEC - Secretaria de Educação Especial - SEESP.
[17]
Ferramenta do governo para surdos conquista espaço na iniciativa privada: 2020. https://www.gov.br/economia/pt-br/assuntos/noticias/2020/setembro/ferramenta-do-governo-para-deficientes-auditivos-conquista-espaco-na-iniciativa-privada. Accessed: 2021-04-19.
[18]
Gesueli, Z.M. 2006. Lingua(gem) e identidade: a surdez em questão. Educação & Sociedade. 27, 94 (2006), 277--292.
[19]
Gomes, V. and Teixeira 2014. A iconicidade e arbitrariedade na Libras - Anais do VI SINEFIL. Revista Philologus - Círculo Fluminense de Estudos Filológicos e Linguísticos. 20, 58 (2014), 91--98.
[20]
Governo Digital - VLIBRAS: 2019. https://www.gov.br/governodigital/pt-br/transformacao-digital/ferramentas/vlibras. Accessed: 2020-12-19.
[21]
HandTalk 2021. Hand Talk: negócio combina inovação tecnológica com impacto social para proporcionar acessibilidade digital a milhões de surdos. O Movimento Amigo do Surdo. Hand Talk.
[22]
IBGE 2010. Censo Demográfico 2010 - Características gerais da população, religião e pessoas com deficiência.
[23]
Jakobson, R. 1959. On Linguistic Aspects of Translation. On Translation. R.A. BROWER, ed. Harvard University Press. 232--239.
[24]
Kahlon, N.K. and Singh, W. 2021. Machine translation from text to sign language: a systematic review. Universal Access in the Information Society. online, (2021).
[25]
Koller, O. et al. 2019. Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective Data-driven Synthesis of American Sign Language Animations View project Teachable Machines View project Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective.
[26]
Kusters, A. et al. 2017. Innovations in Deaf Studies: Critically Mapping the Field. Innovations in Deaf Studies: The Role of Deaf Scholars. A. Kusters et al., eds. Oxford University Press. 1--53.
[27]
Laborit, E. 2000. O Grito da Gaivota. Editorial Caminho, SA.
[28]
Moraes, L.M. et al. 2018. A Usabilidade de avatares de libras em sites: análise da interação de usuários surdos por meio do rastreador ocular Eye Tracking. Design e Tecnologia. 8, 16 (2018), 41.
[29]
Naranjo-Zeledón, L. et al. 2019. A systematic mapping of translation-enabling technologies for sign languages. Electronics (Switzerland). 8, 9 (2019).
[30]
O que é PDF? 1993. https://acrobat.adobe.com/br/pt/acrobat/about-adobe-pdf.html#:~:text=Nós inventamos o Portable Document, Organization of Standardization (ISO). Accessed: 2020-12-19.
[31]
O'Brien, D. and Emery, S.D. 2014. The Role of the Intellectual in Minority Group Studies: Reflections on Deaf Studies in Social and Political Contexts. Qualitative Inquiry. 20, 1 (2014), 27--36.
[32]
ONU 2019. World Population Prospects 2019: Highlights. United Nations, Department of Economic and Social Affairs, Population Division.
[33]
Paulo Colling, J. and Boscarioli, C. 2014. Avaliação De Tecnologias De Tradução Português-Libras Visando O Uso No Ensino De Crianças Surdas. RENOTE - Revista Novas Tecnologias na Educação. 12, 2 (2014).
[34]
Prates, R.O. et al. 2000. Methods and tools: a method for evaluating the communicability of user interfaces. Interactions. 7, 1 (2000), 31--38.
[35]
Prates, R.O. and Barbosa, S.D.J. 2007. Introdução à Teoria e Prática da Interação Humano Computador fundamentada na Engenharia Semiótica. Jornadas de Atualização em Informática, JAI 2007. Editora PUC-Rio. 263--326.
[36]
Quadros, R.M. de and Karnopp, L.B. 2004. Língua de Sinais Brasileira: Estudos Linguísticos. Artes Medicas.
[37]
Reis, L.S. et al. 2018. Assessment of the Treatment of Grammatical Aspects of Machine Translators to Libras. XXIV Simpósio Brasileiro de Sistemas Multimídia e Web (Salvador, Brasil, 2018), 73--76.
[38]
Reis, L.S. et al. 2017. Avaliação de Usabilidade do Aplicativo VLibras-Móvel com Usuários Surdos. Anais do XXIII Simpósio Brasileiro de Sistemas Multimídia e Web: Workshops e Pôsteres (2017), 123--126.
[39]
Ribeiro, E.S. and Souza, E.S. de 2012. A Constituição Sígnica da LIBRAS: Uma Proposta Intersemiótica. XXIV Jornada Nacional do Grupo de Estudos Linguísticos do Nordeste (Natal - Rio Grande do Norte, 2012), 1--12.
[40]
Ribeiro Rocha, P.S. et al. 2018. Tecnologias para o ensino da Língua Brasileira de Sinais (LIBRAS): Uma revisão sistemática da literatura. Revista Brasileira de Informática na Educação. 26, 3 (2018), 42.
[41]
Rodrigues, C.H. 2018. Competência Em Tradução E Línguas De Sinais: a Modalidade Gestual-Visual E Suas Implicações Para Uma Possível Competência Tradutória Intermodal. Trabalhos em Linguística Aplicada. 57, 1 (2018), 287--318.
[42]
Rybená - Sobre: 2021. https://portal.rybena.com.br/site-rybena/sobre.html. Accessed: 2021-04-19.
[43]
Rybená Tradutor Libras Voz: 2020. https://play.google.com/store/apps/details?id=br.com.icts.rybenatorandroid. Accessed: 2021-04-19.
[44]
Sacks, O. 2010. Vendo Vozes. Companhia das Letras.
[45]
Santana, L. 2015. Aquisição da língua escrita pelo surdo: um processo a ser questionado. Estudos Linguísticos. 44, 2 (2015), 491--505.
[46]
Santos, R.G. dos 2017. Aplicativos de LIBRAS, Problema ou Solução? Artefactum - Revista de Estudos em Linguagem e Tecnologia. 19, 1 (2017), 1--16.
[47]
Segala, R.R. and Quadros, R.M. de 2015. Tradução intermodal, intersemiótica e interlinguística de textos escritos em Português para a Libras oral. Cadernos de Tradução. 35, 2 (2015), 354--386.
[48]
da Silva Alves, A. et al. 2012. Evaluation of potential communication breakdowns in the interaction of the deaf in corporate information systems on the web. Procedia Computer Science. 14, Dsai (2012), 234--244.
[49]
da Silva Alves, A. et al. 2013. Web scripts and mediation dialogues as a quality factor in the interaction of the deaf. 5th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, DSAI 2013 (Vigo, Spain, 2013), 158--167.
[50]
Soares, R. et al. 2017. AnyLanguage-To-LIBRAS: Evaluation of an machine translation service of any oralized language for the brazilian sign language. WebMedia 2017 - Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web. (2017), 481--488.
[51]
de Souza, C.S. 2005. Semiotic engineering: Bringing designers and users together at interaction time. Interacting with Computers. 17, 3 (2005), 317--341.
[52]
de Souza, C.S. 2005. The Semiotic Engineering of Human-computer Interaction. MIT Press.
[53]
Temple, B. 2002. Crossed wires: Interpreters, translators, and bilingual workers in cross-language research. Qualitative Health Research. 12, 6 (2002), 844--854.
[54]
VLIBRAS: 2009. https://www.vlibras.gov.br/. Accessed: 2020-12-19.
[55]
Young, A. and Temple, B. 2014. Approach to Social Research - The Case of Deaf Studies. Approach to Social Research - The Case of Deaf Studies. M. Marschark and P.E. Spender, eds. Oxford University Press. 1--16.

Cited By

View all
  • (2023)Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638075(1-15)Online publication date: 16-Oct-2023

Index Terms

  1. When just Ok, is not Ok: An Experimental Study through Sequential Chronological Cuts, with Prescriptive and Semantic Analyzes on the Dynamic Translation by VLibras Avatar

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    IHC '21: Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems
    October 2021
    523 pages
    ISBN:9781450386173
    DOI:10.1145/3472301
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 October 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Libras
    2. VLibras
    3. accessibility
    4. deaf
    5. dynamic translation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    IHC '21

    Acceptance Rates

    IHC '21 Paper Acceptance Rate 29 of 77 submissions, 38%;
    Overall Acceptance Rate 331 of 973 submissions, 34%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)12
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 12 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638075(1-15)Online publication date: 16-Oct-2023

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media