Work in Progress

Personalising the TV Experience with Augmented Reality Technology: Synchronised Sign Language Interpretation

Authors:

Vinoba Vinayagamoorthy,

Richard SchäfferAuthors Info & Claims

TVX '18: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video

Pages 179 - 184

https://doi.org/10.1145/3210825.3213562

Published: 25 June 2018 Publication History

Get Access

Abstract

This paper explores the potential of augmented reality technology as a novel way to allow users to view a sign language interpreter through an optical head-mounted display while watching a TV programme. We address the potential of augmented reality for personalisation of TV access services as part of closed laboratory investigations. Based on guidelines of regulatory authorities and research on traditional sign language services on TV, as well as feedback from experts, we justify our two design proposals. We describe how we produced the content for the AR prototype applications and what we have learned during the process. Finally, we develop questions for our upcoming user studies.

References

[1]

2-Immerse Home Page. 2-Immerse. Retrieved March 27, 2018 from https://2immerse.eu/.

Google Scholar

[2]

BBC R&D - Companion Screens: Creating a viewing experience across more than one screen. BBC R&D Blog Post. Retrieved March 27, 2018 from http://www.bbc.co.uk/rd/projects/companion-screens.

Google Scholar

[3]

BBC R&D -- Unconventional Screens: Exploring the potential of future display technologies. BBC R&D Blog Post. Retrieved March 27, 2018 from https://www.bbc.co.uk/rd/projects/unconventional-screens.

Google Scholar

[4]

Mike Armstrong. Object-Based Media and Accessibility. 2018. BBC R&D Blog Post. Retrieved March 27, 2018 from https://www.bbc.co.uk/rd/blog/2018-01-accessibility-object-based-media

Google Scholar

[5]

Matthew Dye. The Digital Age: Digital and Signed TV. Deaf Studies Trust. 2000

Google Scholar

[6]

Hbb4All. D6.4 -- Pilot-D Evaluation and Recommendations. 2017. Retrieved March 29, 2018 from http://pagines.uab.cat/hbb4all/content/deliverables

Google Scholar

[7]

Microsoft. Microsoft HoloLens. Retrieved March 28, 2018 from https://www.microsoft.com/en-gb/hololens

Google Scholar

[8]

Ofcom. The Ofcom Code on Television Access Services. 2017. Retrieved March 27, 2018 from https://www.ofcom.org.uk/tv-radio-and-on-demand/broadcast-codes/tv-access-services

Google Scholar

[9]

Benice Woll. Sign Language on Television. Centre for Deaf Studies, University of Bristol. 199

Google Scholar

[10]

Yan Wu, Elain Price and Leighton Evans. Digital Television and Deaf/Hard of Hearing Audiences in Wales. Research Institute for Arts and Humanities, Swansea University. 2014. Retrieved from March 29, 2018 from http://www.swansea.ac.uk/riah/research-projects/dtv-wales-survey/

Google Scholar

Cited By

View all

Shahin NIsmail L(2024)From rule-based models to deep learning transformers architectures for natural language processing and sign language translation systems: survey, taxonomy and performance evaluationArtificial Intelligence Review10.1007/s10462-024-10895-z57:10Online publication date: 29-Aug-2024
https://doi.org/10.1007/s10462-024-10895-z
Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Pamparău CVatavu R(2022)The User Experience of Journeys in the Realm of Augmented Reality TelevisionProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529969(161-174)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529969
Show More Cited By

Index Terms

Personalising the TV Experience with Augmented Reality Technology: Synchronised Sign Language Interpretation
1. Human-centered computing
  1. Accessibility
    1. Empirical studies in accessibility
  2. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

The User Experience of Journeys in the Realm of Augmented Reality Television
IMX '22: Proceedings of the 2022 ACM International Conference on Interactive Media Experiences

Augmented Reality Television (ARTV) can take many forms, from AR content displayed outside the TV frame to video-projected TV screens to social TV watching in VR to immersive holograms in the living room. While the user experience (UX) of individual ...
Augmenting Television With Augmented Reality
TVX '19: Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video

This paper explores the effects of adding augmented reality (AR) artefacts to an existing TV programme. A prototype was implemented augmenting a popular nature documentary. Synchronised content was delivered over a Microsoft HoloLens and a TV. Our ...
Personalising the TV Experience using Augmented Reality: An Exploratory Study on Delivering Synchronised Sign Language Interpretation
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) technology has the potential to extend the screen area beyond the rigid frames of televisions. The additional display area can be used to augment televisions (TVs) with extra information tailored to individuals, for instance, the ...

Comments

Information & Contributors

Information

Published In

TVX '18: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video

June 2018

266 pages

ISBN:9781450351157

DOI:10.1145/3210825

General Chairs:
Hokyoung Ryu
Hanyang University, Republic of Korea
,
Jieun Kim
Hanyang University, Republic of Korea
,
Teresa Chambel
LASIGE, Fac. de Ciências, Universidade de Lisboa, Portugal
,
Program Chairs:
Tom Bartindale
Newcastle University, UK
,
Vinoba Vinayagamoorthy
BBC Research & Development, UK
,
Wei Tsang Ooi
National University of Singapore, Singapore

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2018

Check for updates

Author Tags

Qualifiers

Work in progress

Funding Sources

European Union's H2020-ICT-2015 programme (2-Immerse)

Conference

TVX '18

Sponsor:

TVX '18: ACM International Conference on Interactive Experiences for TV and Online Video

June 26 - 28, 2018

SEOUL, Republic of Korea

Acceptance Rates

TVX '18 Paper Acceptance Rate 12 of 36 submissions, 33%;

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
373
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Shahin NIsmail L(2024)From rule-based models to deep learning transformers architectures for natural language processing and sign language translation systems: survey, taxonomy and performance evaluationArtificial Intelligence Review10.1007/s10462-024-10895-z57:10Online publication date: 29-Aug-2024
https://doi.org/10.1007/s10462-024-10895-z
Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Pamparău CVatavu R(2022)The User Experience of Journeys in the Realm of Augmented Reality TelevisionProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529969(161-174)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529969
Yang FMousas CAdamo N(2022)Holographic sign language avatar interpreter: A user interaction study in a mixed reality classroomComputer Animation and Virtual Worlds10.1002/cav.208233:3-4Online publication date: 9-Jun-2022
https://doi.org/10.1002/cav.2082
Vatavu R(2021)Accessibility of Interactive Television and Media Experiences: Users with Disabilities Have Been Little Voiced at IMX and TVXProceedings of the 2021 ACM International Conference on Interactive Media Experiences10.1145/3452918.3465485(218-222)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3452918.3465485
Vatavu RSaeghe PChambel TVinayagamoorthy VUrsu M(2020)Conceptualizing Augmented Reality Television for the Living RoomProceedings of the 2020 ACM International Conference on Interactive Media Experiences10.1145/3391614.3393660(1-12)Online publication date: 17-Jun-2020
https://dl.acm.org/doi/10.1145/3391614.3393660
von der Au SGiering LSchneegass CLudwig M(2020)The SpaceStation App: Design and Evaluation of an AR Application for Educational TelevisionProceedings of the 2020 ACM International Conference on Interactive Media Experiences10.1145/3391614.3393655(24-33)Online publication date: 17-Jun-2020
https://dl.acm.org/doi/10.1145/3391614.3393655
McGill MMathis FKhamis MWilliamson J(2020)Augmenting TV Viewing using Acoustically Transparent Auditory HeadsetsProceedings of the 2020 ACM International Conference on Interactive Media Experiences10.1145/3391614.3393650(34-44)Online publication date: 17-Jun-2020
https://dl.acm.org/doi/10.1145/3391614.3393650
Saeghe PAbercrombie GWeir BClinch SPettifer SStevens R(2020)Augmented Reality and Television: Dimensions and ThemesProceedings of the 2020 ACM International Conference on Interactive Media Experiences10.1145/3391614.3393649(13-23)Online publication date: 17-Jun-2020
https://dl.acm.org/doi/10.1145/3391614.3393649
Popovici IVatavu R(2019)Towards Visual Augmentation of the Television Watching ExperienceProceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3325121(199-204)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3325121
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

The User Experience of Journeys in the Realm of Augmented Reality Television

Augmenting Television With Augmented Reality

Personalising the TV Experience using Augmented Reality: An Exploratory Study on Delivering Synchronised Sign Language Interpretation

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations