research-article

Open access

Conceptualizing Augmented Reality Television for the Living Room

Authors:

Radu-Daniel Vatavu,

Teresa Chambel,

Vinoba Vinayagamoorthy,

Marian F UrsuAuthors Info & Claims

IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

Pages 1 - 12

https://doi.org/10.1145/3391614.3393660

Published: 17 June 2020 Publication History

All formats PDF

Abstract

We examine the concept and characteristics of “Augmented Reality Television” (ARTV) using a four-step investigation method consisting of (1) an analysis of commonly-accepted perspectives on Augmented and Mixed Reality systems, (2) a literature survey of previous work on ARTV, (3) relevant connections with other areas of scientific investigation from TVX/IMX, such as Ambient Media, Interactive TV, and 3-D TV, and (4) by proposing a conceptual framework for ARTV called the “Augmented Reality Television Continuum.” Our work comes at a moment when the excitement and hype about the potential of AR for home entertainment has overlooked rigorous analysis and clear-cut examinations of the concepts involved, which should be the hallmark of any exact science. With this work, our goal is to draw the community’s attention toward fundamentals and first principles of ARTV and to tease out its salient qualities on solid foundations.

References

[1]

Gary Anthes. 2019. Augmented Reality Gets Real. Commun. ACM 62, 9 (Aug. 2019), 16–18. https://doi.org/10.1145/3344293

Digital Library

[2]

Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators & Virtual Environments 6, 4 (Aug. 1997), 355–385. https://doi.org/10.1162/pres.1997.6.4.355

Digital Library

[3]

Ronald T. Azuma. 2016. The Most Important Challenge Facing Augmented Reality. Presence: Teleoperators & Virtual Environments 25, 3 (Dec. 2016), 234–238.

Digital Library

[4]

Ronald T. Azuma. 2017. Making Augmented Reality a Reality. Imaging and Applied Optics 2017 (3D, AIO, COSI, IS, MATH, pcAOP), JTu1F.1. http://www.osapublishing.org/abstract.cfm?URI=AIO-2017-JTu1F.1

[5]

Ronald T. Azuma. 2019. The Road to Ubiquitous Consumer Augmented Reality Systems. Human Behavior and Emerging Technologies 1, 1 (2019), 26–32. https://doi.org/10.1002/hbe2.113

[6]

Caroline Baillard, Matthieu Fradet, Vincent Alleaume, Pierrick Jouet, and Anthony Laurent. 2017. Multi-device Mixed Reality TV: A Collaborative Experience with Joint Use of a Tablet and a Headset. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology(VRST ’17). ACM, New York, NY, USA, Article 67, 2 pages. https://doi.org/10.1145/3139131.3141196

Digital Library

[7]

Chris Baume. 2017. The Mermaid’s Tears. https://www.bbc.co.uk/rd/blog/2017-09-mermaids-tears-object-based-audio

[8]

Rik Bauwens, Hendrik Lievens, Maarten Wijnants, Chris Pike, Iris Jennes, and Werner Bailer. 2019. Interactive Radio Experiences. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 273–278. https://doi.org/10.1145/3317697.3323347

Digital Library

[9]

BBC. 2019. His Dark Materials: Discover your Daemon. https://www.bbc.co.uk/rd/blog/2019-07-personalised-documentary-data-instagramifaction

[10]

Michel Beaudouin-Lafon. 2004. Designing Interaction, Not Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces(AVI ’04). Association for Computing Machinery, New York, NY, USA, 15–22. https://doi.org/10.1145/989863.989865

Digital Library

[11]

Amritpal Singh Bhachu. 2011. Inclusive Technologies for Enhancing the Accessibility of Digital Television. SIGACCESS Access. Comput.99 (Jan. 2011), 9–12. https://doi.org/10.1145/1948954.1948956

Digital Library

[12]

Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Foundations and Trends in Human-Computer Interaction 8, 2–3(2015), 73–272. https://doi.org/10.1561/1100000049

Digital Library

[13]

Oliver Bimber and Ramesh Raskar. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, USA.

[14]

Jan Bobeth, Johann Schrammel, Stephanie Deutsch, Michael Klein, Mario Drobics, Christina Hochleitner, and Manfred Tscheligi. 2014. Tablet, Gestures, Remote Control? Influence of Age on Performance and User Experience with ITV Applications. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’14). Association for Computing Machinery, New York, NY, USA, 139–146. https://doi.org/10.1145/2602299.2602315

Digital Library

[15]

Matthew Brooks. 2019. Creating a Personalised and Interactive Episode of BBC Click with StoryKit. https://www.bbc.co.uk/rd/blog/2019-04-object-based-media-click-interactivity-tv

[16]

Grigore C. Burdea and Philippe Coiffet. 2003. Virtual Reality Technology. John Wiley & Sons.

[17]

Pablo Cesar, Konstantinos Chorianopoulos, and Jens F. Jensen. 2008. Social Television and User Interaction. Computers in Entertainment 6, 1, Article 4(2008), 10 pages. https://doi.org/10.1145/1350843.1350847

Digital Library

[18]

Teresa Chambel, V. Michael Bove, Sharon Strover, Paula Viana, and Graham Thomas. 2013. Immersive Media Experiences: Immersiveme 2013 Workshop at ACM Multimedia. In Proceedings of the 21st ACM International Conference on Multimedia(MM ’13). Association for Computing Machinery, New York, NY, USA, 1095–1096. https://doi.org/10.1145/2502081.2503831

Digital Library

[19]

Teresa Chambel, Rene Kaiser, Omar A. Niamut, Wei Tsang Ooi, and Judith A. Redi. 2016. AltMM ’16: Proceedings of the 1st International Workshop on Multimedia Alternate Realities. Association for Computing Machinery, New York, NY, USA. https://dl.acm.org/doi/proceedings/10.1145/2983298

Digital Library

[20]

José Coelho, Carlos Duarte, Pradipta Biswas, and Patrick Langdon. 2011. Developing Accessible TV Applications. In Proceedings of the 13th Int. ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’11). Association for Computing Machinery, New York, NY, USA, 131–138. https://doi.org/10.1145/2049536.2049561

Digital Library

[21]

John Corpuz. 2019. 20 Remote Control Apps for Android Devices. https://www.tomsguide.com/uk/us/pictures-story/494-android-tv-remote-apps.html

[22]

Jasmine Cox, Rhianne Jones, Chris Northwood, Jonathan Tutcher, and Ben Robinson. 2017. Object-Based Production: A Personalised Interactive Cooking Application. In Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’17 Adjunct). Association for Computing Machinery, New York, NY, USA, 79–80. https://doi.org/10.1145/3084289.3089912

Digital Library

[23]

Marco de Sá and Elizabeth F. Churchill. 2013. Mobile Augmented Reality: A Design Perspective. In Human Factors in Augmented Reality Environments, Huang W., Alem L., and Livingston M. (Eds.). Springer, New York, NY, USA. https://doi.org/10.1007/978-1-4614-4205-9_6

[24]

F. de Sorbier, Y. Takaya, Y. Uematsu, I. Daribo, and H. Saito. 2010. Augmented Reality for 3D TV Using Depth Camera Input. In Proceedings of the 16th International Conference on Virtual Systems and Multimedia. 117–123. https://doi.org/10.1109/VSMM.2010.5665956

[25]

Brian Epstein. 1998. Script for Digital Living Room Conference Keynote. https://epstein.org/ambient-intelligence/

[26]

Jennica Falk, Johan Redström, and Staffan Björk. 1999. Amplifying Reality. In Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing(HUC ’99). Springer-Verlag, Berlin, Heidelberg, 274–280. https://doi.org/10.5555/647985.743879

Digital Library

[27]

Jon Francombe. 2018. Vostok-K Incident: Immersive Audio Drama on Personal Devices. https://www.bbc.co.uk/rd/blog/2018-10-multi-speaker-immersive-audio-metadata

[28]

David Geerts and Dirk De Grooff. 2009. Supporting the Social Uses of Television: Sociability Heuristics for Social TV. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’09). Association for Computing Machinery, New York, NY, USA, 595–604. https://doi.org/10.1145/1518701.1518793

Digital Library

[29]

David Geerts, Rinze Leenheer, Dirk De Grooff, Joost Negenman, and Susanne Heijstraten. 2014. In Front of and behind the Second Screen: Viewer and Producer Perspectives on a Companion App. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’14). Association for Computing Machinery, New York, NY, USA, 95–102. https://doi.org/10.1145/2602299.2602312

Digital Library

[30]

David Geerts, Evert van Beek, and Fernanda Chocron Miranda. 2019. Viewers’ Visions of the Future. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). ACM, New York, NY, USA, 59–69. https://doi.org/10.1145/3317697.3323356

Digital Library

[31]

David Geerts, Evert van Beek, and Fernanda Chocron Miranda. 2019. Viewers’ Visions of the Future. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 59–69. https://doi.org/10.1145/3317697.3323356

Digital Library

[32]

Simon Gibbs, Constantin Arapis, Christian Breiteneder, Vali Lalioti, Sina Mostafawy, and Josef Speier. 1998. Virtual Studios: An Overview. IEEE Multimedia 5, 1 (1998), 18–35. https://doi.org/10.1109/93.664740

Digital Library

[33]

David Gómez, Ana M Bernardos, and José R Casar. 2014. A System to Enable Level-of-Detail Mobile Interaction with Augmented Media Objects. In Proceedings of the 8th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing. IEEE, 346–351. https://doi.org/10.1109/IMIS.2014.47

Digital Library

[34]

Lauren Goode. 2019. Get Ready to Hear a Lot More About ’XR’. https://www.wired.com/story/what-is-xr/

[35]

Google. [n.d.]. ARCore Overview | Google Developers. https://developers.google.com/ar/discover

[36]

O. Grau and V. Vinayagamoorthy. 2010. Stereoscopic 3D Sports Content without Stereo Rigs. SMPTE Motion Imaging Journal 119, 7 (Oct 2010), 51–55. https://doi.org/10.5594/J17314

[37]

Nick Hanson. 2019. Creating a Personalised and Interactive Episode of BBC Click with StoryKit. https://www.bbc.co.uk/rd/blog/2019-07-personalised-documentary-data-instagramifaction

[38]

Nick Hanson. 2019. Storytelling of the Future. https://www.bbc.co.uk/rd/blog/2019-02-storytelling-interactive-digital-drama

[39]

Nick Hanson. 2019. Where Next For Interactive Stories?https://www.bbc.co.uk/rd/blog/2019-01-interactive-drama-stories-branching-narrative

[40]

Intel. [n.d.]. Virtual Reality vs. Augmented Reality vs. Mixed Reality. https://www.intel.co.uk/content/www/uk/en/tech-tips-and-tricks/virtual-reality-vs-augmented-reality.html

[41]

Kaitlyn Irvine. 2017. XR: VR, AR, MR - What’s the Difference?https://www.viget.com/articles/xr-vr-ar-mr-whats-the-difference/

[42]

Aric Jenkins. 2019. The Fall and Rise of VR: The Struggle to Make Virtual Reality Get Real. https://fortune.com/longform/virtual-reality-struggle-hope-vr/

[43]

Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(UIST ’14). Association for Computing Machinery, New York, NY, USA, 637–644. https://doi.org/10.1145/2642918.2647383

Digital Library

[44]

Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, New York, NY, USA, 869–878. https://doi.org/10.1145/2470654.2466112

Digital Library

[45]

Hiroyuki Kawakita and Toshio Nakagawa. 2014. Augmented TV: An Augmented Reality System for TV Programs Beyond the TV Screen. In Proceedings of the 2014 International Conference on Multimedia Computing and Systems (ICMCS). IEEE, 955–960. https://doi.org/10.1109/ICMCS.2014.6911158

[46]

Yuki Kawamura and Kazuhiro Otsuki. 2018. 3D Free-Viewpoint Augmented Reality on a Second Display Synchronized with a Broadcast Program. In Proceedings of the 4th International Conference on Communication and Information Processing(ICCIP ’18). Association for Computing Machinery, New York, NY, USA, 273–277. https://doi.org/10.1145/3290420.3290449

Digital Library

[47]

Naoki Kimura and Jun Rekimoto. 2018. ExtVision: Augmentation of Visual Experiences with Generation of Context Images for a Peripheral Vision Using Deep Neural Network. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). ACM, New York, NY, USA, Article 427, 10 pages. https://doi.org/10.1145/3173574.3174001

Digital Library

[48]

A. Leonidis, M. Korozi, V. Kouroumalis, E. Poutouris, E. Stefanidi, D. Arampatzis, E. Sykianaki, N. Anyfantis, E. Kalligiannakis, V.C. Nicodemou, Z. Stefanidi, E. Adamakis, N. Stivaktakis, T. Evdaimon, and M. Antona. 2019. Ambient Intelligence in the Living Room. Sensors 19, 22 (2019), 5011. https://doi.org/10.3390/s19225011

[49]

Jie Li, Zhiyuan Zheng, Britta Meixner, Thomas Röggla, Maxine Glancy, and Pablo Cesar. 2018. Designing an Object-Based Preproduction Tool for Multiscreen TV Viewing. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(CHI EA ’18). Association for Computing Machinery, New York, NY, USA, Article Paper LBW600, 6 pages. https://doi.org/10.1145/3170427.3188658

Digital Library

[50]

Valentin Lohmüller and Christian Wolff. 2019. Towards a Comprehensive Definition of Second Screen. In Proceedings of Mensch Und Computer 2019(MuC’19). Association for Computing Machinery, New York, NY, USA, 167–177. https://doi.org/10.1145/3340764.3340781

Digital Library

[51]

Víctor Manuel López Jaquero, Radu-Daniel Vatavu, Jose Ignacio Panach, Oscar Pastor, and Jean Vanderdonckt. 2019. A Newcomer’s Guide to EICS, the Engineering Interactive Computing Systems Community. Proc. ACM Hum.-Comput. Interact. 3, EICS, Article Article 1 (June 2019), 9 pages. https://doi.org/10.1145/3300960

Digital Library

[52]

Artur Lugmayr, Bjoern Stockleben, Thomas Risse, Juha Kaario, and Bogdan Pogorelc. 2013. New Business, Design and Models to Create Semantic Ambient Media Experiences. Multimedia Tools Appl. 66, 1 (Sept. 2013), 1–5. https://doi.org/10.1007/s11042-012-1239-1

Digital Library

[53]

Steve Mann. 1999. Mediated Reality. Linux J. 1999, 59es (March 1999), 1. https://doi.org/10.5555/327697.327702

Digital Library

[54]

Steve Mann, Tom Furness, Yu Yuan, Jay Iorio, and Zixin Wang. 2018. All Reality: Virtual, Augmented, Mixed (X), Mediated (X,Y), and Multimediated Reality. https://arxiv.org/abs/1804.08386

[55]

Bernard Marr. 2019. What Is Extended Reality Technology? A Simple Explanation for Anyone. https://www.forbes.com/sites/bernardmarr/2019/08/12/what-is-extended-reality-technology-a-simple-explanation-for-anyone/#6ffa4ba37249

[56]

Mark McGill, John H. Williamson, and Stephen Brewster. 2016. Examining the Role of Smart TVs and VR HMDs in Synchronous At-a-Distance Media Consumption. ACM Transactions on Computer-Human Interaction 23, 5, Article 33 (Nov. 2016), 57 pages. https://doi.org/10.1145/2983530

Digital Library

[57]

Jennifer McNally and Beth Harrington. 2017. How Millennials and Teens Consume Mobile Video. In Proceedings of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’17). Association for Computing Machinery, New York, NY, USA, 31–39. https://doi.org/10.1145/3077548.3077555

Digital Library

[58]

L.M.J. Meesters, W.A. IJsselsteijn, and P.J.H. Seuntiens. 2004. A Survey of Perceptual Evaluations and Requirements of Three-Dimensional TV. IEEE Transactions on Circuits and Systems for Video Technology 14, 3 (March 2004), 381–391. https://doi.org/10.1109/TCSVT.2004.823398

Digital Library

[59]

Microsoft. [n.d.]. Windows Mixed Reality. https://www.microsoft.com/en-gb/windows/windows-mixed-reality

[60]

Paul Milgram and Herman Colquhoun Jr.1999. A Taxonomy of Real and Virtual World Display Integration. Springer, Berlin, Heidelberg.

[61]

Paul Milgram and Fumio Kishino. 1994. A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information and Systems E77-D, 12 (December 1994), 1321–1329.

[62]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented Reality: A Class of Displays on the Reality-Virtuality Continuum. In Proceedings of the Society of Photo-Optical Instrumentation Engineers 2351, Telemanipulator and Telepresence Technologies, Vol. 2351. https://doi.org/10.1117/12.197321

[63]

Keith Mitchell, Andrew Jones, Johnathan Ishmael, and Nicholas J.P. Race. 2010. Social TV: Toward Content Navigation Using Social Awareness. In Proc. of the 8th European Conference on Interactive TV and Video(EuroITV ’10). Association for Computing Machinery, New York, NY, USA, 283–292. https://doi.org/10.1145/1809777.1809833

Digital Library

[64]

Mukesh Nathan, Chris Harrison, Svetlana Yarosh, Loren Terveen, Larry Stead, and Brian Amento. 2008. CollaboraTV: Making Television Viewing Social Again. In Proceedings of the 1st International Conference on Designing Interactive User Experiences for TV and Video(UXTV ’08). Association for Computing Machinery, New York, NY, USA, 85–94. https://doi.org/10.1145/1453805.1453824

Digital Library

[65]

Netflix. 2018. Black Mirror: Bandersnatch. https://www.netflix.com/gb/title/80988062

[66]

Nielsen. 2018. Streamers Show Strong Ties with Traditional TV. https://www.nielsen.com/us/en/insights/news/2018/streamers-showstrong-ties-with-traditional-tv.html

[67]

Lyndon Nixon, Lotte Belice Baltussen, and Johan Oomen. 2015. LinkedCulture: Browsing Related Europeana Objects While Watching a Cultural Heritage TV Programme. In Proceedings of the 8th International Conference on Personalized Access to Cultural Heritage - Volume 1352(PATCH’15). CEUR-WS.org, Aachen, DEU, 37–40.

[68]

Virpi Oksman, Elina Noppari, Antti Tammela, Maarit Mäkinen, and Ville Ollikainen. 2007. Mobile TV in Everyday Life Contexts: Individual Entertainment or Shared Experiences?. In Proc. of the 5th European Conf. on Interactive TV and Video(EuroITV ’07). Springer, Berlin, Heidelberg, 215–225. https://doi.org/10.1007/978-3-540-72559-6_23

[69]

H. M. Ozaktas and L. Onural. 2010. Three-Dimensional Television: Capture, Transmission, Display. Springer, Heidelberg, Germany. http://dx.doi.org/10.1007/978-3-540-72532-9

[70]

J. A. Paradiso and J. A. Landay. 2009. Guest Editors’ Introduction: Cross-Reality Environments. IEEE Pervasive Computing 8, 3 (July 2009), 14–15. https://doi.org/10.1109/MPRV.2009.47

Digital Library

[71]

Bogdan Pogorelc, Artur Lugmayr, Björn Stockleben, Radu-Daniel Vatavu, Nina Tahmasebi, Estefanía Serral, Emilija Stojmenova, Bojan Imperl, Thomas Risse, Gideon Zenz, and Matjaž Gams. 2013. Ambient Bloom: New Business, Content, Design and Models to Increase the Semantic Ambient Media Experience. Multimedia Tools Appl. 66, 1 (Sept. 2013), 7–32. https://doi.org/10.1007/s11042-012-1228-4

Digital Library

[72]

Bogdan Pogorelc, Radu-Daniel Vatavu, Artur Lugmayr, Björn Stockleben, Thomas Risse, Juha Kaario, Estefania Constanza Lomonaco, and Matjaž Gams. 2012. Semantic Ambient Media: From Ambient Advertising to Ambient-Assisted Living. Multimedia Tools Appl. 58, 2 (May 2012), 399–425. https://doi.org/10.1007/s11042-011-0917-8

Digital Library

[73]

Irina Popovici and Radu-Daniel Vatavu. 2019. Consolidating the Research Agenda of Augmented Reality Television with Insights from Potential End-Users. In Proceedings of 2019 IEEE Int. Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)(ISMAR ’19). 73–74. https://doi.org/10.1109/ISMAR-Adjunct.2019.00033

[74]

Irina Popovici and Radu-Daniel Vatavu. 2019. Towards Visual Augmentation of the Television Watching Experience: Manifesto and Agenda. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). ACM, New York, NY, USA, 199–204. https://doi.org/10.1145/3317697.3325121

Digital Library

[75]

Irina Popovici and Radu-Daniel Vatavu. 2019. Understanding Users’ Preferences for Augmented Reality Television. In Proceedings of the 2019 International Symposium on Mixed and Augmented Reality(ISMAR ’19). 269–278. https://doi.org/10.1109/ISMAR.2019.00024

[76]

Irina Popovici, Radu-Daniel Vatavu, and Wenjun Wu. 2019. TV Channels in Your Pocket! Linking Smart Pockets to Smart TVs. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 193–198. https://doi.org/10.1145/3317697.3325119

Digital Library

[77]

Qualcomm. [n.d.]. Extended Reality XR | Immersive VR | Qualcomm. https://www.qualcomm.com/invention/extended-reality

[78]

Glenda Revelle, Emily Reardon, Kristin Cook, Lori Takeuchi, Rafael Ballagas, Koichi Mori, Hiroshi Horii, Hayes Raffle, Maria Sandberg, and Mirjana Spasojevic. 2015. Electric Agents: Combining Collaborative Mobile Augmented Reality and Web-Based Video to Reinvent Interactive Television. Computers in Entertainment 12, 3, Article 1 (Feb. 2015), 21 pages. https://doi.org/10.1145/2702109.2633413

Digital Library

[79]

Asreen Rostami, Chiara Rossitto, and Annika Waern. 2018. Frictional Realities: Enabling Immersion in Mixed-Reality Performances. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’18). Association for Computing Machinery, New York, NY, USA, 15–27. https://doi.org/10.1145/3210825.3210827

Digital Library

[80]

Pejman Saeghe, Sarah Clinch, Bruce Weir, Maxine Glancy, Vinoba Vinayagamoorthy, Ollie Pattinson, Stephen Robert Pettifer, and Robert Stevens. 2019. Augmenting Television With Augmented Reality. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). ACM, New York, NY, USA, 255–261. https://doi.org/10.1145/3317697.3325129

Digital Library

[81]

Ovidiu-Andrei Schipor, Radu-Daniel Vatavu, and Wenjun Wu. 2019. SAPIENS: Towards Software Architecture to Support Peripheral Interaction in Smart Environments. Proceedings of the ACM on Human-Computer Interaction 3, EICS, Article Article 11 (June 2019), 24 pages. https://doi.org/10.1145/3331153

Digital Library

[82]

Albrecht Schmidt, Hans-Werner Gellersen, and Michael Beigl. 1999. Matching Information and Ambient Media. In Proceedings of the Second International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture(CoBuild ’99). Springer-Verlag, Berlin, Heidelberg, 140–149. https://doi.org/10.1007/10705432_13

[83]

Hanna Kathrin Schraffenberger. 2018. Arguably Augmented Reality: Relationships Between the Virtual and the Real. Ph.D. Dissertation. Leiden University, The Netherlands. http://www.arguablyar.com/

[84]

Jenny Scribani. 2019. What is Extended Reality (XR)?https://www.visualcapitalist.com/extended-reality-xr/

[85]

José Somolinos. 2019. Augmented Reality Disrupts Television. https://medium.com/@josesomolinos/augmented-reality-disrupts-television-9d79ed01f27

[86]

Rafael Sotelo, Jose Joskowicz, and Nicolás Rondan. 2017. Experiences on Hybrid Television and Augmented Reality on ISDB-T. In 2017 IEEE Int. Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). IEEE, 1–5. https://doi.org/10.1109/BMSB.2017.7986231

[87]

Maximilian Speicher, Brian D. Hall, and Michael Nebeling. 2019. What is Mixed Reality?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, Article Paper 537, 15 pages. https://doi.org/10.1145/3290605.3300767

Digital Library

[88]

J. Stauder and P. Robert. 2002. Let the Sunshine on Your Screen: Introducing Augmented Reality into Interactive Television. In Proceedings of the IEEE International Conference on Multimedia and Expo, Vol. 1. 837–840 vol.1. https://doi.org/10.1109/ICME.2002.1035912

[89]

Ivan E. Sutherland. 1968. A Head-Mounted Three Dimensional Display. In Proceedings of the December 9-11, 1968, Fall Joint Computer Conference, Part I(AFIPS ’68 (Fall, part I)). ACM, New York, NY, USA, 757–764. https://doi.org/10.1145/1476589.1476686

Digital Library

[90]

Raphael Tang, Ferhan Ture, and Jimmy Lin. 2019. Yelling at Your TV: An Analysis of Speech Recognition Errors and Subsequent User Behavior on Entertainment Systems. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR ’19). Association for Computing Machinery, New York, NY, USA, 853–856. https://doi.org/10.1145/3331184.3331271

Digital Library

[91]

TIME. 2017. Facebook Reveals Augmented Reality, Virtual Reality and More at Annual F8 Conference. https://www.youtube.com/watch?v=YtUye84PuFY

[92]

TWiT Tech Podcast Network. 2018. Augmented Reality on Your Television. https://www.youtube.com/watch?v=lpj90PkfPJ8

[93]

[93] Unity.[n.d.]. https://unity3d.com/what-is-xr-glossary

[94]

Radu-Daniel Vatavu. 2012. Point & Click Mediated Interactions for Large Home Entertainment Displays. Multimedia Tools and Applications 59, 1 (2012), 113–128. https://doi.org/10.1007/s11042-010-0698-5

Digital Library

[95]

Radu-Daniel Vatavu. 2012. Presence Bubbles: Supporting and Enhancing Human-Human Interaction with Ambient Media. Multimedia Tools and Applications 58, 2 (2012), 371–383. http://dx.doi.org/10.1007/s11042-010-0674-0

Digital Library

[96]

Radu-Daniel Vatavu. 2012. User-Defined Gestures for Free-Hand TV Control. In Proceedings of the 10th European Conference on Interactive TV and Video(EuroITV ’12). Association for Computing Machinery, New York, NY, USA, 45–48. https://doi.org/10.1145/2325616.2325626

Digital Library

[97]

Radu-Daniel Vatavu. 2013. There’s a World Outside Your TV: Exploring Interactions Beyond the Physical TV Screen. In Proc. of the 11th European Conf. on Interactive TV and Video(EuroITV ’13). ACM, New York, NY, USA, 143–152. https://doi.org/10.1145/2465958.2465972

Digital Library

[98]

Radu-Daniel Vatavu. 2015. Audience Silhouettes: Peripheral Awareness of Synchronous Audience Kinesics for Social Television. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’15). ACM, New York, NY, USA, 13–22. https://doi.org/10.1145/2745197.2745207

Digital Library

[99]

Radu-Daniel Vatavu and Ştefan Gheorghe Pentiuc. 2008. Interactive Coffee Tables: Interfacing TV within an Intuitive, Fun and Shared Experience. In Proceedings of EuroITV ’08, the 6th European Interactive TV Conference(EuroITV ’08). Springer, 183–187. http://dx.doi.org/10.1007/978-3-540-69478-6_24

Digital Library

[100]

Radu-Daniel Vatavu and Ionut-Alexandru Zaiţi. 2014. Leap Gestures for TV: Insights from an Elicitation Study. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’14). Association for Computing Machinery, New York, NY, USA, 131–138. https://doi.org/10.1145/2602299.2602316

Digital Library

[101]

Carlos Velasco, Yunwen Tu, and Marianna Obrist. 2018. Towards Multisensory Storytelling with Taste and Flavor. In Proceedings of the 3rd International Workshop on Multisensory Approaches to Human-Food Interaction(MHFI ’18). Association for Computing Machinery, New York, NY, USA, Article Article 2, 7 pages. https://doi.org/10.1145/3279954.3279956

Digital Library

[102]

Vinoba Vinayagamoorthy, Penelope Allen, Matt Hammond, and Michael Evans. 2012. Researching the User Experience for Connected TV: A Case Study. In CHI ’12 EA on Human Factors in Computing Systems(CHI EA ’12). Association for Computing Machinery, New York, NY, USA, 589–604. https://doi.org/10.1145/2212776.2212832

Digital Library

[103]

Vinoba Vinayagamoorthy, Maxine Glancy, Paul Debenham, Alastair Bruce, Christoph Ziegler, and Richard Schäffer. 2018. Personalising the TV Experience with Augmented Reality Technology: Synchronised Sign Language Interpretation. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’18). Association for Computing Machinery, New York, NY, USA, 179–184. https://doi.org/10.1145/3210825.3213562

Digital Library

[104]

Vinoba Vinayagamoorthy, Maxine Glancy, Christoph Ziegler, and Richard Schäffer. 2019. Personalising the TV Experience Using Augmented Reality: An Exploratory Study on Delivering Synchronised Sign Language Interpretation. In Proc. of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, Article 532, 12 pages. https://doi.org/10.1145/3290605.3300762

Digital Library

[105]

Vinoba Vinayagamoorthy, Rajiv Ramdhany, and Matt Hammond. 2016. Enabling Frame-Accurate Synchronised Companion Screen Experiences. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’16). ACM, New York, NY, USA, 83–92. https://doi.org/10.1145/2932206.2932214

Digital Library

[106]

John Waterworth and Kei Hoshi. 2016. Human-Experiential Design of Presence in Everyday Blended Reality. Springer, Switzerland. https://www.springer.com/gp/book/9783319303321

[107]

Brian Westover. 2019. How to Connect Alexa to Your Samsung Smart TV. https://www.tomsguide.com/uk/us/samsung-smart-tv-alexa-how-to,news-29557.html

[108]

Jacob O. Wobbrock and Julie A. Kientz. 2016. Research Contributions in Human-Computer Interaction. Interactions 23, 3 (April 2016), 38–44. https://doi.org/10.1145/2907069

Digital Library

[109]

XR Access. [n.d.]. Virtual, Augmented, & Mixed Reality for People with Disabilities. https://xraccess.org/

[110]

Ionut-Alexandru Zaiţi, Ştefan Gheorghe Pentiuc, and Radu-Daniel Vatavu. 2015. On Free-Hand TV Control: Experimental Results on User-Elicited Gestures with Leap Motion. Pers. Ubiq. Computing 19, 5-6 (2015), 821–838. http://dx.doi.org/10.1007/s00779-015-0863-y

[111]

Zenith Media. [n.d.]. Media Consumption Forecasts 2018. https://www.zenithmedia.com/product/media-consumption-forecasts2018

[112]

C. Zimmer, N. Ratz, M. Bertram, and C. Geiger. 2018. War Children: Using AR in a Documentary Context. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 390–394. https://doi.org/10.1109/ISMAR-Adjunct.2018.00112

Cited By

Caldera-Serrano J(2024)Aplicaciones de la Realidad Aumentada desde los Servicios de Documentación Audiovisual de las televisionesCuadernos de Documentación Multimedia10.5209/cdmu.9534334(e95343)Online publication date: 21-Jun-2024
https://doi.org/10.5209/cdmu.95343
Bose DBrown CFilkov VRay BZhou M(2024)An Empirical Study on Current Practices and Challenges of Core AR/VR DevelopersProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering Workshops10.1145/3691621.3694956(233-238)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691621.3694956
Mathis F(2024)Everyday Life Challenges and Augmented Realities: Exploring Use Cases For, and User Perspectives on, an Augmented Everyday LifeProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652921(52-62)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652921
Show More Cited By

Recommendations

The User Experience of Journeys in the Realm of Augmented Reality Television
IMX '22: Proceedings of the 2022 ACM International Conference on Interactive Media Experiences

Augmented Reality Television (ARTV) can take many forms, from AR content displayed outside the TV frame to video-projected TV screens to social TV watching in VR to immersive holograms in the living room. While the user experience (UX) of individual ...
Augmenting Television With Augmented Reality
TVX '19: Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video

This paper explores the effects of adding augmented reality (AR) artefacts to an existing TV programme. A prototype was implemented augmenting a popular nature documentary. Synchronised content was delivered over a Microsoft HoloLens and a TV. Our ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

June 2020

211 pages

ISBN:9781450379762

DOI:10.1145/3391614

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2020

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

IMX '20

Sponsor:

IMX '20: ACM International Conference on Interactive Media Experiences

June 17 - 19, 2020

Cornella, Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
3,647
Total Downloads

Downloads (Last 12 months)848
Downloads (Last 6 weeks)63

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Caldera-Serrano J(2024)Aplicaciones de la Realidad Aumentada desde los Servicios de Documentación Audiovisual de las televisionesCuadernos de Documentación Multimedia10.5209/cdmu.9534334(e95343)Online publication date: 21-Jun-2024
https://doi.org/10.5209/cdmu.95343
Bose DBrown CFilkov VRay BZhou M(2024)An Empirical Study on Current Practices and Challenges of Core AR/VR DevelopersProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering Workshops10.1145/3691621.3694956(233-238)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691621.3694956
Mathis F(2024)Everyday Life Challenges and Augmented Realities: Exploring Use Cases For, and User Perspectives on, an Augmented Everyday LifeProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652921(52-62)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652921
Christie IMcgill MBrewster S(2024)Welcome to the Jungle: Using ARTV to Balance Media Immersion and Reality Awareness for Passengers on Public TransportProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656321(219-230)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656321
Bouquet EVon Der Au SSchneegass CAlt F(2024)CoAR-TV: Design and Evaluation of Asynchronous Collaboration in AR-Supported TV ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656320(231-245)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656320
Abraham MMcgill MKhamis M(2024)What You Experience is What We Collect: User Experience Based Fine-Grained Permissions for Everyday Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642668(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642668
O'Hagan JGugenheimer JBonner JMathis FMcGill M(2023)Augmenting People, Places & Media: The Societal Harms Posed by Everyday Augmented Reality, and the Case for Perceptual Human RightsProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627782(225-235)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627782
Vatavu R(2023)Leveraging Sensorimotor Realities for Assistive Technology Design Bridging Smart Environments and Virtual WorldsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594834(247-253)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594834
Pamparău CSchipor ODancu AVatavu R(2023)SAPIENS in XR: operationalizing interaction-attention in extended realityVirtual Reality10.1007/s10055-023-00776-127:3(1765-1781)Online publication date: 22-Feb-2023
https://doi.org/10.1007/s10055-023-00776-1
Geary DFrancombe JHentschel KMurphy D(2022)Design Dimensions of Co-Located Multi-Device Audio ExperiencesApplied Sciences10.3390/app1215751212:15(7512)Online publication date: 26-Jul-2022
https://doi.org/10.3390/app12157512
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten