research-article

There's a world outside your TV: exploring interactions beyond the physical TV screen

Author:

Radu-Daniel VatavuAuthors Info & Claims

EuroITV '13: Proceedings of the 11th European Conference on Interactive TV and Video

Pages 143 - 152

https://doi.org/10.1145/2465958.2465972

Published: 24 June 2013 Publication History

Abstract

We explore interactions in the space surrounding the TV set, and use this space as a canvas to display additional TV content in the form of projected screens and customized controls and widgets. We present implementation details for a prototype that creates a hybrid, physical-projected, augmented TV space with off-the-shelf, low-cost technical equipment. The results of a participatory design study are reported to inform development of interaction techniques for multimedia content that spans the physical-projected TV space. We report a set of commands for twelve frequently-used TV tasks and compile guidelines for designing interactions for augmented TV spaces. With this work, we plan to make TV interface designers aware of the many opportunities offered by the space around the physical TV screen once turned interactive. It is our hope that this very first investigation of the interactive potential of the area surrounding the TV set will encourage new explorations of augmented TV spaces, and will foster the design of new applications and new entertainment experiences for our interactive, smart TV spaces of the future.

References

[1]

Agarawala, A., Balakrishnan, R. 2006. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 1283--1292

Digital Library

[2]

Alfaro, S., Bove, V.M. 2011. Surround vision: a hand-held screen for accessing peripheral content around a main screen. In Proceedings of the 4th international conference on Interactive Digital Storytelling (ICIDS'11). Springer-Verlag, Berlin, Heidelberg, 342--345

Digital Library

[3]

Bailly, G., Vo, D.B., Lecolinet, E., Guiard, Y. 2011. Gesture-aware remote controls: guidelines and interaction technique. In Proceedings of the 13th international conference on multimodal interfaces (ICMI '11). ACM, New York, NY, USA, 263--270

Digital Library

[4]

Basapur, S., Mandalia, H., Chaysinh, S., Lee, Y., Venkitaraman, N., Metcalf, C. 2012. FANFEEDS: evaluation of socially generated information feed on second screen as a TV show companion. In Proceedings of the 10th European conference on Interactive TV and video (EuroiTV '12). ACM, New York, NY, USA, 87--96

Digital Library

[5]

Baudisch, P., Chu, G. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1923--1932

Digital Library

[6]

Benko, H., Saponas, T.S., Morris, D., Tan, D. 2009. Enhancing input on and above the interactive surface with muscle sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 93--100

Digital Library

[7]

Bernhaupt, R., Obrist, M., Weiss, A., Beck, E., Tscheligi, M. 2008. Trends in the living room and beyond: results from ethnographic studies using creative and playful probing. Comput. Entertain. 6, 1, Article 5 (May 2008), 23 pages.

Digital Library

[8]

Bobeth, J., Schmehl, S., Kruijff, E., Deutsch, S., Tscheligi, M. 2012. Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In Proceedings of the 10th European conference on Interactive TV and video (EuroiTV '12). ACM, New York, USA, 35--44

Digital Library

[9]

Bolt, R.A. 1980. "Put-that-there": Voice and gesture at the graphics interface. In Proceedings of the 7th annual conference on Computer graphics and interactive techniques (SIGGRAPH '80). ACM, New York, NY, USA, 262--270

Digital Library

[10]

Butler, A., Izadi, S., Hodges, S. 2008. SideSight: multi-"touch" interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, USA, 201--204

Digital Library

[11]

Canizares, A.G. 2006. Fun Rooms: Home Theaters, Music Studios, Game Rooms, and More. Harper Design

[12]

Cao, X., Forlines, C., Balakrishnan, R. 2007. Multi-user interaction using handheld projectors. In Proceedings of the 20th annual ACM symposium on User interface software and technology (UIST '07). ACM, New York, NY, USA, 43--52

Digital Library

[13]

Cesar, P., Chorianopoulos, K. 2009. The Evolution of TV Systems, Content, and Users Toward Interactivity. Foundations and Trends in Human.-Computer Interaction 2 (4), 373--95

Digital Library

[14]

Cesar, P, Bulterman, D.C., Jansen, A.J. 2008. Usages of the Secondary Screen in an Interactive Television Environment: Control, Enrich, Share, and Transfer Television Content. In Proceedings of the 6th European conference on Changing Television Environments (EuroITV '08). Springer-Verlag, Berlin, Heidelberg, 168--177

Digital Library

[15]

Courtois, C., D'heer, E. 2012. Second screen applications and tablet users: constellation, awareness, experience, and interest. In Proceedings of the 10th European conference on Interactive TV and video (EuroITV '12). ACM, New York, NY, USA, 153--156

Digital Library

[16]

Cotting, D., Gross, M. 2006. Interactive environment-aware display bubbles. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 245--254.

Digital Library

[17]

Cruickshank, L., Tsekleves, E., Whitham, R., Hill, A. 2007. Making interactive TV easier to use: interface design for a second screen approach. The Design Journal, 10 (3)

[18]

Freeman, W.T., Weissman, C.D. 1995. Television Control by Hand Gestures. In: Proceedings of the IEEE Int. Workshop on Automatic Face and Gesture Recognition, Zurich

[19]

Harboe, G., Metcalf, C.J., Bentley, F., Tullio, J., Massey, N., Romano, G. 2008. Ambient social tv: drawing people into a shared experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1--10.

Digital Library

[20]

Harrison, C., Ramamurthy, S., Hudson, S.E. 2012. On-body interaction: armed and dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). ACM, NY, USA, 69--76

Digital Library

[21]

Harrison, C., Benko, H., Wilson, A.D. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 441--450

Digital Library

[22]

Hilliges, O., Izadi, S., Wilson, A.D., Hodges, S., Garcia-Mendoza, A., Butz, A. 2009. Interactions in the air: adding further depth to interactive tabletops. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, USA, 139--148

Digital Library

[23]

Hoffman, M., Varcholik, P., LaViola, J.J. Jr. 2010. Breaking the status quo: Improving 3D gesture recognition with spatially convenient input devices. In Proceedings of the 2010 IEEE Virtual Reality Conference (VR '10). IEEE Computer Society, Washington, DC, USA, 59--66

Digital Library

[24]

Ibrahim, A., Johansson, P. 2002. Multimodal dialogue systems for interactive TV applications. In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces (ICMI'02), Pittsburgh, USA, 117--122

Digital Library

[25]

Jensen, J.F. 2005. Interactive television: new genres, new format, new content. In Proceedings of the second Australasian conference on Interactive Entertainment (IE '05). Creativity & Cognition Studios Press, Sydney, 89--96

Digital Library

[26]

Jones, B., Benko, H., Ofek, E., Wilson, A.D. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'13)

Digital Library

[27]

Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M., LaMarca, A. 2009. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 129--138

Digital Library

[28]

Kühnel, C., Westermann, T., Hemmert, F., Kratz, S., Müller, A., Möller, S. 2011. I'm home: Defining and evaluating a gesture set for smart-home control. International Journal of Human-Computer Studies, 69 (11), 693--704

[29]

Lee, J.C. 2008. Hacking the Nintendo Wii Remote. IEEE Pervasive Computing 7(3), July 2008, 39--45

Digital Library

[30]

Malizia, A., Bellucci, A. 2012. The artificiality of natural user interfaces. Communications of the ACM, 55(3), 36--38

Digital Library

[31]

MacKenzie, R., Hawkey, K., Booth, K.S., Liu, Z., Perswain, P., Dhillon, S.S. 2012. LACOME: a multi-user collaboration system for shared large displays. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion (CSCW '12). ACM, New York, USA, 267--268

Digital Library

[32]

Marquardt, N., Jota, R., Greenberg, S., Jorge, J.A. 2011. The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface. In Proc. of the 13th IFIP TC 13 international conference on Human-computer interaction (INTERACT'11). Springer, 461--476

Digital Library

[33]

Mistry, P., Maes, P., Chang, L. 2009. WUW - Wear Ur World: a wearable gestural interface. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 4111--4116

Digital Library

[34]

Natapov, D., Castellucci, S.J., MacKenzie, I.S. 2009. ISO 9241-9 evaluation of video game controllers. In Proceedings of Graphics Interface (GI '09). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 223--230

Digital Library

[35]

Nielsen Group. 2012. The digital revolution: A look through the marketer's lens (April 2012) http://na.ad-tech.com/sf/wp-content/uploads/DigitalConsumer.pdf

[36]

Norman, D.A. 2010. Natural user interfaces are not natural. Interactions 17(3), May 2010, 6--10

Digital Library

[37]

Park, K.L., Park, J.K., Kim, S.D. 2008. An Effective Model and Management Scheme of Personal Space for Ubiquitous Computing Applications. IEEE Transactions on Systems, Man, and Cybernetics. Part A: Systems and Humans, 38(6), November 2008, 1295--1311

Digital Library

[38]

Qin, Q., Rohs, M., Kratz, S. 2011. Dynamic ambient lighting for mobile devices. In Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology (UIST '11 Adjunct). ACM, NY, USA, 51--52

Digital Library

[39]

Rushing, K. 2006. Home Theater Design: Planning and Decorating. Media-Savvy Interiors. Quarry Books

[40]

Schlömer, T., Poppinga, B., Henze, N., Boll, S. 2008. Gesture recognition with a Wii controller. In Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI '08). ACM, New York, NY, USA, 11--14.

Digital Library

[41]

Thomas, B.H. 2012. A survey of visual, mixed, and augmented reality gaming. Computers in Entertainment 10 (3), December 2012, 33 pages

Digital Library

[42]

Vatavu, R.D. 2010. Creativity in Interactive TV: Personalize, Share, and Invent Interfaces. In A. Marcus, A. Cereijo Roibas, R. Sala (Eds.), Mobile TV: Customizing Content and Experience, Springer Human-Computer Interaction Series, Springer London, pp. 121--139

[43]

Vatavu, R.D. 2012. Point & Click Mediated Interactions for Large Home Entertainment Displays. Multimedia Tools and Applications. 59 (1). Springer Netherlands, 113--128

Digital Library

[44]

Vatavu, R.D. 2012. User-defined gestures for free-hand TV control. In Proceedings of the 10th European conference on Interactive TV and video (EuroITV '12). ACM, New York, NY, USA, 45--48

Digital Library

[45]

Vermeulen, J., Slenders, J., Luyten, K., Coninx, K. 2009. I Bet You Look Good on the Wall: Making the Invisible Computer Visible. In Proc. of the 3rd European Conference on Ambient Intelligence (AmI'09). Springer, 196--205

Digital Library

[46]

Wigdor, D., Leigh, D., Forlines, C., Shipman, S., Barnwell, J., Balakrishnan, R., Shen, C. 2006. Under the table interaction. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 259--268

Digital Library

[47]

Wilson, A.D. 2005. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05). ACM, New York, NY, USA, 83--92

Digital Library

[48]

Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D. 2008. Bringing physics to the surface. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, NY, USA, 67--76

Digital Library

[49]

Wilson, A.D., Benko, H. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 273--282

Digital Library

[50]

Wilson, A., Benko, H., Izadi, S., Hilliges, O. 2012. Steerable augmented reality with the beamatron. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, USA, 413--422

Digital Library

[51]

Wobbrock, J.O., Morris, M.R., Wilson, A.D. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1083--1092.

Digital Library

[52]

You, W., Fels, S., Lea, R. 2008. Studying vision-based multiple-user interaction with in-home large displays. In Proceedings of the 3rd ACM international workshop on Human-centered computing (HCC '08). ACM, New York, NY, USA, 19--26

Digital Library

[53]

Ziola, R., Kellar, M., Inkpen, K. 2007. DeskJockey: exploiting passive surfaces to display peripheral information. In Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction (INTERACT'07). Springer Berlin, Heidelberg, 447--460

Digital Library

Cited By

Christie IMcgill MBrewster S(2024)Welcome to the Jungle: Using ARTV to Balance Media Immersion and Reality Awareness for Passengers on Public TransportProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656321(219-230)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656321
Hosseini MMueller HBoll S(2024)Controlling the Rooms: How People Prefer Using Gestures to Control Their Smart HomesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642687(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642687
Ehtesham-Ul-Haque MBillah S(2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610898
Show More Cited By

Index Terms

There's a world outside your TV: exploring interactions beyond the physical TV screen
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

ShapeShifting TV: interactive screen media narratives

This paper presents a paradigm, called ShapeShifting TV, for the realisation of interactive TV narratives or, more generally, of interactive screen-media narratives. These are productions whose narrations respond on the fly (i.e. in real time) to ...
Designing gestural interfaces for the interactive TV
EuroITV '13: Proceedings of the 11th European Conference on Interactive TV and Video

Home entertainment and interactive TV have known fundamental technological advances in the last years by incorporating developments from sensing, processing, and communications technologies. As such systems become more complex and present more options ...
A Model for Interactive TV Storytelling
SBGAMES '09: Proceedings of the 2009 VIII Brazilian Symposium on Games and Digital Entertainment

Interactive storytelling systems are applications to generate and dramatize interactive stories. The main challenge to such systems is the generation of coherent stories while users are watching and interfering with what is happening. In an interactive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EuroITV '13: Proceedings of the 11th European Conference on Interactive TV and Video

June 2013

188 pages

ISBN:9781450319515

DOI:10.1145/2465958

General Chair:
Paolo Paolini
Politecnico di Milano, Italy
,
Program Chairs:
Paolo Cremonesi
Politecnico di Milano, Italy
,
George Lekakos
Athens University of Economics and Business, Greece

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Politecnico di Milano: Politecnico di Milano

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EuroITV '13

Sponsor:

Politecnico di Milano

EuroITV '13: 11th European Conference on Interactive TV and Video

June 24 - 26, 2013

Como, Italy

Acceptance Rates

EuroITV '13 Paper Acceptance Rate 21 of 58 submissions, 36%;

Overall Acceptance Rate 52 of 149 submissions, 35%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
897
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)1

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Christie IMcgill MBrewster S(2024)Welcome to the Jungle: Using ARTV to Balance Media Immersion and Reality Awareness for Passengers on Public TransportProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656321(219-230)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656321
Hosseini MMueller HBoll S(2024)Controlling the Rooms: How People Prefer Using Gestures to Control Their Smart HomesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642687(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642687
Ehtesham-Ul-Haque MBillah S(2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610898
Vatavu R(2023)Leveraging Sensorimotor Realities for Assistive Technology Design Bridging Smart Environments and Virtual WorldsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594834(247-253)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594834
Villarreal-Narvaez SSluÿters AVanderdonckt JMbaki Luzayisu E(2022)Theoretically-Defined vs. User-Defined Squeeze GesturesProceedings of the ACM on Human-Computer Interaction10.1145/35678056:ISS(73-102)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567805
Siean APamparău CVatavu R(2022)Scenario-based Exploration of Integrating Radar Sensing into Everyday Objects for Free-Hand Television ControlProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3532982(357-362)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3532982
Saeghe PWeir BMcGill MClinch SStevens R(2022)Augmenting a Nature Documentary with a Lifelike Hologram in Virtual RealityProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3532974(275-280)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3532974
Pamparău CVatavu R(2022)The User Experience of Journeys in the Realm of Augmented Reality TelevisionProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529969(161-174)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529969
Vatavu R(2022)Are Ambient Intelligence and Augmented Reality Two Sides of the Same Coin? Implications for Human-Computer InteractionExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519710(1-8)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519710
Vatavu R(2022)Designing Interactive Experiences in the Interplay between Ambient Intelligence and Mixed RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503763(1-3)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503763
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents