Work in Progress

Going Beyond Second Screens: Applications for the Multi-display Intelligent Living Room

Authors:

Asterios Leonidis,

Vasilios Kouroumalis,

Emmanouil Adamakis,

Dimitrios Milathianakis,

Constantine StephanidisAuthors Info & Claims

IMX '21: Proceedings of the 2021 ACM International Conference on Interactive Media Experiences

Pages 187 - 193

https://doi.org/10.1145/3452918.3465486

Published: 23 June 2021 Publication History

Abstract

This work aims to investigate how the amenities offered by Intelligent Environments can be used to shape new types of useful, exciting and fulfilling experiences while watching sports or movies. Towards this direction, two ambient media players were developed aspiring to offer live access to secondary information via the available displays of an Intelligent Living Room, and to appropriately exploit the technological equipment so as to support natural interaction. Expert-based evaluation experiments revealed some factors that can influence the overall experience significantly, without hindering the viewers’ immersion to the main media.

References

[1]

Chadia Abras, Diane Maloney-Krichmar, and Jenny Preece. 2004. User-centered design. Bainbridge, W. Encyclopedia of Human-Computer Interaction. Thousand Oaks: Sage Publications 37, 4: 445–456.

[2]

Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The internet of things: A survey. Computer networks 54, 15: 2787–2805.

[3]

Alexandra Barka, Asterios Leonidis, Margherita Antona, and Constantine Stephanidis. 2017. A Unified Interactive System for Controlling a Smart Home. Proceedings of the ACM Europe Celebration of Women in Computing (womENcourage 2017), 6–8.

[4]

Frank R. Bentley. 2017. Understanding Secondary Content Practices for Television Viewing. Proceedings of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, Association for Computing Machinery, 123–128.

Digital Library

[5]

Fernando Vannier Borges. Always Together: How Football Clubs Want Constant Connections with Fans. The Athens Journal of Sports: 263.

[6]

Barry Brumitt, Brian Meyers, John Krumm, Amanda Kern, and Steven Shafer. 2000. Easyliving: Technologies for intelligent environments. International Symposium on Handheld and Ubiquitous Computing, Springer, 12–29.

[7]

Pedro Centieiro, Teresa Romão, and A. Eduardo Dias. 2014. From the Lab to the World: Studying Real-Time Second Screen Interaction with Live Sports. Proceedings of the 11th Conference on Advances in Computer Entertainment Technology, Association for Computing Machinery.

[8]

Ailsa Chapman. 2016. What we can learn from… Living rooms. Early Years Educator 18, 2: ii–iv.

[9]

CORDIS EU research results. The ultimate companion app for enhanced movie or series watching experience. Retrieved March 31, 2021 from https://cordis.europa.eu/article/id/122147-the-ultimate-companion-app-for-enhanced-movie-or-series-watching-experience.

[10]

Nicole R. Cunningham and Matthew S. Eastin. 2017. Second screen and sports: A structural investigation into team identification and efficacy. Communication & Sport 5, 3: 288–310.

[11]

Soumaya El Kadiri, Bernard Grabot, Klaus-Dieter Thoben, 2016. Current trends on ICT technologies for enterprise information systems. Computers in Industry 79: 14–33.

Digital Library

[12]

Walter Gantz. 2013. Reflections on communication and sport: On fanship and social relationships. Communication & Sport 1, 1–2: 176–187.

[13]

David Geerts, Rinze Leenheer, Dirk De Grooff, Joost Negenman, and Susanne Heijstraten. 2014. In front of and behind the second screen: viewer and producer perspectives on a companion app. Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, ACM, 95–102.

Digital Library

[14]

Google. 2012. The New Multi-Screen World: Understanding Cross-platform Consumer Behavior. Retrieved March 31, 2021 from http://services.google.com/fh/files/misc/multiscreenworld_final.pdf.

[15]

Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: peripheral projected illusions for interactive experiences. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 869–878.

[16]

Maria Korozi, Asterios Leonidis, Margherita Antona, and Constantine Stephanidis. 2017. Lector: Towards Reengaging Students in the Educational Process inside Smart Classrooms. Springer.

[17]

Asterios Leonidis, Dimitrios Arampatzis, Nikolaos Louloudakis, and Constantine Stephanidis. 2017. The AmI-Solertis system: creating user experiences in smart environments. 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), IEEE, 151–158.

[18]

Asterios Leonidis, Maria Korozi, Vassilis Kouroumalis, 2019. Ambient intelligence in the living room. Sensors 19, 22: 5011.

[19]

Mark Lochrie and Paul Coulton. 2012. Sharing the viewing experience through second screens. Proceedings of the 10th European conference on Interactive tv and video, ACM, 199–202.

Digital Library

[20]

Davit Marikyan, Savvas Papagiannidis, and Eleftherios Alamanos. 2019. A systematic review of the smart home literature: A user perspective. Technological Forecasting and Social Change 138: 139–154.

[21]

Meredith Ringel Morris. 2004. Benefits and Challenges of Tabletop Peripheral Displays. Adjunct Proceedings of UbiComp 2004.

[22]

Abhishek Nandakumar and Janet Murray. 2014. Companion apps for long arc TV series: supporting new viewers in complex storyworlds with tightly synchronized context-sensitive annotations. Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, 3–10.

Digital Library

[23]

Timothy Neate, Matt Jones, and Michael Evans. 2015. Mediating attention for second screen companion content. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 3103–3106.

Digital Library

[24]

Florian Pfeffel, Peter Kexel, Christoph A. Kexel, and Maria Ratz. 2016. Second screen: User behaviour of spectators while watching football. Athens Journal of Sports 3, 2: 119–128.

[25]

Hasso Plattner, Christoph Meinel, and Ulrich Weinberg. 2009. Design-thinking. Springer.

[26]

Irina Popovici and Radu-Daniel Vatavu. 2019. Towards Visual Augmentation of the Television Watching Experience: Manifesto and Agenda. Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video, Association for Computing Machinery, 199–204.

Digital Library

[27]

Bridget Rubenking and Nicky Lewis. 2016. The sweet spot: An examination of second-screen sports viewing. International Journal of Sport Communication 9, 4: 424–439.

[28]

Pejman Saeghe, Sarah Clinch, Bruce Weir, 2019. Augmenting Television With Augmented Reality. Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video, Association for Computing Machinery, 255–261.

Digital Library

[29]

Neelima Sailaja, Andy Crabtree, James Colley, 2019. The Living Room of the Future. Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video, Association for Computing Machinery, 95–107.

Digital Library

[30]

Evropi Stefanidi, Dimitrios Arampatzis, Asterios Leonidis, Maria Korozi, Margherita Antona, and George Papagiannakis. 2020. MagiPlay: An Augmented Reality Serious Game Allowing Children to Program Intelligent Environments. In Transactions on Computational Science XXXVII. Springer, 144–169.

[31]

Evropi Stefanidi, Michalis Foukarakis, Dimitrios Arampatzis, Maria Korozi, Asterios Leonidis, and Margherita Antona. 2019. ParlAmI: a multimodal approach for programming intelligent environments. Technologies 7, 1: 11.

[32]

Emmanuel Tsekleves, Roger Whitham, Koko Kondo, and Annette Hill. 2011. Investigating media use and the television user experience in the home. Entertainment computing 2, 3: 151–161.

[33]

Radu-Daniel Vatavu, Pejman Saeghe, Teresa Chambel, Vinoba Vinayagamoorthy, and Marian F Ursu. 2020. Conceptualizing Augmented Reality Television for the Living Room. ACM International Conference on Interactive Media Experiences, Association for Computing Machinery, 1–12.

[34]

Ryan P. Vooris and Chase ML Smith. 2015. Reflections of two-screen users: How people use information technology while watching sports. International Public Health Journal 7, 4: 383.

[35]

Sherryl Wilson. 2016. In the living room: Second screens and TV audiences. Television & new media 17, 2: 174–191.

Cited By

Pamparău CVatavu R(2022)The User Experience of Journeys in the Realm of Augmented Reality TelevisionProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529969(161-174)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529969
Leonidis AKorozi MAntona MStephanidis C(2022)Interaction in Smart CitiesHuman-Automation Interaction10.1007/978-3-031-10788-7_30(513-564)Online publication date: 15-Dec-2022
https://doi.org/10.1007/978-3-031-10788-7_30

Recommendations

Going beyond the display: a surface technology with an electronically switchable diffuser
UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technology

We introduce a new type of interactive surface technology based on a switchable projection screen which can be made diffuse or clear under electronic control. The screen can be continuously switched between these two states so quickly that the change is ...
Wrestling with Destiny: Storytelling in Perennial Games
Interactive Storytelling
Abstract
“Games-as-a-service” games like League of Legends, Destiny, and Fortnite have been overlooked in terms of how their storytelling contributes to the audience’s experience. This paper wants to rectify that by defining these games as storytelling ...
The living wall display: physical augmentation of interactive content using an autonomous mobile display
SA '18: SIGGRAPH Asia 2018 Emerging Technologies

The Living Wall Display displays interactive content on a mobile wall screen that moves in concert with content animation. To augment the interaction experience, the display dynamically changes its position and orientation, responding to the content ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMX '21: Proceedings of the 2021 ACM International Conference on Interactive Media Experiences

June 2021

331 pages

ISBN:9781450383899

DOI:10.1145/3452918

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 June 2021

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

IMX '21

Sponsor:

IMX '21: ACM International Conference on Interactive Media Experiences

June 21 - 23, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
99
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pamparău CVatavu R(2022)The User Experience of Journeys in the Realm of Augmented Reality TelevisionProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529969(161-174)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529969
Leonidis AKorozi MAntona MStephanidis C(2022)Interaction in Smart CitiesHuman-Automation Interaction10.1007/978-3-031-10788-7_30(513-564)Online publication date: 15-Dec-2022
https://doi.org/10.1007/978-3-031-10788-7_30

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents