research-article

Open access

HCI over multiple screens

Authors:

Simon HarperAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 665 - 674

https://doi.org/10.1145/2559206.2578869

Published: 26 April 2014 Publication History

Abstract

Mobile devices are playing an increasingly important role in leisure activities, including TV viewing. Broadcasters see this as an opportunity to enhance a TV programme through the provision of additional information to the 'second screen', but determining how to optimise this experience is one of the grand challenges currently facing content providers. Addressing this issue requires a detailed understanding of interaction with both the TV and the secondary device, but this new form of HCI, as much about passive consumption as active interaction, is not well represented by typical task-based paradigms. This paper describes experiments that use eye tracking to understand one of the key components of this new area of study - determining which device is currently receiving the user's attention - and discusses the considerable challenge of accurately monitoring attention while maintaining ecological validity.

References

[1]

Ali, A., Wong, E., Subramanyam, R., Cushman, P., Morel, B., Hawari, A. K., Shinde, M., Meeker, G., Gill, D., Paquette, A., and Moskowitz, J. Mobile shopping framework. the role of mobile devices in the shopping process. Tech. rep., Yahoo! and The Nielsen Foundation, 2010.

[2]

Bardram, J., Gueddana, S., Houben, S., and Nielsen, S. Reticularspaces: Activity-based computing support for physically distributed and collaborative smart spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (New York, NY, USA, 2012), 2845--2854.

Digital Library

[3]

Basapur, S., Harboe, G., Mandalia, H., Novak, A., Vuong, V., and Metcalf, C. Field trial of a dual device user experience for itv. In Proceddings of the 9th International Interactive Conference on Interactive Television, EuroITV '11, ACM (New York, NY, USA, 2011), 127--136.

Digital Library

[4]

Caroline Jay, Andy Brown, M. G. M. S. H. Attention approximation: from the web to multi-screen television. In Exploring and Enhancing the User Experience for Television: A workshop at CHI, acm (2013).

[5]

Centieiro, P. Bringing the sport stadium atmosphere to remote fans. In Proceedings of the 21st ACM International Conference on Multimedia, MM '13, ACM (New York, NY, USA, 2013), 1063--1066.

Digital Library

[6]

Chen, N., Guimbretiére, F., and Sellen, A. Graduate student use of a multi-slate reading system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, ACM (New York, NY, USA, 2013), 1799--1808.

Digital Library

[7]

Chorianopoulos, K. User interface design principles for interactive television applications. International Journal of Human-Computer Interaction 24, 6 (2008), 556--573.

[8]

Cruickshank, L., Tsekleves, E., Whitham, R., Hill, A., and Kondo, K. Making interactive tv easier to use: Interface design for a second screen approach. The Design Journal 10, 3 (2007), 41--53.

[9]

Duong, N. Q., Howson, C., and Legallais, Y. Fast second screen tv synchronization combining audio fingerprint technique and generalized cross correlation. In Consumer Electronics-Berlin (ICCE-Berlin), 2012 IEEE International Conference on, IEEE (2012), 241--244.

[10]

Hennecke, F., Matzke, W., and Butz, A. How screen transitions influence touch and pointer interaction across angled display arrangements. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (New York, NY, USA, 2012), 209--212.

Digital Library

[11]

Hennessey, C., and Fiset, J. Long range eye tracking: Bringing eye tracking into the living room. In Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA '12, ACM (New York, NY, USA, 2012), 249--252.

Digital Library

[12]

Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F., and Balakrishnan, R. Codex: A dual screen tablet computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09, ACM (New York, NY, USA, 2009), 1933--1942.

Digital Library

[13]

Holmes, M. E., Josephson, S., and Carney, R. E. Visual attention to television programs with a second-screen application. In Proceedings of the Symposium on Eye Tracking Research and Applications, ACM (2012), 397--400.

Digital Library

[14]

Hornof, A. J., Zhang, Y., and Halverson, T. Knowing where and when to look in a time-critical multimodal dual task. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, ACM (New York, NY, USA, 2010), 2103--2112.

Digital Library

[15]

Howson, C., Gautier, E., Gilberton, P., Laurent, A., and Legallais, Y. Second screen tv synchronization. In Consumer Electronics-Berlin (ICCE-Berlin), 2011 IEEE International Conference on, IEEE (2011), 361--365.

[16]

Hutchings, D. An investigation of fitts' law in a multiple-display environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (New York, NY, USA, 2012), 3181--3184.

Digital Library

[17]

Jain, J., Evans, M., and Vinayagamoorthy, V. Exploring and enhancing the user experience for tv. In CHI '13 Extended Abstracts on Human Factors in Computing Systems, CHI EA '13, ACM (New York, NY, USA, 2013), 3187--3190.

Digital Library

[18]

Jones, T. Designing for second screens: The autumnwatch companion. http://www.bbc.co.uk/blogs/researchanddevelopment/2011/04/the-autumnwatch-companion-de.shtml, last accessed 2013-12-12.

[19]

Kern, D., Marshall, P., and Schmidt, A. Gazemarks: Gaze-based visual placeholders to ease attention switching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, ACM (New York, NY, USA, 2010), 2093--2102.

Digital Library

[20]

Murray, J., Goldenberg, S., Agarwal, K., Chakravorty, T., Cutrell, J., Doris-Down, A., and Kothandaraman, H. Story-map: Ipad companion for long form tv narratives. In Proceedings of the 10th European Conference on Interactive Tv and Video, EuroiTV '12, ACM (New York, NY, USA, 2012), 223--226.

Digital Library

[21]

Pirker, M. M., and Bernhaupt, R. Measuring user experience in the living room: Results from an ethnographically oriented field study indicating major evaluation factors. In Proceddings of the 9th International Interactive Conference on Interactive Television, EuroITV '11, ACM (New York, NY, USA, 2011), 79--82.

Digital Library

[22]

Vanattenhoven, J., and Geerts, D. Second-screen use in the home: An ethnographic study. In Proceedings 3rd International Workshop on Future Television, EuroITV 2012, Springer (Berlin, 2012), 162--173.

[23]

Vinayagamoorthy, V., Allen, P., Hammond, M., and Evans, M. Researching the user experience for connected tv: A case study. In CHI '12 Extended Abstracts on Human Factors in Computing Systems, CHI EA '12, ACM (New York, NY, USA, 2012), 589--604.

Digital Library

[24]

Wallace, J. R., Scott, S. D., and MacGregor, C. G. Collaborative sensemaking on a digital tabletop and personal tablets: Prioritization, comparisons, and tableaux. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, ACM (New York, NY, USA, 2013), 3345--3354.

Digital Library

Cited By

Li QXu ZChen Y(2025)Understanding college students’ cross-device learning behavior in the wild: Device ecologies, physical configurations, usage patterns, and attention issuesComputers & Education10.1016/j.compedu.2025.105259(105259)Online publication date: Feb-2025
https://doi.org/10.1016/j.compedu.2025.105259
Zhou XLee BOrtega FBatmaz AYang Y(2024)Lights, Headset, Tablet, Action: Exploring the Use of Hybrid User Interfaces for Immersive Situated AnalyticsProceedings of the ACM on Human-Computer Interaction10.1145/36981478:ISS(517-539)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698147
Khan TRashid UKhan A(2024)End-to-end pseudo relevance feedback based vertical web search queries recommendationMultimedia Tools and Applications10.1007/s11042-024-18559-4Online publication date: 21-Feb-2024
https://doi.org/10.1007/s11042-024-18559-4
Show More Cited By

Index Terms

HCI over multiple screens
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Designing attention for multi-screen TV experiences
British HCI '15: Proceedings of the 2015 British HCI Conference

In this Work-In-Progress we discuss our work on designing attention for multi-screen TV experiences. We first briey describe the current trends, and then progress to touch on two investigations we have conducted. In the first study we look at current ...
Dynamic Subtitles: The User Experience
TVX '15: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

Subtitles (closed captions) on television are typically placed at the bottom-centre of the screen. However, placing subtitles in varying positions, according to the underlying video content (`dynamic subtitles'), has the potential to make the overall ...
Interactive Coffee Tables: Interfacing TV within an Intuitive, Fun and Shared Experience
EUROITV '08: Proceedings of the 6th European conference on Changing Television Environments

Watching television is usually a shared experience allowing family or friends that share the same viewing interests to watch, comment and enjoy programs together. The interaction part however is at the opposite end being reduced to the traditional ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
1,755
Total Downloads

Downloads (Last 12 months)166
Downloads (Last 6 weeks)32

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li QXu ZChen Y(2025)Understanding college students’ cross-device learning behavior in the wild: Device ecologies, physical configurations, usage patterns, and attention issuesComputers & Education10.1016/j.compedu.2025.105259(105259)Online publication date: Feb-2025
https://doi.org/10.1016/j.compedu.2025.105259
Zhou XLee BOrtega FBatmaz AYang Y(2024)Lights, Headset, Tablet, Action: Exploring the Use of Hybrid User Interfaces for Immersive Situated AnalyticsProceedings of the ACM on Human-Computer Interaction10.1145/36981478:ISS(517-539)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698147
Khan TRashid UKhan A(2024)End-to-end pseudo relevance feedback based vertical web search queries recommendationMultimedia Tools and Applications10.1007/s11042-024-18559-4Online publication date: 21-Feb-2024
https://doi.org/10.1007/s11042-024-18559-4
Shen VHarrison C(2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556620
Lohmüller VEiermann PZeitlhöfler PWolff C(2019)Attention Guidance in Second Screen ApplicationsProceedings of Mensch und Computer 201910.1145/3340764.3340788(179-187)Online publication date: 8-Sep-2019
https://dl.acm.org/doi/10.1145/3340764.3340788
Lohmüller VWolff C(2019)Towards a Comprehensive Definition of Second ScreenProceedings of Mensch und Computer 201910.1145/3340764.3340781(167-177)Online publication date: 8-Sep-2019
https://dl.acm.org/doi/10.1145/3340764.3340781
Ozimek ALewandowska PKrejtz KDuchowski AKrejtz KSharif B(2019)Attention towards privacy notifications on web pagesProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3317960.3321618(1-5)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3317960.3321618
Sailaja NCrabtree AColley JGradinar ACoulton PForrester IKerlin LStenton P(2019)The Living Room of the FutureProceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3323360(95-107)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3323360
Ozimek ALewandowska PKrejtz KDuchowski A(2019)Attention towards privacy notifications on web pagesProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications - ETRA '1910.1145/3314111.3321618(1-5)Online publication date: 2019
https://doi.org/10.1145/3314111.3321618
Brown AAizpurua AJay CEvans MGlancy MHarper S(2019)Contrasting delivery modes for second screen TV content—Push or pull?International Journal of Human-Computer Studies10.1016/j.ijhcs.2019.03.007129:C(15-26)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.ijhcs.2019.03.007
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten