research-article

Multi-plié: A Linear Foldable and Flattenable Interactive Display to Support Efficiency, Safety and Collaboration

Authors:

Sylvain Pauchet,

Jean-Luc Vinot,

Catherine Letondal,

Alexandre Lemort,

Claire Lavenir,

Timothée Lecomte,

Stéphanie Rey,

Valentin Becquet,

Guillaume CrouzetAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 154, Pages 1 - 13

https://doi.org/10.1145/3290605.3300384

Published: 02 May 2019 Publication History

Abstract

We present the design concept of an accordion-fold interactive display to address the limits of touch-based interaction in airliner cockpits. Based on an analysis of pilot activity, tangible design principles for this design concept are identified. Two resulting functional prototypes are explored during participatory workshops with pilots, using activity scenarios. This exploration validated the design concept by revealing its ability to match pilot responsibilities in terms of safety, efficiency and collaboration. It provides an efficient visual perception of the system for real-time collaborative operations and tangible interaction to strengthen the perception of action and to manage safety through anticipation and awareness. The design work and insights enabled to specify further our needs regarding flexible screens. They also helped to better characterize the design concept as based on continuity of a developed surface, predictability of aligned folds and pleat face roles, embodied interactive properties, and flexibility through affordable reconfigurations.

Supplementary Material

MP4 File (paper154p.mp4)

Preview video

Download
2.98 MB

References

[1]

Alapetite, A., Fogh, R., Zammit-Mangion, D. et al. Direct Tactile Manipulation of the Flight Plan in a Modern Aircraft Cockpit. In Proc. of HCI Aero 2012

[2]

Jason Alexander, Andrés Lucero, and Sriram Subramanian. 2012. Tilt displays: designing display surfaces with multi-axis tilting and actuation. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (MobileHCI '12). ACM, New York, NY, USA, 161--170.

Digital Library

[3]

Jacques Bertin. La graphique et le traitement graphique de l'information. Paris : Flammarion, 1977, 273 p. (translation 1981. Graphics and graphic information-processing by William J. Berg and Paul Scott)

[4]

Cécile Bourgaux, Jacques Cellard. 2013. Les racines grecques et latines du vocabulaire français. De Boeck/Duculot, publishers, ISBN13: 978--2801116944

[5]

Guy A., Boy, 2012. What do we mean by Human-Centered Design of Life-Critical Systems? In Proceedings of the 2012 IEA World Congress on Ergonomics, Recife, Brazil.

[6]

Stephen M. Casner, S.M., Geven, R.W., Recker, M. P. and Schooler, J.W. 2014. The Retention of Manual Flying Skills in the Automated Cockpit. Human Factors: The Journal of the Human Factors and Ergonomics Society.

[7]

Andy Cockburn, Carl Gutwin, Philippe Palanque, Yannick Deleris, Catherine Trask, Ashley Coveney, Marcus Yung, and Karon MacLean. 2017. Turbulent Touch: Touchscreen Input for Cockpit Flight Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6742--6753.

Digital Library

[8]

Marcelo Coelho and Jamie Zigelbaum. 2011. Shape-changing interfaces. Personal Ubiquitous Comput. 15, 2 (February 2011), 161173.

Digital Library

[9]

Philip R. Cohen and David R. McGee. 2004. Tangible multimodal interfaces for safety-critical applications. Commun. ACM 47, 1 (January 2004), 41--46.

Digital Library

[10]

Degani A, Wiener E.L. Cockpit checklists: Concepts, design, and use. Human Factors. 1993;35((2)):28--43.

[11]

Sonia Dodd, Jeff Lancaster, Andrew Miranda, et al. 2014. Touch Screens on the Flight Deck: The Impact of Touch Target Size, Spacing, Touch Technology and Turbulence on Pilot Performance. In Pp. 6--10. SAGE Publications Sage CA: Los Angeles, CA.

[12]

Ken Funk. 1991. Cockpit task management: Preliminary definitions, normative theory, error taxonomy, and design recommendations. The International Journal of Aviation Psychology, 1(4), 271--285.

[13]

David T. Gallant, Andrew G. Seniuk, and Roel Vertegaal. 2008. Towards more paper-like input: flexible input devices for foldable interaction styles. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, NY, USA, 283--286.

Digital Library

[14]

Antonio Gomes and Roel Vertegaal. 2014. Paperfold: a shape changing mobile device with multiple reconfigurable electrophoretic magnetic display tiles. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 535--538.

Digital Library

[15]

Jens Emil Grønbæk, Henrik Korsgaard, Marianne Graves Petersen, Morten Henriksen Birk, and Peter Gall Krogh. 2017. Proxemic Transitions: Designing Shape-Changing Furniture for Informal Meetings. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 7029--7041.

Digital Library

[16]

Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. 2009. Codex: a dual screen tablet computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1933--1942.

Digital Library

[17]

Eva Hornecker and Jacob Buur. 2006. Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), Rebecca Grinter, Thomas Rodden, Paul Aoki, Ed Cutrell, Robin Jeffries, and Gary Olson (Eds.). ACM, New York, NY, USA, 437--446.

Digital Library

[18]

Sylvain Hourlier, Sandra Guérard, Jean-Luc Barou and Xavier Servantie, 2015. Testing Touch Screens in Realistic Aeronautic Turbulent Conditions (Light to Severe). SAE International Journal of Aerospace 8.

[19]

Sridher Kaminani. 2011. Human Computer Interaction Issues with Touch Screen Interfaces in the Flight Deck. In P. 6B4--1. IEEE.

[20]

Hyunyoung Kim, Celine Coutrix, and Anne Roudaut. 2018. Morphees+: Studying Everyday Reconfigurable Objects for the Design and Taxonomy of Reconfigurable UIs. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 619, 14 pages.

Digital Library

[21]

Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. 2012. FoldMe: interacting with double-sided foldable displays. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12), Stephen N. Spencer (Ed.). ACM, New York, NY, USA, 33--40.

Digital Library

[22]

Koleva, B, Benford, S, Kher Hui Ng, Rodden, T. A Framework for Tangible User Interfaces, Physical Interaction (PI03) - Workshop on Real World User Interfaces, Mobile HCI Conference 2003.

[23]

Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1303--1312.

Digital Library

[24]

Johnny C. Lee, Scott E. Hudson, and Edward Tse. 2008. Foldable interactive displays. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, NY, USA, 287--290.

Digital Library

[25]

Catherine Letondal, Jean-Luc Vinot, Sylvain Pauchet, Caroline Boussiron, Stéphanie Rey, Valentin Becquet, and Claire Lavenir. 2018. Being in the Sky: Framing Tangible and Embodied Interaction for Future Airliner Cockpits. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 656--666.

Digital Library

[26]

Loukia D. Loukopoulos, R. K. Dismukes, and I. Barshi. 2001. Cockpit interruptions and distractions: A line observation study. Proceedings of the 11th international symposium on aviation psychology, Ohio State University Press Columbus, 1--6.

[27]

Mackay, W.E., Is paper safer? The role of paper flight strips in air traffic control. ACM Trans. Comput.-Hum. Interact. 6, 4 (December 1999), 311--340.

Digital Library

[28]

Gregory Mone. 2013. The future is flexible displays. Commun. ACM 56, 6 (June 2013), 16--17.

Digital Library

[29]

Samudrala Nagaraju. 2013. Novel user interaction styles with flexible/rollable screens. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI (CHItaly '13). ACM, New York, NY, USA, Article 20, 7 pages.

Digital Library

[30]

Noyes, J.M. and Starr, A.F. 2007. A Comparison of Speech Input and Touch Screen for Executing Checklists in an Avionics Application. Int. J. Aviation Psychology 17.

[31]

Sylvain Pauchet, Catherine Letondal, Jean-Luc Vinot, Mickaël Causse, Mathieu Cousy, Valentin Becquet, and Guillaume Crouzet. 2018. GazeForm: Dynamic Gaze-adaptive Touch Surface for Eyesfree Interaction in Airliner Cockpits. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 1193--1205.

Digital Library

[32]

Raf Ramakers, Johannes Schöning, and Kris Luyten. 2014. Paddle: highly deformable mobile devices with physical controls. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2569--2578.

Digital Library

[33]

Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-changing interfaces: a review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 735--744.

Digital Library

[34]

Simon Robinson, Céline Coutrix, Jennifer Pearson, Juan Rosso, Matheus Fernandes Torquato, Laurence Nigay, and Matt Jones. 2016. Emergeables: Deformable Displays for Continuous Eyes-Free Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3793--3805.

Digital Library

[35]

Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: toward high "shape resolution" in self-actuated flexible mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 593--602.

Digital Library

[36]

Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: highly flexible bending interactions for projected handheld displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 237--246.

Digital Library

[37]

Dag Svanæs. 2013. Interaction design for and with the lived body: Some implications of merleau-ponty's phenomenology. ACM Trans. Comput.-Hum. Interact. 20, 1, Article 8 (April 2013), 30 pages.

Digital Library

[38]

Melanie Tory and Robert Kincaid. 2013. Comparing physical, overlay, and touch screen parameter controls. ACM Press, 91--100.

Digital Library

[39]

Jean-Luc Vinot, Catherine Letondal, Sylvain Pauchet, and Stéphane Chatty. 2016. Could tangibility improve the safety of touch-based interaction?: exploring a new physical design space for pilot-system interfaces. In Proceedings of the International Conference on HumanComputer Interaction in Aerospace (HCI-Aero '16). ACM, New York, NY, USA, Article 8, 8 pages.

Digital Library

[40]

Simon Voelker, Kjell Ivar Øvergård, Chat Wacharamanotham, and Jan Borchers. 2015. Knobology Revisited: A Comparison of User Performance between Tangible and Virtual Rotary Knobs. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 35--38.

Digital Library

[41]

Kening Zhu, Morten Fjeld, and Ayça Ünlüer. 2018. WristOrigami: Exploring Foldable Design for Multi-Display Smartwatch. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 1207--1218.

Digital Library

Cited By

Letondal CGiroud GPauchet SBornes L(2024)Une critique de l’hylémorphisme dans les théories du design d’interaction : recherche de concepts dans la philosophie pour appréhender la forme et la matérialitéSciences du Design10.3917/sdd.019.0162n° 19:1(162-179)Online publication date: 8-Jul-2024
https://doi.org/10.3917/sdd.019.0162
Dubus RBrock AMackay W(2024)Developing a Design Space for Critiquing Autopilot InterfacesProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649805(1-12)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649805
Yamakawa NMaruta TKinoshita YGo K(2024)Extending Fitts' Law for Tapping on Surfaces Angled in the Depth DirectionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650984(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650984
Show More Cited By

Index Terms

Multi-plié: A Linear Foldable and Flattenable Interactive Display to Support Efficiency, Safety and Collaboration
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction devices

Recommendations

GazeForm: Dynamic Gaze-adaptive Touch Surface for Eyes-free Interaction in Airliner Cockpits
DIS '18: Proceedings of the 2018 Designing Interactive Systems Conference

An increasing number of domains, including aeronautics, are adopting touchscreens. However, several drawbacks limit their operational use, in particular, eyes-free interaction is almost impossible making it difficult to perform other tasks ...
Being in the Sky: Framing Tangible and Embodied Interaction for Future Airliner Cockpits
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

In order to contribute to a design for future airline cockpits that can address the limitations of touch-based interfaces, we analyze tangible dimensions of cockpit activity based on observations and pilot interviews. Working from these data, using TEI ...
Simulating an extendable tangible slider for eyes-free one-handed interaction on mobile devices
AVI '18: Proceedings of the 2018 International Conference on Advanced Visual Interfaces

Sliders are widely used on mobile devices. Envisioning mobile devices that can dynamically deform to raise tangible controls from the screen surface, tangible sliders offer the benefit of eyes-free interaction. However, reaching for distant values with ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
524
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Letondal CGiroud GPauchet SBornes L(2024)Une critique de l’hylémorphisme dans les théories du design d’interaction : recherche de concepts dans la philosophie pour appréhender la forme et la matérialitéSciences du Design10.3917/sdd.019.0162n° 19:1(162-179)Online publication date: 8-Jul-2024
https://doi.org/10.3917/sdd.019.0162
Dubus RBrock AMackay W(2024)Developing a Design Space for Critiquing Autopilot InterfacesProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649805(1-12)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649805
Yamakawa NMaruta TKinoshita YGo K(2024)Extending Fitts' Law for Tapping on Surfaces Angled in the Depth DirectionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650984(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650984
Zhong CWakkary ROdom WChen AYoo MOogjes D(2022)On the Design of deformTable: Attending to Temporality and Materiality for Supporting Everyday Interactions with a Shape-Changing ArtifactProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533501(1555-1564)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533501
Zhong C(2021)Designing and Deploying Shape-changing Artifacts in Everyday Settings Over Time: Extending Practices and Methodologies for Materiality in HCICompanion Publication of the 2021 ACM Designing Interactive Systems Conference10.1145/3468002.3468229(1-4)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3468002.3468229
Pruszko LLaurillau YPiranda BBourgeois JCoutrix C(2021)Impact of the Size of Modules on Target Acquisition and Pursuit for Future Modular Shape-changing Physical User InterfacesProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479936(297-307)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479936
Pruszko LCoutrix CLaurillau YPiranda BBourgeois J(2021)Molecular HCIProceedings of the ACM on Human-Computer Interaction10.1145/34617335:EICS(1-33)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3461733
Wambecke JGoguey ANigay LDargent LHauret DLafon Sde Visme J(2021)M[eye]croProceedings of the ACM on Human-Computer Interaction10.1145/34617325:EICS(1-22)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3461732
Zhong CSas CMaiden N(2021)Investigating Materiality as a Frame for Supporting Creative and Organic Relations with Shape-changing Artifacts in Everyday Settings Over TimeProceedings of the 13th Conference on Creativity and Cognition10.1145/3450741.3467463(1-5)Online publication date: 22-Jun-2021
https://dl.acm.org/doi/10.1145/3450741.3467463
Rossmy BRümelin SWiethoff AKaltenbrunner MMurer MWolf KOakley I(2021)StringTouch - From String Instruments towards new Interface MorphologiesProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440628(1-10)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440628

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten