research-article

Fortunettes: Feedforward about the Future State of GUI Widgets

Authors:

Philippe Palanque,

Christine GrisAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 3, Issue EICS

Article No.: 20, Pages 1 - 20

https://doi.org/10.1145/3331162

Published: 13 June 2019 Publication History

Abstract

Feedback is commonly used to explain what happened in an interface. What if questions, on the other hand, remain mostly unanswered. In this paper, we present the concept of enhanced widgets capable of visualizing their future state, which helps users to understand what will happen without committing to an action. We describe two approaches to extend GUI toolkits to support widget-level feedforward, and illustrate the usefulness of widget-level feedforward in a standardized interface to control the weather radar in commercial aircraft. In our evaluation, we found that users require less clicks to achieve tasks and are more confident about their actions when feedforward information was available. These findings suggest that widget-level feedforward is highly suitable in applications the user is unfamiliar with, or when high confidence is desirable.

References

[1]

Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 582, 18 pages.

Digital Library

[2]

Incorporated (ARINC) Aeronautical Radio. 2016. ARINC661 Cockpit Display System Interfaces to User Systems ARINC Specification 661, supplement 6. Standard. AEEC - Engineering Standards for Aircraft Systems.

[3]

Stavros Antifakos, Nicky Kern, Bernt Schiele, and Adrian Schwaninger. 2005. Towards Improving Trust in Context-aware Systems by Displaying System Confidence. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '05). ACM, New York, NY, USA, 9--14.

Digital Library

[4]

Caroline Appert and Michel Beaudouin-Lafon. 2006. SwingStates: Adding State Machines to the Swing Toolkit. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 319--322.

Digital Library

[5]

Mark Assad, David J. Carmichael, Judy Kay, and Bob Kummerfeld. 2007. PersonisAD: Distributed, Active, Scrutable Model Framework for Context-Aware Services. In Pervasive Computing, Anthony LaMarca, Marc Langheinrich, and Khai N. Truong (Eds.). Vol. 4480. Springer Berlin Heidelberg, Berlin, Heidelberg, 55--72. http://link.springer.com/10.1007/978--3--540--72037--9_4

Digital Library

[6]

Louise Barkhuus and Anind Dey. 2003. Is Context-Aware Computing Taking Control away from the User? Three Levels of Interactivity Examined. In UbiComp 2003: Ubiquitous Computing: 5th International Conference, Seattle, WA, USA, October 12--15, 2003. Proceedings, Anind K. Dey, Albrecht Schmidt, and Joseph F. McCarthy (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 149--156.

[7]

Rémi Bastide and Philippe A. Palanque. 1990. Petri Net Objects for the Design, Validation and Prototyping of User-driven Interfaces. In Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction (INTERACT '90). North-Holland Publishing Co., Amsterdam, The Netherlands, The Netherlands, 625--631. http://dl.acm.org/citation.cfm?id=647402.725296

[8]

Ré mi Bastide and Philippe A. Palanque. 1996. Implementation Techniques for Petri Net Based Specifications of Human-Computer Dialogues. In Computer-Aided Design of User Interfaces I, Jean Vanderdonckt (Ed.). 285--302.

[9]

Olivier Bau and Wendy E. Mackay. 2008. OctoPocus: A Dynamic Guide for Learning Gesture-based Command Sets. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 37--46.

Digital Library

[10]

Patrick Baudisch, Desney Tan, Maxime Collomb, Dan Robbins, Ken Hinckley, Ken Hinckley, Maneesh Agrawala, Shengdong Zhao, and Gonzalo Ramos. 2006. Phosphor: Explaining Transitions in the User Interface Using Afterglow Effects. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 169--178.

Digital Library

[11]

Victoria Bellotti and Keith Edwards. 2001. Intelligibility and Accountability: Human Considerations in Context-Aware Systems. Human-Computer Interaction, Vol. 16, 2 (Dec. 2001), 193--212.

Digital Library

[12]

Brian Burg, Andrew J. Ko, and Michael D. Ernst. 2015. Explaining Visual Changes in Web Interfaces. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, New York, NY, USA, 259--268.

Digital Library

[13]

John M. Carroll and Mary Beth Rosson. 1987. Paradox of the Active User.

Digital Library

[14]

Richard Catrambone and John M. Carroll. 1987. Learning a Word Processing System with Training Wheels and Guided Exploration. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87). ACM, New York, NY, USA, 169--174.

Digital Library

[15]

Scott Clifford and Jennifer Jerit. 2014. Is There a Cost to Convenience? An Experimental Comparison of Data Quality in Laboratory and Online Studies. Journal of Experimental Political Science, Vol. 1, 2 (2014), 120--131.

[16]

Frédéric Dandurand, Thomas R. Shultz, and Kristine H. Onishi. 2008. Comparing online and lab methods in a problem-solving experiment. Behavior Research Methods, Vol. 40, 2 (01 May 2008), 428--434.

[17]

William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing Guiding Systems for Gesture-based Interaction. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 44--53.

Digital Library

[18]

Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But How, Donald, Tell Us How?: On the Creation of Meaning in Interaction Design Through Feedforward and Inherent Feedback. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '02). ACM, New York, NY, USA, 285--291.

Digital Library

[19]

Mica R. Endsley. 2011. Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition 2nd ed.). CRC Press, Inc., Boca Raton, FL, USA.

[20]

David K. Farkas. 1993. The role of balloon help. ACM SIGDOC Asterisk Journal of Computer Documentation, Vol. 17, 2 (May 1993), 3--19.

Digital Library

[21]

Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1995. Design Patterns: Elements of Reusable Object-oriented Software .Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.

Digital Library

[22]

Mark Green. 1986. A Survey of Three Dialogue Models. ACM Trans. Graph., Vol. 5, 3 (July 1986), 244--275.

Digital Library

[23]

T. R. G. Green. 1989. Cognitive Dimensions of Notations. In Proceedings of the Fifth Conference of the British Computer Society, Human-Computer Interaction Specialist Group on People and Computers V. Cambridge University Press, New York, NY, USA, 443--460. http://dl.acm.org/citation.cfm?id=92968.93015

Digital Library

[24]

Tovi Grossman and George Fitzmaurice. 2010. ToolClips: An Investigation of Contextual Video Assistance for Functionality Understanding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1515--1524.

Digital Library

[25]

Caitlin Kelleher and Randy Pausch. 2005. Stencils-based Tutorials: Design and Evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 541--550.

Digital Library

[26]

Andrew J. Ko and Brad A. Myers. 2010. Extracting and answering why and why not questions about Java program output. ACM Transactions on Software Engineering and Methodology, Vol. 20, 2 (Aug. 2010), 1--36.

Digital Library

[27]

Benjamin Lafreniere, Parmit K. Chilana, Adam Fourney, and Michael A. Terry. 2015. These Aren't the Commands You're Looking For: Addressing False Feedforward in Feature-Rich Software. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and; Technology (UIST '15). ACM, New York, NY, USA, 619--628.

Digital Library

[28]

Jonathan Lazar, Adam Jones, and Ben Shneiderman. 2006. Workplace user frustration with computers: an exploratory investigation of the causes and severity. Behaviour & Information Technology, Vol. 25, 3 (May 2006), 239--251.

[29]

Catherine Letondal, Stéphane Chatty, Greg Philips, Fabien André, and Stéphane Conversy. 2010. Usability requirements for interaction-oriented development tools. In PPIG 2010, 22nd Annual Workshop on the Psychology of Programming Interest Group. 12--16.

[30]

Brian Y. Lim and Anind K. Dey. 2010. Toolkit to Support Intelligibility in Context-aware Applications. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (UbiComp '10). ACM, New York, NY, USA, 13--22.

Digital Library

[31]

Brian Y. Lim, Anind K. Dey, and Daniel Avrahami. 2009. Why and Why Not Explanations Improve the Intelligibility of Context-aware Intelligent Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 2119--2128.

Digital Library

[32]

Quentin Limbourg, Jean Vanderdonckt, Benjamin Michotte, Laurent Bouillon, and Murielle Florins. 2004. USIXML: A User Interface Description Language Supporting Multiple Levels of Independence. In ICWE Workshops. 325--338.

[33]

Kris Luyten, Tim Clerckx, Karin Coninx, and Jean Vanderdonckt. 2003. Derivation of a Dialog Model from a Task Model by Activity Chain Extraction. In Interactive Systems. Design, Specification, and Verification, Joaquim A. Jorge, Nuno Jardim Nunes, and Joao Falcaoe Cunha (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 203--217.

[34]

Célia Martinie, David Navarre, Philippe Palanque, and Camille Fayollas. 2015. A Generic Tool-supported Framework for Coupling Task Models and Interactive Applications. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 244--253.

Digital Library

[35]

Leo A. Meyerovich, Arjun Guha, Jacob Baskin, Gregory H. Cooper, Michael Greenberg, Aleks Bromfield, and Shriram Krishnamurthi. 2009. Flapjax: a programming language for Ajax applications. ACM SIGPLAN Notices, Vol. 44, 10 (Oct. 2009), 1.

Digital Library

[36]

Bonnie M. Muir. 1994. Trust in Automation: Part I. Theoretical Issues in the Study of Trust and Human Intervention in Automated Systems. Ergonomics, Vol. 37, 11 (Nov. 1994), 1905--1922.

[37]

Lars Müller, Ilhan Aslan, and Lucas Krüßen. 2013. GuideMe: A Mobile Augmented Reality System to Display User Manuals for Home Appliances. In Advances in Computer Entertainment. Vol. 8253. Springer International Publishing, Cham, 152--167.

[38]

Brad Myers, Scott E. Hudson, Randy Pausch, and Randy Pausch. 2000. Past, Present, and Future of User Interface Software Tools. ACM Trans. Comput.-Hum. Interact., Vol. 7, 1 (March 2000), 3--28.

Digital Library

[39]

Brad Myers, Sun Young Park, Yoko Nakano, Greg Mueller, and Andrew Ko. 2008. How designers design and program interactive behaviors. In 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. IEEE, 177--184.

Digital Library

[40]

Brad A. Myers. 1991. Separating Application Code from Toolkits: Eliminating the Spaghetti of Call-backs. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (UIST '91). ACM, New York, NY, USA, 211--220.

Digital Library

[41]

Mathieu Nancel and Andy Cockburn. 2014. Causality: A Conceptual Model of Interaction History. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1777--1786.

Digital Library

[42]

Donald A Norman. 2010. Living with complexity. MIT press.

[43]

Donald A Norman. 2013. The design of everyday things: Revised and expanded edition .Basic Books (AZ).

Digital Library

[44]

Dan R. Olsen, Jr. 1984. Pushdown Automata for User Interface Management. ACM Trans. Graph., Vol. 3, 3 (July 1984), 177--203.

Digital Library

[45]

Dan R. Olsen, Jr. 2007. Evaluating User Interface Systems Research. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 251--258.

Digital Library

[46]

Stephen Oney, Brad Myers, and Joel Brandt. 2012. ConstraintJS: Programming Interactive Behaviors for the Web by Integrating Constraints and States. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 229--238.

Digital Library

[47]

Stephen Oney, Brad Myers, and Joel Brandt. 2014. InterState: A Language and Environment for Expressing Interface Behavior. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 263--272.

Digital Library

[48]

Robert S Rist et almbox. 1986. Plans in programming: definition, demonstration, and development. In Empirical studies of programmers. 28--47.

Digital Library

[49]

Gustavo Rovelo, Donald Degraen, Davy Vanacken, Kris Luyten, and Karin Coninx. 2015. Gestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays. In Human-Computer Interaction - INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Vol. 9297. Springer International Publishing, 368--386.

Digital Library

[50]

Miro Samek. 2003. Who moved my state. Dr. Dobb's Journal (2003).

[51]

Julia Schwarz, Jennifer Mankoff, and Scott Hudson. 2011. Monte Carlo Methods for Managing Interactive State, Action and Feedback Under Uncertainty. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 235--244.

Digital Library

[52]

Koushik Sen, Swaroop Kalasapur, Tasneem Brutch, and Simon Gibbs. 2013. Jalangi: A Selective Record-replay and Dynamic Analysis Framework for JavaScript. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2013). ACM, New York, NY, USA, 488--498.

Digital Library

[53]

Michael Terry and Elizabeth D. Mynatt. 2002. Side Views: Persistent, On-demand Previews for Open-ended Tasks. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, New York, NY, USA, 71--80.

Digital Library

[54]

Davy Vanacken, Alexandre Demeure, Kris Luyten, and Karin Coninx. 2008. Ghosts in the interface: meta-user interface visualizations as guides for multi-touch interaction. In Proceedings of the 3rd IEEE international workshop on Horizontal Interactive Human Computer Systems (TABLETOP '08). IEEE Computer Society, 81--84.

[55]

Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the Bridge over Norman's Gulf of Execution: Revealing Feedforward's True Identity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1931--1940.

Digital Library

[56]

W. A. Woods. 1970. Transition network grammars for natural language analysis. Commun. ACM, Vol. 13, 10 (Oct. 1970), 591--606.

Digital Library

Cited By

Artizzu VLuyten KRuiz GSpano L(2024)ViRgilites: Multilevel Feedforward for Multimodal Interaction in VRProceedings of the ACM on Human-Computer Interaction10.1145/36586458:EICS(1-24)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3658645
John KLi YSeifi H(2024)AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound TactonsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642090(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642090
Ren XHe JHan TLiu SLv MZhou R(2024)Exploring the effect of fingertip aero-haptic feedforward cues in directing eyes-free target acquisition in VRVirtual Reality & Intelligent Hardware10.1016/j.vrih.2023.12.0016:2(113-131)Online publication date: Apr-2024
https://doi.org/10.1016/j.vrih.2023.12.001
Show More Cited By

Index Terms

Fortunettes: Feedforward about the Future State of GUI Widgets
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

RBE: Rendering By Example
ICDE '95: Proceedings of the Eleventh International Conference on Data Engineering

Rendering is defined to be a customized presentation of data in such a way that allows users to subsequently interact with the presented data. Traditionally such a user interface would be a custom application written using conventional programming ...
The previewable switch: a light switch with feedforward
DIS '14: Proceedings of the 2014 conference on Designing interactive systems

A light switch and its spatial mapping constitute an unsolved, user interface problem introduced to the realm of Human Computer Interaction by Norman. In this paper, we introduce the Previewable Switch which is a light switch enhanced with a touch ...
Fortune Nets for Fortunettes: Formal, Petri Nets-Based, Engineering of Feedforward for GUI Widgets
Formal Methods. FM 2019 International Workshops
Abstract
Feedback and feedforward are two fundamental mechanisms that supports users’ activities while interacting with computing devices. While feedback can be easily solved by providing information to the users following the triggering of an action, ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 3, Issue EICS

June 2019

553 pages

EISSN:2573-0142

DOI:10.1145/3340630

Editors:
Cliff Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Microsoft Research
,
Wolfgang Stuerzlinger
Simon Fraser University

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2019

Published in PACMHCI Volume 3, Issue EICS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Fonds Wetenschappelijk Onderzoek

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)8

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Artizzu VLuyten KRuiz GSpano L(2024)ViRgilites: Multilevel Feedforward for Multimodal Interaction in VRProceedings of the ACM on Human-Computer Interaction10.1145/36586458:EICS(1-24)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3658645
John KLi YSeifi H(2024)AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound TactonsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642090(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642090
Ren XHe JHan TLiu SLv MZhou R(2024)Exploring the effect of fingertip aero-haptic feedforward cues in directing eyes-free target acquisition in VRVirtual Reality & Intelligent Hardware10.1016/j.vrih.2023.12.0016:2(113-131)Online publication date: Apr-2024
https://doi.org/10.1016/j.vrih.2023.12.001
Navarre DPalanque PMartinie C(2024)Engineering AI-Similar Designs: Should I Engineer My Interactive System with AI Technologies?Engineering Interactive Computer Systems. EICS 2023 International Workshops and Doctoral Consortium10.1007/978-3-031-59235-5_8(72-89)Online publication date: 8-Aug-2024
https://doi.org/10.1007/978-3-031-59235-5_8
Ciorna VMelançon GPetry FGhoniem M(2023)Interact: A visual what-if analysis tool for virtual product designInformation Visualization10.1177/1473871623121603023:2(123-141)Online publication date: 29-Dec-2023
https://doi.org/10.1177/14738716231216030
Waugh KMcGill MFreeman E(2023)Proxemic Cursor Interactions for Touchless Widget ControlProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614525(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614525
Muresan AMcintosh JHornbæk K(2023)Using Feedforward to Reveal Interaction Possibilities in Virtual RealityACM Transactions on Computer-Human Interaction10.1145/360362330:6(1-47)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3603623
Beyeler MCheng YHolz C(2023)Cross-Device Shortcuts: Seamless Attention-guided Content Transfer via Opportunistic Deep Links between Apps and DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614145(125-134)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614145
Coppers SVanacken DLuyten K(2022)FortClash: Predicting and Mediating Unintended Behavior in Home AutomationProceedings of the ACM on Human-Computer Interaction10.1145/35322046:EICS(1-20)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532204
Buschek DEiband MHussmann H(2022)How to Support Users in Understanding Intelligent Systems? An Analysis and Conceptual Framework of User Questions Considering User Mindsets, Involvement, and Knowledge OutcomesACM Transactions on Interactive Intelligent Systems10.1145/351926412:4(1-27)Online publication date: 5-Nov-2022
https://dl.acm.org/doi/10.1145/3519264
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents