Article

Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays

Authors:

Anastasia Bezerianos,

Pierre Dragicevic,

Ravin BalakrishnanAuthors Info & Claims

UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

Pages 159 - 168

https://doi.org/10.1145/1166253.1166279

Published: 15 October 2006 Publication History

Abstract

Managing large amounts of dynamic visual information involves understanding changes happening out of the user's sight. In this paper, we show how current software does not adequately support users in this task, and motivate the need for a more general approach. We propose an image-based storage, visualization, and implicit interaction paradigm called mnemonic rendering that provides better support for handling visual changes. Once implemented on a system, mnemonic rendering techniques can benefit all applications. We explore its rich design space and discuss its expected benefits as well as limitations based on feedback from users of a small-screen and a wall-size prototype.

Supplementary Material

JPG File (1166279.jpg)

Download
12.45 KB

index.html (index.html)

Slides from the presentation

Download
.96 KB

ZIP File (p159-slides.zip)

Supplemental material for Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays

Download
17.07 MB

Audio only (1166279.mp3)

Download
5.27 MB

Video (1166279.mp4)

Download
126.68 MB

References

[1]

Banbury, B. and Tremblay, S., eds. (2004). A cognitive approach to situation awareness: theory and application. Ashgate.

[2]

Baudisch, P., Cutrell, E., and Robertson, G. (2003). High-density cursor: A visualization technique that helps users keep track of fast-moving mouse cursors. Interact. p. 236--243.

[3]

Baudisch, P. and Gutwin, C. (2004). Multiblending: displaying overlapping windows simultaneously without the drawbacks of alpha blending. ACM CHI Conference. p. 367--374.

Digital Library

[4]

Bier, E., Stone, M., Pier, K., Buxton, W., and DeRose, T. (1993). Toolglass and Magic Lenses: The see-through interface. ACM SIGGRAPH. p. 73--80.

Digital Library

[5]

Chang, B., Mackinlay, J., Zellweger, P., and Igarashi, T. (1998). A negotiation architecture for fluid documents. ACM UIST Symposium on User Interface Software and Technology. p. 123--132.

Digital Library

[6]

Chang, B. and Ungar, D. (1993). Animation: From cartoons to the user interface. ACM UIST Symposium on User Interface Software and Technology. p. 45--55.

Digital Library

[7]

Chapuis, O. and Roussel, N. (2005). Metisse is not a 3D desktop! ACM Symposium on User Interface Software and Technology. p. 13--22.

Digital Library

[8]

Cockburn, A., Greenberg, S., Jones, S., McKenzie, B., and Moyle, M. (2003). Improving web page revisitation: Analysis, design and evaluation. Special Issue on Web Navigation Skills, IT & Society, 3(1). p. 159--183.

[9]

Edwards, W. K., Igarashi, T., LaMarca, A., and Mynatt, E. D. (2000). A temporal model for multi-level undo and redo. ACM UIST Symposium on User Interface Software and Technology. p. 31--40.

Digital Library

[10]

Endsley, M., Bolté, B., and Jones, D. (2003). Designing for situation awareness: CRC.

[11]

Freeman, E. and Fertig, S. (1995). Lifestreams: Organizing your electronic life. AAAI Fall Symposium: AI Applications in Knowledge Navigation and Retrieval.

[12]

Grudin, J. (2001). Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. ACM CHI Conference. p. 458--465.

Digital Library

[13]

Hunt, A. R. and Andkingstone, A. (2003). Covert and overt voluntary attention: linked or independent? Cognitive Brain Research, 18. p. 102--105.

[14]

Hutchings, D. R., Smith, G., Meyers, B., Czerwinski, M., and Robertson, G. (2004). Display space usage and window management operation comparisons between single monitor and multiple monitor users. ACM AVI Conference on Advanced Visual Interfaces. p. 32--39.

Digital Library

[15]

Hutchings, D. R. and Stasko, J. (2004). Revisiting display space management: understanding current practice to inform next-generation design. Graphics Interface Conference. p. 127--134.

Digital Library

[16]

Itti, L., Rees, G., and Tsotsos, J., eds. (2005). Neurobiology of attention. Elsevier.

[17]

Jacob, R. J. K. (1993). Eye-movement-based human-computer interaction techniques: Toward non-command interfaces. In Advances in Human-Computer Interaction, D. Hix, Editor. Ablex. chapter 6. p. 151--190.

[18]

Jaynes, C., Webb, S., Steele, R. M., Brown, M., and Seales, W. B. (2001). Dynamic shadow removal from front projection displays. IEEE Visualization. p. 175--182.

Digital Library

[19]

Kawasaki, Y. and Igarashi, T. (2004). Regional undo for spreadsheets. ACM UIST Symposium on User Interface Software and Technology. Demo abstract.

[20]

Kurlander, D. and Feiner, S. (1992). A history-based macro by example system. ACM UIST Symposium on User Interface Software and Technology. p. 99--106.

Digital Library

[21]

Mertz, C., Chatty, S., and Vinot, J. (2000). Pushing the limits of ATC user interface design beyond S&M interaction: the DigiStrips experience. 3rd USA/Europe Air Traffic Management R&D Seminar.

[22]

Moscovich, T. and Hughes, J. F. (2004). Navigating documents with the virtual scroll ring. ACM UIST Symposium on User Interface Software and Technology. p. 57--60.

Digital Library

[23]

Rekimoto, J. (1999). Time-machine computing: a time-centric approach for the information environment. ACM UIST Symposium on User Interface Software and Technology. p. 45--54.

Digital Library

[24]

Renaud, K. (2000). Expediting rapid recovery from interruptions by providing a visualization of application activity. OZCHI. p. 348--355.

[25]

Rensink, R. A. (2002). Change detection. Annual Review of Psychology, 53. p. 245--277.

[26]

Ringel, M. (2003). When one isn't enough: An analysis of virtual desktop usage strategies and their implications for design. ACM CHI Conference (Ext. Abstracts). p. 762--763.

Digital Library

[27]

Salembier, P. and Marques, F. (1999). Region-based representations of image and video: Segmentation tools for multimedia services. IEEE Transactions on Circuits and Systems for Video Technology, 9(8). p. 1147--1169.

Digital Library

[28]

Skopik, A. and Gutwin, C. (2005). Improving revisitation in fisheye views with visit wear. ACM CHI Conference. p. 771--780.

Digital Library

[29]

Smith, G. M. and schraefel, m. c. (2004). The radial scroll tool: scrolling support for stylus- or touch-based document navigation. ACM UIST Symposium on User Interface Software and Technology. p. 53--56.

Digital Library

[30]

Tam, J. and Greenberg, S. (In press - accepted 2005). A framework for asynchronous change awareness in collaborative documents and workspaces. International Journal of Human Computer Studies.

Digital Library

[31]

Tomitsch, M. (2003). Trends and evolution of window interfaces. Thesis, University of Technology: Vienna.

[32]

Turk, M. (2004). Computer vision in the interface. Communications of the ACM, 47(1). p. 60--67.

Digital Library

[33]

Varakin, D. A. and Levin, D. T. (2004). Unseen and unaware: Implications of recent research on failures of visual awareness for human-computer interface design. Human-Computer Interaction, 19. p. 389--422.

Digital Library

[34]

Venolia, G. D., Dabbish, L., Cadiz, J. J., and Gupta, A. (2001). Supporting email Workflow. Tech Report MSR-TR-2001-88. Microsoft Research.

[35]

Vertegaal, R., Mamuji, A., Sohn, C., and Cheng, D. Media eyepliances: using eye tracking for remote control focus selection of appliances. ACM CHI Conference (Extended Abstracts). p. 1861--1864.

Digital Library

[36]

Wang, X. and Jin, J. (2001). A quantitative analysis for decomposing visual signal of the gaze displacement. Pan-Sydney area workshop on visual informtaion processing conference on visual information processing 2001. p. 153--159.

Digital Library

[37]

Wexelblat, A. and Maes, P. (1999). Footprints: History-rich tools for information foraging. ACM CHI Conference. p. 279--277.

Digital Library

[38]

Whittaker, S. and Sidner, C. (1996). Email overload: exploring personal information management of email. ACM CHI Conference. p. 276--283.

Digital Library

[39]

Woods, D. D. and Watts, J. C. (1997). How not to have to navigate through too many displays. In Handbook of Human-Computer Interaction. Elsevier Science.

Cited By

Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Ikeno SChang CIgarashi T(2023)Sticky Cursor: A Technique for Facilitating Moving Target SelectionHuman-Computer Interaction10.1007/978-3-031-35596-7_30(467-483)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_30
Peacock CLafreniere BZhang TSantosa SBenko HJonker T(2022)Gaze as an Indicator of Input Recognition ErrorsProceedings of the ACM on Human-Computer Interaction10.1145/35308836:ETRA(1-18)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530883
Show More Cited By

Index Terms

Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Pipeline rendering: interaction and realism through hardware-based multi-pass rendering
Multiple light field rendering
GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia

A light field is a 4D function describing the radiance across a boundary between the volume containing a scene, and the disjoint volume in which the eyepoint may be placed. Light field rendering is the process of rendering novel views of a scene ...
Global illumination models for volume rendering

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

October 2006

354 pages

ISBN:1595933131

DOI:10.1145/1166253

General Chair:
Pierre Wellner
IDIAP Research Institute, Switzerland
,
Program Chair:
Ken Hinckley
Microsoft Research, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST06

Sponsor:

UIST06: The 19th Annual ACM Symposium on User Interface Software and Technology

October 15 - 18, 2006

Montreux, Switzerland

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
909
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Ikeno SChang CIgarashi T(2023)Sticky Cursor: A Technique for Facilitating Moving Target SelectionHuman-Computer Interaction10.1007/978-3-031-35596-7_30(467-483)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_30
Peacock CLafreniere BZhang TSantosa SBenko HJonker T(2022)Gaze as an Indicator of Input Recognition ErrorsProceedings of the ACM on Human-Computer Interaction10.1145/35308836:ETRA(1-18)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530883
Khadim UIqbal MAzam M(2021)An Intelligent Three-Level Digital Watermarking Method for Document ProtectionMehran University Research Journal of Engineering and Technology10.22581/muet1982.2102.0740:2(323-334)Online publication date: 1-Apr-2021
https://doi.org/10.22581/muet1982.2102.07
Lafreniere BR. Jonker TSantosa SParent MGlueck MGrossman TBenko HWigdor D(2021)False Positives vs. False NegativesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474735(54-68)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474735
Schmid PMalacria SCockburn ANancel MIqbal SMacLean KChevalier FMueller S(2020)Interaction InterferencesProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415883(516-528)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415883
Chow KCoyiuto CNguyen CYoon D(2019)Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VRProceedings of the ACM on Human-Computer Interaction10.1145/33591423:CSCW(1-24)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359142
Dragicevic PJansen YSarma AKay MChevalier FBrewster SFitzpatrick GCox AKostakos V(2019)Increasing the Transparency of Research Papers with Explorable Multiverse AnalysesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300295(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300295
Prouzeau ABezerianos AChapuis OKoike HRatti CTakeuchi YFukuchi KScott SPlasencia D(2018)Awareness Techniques to Aid Transitions between Personal and Shared Workspaces in Multi-Display EnvironmentsProceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces10.1145/3279778.3279780(291-304)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.1145/3279778.3279780
Nguyen CDiVerdi SHertzmann ALiu FMandryk RHancock MPerry MCox A(2018)Depth Conflict Reduction for Stereo VR Video InterfacesProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173638(1-9)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173638
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents