research-article

Occlusion-aware interfaces

Authors:

Ravin BalakrishnanAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 263 - 272

https://doi.org/10.1145/1753326.1753365

Published: 10 April 2010 Publication History

Abstract

We define occlusion-aware interfaces as interaction techniques which know what area of the display is currently occluded, and use this knowledge to counteract potential problems and/or utilize the hidden area. As a case study, we describe the Occlusion-Aware Viewer, which identifies important regions hidden beneath the hand and displays them in a non-occluded area using a bubble-like callout. To determine what is important, we use an application agnostic image processing layer. For the occluded area, we use a user configurable, real-time version of Vogel et al.'s [21] geometric model. In an evaluation with a simultaneous monitoring task, we find the technique can successfully mitigate the effects of occlusion, although issues with ambiguity and stability suggest further refinements. Finally, we present designs for three other occlusion-aware techniques for pop-ups, dragging, and a hidden widget.

Supplementary Material

JPG File (p263.jpg)

Download
8.89 KB

MP4 File (p263.mp4)

Download
43.52 MB

References

[1]

Accot, J. and Zhai, S. More than dotting the i's -- foundations for crossing-based interfaces. In Proc. CHI, ACM (2002), 73--80.

Digital Library

[2]

Apitz, G. and Guimbretière, F. CrossY: a crossing-based drawing application. In Proc. UIST, ACM (2004), 3--12.

Digital Library

[3]

Benko, H., Wilson, A.D., and Baudisch, P. Precise selection techniques for multi-touch screens. In Proc. CHI, ACM (2006), 1263--1272.

Digital Library

[4]

Bezerianos, A., Dragicevic, P., and Balakrishnan, R. Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays. In Proc.UIST, ACM (2006), 159--168.

Digital Library

[5]

Brandl, P., Leitner, J., Seifried, T., Haller, M., Doray, B., and To, P. Occlusion-aware menu design for digital tabletops. Ext. Abstracts CHI, ACM (2009), 3223--3228.

Digital Library

[6]

Cotting, D. and Gross, M. Interactive environment-aware display bubbles. In Proc. UIST, ACM (2006), 245--254.

Digital Library

[7]

Echtler, F., Huber, M., and Klinker, G. Shadow tracking on multi-touch tables. In Proc. Advanced visual interfaces, ACM (2008), 388--391.

Digital Library

[8]

Forlines, C. and Balakrishnan, R. Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks. In Proc. CHI, ACM (2008), 1563--1572.

Digital Library

[9]

Forlines, C., Vogel, D., and Balakrishnan, R. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proc. UIST, ACM (2006), 211--220.

Digital Library

[10]

Hancock, M.S. and Booth, K.S. Improving menu placement strategies for pen input. In Proc. Graphics Interface, (2004), 221--230.

Digital Library

[11]

Inkpen, K., Dearman, D., Argue, R., et al. Left-Handed Scrolling for Pen-Based Devices. International Journal of Human-Computer Interaction 21, 1 (2006), 91--108.

[12]

Ishak, E.W. and Feiner, S.K. Interacting with hidden content using content-aware free-space transparency. In Proc. UIST, ACM (2004), 189--192.

Digital Library

[13]

Meyer, A. Pen computing: a technology overview and a vision. SIGCHI Bull 27, 3 (1995), 46--90.

Digital Library

[14]

Pheasant, S. and Hastlegrave, C. Bodyspace: Anthropometry, Ergonomics and the Design of the Work. CRC, 2006.

[15]

Ramos, G. and Balakrishnan, R. Fluid interaction techniques for the control and annotation of digital video. In Proc. UIST, ACM (2003), 105--114.

Digital Library

[16]

Schilit, B.N., Golovchinsky, G., and Price, M.N. Beyond paper: supporting active reading with free form digital ink annotations. In Proc. CHI, ACM (1998), 249--256.

Digital Library

[17]

Shen, C., Hancock, M.S., Forlines, C., and Vernier, F.D. CoR2Ds. Ext. Abstracts CHI, ACM (2005), 1781--1784.

Digital Library

[18]

Vogel, D. and Balakrishnan, R. Direct Pen Interaction with a Conventional Graphical User Interface. Human-Computer Interaction, (forthcoming).

[19]

Vogel, D. and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. UIST, ACM (2005), 33--42.

Digital Library

[20]

Vogel, D. and Baudisch, P. Shift: a technique for operating pen-based interfaces using touch. In Proc. CHI, ACM (2007), 657--666.

Digital Library

[21]

Vogel, D., Cudmore, M., Casiez, G., Balakrishnan, R., and Keliher, L. Hand Occlusion with Tablet-sized Direct Pen Input. In Proc. CHI, ACM (2009), 557--566.

Digital Library

[22]

Zeleznik, R. and Miller, T. Fluid inking: augmenting the medium of free-form inking with gestures. In Proc. Graphics Interface, (2006), 155--162.

Digital Library

Cited By

Pan XHuan ZLi YCao Y(2024)Enhancement of GUI Display Error Detection Using Improved Faster R-CNN and Multi-Scale Attention MechanismApplied Sciences10.3390/app1403114414:3(1144)Online publication date: 30-Jan-2024
https://doi.org/10.3390/app14031144
Perelman GDubois ESerrano M(2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103203
Chu JMa YZhai SGu XBi X(2023)TouchType-GAN: Modeling Touch Typing with Generative Adversarial NetworkProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606760(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606760
Show More Cited By

Index Terms

Occlusion-aware interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Hand occlusion on a multi-touch tabletop
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We examine the shape of hand and forearm occlusion on a multi-touch table for different touch contact types and tasks. Individuals have characteristic occlusion shapes, but with commonalities across tasks, postures, and handedness. Based on this, we ...
Occlusion Detectable Stereo -- Occlusion Patterns in Camera Matrix
CVPR '96: Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)

In stereo algorithms with more than two cameras, the improvement of accuracy is often reported since they are robust against noise. However, another important aspect of the polynocular stereo, that is the ability of occlusion detection, has been paid ...
Towards occlusion-aware multifocal displays

The human visual system uses numerous cues for depth perception, including disparity, accommodation, motion parallax and occlusion. It is incumbent upon virtual-reality displays to satisfy these cues to provide an immersive user experience. Multifocal ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

62
Total Citations
View Citations
2,131
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)3

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pan XHuan ZLi YCao Y(2024)Enhancement of GUI Display Error Detection Using Improved Faster R-CNN and Multi-Scale Attention MechanismApplied Sciences10.3390/app1403114414:3(1144)Online publication date: 30-Jan-2024
https://doi.org/10.3390/app14031144
Perelman GDubois ESerrano M(2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103203
Chu JMa YZhai SGu XBi X(2023)TouchType-GAN: Modeling Touch Typing with Generative Adversarial NetworkProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606760(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606760
Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Yan YHuang ZXudu FYang Z(2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517666
Palanque P(2022)How to Design and Assess Automation for Interactive Applications and Interaction TechniquesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503769(1-3)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503769
Ko YZhao HRamakrishnan IZhai SBi X(2021)Issues Related to Using Finger-Fitts law to Model One-Dimensional Touch Pointing TasksProceedings of the Ninth International Symposium of Chinese CHI10.1145/3490355.3490360(41-49)Online publication date: 16-Oct-2021
https://dl.acm.org/doi/10.1145/3490355.3490360
Niyazov AMellado NBarthe LSerrano M(2021)Dynamic DecalsProceedings of the ACM on Human-Computer Interaction10.1145/34885385:ISS(1-27)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488538
Ma YZhai SRamakrishnan IBi X(2021)Modeling Touch Point Distribution with Rotational Dual Gaussian ModelThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474816(1197-1209)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474816
Neshati ARey BMohommed Faleel ABardot SLatulipe CIrani PKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)BezelGlide: Interacting with Graphs on Smartwatches with Minimal Screen OcclusionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445201(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445201
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents