research-article

SurfAirs: Surface + Mid-air Input for Large Vertical Displays

Authors:

Emmanuel Courtoux,

Caroline Appert,

Olivier ChapuisAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 644, Pages 1 - 15

https://doi.org/10.1145/3544548.3580877

Published: 19 April 2023 Publication History

Abstract

Large vertical surfaces such as wall displays allow users to work with a very large and high-resolution workspace. Such displays promote physical navigation: users can step close to the display to see details, but also move away to get a wider view of the workspace. In terms of input, current solutions usually combine direct touch on the wall with input on a handheld device, disconnecting close and distant input rather than treating it as a continuum. We present SurfAirs, which are physical controllers that users can manipulate on screen (surface input), in the air (mid-air input), and transition from the surface to the air during a single manipulation (hybrid input). We report on two user studies that compare SurfAirs’ performance with bare-hand input for both mid-air and hybrid input. Participants prefer and perform better with SurfAirs.

Supplementary Material

Supplemental Materials (3544548.3580877-supplemental-materials.zip)

Download
1.75 MB

MP4 File (3544548.3580877-video-figure.mp4)

Video Figure

Download
47.44 MB

MP4 File (3544548.3580877-talk-video.mp4)

Pre-recorded Video Presentation

Download
52.72 MB

References

[1]

Benjamin Bach, Ronell Sicat, Johanna Beyer, Maxime Cordeil, and Hanspeter Pfister. 2018. The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality?IEEE Transactions on Visualization and Computer Graphics 24, 1(2018), 457–467. https://doi.org/10.1109/TVCG.2017.2745941

[2]

Robert Ball and Chris North. 2008. The Effects of Peripheral Vision and Physical Navigation on Large Scale Visualization. In Proceedings of Graphics Interface 2008(GI ’08). CIPS, 9–16. https://dl.acm.org/doi/abs/10.5555/1375714.1375717

Digital Library

[3]

Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to Improve: Promoting Physical Navigation to Increase User Performance with Large Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). ACM, 191–200. https://doi.org/10.1145/1240624.1240656

Digital Library

[4]

Amartya Banerjee, Jesse Burstyn, Audrey Girouard, and Roel Vertegaal. 2011. Pointable: An in-Air Pointing Technique to Manipulate out-of-Reach Targets on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces(ITS ’11). ACM, 11–20. https://doi.org/10.1145/2076354.2076357

Digital Library

[5]

Mark Billinghurst, Ivan Poupyrev, Hirokazu Kato, and Richard May. 2000. Mixing realities in Shared Space: an augmented reality interface for collaborative computing. In International Conference on Multimedia and Expo. Proceedings. Latest Advances in the Fast Changing World of Multimedia(ICME ’00, Vol. 3). IEEE, 1641–1644. https://doi.org/10.1109/ICME.2000.871085

[6]

Eugenie Brasier, Emmanuel Pietriga, and Caroline Appert. 2021. AR-Enhanced Widgets for Smartphone-Centric Interaction. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction(MobileHCI ’21). ACM, Article 32, 12 pages. https://doi.org/10.1145/3447526.3472019

Digital Library

[7]

Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: Multi-"touch" Interaction around Small Devices. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology(UIST ’08). ACM, 201–204. https://doi.org/10.1145/1449715.1449746

Digital Library

[8]

William Buxton. 1990. A Three-State Model of Graphical Input. In Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction(INTERACT ’90). North-Holland, 449–456. https://www.dgp.toronto.edu/OTP/papers/bill.buxton/3state.html

Digital Library

[9]

Olivier Chapuis, Anastasia Bezerianos, and Stelios Frantzeskakis. 2014. Smarties: An Input System for Wall Display Development. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). ACM, 2763–2772. https://doi.org/10.1145/2556288.2556956

Digital Library

[10]

Christian Cherek, David Asselborn, Simon Voelker, and Jan Borchers. 2019. Off-Surface Tangibles: Exploring the Design Space of Midair Tangible Interaction. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). ACM, Article LBW2115, 6 pages. https://doi.org/10.1145/3290607.3312966

Digital Library

[11]

Maxime Cordeil, Benjamin Bach, Andrew Cunningham, Bastian Montoya, Ross T. Smith, Bruce H. Thomas, and Tim Dwyer. 2020. Embodied Axes: Tangible, Actuated Interaction for 3D Augmented Reality Data Spaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). ACM, 1–12. https://doi.org/10.1145/3313831.3376613

Digital Library

[12]

Emmanuel Courtoux, Caroline Appert, and Olivier Chapuis. 2021. WallTokens: Surface Tangibles for Vertical Displays. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). ACM, Article 421, 13 pages. https://doi.org/10.1145/3411764.3445404

Digital Library

[13]

D. Englmeier, J. Dörner, A. Butz, and T. Höllerer. 2020. A Tangible Spherical Proxy for Object Manipulation in Augmented Reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 221–229. https://doi.org/10.1109/VR46266.2020.00041

[14]

Barrett Ens, Sarah Goodwin, Arnaud Prouzeau, Fraser Anderson, Florence Y. Wang, Samuel Gratzl, Zac Lucarelli, Brendan Moyle, Jim Smiley, and Tim Dwyer. 2021. Uplift: A Tangible and Immersive Tabletop System for Casual Collaborative Visual Analytics. IEEE Transactions on Visualization and Computer Graphics 27, 2(2021), 1193–1203. https://doi.org/10.1109/TVCG.2020.3030334

[15]

George W. Fitzmaurice and William Buxton. 1997. An Empirical Evaluation of Graspable User Interfaces: Towards Specialized, Space-Multiplexed Input. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems(CHI ’97). ACM, 43–50. https://doi.org/10.1145/258549.258578

Digital Library

[16]

Mike Fraser, Michael R. McCarthy, Muneeb Shaukat, and Phillip Smith. 2007. Seconds Matter: Improving Distributed Coordination Bytracking and Visualizing Display Trajectories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). ACM, 1303–1312. https://doi.org/10.1145/1240624.1240822

Digital Library

[17]

Bernd Fröhlich and John Plate. 2000. The Cubic Mouse: A New Device for Three-Dimensional Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’00). ACM, 526–531. https://doi.org/10.1145/332040.332491

Digital Library

[18]

Tovi Grossman, Daniel Wigdor, and Ravin Balakrishnan. 2004. Multi-Finger Gestural Interaction with 3d Volumetric Displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology(UIST ’04). ACM, 61–70. https://doi.org/10.1145/1029632.1029644

Digital Library

[19]

Charlotte Häger-Ross and Marc H. Schieber. 2000. Quantifying the Independence of Human Finger Movements: Comparisons of Digits, Hands, and Movement Frequencies. Journal of Neuroscience 20, 22 (2000), 8542–8550. https://doi.org/10.1523/JNEUROSCI.20-22-08542.2000

[20]

Mark Hancock, Otmar Hilliges, Christopher Collins, Dominikus Baur, and Sheelagh Carpendale. 2009. Exploring Tangible and Direct Touch Interfaces for Manipulating 2D and 3D Information on a Digital Table. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces(ITS ’09). ACM, 77–84. https://doi.org/10.1145/1731903.1731921

Digital Library

[21]

Khalad Hasan, David Ahlström, Junhyeok Kim, and Pourang Irani. 2017. AirPanes: Two-Handed Around-Device Interaction for Pane Switching on Smartphones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, 679–691. https://doi.org/10.1145/3025453.3026029

Digital Library

[22]

Kirstie Hawkey, Melanie Kellar, Derek Reilly, Tara Whalen, and Kori M. Inkpen. 2005. The Proximity Factor: Impact of Distance on Co-Located Collaboration. In Proceedings of the 2005 International ACM SIGGROUP Conference on Supporting Group Work(GROUP ’05). ACM, 31–40. https://doi.org/10.1145/1099203.1099209

Digital Library

[23]

Fabian Hennecke, Raphael Wimmer, Eduard Vodicka, and Andreas Butz. 2012. Vertibles: Using Vacuum Self-Adhesion to Create a Tangible User Interface for Arbitrary Interactive Surfaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction(TEI ’12). ACM, 303–306. https://doi.org/10.1145/2148131.2148194

Digital Library

[24]

Otmar Hilliges, Shahram Izadi, Andrew D. Wilson, Steve Hodges, Armando Garcia-Mendoza, and Andreas Butz. 2009. Interactions in the Air: Adding Further Depth to Interactive Tabletops. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology(UIST ’09). ACM, 139–148. https://doi.org/10.1145/1622176.1622203

Digital Library

[25]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems(CHI ’97). ACM, 234–241. https://doi.org/10.1145/258549.258715

Digital Library

[26]

Shahram Izadi, Steve Hodges, Stuart Taylor, Dan Rosenfeld, Nicolas Villar, Alex Butler, and Jonathan Westhues. 2008. Going beyond the Display: A Surface Technology with an Electronically Switchable Diffuser. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology(UIST ’08). ACM, 269–278. https://doi.org/10.1145/1449715.1449760

Digital Library

[27]

Robert J. K. Jacob, Linda E. Sibert, Daniel C. McFarlane, and M. Preston Mullen. 1994. Integrality and Separability of Input Devices. ACM Trans. Comput.-Hum. Interact. 1, 1 (March 1994), 3–26. https://doi.org/10.1145/174630.174631

Digital Library

[28]

Mikkel R. Jakobsen and Kasper HornbÆk. 2014. Up Close and Personal: Collaborative Work on a High-Resolution Multitouch Wall Display. ACM Trans. Comput.-Hum. Interact. 21, 2, Article 11 (feb 2014), 34 pages. https://doi.org/10.1145/2576099

Digital Library

[29]

Mikkel R. Jakobsen and Kasper Hornbæk. 2015. Is Moving Improving? Some Effects of Locomotion in Wall-Display Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, 4169–4178. https://doi.org/10.1145/2702123.2702312

Digital Library

[30]

Mikkel R. Jakobsen and Kasper Hornbæk. 2016. Negotiating for Space? Collaborative Work Using a Wall Display with Mouse and Touch Input. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, 2050–2061. https://doi.org/10.1145/2858036.2858158

Digital Library

[31]

Mikkel R. Jakobsen, Yvonne Jansen, Sebastian Boring, and Kasper Hornbæk. 2015. Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction. In IFIP Conference on Human-Computer Interaction(INTERACT ’15). Springer, 455–473. https://doi.org/10.1007/978-3-319-22698-9_31

Digital Library

[32]

Mikkel R. Jakobsen, Yonas Sahlemariam Haile, Søren Knudsen, and Kasper Hornbæk. 2013. Information Visualization and Proxemics: Design Opportunities and Empirical Findings. IEEE Transactions on Visualization and Computer Graphics 19, 12(2013), 2386–2395. https://doi.org/10.1109/TVCG.2013.166

Digital Library

[33]

Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2012. Tangible Remote Controllers for Wall-Size Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). ACM, 2865–2874. https://doi.org/10.1145/2207676.2208691

Digital Library

[34]

Brett Jones, Rajinder Sodhi, David Forsyth, Brian Bailey, and Giuliano Maciocci. 2012. Around Device Interaction for Multiscale Navigation. In Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’12). ACM, 83–92. https://doi.org/10.1145/2371574.2371589

Digital Library

[35]

Sergi Jordà, Günter Geiger, Marcos Alonso, and Martin Kaltenbrunner. 2007. The ReacTable: Exploring the Synergy between Live Music Performance and Tabletop Tangible Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction(TEI ’07). ACM, 139–146. https://doi.org/10.1145/1226969.1226998

Digital Library

[36]

Ricardo Jota, Miguel A. Nacenta, Joaquim A. Jorge, Sheelagh Carpendale, and Saul Greenberg. 2010. A Comparison of Ray Pointing Techniques for Very Large Displays. In Proceedings of Graphics Interface 2010(GI ’10). CIPS, 269–276. https://doi.org/10.11575/PRISM/30630

[37]

Hirokazu Kato, Mark Billinghurst, Ivan Poupyrev, K. Imamoto, and K. Tachibana. 2000. Virtual object manipulation on a table-top AR environment. In Proceedings IEEE and ACM International Symposium on Augmented Reality(ISAR ’00). IEEE, 111–119. https://doi.org/10.1109/ISAR.2000.880934

[38]

Sven Kratz and Michael Rohs. 2009. HoverFlow: Expanding the Design Space of around-Device Interaction. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’09). ACM, Article 4, 8 pages. https://doi.org/10.1145/1613858.1613864

Digital Library

[39]

Ricardo Langner, Ulrike Kister, and Raimund Dachselt. 2019. Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances. IEEE Transactions on Visualization and Computer Graphics 25, 1 (jan 2019), 608–618. https://doi.org/10.1109/TVCG.2018.2865235

Digital Library

[40]

Jakob Leitner and Michael Haller. 2011. Geckos: Combining Magnets and Pressure Images to Enable New Tangible-Object Design and Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). ACM, 2985–2994. https://doi.org/10.1145/1978942.1979385

Digital Library

[41]

Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, and Eric Lecolinet. 2017. CoReach: Cooperative Gestures for Data Manipulation on Wall-Sized Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, 6730–6741. https://doi.org/10.1145/3025453.3025594

Digital Library

[42]

Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of Display Size and Navigation Type on a Classification Task. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). ACM, 4147–4156. https://doi.org/10.1145/2556288.2557020

Digital Library

[43]

Nicolai Marquardt, Ricardo Jota, Saul Greenberg, and Joaquim A. Jorge. 2011. The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface. In IFIP Conference on Human-Computer Interaction(INTERACT ’11). Springer, 461–476. https://doi.org/10.1007/978-3-642-23765-2_32

[44]

Fabrice Matulic and Daniel Vogel. 2018. Multiray: Multi-Finger Raycasting for Large Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). ACM, 1–13. https://doi.org/10.1145/3173574.3173819

Digital Library

[45]

David C. McCallum and Pourang Irani. 2009. ARC-Pad: Absolute+relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology(UIST ’09). ACM, 153–156. https://doi.org/10.1145/1622176.1622205

Digital Library

[46]

Rafael Morales González, Caroline Appert, Gilles Bailly, and Emmanuel Pietriga. 2016. TouchTokens: Guiding Touch Patterns with Passive Tokens. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, 4189–4202. https://doi.org/10.1145/2858036.2858041

Digital Library

[47]

Jörg Müller, Gilles Bailly, Thor Bossuyt, and Niklas Hillgren. 2014. MirrorTouch: Combining Touch and Mid-Air Gestures for Public Displays. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services(MobileHCI ’14). ACM, 319–328. https://doi.org/10.1145/2628363.2628379

Digital Library

[48]

Miguel A. Nacenta, Carl Gutwin, Dzmitry Aliakseyeu, and Sriram Subramanian. 2009. There and Back Again: Cross-Display Object Movement in Multi-Display Environments. Human–Computer Interaction 24, 1-2 (2009), 170–229. https://doi.org/10.1080/07370020902819882

[49]

Miguel A. Nacenta, David Pinelle, Dane Stuckel, and Carl Gutwin. 2007. The Effects of Interaction Technique on Coordination in Tabletop Groupware. In Proceedings of Graphics Interface 2007(GI ’07). ACM, 191–198. https://doi.org/10.1145/1268517.1268550

Digital Library

[50]

Mathieu Nancel, Olivier Chapuis, Emmanuel Pietriga, Xing-Dong Yang, Pourang P. Irani, and Michel Beaudouin-Lafon. 2013. High-Precision Pointing on Large Wall Displays Using Small Handheld Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, 831–840. https://doi.org/10.1145/2470654.2470773

Digital Library

[51]

Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, and Wendy Mackay. 2011. Mid-Air Pan-and-Zoom on Wall-Sized Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). ACM, 177–186. https://doi.org/10.1145/1978942.1978969

Digital Library

[52]

Halla Olafsdottir, Vladimir M Zatsiorsky, and Mark L Latash. 2005. Is the thumb a fifth finger? A study of digit interaction during force production tasks. Experimental brain research 160, 2 (2005), 203–213. https://doi.org/10.1007/s00221-004-2004-0

[53]

Gary Perelman, Marcos Serrano, Christophe Bortolaso, Celia Picard, Mustapha Derras, and Emmanuel Dubois. 2019. Combining Tablets with Smartphones for Data Analytics. In IFIP Conference on Human-Computer Interaction(INTERACT ’19). Springer, 439–460. https://doi.org/10.1007/978-3-030-29390-1_24

Digital Library

[54]

Hanae Rateau, Yosra Rekik, Laurent Grisoni, and Joaquim Jorge. 2016. Talaria: Continuous Drag & Drop on a Wall Display. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces(ISS ’16). ACM, 199–204. https://doi.org/10.1145/2992154.2992164

Digital Library

[55]

Jun Rekimoto. 1997. Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology(UIST ’97). ACM, 31–39. https://doi.org/10.1145/263407.263505

Digital Library

[56]

Alexander Schick, Florian van de Camp, Joris Ijsselmuiden, and Rainer Stiefelhagen. 2009. Extending Touch: Towards Interaction with Large-Scale Surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces(ITS ’09). ACM, 117–124. https://doi.org/10.1145/1731903.1731927

Digital Library

[57]

Dominik Schmidt, Fadi Chehimi, Enrico Rukzio, and Hans Gellersen. 2010. PhoneTouch: A Technique for Direct Phone Interaction on Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology(UIST ’10). ACM, 13–16. https://doi.org/10.1145/1866029.1866034

Digital Library

[58]

Garth Shoemaker, Anthony Tang, and Kellogg S. Booth. 2007. Shadow Reaching: A New Perspective on Interaction for Large Displays. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology(UIST ’07). ACM, 53–56. https://doi.org/10.1145/1294211.1294221

Digital Library

[59]

Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2019. Experimental Analysis of Barehand Mid-Air Mode-Switching Techniques in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, 1–14. https://doi.org/10.1145/3290605.3300426

Digital Library

[60]

Theophanis Tsandilas, Anastasia Bezerianos, and Thibaut Jacob. 2015. SketchSliders: Sketching Widgets for Visual Exploration on Wall Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, 3255–3264. https://doi.org/10.1145/2702123.2702129

Digital Library

[61]

Philip Tuddenham, David Kirk, and Shahram Izadi. 2010. Graspables Revisited: Multi-Touch vs. Tangible Input for Tabletop Displays in Acquisition and Manipulation Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’10). ACM, 2223–2232. https://doi.org/10.1145/1753326.1753662

Digital Library

[62]

Simon Voelker, Kosuke Nakajima, Christian Thoresen, Yuichi Itoh, Kjell Ivar Øvergård, and Jan Borchers. 2013. PUCs: Detecting Transparent, Passive Untouched Capacitive Widgets on Unmodified Multi-Touch Displays. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces(ITS ’13). ACM, 101–104. https://doi.org/10.1145/2512349.2512791

Digital Library

[63]

Simon Voelker, Kjell Ivar Øvergård, Chat Wacharamanotham, and Jan Borchers. 2015. Knobology Revisited: A Comparison of User Performance between Tangible and Virtual Rotary Knobs. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces(ITS ’15). ACM, 35–38. https://doi.org/10.1145/2817721.2817725

Digital Library

[64]

Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology(UIST ’04). ACM, 137–146. https://doi.org/10.1145/1029632.1029656

Digital Library

[65]

Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology(UIST ’05). ACM, 33–42. https://doi.org/10.1145/1095034.1095041

Digital Library

[66]

Ulrich von Zadow, Daniel Bösel, Duc Dung Dam, Anke Lehmann, Patrick Reipschläger, and Raimund Dachselt. 2016. Miners: Communication and Awareness in Collaborative Gaming at an Interactive Display Wall. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces(ISS ’16). ACM, 235–240. https://doi.org/10.1145/2992154.2992174

Digital Library

[67]

Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-Sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces(ITS ’14). ACM, 129–138. https://doi.org/10.1145/2669485.2669507

Digital Library

[68]

Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. 2009. SLAP Widgets: Bridging the Gap between Virtual and Physical Controls on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’09). ACM, 481–490. https://doi.org/10.1145/1518701.1518779

Digital Library

[69]

Pierre Wellner. 1991. The DigitalDesk Calculator: Tangible Manipulation on a Desk Top Display. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology(UIST ’91). ACM, 27–33. https://doi.org/10.1145/120782.120785

Digital Library

[70]

Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, above and between Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology(UIST ’10). ACM, 273–282. https://doi.org/10.1145/1866029.1866073

Digital Library

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Lyu YUrata TGarzanti AJiang ZGarcia Fernandez CKakehi Y(2024)TensionFab: Fabrication of Room-scale Surface Structures From the Tension-Active Form of Planar ModulesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641958(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641958
Show More Cited By

Index Terms

SurfAirs: Surface + Mid-air Input for Large Vertical Displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques
      1. Gestural input

Recommendations

WallTokens: Surface Tangibles for Vertical Displays
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Tangibles can enrich interaction with digital surfaces. Among others, they support eyes-free control or increase awareness of other users’ actions. Tangibles have been studied in combination with horizontal surfaces such as tabletops, but not with ...
Mid-air text input techniques for very large wall displays
GI '09: Proceedings of Graphics Interface 2009

Traditional text input modalities, namely keyboards, are often not appropriate for use when standing in front of very large wall displays. Direct interaction techniques, such as handwriting, are better, but are not well suited to situations where users ...
Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Freehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Agence Nationale de la Recherche

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
453
Total Downloads

Downloads (Last 12 months)204
Downloads (Last 6 weeks)27

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Lyu YUrata TGarzanti AJiang ZGarcia Fernandez CKakehi Y(2024)TensionFab: Fabrication of Room-scale Surface Structures From the Tension-Active Form of Planar ModulesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641958(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641958
Zhang XMao XChung WGao ZFeng JGo K(2024)Area4U: Predicting Interaction Hotspots for Large Public Displays2024 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICNC59896.2024.10555890(1158-1163)Online publication date: 19-Feb-2024
https://doi.org/10.1109/ICNC59896.2024.10555890

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Table of Conten