research-article

Open access

BlendMR: A Computational Method to Create Ambient Mixed Reality Interfaces

Authors:

Violet Yinuo Han,

David LindlbauerAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue ISS

Article No.: 436, Pages 217 - 241

https://doi.org/10.1145/3626472

Published: 01 November 2023 Publication History

Abstract

Mixed Reality (MR) systems display content freely in space, and present nearly arbitrary amounts of information, enabling ubiquitous access to digital information. This approach, however, introduces clutter and distraction if too much virtual content is shown. We present BlendMR, an optimization-based MR system that blends virtual content onto the physical objects in users’ environments to serve as ambient information displays. Our approach takes existing 2D applications and meshes of physical objects as input. It analyses the geometry of the physical objects and identifies regions that are suitable hosts for virtual elements. Using a novel integer programming formulation, our approach then optimally maps selected contents of the 2D applications onto the object, optimizing for factors such as importance and hierarchy of information, viewing angle, and geometric distortion. We evaluate BlendMR by comparing it to a 2D window baseline. Study results show that BlendMR decreases clutter and distraction, and is preferred by users. We demonstrate the applicability of BlendMR in a series of results and usage scenarios.

Supplementary Material

Video (iss23main-p2832-p-video.mp4)

Presentation of BlendMR: A Computational Method to Create Ambient Mixed Reality Interfaces.

Download
221.87 MB

Teaser (iss23main-p2832-p-teaser.mp4)

Video figure for BlendMR: A Computational Method to Create Ambient Mixed Reality Interfaces.

Download
93.45 MB

References

[1]

Ronald T. Azuma and Chris Furmanski. 2003. Evaluating Label Placement for Augmented Reality View Management. In 2003 IEEE / ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003), 7-10 October 2003, Tokyo, Japan. IEEE Computer Society, 66–75. https://doi.org/10.1109/ISMAR.2003.1240689

[2]

Blaine Bell, Steven Feiner, and Tobias Höllerer. 2001. View management for virtual and augmented reality. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, UIST 2001, Disney’s BoardWalk Inn Resort, Walt Disney World, Orlando, Florida, USA, November 11-14, 2001. ACM, New York, NY. 101–110. https://doi.org/10.1145/502348.502363

Digital Library

[3]

Mark Billinghurst, Hirokazu Kato, and Ivan Poupyrev. 2008. Tangible augmented reality. ACM Siggraph Asia, 7, 2 (2008), 1–10. https://doi.org/10.1145/1508044.1508051

[4]

John Brooke. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry, 189, 194 (1996), 4–7.

[5]

Runze Cai, Nuwan Nanayakkarawasam Peru Kandage Janaka, Shengdong Zhao, and Minghui Sun. 2023. ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–21. https://doi.org/10.1145/3544548.3581065

Digital Library

[6]

Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols, and Xiaoyi Zhang. 2022. Towards Complete Icon Labeling in Mobile Applications. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA. Article 387, 14 pages. isbn:9781450391573 https://doi.org/10.1145/3491102.3502073

Digital Library

[7]

Yifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi, and David Lindlbauer. 2021. SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic Connections. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA. 282–297. isbn:9781450386357 https://doi.org/10.1145/3472749.3474750

Digital Library

[8]

Yi Fei Cheng, Tiffany Luong, Andreas Fender, Paul Streli, and Christian Holz. 2022. ComforTable User Interfaces: Surfaces Reduce Input Error, Time, and Exertion for Tabletop and Mid-air User Interfaces. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (ISMAR ’22). https://doi.org/10.1109/ISMAR55827.2022.00029

[9]

Shakiba Davari, Feiyu Lu, and Doug A. Bowman. 2022. Validating the Benefits of Glanceable and Context-Aware Augmented Reality for Everyday Information Access Tasks. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 436–444. https://doi.org/10.1109/VR51125.2022.00063

[10]

Niraj Ramesh Dayama, Kashyap Todi, Taru Saarelainen, and Antti Oulasvirta. 2020. GRIDS: Interactive Layout Design with Integer Programming. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:9781450367080 https://doi.org/10.1145/3313831.3376553

Digital Library

[11]

Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017. Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). Association for Computing Machinery, New York, NY, USA. 845–854. isbn:9781450349819 https://doi.org/10.1145/3126594.3126651

Digital Library

[12]

Stephen DiVerdi, Tobias Hollerer, and Richard Schreyer. 2004. Level of Detail Interfaces. In Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR ’04). IEEE Computer Society, USA. 300–301. isbn:9780769521916 https://doi.org/10.1109/ISMAR.2004.38

Digital Library

[13]

Ruofei Du, Alex Olwal, Mathieu Le Goc, Shengzhi Wu, Danhang Tang, Yinda Zhang, Jun Zhang, David Joseph Tan, Federico Tombari, and David Kim. 2022. Opportunistic Interfaces for Augmented Reality: Transforming Everyday Objects into Tangible 6DoF Interfaces Using Ad Hoc UI. CHI EA ’22. Association for Computing Machinery, New York, NY, USA. Article 183, 4 pages. isbn:9781450391566 https://doi.org/10.1145/3491101.3519911

Digital Library

[14]

Barrett Ens, Benjamin Bach, Maxime Cordeil, Ulrich Engelke, Marcos Serrano, Wesley Willett, Arnaud Prouzeau, Christoph Anthes, Wolfgang Büschel, Cody Dunne, Tim Dwyer, Jens Grubert, Jason H. Haga, Nurit Kirshenbaum, Dylan Kobayashi, Tica Lin, Monsurat Olaosebikan, Fabian Pointecker, David Saffo, Nazmus Saquib, Dieter Schmalstieg, Danielle Albers Szafir, Matt Whitlock, and Yalong Yang. 2021. Grand Challenges in Immersive Analytics. In CHI ’21: CHI Conference on Human Factors in Computing Systems, Virtual Event / Yokohama, Japan, May 8-13, 2021. ACM, New York, NY. 459:1–459:17. https://doi.org/10.1145/3411764.3446866

Digital Library

[15]

Barrett Ens, Eyal Ofek, Neil D. B. Bruce, and Pourang Irani. 2015. Spatial Constancy of Surface-Embedded Layouts across Multiple Environments. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction, SUI 2015, Los Angeles, CA, USA, August 8-9, 2015. ACM, New York, NY. 65–68. https://doi.org/10.1145/2788940.2788954

Digital Library

[16]

Andreas Rene Fender, David Lindlbauer, Philipp Herholz, Marc Alexa, and Jörg Müller. 2017. HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). Association for Computing Machinery, New York, NY, USA. 611–621. isbn:9781450349819 https://doi.org/10.1145/3126594.3126621

Digital Library

[17]

Andreas Rene Fender and Jörg Müller. 2019. SpaceState: Ad-Hoc Definition and Recognition of Hierarchical Room States for Smart Environments. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (ISS ’19). Association for Computing Machinery, New York, NY, USA. 303–314. isbn:9781450368919 https://doi.org/10.1145/3343055.3359715

Digital Library

[18]

Krzysztof Z Gajos, Daniel S Weld, and Jacob O Wobbrock. 2010. Automatically generating personalized user interfaces with Supple. 910–950 pages. https://doi.org/10.1016/j.artint.2010.05.005

Digital Library

[19]

Ran Gal, Lior Shapira, Eyal Ofek, and Pushmeet Kohli. 2014. FLARE: Fast layout for augmented reality applications. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). ieeexplore.ieee.org, 207–212. https://doi.org/10.1109/ISMAR.2014.6948429

[20]

Christoph Gebhardt, Brian Hecox, Bas van Opheusden, Daniel Wigdor, James Hillis, Otmar Hilliges, and Hrvoje Benko. 2019. Learning Cooperative Personalized Policies from Gaze Data. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA. 197–208. isbn:9781450368162 https://doi.org/10.1145/3332165.3347933

Digital Library

[21]

Google/Ipsos, U.S. 2016. How People Discover, Use, and Stay Engaged With Apps. https://www.thinkwithgoogle.com/marketing-strategies/app-and-mobile/app-discover-process-statistics/ Retrieved Sept. 14 2022

[22]

Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2016. Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE transactions on visualization and computer graphics, 23, 6 (2016), 1706–1724. https://doi.org/10.1109/TVCG.2016.2543720

Digital Library

[23]

Gurobi Optimization, LLC. 2022. Gurobi Optimizer Reference Manual. https://www.gurobi.com

[24]

Paul S Heckbert. 1986. Survey of Texture Mapping. IEEE computer graphics and applications, 6, 11 (1986), Nov., 56–67. issn:0272-1716, 1558-1756 https://doi.org/10.1109/MCG.1986.276672

Digital Library

[25]

Steven Henderson and Steven Feiner. 2010. Opportunistic Tangible User Interfaces for Augmented Reality. IEEE Transactions on Visualization and Computer Graphics, 16, 1 (2010), 4–16. https://doi.org/10.1109/TVCG.2009.91

Digital Library

[26]

Alec Jacobson and Daniele Panozzo. 2018. libigl: A simple C++ geometry processing library. https://libigl.github.io/

[27]

JASP Team. 2022. JASP (Version 0.16.3)[Computer software]. https://jasp-stats.org/

[28]

Mohamed Kari, Tobias Grosse-Puppendahl, Luis Falconeri Coelho, Andreas Rene Fender, David Bethge, Reinhard Schütte, and Christian Holz. 2021. TransforMR: Pose-Aware Object Substitution for Composing Alternate Mixed Realities. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 69–79. issn:1554-7868 https://doi.org/10.1109/ISMAR52148.2021.00021

[29]

Wallace Santos Lages and Doug A. Bowman. 2019. Walking with adaptive augmented reality workspaces: design and usage patterns. In Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, CA, USA, March 17-20, 2019. ACM, New York, NY. 356–366. https://doi.org/10.1145/3301275.3302278

Digital Library

[30]

Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least squares conformal maps for automatic texture atlas generation. ACM transactions on graphics, 21, 3 (2002), July, 362–371. issn:0730-0301 https://doi.org/10.1145/566654.566590

Digital Library

[31]

David Lindlbauer, Anna Maria Feit, and Otmar Hilliges. 2019. Context-Aware Online Adaptation of Mixed Reality Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA. 147–160. isbn:9781450368162 https://doi.org/10.1145/3332165.3347945

Digital Library

[32]

David Lindlbauer and Andrew D Wilson. 2018. Remixed reality: manipulating space and time in augmented reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3173574.3173703

Digital Library

[33]

Rong Liu and Hao Zhang. 2004. Segmentation of 3D meshes through spectral clustering. In 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings. 298–305. issn:1550-4085 https://doi.org/10.1109/PCCGA.2004.1348360

[34]

Feiyu Lu and Doug A Bowman. 2021. Evaluating the potential of glanceable ar interfaces for authentic everyday uses. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 768–777. https://doi.org/10.1109/VR50410.2021.00104

[35]

Feiyu Lu, Shakiba Davari, and Doug Bowman. 2021. Exploration of Techniques for Rapid Activation of Glanceable Information in Head-Worn Augmented Reality. In Proceedings of the 2021 ACM Symposium on Spatial User Interaction (SUI ’21). Association for Computing Machinery, New York, NY, USA. Article 14, 11 pages. isbn:9781450390910 https://doi.org/10.1145/3485279.3485286

Digital Library

[36]

Feiyu Lu, Shakiba Davari, Lee Lisle, Yuan Li, and Doug A. Bowman. 2020. Glanceable AR: Evaluating Information Access Methods for Head-Worn Augmented Reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 930–939. https://doi.org/10.1109/VR46266.2020.00113

[37]

Feiyu Lu and Yan Xu. 2022. Exploring spatial ui transition mechanisms with head-worn augmented reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–16. https://doi.org/10.1145/3491102.3517723

Digital Library

[38]

Weizhou Luo, Anke Lehmann, Hjalmar Widengren, and Raimund Dachselt. 2022. Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative Sensemaking. In CHI ’22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022 - 5 May 2022. ACM, New York, NY. 627:1–627:16. https://doi.org/10.1145/3491102.3501946

Digital Library

[39]

Kalle Lyytinen and Youngjin Yoo. 2002. Ubiquitous computing. Commun. ACM, 45, 12 (2002), 63–96.

Digital Library

[40]

Yuewen Ma, Jianmin Zheng, and Jian Xie. 2015. Foldover-Free Mesh Warping for Constrained Texture Mapping. IEEE transactions on visualization and computer graphics, 21, 3 (2015), March, 375–388. issn:1077-2626, 1941-0506 https://doi.org/10.1109/TVCG.2014.2366101

Digital Library

[41]

Jérôme Maillot, Hussein Yahia, and Anne Verroust. 1993. Interactive texture mapping. In Proceedings of the 20th annual conference on Computer graphics and interactive techniques (SIGGRAPH ’93). Association for Computing Machinery, New York, NY, USA. 27–34. isbn:9780897916011 https://doi.org/10.1145/166117.166120

Digital Library

[42]

Michael R. Marner, Ross T. Smith, James A. Walsh, and Bruce H. Thomas. 2014. Spatial User Interfaces for Large-Scale Projector-Based Augmented Reality. IEEE Computer Graphics and Applications, 34, 6 (2014), 74–82. https://doi.org/10.1109/MCG.2014.117

[43]

Fabrice Matulic, Wolfgang Büschel, Michael Ying Yang, Stephan Ihrke, Anmol Ramraika, Carsten Rother, and Raimund Dachselt. 2016. Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, May 7-12, 2016, Extended Abstracts. ACM, New York, NY. 2592–2600. https://doi.org/10.1145/2851581.2892545

Digital Library

[44]

Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko, and Andrew D. Wilson. 2016. SnapToReality: Aligning Augmented Reality to the Real World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, May 7-12, 2016. ACM, New York, NY. 1233–1244. https://doi.org/10.1145/2858036.2858250

Digital Library

[45]

Antti Oulasvirta. 2017. User Interface Design with Combinatorial Optimization. 40–47 pages. https://doi.org/10.1109/mc.2017.6

Digital Library

[46]

Antti Oulasvirta, Niraj Ramesh Dayama, Morteza Shiripour, Maximilian John, and Andreas Karrenbauer. 2020. Combinatorial Optimization of Graphical User Interface Designs. Proc. IEEE, 108, 3 (2020), 434–464. https://doi.org/10.1109/JPROC.2020.2969687

[47]

Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, and Andrew Howes. 2018. Computational Interaction. Oxford University Press. isbn:9780198799603 https://doi.org/10.1093/oso/9780198799603.001.0001

[48]

Seonwook Park, Christoph Gebhardt, Roman Rädle, Anna Maria Feit, Hana Vrzakova, Niraj Ramesh Dayama, Hui-Shyong Yeo, Clemens Nylandsted Klokmose, Aaron Quigley, Antti Oulasvirta, and Otmar Hilliges. 2018. AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21-26, 2018. ACM, New York, NY. 184. https://doi.org/10.1145/3173574.3173758

Digital Library

[49]

Ken Pfeuffer, Yasmeen Abdrabou, Augusto Esteves, Radiah Rivu, Yomna Abdelrahman, Stefanie Meitner, Amr Saadi, and Florian Alt. 2021. ARtention: A design space for gaze-adaptive user interfaces in augmented reality. Computers & graphics, 95 (2021), April, 1–12. issn:0097-8493 https://doi.org/10.1016/j.cag.2021.01.001

[50]

Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, Ananya Ipsita, and Karthik Ramani. 2022. Scalar: Authoring semantically adaptive augmented reality experiences in virtual reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–18. https://doi.org/10.1145/3491102.3517665

Digital Library

[51]

Ramesh Raskar and Kok-Lim Low. 2001. Interacting with Spatially Augmented Reality. AFRIGRAPH ’01. Association for Computing Machinery, New York, NY, USA. 101–108. isbn:1581134460 https://doi.org/10.1145/513867.513889

Digital Library

[52]

Pedro V. Sander, John Snyder, Steven J. Gortler, and Hugues Hoppe. 2001. Texture mapping progressive meshes. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques (SIGGRAPH ’01). Association for Computing Machinery, New York, NY, USA. 409–416. isbn:9781581133745 https://doi.org/10.1145/383259.383307

Digital Library

[53]

Hyewon Seo and Frederic Cordier. 2010. Constrained Texture Mapping using Image Warping. Computer graphics forum: journal of the European Association for Computer Graphics, 29, 1 (2010), March, 160–174. issn:0167-7055 https://doi.org/10.1111/j.1467-8659.2009.01584.x

[54]

Adalberto L Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). Association for Computing Machinery, New York, NY, USA. 3307–3316. isbn:9781450331456 https://doi.org/10.1145/2702123.2702389

Digital Library

[55]

Misha Sra, Sergio Garrido-Jurado, and Pattie Maes. 2018. Oasis: Procedurally Generated Social Virtual Spaces from 3D Scanned Real Spaces. IEEE transactions on visualization and computer graphics, 24, 12 (2018), Dec., 3174–3187. issn:1077-2626, 1941-0506 https://doi.org/10.1109/TVCG.2017.2762691

[56]

Keisuke Suzuki, Sohei Wakisaka, and Naotaka Fujii. 2012. Substitutional Reality System: A Novel Experimental Platform for Experiencing Alternative Reality. Scientific reports, 2, 1 (2012), June, 1–9. issn:2045-2322, 2045-2322 https://doi.org/10.1038/srep00459

[57]

Tomu Tahara, Takashi Seno, Gaku Narita, and Tomoya Ishikawa. 2020. Retargetable AR: Context-aware augmented reality in indoor scenes based on 3D scene graph. In 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 249–255. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00072

[58]

Chunxue Wei, Difeng Yu, and Tilman Dingler. 2020. Reading on 3D Surfaces in Virtual Environments. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 721–728. https://doi.org/10.1109/VR46266.2020.00095

[59]

Mark Weiser and John Seely Brown. 1996. Designing calm technology. PowerGrid Journal, 1, 1 (1996), 75–85.

[60]

Craig Wisneski, Hiroshi Ishii, Andrew Dahley, Matt Gorbet, Scott Brave, Brygg Ullmer, and Paul Yarin. 1998. Ambient displays: Turning architectural space into an interface between people and digital information. In Cooperative Buildings: Integrating Information, Organization, and Architecture: First International Workshop, CoBuild’98 Darmstadt, Germany, February 25–26, 1998 Proceedings 1. 22–32. https://doi.org/10.1007/3-540-69706-3_4

[61]

Jason Wu, Xiaoyi Zhang, Jeff Nichols, and Jeffrey P Bigham. 2021. Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA. 470–483. isbn:9781450386357 https://doi.org/10.1145/3472749.3474763

Digital Library

[62]

Fanbo Xiang, Zexiang Xu, Milos Hasan, Yannick Hold-Geoffroy, Kalyan Sunkavalli, and Hao Su. 2021. Neutex: Neural texture mapping for volumetric neural rendering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7119–7128. https://doi.org/10.1109/CVPR46437.2021.00704

[63]

Ya-Ting Yue, Yong-Liang Yang, Gang Ren, and Wenping Wang. 2017. SceneCtrl: Mixed Reality Enhancement via Efficient Scene Editing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). Association for Computing Machinery, New York, NY, USA. 427–436. isbn:9781450349819 https://doi.org/10.1145/3126594.3126601

Digital Library

Cited By

Cho HWang AKartik DXie EYan YLindlbauer D(2024)Auptimize: Optimal Placement of Spatial Audio Cues for Extended RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676424(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676424
Dogan MGonzalez EAhuja KDu RColaço ALee JGonzalez-Franco MKim D(2024)Augmented Object Intelligence with XR-ObjectsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676379(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676379
Yoshida HItoh S(2024)Modeling by Clipped Furniture Parts: Design with Text-Image Model with Stability UnderstandingProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656315(294-299)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656315
Show More Cited By

Index Terms

BlendMR: A Computational Method to Create Ambient Mixed Reality Interfaces
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Towards Ambient Augmented Reality with Tangible Interfaces
Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction

Ambient Interface research has the goal of embedding technology that disappears into the user's surroundings. In many ways Augmented Reality (AR) technology is complimentary to this in that AR interfaces seamlessly enhances the real environment with ...
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality Conference

In this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue ISS

December 2023

482 pages

EISSN:2573-0142

DOI:10.1145/3554314

Editor:
Jeffrey Nichols
Apple, USA

Issue’s Table of Contents

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution 4.0 International License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2023

Published in PACMHCI Volume 7, Issue ISS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
1,265
Total Downloads

Downloads (Last 12 months)1,265
Downloads (Last 6 weeks)155

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cho HWang AKartik DXie EYan YLindlbauer D(2024)Auptimize: Optimal Placement of Spatial Audio Cues for Extended RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676424(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676424
Dogan MGonzalez EAhuja KDu RColaço ALee JGonzalez-Franco MKim D(2024)Augmented Object Intelligence with XR-ObjectsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676379(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676379
Yoshida HItoh S(2024)Modeling by Clipped Furniture Parts: Design with Text-Image Model with Stability UnderstandingProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656315(294-299)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656315
Cho HYan YTodi KParent MSmith MJonker TBenko HLindlbauer D(2024)MineXR: Mining Personalized Extended Reality InterfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642394(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642394
Stemasov EDemharter SRädler MGugenheimer JRukzio E(2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642083

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents