Hey Building! Novel Interfaces for Parametric Design Manipulations in Virtual Reality
Authors: 
Adam Drogemuller, Brandon J. Matthews, Andrew Cunningham, Rongrong Yu, Ning Gu, Bruce H. ThomasAuthors Info & Claims
Adam Drogemuller, Brandon J. Matthews, Andrew Cunningham, Rongrong Yu, Ning Gu, Bruce H. ThomasAuthors Info & ClaimsArticle No.: 540, Pages 330 - 355
Abstract
Parametric Design enables designers to formulate and explore new ideas through parameters, typically by manipulating numerical values. However, visualising and exploring the design space of an established parametric design solution is natively difficult through desktop displays for designers due to screen space constraints and requiring familiarity with visual-language programming interfaces. Thus, we sought to explore Virtual Reality (VR), inspired by Natural User Interfaces (NUI), to develop and explore new interfaces departing from traditional programming interfaces, that could complement the spatial and embodied affordances of contemporary VR devices. Informed by two industry-led focus groups with architects we developed and examined the usability of three different interfaces: 1) Paramaxes, an axes-based interface that allows designers to distribute and manipulate parameter visualisations around them in physical space; 2) ParamUtter, a Voice-based User Interface (VUI) that allows designers to manipulate parameter visualisations through natural languages; 3) Control Panel, which presents the parameters as sliders in a scrollable pane and acts as baseline comparison. We ran an exploratory study with experts and found that the Control Panel was ultimately the preferred interface for a design manipulation task. However, participants commented favorably towards qualities in the unconventional interfaces, with ParamUtter scoring highest in System Usability Scores (SUS), and participants valuing the potential of using physical space to explore design spaces with Paramaxes.
Supplemental Material
MP4 File - Hey Building! Interfaces for Parametric Design Manipulations in Virtual Reality
Video demonstrating different interfaces (Paramaxes, ParamUtter and Control Panel) capable of manipulating Parametric Designs in Virtual Reality.
- Download
- 278.76 MB
References
[1]
HK Abdullah and JM Kamara. 2013. Parametric design procedures: a new approach to generative-form in the conceptual design phase. In AEI 2013: Building Solutions for Architectural Engineering. 334–343.
[2]
Saul Albert and Magnus Hamann. 2021. Putting wake words to bed: We speak wake words with systematically varied prosody, but CUIs don’t listen. In Proceedings of the 3rd Conference on Conversational User Interfaces. 1–5.
[3]
Kifah Alhazzaa and Wei Yan. 2023. Integrating Parametric Modeling, BIM, and Building Performance Analysis into Augmented Reality for Architectural Design and Education. In Proceedings of the 2023 7th International Conference on Virtual and Augmented Reality Simulations (ICVARS ’23). Association for Computing Machinery, New York, NY, USA. 68–76. isbn:9781450397469 https://doi.org/10.1145/3603421.3603431
[4]
Reiner Anderl and Ralf Mendgen. 1995. Parametric design and its impact on solid modeling applications. In Proceedings of the third ACM symposium on Solid modeling and applications. 1–12.
[5]
Lee Anderson, James Esser, and Victoria Interrante. 2003. A virtual environment for conceptual design in architecture. In Proceedings of the workshop on Virtual environments 2003. 57–63.
[6]
Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the SIGCHI conference on human factors in computing systems. 55–64.
[7]
Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction, 24, 6 (2008), 574–594.
[8]
Thomas Berlage. 1994. A selective undo mechanism for graphical user interfaces based on command objects. ACM Transactions on Computer-Human Interaction (TOCHI), 1, 3 (1994), 269–294.
[9]
Andreea Dalia Blaga, Maite Frutos-Pascual, Chris Creed, and Ian Williams. 2021. Freehand grasping: An analysis of grasping for docking tasks in virtual reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 749–758.
[10]
Richard A Bolt. 1980. “Put-that-there” Voice and gesture at the graphics interface. In Proceedings of the 7th annual conference on Computer graphics and interactive techniques. 262–270.
[11]
Sheelagh Carpendale. 2008. Evaluating information visualizations. In Information visualization: Human-centered issues and perspectives. Springer, 19–45.
[12]
Renata Castelo-Branco, António Leitão, and Catarina Brás. 2020. Program comprehension for live algorithmic design in virtual reality. In Companion Proceedings of the 4th International Conference on Art, Science, and Engineering of Programming. 69–76.
[13]
Michael Harris Cohen, James P Giangola, and Jennifer Balogh. 2004. Voice user interface design. Addison-Wesley Professional.
[14]
Maxime Cordeil, Andrew Cunningham, Tim Dwyer, Bruce H Thomas, and Kim Marriott. 2017. ImAxes: Immersive axes as embodied affordances for interactive multivariate data visualisation. In Proceedings of the 30th annual ACM symposium on user interface software and technology. 71–83.
[15]
Rui de Klerk, André Mendes Duarte, Daniel Pires Medeiros, José Pinto Duarte, Joaquim Jorge, and Daniel Simões Lopes. 2019. Usability studies on building early stage architectural models in virtual reality. Automation in Construction, 103 (2019), 104–116.
[16]
Juan Manuel Davila Delgado, Lukumon Oyedele, Peter Demian, and Thomas Beach. 2020. A research agenda for augmented and virtual reality in architecture, engineering and construction. Advanced Engineering Informatics, 45 (2020), 101122.
[17]
Dirk Donath and Holger Regenbrecht. 1996. Using virtual reality aided design techniques for three-dimensional architectural sketching. In Design Computation, Collaboration, Reasoning, Pedagogy. ACADIA Conference Proceedings. 201–212.
[18]
Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT press.
[19]
Tim Dwyer, Bongshin Lee, Danyel Fisher, Kori Inkpen Quinn, Petra Isenberg, George Robertson, and Chris North. 2009. A comparison of user-generated and automatic graph layouts. IEEE transactions on visualization and computer graphics, 15, 6 (2009), 961–968.
[20]
Eduardo Castro e Costa, Joaquim Jorge, Aaron D Knochel, and José Pinto Duarte. 2020. Enabling parametric design space exploration by non-designers. AI EDAM, 34, 2 (2020), 160–175.
[21]
James F Eckler. 2012. Language of Space and Form: generative terms for architecture. John Wiley & Sons.
[22]
Ahmad Eltaweel and SU Yuehong. 2017. Parametric design and daylighting: A literature review. Renewable and Sustainable Energy Reviews, 73 (2017), 1086–1103.
[23]
Kailun Feng, Weizhuo Lu, and Yaowu Wang. 2019. Assessing environmental performance in early building design stage: An integrated parametric design and machine learning method. Sustainable Cities and Society, 50 (2019), 101596.
[24]
Fologram. 2024. Fologram. https://fologram.com/.
[25]
Daniele Giunchi, Alejandro Sztrajman, Stuart James, and Anthony Steed. 2021. Mixing modalities of 3d sketching and speech for interactive model retrieval in virtual reality. In Proceedings of the 2021 ACM International Conference on Interactive Media Experiences. 144–155.
[26]
Gary G Hendrix. 1982. Natural-language interface. American Journal of Computational Linguistics, 8, 2 (1982), 56–61.
[27]
James Hollan, Edwin Hutchins, and David Kirsh. 2000. Distributed cognition: toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction (TOCHI), 7, 2 (2000), 174–196.
[28]
Seung Wan Hong, Jin Lee, and Jin Kook Lee. 2024. Human behaviour simulation for promoting usefulness and user-centric values in parametric design. Automation in Construction, 162 (2024), 105386.
[29]
Wassim Jabi. 2013. Parametric design for architecture. Hachette UK.
[30]
Nicholas Jennings, Ananya Nandy, Xinyi Zhu, Yuting Wang, Fanping Sui, James Smith, and Bjoern Hartmann. 2022. Generativr: Spatial interactions in virtual reality to explore generative design spaces. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–6.
[31]
Sumbul Khan and Bige Tunçer. 2019. Speech analysis for conceptual CAD modeling using multi-modal interfaces: An investigation into architects’ and engineers’ speech preferences. AI EDAM, 33, 3 (2019), 275–288.
[32]
Ho-Jeong Kim, Woo-Seok Choi, and Ji-Won Kim. 2022. A study on parametric design tool for residential buildings securing valid sunlight hours on the winter solstice. Journal of Asian Architecture and Building Engineering, 21, 5 (2022), 1657–1676.
[33]
Yelim Kim, Mohi Reza, Joanna McGrenere, and Dongwook Yoon. 2021. Designers characterize naturalness in voice user interfaces: Their goals, practices, and challenges. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
[34]
Cheryl Lao, Haijun Xia, Daniel Wigdor, and Fanny Chevalier. 2021. Attribute spaces: Supporting design space exploration in virtual reality. In Proceedings of the 2021 ACM Symposium on Spatial User Interaction. 1–11.
[35]
JuHyun Lee, Ning Gu, and Anthony P Williams. 2014. Parametric design strategies for the generation of creative designs. International Journal of Architectural Computing, 12, 3 (2014), 263–282.
[36]
Ju Hyun Lee and Michael J Ostwald. 2020. Creative decision-making processes in parametric design. Buildings, 10, 12 (2020), 242.
[37]
Seung Won Lee, Tae Hee Jo, Semin Jin, Jiin Choi, Kyungwon Yun, Sergio Bromberg, Seonghoon Ban, and Kyung Hoon Hyun. 2024. The Impact of Sketch-guided vs. Prompt-guided 3D Generative AIs on the Design Exploration Process. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–18.
[38]
Clayton Lewis and John Rieman. 1993. Task-centered user interface design. A practical introduction.
[39]
Yehia Madkour, Oliver Neumann, and Halil Erhan. 2009. Programmatic formation: Practical applications of parametric design. International Journal of Architectural Computing, 7, 4 (2009), 587–603.
[40]
Alessio Malizia and Andrea Bellucci. 2012. The artificiality of natural user interfaces. Commun. ACM, 55, 3 (2012), 36–38.
[41]
José Luis Menegotto. 2015. A Framework for Speech-Oriented CAD and BIM Systems. In Computer-Aided Architectural Design Futures. The Next City-New Technologies and the Future of the Built Environment: 16th International Conference, CAAD Futures 2015, São Paulo, Brazil, July 8-10, 2015. Selected Papers 16. 329–347.
[42]
Pedro Monteiro, Guilherme Gonçalves, Hugo Coelho, Miguel Melo, and Maximino Bessa. 2021. Hands-free interaction in immersive virtual reality: A systematic review. IEEE Transactions on Visualization and Computer Graphics, 27, 5 (2021), 2702–2713. https://doi.org/10.1109/TVCG.2021.3067687
[43]
Enrico Motta and Zdenek Zdrahal. 1996. Parametric design problem solving. In Proceedings of the 10th Banff Knowledge Acquisition for Knowledge-Based System Workshop.
[44]
Donald A Norman. 1968. Toward a theory of memory and attention. Psychological review, 75, 6 (1968), 522.
[45]
Donald A Norman. 2010. Natural user interfaces are not natural. interactions, 17, 3 (2010), 6–10.
[46]
Rivka Oxman. 2017. Thinking difference: Theories and models of parametric design thinking. Design studies, 52 (2017), 4–39.
[47]
Richard Rodriguez, Brian T Sullivan, Mayra Donaji Barrera Machuca, Anil Ufuk Batmaz, Cyane Tornatzky, and Francisco R Ortega. 2024. An Artists’ Perspectives on Natural Interactions for Virtual Reality 3D Sketching. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–20.
[48]
Anirudh Sharma, Sriganesh Madhvanath, Ankit Shekhawat, and Mark Billinghurst. 2011. MozArt: a multimodal interface for conceptual 3D modeling. In Proceedings of the 13th international conference on multimodal interfaces. 307–310.
[49]
Naghmi Shireen, Halil Erhan, Rodolfo Sanchez, Jelena Popovic, Robert Woodbury, and Bernhard E Riecke. 2011. Design space exploration in parametric systems: analyzing effects of goal specificity and method specificity on design solutions. In Proceedings of the 8th ACM Conference on Creativity and Cognition. 249–258.
[50]
Gideon Steinberg. 2012. Natural user interfaces. In ACM SIGCHI conference on human factors in computing systems.
[51]
Evgeny Stemasov, Simon Demharter, Max Rädler, Jan Gugenheimer, and Enrico Rukzio. 2024. pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal Fabrication. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24). Association for Computing Machinery, New York, NY, USA. Article 337, 22 pages. isbn:9798400703300 https://doi.org/10.1145/3613904.3642083
[52]
Joachim Stempfle and Petra Badke-Schaub. 2002. Thinking in design teams-an analysis of team communication. Design studies, 23, 5 (2002), 473–496.
[53]
Bernhard Suhm. 2003. Towards best practices for speech user interface design. In INTERSPEECH. 2217–2220.
[54]
Hasan Tastan, Cetin Tuker, and Togan Tong. 2022. Using handheld user interface and direct manipulation for architectural modeling in immersive virtual reality: An exploratory study. Computer Applications in Engineering Education, 30, 2 (2022), 415–434.
[55]
Josh Urban Davis, Fraser Anderson, Merten Stroetzel, Tovi Grossman, and George Fitzmaurice. 2021. Designing co-creative ai for virtual environments. In Creativity and Cognition. 1–11.
[56]
Zhuxiaona Wei and James A Landay. 2018. Evaluating speech-based smart devices using new usability heuristics. IEEE Pervasive Computing, 17, 2 (2018), 84–96.
[57]
Adam S Williams, Jason Garcia, and Francisco Ortega. 2020. Understanding multimodal user gesture and speech behavior for object manipulation in augmented reality using elicitation. IEEE Transactions on Visualization and Computer Graphics, 26, 12 (2020), 3479–3489.
[58]
Terry Winograd. 1972. Understanding natural language. Cognitive psychology, 3, 1 (1972), 1–191.
[59]
Erik Wolf, Sara Klüber, Chris Zimmerer, Jean-Luc Lugrin, and Marc Erich Latoschik. 2019. ” Paint that object yellow”: Multimodal interaction to enhance creativity during design tasks in VR. In 2019 International conference on multimodal interaction. 195–204.
[60]
Robert Robert Francis Woodbury. 2010. Elements of parametric design. (No Title).
[61]
Yingxin Wu and Masahiro Takatsuka. 2005. Three dimensional colour pickers. In Proceedings of the 2005 Asia-Pacific Symposium on Information Visualisation - Volume 45 (APVis ’05). Australian Computer Society, Inc., AUS. 107–114. isbn:1920682279
[62]
Rongrong Yu, Ning Gu, and Michael Ostwald. 2013. Comparing designers’ problem-solving behavior in a parametric design environment and a geometric modeling environment. Buildings, 3, 3 (2013), 621–638.
[63]
Qi Yuan and Yongjian Huai. 2021. Immersive sketch-based tree modeling in virtual reality. Computers & Graphics, 94 (2021), 132–143.
[64]
Yasser Zarei. 2012. The challenges of parametric design in architecture today: Mapping the design practice. Ph. D. Dissertation. The University of Manchester (United Kingdom).
[65]
Lei Zhang, Ashutosh Agrawal, Steve Oney, and Anhong Guo. 2023. VRGit: A Version Control System for Collaborative Content Creation in Virtual Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA. Article 36, 14 pages. isbn:9781450394215 https://doi.org/10.1145/3544548.3581136
[66]
Yuxuan Zhang, Hexu Liu, Shih-Chung Kang, and Mohamed Al-Hussein. 2020. Virtual reality applications for the built environment: Research trends and opportunities. Automation in Construction, 118 (2020), 103311.
Index Terms
- Hey Building! Novel Interfaces for Parametric Design Manipulations in Virtual Reality
Recommendations
Evaluation of haptic virtual reality user interfaces for medical marking on 3D models
Highlights- Two haptic VR interfaces are proposed to interact with volumetric medical images for improving current computer-aided medical diagnosis and planning.
- Compared with the traditional 2D interface using a screen-based 2D display and a ...
AbstractThree-dimensional (3D) visualization has been widely used in computer-aided medical diagnosis and planning. To interact with 3D models, current user interfaces in medical systems mainly rely on the traditional 2D interaction techniques by ...
Walking by Cycling: A Novel In-Place Locomotion User Interface for Seated Virtual Reality Experiences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsWe introduce VR Strider, a novel locomotion user interface (LUI) for seated virtual reality (VR) experiences, which maps cycling biomechanics of the user's legs to virtual walking movements. The core idea is to translate the motion of pedaling on a mini ...
A comparative study of 2D and 3D mobile keypad user interaction preferences in virtual reality graphic user interfaces
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyGraphical User Interfaces (GUI) on mobiles involves user interaction of touch input on a 2D surface. With advances in Augmented/Virtual Reality, possibilities of 3D GUIs will emerge. However, 3D GUIs do not have many design heuristics. This paper ...
Comments
Information & Contributors
Information
Published In
December 2024
693 pages
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 October 2024
Published in PACMHCI Volume 8, Issue ISS
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Australian Research Council?s Discovery Grant
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 116Total Downloads
- Downloads (Last 12 months)116
- Downloads (Last 6 weeks)48
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in