research-article

MixFab: a mixed-reality environment for personal fabrication

Authors:

Christian Weichel,

Nicolas Villar,

Hans W. GellersenAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 3855 - 3864

https://doi.org/10.1145/2556288.2557090

Published: 26 April 2014 Publication History

Abstract

Personal fabrication machines, such as 3D printers and laser cutters, are becoming increasingly ubiquitous. However, designing objects for fabrication still requires 3D modeling skills, thereby rendering such technologies inaccessible to a wide user-group. In this paper, we introduce MixFab, a mixed-reality environment for personal fabrication that lowers the barrier for users to engage in personal fabrication. Users design objects in an immersive augmented reality environment, interact with virtual objects in a direct gestural manner and can introduce existing physical objects effortlessly into their designs. We describe the design and implementation of MixFab, a user-defined gesture study that informed this design, show artifacts designed with the system and describe a user study evaluating the system's prototype.

Supplementary Material

suppl.mov (pn0736-file3.mp4)

Supplemental video

Download
95.17 MB

References

[1]

Autodesk 123D Design. http://www.123dapp.com/design.

[2]

TinkerCAD: Mind to design in minutes. https://tinkercad.com/.

[3]

Anderson, D., Frankel, J. L., Marks, J., Agarwala, A., Beardsley, P., Hodgins, J., Leigh, D., Ryall, K., Sullivan, E., and Yedidia, J. S. Tangible interaction + graphical interpretation: a new approach to 3d modeling. In Proc. SIGGRAPH (2000), 393--402.

Digital Library

[4]

Arisandi, R., Takami, Y., Otsuki, M., Kimura, A., Shibata, F., and Tamura, H. Enjoying virtual handcrafting with tooldevice. In Adjunct Proc. UIST (2012), 17--18.

Digital Library

[5]

Benko, H., Jota, R., and Wilson, A. Miragetable: Freehand interaction on a projected augmented reality tabletop. In Proc. CHI (2012), 199--208.

Digital Library

[6]

Bradski, G., and Kaehler, A. Learning OpenCV: Computer Vision with the OpenCV Library. O'Reilly Media, Incorporated, 2008.

Digital Library

[7]

Buchmann, V., Violich, S., Billinghurst, M., and Cockburn, A. Fingartips: Gesture based direct manipulation in augmented reality. In Proc. GRAPHITE (2004), 212--221.

Digital Library

[8]

Douglas, D. H., and Peucker, T. K. Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Cartographica: The International Journal for Geographic Information and Geovisualization 10 (1973), 112--122.

[9]

Follmer, S., Carr, D., Lovell, E., and Ishii, H. Copycad: remixing physical objects with copy and paste from the real world. In Adjunct Proc., UIST (2010), 381--382.

Digital Library

[10]

Follmer, S., and Ishii, H. Kidcad: digitally remixing toys through tangible tools. In Proc. CHI (2012), 2401--2410.

Digital Library

[11]

Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. Holodesk: direct 3d interactions with a situated see-through display. In Proc. CHI (2012), 2421--2430.

Digital Library

[12]

Holz, C., and Wilson, A. Data miming: inferring spatial object descriptions from human gesture. In Proc. CHI (2011), 811--820.

Digital Library

[13]

Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST (2012), 167--176.

Digital Library

[14]

Kim, H., Albuquerque, G., Havemann, S., and Fellner, D. W. Tangible 3d: hand gesture interaction for immersive 3d modeling. In Proc. EGVE (2005), 191--199.

Digital Library

[15]

Lau, M., Hirose, M., Ohgawara, A., Mitani, J., and Igarashi, T. Situated modeling: a shape-stamping interface with tangible primitives. In Proc. TEI (2012), 275--282.

Digital Library

[16]

Lau, M., Saul, G., Mitani, J., and Igarashi, T. Modeling-in-context: user design of complementary objects with a single photo. In Proc. SBIM (2010), 17--24.

Digital Library

[17]

Llamas, I., Kim, B., Gargus, J., Rossignac, J., and Shaw, C. D. Twister: a space-warp operator for the two-handed editing of 3d shapes. In ACM SIGGRAPH (2003), 663--668.

Digital Library

[18]

Mori, Y., and Igarashi, T. Plushie: an interactive design system for plush toys. In ACM SIGGRAPH (2007).

Digital Library

[19]

Mueller, S., Lopes, P., and Baudisch, P. Interactive construction: interactive fabrication of functional mechanical devices. In Proc. UIST (2012), 599--606.

Digital Library

[20]

Nishino, H., Utsumiya, K., and Korida, K. 3d object modeling using spatial and pictographic gestures. In Proc. VRST (1998), 51--58.

Digital Library

[21]

Oka, K., Sato, Y., and Koike, H. Real-time 'ngertip tracking and gesture recognition. Computer Graphics and Applications, IEEE 22, 6 (2002), 64--71.

Digital Library

[22]

Pavlovic, V. I., Sharma, R., and Huang, T. S. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7 (July 1997), 677--695.

Digital Library

[23]

Saul, G., Lau, M., Mitani, J., and Igarashi, T. Sketchchair: an all-in-one chair design system for end users. In Proc. TEI (2011), 73--80.

Digital Library

[24]

Schkolne, S., Pruett, M., and Schroder, P. Surface drawing: creating organic 3d shapes with the hand and tangible tools. In Proc. CHI (2001), 261--268.

Digital Library

[25]

Sheng, J., Balakrishnan, R., and Singh, K. An interface for virtual 3d sculpting via physical proxy. In Proc. GRAPHITE (2006), 213--220.

Digital Library

[26]

Starner, T., Leibe, B., Minnen, D., Westyn, T., Hurst, A., and Weeks, J. The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3d reconstruction for augmented desks. Machine Vision and Applications 14, 1 (2003), 59--71.

Digital Library

[27]

Weichel, C., Lau, M., and Gellersen, H. Enclosed: A component-centric interface for designing prototype enclosures. In Proc. TEI (2013), 215--218.

Digital Library

[28]

Wilson, A. D. Using a depth camera as a touch sensor. In Proc. ITS (2010), 69--72.

Digital Library

[29]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proc. CHI (2009), 1083--1092.

Digital Library

Cited By

Raina AMone VGorjian MQuek FSueda SKrishnamurthy V(2024)Blended Physical-Digital Kinesthetic Feedback for Mixed Reality-Based Conceptual Design-In-ContextProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670967(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670967
Moyer IBourgault SFrost DJacobs J(2024)Don't Mesh Around: Streamlining Manual-Digital Fabrication Workflows with Domain-Specific 3D ScanningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676385(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676385
Hanton OFraser MRoudaut A(2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642708
Show More Cited By

Index Terms

MixFab: a mixed-reality environment for personal fabrication
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

“Anyone Can Print”: Supporting Collaborations with 3D Printing Services to Empower Broader Participation in Personal Fabrication
NordiCHI '20: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society

Broader participation in 3D printing may be facilitated through printing services that insulate clients from the costs and detailed technical knowledge necessary to operate and maintain printers. However, newcomers to 3D printing encounter barriers and ...
WireMolding: 3D Modeling Approach Involving Molding with Wire
TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

Due to the popularization of personal 3D printing, individuals without a technical background have opportunities to manipulate 3D data. However, creating 3D data needs technical knowledge and it is difficult for beginners. Especially when we make ...
Tutorial: Hot Topics in Personal Fabrication Research
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

In this tutorial, we survey novel ways for interacting with personal fabrication machines, such as laser cutters, milling machines, and 3D printers. The goal is to provide attendees with an overview of recent HCI re- search in personal fabrication and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

136
Total Citations
View Citations
2,587
Total Downloads

Downloads (Last 12 months)171
Downloads (Last 6 weeks)13

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Raina AMone VGorjian MQuek FSueda SKrishnamurthy V(2024)Blended Physical-Digital Kinesthetic Feedback for Mixed Reality-Based Conceptual Design-In-ContextProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670967(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670967
Moyer IBourgault SFrost DJacobs J(2024)Don't Mesh Around: Streamlining Manual-Digital Fabrication Workflows with Domain-Specific 3D ScanningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676385(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676385
Hanton OFraser MRoudaut A(2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642708
Lakhdhir SNayar CAnderson FFournier HHolsti LKondratova IPerin CSomanath S(2024)GlucoMaker: Enabling Collaborative Customization of Glucose MonitorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642435(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642435
Stemasov EWagner TAskari AJanek JRajabi OSchikorr AFrommel JGugenheimer JRukzio E(2024)DungeonMaker: Embedding Tangible Creation and Destruction in Hybrid Board Games through Personal Fabrication TechnologyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642243(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642243
Stemasov EDemharter SRädler MGugenheimer JRukzio E(2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642083
Cheng K(2024)Towards Safer Mixed Reality: Identifying, Evaluating, and Mitigating Security and Privacy Threats2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00200(662-663)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00200
Caputo ABartolomioli ROrso VMingardi MDa Granaiola LGamberini LGiachetti A(2024)Comparison of deviceless methods for distant object manipulation in mixed realityComputers & Graphics10.1016/j.cag.2024.103959122(103959)Online publication date: Aug-2024
https://doi.org/10.1016/j.cag.2024.103959
Jung TIsrael JAhlhelm RBauer P(2023)Constraint-based bare-hand immersive 3D modellingi-com10.1515/icom-2023-001322:2(125-141)Online publication date: 31-May-2023
https://doi.org/10.1515/icom-2023-0013
Malik ALhachemi HShorten R(2023)A cyber-physical system to design 3D models using mixed reality technologies and deep learning for additive manufacturingPLOS ONE10.1371/journal.pone.028920718:7(e0289207)Online publication date: 27-Jul-2023
https://doi.org/10.1371/journal.pone.0289207
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents