research-article

MetaSense: Integrating Sensing Capabilities into Mechanical Metamaterial

Authors:

Stefanie MuellerAuthors Info & Claims

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

Pages 1063 - 1073

https://doi.org/10.1145/3472749.3474806

Published: 12 October 2021 Publication History

Abstract

In this paper, we present a method to integrate sensing capabilities into 3D printable metamaterial structures comprised of cells, which enables the creation of monolithic input devices for HCI. We accomplish this by converting select opposing cell walls within the metamaterial device into electrodes, thereby creating capacitive sensors. When a user interacts with the object and applies a force, the distance and overlapping area between opposing cell walls change, resulting in a measurable capacitance variation.

To help designers create interactive metamaterial devices, we contribute a design and fabrication pipeline based on multi-material 3D printing. Our 3D editor automatically places conductive cells in locations that are most affected by deformation during interaction and thus are most suitable as sensors. On export, our editor creates two files, one for conductive and one for non-conductive cell walls, which designers can fabricate on a multi-material 3D printer. Our applications show that designers can create metamaterial devices that sense various interactions, including sensing acceleration, binary state, shear, and magnitude and direction of applied force.

Supplementary Material

MP4 File (p1063-video_figure.mp4)

Supplemental video

Download
122.50 MB

MP4 File (p1063-video_preview.mp4)

Supplemental video

Download
4.41 MB

References

[1]

K. S. Arun, T. S. Huang, and S. D. Blostein. 1987. Least-Squares Fitting of Two 3-D Point Sets. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-9, 5 (Sept. 1987), 698–700. https://doi.org/10.1109/tpami.1987.4767965

Digital Library

[2]

Autodesk. 2021. Connected software for additive manufacturing, design and simulation. Retrieved Jun 25 from http://autodesk.com/products/netfabb

[3]

Patrick Baudisch and Stefanie Mueller. 2017. Personal Fabrication. Foundations and Trends® in Human–Computer Interaction 10, 3–4(2017), 165–293. https://doi.org/10.1561/1100000055

[4]

Alberto Boem and Giovanni Maria Troiano. 2019. Non-Rigid HCI: A Review of Deformable Interfaces and Input. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 885–906. https://doi.org/10.1145/3322276.3322347

Digital Library

[5]

Bart Braden. 1986. The Surveyor's Area Formula. The College Mathematics Journal 17, 4 (Sept. 1986), 326–337. https://doi.org/10.1080/07468342.1986.11972974

[6]

Jesse Burstyn, Nicholas Fellion, Paul Strohmeier, and Roel Vertegaal. 2015. PrintPut: Resistive and Capacitive Input Widgets for Interactive 3D Prints. In Human-Computer Interaction – INTERACT 2015. Springer International Publishing, 332–339. https://doi.org/10.1007/978-3-319-22701-6_25

Digital Library

[7]

Troy A. Chase and Ren C. Luo. 1995. A Flexible Capacitive Normal / Shear Tactile Force Sensor. In ESSDERC ’95: Proceedings of the 25th European Solid State Device Research Conference. 351–355.

[8]

Oliver Glauser, Daniele Panozzo, Otmar Hilliges, and Olga Sorkine-Hornung. 2019. Deformation Capture via Soft and Stretchable Sensor Arrays. ACM Transactions on Graphics 38, 2 (April 2019), 1–16. https://doi.org/10.1145/3311972

Digital Library

[9]

Babak Haghpanah, Hamid Ebrahimi, Davood Mousanezhad, Jonathan Hopkins, and Ashkan Vaziri. 2015. Programmable Elastic Metamaterials. Advanced Engineering Materials 18, 4 (Oct. 2015), 643–649. https://doi.org/10.1002/adem.201500295

[10]

Charles El Helou, Philip R. Buskohl, Christopher E. Tabor, and Ryan L. Harne. 2021. Digital logic gates in soft, conductive mechanical metamaterials. Nature Communications 12, 1 (March 2021). https://doi.org/10.1038/s41467-021-21920-y

[11]

Texas Instruments. 2021. Capacitive Proximity Sensing Using FDC2x1y. Retrieved Jun 25 from https://www.ti.com/lit/an/slya048b/slya048b.pdf

[12]

Texas Instruments. 2021. Common Inductive & Capacitive Sensing Applications. Retrieved Jun 25 from http://ti.com/lit/an/slya048a/slya048a.pdf

[13]

Alexandra Ion, Johannes Frohnhofen, Ludwig Wall, Robert Kovacs, Mirela Alistar, Jack Lindsay, Pedro Lopes, Hsiang-Ting Chen, and Patrick Baudisch. 2016. Metamaterial Mechanisms. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/2984511.2984540

[14]

Alexandra Ion, Ludwig Wall, Robert Kovacs, and Patrick Baudisch. 2017. Digital Mechanical Metamaterials. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3025453.3025624

Digital Library

[15]

Vikram Iyer, Justin Chan, and Shyamnath Gollakota. 2017. 3D printing wireless connected objects. ACM Transactions on Graphics 36, 6 (Nov. 2017), 1–13. https://doi.org/10.1145/3130800.3130822

Digital Library

[16]

Lin Lu, Andrei Sharf, Haisen Zhao, Yuan Wei, Qingnan Fan, Xuelin Chen, Yann Savoye, Changhe Tu, Daniel Cohen-Or, and Baoquan Chen. 2014. Build-to-last. ACM Transactions on Graphics 33, 4 (July 2014), 1–10. https://doi.org/10.1145/2601097.2601168

Digital Library

[17]

Karola Marky, Martin Schmitz, Verena Zimmermann, Martin Herbers, Kai Kunze, and Max Mühlhäuser. 2020. 3D-Auth: Two-Factor Authentication with Personalized 3D-Printed Items. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3313831.3376189

Digital Library

[18]

Materialise. 2021. Premium data optimization software. Retrieved Jun 25 from http://materialise.com/en/software/3-matic

[19]

Zachary H. Nick, Christopher E. Tabor, and Ryan L. Harne. 2020. Liquid metal microchannels as digital sensors in mechanical metamaterials. Extreme Mechanics Letters 40 (2020), 100871. https://doi.org/10.1016/j.eml.2020.100871

[20]

Stoyan Nihtianov. 2014. Measuring in the Subnanometer Range: Capacitive and Eddy Current Nanodisplacement Sensors. IEEE Industrial Electronics Magazine 8, 1 (2014), 6–15. https://doi.org/10.1109/MIE.2013.2285240

[21]

Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM. https://doi.org/10.1145/2807442.2807494

[22]

Johannes T.B. Overvelde, Twan A. de Jong, Yanina Shevchenko, Sergio A. Becerra, George M. Whitesides, James C. Weaver, Chuck Hoberman, and Katia Bertoldi. 2016. A three-dimensional actuated origami-inspired transformable metamaterial with multiple degrees of freedom. Nature Communications 7, 1 (March 2016). https://doi.org/10.1038/ncomms10929

[23]

Johannes T. B. Overvelde, James C. Weaver, Chuck Hoberman, and Katia Bertoldi. 2017. Rational design of reconfigurable prismatic architected materials. Nature 541, 7637 (Jan. 2017), 347–352. https://doi.org/10.1038/nature20824

[24]

Jayson Paulose, Anne S. Meeussen, and Vincenzo Vitelli. 2015. Selective buckling via states of self-stress in topological metamaterials. Proceedings of the National Academy of Sciences 112, 25 (June 2015), 7639–7644. https://doi.org/10.1073/pnas.1502939112

[25]

Romain Prévost, Emily Whiting, Sylvain Lefebvre, and Olga Sorkine-Hornung. 2013. Make it stand. ACM Transactions on Graphics 32, 4 (July 2013), 1–10. https://doi.org/10.1145/2461912.2461957

Digital Library

[26]

Mirza Saquib us Sarwar. 2019. Soft capacitive sensors for proximity, touch, pressure and shear measurements. Ph.D. Dissertation. University of British Columbia. https://doi.org/10.14288/1.0378695

[27]

Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann. 2014. A series of tubes. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM. https://doi.org/10.1145/2642918.2647374

Digital Library

[28]

Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas. In Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12. ACM Press. https://doi.org/10.1145/2380116.2380189

[29]

Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM. https://doi.org/10.1145/2807442.2807503

[30]

Martin Schmitz, Jürgen Steimle, Jochen Huber, Niloofar Dezfuli, and Max Mühlhäuser. 2017. Flexibles. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3025453.3025663

[31]

Martin Schmitz, Martin Stitz, Florian Müller, Markus Funk, and Max Mühlhäuser. 2019. ./trilaterate. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3290605.3300684

Digital Library

[32]

Christian Schumacher, Bernd Bickel, Jan Rys, Steve Marschner, Chiara Daraio, and Markus Gross. 2015. Microstructures to control elasticity in 3D printing. ACM Transactions on Graphics 34, 4 (July 2015), 1–13. https://doi.org/10.1145/2766926

Digital Library

[33]

Sicong Shan, Sung H. Kang, Jordan R. Raney, Pai Wang, Lichen Fang, Francisco Candido, Jennifer A. Lewis, and Katia Bertoldi. 2015. Multistable Architected Materials for Trapping Elastic Strain Energy. Advanced Materials 27, 29 (June 2015), 4296–4301. https://doi.org/10.1002/adma.201501708

[34]

Madlaina Signer, Alexandra Ion, and Olga Sorkine-Hornung. 2021. Developable Metamaterials: Mass-fabricable Metamaterials by Laser-Cutting Elastic Structures. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[35]

Ronit Slyper, Ivan Poupyrev, and Jessica Hodgins. 2010. Sensing through structure. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction. ACM. https://doi.org/10.1145/1935701.1935744

Digital Library

[36]

Ivan E. Sutherland and Gary W. Hodgman. 1974. Reentrant polygon clipping. Commun. ACM 17, 1 (Jan. 1974), 32–42. https://doi.org/10.1145/360767.360802

Digital Library

[37]

Nobuyuki Umetani and Ryan Schmidt. 2017. SurfCuit: Surface-Mounted Circuits on 3D Prints. IEEE Computer Graphics and Applications 37, 3 (May 2017), 52–60. https://doi.org/10.1109/mcg.2017.40

Digital Library

[38]

Tatyana Vasilevitsky and Amit Zoran. 2016. Steel-Sense. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/2858036.2858309

[39]

Kiril Vidimce, Alexandre Kaspar, Ye Wang, and Wojciech Matusik. 2016. Foundry. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/2984511.2984516

[40]

Kiril Vidimče, Szu-Po Wang, Jonathan Ragan-Kelley, and Wojciech Matusik. 2013. OpenFab. ACM Transactions on Graphics 32, 4 (July 2013), 1–12. https://doi.org/10.1145/2461912.2461993

Digital Library

[41]

Michael Wessely, Ticha Sethapakdi, Carlos Castillo, Jackson C. Snowden, Ollie Hanton, Isabel P. S. Qamar, Mike Fraser, Anne Roudaut, and Stefanie Mueller. 2020. Sprayable User Interfaces: Prototyping Large-Scale Interactive Surfaces with Sensors and Displays. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376249

Digital Library

[42]

Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3025453.3025842

[43]

Junyi Zhu, Lotta-Gili Blumberg, Yunyi Zhu, Martin Nisser, Ethan Levi Carlson, Xin Wen, Kevin Shum, Jessica Ayeley Quaye, and Stefanie Mueller. 2020. CurveBoards: Integrating Breadboards into Physical Objects to Prototype Function in the Context of Form. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376617

Digital Library

[44]

Shannon A. Zirbel, Kyler A. Tolman, Brian P. Trease, and Larry L. Howell. 2016. Bistable Mechanisms for Space Applications. PLOS ONE 11, 12 (Dec. 2016), e0168218. https://doi.org/10.1371/journal.pone.0168218

Cited By

Yu JKuruppu SFernando BPerera PSugiura YSubramanian SWithana A(2024)IrOnTex: Using Ironable 3D Printed Objects to Fabricate and Prototype Customizable Interactive TextilesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785438:3(1-26)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678543
Shen CJiao YSojitra R(2024)MetaController: Sheet Material Based Flexible Game Controlling SystemAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686732(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686732
Lee HShan YMao HHe L(2024)Fluxable: A Tool for Making 3D Printable Sensors and ActuatorsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686342(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686342
Show More Cited By

Recommendations

Metamaterial-based antennas for integration in UWB transceivers and portable microwave handsets

Two planar antennas based on metamaterial unit-cells are designed, fabricated, and tested. The unit-cell configuration consists of H-shaped or T-shaped slits and a grounded spiral. The slits essentially behave as series left-handed capacitance and the ...
Flexible, low-loss and large area metamaterials with high Q value

Three kinds of methods to fabricate the metamaterials are proposed.The shadow mask and EBL are used to control the nanogap.The shadow mask is reusable and low cost.The Q value is turned by changing the nanogap and substrate.The transmission spectra are ...
Investigation on resonance and radiation properties of rectangular microstrip antennas with partially filled metamaterial substrates and superstrates

In this article, the effect on the resonance and radiation characteristics of a rectangular microstrip patch antenna partially loaded with inhomogeneous substrates and superstrates consisting of μ-negative (MNG) and double-negative (DNG) metamaterials ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

October 2021

1357 pages

ISBN:9781450386357

DOI:10.1145/3472749

Editors:
Jeffrey Nichols
Apple, USA
,
Ranjitha Kumar
UIUC, USA
,
Michael Nebeling
University of Michigan, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

UIST '21

Sponsor:

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

October 10 - 14, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,174
Total Downloads

Downloads (Last 12 months)353
Downloads (Last 6 weeks)33

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu JKuruppu SFernando BPerera PSugiura YSubramanian SWithana A(2024)IrOnTex: Using Ironable 3D Printed Objects to Fabricate and Prototype Customizable Interactive TextilesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785438:3(1-26)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678543
Shen CJiao YSojitra R(2024)MetaController: Sheet Material Based Flexible Game Controlling SystemAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686732(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686732
Lee HShan YMao HHe L(2024)Fluxable: A Tool for Making 3D Printable Sensors and ActuatorsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686342(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686342
Panotopoulou ASavage VAshbrook D(2024)Threa-D Printing Tunable Bistable MechanismsAdjunct Proceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3665662.3673272(1-3)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3665662.3673272
Lyu YAo JKakehi Y(2024)Designing Mechanical 3D Metamaterials with Tension-Active ModulesAdjunct Proceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3665662.3673261(1-3)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3665662.3673261
Palma GPourjafarian NSteimle JCignoni P(2024)Capacitive Touch Sensing on General 3D SurfacesACM Transactions on Graphics10.1145/365818543:4(1-20)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658185
Li XYao CShi SFeng SZhou YDong HHuang SCai XJin KYing FWang G(2024)E-Joint: Fabrication of Large-Scale Interactive Objects Assembled by 3D Printed Conductive Parts with Copper Plated JointsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676398(1-18)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676398
Yu JPerera PWithana A(2024)Tuning Infill Characteristics to Fabricate Customizable 3D Printed Pressure SensorsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653058(315-317)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653058
Lee HHe L(2024)3D Printing Shape-Changing Devices with Inductive SensingACM SIGGRAPH 2024 Posters10.1145/3641234.3671039(1-2)Online publication date: 25-Jul-2024
https://dl.acm.org/doi/10.1145/3641234.3671039
Glazko KPortnova-Fahreeva AMankoff-Dey APsarra AMankoff J(2024)Shaping lace: Machine embroidered metamaterialsProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665792(1-12)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665792
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents