research-article

SAWSense: Using Surface Acoustic Waves for Surface-bound Event Recognition

Authors:

Yasha Iravantchi,

Alanson P. SampleAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 422, Pages 1 - 18

https://doi.org/10.1145/3544548.3580991

Published: 19 April 2023 Publication History

Abstract

Enabling computing systems to understand user interactions with everyday surfaces and objects can drive a wide range of applications. However, existing vibration-based sensors (e.g., accelerometers) lack the sensitivity to detect light touch gestures or the bandwidth to recognize activity containing high-frequency components. Conversely, microphones are highly susceptible to environmental noise, degrading performance. Each time an object impacts a surface, Surface Acoustic Waves (SAWs) are generated that propagate along the air-to-surface boundary. This work repurposes a Voice PickUp Unit (VPU) to capture SAWs on surfaces (including smooth surfaces, odd geometries, and fabrics) over long distances and in noisy environments. Our custom-designed signal acquisition, processing, and machine learning pipeline demonstrates utility in both interactive and activity recognition applications, such as classifying trackpad-style gestures on a desk and recognizing 16 cooking-related activities, all with >97% accuracy. Ultimately, SAWs offer a unique signal that can enable robust recognition of user touch and on-surface events.

Supplementary Material

MP4 File (3544548.3580991-video-preview.mp4)

Video Preview

Download
25.95 MB

MP4 File (3544548.3580991-video-figure.mp4)

Video Figure

Download
271.05 MB

MP4 File (3544548.3580991-talk-video.mp4)

Pre-recorded Video Presentation

Download
151.85 MB

References

[1]

R.N. Aguilar and G.C.M. Meijer. 2002. Fast interface electronics for a resistive touch-screen. In SENSORS, 2002 IEEE, Vol. 2. 1360–1363 vol.2. https://doi.org/10.1109/ICSENS.2002.1037318

[2]

AnalogDevices. 2019. Analog Devices ADMP 401. Website. Retrieved September 20, 2019 from https://www.analog.com/media/en/technical-documentation/obsolete-data-sheets/ADMP401.pdf.

[3]

Juliette Artru, Thomas Farges, and Philippe Lognonné. 2004. Acoustic waves generated from seismic surface waves: propagation properties determined from Doppler sounding observations and normal-mode modelling. Geophysical Journal International 158, 3 (09 2004), 1067–1077. https://doi.org/10.1111/j.1365-246X.2004.02377.x arXiv:https://academic.oup.com/gji/article-pdf/158/3/1067/5985707/158-3-1067.pdf

[4]

Yusuf Aytar, Carl Vondrick, and Antonio Torralba. 2016. Soundnet: Learning sound representations from unlabeled video. In Advances in neural information processing systems. 892–900.

[5]

Behringer. 2022. "Behringer UM2". Website. Retrieved April 7, 2022 from https://www.behringer.com/product.html?modelCode=P0AVV.

[6]

Juan Pablo Bello, Charlie Mydlarz, and Justin Salamon. 2018. Sound Analysis in Smart Cities. Springer International Publishing, Cham, 373–397. https://doi.org/10.1007/978-3-319-63450-0_13

[7]

Hrvoje Benko, Andrew D. Wilson, and Federico Zannier. 2014. Dyadic Projected Spatial Augmented Reality. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 645–655. https://doi.org/10.1145/2642918.2647402

Digital Library

[8]

Andreas Braun, Stefan Krepp, and Arjan Kuijper. 2015. Acoustic Tracking of Hand Activities on Surfaces. In Proceedings of the 2nd International Workshop on Sensor-Based Activity Recognition and Interaction (Rostock, Germany) (iWOAR ’15). Association for Computing Machinery, New York, NY, USA, Article 9, 5 pages. https://doi.org/10.1145/2790044.2790052

Digital Library

[9]

Pia Breuer, Christian Eckes, and Stefan Müller. 2007. Hand gesture recognition with a novel IR time-of-flight range camera–a pilot study. In International Conference on Computer Vision/Computer Graphics Collaboration Techniques and Applications. Springer, 247–260.

[10]

Colin Campbell. 1989. 1 - Introduction. In Surface Acoustic Wave Devices and their Signal Processing Applications, Colin Campbell (Ed.). Academic Press, 1–7. https://doi.org/10.1016/B978-0-12-157345-4.50005-9

[11]

Paul Clemens. 2018. Sonion Voice Pick up (VPU) sensor - TDK. https://invensense.tdk.com/wp-content/uploads/2018/10/Sonion-Voice-Pick-Up-VPU-Sensor-Paul-Clemens.pdf

[12]

Analog Devices. 2022. "ADXL1001 Datasheet". Website. Retrieved April 7, 2022 from https://www.analog.com/en/products/adxl1001.html.

[13]

Paul Dietz and Darren Leigh. 2001. DiamondTouch: A Multi-User Touch Technology. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida) (UIST ’01). Association for Computing Machinery, New York, NY, USA, 219–226. https://doi.org/10.1145/502348.502389

Digital Library

[14]

Dodotronic. 2019. Ultramic384K. Website. Retrieved September 20, 2019 from https://www.dodotronic.com/ultramic384k/.

[15]

Rick Downs. 2005. Using resistive touch screens for human/machine interface. Analog Applications Journal Q 3 (2005), 5–10.

[16]

Bill Drafts. 2000. Acoustic Wave Technology Sensors. https://www.fierceelectronics.com/components/acoustic-wave-technology-sensors

[17]

Benjamin Elizalde, Rohan Badlani, Ankit Shah, Anurag Kumar, and Bhiksha Raj. 2018. Nels-never-ending learner of sounds. arXiv preprint arXiv:1801.05544(2018).

[18]

Kees Faber and Peter W. Maxwell. 2005. Geophone spurious frequency: What is it and how does it affect seismic data?79–80. https://doi.org/10.1190/1.1826773 arXiv:https://library.seg.org/doi/pdf/10.1190/1.1826773

[19]

Thomas Franke, Adam R Abate, David A Weitz, and Achim Wixforth. 2009. Surface acoustic wave (SAW) directed droplet flow in microfluidics for PDMS devices. Lab on a Chip 9, 18 (2009), 2625–2627.

[20]

Jort F Gemmeke, Daniel PW Ellis, Dylan Freedman, Aren Jansen, Wade Lawrence, R Channing Moore, Manoj Plakal, and Marvin Ritter. 2017. Audio set: An ontology and human-labeled dataset for audio events. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 776–780.

Digital Library

[21]

Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, and Bo Begole. 2014. SurfaceLink: Using Inertial and Acoustic Sensing to Enable Multi-Device Interaction on a Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1387–1396. https://doi.org/10.1145/2556288.2557120

Digital Library

[22]

Jun Gong, Aakar Gupta, and Hrvoje Benko. 2020. Acustico: Surface Tap Detection and Localization Using Wrist-Based Acoustic TDOA Sensing. Association for Computing Machinery, New York, NY, USA, 406–419. https://doi.org/10.1145/3379337.3415901

Digital Library

[23]

Tobias Grosse-Puppendahl, Christian Holz, Gabe Cohn, Raphael Wimmer, Oskar Bechtold, Steve Hodges, Matthew S. Reynolds, and Joshua R. Smith. 2017. Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3293–3315. https://doi.org/10.1145/3025453.3025808

Digital Library

[24]

Chris Harrison and Scott E. Hudson. 2008. Scratch Input: Creating Large, Inexpensive, Unpowered and Mobile Finger Input Surfaces. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (Monterey, CA, USA) (UIST ’08). Association for Computing Machinery, New York, NY, USA, 205–208. https://doi.org/10.1145/1449715.1449747

Digital Library

[25]

Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 627–636. https://doi.org/10.1145/2047196.2047279

Digital Library

[26]

Chris Harrison, Robert Xiao, and Scott Hudson. 2012. Acoustic Barcodes: Passive, Durable and Inexpensive Notched Identification Tags. Association for Computing Machinery, New York, NY, USA, 563–568. https://doi.org/10.1145/2380116.2380187

Digital Library

[27]

Alexander G. Hauptmann and Paul McAvinney. 1993. Gestures with speech for graphic manipulation. International Journal of Man-Machine Studies 38, 2 (1993), 231–249. https://doi.org/10.1006/imms.1993.1011

Digital Library

[28]

Yan He, Hanyan Zhang, Edwin Yang, and Song Fang. 2020. Virtual Step PIN Pad: Towards Foot-input Authentication Using Geophones. In 2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS). 649–657. https://doi.org/10.1109/MASS50613.2020.00084

[29]

David Holman, Nicholas Fellion, and Roel Vertegaal. 2014. Sensing Touch Using Resistive Graphs. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 195–198. https://doi.org/10.1145/2598510.2598552

Digital Library

[30]

Yasha Iravantchi, Karan Ahuja, Mayank Goel, Chris Harrison, and Alanson Sample. 2021. PrivacyMic: Utilizing Inaudible Frequencies for Privacy Preserving Daily Activity Recognition. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 198, 13 pages. https://doi.org/10.1145/3411764.3445169

Digital Library

[31]

Hiroshi Ishii, Craig Wisneski, Julian Orbanes, Ben Chun, and Joe Paradiso. 1999. PingPongPlus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). Association for Computing Machinery, New York, NY, USA, 394–401. https://doi.org/10.1145/302979.303115

Digital Library

[32]

Naoya Isoyama, Tsutomu Terada, and Masahiko Tsukamoto. 2014. An Interactive System for Recognizing User Actions on a Surface Using Accelerometers. In Proceedings of the 5th Augmented Human International Conference (Kobe, Japan) (AH ’14). Association for Computing Machinery, New York, NY, USA, Article 57, 2 pages. https://doi.org/10.1145/2582051.2582108

Digital Library

[33]

Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 637–644. https://doi.org/10.1145/2642918.2647383

Digital Library

[34]

Iver Jordal, Araik Tamazian, Emmanouil Theofanis Chourdakis, Céline Angonin, askskro, Nikolay Karpov, Omer Sarioglu, kvilouras, Enis Berk Çoban, Florian Mirus, Jeong-Yoon Lee, Kwanghee Choi, MarvinLvn, SolomidHero, and Tanel Alumäe. 2022. iver56/audiomentations: v0.24.0. https://doi.org/10.5281/zenodo.6367011

[35]

Shrinivas G Joshi. 1991. Surface-acoustic-wave (SAW) flow sensor. IEEE transactions on ultrasonics, ferroelectrics, and frequency control 38, 2 (1991), 148–154.

[36]

KeySight. 2019. Agilent 33521A Function Generator. Website. Retrieved September 20, 2019 from https://www.keysight.com/en/pd-1871159-pn-33521A/function-arbitrary-waveform- generator-30-mhz?&cc=US&lc=eng.

[37]

Hyosu Kim, Anish Byanjankar, Yunxin Liu, Yuanchao Shu, and Insik Shin. 2018. UbiTap: Leveraging Acoustic Dispersion for Ubiquitous Touch Interface on Solid Surfaces. In Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems (Shenzhen, China) (SenSys ’18). Association for Computing Machinery, New York, NY, USA, 211–223. https://doi.org/10.1145/3274783.3274848

Digital Library

[38]

Eric Larson, Gabe Cohn, Sidhant Gupta, Xiaofeng Ren, Beverly Harrison, Dieter Fox, and Shwetak Patel. 2011. HeatWave: Thermal Imaging for Surface User Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 2565–2574. https://doi.org/10.1145/1978942.1979317

Digital Library

[39]

Ching-Hua Lee, Bhaskar D Rao, and Harinath Garudadri. 2018. Bone-conduction sensor assisted noise estimation for improved speech enhancement. In Interspeech, Vol. 2018. NIH Public Access, 1180.

[40]

Hanchuan Li, Can Ye, and Alanson P. Sample. 2015. IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2555–2564. https://doi.org/10.1145/2702123.2702178

Digital Library

[41]

Pedro Lopes, Ricardo Jota, and Joaquim A. Jorge. 2011. Augmenting Touch Interaction through Acoustic Sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS ’11). Association for Computing Machinery, New York, NY, USA, 53–56. https://doi.org/10.1145/2076354.2076364

Digital Library

[42]

LSMDS1. 2022. "LSMDS1 Fast Library". Website. Retrieved April 7, 2022 from https://github.com/FemmeVerbeek/Arduino_LSM9DS1.

[43]

Ben Maman and Amit Bermano. 2022. TypeNet: Towards Camera Enabled Touch Typing on Flat Surfaces through Self-Refinement. In 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 567–576. https://doi.org/10.1109/WACV51458.2022.00064

[44]

Brian McFee, Alexandros Metsai, Matt McVicar, Stefan Balke, Carl Thomé, Colin Raffel, Frank Zalkow, Ayoub Malek, Dana, Kyungyun Lee, Oriol Nieto, Dan Ellis, Jack Mason, Eric Battenberg, Scott Seyfarth, Ryuichi Yamamoto, viktorandreevichmorozov, Keunwoo Choi, Josh Moore, Rachel Bittner, Shunsuke Hidaka, Ziyao Wei, nullmightybofo, Adam Weiss, Darío Hereñú, Fabian-Robert Stöter, Pius Friesch, Matt Vollrath, Taewoon Kim, and Thassilo. 2022. librosa/librosa: 0.9.1. https://doi.org/10.5281/zenodo.6097378

[45]

Manuel Meier, Paul Streli, Andreas Fender, and Christian Holz. 2021. TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 519–528. https://doi.org/10.1109/VR50410.2021.00076

[46]

Bjoern H Menze, B Michael Kelm, Ralf Masuch, Uwe Himmelreich, Peter Bachert, Wolfgang Petrich, and Fred A Hamprecht. 2009. A comparison of random forest and its Gini importance with standard chemometric methods for the feature selection and classification of spectral data. BMC bioinformatics 10, 1 (2009), 213.

[47]

Jon Moeller and Andruid Kerne. 2012. ZeroTouch: An Optical Multi-Touch and Free-Air Interaction Architecture. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 2165–2174. https://doi.org/10.1145/2207676.2208368

Digital Library

[48]

Takaaki Nara, Masaya Takasaki, Taro Maeda, Toshiro Higuchi, Shigeru Ando, and Susumu Tachi. 2001. Surface acoustic wave tactile display. IEEE Computer Graphics and Applications 21, 6 (2001), 56–63.

Digital Library

[49]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & Activate: Adding Interactivity to Existing Objects Using Active Acoustic Sensing. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 31–40. https://doi.org/10.1145/2501988.2501989

Digital Library

[50]

Shijia Pan, Ceferino Gabriel Ramirez, Mostafa Mirshekari, Jonathon Fagert, Albert Jin Chung, Chih Chi Hu, John Paul Shen, Hae Young Noh, and Pei Zhang. 2017. SurfaceVibe: Vibration-Based Tap & Swipe Tracking on Ubiquitous Surfaces(IPSN ’17). Association for Computing Machinery, New York, NY, USA, 197–208. https://doi.org/10.1145/3055031.3055077

Digital Library

[51]

J. A. Paradiso, K. Hsiao, J. Strickon, J. Lifton, and A. Adler. 2000. Sensor systems for interactive surfaces. IBM Systems Journal 39, 3.4 (2000), 892–914. https://doi.org/10.1147/sj.393.0892

Digital Library

[52]

Hubert Pham. 2017. "PyAudio". Website. Retrieved September 17, 2020 from https://people.csail.mit.edu/hubert/pyaudio/.

[53]

Karol J Piczak. 2015. Environmental sound classification with convolutional neural networks. In 2015 IEEE 25th international workshop on machine learning for signal processing (MLSP). IEEE, 1–6.

[54]

Louis Pisha, Julian Warchall, Tamara Zubatiy, Sean Hamilton, Ching-Hua Lee, Ganz Chockalingam, Patrick P Mercier, Rajesh Gupta, Bhaskar D Rao, and Harinath Garudadri. 2019. A wearable, extensible, open-source platform for hearing healthcare research. IEEE Access 7(2019), 162083–162101.

[55]

Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E. Robinson. 2016. Project Jacquard: Interactive Digital Textiles at Scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 4216–4227. https://doi.org/10.1145/2858036.2858176

Digital Library

[56]

Mark Richardson, Matt Durasoff, and Robert Wang. 2020. Decoding Surface Touch Typing from Hand-Tracking. Association for Computing Machinery, New York, NY, USA, 686–696. https://doi.org/10.1145/3379337.3415816

Digital Library

[57]

Justin Salamon and Juan Pablo Bello. 2015. Unsupervised feature learning for urban sound classification. In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 171–175.

[58]

Justin Salamon and Juan Pablo Bello. 2017. Deep convolutional neural networks and data augmentation for environmental sound classification. IEEE Signal processing letters 24, 3 (2017), 279–283.

[59]

SciKit. 2020. "SciKit". Website. Retrieved September 17, 2020 from https://scikit-learn.org/stable/.

[60]

Yilei Shi, Haimo Zhang, Jiashuo Cao, and Suranga Nanayakkara. 2020. VersaTouch: A Versatile Plug-and-Play System That Enables Touch Interactions on Everyday Passive Surfaces. In Proceedings of the Augmented Humans International Conference (Kaiserslautern, Germany) (AHs ’20). Association for Computing Machinery, New York, NY, USA, Article 26, 12 pages. https://doi.org/10.1145/3384657.3384778

Digital Library

[61]

SM-24. 2022. "SM-24 Geophone". Website. Retrieved April 7, 2022 from https://www.iongeo.com/wp-content/uploads/2020/07/SM-24-Geophone-Element-Product-Flyer.pdf.

[62]

Knowles SPH1668LM4H. 2022. "Knowles SPH1668LM4H". Website. Retrieved April 7, 2022 from https://www.digikey.com/en/products/detail/knowles/SPH1668LM4H-1/5332441.

[63]

Sai Ganesh Swaminathan, Scott Hudson, and Steve Hodges. 2020. Using Surface Acoustic Wave Devices for Self-powered Sensing & Interaction. In SelfSustainableCHI Workshop, CHI 2020. https://www.microsoft.com/en-us/research/publication/using-surface-acoustic-wave-devices-for-self-powered-sensing-interaction/

[64]

UMA-8. 2022. "MiniDSP UMA-8". Website. Retrieved April 7, 2022 from https://www.minidsp.com/products/usb-audio-interface/uma-8-microphone-array.

[65]

Pierre Wellner. 1991. The DigitalDesk Calculator: Tangible Manipulation on a Desk Top Display. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (Hilton Head, South Carolina, USA) (UIST ’91). Association for Computing Machinery, New York, NY, USA, 27–33. https://doi.org/10.1145/120782.120785

Digital Library

[66]

Andrew Wilson, Hrvoje Benko, Shahram Izadi, and Otmar Hilliges. 2012. Steerable Augmented Reality with the Beamatron. Association for Computing Machinery, New York, NY, USA, 413–422. https://doi.org/10.1145/2380116.2380169

Digital Library

[67]

Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, above and between Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). Association for Computing Machinery, New York, NY, USA, 273–282. https://doi.org/10.1145/1866029.1866073

Digital Library

[68]

Robert Xiao, Teng Cao, Ning Guo, Jun Zhuo, Yang Zhang, and Chris Harrison. 2018. LumiWatch: On-Arm Projected Graphics and Touch Input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173669

Digital Library

[69]

Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: Rapid and Easy Creation of Ad-Hoc Interactive Applications on Everyday Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 879–888. https://doi.org/10.1145/2470654.2466113

Digital Library

[70]

Robert Xiao, Scott Hudson, and Chris Harrison. 2016. DIRECT: Making Touch Tracking on Ordinary Surfaces Practical with Hybrid Depth-Infrared Sensing. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS ’16). Association for Computing Machinery, New York, NY, USA, 85–94. https://doi.org/10.1145/2992154.2992173

Digital Library

[71]

Robert Xiao, Greg Lew, James Marsanico, Divya Hariharan, Scott Hudson, and Chris Harrison. 2014. Toffee: Enabling Ad Hoc, around-Device Interaction with Acoustic Time-of-Arrival Correlation. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices; Services (Toronto, ON, Canada) (MobileHCI ’14). Association for Computing Machinery, New York, NY, USA, 67–76. https://doi.org/10.1145/2628363.2628383

Digital Library

[72]

Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3025453.3025842

Digital Library

[73]

Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, Article 273, 15 pages. https://doi.org/10.1145/3173574.3173847

Digital Library

Cited By

Huang KIravantchi YChen DSample A(2024)MagDesk: Interactive Tabletop Workspace Based on Passive Magnetic TrackingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997568:4(1-31)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699756
Ding JChatterjee IChing AWaghmare APatel S(2024)Demo of FlowRing: Seamless Cross-Surface Interaction via Opto-Acoustic RingAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686744(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686744
Kim JJung HOakley I(2024)VibraHand: In-Hand Superpower Enabling Spying, Precognition, and TelekinesisAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686728(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686728
Show More Cited By

Index Terms

SAWSense: Using Surface Acoustic Waves for Surface-bound Event Recognition
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sensor devices and platforms
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
    2. Interaction techniques
      1. Gestural input
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices

Recommendations

New Concepts for Motion Sensors Based on Surface Acoustic Waves
SSIP '19: Proceedings of the 2019 2nd International Conference on Sensors, Signal and Image Processing

New concepts for motion sensors on acoustic waves are discussed. An algorithm for studying surface acoustic wave (SAW) characteristics in piezodielectric crystals of arbitrary symmetry type under stress is considered. The main mechanisms of the impact ...
Numerical simulation of piezoelectrically agitated surface acoustic waves on microfluidic biochips
Abstract
Microfluidic biochips are biochemical laboratories on the microscale that are used for genotyping and sequencing in genomics, protein profiling in proteomics, and cytometry in cell analysis. There are basically two classes of such biochips: active ...
Acoustic Field Analysis of Surface Acoustic Wave Dispersive Delay Lines Using Inclined Chirp IDT

Acoustic field analysis results of surface acoustic wave dispersive delay lines using inclined chirp IDTs on a Y-Z LiNbO₃ substrate are described. The calculated results are compared with optical measurements. The angular spectrum of the plane wave ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
2,321
Total Downloads

Downloads (Last 12 months)1,119
Downloads (Last 6 weeks)82

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang KIravantchi YChen DSample A(2024)MagDesk: Interactive Tabletop Workspace Based on Passive Magnetic TrackingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997568:4(1-31)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699756
Ding JChatterjee IChing AWaghmare APatel S(2024)Demo of FlowRing: Seamless Cross-Surface Interaction via Opto-Acoustic RingAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686744(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686744
Kim JJung HOakley I(2024)VibraHand: In-Hand Superpower Enabling Spying, Precognition, and TelekinesisAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686728(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686728
Iravantchi YSample A(2024)T4Train: Rapid Prototyping of ML-Driven Interactive ApplicationsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636269(1-4)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636269
Yang YChen THuang YGuo XShangguan L(2024)MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642437(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642437
Su YZhang TFeng JShi YYang XWu T(2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642356
Huang JBai JZhang XLiu ZFeng YLiu JSun XDong MLi M(2024)KeystrokeSniffer: An Off-the-Shelf Smartphone Can Eavesdrop on Your Privacy From AnywhereIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.342430119(6840-6855)Online publication date: 2024
https://doi.org/10.1109/TIFS.2024.3424301
Li KIravantchi YPark HLiu YSample A(2024)ECG Signal Construction From Heart Sounds via Single Node, Surface Acoustic Sensing2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)10.1109/EMBC53108.2024.10781974(1-4)Online publication date: 15-Jul-2024
https://doi.org/10.1109/EMBC53108.2024.10781974
Yoshida MMatsui TIshiyama TFujimoto MSuwa HYasumoto K(2023)Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-InterfacesIEEE Access10.1109/ACCESS.2023.334350011(142611-142627)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3343500

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Table of Conten