research-article

Open access

Vibrosight++: City-Scale Sensing Using Existing Retroreflective Signs and Markers

Authors:

Jesse T. Gonzalez,

Chris HarrisonAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 410, Pages 1 - 14

https://doi.org/10.1145/3411764.3445054

Published: 07 May 2021 Publication History

All formats PDF

Abstract

Today’s smart cities use thousands of physical sensors distributed across the urban landscape to support decision making in areas such as infrastructure monitoring, public health, and resource management. These weather-hardened devices require power and connectivity, and often cost thousands just to install, let alone maintain. In this paper, we show how long-range laser vibrometry can be used for low-cost, city-scale sensing. Although typically limited to just a few meters of sensing range, the use of retroreflective markers can boost this to 1km or more. Fortuitously, cities already make extensive use of retroreflective materials for street signs, construction barriers, road studs, license plates, and many other markings. We describe how our prototype system can co-opt these existing markers at very long ranges and use them as unpowered accelerometers for use in a wide variety of sensing applications.

Supplementary Material

VTT File (3411764.3445054_videofigurecaptions.vtt)

Download
4.78 KB

VTT File (3411764.3445054_videopreviewcaptions.vtt)

Download
.64 KB

MP4 File (3411764.3445054_videofigure.mp4)

Supplemental video

Download
175.54 MB

MP4 File (3411764.3445054_videopreview.mp4)

Preview video

Download
44.05 MB

References

[1]

American National Standards Institute. 2014. ANSI Z136.1 - Safe Use of Lasers. https://www.lia.org/resources/laser-safety-information/laser-safety-standards/ansi-z136-standards/z136-1 Retrieved January 10, 2021.

[2]

Array of Things. 2020. Project Information. https://arrayofthings.github.io Retrieved January 10, 2021.

[3]

Kridsakron Auynirundronkool, Nengcheng Chen, Caihua Peng, Chao Yang, Jianya Gong, and Chaowalit Silapathong. 2012. Flood detection and mapping of the Thailand Central plain using RADARSAT and MODIS under a sensor web environment. International Journal of Applied Earth Observation and Geoinformation 14, 1(2012), 245 – 255. https://doi.org/10.1016/j.jag.2011.09.017

[4]

Yuequan Bao, James L Beck, and Hui Li. 2011. Compressive sampling for accelerometer signals in structural health monitoring. Structural Health Monitoring 10, 3 (2011), 235–246. https://doi.org/10.1177/1475921710373287

[5]

Johan Barthélemy, Nicolas Verstaevel, Hugh Forehead, and Pascal Perez. 2019. Edge-Computing Video Analytics for Real-Time Traffic Monitoring in a Smart City. Sensors 19, 9 (May 2019), 2048. https://doi.org/10.3390/s19092048

[6]

Juan P Bello, Claudio Silva, Oded Nov, R Luke DuBois, Anish Arora, Justin Salamon, Charles Mydlarz, and Harish Doraiswamy. 2019. Sonyc: A system for monitoring, analyzing, and mitigating urban noise pollution. Commun. ACM 62, 2 (2019), 68–77.

Digital Library

[7]

Austin Lyons Bischoff and Darcy M Bullock. 2002. Sign retroreflectivity study. Joint Transportation Research Program (01 2002). https://doi.org/10.5703/1288284313313

[8]

Jillian Carr and Jennifer L Doleac. 2016. The geography, incidence, and underreporting of gun violence: new evidence using ShotSpotter data. Incidence, and Underreporting of Gun Violence: New Evidence Using Shotspotter (2016). https://doi.org/10.2139/ssrn.2770506

[9]

Paolo Castellinim, Milena Martarelli, and Enrico Primo Tomasini. 2006. Laser Doppler Vibrometry: Development of advanced solutions answering to technology’s needs. Mechanical Systems and Signal Processing 20, 6 (2006), 1265 – 1285. https://doi.org/10.1016/j.ymssp.2005.11.015Special Issue: Laser Doppler Vibrometry.

[10]

Yiheng Chen and Dawei Han. 2018. Water quality monitoring in smart city: A pilot project. Automation in Construction 89 (2018), 307 – 316. https://doi.org/10.1016/j.autcon.2018.02.008

[11]

Emilio Chuvieco. 2016. Fundamentals of satellite remote sensing: An environmental approach. CRC press.

[12]

Dominick M. Ciruzzi and Steven P. Loheide II. 2019. Monitoring Tree Sway as an Indicator of Water Stress. Geophysical Research Letters 46, 21 (2019), 12021–12029. https://doi.org/10.1029/2019GL084122

[13]

Code of Federal Regulations. 2011. Title 49 §393.11 - Lamps and reflective devices. https://www.govinfo.gov/app/details/CFR-2011-title49-vol5/CFR-2011-title49-vol5-sec393-11 Retrieved January 10, 2021.

[14]

Cristina Cristalli, Nicola Paone, and R. M. Rodríguez. 2006. Mechanical fault detection of electric motors by laser vibrometer and accelerometer measurements. Mechanical Systems and Signal Processing 20, 6 (2006), 1350 – 1361. https://doi.org/10.1016/j.ymssp.2005.11.013Special Issue: Laser Doppler Vibrometry.

[15]

Amr S El-Wakeel, Jin Li, Muhammed T Rahman, Aboelmagd Noureldin, and Hossam S Hassanein. 2017. Monitoring road surface anomalies towards dynamic road mapping for future smart cities. In IEEE Global Conference on Signal and Information Processing(GlobalSIP ’17). IEEE, 828–832. https://doi.org/10.1109/GlobalSIP.2017.8309076

[16]

William Emery and Adriano Camps. 2017. Introduction to satellite remote sensing: atmosphere, ocean, land and cryosphere applications. Elsevier.

[17]

Jennifer Gabrys. 2014. Programming Environments: Environmentality and Citizen Sensing in the Smart City. Environment and Planning D: Society and Space 32, 1 (2014), 30–48. https://doi.org/10.1068/d16812

[18]

Guido Giuliani, Simone Bozzi-Pietra, and Silvano Donati. 2002. Self-mixing laser diode vibrometer. Measurement Science and Technology 14, 1 (nov 2002), 24–32. https://doi.org/10.1088/0957-0233/14/1/304

[19]

Earl E. Gossard. 1988. Measuring Drop-Size Distributions in Clouds with a Clear-Air-Sensing Doppler Radar. Journal of Atmospheric and Oceanic Technology 5, 5 (oct 1988), 640 – 649. https://doi.org/10.1175/1520-0426(1988)005<0640:MDSDIC>2.0.CO;2

[20]

Daniel Granlund and Robert Brännström. 2012. Smart City: The smart sewerage. In 37th Annual IEEE Conference on Local Computer Networks - Workshops(LCNW ’12). IEEE, 856–859. https://doi.org/10.1109/LCNW.2012.6424074

[21]

Hadi Habibzadeh, Zhou Qin, Tolga Soyata, and Burak Kantarci. 2017. Large-Scale Distributed Dedicated- and Non-Dedicated Smart City Sensing Systems. IEEE Sensors Journal 17, 23 (2017), 7649–7658. https://doi.org/10.1109/JSEN.2017.2725638

[22]

Gerhard Hancke, Bruno Silva, and Gerhard Hancke, Jr.2012. The Role of Advanced Sensing in Smart Cities. Sensors 13, 1 (Dec 2012), 393–425. https://doi.org/10.3390/s130100393

[23]

Roy Henderson and Karl Schulmeister. 2003. Laser safety. CRC Press.

[24]

Zhiwen Hu, Zixuan Bai, Yuzhe Yang, Zijie Zheng, Kaigui Bian, and Lingyang Song. 2019. UAV Aided Aerial-Ground IoT for Air Quality Sensing in Smart City: Architecture, Technologies, and Implementation. IEEE Network 33, 2 (2019), 14–22. https://doi.org/10.1109/MNET.2019.1800214

[25]

Sukun Kim, Shamim Pakzad, David Culler, James Demmel, Gregory Fenves, Steve Glaser, and Martin Turon. 2006. Wireless Sensor Networks for Structural Health Monitoring. In Proceedings of the 4th International Conference on Embedded Networked Sensor Systems (Boulder, Colorado, USA) (SenSys ’06). Association for Computing Machinery, New York, NY, USA, 427–428. https://doi.org/10.1145/1182807.1182889

Digital Library

[26]

Gierad Laput, Walter S. Lasecki, Jason Wiese, Robert Xiao, Jeffrey P. Bigham, and Chris Harrison. 2015. Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 1935–1944. https://doi.org/10.1145/2702123.2702416

Digital Library

[27]

Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 321–333. https://doi.org/10.1145/2984511.2984582

Digital Library

[28]

Gierad Laput, Yang Zhang, and Chris Harrison. 2017. Synthetic Sensors: Towards General-Purpose Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3986–3999. https://doi.org/10.1145/3025453.3025773

Digital Library

[29]

Fabio Leccese, Marco Cagnetti, and Daniele Trinca. 2014. A Smart City Application: A Fully Controlled Street Lighting Isle Based on Raspberry-Pi Card, a ZigBee Sensor Network and WiMAX. Sensors 14, 12 (Dec 2014), 24408–24424. https://doi.org/10.3390/s141224408

[30]

W. H. Leong, Wiesław Jerzy Staszewski, B. C. Lee, and Fabrizio Scarpa. 2005. Structural health monitoring using scanning laser vibrometry: III. Lamb waves for fatigue crack detection. Smart Materials and Structures 14, 6 (oct 2005), 1387–1395. https://doi.org/10.1088/0964-1726/14/6/031

[31]

Zhong-Xian Li, Xiao-Ming Yang, and Zongjin Li. 2006. Application of Cement-Based Piezoelectric Sensors for Monitoring Traffic Flows. Journal of Transportation Engineering 132, 7 (2006), 565–573. https://doi.org/10.1061/(ASCE)0733-947X(2006)132:7(565)

[32]

Shunlin Liang and Jindi Wang. 2019. Advanced remote sensing: terrestrial information extraction and applications. Academic Press.

[33]

Shi-Wei Lo, Jyh-Horng Wu, Fang-Pang Lin, and Ching-Han Hsu. 2015. Visual Sensing for Urban Flood Monitoring. Sensors 15, 8 (Aug 2015), 20006–20029. https://doi.org/10.3390/s150820006

[34]

Jon Derek Loftis, David Forrest, Sridhar Katragadda, Kyle Spencer, Tammie Organski, Cuong Nguyen, and Sokwoo Rhee. 2018. StormSense: A New Integrated Network of IoT Water Level Sensors in the Smart Cities of Hampton Roads, VA. Marine Technology Society Journal 52, 2 (2018), 56–67. https://doi.org/10.4031/MTSJ.52.2.7

[35]

Xianghong Ma, Lawrence Bergman, and Alexander Vakakis. 2001. Identification of Bolted Joints Through Laser Vibrometry. Journal of Sound and Vibration 246, 3 (2001), 441 – 460. https://doi.org/10.1006/jsvi.2001.3573

[36]

Mousumi Majumder, Tarun Kumar Gangopadhyay, Ashim Kumar Chakraborty, Kamal Dasgupta, and Dipak Kumar Bhattacharya. 2008. Fibre Bragg gratings in structural health monitoring—Present status and applications. Sensors and Actuators A: Physical 147, 1 (2008), 150 – 164. https://doi.org/10.1016/j.sna.2008.04.008

[37]

MetroCount Inc.2020. Metrocount. https://metrocount.com Retrieved January 10, 2021.

[38]

Saraju P Mohanty, Uma Choppali, and Elias Kougianos. 2016. Everything you wanted to know about smart cities: The Internet of things is the backbone. IEEE Consumer Electronics Magazine 5, 3 (2016), 60–70. https://doi.org/10.1109/MCE.2016.2556879

[39]

Wongi Na and Jongdae Baek. 2018. A Review of the Piezoelectric Electromechanical Impedance Based Structural Health Monitoring Technique for Engineering Structures. Sensors 18, 5 (Apr 2018), 1307. https://doi.org/10.3390/s18051307

[40]

Christophe Ishimwe Ngabo and Omar El Beqqali. 2018. 3D tilt sensing by using accelerometer-based wireless sensor networks: Real case study: Application in the smart cities. In International Conference on Intelligent Systems and Computer Vision(ISACV ’18). IEEE, 1–8. https://doi.org/10.1109/ISACV.2018.8354013

[41]

Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2014. Sensing as a service model for smart cities supported by Internet of Things. Transactions on Emerging Telecommunications Technologies 25, 1(2014), 81–93. https://doi.org/10.1002/ett.2704

Digital Library

[42]

Polytec Inc.2020. Product Information. https://www.polytec.com/us/vibrometry/products/single-point-vibrometers/vibrogo/ Retrieved January 10, 2021.

[43]

Mark Potosnak, Pinaki Banerjee, Rajesh Sankaran, Veerabhadra Kotamarthi, Robert Jacob, Peter Beckman, and Charlie Catlett. 2018. Array of Things: Characterizing low-cost air quality sensors for a city-wide instrument. Earth and Space Science Open Archive(2018), 1. https://doi.org/10.1002/essoar.10500209.1

[44]

Manaswi Saha, Michael Saugstad, Hanuma Teja Maddali, Aileen Zeng, Ryan Holland, Steven Bower, Aditya Dash, Sage Chen, Anthony Li, Kotaro Hara, and Jon Froehlich. 2019. Project Sidewalk: A Web-Based Crowdsourcing Tool for Collecting Sidewalk Accessibility Data At Scale. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland UK) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300292

Digital Library

[45]

Nobuhiro Shimoi, C. Cuadra, Madokoroa Hirokazu, and Masahiro Saijo. 2012. Simple smart piezoelectric bolt sensor for structural monitoring of bridges. Int. J. Instrumentation Science 1, 5 (2012), 78–83. https://doi.org/10.5923/j.instrument.20120105.03

[46]

Robert L Showen, Robert B Calhoun, and Jason W Dunham. 2009. Acoustic location of gunshots using combined angle of arrival and time of arrival measurements. US Patent 7,474,589.

[47]

Wei Sun, Tuochao Chen, Jiayi Zheng, Zhenyu Lei, Lucy Wang, Benjamin Steeper, Peng He, Matthew Dressa, Feng Tian, and Cheng Zhang. 2020. VibroSense: Recognizing Home Activities by Deep Learning Subtle Vibrations on an Interior Surface of a House from a Single Point Using Laser Doppler Vibrometry. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 96 (Sept. 2020), 28 pages. https://doi.org/10.1145/3411828

Digital Library

[48]

Saiganesh Swaminathan, Jonathon Fagert, Michael Rivera, Andrew Cao, Gierad Laput, Hae Young Noh, and Scott E. Hudson. 2020. OptiStructures: Fabrication of Room-Scale Interactive Structures with Embedded Fiber Bragg Grating Optical Sensors and Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 50 (June 2020), 21 pages. https://doi.org/10.1145/3397310

Digital Library

[49]

Francisco Sánchez-Rosario, David Sánchez-Rodríguez, Jesús B Alonso-Hernández, Carlos M Travieso-González, Itziar Alonso-González, Carlos Ley-Bosch, Carlos Ramírez-Casañas, and Miguel A Quintana-Suárez. 2015. A low consumption real time environmental monitoring system for smart cities based on ZigBee wireless sensor network. In International Wireless Communications and Mobile Computing Conference(IWCMC ’15). IEEE, 702–707. https://doi.org/10.1109/IWCMC.2015.7289169

[50]

The Free Encyclopedia Wikipedia. 2020. Street furniture. https://en.wikipedia.org/w/index.php?title=Street_furniture&oldid=985712859 Retrieved January 10, 2021.

[51]

Deepak Vasisht, Zerina Kapetanovic, Jongho Won, Xinxin Jin, Ranveer Chandra, Sudipta Sinha, Ashish Kapoor, Madhusudhan Sudarshan, and Sean Stratman. 2017. FarmBeats: An IoT Platform for Data-Driven Agriculture. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). USENIX Association, Boston, MA, 515–529. https://www.usenix.org/conference/nsdi17/technical-sessions/presentation/vasisht

Digital Library

[52]

Meisong Wang, Charith Perera, Prem Prakash Jayaraman, Miranda Zhang, Peter Strazdins, R. K. Shyamsundar, and Rajiv Ranjan. 2016. City Data Fusion: Sensor Data Fusion in the Internet of Things. International Journal of Distributed Systems and Technologies (IJDST) 7, 1(2016), 15–36. https://doi.org/10.4018/IJDST.2016010102

Digital Library

[53]

World Sensing. 2020. Traffic Flow Monitoring. https://www.worldsensing.com/ Retrieved January 10, 2021.

[54]

Andrea Zanella, Nicola Bui, Angelo Castellani, Lorenzo Vangelista, and Michele Zorzi. 2014. Internet of Things for Smart Cities. IEEE Internet of Things Journal 1, 1 (2014), 22–32. https://doi.org/10.1109/JIOT.2014.2306328

[55]

Zensors Inc.2020. Zensors. https://www.zensors.com Retrieved January 10, 2021.

[56]

Guifu Zhang, Richard J Doviak, Dusan S Zrnic, Jerry Crain, David Staiman, and Yasser Al-Rashid. 2009. Phased Array Radar Polarimetry for Weather Sensing: A Theoretical Formulation for Bias Corrections. IEEE Transactions on Geoscience and Remote Sensing 47, 11 (2009), 3679–3689. https://doi.org/10.1109/TGRS.2009.2029332

[57]

Yang Zhang, Gierad Laput, and Chris Harrison. 2018. Vibrosight: Long-Range Vibrometry for Smart Environment Sensing. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 225–236. https://doi.org/10.1145/3242587.3242608

Digital Library

Cited By

Wang XZhang Y(2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631413
Balaji AKimber CLi DWu SDu RKim D(2023)RetroSphereProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694796:4(1-36)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569479
Sheinin MChan DO'Toole MNarasimhan S(2022)Dual-Shutter Optical Vibration Sensing2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01584(16303-16312)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01584

Index Terms

Vibrosight++: City-Scale Sensing Using Existing Retroreflective Signs and Markers
1. Computer systems organization
  1. Embedded and cyber-physical systems
2. Human-centered computing

Index terms have been assigned to the content through auto-classification.

Recommendations

Sensing in the Urban Technological Deserts: A Position Paper for Smart Cities in Least Developed Countries
IWWISS '14: Proceedings of the 2014 International Workshop on Web Intelligence and Smart Sensing

The technological progress in recent years has allowed to produce sensors, on macroscopic and microscopic scales, that are now essential to ubiquitous computing. This paradigm has made the concept of smart cities a reality that is now in synchrony with ...
A human tracking and sensing platform for enabling smart city applications
Workshops ICDCN '18: Proceedings of the Workshop Program of the 19th International Conference on Distributed Computing and Networking

The progress of IoT technologies, which connect, control and operate everything in the physical world, is expected to realize secure and convenient societies and communities, and embodies a variety of smart city applications. However, not a few smart ...
Smart City Applications: A Survey
ICIST '19: Proceedings of the 9th International Conference on Information Systems and Technologies

The rapid growth of the population in urban cities creates a challenge and problems. Therefore, the smart city concept is utilized to solve the challenges in urban cities by providing a good livable environment for the citizens. This paper presents a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
1,283
Total Downloads

Downloads (Last 12 months)360
Downloads (Last 6 weeks)74

Reflects downloads up to 03 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang XZhang Y(2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631413
Balaji AKimber CLi DWu SDu RKim D(2023)RetroSphereProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694796:4(1-36)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569479
Sheinin MChan DO'Toole MNarasimhan S(2022)Dual-Shutter Optical Vibration Sensing2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01584(16303-16312)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01584

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents