Light Codes for Fast Two-Way Human-Centric Visual Communication
Article No.: 1, Pages 1 - 14
Abstract
Visual codes, such as QR codes, are widely used in several applications for conveying information to users. However, user interactions based on spatial codes (e.g., displaying codes on phone screens for exchanging contact information) are often tedious, time consuming, and prone to errors due to image corruptions such as noise, blur, saturation, and perspective distortions. We propose Light Codes (LICO), a novel method for fast and fluid exchange of information among users. Light codes are based on transmitting and receiving temporal codes (instead of spatial) using compact and low-cost transceiver devices. The resulting approach enables seamless and near instantaneous exchange of short messages among users with minimal physical and cognitive effort. We design novel coding techniques, hardware prototypes, and applications that are optimized for human-centric communication, and facilitate fast and fluid user-to-user interactions in various challenging conditions, including a range of distances, motion, and ambient illumination. We evaluate the performance of the proposed methods both via quantitative analysis and user study based comparisons with several existing approaches including display-camera links, Bluetooth, and near-field communication, which show strong preference toward Light Codes in various real-world application scenarios.
Supplementary Material
Supplementary material
- Download
- 106.63 KB
References
[1]
Norman Abramson. 1985. Development of the ALOHANET. IEEE Transactions on Information Theory 31, 2 (1985), 119–123.
[2]
Norman Abramson. 1990. VSAT data networks. Proceedings of the IEEE 78, 7 (1990), 1267–1274.
[3]
Norman Abramson. 2009. The ALOHAnet—Surfing for wireless data. IEEE Communications Magazine 47, 12 (2009), 21–25.
[4]
Amazon. 2022. Popl Dot Digital Business Card–Smart NFC Sticker Tag. Retrieved January 1, 2022 from https://tinyurl.com/3yft3eum
[5]
Apple. 2022. Share Audio with AirPods or Beats Headphones. Retrieved January 1, 2022 from https://support.apple.com/en-us/HT210421
[6]
Shumeet Baluja. 2017. Hiding images in plain sight: Deep steganography. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, 1–11.
[7]
John R. Barry and Joseph M. Kahn. 1995. Link design for nondirected wireless infrared communications. Applied Optics 34, 19 (July1995), 3764–3776.
[8]
Vedat Coskun, Busra Ozdenizci, and Kerem Ok. 2013. A survey on near field communication (NFC) technology. Wireless Personal Communications 71, 3 (2013), 2259–2294.
[9]
DigiKey. 2022. Understanding the Basics of Infrared Communications. Retrieved September 7, 2023 from https://www.digikey.com/en/maker/blogs/2021/understanding-the-basics-of-infrared-communications
[10]
Dot.2022. Shop Basics. Retrieved August 1, 2023 fromhttps://dotcards.net/collections/all-products
[11]
GitHub. 2021. WeChat QR Code Detector for Detecting and Parsing QR Code. Retrieved September 7, 2023 from https://github.com/opencv/opencv_contrib/tree/4.x/modules/wechat_qrcode
[12]
Tian Hao, Ruogu Zhou, and Guoliang Xing. 2012. COBRA: Color barcode streaming for smartphone systems. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys ’12). 85–98.
[13]
P. R. Haugen, S. Rychnovsky, A. Husain, and L. Hutcheson. 1986. Optical interconnects for high speed computing. Optical Engineering 25, 10 (1986), 251076.
[14]
Wenjun Hu, Jingshu Mao, Zihui Huang, Yiqing Xue, Junfeng She, Kaigui Bian, and Guobin Shen. 2014. Strata: Layered coding for scalable visual communication. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking(MobiCom ’14). ACM, New York, NY, 79–90.
[15]
International Electrotechnical Commission (IEC). 2006. Photobiological safety of lamps and lamp systems. International Standard IEC 62471:2006. IEC.
[16]
Kensei Jo, Mohit Gupta, and Shree K. Nayar. 2016. DisCo: Display-camera communication using rolling shutter sensors. ACM Transactions on Graphics 35, 5 (2016), Article 150, 13 pages.
[17]
Tobias Langlotz and Oliver Bimber. 2007. Unsynchronized 4D barcodes: Coding and decoding time-multiplexed 2D colorcodes. In Proceedings of the International Conference on Advances in Visual Computing.
[18]
C. G. Lee, C. S. Park, J. H. Kim, and D. H. Kim. 2007. Experimental verification of optical wireless communication link using high-brightness illumination light-emitting diodes. Optical Engineering 46, 12 (2007), 125005.
[19]
J. Martin. 2005. The impact of the DOCSIS 1.1/2.0 MAC protocol on TCP. In Proceedings of the 2nd IEEE Conference on Consumer Communications and Networking.
[20]
Robert M. Metcalfe and David R. Boggs. 1976. Ethernet: Distributed packet switching for local computer networks. Communications of the ACM 19, 7 (July 1976), 395–404.
[21]
Guowang Miao, Jens Zander, Ki Won Sung, and Ben Slimane. 2016. Fundamentals of Mobile Data Networks. Cambridge University Press.
[22]
Shree K. Nayar, Jian Wang, and Wenzheng Chen. 2022. Long distance QR code decoding. US Patent 11,461,924.
[23]
Viet Nguyen, Yaqin Tang, Ashwin Ashok, Marco Gruteser, Kristin Dana, Wenjun Hu, Eric Wengrowski, and Narayan Mandayam. 2016. High-rate flicker-free screen-camera communication with spatially adaptive embedding. In Proceedings of the 35th Annual International Conference on Computer Communications (IEEE INFOCOM ’16). 1–9. DOI:
[24]
Rob Otte, Leo P. De Jong, and Arthur H. M. Van Roermund. 2013. Low-Power Wireless Infrared Communications. Springer.
[25]
K. Pahlavan and A. Levesque. 1994. Wireless data communications. Proceedings of the IEEE 82, 9 (1994), 1398–1430.
[26]
Hyuncheol Park and J. R. Barry. 2004. Trellis-coded multiple-pulse-position modulation for wireless infrared communications. IEEE Transactions on Communications 52, 4 (2004), 643–651. DOI:
[27]
Annika Paus. 2007. Near Field Communication in Cell Phones. Seminararbeit Ruhr-Universitat Bochum.
[28]
Samuel David Perli, Nabeel Ahmed, and Dina Katabi. 2010. PixNet: Interference-free wireless links using LCD-camera pairs. In Proceedings of the 16th Annual International Conference on Mobile Computing and Networking (MobiCom ’10). 137–148.
[29]
W. W. Peterson and D. T. Brown. 1961. Cyclic codes for error detection. Proceedings of the IRE 49, 1 (1961), 228–235.
[30]
Sony. 2022. Sony SIRC Protocol. Retrieved November 1, 2022 from https://www.sbprojects.net/knowledge/ir/sirc.php
[31]
Statista. 2019. Protective Case Usage among U.S. Smartphone Owners 2017. Retrieved August 19, 2023 from https://www.statista.com/statistics/368627/us-protective-case-usage-among-smartphone-owners/
[32]
B. Stavenow. 1984. Throughput-delay characteristics and stability considerations of the access channel in a mobile telephone system. ACM SIGMETRICS Performance Evaluation Review 12, 3 (1984), 105–112.
[33]
Matthew Tancik, Ben Mildenhall, and Ren Ng. 2020. StegaStamp: Invisible hyperlinks in physical photographs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR ’20). 1515–1524. DOI:
[34]
Vu Tran, Gihan Jayatilaka, Ashwin Ashok, and Archan Misra. 2021. DeepLight: Robust & unobtrusive real-time screen-camera communication for real-world displays. In Proceedings of the International Conference on Information Processing in Sensor Networks.
[35]
Dobroslav Tsonev, Stefan Videv, and Harald Haas. 2014. Light fidelity (Li-Fi): Towards all-optical networking. In Broadband Access Communication Technologies VIII, Vol. 9007. International Society for Optics and Photonics, 900702.
[36]
Vishay Semiconductors. 2022. TFDU4301 Infrared Transceiver Module (SIR, 115.2 kbit/s) for IrDA® Applications. Retrieved August 19, 2023 from https://www.vishay.com/docs/81965/tfdu4301.pdf
[37]
J. Vucic, C. Kottke, S. Nerreter, K.-D. Langer, and J. W. Walewski. 2010. 513 Mbit/s visible light communications link based on DMT-modulation of a white LED. Journal of Lightwave Technology28, 24 (2010), 3512–3518.
[38]
Eric Wengrowski and Kristin Dana. 2019. Light field messaging with deep photographic steganography. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR ’19). 1515–1524. DOI:
[39]
Wenjia Yuan, Kristin Dana, Ashwin Ashok, Marco Gruteser, and Narayan Mandayam. 2012. Dynamic and invisible messaging for visual MIMO. In Proceedings of the IEEE Workshop on the Applications of Computer Vision (WACV ’12). 345–352. DOI:
Index Terms
- Light Codes for Fast Two-Way Human-Centric Visual Communication
Index terms have been assigned to the content through auto-classification.
Recommendations
QfaR: Location-Guided Scanning of Visual Codes from Long Distances
ACM MobiCom '23: Proceedings of the 29th Annual International Conference on Mobile Computing and NetworkingVisual codes such as QR codes provide a low-cost and convenient communication channel between physical objects and mobile devices, but typically operate when the code and the device are in close physical proximity. We propose a system, called QfaR, which ...
Adaptive Software-Defined Visible Light Communication Networks: Demo Abstract
IoTDI '17: Proceedings of the Second International Conference on Internet-of-Things Design and ImplementationLight bulbs using Light Emitting Diodes (LEDs), paired with microcontrollers that run software-defined Visible Light Communication (VLC) protocols, combine illumination and communication. Such smart light sources can communicate with each other and with ...
One-way communication and error-correcting codes
We establish a further connection between one-way communication where a sender conveys information to a receiver who has related information, and error-correction coding where a sender attempts to communicate reliably over a noisy channel. Using this ...
Comments
Information & Contributors
Information
Published In
February 2024
211 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 September 2023
Online AM: 30 August 2023
Accepted: 22 August 2023
Revised: 21 August 2023
Received: 29 November 2022
Published in TOG Volume 43, Issue 1
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 593Total Downloads
- Downloads (Last 12 months)475
- Downloads (Last 6 weeks)32
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in