Cited By
View all- Xu YDang FLiu KZhu ZChen XWang XMiao XZhao H(2024)BEANet: An Energy-efficient BLE Solution for High-capacity Equipment Area NetworkACM Transactions on Sensor Networks10.1145/364128020:3(1-23)Online publication date: 17-Jan-2024
LSync: A Universal Event-synchronizing Solution for Live Streaming
Authors: 
Yifan Xu, Fan Dang, Rongwu Xu, Xinlei Chen, 
Yunhao LiuAuthors Info & Claims
Yifan Xu, Fan Dang, Rongwu Xu, Xinlei Chen, Yunhao LiuAuthors Info & ClaimsPages 2188 - 2197
Abstract
The widespread of smart devices and the development of mobile networks brings the growing popularity of live streaming services worldwide. In addition to the video and audio transmission, a lot more media content is sent to the audiences as well, including player statistics for a sports stream, subtitles for living news, etc. However, due to the diverse transmission process between live streams and other media content, the synchronization of them has grown to be a great challenge. Unfortunately, the existing commercial solutions are not universal, which require specific server cloud services or CDN and limit the users’ free choices of web infrastructures. To address the issue, we propose a lightweight universal event-synchronizing solution for live streaming, called LSync, which inserts a series of audio signals containing metadata into the original audio stream. It brings no modification to the original live broadcast process and thus fits prevalent live broadcast infrastructure. Evaluations on real system show that the proposed solution reduces the signal processing delay by at most 5.62% of an audio buffer length in mobile phones and ensures real-time signal processing. It also achieves a data rate of 156.25 bps in a specific configuration and greatly outperforms recent works.
References
[1]
Z. Yin, C. Wu, Z. Yang, and Y. Liu, “Peer-to-Peer Indoor Navigation Using Smartphones,” IEEE Journal on Selected Areas in Communications, vol. 35, no. 5, pp. 1141–1153, 2017.
[2]
W. Gu, Z. Yang, L. Shangguan, W. Sun, K. Jin, and Y. Liu, “Intelligent Sleep Stage Mining Service with Smartphones,” in Proceedings of the 2014 ACM international Joint Conference on pervasive and ubiquitous Computing, 2014, pp. 649–660.
[3]
“Rain Classroom,” https://www.yuketang.cn/, (Accessed on April 21, 2021).
[4]
“HQ Trivia,” https://hqtrivia.com/legal/faq.html, (Accessed on June 20, 2021).
[5]
“Live Streaming Process,” https://www.dacast.com/blog/what-is-live-streaming/, (Accessed on June 24, 2021).
[6]
“Solution of Alibaba Cloud for Live Quiz,” https://help.aliyun.com/document_detail/67427.html, (Accessed on April 21, 2021).
[7]
“ID3,” https://id3.org/, (Accessed on June 20, 2021).
[8]
“Amazon IVS User Guide,” https://docs.aws.amazon.com/ivs/latest/userguide/ivs-ug.pdf, (Accessed on June 20, 2021).
[9]
B. Reynders and S. Pollin, “Chirp Spread Spectrum as a Modulation Technique for Long Range Communication,” in Proceedings of the 2016 Symposium on Communications and Vehicular Technologies. IEEE, 2016, pp. 1–5.
[10]
M. Bosi, K. Brandenburg, S. Quackenbush, L. Fielder, K. Akagiri, H. Fuchs, and M. Dietz, “ISO/IEC MPEG-2 Advanced Audio Coding,” Journal of the Audio engineering society, vol. 45, no. 10, pp. 789–814, 1997.
[11]
“OBS Studio,” https://obsproject.com/, (Accessed on June 20, 2021).
[12]
“SBR White Paper,” http://users.ece.utexas.edu/∼gerstl/ee382v_f14/soc/drm/SBR_White_Paper_v1.pdf, (Accessed on July 24, 2021).
[13]
Q. Lin, L. Yang, and Y. Liu, “Tagscreen: Synchronizing Social Televisions through Hidden Sound Markers,” in Proceedings of the 36th IEEE Conference on Computer Communications. IEEE, 2017, pp. 1–9.
[14]
F. Dang, P. Zhou, Z. Li, and Y. Liu, “NFC-enabled Attack on Cyber Physical Systems: A Practical Case Study,” in Proceedings of the 36th IEEE Conference on Computer Communications Workshops, 2017, pp. 289–294.
[15]
“Web Audio API,” https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_API, (Accessed on June 24, 2021).
[16]
“Web Audio BiquadFilterNode,” https://developer.mozilla.org/zh-CN/docs/Web/API/BiquadFilterNode, (Accessed on June 20, 2021).
[17]
A. Berni and W. Gregg, “On the Utility of Chirp Modulation for Digital Signaling,” IEEE Transactions on Communications, vol. 21, no. 6, pp. 748–751, 1973.
[18]
Y. Lin, W. Dong, Y. Gao, and T. Gu, “SateLoc: A Virtual Fingerprinting Approach to Outdoor LoRa Localization Using Satellite Images,” ACM Transactions on Sensor Networks, vol. 17, no. 4, pp. 1–28, 2021.
[19]
H. Jiang, J. Zhang, X. Guo, and Y. He, “Sense Me on the Ride: Accurate Mobile Sensing over a LoRa Backscatter Channel,” in Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. ACM, 2021, pp. 125–137.
[20]
D. Lin, Q. Wang, W. Min, J. Xu, and Z. Zhang, “A Survey on Energy-efficient Strategies in Static Wireless Sensor Networks,” ACM Transactions on Sensor Networks, vol. 17, no. 1, pp. 1–48, 2020.
[21]
H. Lee, T. H. Kim, J. W. Choi, and S. Choi, “Chirp Signal-based Aerial Acoustic Communication for Smart Devices,” in Proceedings of the 34th IEEE Conference on Computer Communications. IEEE, 2015, pp. 2407–2415.
[22]
S. Ka, T. H. Kim, J. Y. Ha, S. H. Lim, S. C. Shin, J. W. Choi, C. Kwak, and S. Choi, “Near-ultrasound Communication for Tv’s 2nd Screen Services,” in Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, 2016, pp. 42–54.
[23]
“Cyclic Redundancy Check,” https://en.wikipedia.org/wiki/Cyclic_redundancy_check, (Accessed on June 24, 2021).
[24]
“Real-time Messaging Protocol (RTMP) Specification,” https://www.adobe.com/devnet/rtmp.html, (Accessed on July 27, 2021).
[25]
“VB-Cable Virtual Audio Device,” https://vb-audio.com/Cable/, (Accessed on June 20, 2021).
[26]
“MediaElementAudioSourceNode,” https://developer.mozilla.org/en-US/docs/Web/API/MediaElementAudioSourceNode, (Accessed on July 27, 2021).
[27]
“ScriptProcessorNode,” https://developer.mozilla.org/en-US/docs/Web/API/ScriptProcessorNode, (Accessed on July 27, 2021).
[28]
“Audio Passed through WebAudio is Delayed and Glitchy on Safari,” https://bugs.webkit.org/show_bug.cgi?id=221334, (Accessed on July 27, 2021).
[29]
“Node Media Server,” https://github.com/illuspas/Node-Media-Server, (Accessed on June 24, 2021).
[30]
“Flash Video,” https://en.wikipedia.org/wiki/Flash_Video, (Accessed on June 24, 2021).
[31]
“HTTP Live Streaming,” https://www.encoding.com/http-live-streaming-hls/, (Accessed on June 20, 2021).
[32]
“Dynamic Adaptive Streaming over HTTP,” https://en.wikipedia.org/wiki/Dynamic_Adaptive_Streaming_over_HTTP, (Accessed on June 24, 2021).
[33]
“BT.1395,” https://www.itu.int/dms_pubrec/itu-r/rec/bt/R-REC-BT.1359-1-199811-I!!PDF-E.pdf, (Accessed on June 20, 2021).
[34]
Q. Wang, K. Ren, M. Zhou, T. Lei, D. Koutsonikolas, and L. Su, “Messages Behind the Sound: Real-time Hidden Acoustic Signal Capture with Smartphones,” in Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, 2016, pp. 29–41.
[35]
X. Chen, X. Wu, X.-Y. Li, X. Ji, Y. He, and Y. Liu, “Privacy-Aware High-Quality Map Generation with Participatory Sensing,” IEEE Transactions on Mobile Computing, vol. 15, no. 3, pp. 719–732, 2016.
[36]
Z. Yang, L. Jian, C. Wu, and Y. Liu, “Beyond Triangle Inequality: Sifting Noisy and Outlier Distance Measurements for Localization,” ACM Transactions on Sensor Networks, vol. 9, no. 2, pp. 1–20, 2013.
[37]
A. Wang, Z. Li, C. Peng, G. Shen, G. Fang, and B. Zeng, “Inframe++ Achieve Simultaneous Screen-human Viewing and Hidden Screen-camera Communication,” in Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services, 2015, pp. 181–195.
[38]
T. Li, C. An, X. Xiao, A. T. Campbell, and X. Zhou, “Real-time Screen-camera Communication behind Any Scene,” in Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services, 2015, pp. 197–211.
[39]
S. Shi, L. Chen, W. Hu, and M. Gruteser, “Reading between Lines: High-rate, Non-intrusive Visual Codes within Regular Videos via Implicitcode,” in Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, 2015, pp. 157–168.
[40]
V. Nguyen, Y. Tang, A. Ashok, M. Gruteser, K. Dana, W. Hu, E. Wengrowski, and N. Mandayam, “High-rate Flicker-free Screen-camera Communication with Spatially Adaptive Embedding,” in Proceedings of the 35th IEEE Conference on Computer Communications. IEEE, 2016, pp. 1–9.
[41]
M. Izz, Z. Li, H. Liu, Y. Chen, and F. Li, “Uber-in-light: Unobtrusive Visible Light Communication Leveraging Complementary Color Channel,” in Proceedings of the 35th IEEE Conference on Computer Communications. IEEE, 2016, pp. 1–9.
[42]
A. S. Nittala, X.-D. Yang, S. Bateman, E. Sharlin, and S. Greenberg, “Phoneear: Interactions for Mobile Devices that Hear High-frequency Sound-encoded Data,” in Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 2015, pp. 174–179.
[43]
“WebRTC,” https://webrtc.org/, (Accessed on July 27, 2021).
[44]
“Google Meet,” https://meet.google.com/, (Accessed on July 27, 2021).
[45]
“Facebook Messenger,” https://www.messenger.com/, (Accessed on July 27, 2021).
[46]
“Prevent WebRTC from Leaking Local IP Address,” https://github.com/gorhill/uBlock/wiki/Prevent-WebRTC-from-leaking-local-IP-address, (Accessed on July 27, 2021).
Index Terms
- LSync: A Universal Event-synchronizing Solution for Live Streaming
Index terms have been assigned to the content through auto-classification.
Recommendations
Optimizing CDN Infrastructure for Live Streaming with Constrained Server Chaining
ISPA '11: Proceedings of the 2011 IEEE Ninth International Symposium on Parallel and Distributed Processing with ApplicationsContent Delivery Networks (CDNs) are increasingly being used to deliver live streaming on today's Internet. The new application type of live streaming exposes unique characteristics and challenges that require more advanced design of CDN infrastructure. ...
Study On Purchase Intention In Different Live Streaming Scenarios Based On Experimental Approach
ICEBI '22: Proceedings of the 2022 6th International Conference on E-Business and InternetLive streaming e-commerce has exploded recently. While the live streaming traffic is dominated by the top live streamers, merchants and ordinary live streamers attempt to establish self-operating live streaming, but the number of fans and sales ...
Live Streaming as Co-Performance: Dynamics between Center and Periphery in Theatrical Engagement
Live streaming is a highly participatory form of performance, involving various types of audience participation such as liking, commenting, and gifting. But how do streamers and audiences collaborate to deliver live streaming performances? We approach ...
Comments
Information & Contributors
Information
Published In
May 2022
2237 pages
Copyright © 2022.
Publisher
IEEE Press
Publication History
Published: 02 May 2022
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Sep 2024
Other Metrics
Citations
Cited By
View all- Xu YDang FLiu KZhu ZChen XWang XMiao XZhao H(2024)BEANet: An Energy-efficient BLE Solution for High-capacity Equipment Area NetworkACM Transactions on Sensor Networks10.1145/364128020:3(1-23)Online publication date: 17-Jan-2024
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in