Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3595916.3626393acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article
Open access

Block based Adaptive Compressive Sensing with Sampling Rate Control

Published: 01 January 2024 Publication History

Abstract

Compressive sensing (CS), acquiring and reconstructing signals below the Nyquist rate, has great potential in image and video acquisition to exploit data redundancy and greatly reduce the amount of sampled data. To further reduce the sampled data while keeping the video quality, this paper explores the temporal redundancy in video CS and proposes a block based adaptive compressive sensing framework with a sampling rate (SR) control strategy. To avoid redundant compression of non-moving regions, we first incorporate moving block detection between consecutive frames, and only transmit the measurements of moving blocks. The non-moving regions are reconstructed from the previous frame. In addition, we propose a block storage system and a dynamic threshold to achieve adaptive SR allocation to each frame based on the area of moving regions and target SR for controlling the average SR within the target SR. Finally, to reduce blocking artifacts and improve reconstruction quality, we adopt a cooperative reconstruction of the moving and non-moving blocks by referring to the measurements of the non-moving blocks from the previous frame. Extensive experiments have demonstrated that this work is able to control SR and obtain better performance than existing works.

References

[1]
Bin Chen and Jian Zhang. 2022. Content-aware scalable deep compressed sensing. IEEE Transactions on Image Processing 31 (2022), 5412–5426.
[2]
Wenjun Chen, Chunling Yang, and Xin Yang. 2022. FSOINET: feature-space optimization-inspired network for image compressive sensing. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2460–2464.
[3]
Weisheng Dong, Guangming Shi, Xin Li, Yi Ma, and Feng Huang. 2014. Compressive sensing via nonlocal low-rank regularization. IEEE transactions on image processing 23, 8 (2014), 3618–3632.
[4]
David L Donoho. 2006. Compressed sensing. IEEE Transactions on information theory 52, 4 (2006), 1289–1306.
[5]
Jiang Du, Xuemei Xie, and Guangming Shi. 2021. Multi-rate Video Compressive Sensing for Fixed Scene Measurement. In Proceedings of the 2021 5th International Conference on Video and Image Processing. 177–183.
[6]
Marco F Duarte, Mark A Davenport, Dharmpal Takhar, Jason N Laska, Ting Sun, Kevin F Kelly, and Richard G Baraniuk. 2008. Single-pixel imaging via compressive sampling. IEEE signal processing magazine 25, 2 (2008), 83–91.
[7]
Michael Elad. 2010. Sparse and redundant representations: from theory to applications in signal and image processing. Vol. 2. Springer.
[8]
Kuldeep Kulkarni, Suhas Lohit, Pavan Turaga, Ronan Kerviche, and Amit Ashok. 2016. Reconnet: Non-iterative reconstruction of images from compressively sensed measurements. In Proceedings of the IEEE conference on computer vision and pattern recognition. 449–458.
[9]
Michael Lustig, David Donoho, and John M Pauly. 2007. Sparse MRI: The application of compressed sensing for rapid MR imaging. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 58, 6 (2007), 1182–1195.
[10]
Michael Lustig, David L Donoho, Juan M Santos, and John M Pauly. 2008. Compressed sensing MRI. IEEE signal processing magazine 25, 2 (2008), 72–82.
[11]
Sungkwang Mun and James E Fowler. 2012. DPCM for quantized block-based compressed sensing of images. In 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO). IEEE, 1424–1428.
[12]
Sangmin Oh, Anthony Hoogs, Amitha Perera, Naresh Cuntoor, Chia-Chih Chen, Jong Taek Lee, Saurajit Mukherjee, JK Aggarwal, Hyungtae Lee, Larry Davis, 2011. A large-scale benchmark dataset for event recognition in surveillance video. In CVPR 2011. IEEE, 3153–3160.
[13]
Wuzhen Shi, Feng Jiang, Shaohui Liu, and Debin Zhao. 2019. Image compressed sensing using convolutional neural network. IEEE Transactions on Image Processing 29 (2019), 375–388.
[14]
Jian Yang, Haixing Wang, Yibo Fan, and Jinjia Zhou. 2023. VCSL: Video Compressive Sensing with Low-complexity ROI Detection in Compressed Domain. In 2023 Data Compression Conference (DCC). IEEE, 1–1.
[15]
Ying Yu, Bin Wang, and Liming Zhang. 2010. Saliency-based compressive sampling for image signals. IEEE signal processing letters 17, 11 (2010), 973–976.
[16]
Jian Zhang and Bernard Ghanem. 2018. ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1828–1837.
[17]
Jian Zhang, Chen Zhao, and Wen Gao. 2020. Optimization-inspired compact deep compressive sensing. IEEE Journal of Selected Topics in Signal Processing 14, 4 (2020), 765–774.
[18]
Siwang Zhou, Yan He, Yonghe Liu, Chengqing Li, and Jianming Zhang. 2020. Multi-channel deep networks for block-based image compressive sensing. IEEE Transactions on Multimedia 23 (2020), 2627–2640.

Index Terms

  1. Block based Adaptive Compressive Sensing with Sampling Rate Control

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MMAsia '23: Proceedings of the 5th ACM International Conference on Multimedia in Asia
    December 2023
    745 pages
    ISBN:9798400702051
    DOI:10.1145/3595916
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 January 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. adaptive sampling
    2. compressive sensing
    3. rate control
    4. video compressive sensing
    5. video reconstruction

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • JSPS KAKENHI

    Conference

    MMAsia '23
    Sponsor:
    MMAsia '23: ACM Multimedia Asia
    December 6 - 8, 2023
    Tainan, Taiwan

    Acceptance Rates

    Overall Acceptance Rate 59 of 204 submissions, 29%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 185
      Total Downloads
    • Downloads (Last 12 months)185
    • Downloads (Last 6 weeks)36
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media