research-article

Adaptive Fractional-Pixel Motion Estimation Skipped Algorithm for Efficient HEVC Motion Estimation

Authors:

Fu Lee WangAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 14, Issue 1

Article No.: 12, Pages 1 - 19

https://doi.org/10.1145/3159170

Published: 04 January 2018 Publication History

Abstract

High-Efficiency Video Coding (HEVC) efficiently addresses the storage and transmit problems of high-definition videos, especially for 4K videos. The variable-size Prediction Units (PUs)--based Motion Estimation (ME) contributes a significant compression rate to the HEVC encoder and also generates a huge computation load. Meanwhile, high-level encoding complexity prevents widespread adoption of the HEVC encoder in multimedia systems. In this article, an adaptive fractional-pixel ME skipped scheme is proposed for low-complexity HEVC ME. First, based on the property of the variable-size PUs--based ME process and the video content partition relationship among variable-size PUs, all inter-PU modes during a coding unit encoding process are classified into root-type PU mode and children-type PU modes. Then, according to the ME result of the root-type PU mode, the fractional-pixel ME of its children-type PU modes is adaptively skipped. Simulation results show that, compared to the original ME in HEVC reference software, the proposed algorithm reduces ME encoding time by an average of 63.22% while encoding efficiency performance is maintained.

References

[1]

A. Abdelazim, W. Masri, and B. Noaman. 2014. Motion estimation optimization tools for the emerging high efficiency video coding (HEVC). Proceedings of SPIE 9029, 902905--902905--8.

[2]

G. Bjontegaard. 2001. Calculation of average PSNR differences between RD curves. In Proceedings of the ITU-T VCEG 13th VCEG-M33 Meeting. Document VCEG--M33.

[3]

S. G. Blasi, I. Zupancic, E. Izquierdo, and E. Peixoto. 2015. Adaptive precision motion estimation for HEVC coding. In Picture Coding Symposium (PCS’15). 144--148.

[4]

F. Bossen. 2012. Common test conditions and software reference configurations. In ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC’12). Document JCTVC--J1100.

[5]

W. Dai, O. C. Au, C. Pang, L. Sun, R. Zou, and S. Li. 2012. A novel fast two step sub-pixel motion estimation algorithm in HEVC. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’12). 1197--1200.

[6]

T. Dutta and H. P. Gupta. 2017. An efficient framework for compressed domain watermarking in P frames of high-efficiency video coding (HEVC)-encoded video. ACM Transactions on Multimedia Computing, Communications, and Applications 13, 1, Article 12, 24 pages.

Digital Library

[7]

L. Gao, S. Dong, W. Wang, R. Wang, and W. Gao. 2015. A novel integer-pixel motion estimation algorithm based on quadratic prediction. In IEEE International Conference on Image Processing (ICIP’15). 2810--2814.

[8]

N. Hu and E. H. Yang. 2014. Fast motion estimation based on confidence interval. IEEE Transactions on Circuits and Systems for Video Technology 24, 8, 1310--1322.

[9]

T. K. Lee, Y. L. Chan, and W. C. Siu. 2014. Depth-based adaptive search range algorithm for motion estimation in HEVC. In 19th International Conference on Digital Signal Processing (ICDSP’14). 919--923.

[10]

H. Li, Y. Zhang, and H. Chao. 2013. An optimally scalable and cost-effective fractional-pixel motion estimation algorithm for HEVC. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’13). 1399--1403.

[11]

X. Li, R. Wang, X. Cui, and W. Wang. 2015. Context-adaptive fast motion estimation of HEVC. In IEEE International Symposium on Circuits and Systems (ISCAS’15). 2784--2787.

[12]

Z. Pan, P. Jin, J. Lei, Y. Zhang, X. Sun, and S. Kwong. 2016. Fast reference frame selection based on content similarity for low complexity HEVC encoder. Journal of Visual Communication and Image Representation 40, Part B, 516--524.

Digital Library

[13]

Z. Pan, S. Kwong, M. T. Sun, and J. Lei. 2014. Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC. IEEE Transactions on Broadcasting 60, 2, 405--412.

[14]

Z. Pan, J. Lei, Y. Zhang, X. Sun, and S. Kwong. 2016. Fast motion estimation based on content property for low-complexity H.265/HEVC encoder. IEEE Transactions on Broadcasting 62, 3, 675--684.

[15]

Z. Pan, Y. Zhang, and S. Kwong. 2015. Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Transactions on Broadcasting 61, 2, 166--176.

[16]

L. Shen, P. An, Z. Zhang, Q. Hu, and Z. Chen. 2015. A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Transactions on Multimedia Computing, Communications, and Applications 11, 3, Article 34, 23 pages.

Digital Library

[17]

T. Sotetsumoto, T. Song, and T. Shimamoto. 2013. Low complexity algorithm for sub-pixel motion estimation of HEVC. In IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC’13). 1--4.

[18]

G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology 22, 12, 1649--1668.

Digital Library

[19]

C. Yan, Y. Zhang, J. Xu, F. Dai, L. Li, Q. Dai, and F. Wu. 2014a. A highly parallel framework for HEVC coding unit partitioning tree decision on many-core processors. IEEE Signal Processing Letters 21, 5, 573--576.

[20]

C. Yan, Y. Zhang, J. Xu, F. Dai, J. Zhang, Q. Dai, and F. Wu. 2014b. Efficient parallel framework for HEVC motion estimation on many-core processors. IEEE Transactions on Circuits and Systems for Video Technology 24, 12, 2077--2089.

[21]

S. Yang, H. J. Shim, and B. Jeon. 2014. Motion vector inheritance method for fast HEVC encoding. In IEEE International Symposium on Broadband Multimedia Systems and Broadcasting. 1--4.

[22]

X. Zuo and L. Yu. 2015. A novel interpolation-free scheme for fractional pixel motion estimation. In Picture Coding Symposium (PCS’15). 80--84.

Cited By

Benjak JHofman DMlinarić H(2024)Efficient Motion Estimation for Remotely Controlled Vehicles: A Novel Algorithm Leveraging User InteractionApplied Sciences10.3390/app1416729414:16(7294)Online publication date: 19-Aug-2024
https://doi.org/10.3390/app14167294
Kim YKwon SKang DLee HPaik J(2024)Enhancing video frame interpolation with region of motion loss and self-attention mechanisms: A dual approach to address large, nonlinear motionsNeurocomputing10.1016/j.neucom.2024.128728(128728)Online publication date: Nov-2024
https://doi.org/10.1016/j.neucom.2024.128728
Wang YWang YCui TFang Z(2024)Occupancy map-based low complexity motion prediction for video-based point cloud compressionJournal of Visual Communication and Image Representation10.1016/j.jvcir.2024.104110100:COnline publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1016/j.jvcir.2024.104110
Show More Cited By

Index Terms

Adaptive Fractional-Pixel Motion Estimation Skipped Algorithm for Efficient HEVC Motion Estimation
1. Computing methodologies
  1. Computer graphics
    1. Image compression

Recommendations

Efficient Inter-Prediction Transcoding Algorithm from H.264/AVC to HEVC
RCAE 2019: Proceedings of the 2019 The 2nd International Conference on Robotics, Control and Automation Engineering

With the development of the High Efficiency Video Coding (HEVC) video compression standard, there is an urgent need for more research on video format transcoding from H.264/Advanced Video Coding (AVC) to HEVC. In this paper, we highlight the difference ...
Computationally Efficient Motion Estimation Algorithm for HEVC

In this paper, we present a novel computationally efficient motion estimation (ME) algorithm for high-efficiency video coding (HEVC). The proposed algorithm searches in the hexagonal pattern with a fixed number of search points at each grid. It utilizes ...
Low complexity encoder optimization for HEVC

Considering the content characteristic of different PU, an optimization scheme is proposed.Based on the R-D cost distribution, an early termination scheme of coding unit (CU) splitting is proposed.Based on the reference frame distribution, an adaptive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 14, Issue 1

February 2018

287 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3173554

Editor:
Alberto Del Bimbo
University of Firenze, Italy

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 January 2018

Accepted: 01 October 2017

Revised: 01 August 2017

Received: 01 March 2017

Published in TOMM Volume 14, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Research Grants Council of the Hong Kong Special Administrative Region of China
National Natural Science Foundation of China
Natural Science Foundation of the Jiangsu Higher Education Institutions
Six Talent Peaks Project of Jiangsu Province
Natural Science Foundation of Jiangsu Province of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
367
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)3

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Benjak JHofman DMlinarić H(2024)Efficient Motion Estimation for Remotely Controlled Vehicles: A Novel Algorithm Leveraging User InteractionApplied Sciences10.3390/app1416729414:16(7294)Online publication date: 19-Aug-2024
https://doi.org/10.3390/app14167294
Kim YKwon SKang DLee HPaik J(2024)Enhancing video frame interpolation with region of motion loss and self-attention mechanisms: A dual approach to address large, nonlinear motionsNeurocomputing10.1016/j.neucom.2024.128728(128728)Online publication date: Nov-2024
https://doi.org/10.1016/j.neucom.2024.128728
Wang YWang YCui TFang Z(2024)Occupancy map-based low complexity motion prediction for video-based point cloud compressionJournal of Visual Communication and Image Representation10.1016/j.jvcir.2024.104110100:COnline publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1016/j.jvcir.2024.104110
Papaioannou GKoziri MLoukopoulos TAnagnostopoulos I(2023)Fraction Execution Resolver Using a Hybrid Multi-CPU/GPU Encoding SchemeElectronics10.3390/electronics1217358612:17(3586)Online publication date: 25-Aug-2023
https://doi.org/10.3390/electronics12173586
Benjak JHofman D(2023)User Input Search - Custom Motion Estimation Algorithm Optimized for UAVs2023 46th MIPRO ICT and Electronics Convention (MIPRO)10.23919/MIPRO57284.2023.10159960(506-510)Online publication date: 22-May-2023
https://doi.org/10.23919/MIPRO57284.2023.10159960
Venkatesan RPandiaraj ASelvakumar M(2023)A Recurrent Neural Network for Image Deblocking Detection and Quality Enhancement2023 5th International Conference on Smart Systems and Inventive Technology (ICSSIT)10.1109/ICSSIT55814.2023.10061146(1-8)Online publication date: 23-Jan-2023
https://doi.org/10.1109/ICSSIT55814.2023.10061146
Li RWei WHao PSu JSun F(2022)Context-aware Pseudo-true Video Interpolation at 6G EdgeACM Transactions on Multimedia Computing, Communications, and Applications10.1145/355531318:3s(1-17)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1145/3555313
Guo YGao WMa SLi G(2022)Accelerating Transform Algorithm Implementation for Efficient Intra Coding of 8K UHD VideosACM Transactions on Multimedia Computing, Communications, and Applications10.1145/350797018:4(1-20)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3507970
Benjak JHofman DPerleta M(2022)Spatial and Temporal Complexity Analysis of 4K Drone Footage2022 International Conference on Smart Systems and Technologies (SST)10.1109/SST55530.2022.9954823(301-307)Online publication date: 19-Oct-2022
https://doi.org/10.1109/SST55530.2022.9954823
Tian TWang HKwong SKuo C(2021)Perceptual Image Compression with Block-Level Just Noticeable Difference PredictionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/340832016:4(1-15)Online publication date: 28-Jan-2021
https://dl.acm.org/doi/10.1145/3408320
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents