Abstract
Block matching algorithm is the most popular motion estimation technique, due to its simplicity of implementation and effectiveness. However, the algorithm suffers from a long computation time which affects its general performance. In order to achieve faster motion estimation, a new block matching algorithm based on stochastic fractal search, SFS, is proposed in this paper. SFS is a metaheuristic technique used to solve hard optimization problems in minimal time. In this work, two main contributions are presented. The first one consists of computing the motion vectors in a parallel structure as opposed to the other hierarchical metaheuristic block matching algorithms. When the video sequence frame is divided into blocks, a multi-population model of SFS is used to estimate the motion vectors of all blocks simultaneously. As a second contribution, the proposed algorithm is modified in order to enhance the results. In this modified version, four ideas are investigated. The random initialization, usually used in metaheuristics, is replaced by a fixed pattern. The initialized solutions are evaluated using a new fitness function that combines two matching criteria. The considered search space is controlled by a new adaptive window size strategy. A modified version of the fitness approximation method, which is known to reduce computation time but causes some degradation in the estimation accuracy, is proposed to balance between computation time and estimation accuracy. These ideas are evaluated in nine video sequences and the percentage improvement of each idea, in terms of estimation accuracy and computational complexity, is reported. The presented algorithms are then compared with other well-known block matching algorithms. The experimental results indicate that the proposed ideas improve the block matching performance, and show that the proposed algorithm outperforms many state-of-the-art methods.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Fortun D, Bouthemy P, Kervrann C (2015) Optical flow modeling and computation: a survey. Comput Vis Image Underst 134:1–21
Ilg E, Mayer N, Saikia T, et al. (2016) Flownet 2.0: Evolution of optical flow estimation with deep networks. arXiv:1612.01925
Chen Q, Koltun V (2016) Full flow: Optical flow estimation by global optimization over regular grids. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4706–4714
Palomares RP, Meinhardt-Llopis E, Ballester C, ohers (2017) FALDOI: A new minimization strategy for large displacement variational optical flow. J Math Imaging Vision 58(1):27–46
Horn BKP, Schunck BG (1981) Determining optical flow. Artif Intell 17(1–3):185–203
Metkar S, Talbar S (2013) Performance evaluation of block matching algorithms for video coding. In: Motion estimation techniques for digital video coding. Springer, India, pp 13–31
Furht B, Greenberg J, Westwater R (2012) Motion estimation algorithms for video compression. Springer Science, Business Media
Terki N, Saigaa D, Cheriet L, et al. (2013) Fast motion estimation algorithm based on complex wavelet transform. Journal of Signal Processing Systems 72(2):99–105
Barjatya A (2004) Block matching algorithms for motion estimation. IEEE Trans Evol Comput 8(3):225–239
Choudhury HA, Saikia M (2014) Survey on block matching algorithms for motion estimation. In: 2014 international conference on communications and signal processing (ICCSP). IEEE, pp 036–040
Li S, Xu W-P, Wang H, et al. (1999) A novel fast motion estimation method based on genetic algorithm. In: 1999 international conference on image processing, 1999. ICIP 99. Proceedings. IEEE, pp 66–69
Ren R, Shi Y, Zheng B, et al. (2006) A fast block matching algorithm for video motion estimation based on particle swarm optimization and motion prejudgment. arXiv:cs/0609131
Cai J, Pan WD (2012) On fast and accurate block-based motion estimation algorithms using particle swarm optimization. Inf Sci 197:53–64
Yuan X, Shen X (2008) Block matching algorithm based on particle swarm optimization for motion estimation. In: International conference on embedded software and systems, 2008. ICESS’08. IEEE, pp 191–195
Cuevas E, Zaldivar D, Pérez-Cisneros M, et al. (2013) Block-matching algorithm based on differential evolution for motion estimation. Eng Appl Artif Intell 26(1):488–498
Díaz-Cortés M-A, Cuevas E, Rojas R (2017) Motion estimation algorithm using block-matching and harmony search optimization. In: Engineering applications of soft computing. Springer International Publishing, pp 13–44
Damerchilu B, Norouzzadeh MS, Meybodi MR (2016) Motion estimation using learning automata. Mach Vis Appl 27(7):1047–1061
Zhang J, Wang C, Zhou M (2015) Fast and epsilon-optimal discretized pursuit learning automata. IEEE Transactions on Cybernetics 45(10):2089–2099
Salimi H (2015) Stochastic fractal search: a powerful metaheuristic algorithm. Knowl-Based Syst 75:1–18
Chuan SUN, Wei Z-Q, Zhou C-J, et al. (2016) Stochastic fractal search algorithm for 3d protein structure prediction. DEStech Transactions on Computer Science and Engineering, no aics
Rahman TAZ (2016) Parameters optimization of an SVM-classifier using stochastic fractal search algorithm for monitoring an aerospace structure
Sivalingam R, Chinnamuthu S, Dash SS (2017) A hybrid stochastic fractal search and local unimodal sampling based multistage PDF plus (1 + PI) controller for automatic generation control of power systems. Journal of the Franklin Institute
Parejo Maestre JA, Ruiz Cortés A, Lozano Segura S, et al. (2012) Metaheuristic optimization frameworks: a survey and benchmarking. Soft Comput 16(3):1–35
Boussaïd I, Lepagnot J, Siarry P (2013) A survey on optimization metaheuristics. Inf Sci 237:82–117
Deviant S. (2011) The practically cheating statistics handbook–. https://Lulu.com
Goshtasby AA (2012) Image registration: principles, tools and methods. Springer Science, Business Media
Smith SW, et al. (1997) The scientist and engineer’s guide to digital signal processing
Feng J, Lo K-T, Mehrpour H, et al. (1995) Adaptive block matching motion estimation algorithm for video coding. Electron Lett 31(18):1542–1543
Oh H-S, Park G, Lee H-K (1997) Block-matching algorithm based on dynamic search window adjustment. Dept. of CS, KAIST
Li W, Salari E (1995) Successive elimination algorithm for motion estimation. IEEE Trans Image Process 4(1):105–107
Jong H-M, Chen L-G, Chiueh T-D (1994) Accuracy improvement and cost reduction of 3-step search block matching algorithm for video coding. IEEE Trans Circuits Syst Video Technol 4(1):88–90
Li R, Zeng B, Liou ML (1994) A new three-step search algorithm for block motion estimation. IEEE Trans Circuits Syst Video Technol 4(4):438–442
Lu J, Liou ML (1997) A simple and efficient search algorithm for block-matching motion estimation. IEEE Trans Circuits Syst Video Technol 7(2):429–433
Po L-M, Ma W-C (1996) A novel four-step search algorithm for fast block motion estimation. IEEE Trans Circuits Syst Video Technol 6(3):313–317
Zhu S, Ma K-K (1997) A new diamond search algorithm for fast block matching motion estimation. In: Proceedings of 1997 international conference on information, communications and signal processing, 1997. ICICS. IEEE, pp 292–296
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
The video sequences used in this paper were downloaded from these addresses:
http://trace.kom.aau.dk/yuv/index.html
https://media.xiph.org/video/derf/
The code sources used in this paper were downloaded from these addresses:
Rights and permissions
About this article
Cite this article
Betka, A., Terki, N., Toumi, A. et al. A new block matching algorithm based on stochastic fractal search. Appl Intell 49, 1146–1160 (2019). https://doi.org/10.1007/s10489-018-1312-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-018-1312-1