Abstract
Matching cost initialization and aggregation are two major steps in the stereo matching framework. For dense stereo matching, a matching cost needs to be computed at each pixel for all disparities within the search range so that it can be used to evaluate pixel-to-pixel correspondence. Cost aggregation connects the matching cost with a certain neighbourhood to reduce mismatches by a supporting smoothness term. This paper presents a hybrid cost aggregation method to overcome mismatches caused by textureless surface, depth-discontinuity areas, inconsistent lightings in an image. The steps taken to aggregate costs for an energy function include adaptive support regions, multi-path aggregation, and adaptive penalties to generate a more accurate disparity map. Compared with two top-ranked stereo matching algorithms, the proposed algorithm yielded the disparity maps of the dataset in Middlebury benchmark V2 with smaller error ratios in depth-discontinuity regions.
Similar content being viewed by others
References
Amdahl GM (1967) Validity of the single processor approach to achieving large scale computing capabilities. In Proceedings of the April 18–20, 1967, spring joint computer conference
Birchfield S, Tomasi C (1999) Depth discontinuities by pixel-to-pixel stereo. Int J Comput Vis 35(3):269–293
Bobick AF, Intille SS (1999) Large occlusion stereo. Int J Comput Vis 33(3):181–200
Chapman B, Jost G, Pas RVD (2008) Using OpenMP: portable shared memory parallel programming. MIT press vol 10
Gong M, Yang R, Wang L, Gong M (2007) A performance study on different cost aggregation approaches used in real-time stereo matching. Int J Comput Vis 75(2):289–296
Hirschmuller H (2008) Stereo processing by semiglobal matching and mutual information. IEEE Trans Pattern Anal Mach Intell 30(2):328–341
Hirschmuller H, Scharstein D (2007) Evaluation of cost functions for stereo matching. In Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on pp 1–8
Kanade T, Okutomi M (1994) A sterro matching algorithm with an adaptive window: Theory and experiment. Pattern Analysis and Machine Intelligence: IEEE Transactions on 16(9):902–932
Liu J, Li C, Mei F, Wang Z 3D entity-based stereo matching with ground control points and joint second-order smoothness prior. The Visual Computer 31(9):1253–1269 215
Mei X, Sun X, Dong W, Wang H, Zhang X (2013) Segment-tree based cost aggregation for stereo matching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp 313–320
Mei X, Sun X, Zhou M, Jiao S, Wang H, Zhang X (2011) On building an accurate stereo matching system on graphics hardware. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pp 467–474
Rhemann C, Hosni A, Bleyer M, Rother C, Gelautz M (2011) Fast cost-volume filtering for visual correspondence and beyond. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pp 3017–3024
Scharstein D, Szeliski R Middlebury stereo vision page. [Online]. Available: http://vision.middlebury.edu/stereo/. [Accessed 21 3 2018]
Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. Computer Vision, 1998. Sixth International Conference pp 839–846
Van Meerbergen G, Vergauwen M, Pollefeys M, Gool LV (2002) A hierarchical symmetric stereo algorithm using dynamic programming. Int J Comput Vis 47(1–3):275–285
Veksler O (2003) Fast variable window for stereo correspondence using integral images. In Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 IEEE Computer Society Conference on, vol 1 pp I-I
Yao M, Xu B (2019) A dense stereovision system for 3D body imaging. IEEE Access 7(1):170907–170918
Yoon K-J, Kweon IS (2006) Adaptive support-weight approach for correspondence search. IEEE Trans Pattern Anal Mach Intell 28(4):650–656
Yu W, Xu B (2010) A portable stereo vision system for whole body surface imaging. Image Vis Comput 28(4):605–613
Zhan Y, Gu Y, Huang K, Zhang C, Hu K (2016) Accurate image-guided stereo matching with efficient matching cost and disparity refinement. IEEE Transactions on Circuits and Systems for Video Technology 26(9):1632–1645
Zhang K, Lu J, Lafruit G (2009) Cross-based local stereo matching using orthogonal integral images. IEEE transactions on circuits and systems for video technology 19(7):1073–1079
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yao, M., Ouyang, W. & Xu, B. Hybrid cost aggregation for dense stereo matching. Multimed Tools Appl 79, 23189–23202 (2020). https://doi.org/10.1007/s11042-020-09127-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09127-7