Abstract
Extracting meaningful structural edges from complex texture images presents a significant challenge. Accurately measuring and differentiating texture information within an image are crucial for efficient texture filtering. While most existing texture filtering methods employ regular rectangular filter windows, the irregularity inherent in textures and structures can limit measurement accuracy, reducing the effectiveness of texture filtering. To address this problem, we propose an edge-aware texture filtering method that integrates superpixels. By employing patch shift, our filter constructs an edge-aware filtering region with superpixels constraint. This region includes pixels with minimal differences and similar texture characteristics. Utilizing the perceptual properties of superpixels for irregular edges enhances texture measurement, thereby improving the quality of texture filtering. Experimental results demonstrate that the proposed method outperforms existing techniques, yielding superior filtering outcomes. The source code is available at: https://github.com/kxZhang1016/EATFS.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The datasets used in this paper are public datasets.
References
Cho, H., Lee, H., Kang, H., Lee, S.: Bilateral texture filtering. ACM Transact. Gr. (TOG) 33(4), 1–8 (2014)
Xu, L., Yan, Q., Xia, Y., Jia, J.: Structure extraction from texture via relative total variation. ACM Transact. Gr. (TOG) 31(6), 1–10 (2012)
Karacan, L., Erdem, E., Erdem, A.: Structure-preserving image smoothing via region covariances. ACM Transact. Gr. (TOG) 32(6), 1–11 (2013)
Zhu, L., Fu, C.-W., Jin, Y., Wei, M., Qin, J., Heng, P.-A.: Non-local sparse and low-rank regularization for structure-preserving image smoothing. In: Computer Graphics Forum, 35, 217–226 (2016). Wiley Online Library
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), 839–846 (1998). IEEE
Farbman, Z., Fattal, R., Lischinski, D., Szeliski, R.: Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transact. Gr. (TOG) 27(3), 1–10 (2008)
Zhang, Q., Shen, X., Xu, L., Jia, J.: Rolling guidance filter. In: Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part III 13, 815–830 (2014). Springer
Yang, Q.: Semantic filtering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4517–4526 (2016)
Jeon, J., Lee, H., Kang, H., Lee, S.: Scale-aware structure-preserving texture filtering. In: Computer Graphics Forum, 35, 77–86 (2016). Wiley Online Library
Lin, T.-H., Way, D.-L., Shih, Z.-C., Tai, W.-K., Chang, C.-C.: An efficient structure-aware bilateral texture filtering for image smoothing. In: Computer Graphics Forum, 35, 57–66 (2016). Wiley Online Library
Zhang, F., Dai, L., Xiang, S., Zhang, X.: Segment graph based image filtering: fast structure-preserving smoothing. In: Proceedings of the IEEE International Conference on Computer Vision, 361–369 (2015)
Xu, P., Wang, W.: Improved bilateral texture filtering with edge-aware measurement. IEEE Trans. Image Process. 27(7), 3621–3630 (2018)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60(1–4), 259–268 (1992)
Zang, Y., Huang, H., Zhang, L.: Efficient structure-aware image smoothingby local extrema on space-filling curve. IEEE Trans. Visual Comput. Gr. 20(9), 1253–1265 (2014)
Zang, Y., Huang, H., Zhang, L.: Guided adaptive image smoothing via directional anisotropic structure measurement. IEEE Trans. Visual Comput. Gr. 21(9), 1015–1027 (2015)
Ham, B., Cho, M., Ponce, J.: Robust image filtering using joint static and dynamic guidance. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4823–4831 (2015)
Xu, L., Lu, C., Xu, Y., Jia, J.: Image smoothing via l 0 gradient minimization. In: Proceedings of the 2011 SIGGRAPH Asia Conference, 1–12 (2011)
Magnier, B., Montesinos, P., Diep, D.: Texture removal preserving edges by diffusion. In: Image Analysis: 19th Scandinavian Conference, SCIA 2015, Copenhagen, Denmark, June 15-17, 2015. Proceedings 19, 3–15 (2015). Springer
Huang, J., Wang, H., Wang, X., Ruzhansky, M.: Semi-sparsity for smoothing filters. IEEE Trans. Image Process. 32, 1627–1639 (2023)
Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, 257–266 (2002)
Porikli, F.: Constant time o (1) bilateral filtering. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, 1–8 (2008). IEEE
Yang, Q., Tan, K.-H., Ahuja, N.: Real-time o (1) bilateral filtering. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, 557–564 (2009). IEEE
Ghosh, S., Gavaskar, R.G., Panda, D., Chaudhury, K.N.: Fast scale-adaptive bilateral texture smoothing. IEEE Trans. Circuits Syst. Video Technol. 30(7), 2015–2026 (2019)
Song, C., Xiao, C., Lei, L., Sui, H.: Scale-adaptive structure-preserving texture filtering. In: Computer Graphics Forum, 38, 149–158 (2019). Wiley Online Library
Lee, H., Jeon, J., Kim, J., Lee, S.: Structure-texture decomposition of images with interval gradient. In: Computer Graphics Forum, 36, 262–274 (2017). Wiley Online Library
Pradhan, K., Patra, S.: Semantic-aware structure-preserving median morpho-filtering. The Visual Computer, 1–17 (2023)
Yuan, Y., Zhang, W., Yu, H., Zhu, Z.: Superpixels with content-adaptive criteria. IEEE Trans. Image Process. 30, 7702–7716 (2021)
Bao, L., Song, Y., Yang, Q., Yuan, H., Wang, G.: Tree filtering: efficient structure-preserving smoothing with a minimum spanning tree. IEEE Trans. Image Process. 23(2), 555–569 (2013)
Cai, B., Xing, X., Xu, X.: Edge/structure preserving smoothing via relativity-of-gaussian. In: 2017 IEEE International Conference on Image Processing (ICIP), 250–254 (2017). IEEE
Yin, H., Gong, Y., Qiu, G.: Side window filtering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 8758–8766 (2019)
Cao, W., Wu, S., Liu, Z., Agaian, S.: Scale-aware guided and structure-preserved texture filter. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2021)
Li, M., Fu, Y., Li, X., Guo, X.: Deep flexible structure preserving image smoothing. In: Proceedings of the 30th ACM International Conference on Multimedia, 1875–1883 (2022)
Sun, B., Qi, Y., Zhang, G., Liu, Y.: Edge guidance filtering for structure extraction. Vis. Comput. 39(11), 5327–5342 (2023)
Acknowledgements
This work was supported by the Science and Technology Research Program of Chongqing Municipal Education Commission (Grant No. KJQN202201148), the Humanities and Social Sciences Research Program of Chongqing Municipal Education Commission (Grant No. 23SKGH263), the Foundation and Frontier Research Key Program of Chongqing Science and Technology Commission (Grant No. cstc2015jcyjBX0127), the National Natural Science Foundation of China for Young Scientists (Grant No. 61502065), and the Funding Achievements of the Action Plan for High Quality Development of Graduate Education at Chongqing University of Technology (Grant No. gzlcx20233225).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study design. J.L. was involved in conceptualization, resources, and writing—reviewing and editing. K.Z. was responsible for methodology, software, validation, and writing—original draft. J.Z. contributed to data curation and visualization.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Long, J., Zhang, K. & Zhu, J. Edge-aware texture filtering with superpixels constraint. Vis Comput 40, 7161–7184 (2024). https://doi.org/10.1007/s00371-024-03415-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-024-03415-1