research-article

Image retargeting using mesh parametrization

Authors:

Michael GleicherAuthors Info & Claims

IEEE Transactions on Multimedia, Volume 11, Issue 5

Pages 856 - 867

https://doi.org/10.1109/TMM.2009.2021781

Published: 01 August 2009 Publication History

Abstract

Image retargeting aims to adapt images to displays of small sizes and different aspect ratios. Effective retargeting requires emphasizing the important content while retaining surrounding context with minimal visual distortion. In this paper, we present such an effective image retargeting method using saliency-based mesh parametrization. Our method first constructs a mesh image representation that is consistent with the underlying image structures. Such a mesh representation enables easy preservation of image structures during retargeting since it captures underlying image structures. Based on this mesh representation, we formulate the problem of retargeting an image to a desired size as a constrained image mesh parametrization problem that aims at finding a homomorphous target mesh with desired size. Specifically, to emphasize salient objects and minimize visual distortion, we associate image saliency into the image mesh and regard image structure as constraints for mesh parametrization. Through a stretch-based mesh parametrization process we obtain the homomorphous target mesh, which is then used to render the target image by texture mapping. The effectiveness of our algorithm is demonstrated by experiments.

References

[1]

Y. Altunbasak and A. Tekalp, "Closed-form connectivity-preserving solutions for motion compensation using 2-D meshes," IEEE Trans. Image Process., vol. 6, no. 9, pp. 1255-1269, Sep. 1997.

Digital Library

[2]

S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Trans. Graph., vol. 26, no. 3, pp. 267-276, 2007.

Digital Library

[3]

L.-Q. Chen, X. Xie, X. Fan, W.-Y. Ma, H.-J. Zhang, and H.-Q. Zhou, "A visual attention model for adapting images on small displays," Multimedia Syst., vol. 9, no. 4, pp. 353-364, 2003.

Digital Library

[4]

W.-H. Cheng, C.-W. Wang, and J.-L. Wu, "Video adaptation for small display based on content recomposition," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 1, pp. 43-58, Jan. 2007.

Digital Library

[5]

X. Fan, X. Xie, H.-Q. Zhou, and W.-Y. Ma, "Looking into video frames on small displays," in Proc. ACM Multimedia, 2003, pp. 247-250.

Digital Library

[6]

D. Hearn and M. P. Baker, Computer Graphics with OpenGL. Englewood Cliffs, NJ: Pearson Prentice-Hall, 2004.

Digital Library

[7]

Y. Hu, D. Rajan, and L.-T. Chia, "Robust subspace analysis for detecting visual attention regions in images," in Proc. ACM Multimedia, 2005, pp. 716-724.

Digital Library

[8]

L. Itti and C. Koch, "Computational modeling of visual attention," Nature Rev. Neurosci., vol. 2, no. 3, pp. 194-203, Mar. 2001.

[9]

L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.

Digital Library

[10]

S. Jiang, H. Liu, Z. Zhao, Q. Huang, and W. Gao, "Generating video sequence from photo image for mobile screens by content analysis," in Proc. IEEE Int. Conf. Multimedia and Expo, 2007, pp. 1475-4178.

[11]

Y. Li, Y.-F. Ma, and H.-J. Zhang, "Salient region detection and tracking in video," in IEEE Int. Conf. Multimedia and Expo, 2003, pp. 269-272.

Digital Library

[12]

F. Liu and M. Gleicher, "Automatic image retargeting with fisheyeview warping," in Proc. ACM UIST, 2005, pp. 153-162.

Digital Library

[13]

R. Gal, O. Sorkine, and D. Cohen-Or, "Feature-aware texturing," in Proc. Eurographics Symp. Rendering, 2006, pp. 297-303.

Digital Library

[14]

Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee, "Optimized scale-and-stretch for image resizing," ACM Trans. Graph. (ACM Siggraph Asia), vol. 27, no. 5, pp. 118:1-118:8, 2008.

Digital Library

[15]

F. Liu and M. Gleicher, "Video retargeting: Automating pan and scan," in Proc. ACM Multimedia, 2006, pp. 241-250.

Digital Library

[16]

H. Liu, X. Xie, W.-Y. Ma, and H.-J. Zhang, "Automatic browsing of large pictures on mobile devices," in Proc. ACM Multimedia, 2003, pp. 148-155.

Digital Library

[17]

Y.-F. Ma and H.-J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. ACM Multimedia, 2003, pp. 374-381.

Digital Library

[18]

J. Maillot, H. Yahia, and A. Verroust, "Interactive texture mapping," in Proc. ACM Siggraph, 1993, pp. 27-34.

Digital Library

[19]

W. Press, S. Teukolsky, W. Vetterling, and B. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge, U.K.: Cambridge Univ. Press, 1992.

Digital Library

[20]

Y. Rui, L. He, A. Gupta, and Q. Liu, "Building an intelligent camera management system," in Proc. ACM Multimedia, 2001, pp. 2-11.

Digital Library

[21]

A. Santella, M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen, "Gaze-based interaction for semi-automatic photo cropping," in Proc. CHI, 2006.

Digital Library

[22]

R. Seidel, Constrained Delaunay Triangulations and Voronoi Diagrams with Obstacles, Inst. Inf. Process., Graz, Austria, 1988, Tech. Rep. 260.

[23]

V. Setlur, T. Lechner, M. Nienhaus, and B. Gooch, "Retargeting images and video for preserving information saliency," IEEE Comput. Graph. Appl., vol. 27, no. 5, pp. 80-88, Sep./Oct. 2007.

Digital Library

[24]

V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch, "Automatic image retargeting," in Proc. 4th Int. Conf. Mobile and Ubiquitous Multimedia, 2005.

Digital Library

[25]

B. Suh, H. Ling, B. Bederson, and D. Jacobs, "Automatic thumbnail cropping and its effectiveness," in Proc. ACM UIST, 2003, pp. 95-104.

Digital Library

[26]

P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. CVPR, 2001, pp. 511-518.

[27]

J. Wang, M. Reinders, R. Lagendijk, J. Lindenberg, and M. Kankanhalli, "Video content representation on tiny devices," in Proc. IEEE Int. Conf. Multimedia and Expo, 2004, pp. 1711-1714.

[28]

J. Wang, Y. Ying, Y. Guo, and Q.-S. Peng, "Automatic foreground extraction of head shoulder images," in Computer Graphics International. New York: Springer, 2006, vol. 4035, LNCS, pp. 385-396.

Digital Library

[29]

L. Wolf, M. Guttmann, and D. Cohen-Or, "Non-homogeneous content-driven video-retargeting," in Proc. IEEE Int. Conf. Computer Vision, 2007, pp. 1-6.

[30]

K. Zhou, J. Snyder, B. Guo, and H.-Y. Shum, "Iso-charts: Stretch-driven mesh parameterization using spectral analysis," in Proc. ACM Symp. Geometry Processing, 2004, pp. 45-54.

Digital Library

Cited By

Wang MMei YYang LTian BWu K(2025)SDR: stepwise deep rectangling model for stitched imagesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03407-141:2(1197-1211)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1007/s00371-024-03407-1
Zhang LChen MTu BLi YXia Y(2024)Retargeting HR Aerial Photos Under Contaminated Labels With Application in Smart NavigationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.328887725:1(349-358)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TITS.2023.3288877
Sun DGuo YYao CMei YChen DPan G(2024)MulTIR: Deep Multi-Target Image RetargetingAdvanced Intelligent Computing Technology and Applications10.1007/978-981-97-5600-1_11(124-133)Online publication date: 5-Aug-2024
https://dl.acm.org/doi/10.1007/978-981-97-5600-1_11
Show More Cited By

Recommendations

Dynamic distortion maps for image retargeting

We present an image retargeting method that incorporates image content distortion into a mesh optimization process through the generation of dynamic distortion maps. The warping process is driven by the distortion produced by the warping process itself. ...
Non-uniform mesh warping for content-aware image retargeting
ICIAR'11: Proceedings of the 8th international conference on Image analysis and recognition - Volume Part I

Image retargeting is the process of adapting an existing image to display with arbitrary sizes and aspect ratios. A compelling retargeting method aims at preserving the viewers' experience by maintaining the significant regions in the image. In this ...
Quad-Mesh Generation and Processing: A Survey

Triangle meshes have been nearly ubiquitous in computer graphics, and a large body of data structures and geometry processing algorithms based on them has been developed in the literature. At the same time, quadrilateral meshes, especially semi-regular ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Multimedia

IEEE Transactions on Multimedia Volume 11, Issue 5

August 2009

245 pages

ISSN:1520-9210

Issue’s Table of Contents

Copyright © 2009.

Publisher

IEEE Press

Publication History

Published: 01 August 2009

Revised: 09 March 2009

Received: 04 September 2008

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang MMei YYang LTian BWu K(2025)SDR: stepwise deep rectangling model for stitched imagesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03407-141:2(1197-1211)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1007/s00371-024-03407-1
Zhang LChen MTu BLi YXia Y(2024)Retargeting HR Aerial Photos Under Contaminated Labels With Application in Smart NavigationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.328887725:1(349-358)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TITS.2023.3288877
Sun DGuo YYao CMei YChen DPan G(2024)MulTIR: Deep Multi-Target Image RetargetingAdvanced Intelligent Computing Technology and Applications10.1007/978-981-97-5600-1_11(124-133)Online publication date: 5-Aug-2024
https://dl.acm.org/doi/10.1007/978-981-97-5600-1_11
Ayubi JAmirani MValizadeh M(2022)A New Seam Carving Method for Image Resizing Based on Entropy Energy and Lyapunov ExponentMultimedia Tools and Applications10.1007/s11042-022-13823-x82:13(19417-19440)Online publication date: 24-Nov-2022
https://dl.acm.org/doi/10.1007/s11042-022-13823-x
Tang ZYao JZhang Q(2022)Multi-operator image retargeting in compressed domain by preserving aspect ratio of important contentsMultimedia Tools and Applications10.1007/s11042-021-11376-z81:1(1501-1522)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1007/s11042-021-11376-z
Tang ZYao JZhang QLuo Y(2022)Multi-operator image retargeting with visual quality preservation of salient regionsMultimedia Systems10.1007/s00530-022-01023-429:2(811-829)Online publication date: 17-Nov-2022
https://dl.acm.org/doi/10.1007/s00530-022-01023-4
Morita RShirai KTanaka Y(2021)Performance analysis of retargeting pyramid and its applications2015 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2015.7351184(2164-2168)Online publication date: 9-Mar-2021
https://dl.acm.org/doi/10.1109/ICIP.2015.7351184
Yeh ILin SHung SLee T(2020)Disparity-preserving image rectangularization for stereoscopic panoramaMultimedia Tools and Applications10.1007/s11042-020-09159-z79:35-36(26123-26138)Online publication date: 10-Jul-2020
https://dl.acm.org/doi/10.1007/s11042-020-09159-z
Cho DJung YRameau FKim DWoo SKweon IAmsaleg LHuet BLarson MGravier GHung HNgo CTsang Ooi W(2019)Video RetargetingProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350895(882-889)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1145/3343031.3350895
Zhang LYao YLu ZShao L(2019)Aesthetics-Guided Graph Clustering With Absent Modalities ImputationIEEE Transactions on Image Processing10.1109/TIP.2019.289794028:7(3462-3476)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1109/TIP.2019.2897940
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents