survey

A Survey on Content-Aware Image and Video Retargeting

Authors:

Johannes Kiess,

Benjamin Guthier,

Wolfgang EffelsbergAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 14, Issue 3

Article No.: 76, Pages 1 - 28

https://doi.org/10.1145/3231598

Published: 24 July 2018 Publication History

Abstract

This survey introduces the current state of the art in image and video retargeting and describes important ideas and technologies that have influenced the recent work. Retargeting is the process of adapting an image or video from one screen resolution to another to fit different displays, for example, when watching a wide screen movie on a normal television screen or a mobile device. As there has been considerable work done in this field already, this survey provides an overview of the techniques. It is meant to be a starting point for new research in the field. We include explanations of basic terms and operators, as well as the basic workflow of the different methods.

Supplementary Material

a76-kiess-apndx.pdf (kiess.zip)

Supplemental movie, appendix, image and software files for, A Survey on Content-Aware Image and Video Retargeting

Download
37.27 KB

References

[1]

R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk. 2009. Frequency-tuned salient region detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). 1597--1604.

[2]

S. Avidan and A. Shamir. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3.

Digital Library

[3]

T. Dekel Basha, Y. Moses, and S. Avidan. 2013. Stereo seam carving a geometrically consistent approach. IEEE Trans. Pattern Anal. Mach. Intell. 35, 10 (Oct 2013), 2513--2525.

Digital Library

[4]

J. Bhatt, D. Pappusetty, H. Kalva, and M. Naik. 2016. Image retargeting for wearable devices. In Proceedings of the IEEE International Conference on Consumer Electronics (ICCE’16). 55--57.

[5]

A. Carlier, V. Charvillat, W. T. Ooi, R. Grigoras, and G. Morin. 2010. Crowdsourced automatic zoom and scroll for video retargeting. In Proceedings of the 18th ACM International Conference on Multimedia (MM’10). ACM, New York, NY, 201--210.

Digital Library

[6]

Yanxiang Chen, Yifei Pan, Minglong Song, and Meng Wang. 2015. Improved seam carving combining with 3D saliency for image retargeting. Neurocomputing 151, Part 2 (2015), 645--653.

[7]

W.-H. Cheng, C.-W. Wang, and J.-L. Wu. 2007. Video adaptation for small display based on content recomposition. IEEE Trans. Circ. Syst. Video Technol. 17, 1 (Jan. 2007), 43 --58.

Digital Library

[8]

C.-K. Chiang, S.-F. Wang, Y.-L. Chen, and S.-H. Lai. 2009. Fast JND-based video carving with GPU acceleration for real-time video retargeting. IEEE Trans. Circ. Syst. Video Technol. 19, 11 (2009), 1588--1597.

Digital Library

[9]

Jiwon Choi and Changick Kim. 2015. Sparse seam-carving for structure preserving image retargeting. J. Signal Process. Syst. (2015), 1--9.

Digital Library

[10]

Meir Johnathan Dahan, Nir Chen, Ariel Shamir, and Daniel Cohen-Or. 2012. Combining color and depth for enhanced image segmentation and retargeting. Visual Comput. 28, 12 (2012), 1181--1193.

[11]

Torben Dittrich, Stephan Kopf, Philipp Schaber, Benjamin Guthier, and Wolfgang Effelsberg. 2013. Saliency detection for stereoscopic video. In Proceedings of the ACM Multimedia Systems Conference (MMSYS’13). 12--23.

Digital Library

[12]

Weiming Dong, Guanbo Bao, Xiaopeng Zhang, and Jean-Claude Paul. 2012. Fast multi-operator image resizing and evaluation. J. Comput. Sci. Technol. 27, 1 (2012), 121--134.

[13]

W. Dong, F. Wu, Y. Kong, X. Mei, T. Y. Lee, and X. Zhang. 2016. Image retargeting by texture-aware synthesis. IEEE Trans. Visual. Comput. Graph. 22, 2 (Feb 2016), 1088--1101.

Digital Library

[14]

Weiming Dong, Ning Zhou, Tong-Yee Lee, Fuzhang Wu, Yan Kong, and Xiaopeng Zhang. 2014. Summarization-based image resizing by intelligent object carving. IEEE Trans. Visual. Comput. Graph. 20, 1 (2014), 111--124.

Digital Library

[15]

Huan Du, Zhi Liu, Jian Wang, Lin Mei, and Ying He. 2014. Video Retargeting Based on Spatiotemporal Saliency Model. Springer, Berlin, 397--402.

[16]

U. Engelke, J. Wang, and P. Marendy. 2015. Perceptual relevance based image retargeting. IEEE Signal Process. Lett. 22, 6 (June 2015), 705--708.

[17]

Simone Frintrop, Erich Rome, and Henrik I. Christensen. 2010. Computational visual attention systems and their cognitive foundations: A survey. ACM Trans. Appl. Percept. 7, 1 (2010), 1--39.

Digital Library

[18]

R. Furuta, I. Tsubaki, and T. Yamasaki. 2017. Fast volume seam carving with multi-pass dynamic programming. IEEE Trans. Circ. Syst. Video Technol. (2017).

[19]

R. Gal, O. Sorkine, and D. Cohen-Or. 2006. Feature-aware texturing. In Proceedings of the 17th Eurographics Conference on Rendering Techniques (EGSR’06). Eurographics Association, 297--303.

Digital Library

[20]

R. Gallea, E. Ardizzone, and R. Pirrone. 2014. Physical metaphor for streaming media retargeting. IEEE Trans. Multimedia 16, 4 (June 2014), 971--979.

Digital Library

[21]

R. Gao, Q. Tu, C. Li, M. Zhao, G. Fu, and B. Yang. 2015. Graph based spatiotemporal saliency detection incorporating low- and high-level features. In Proceedings of the Conference on Visual Communications and Image Processing (VCIP’15). 1--4.

[22]

S. Goferman, L. Zelnik-Manor, and A. Tal. 2012. Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34, 10 (Oct 2012), 1915--1926.

Digital Library

[23]

M. Grundmann, V. Kwatra, M. Han, and I. Essa. 2010. Discontinuous seam-carving for video retargeting. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 569--576.

[24]

Yanwen Guo, Feng Liu, Zhi-Hua Zhou, and Michael Gleicher. 2009. Image retargeting using mesh parameterization. IEEE Trans. Multimedia 11, 5 (2009), 856--867.

Digital Library

[25]

B. Guthier, J. Kiess, S. Kopf, and W. Effelsberg. 2013. Seam carving for stereoscopic video. In Proceedings of the 2013 IEEE 11th IVMSP Workshop: 3D Image/Video Technologies and Applications. 1--4.

[26]

Dongfeng Han, X. Wu, and M. Sonka. 2009. Optimal multiple surfaces searching for video/image resizing—A graph-theoretic approach. In Proceedings of the IEEE 12th International Conference on Computer Vision. 1026--1033.

[27]

J. Han, S. He, X. Qian, D. Wang, L. Guo, and T. Liu. 2013. An object-oriented visual saliency detection framework based on sparse coding representations. IEEE Trans. Circ. Syst. Video Technol. 23, 12, 2009--2021.

Digital Library

[28]

J.-W. Han, K.-S. Choi, T.-S. Wang, S.-H. Cheon, and S.-J. Ko. 2009. Improved seam carving using a modified energy function based on wavelet decomposition. In Proceedings of the IEEE 13th International Symposium on Consumer Electronics. 38--41.

[29]

C. C. Hsu, C. W. Lin, Y. Fang, and W. Lin. 2014. Objective quality assessment for image retargeting based on perceptual geometric distortion and information loss. IEEE J. Select. Topics Signal Process. 8, 3 (2014), 377--389.

[30]

W. Hu, Z. Luo, and X. Fan. 2014. Image retargeting via adaptive scaling with geometry preservation. IEEE J. Emerg. Select. Topics Circ. Syst. 4, 1 (March 2014), 70--81.

[31]

Daw-Sen Hwang and Shao-Yi Chien. 2008. Content-aware image resizing using perceptual seam carving with human attention model. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1029--1032.

[32]

Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa. 2017. Globally and locally consistent image completion. ACM Trans. Graph. 36, 4 (2017), 107:1--107:14.

Digital Library

[33]

Laurent Itti, Christof Koch, and Ernst Niebur. 1999. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 11 (1999), 1254--1259.

Digital Library

[34]

W. C. Jhou, Y. H. Lin, and J. L. Wu. 2014. Seam carving for color-plus-depth 3D image. In Proceedings of the IEEE International Symposium on Multimedia (ISM’14). 82--85.

Digital Library

[35]

J. Kiess, R. Garcia, S. Kopf, and W. Effelsberg. 2012. Improved image retargeting by distinguishing between faces in focus and out of focus. In Proceedings of the IEEE International Conference on Multimedia and Expo Workshops. 145--150.

Digital Library

[36]

Johannes Kiess, Daniel Gritzner, Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2014. GPU video retargeting with parallelized SeamCrop. In Proceedings of the 5th ACM Multimedia Systems Conference (MMSys’14). ACM, New York, NY, 139--147.

Digital Library

[37]

Johannes Kiess, Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2012. SeamCrop: Changing the size and aspect ratio of videos. In Proceedings of the 4th Workshop on Mobile Video (MoVid’12). ACM, New York, NY, 13--18.

Digital Library

[38]

Johannes Kiess, Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2012. SeamCrop for image retargeting. Proc. SPIE 8304 (2012), 83040K--83040K--8.

[39]

Johannes Kiess, Stephan Kopf, Benjamin Guthier, and Wolfgang Effelsberg. 2010. Seam carving with improved edge preservation. Proc. SPIE 7542 (2010), 75420G--75420G--11.

[40]

W. Kim and C. Kim. 2014. Spatiotemporal saliency detection using textural contrast and its applications. IEEE Trans. Circ. Syst. Video Technol. 24, 4 (Apr. 2014), 646--659.

[41]

Y. Kong, W. Dong, X. Mei, C. Ma, T.-L. Lee, S. Lyu, F. Huang, and X. Zhang. 2016. Measuring and predicting visual importance of similar objects. IEEE Trans. Visual. Comput. Graph. 22, 12 (2016), 2564--2578.

Digital Library

[42]

S. Kopf, B. Guthier, C. Hipp, J. Kiess, and W. Effelsberg. 2014. Warping-based video retargeting for stereoscopic video. In Proceedings of the IEEE International Conference on Image Processing (ICIP). 2898--2902.

[43]

Stephan Kopf, Benjamin Guthier, Hendrik Lemelson, and Wolfgang Effelsberg. 2009. Adaptation of web pages and images for mobile applications. Proc. SPIE 7256 (2009), 72560C--72560C--12.

[44]

Stephan Kopf, Thomas Haenselmann, Johannes Kiess, Benjamin Guthier, and Wolfgang Effelsberg. 2011. Algorithms for video retargeting. Multimedia Tools Appl. 51, 2 (2011), 819--861.

Digital Library

[45]

Stephan Kopf, Johannes Kiess, Hendrik Lemelson, and Wolfgang Effelsberg. 2009. FSCAV: Fast seam carving for size adaptation of videos. In Proceedings of the 17th ACM International Conference on Multimedia (MM’09). ACM, New York, NY, 321--330.

Digital Library

[46]

S. Kopf, F. Lampi, T. King, and W. Effelsberg. 2006. Automatic scaling and cropping of videos for devices with limited screen resolution. In Proceedings of the 14th ACM International Conference on Multimedia (MM’06). ACM, New York, NY, 957--958.

Digital Library

[47]

Philipp Krähenbühl, Manuel Lang, Alexander Hornung, and Markus Gross. 2009. A system for retargeting of streaming video. In ACM SIGGRAPH Asia papers. ACM, New York, NY, 1--10.

Digital Library

[48]

J. S. Lee and T. Ebrahimi. 2012. Perceptual video compression: A survey. IEEE J. Select. Topics Signal Process. 6, 6 (Oct. 2012), 684--697.

[49]

Jianjun Lei, Min Wu, Changqing Zhang, Feng Wu, Nam Ling, and Chunping Hou. 2017. Depth-preserving image retargeting based in pixel fusion. IEEE Trans. Multimedia 19, 7 (2017), 1442--1453.

Digital Library

[50]

B. Li, L. Y. Duan, C. W. Lin, T. Huang, and W. Gao. 2015. Depth-preserving warping for stereo image retargeting. IEEE Trans. Image Process. 24, 9 (Sept 2015), 2811--2826.

Digital Library

[51]

B. Li, L. Y. Duan, J. Wang, R. Ji, C. W. Lin, and W. Gao. 2014. Spatiotemporal grid flow for video retargeting. IEEE Trans. Image Process. 23, 4 (April 2014), 1615--1628.

Digital Library

[52]

S. Li, H. Lu, Z. Lin, X. Shen, and B. Price. 2015. Adaptive metric learning for saliency detection. IEEE Trans. Image Process. 24, 11 (Nov 2015), 3321--3331.

Digital Library

[53]

Y. Li, Y. Tian, J. Yang, L.-Y. Duan, and W. Gao. 2010. Video retargeting with multi-scale trajectory optimization. In Proceedings of the International Conference on Multimedia Information Retrieval (MIR’10). ACM, New York, NY, 45--54.

Digital Library

[54]

Yun Liang, Yong-Jin Liu, and Diego Gutierrez. 2017. Objective quality prediction of image retargeting algorithms. IEEE Trans. Visual. Comput. Graph. 23, 2 (2017), 1099--1110.

Digital Library

[55]

Y. Liang, Y. J. Liu, X. N. Luo, L. Xie, and X. Fu. 2013. Optimal-scaling-factor assignment for patch-wise image retargeting. IEEE Comput. Graph. Appl. 33, 5 (Sept 2013), 68--78.

Digital Library

[56]

K. C. Lien and M. Turk. 2015. On preserving structure in stereo seam carving. In Proceedings of the International Conference on 3D Vision (3DV’15). 571--579.

Digital Library

[57]

S. Lin, C. Lin, I. Yeh, S. Chang, C. Yeh, and T. Lee. 2013. Content-aware video retargeting using object-preserving warping. IEEE Trans. Visual. Comput. Graph. 19, 10 (2013), 1677--1686.

[58]

Xiao Lin, Ying-lan Ma, Li-zhuang Ma, and Rui-ling Zhang. 2014. A survey for image resizing. J. Zhejiang Univ. Sci. C 15, 9 (2014), 697--716.

[59]

Di Liu, Zhaogai Wu, Xianming Lin, and Rongrong Ji. 2016. Towards perceptual video cropping with curve fitting. Multimedia Tools Appl. 75, 20 (2016), 12465--12475.

Digital Library

[60]

Feng Liu and Michael Gleicher. 2005. Automatic image retargeting with fisheye-view warping. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST’05). ACM, New York, NY, 153--162.

Digital Library

[61]

Feng Liu and Michael Gleicher. 2006. Video retargeting: Automating pan and scan. In Proceedings of the 14th ACM International Conference on Multimedia (MM’06). ACM, New York, NY, 241--250.

Digital Library

[62]

Hao Liu, Xing Xie, Wei-Ying Ma, and Hong-Jiang Zhang. 2003. Automatic browsing of large pictures on mobile devices. In Proceedings of the 11th ACM International Conference on Multimedia (MULTIMEDIA’03). ACM, New York, NY, 148--155.

Digital Library

[63]

Yi Liu, Lifeng Sun, and Shiqiang Yang. 2015. A retargeting method for stereoscopic 3D video. Comput. Visual Media 1, 2 (2015), 119--127.

[64]

L. Ma, W. Lin, C. Deng, and K. N. Ngan. 2012. Image retargeting quality assessment: A study of subjective scores and objective metrics. IEEE J. Select. Topics Signal Process. 6, 6 (Oct 2012), 626--639.

[65]

Yu-Fei Ma and Hong-Jiang Zhang. 2003. Contrast-based image attention analysis by using fuzzy growing. In Proceedings of the 11th ACM International Conference on Multimedia. ACM, New York, NY, 374--381.

Digital Library

[66]

V. A. Mateescu and I. V. Bajic. 2016. Visual attention retargeting. IEEE MultiMedia 23, 1 (Jan. 2016), 82--91.

Digital Library

[67]

Yongwei Nie, Qing Zhang, Renfang Wang, and Chunxia Xiao. 2013. Video retargeting combining warping and summarizing optimization. Visual Comput. 29, 6 (2013), 785--794.

Digital Library

[68]

Yuzhen Niu, Feng Liu, Wu chi Feng, and Hailin Jin. 2012. Aesthetics-based stereoscopic photo cropping for heterogeneous displays. IEEE Trans. Multimedia 14, 3 (2012), 783--796.

Digital Library

[69]

Hyeonwoo Noh and Bohyung Han. 2012. Seam carving with forward gradient difference maps. In Proceedings of the 20th ACM International Conference on Multimedia (MM’12). ACM, New York, NY, 709--712.

Digital Library

[70]

Daniele Panozzo, Ofir Weber, and Olga Sorkine. 2012. Robust image retargeting via axis-aligned deformation. Comput. Graph. Forum 31, 2pt1 (2012), 229--236.

Digital Library

[71]

Y. Pritch, E. Kav-Venaki, and S. Peleg. 2009. Shift-map image editing. In Proceedings of the IEEE 12th International Conference on Computer Vision. 151--158.

[72]

S. Qi, Y. T. J. Chi, A. M. Peter, and J. Ho. 2016. CASAIR: Content and shape-aware image retargeting and its applications. IEEE Trans. Image Process. 25, 5 (May 2016), 2222--2232.

Digital Library

[73]

Zhongyan Qiu, Tongwei Ren, Yan Liu, Jia Bei, and Muyang Song. 2013. Image Retargeting by Combining Region Warping and Occlusion. Springer International Publishing, Cham, 200--210.

Digital Library

[74]

Z. Qu, J. Wang, M. Xu, and H. Lu. 2013. Context-aware video retargeting via graph model. IEEE Trans. Multimedia 15, 7 (Nov 2013), 1677--1687.

Digital Library

[75]

Parvin Razzaghi and Shadrokh Samavi. 2015. Image retargeting using nonparametric semantic segmentation. Multimedia Tools Appl. 74, 24 (Dec. 2015), 11517--11536.

Digital Library

[76]

Tongwei Ren, Yan Liu, Ran Ju, and Gangshan Wu. 2016. How important is location information in saliency detection of natural images. Multimedia Tools Appl. 75, 5 (2016), 2543--2564.

Digital Library

[77]

Tongwei Ren, Yan Liu, and Gangshan Wu. 2009. Image retargeting based on global energy optimization. In Proceedings of the 2009 IEEE International Conference on Multimedia and Expo (ICME’09). IEEE Press, Piscataway, NJ, 406--409.

Digital Library

[78]

Michael Rubinstein, Diego Gutierrez, Olga Sorkine, and Ariel Shamir. 2010. A comparative study of image retargeting. In ACM SIGGRAPH Asia papers. ACM, New York, NY.

Digital Library

[79]

Michael Rubinstein, Ariel Shamir, and Shai Avidan. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27, 3 (Aug. 2008).

Digital Library

[80]

Michael Rubinstein, Ariel Shamir, and Shai Avidan. 2009. Multi-operator media retargeting. ACM Trans. Graph. SIGGRAPH 28, 3 (2009), 1--11.

Digital Library

[81]

A. Santella, M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen. 2006. Gaze-based interaction for semi-automatic photo cropping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’06). 771--780.

Digital Library

[82]

C. Scharfenberger, A. Wong, and D. A. Clausi. 2015. Structure-guided statistical textural distinctiveness for salient region detection in natural images. IEEE Trans. Image Process. 24, 1 (Jan 2015), 457--470.

[83]

Vidya Setlur, Saeko Takagi, Ramesh Raskar, Michael Gleicher, and Bruce Gooch. 2005. Automatic image retargeting. In Proceedings of the 4th International Conference on Mobile and Ubiquitous Multimedia (MUM’05). ACM, New York, NY, 59--68.

Digital Library

[84]

F. Shao, W. Lin, W. Lin, G. Jiang, M. Yu, and R. Fu. 2016. Stereoscopic visual attention guided seam carving for stereoscopic image retargeting. J. Display Technol. 12, 1 (Jan. 2016), 22--30.

[85]

J. Shi, Q. Yan, L. Xu, and J. Jia. 2016. Hierarchical image saliency detection on extended CSSD. IEEE Trans. Pattern Anal. Mach. Intell. 38, 4 (April 2016), 717--729.

Digital Library

[86]

Li. Shi, J. Wang, L. Duan, and H. Lu. 2009. Consumer video retargeting: Context assisted spatial-temporal grid optimization. In Proceedings of the 17th ACM International Conference on Multimedia (MM’09). ACM, New York, NY, 301--310.

Digital Library

[87]

Bongwon Suh, Haibin Ling, Benjamin B. Bederson, and David W. Jacobs. 2003. Automatic thumbnail cropping and its effectiveness. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST’03). ACM, 95--104.

Digital Library

[88]

W. J. Tsai and C. F. Chen. 2015. Hybrid image retargeting. In Proceedings of the Conference on Visual Communications and Image Processing (VCIP’15). 1--4.

[89]

K. Utsugi, T. Shibahara, T. Koike, K. Takahashi, and T. Naemura. 2010. Seam carving for stereo images. In Proceedings of the Conference on True Vision—Capture, Transmission and Display of 3D Video (3DTV’10). 1--4.

[90]

Daniel Vaquero, Matthew Turk, Kari Pulli, Marius Tico, and Natasha Gelfand. 2010. A survey of image retargeting techniques. Proc. SPIE 7798 (2010), 779814--779814--15.

[91]

B. Wang, H. Xiong, Z. Ren, and C. W. Chen. 2014. Deformable shape preserving video retargeting with salient curve matching. IEEE J. Emerg. Select. Topics Circ. Syst. 4, 1 (March 2014), 82--94.

[92]

J. Wang, Y. Fang, M. Narwaria, W. Lin, and P. Le Callet. 2014. Stereoscopic image retargeting based on 3D saliency detection. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’14). 669--673.

[93]

J. Wang, Z. Qu, Y. Chen, T. Mei, M. Xu, L. Zhang, and H. Lu. 2016. Adaptive content condensation based on grid optimization for thumbnail image generation. IEEE Trans. Circ. Syst. Video Technol. 26, 11 (2016), 2079--2092.

Digital Library

[94]

S. Wang, M. Wang, S. Yang, and K. Zhang. 2017. Salient region detection via discriminative dictionary learning and joint Bayesian inference. IEEE Trans. Circ. Syst. Video Technol. (2017).

[95]

Shu-Fan Wang and Shang-Hong Lai. 2011. Compressibility-aware media retargeting with structure preserving. IEEE Trans. Image Process. 20, 3 (Mar. 2011), 855--865.

Digital Library

[96]

Wenguan Wang, Jianbing Shen, Yizhou Yu, and Kwan-Liu Ma. 2017. Stereoscopic thumbnail creation via efficient stereo saliency detection. IEEE Trans. Visual. Comput. Graph. 23, 8 (2017), 2014--2017.

Digital Library

[97]

Weiwei Wang, Dong Zhai, Tao Li, and Xiangchu Feng. 2014. Salient edge and region aware image retargeting. Signal Process.: Image Commun. 29, 10 (2014), 1223--1231.

Digital Library

[98]

Yu-Shuen Wang, Hongbo Fu, Olga Sorkine, Tong-Yee Lee, and Hans-Peter Seidel. 2009. Motion-aware temporal coherence for video resizing. ACM Trans. Graph. 28, 5 (Dec. 2009).

Digital Library

[99]

Yu-Shuen Wang, Jen-Hung Hsiao, Olga Sorkine, and Tong-Yee Lee. 2011. Scalable and coherent video resizing with per-frame optimization. ACM Trans. Graph. 30, 4 (July 2011).

Digital Library

[100]

Yu-Shuen Wang, Hui-Chih Lin, Olga Sorkine, and Tong-Yee Lee. 2010. Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. SIGGRAPH 29, 4 (2010).

Digital Library

[101]

Yu-Shuen Wang, Chiew-Lan Tai, Olga Sorkine, and Tong-Yee Lee. 2008. Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27, 5 (2008), 1--8.

Digital Library

[102]

L. Wolf, M. Guttmann, and D. Cohen-Or. 2007. Non-homogeneous Content-driven Video-retargeting. In Proceedings of the IEEE 11th International Conference on Computer Vision. 1--6.

[103]

Lifang Wu, Lianchao Cao, Min Xu, and Jinqiao Wang. 2014. A hybrid image retargeting approach via combining seam carving and grid warping. J. Multimedia 9, 4 (2014).

[104]

B. Yan, K. Li, X. Yang, and T. Hu. 2015. Seam searching-based pixel fusion for image retargeting. IEEE Trans. Circ. Syst. Video Technol. 25, 1 (Jan. 2015), 15--23.

[105]

Bo Yan, Weimin Tan, Ke Li, and Tian Qi. 2017. Codebook-guided feature preserving for recognition-oriented image retargeting. IEEE Trans. Image Process. 26, 5 (2017), 2454--2465.

Digital Library

[106]

B. Yan, B. Yuan, and B. Yang. 2014. Effective video retargeting with jittery assessment. IEEE Trans. Multimedia 16, 1 (Jan 2014), 272--277.

[107]

Z. Yan and H. Chen. 2014. A study of image retargeting based on seam carving. In Proceedings of the 6th International Conference on Measuring Technology and Mechatronics Automation. 60--63.

Digital Library

[108]

Z. Yan, P. Jingliang, and H. Yan. 2013. Improved adaptive seam carving for image retargeting. In Proceedings of the 4th International Conference on Digital Manufacturing and Automation (ICDMA’13). 675--678.

[109]

J. Zhang and C. C. J. Kuo. 2012. Region-adaptive texture-aware image resizing. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’12). 837--840.

[110]

J. Zhang, S. Li, and C. C. J. Kuo. 2014. Compressed-domain video retargeting. IEEE Trans. Image Process. 23, 2 (Feb 2014), 797--809.

Digital Library

[111]

Lixia Zhang, Kangshun Li, Zhaoming Ou, and Fubin Wang. 2015. Seam warping: A new approach for image retargeting for small displays. Soft Comput. (2015), 1--11.

Digital Library

[112]

Luming Zhang, Xuelong Li, Liqiang Nie, Yan Yan, and Roger Zimmermann. 2016. Semantic photo retargeting under noisy image labels. ACM Trans. Multimedia Comput. Commun. Appl. 12, 3 (May 2016).

Digital Library

[113]

Luming Zhang, Meng Wang, Liqiang Nie, Liang Hong, Yong Rui, and Qi Tian. 2015. Retargeting semantically rich photos. IEEE Trans. Multimedia 17, 9 (2015), 1538--1549.

Digital Library

[114]

Y. Zhang, W. Lin, X. Zhang, Y. Fang, and L. Li. 2016. Aspect ratio similarity (ARS) for image retargeting quality assessment. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’16). 1080--1084.

[115]

Yi-Fei Zhang, Shi-Min Hu, and Ralph R. Martin. 2008. Shrinkability maps for content-aware video resizing. Comput. Graph. Forum (Special issue of Pacific Graphics) 27, 7 (2008), 1797--1804.

Cited By

Fan XZhang ZSun LXiao BDurrani T(2024)A comprehensive review of image retargetingNeurocomputing10.1016/j.neucom.2024.127416579(127416)Online publication date: Apr-2024
https://doi.org/10.1016/j.neucom.2024.127416
Zhu CJoslin C(2024)A review of motion retargeting techniques for 3D character facial animationComputers & Graphics10.1016/j.cag.2024.104037123(104037)Online publication date: Oct-2024
https://doi.org/10.1016/j.cag.2024.104037
Kim DLee SBae JCho SBae BLee JPark S(2024)Human-oriented video retargeting via object detection and patch decisionMultimedia Tools and Applications10.1007/s11042-024-18878-6Online publication date: 8-Apr-2024
https://doi.org/10.1007/s11042-024-18878-6
Show More Cited By

Index Terms

A Survey on Content-Aware Image and Video Retargeting
1. General and reference
  1. Document types
    1. Surveys and overviews

Recommendations

Seam carving for content-aware image resizing
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Effective resizing of images should not only use geometric constraints, but consider the image content as well. We present a simple image operator called seam carving that supports content-aware image resizing for both reduction and expansion. A seam is ...
Improved seam carving for video retargeting

Video, like images, should support content aware resizing. We present video retargeting using an improved seam carving operator. Instead of removing 1D seams from 2D images we remove 2D seam manifolds from 3D space-time volumes. To achieve this we ...
A Distortion-Sensitive Seam Carving Algorithm for Content-Aware Image Resizing

As displays become less expensive and are incorporated into more and more devices, there has been an increased focus on image resizing techniques to fill an image to an arbitrary screen size. Traditional methods such as cropping or resampling can ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 14, Issue 3

August 2018

249 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3241977

Editor:
Alberto Del Bimbo
University of Firenze, Italy

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2018

Accepted: 01 June 2018

Revised: 01 June 2018

Received: 01 July 2017

Published in TOMM Volume 14, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
677
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fan XZhang ZSun LXiao BDurrani T(2024)A comprehensive review of image retargetingNeurocomputing10.1016/j.neucom.2024.127416579(127416)Online publication date: Apr-2024
https://doi.org/10.1016/j.neucom.2024.127416
Zhu CJoslin C(2024)A review of motion retargeting techniques for 3D character facial animationComputers & Graphics10.1016/j.cag.2024.104037123(104037)Online publication date: Oct-2024
https://doi.org/10.1016/j.cag.2024.104037
Kim DLee SBae JCho SBae BLee JPark S(2024)Human-oriented video retargeting via object detection and patch decisionMultimedia Tools and Applications10.1007/s11042-024-18878-6Online publication date: 8-Apr-2024
https://doi.org/10.1007/s11042-024-18878-6
Le TLee TLin SDong W(2024)Deep learning-based importance map for content-aware media retargetingMultimedia Tools and Applications10.1007/s11042-024-18389-483:30(74301-74322)Online publication date: 15-Feb-2024
https://doi.org/10.1007/s11042-024-18389-4
Le THuang HChen YLee T(2023)Retargeting Video With an End-to-End FrameworkIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332782530:9(6164-6176)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3327825
El-Torky DAl-Berry MEl-Regaily SFayed Z(2023)A Survey on Content-aware Image Retargeting Techniques for Visually Impaired Assistance2023 Eleventh International Conference on Intelligent Computing and Information Systems (ICICIS)10.1109/ICICIS58388.2023.10391175(174-182)Online publication date: 21-Nov-2023
https://doi.org/10.1109/ICICIS58388.2023.10391175
Cao JZhang XHuang JZhang Y(2023)Polygonal finite element-based content-aware image warpingComputational Visual Media10.1007/s41095-022-0283-79:2(367-383)Online publication date: 3-Jan-2023
https://doi.org/10.1007/s41095-022-0283-7
Asheghi BSalehpour PKhiavi AHashemzadeh M(2022)A Comprehensive Review on Content-Aware Image Retargeting: From Classical to State-of-the-art MethodsSignal Processing10.1016/j.sigpro.2022.108496(108496)Online publication date: Feb-2022
https://doi.org/10.1016/j.sigpro.2022.108496
Garg ANayyar ASingh A(2022)Improved seam carving for structure preservation using efficient energy functionMultimedia Tools and Applications10.1007/s11042-022-12003-181:9(12883-12924)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1007/s11042-022-12003-1
Garg ASingh A(2022)Analysis of seam carving technique: limitations, improvements and possible solutionsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-022-02486-239:7(2683-2709)Online publication date: 23-Apr-2022
https://dl.acm.org/doi/10.1007/s00371-022-02486-2
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents