Location based abstraction of user generated mobile videos
Abstract
Demand for efficient ways to represent vast amount of video data has grown rapidly in recent years. The advances in positioning services have led to new possibilities in combining location information to video content. In this paper we present an automatic video editing system for geotagged mobile videos. In our solution the system creates automatically a video summary from a set of unedited video clips. Location information and timestamps are used to group video clips with the same context properties. The groups are used to create a video summary where subshots from same context group are represented as scenes. The novelty in our solution lies in combining geotags with low level content analysis tools in video abstraction. We have evaluated the created video summaries with a group of users and the system usability for service creation by building a semi-automatic web-based video editing service. The evaluations prove that our concept is useful as it improves coherence and enjoyability of the automatic video summaries.
References
[1]
Hua, Xiang-Sheng, Lu, Lie and Zhang, Hong-Jiang, Optimization-based automated home video editing system. IEEE Transactions on Circuits and Systems for Video Technology. v14 i5.
[2]
Mei, Tao, Hua, Xiang-Sheng, Zhu, Cai-Zhi, Zhou, He-Qin and Li, Shipeng, Home video visual quality assessment With spatiotemporal factors. IEEE Transactions on Circuits and Systems for Video Technology. v17 i6.
[3]
Ekin, A., Tekalp, A.M. and Mehrotra, R., Automatic soccer video analysis and summarization. IEEE Transactions on Image Processing. v12 i7.
[4]
Chien-Lin Huang, Chia-Hsin Hsieh, Chung-Hsien Wu, Audio-video summarization of TV news using speech recognition and shot change detection, in: Proceedings of the 9th European Conference on Speech Communication and Technology, International Speech and Communication Association, 2005.
[5]
G. Evangelopoulos, K. Rapantzikos, A. Potamianos, P. Maragos, A. Zlatintsi, Y. Avrithis, Movie summarization based on audiovisual saliency detection, in: Proceedings of the 15th IEEE International Conference on Image Processing, 2008.
[6]
R. Lienhart, Abstracting home video automatically, in: Proceedings of the 7th ACM International Conference on Multimedia (Part 2), 1999.
[7]
M. Zhao, J. Bu, C. Chen, Audio and video combined for home video abstraction. Acoustics, Speech, and Signal Processing, in: Proceedings of the IEEE International Conference (ICASSP '03), 2003.
[8]
Jokela, T., Karukka, M. and Mäkelä, K., Mobile Video Editor: Design and Evaluation. Human-Computer Interaction, Interaction Platforms and Techniques Science. 2007. Springer, Berlin/Heidelberg.
[9]
OpenCV documentation of optical flow algorithms. (accessed 9.4.09) {http://opencv.willowgarage.com/wiki/CvReference#OpticalFlow}, OpenCV Wiki.
[10]
N. Adami, S. Benini, R. Leonardi, An overview of video shot clustering and summarization techniques for mobile applications, in: Proceedings of the 2nd International Conference on Mobile Multimedia Communications, 2006
[11]
Dey, A.K., Understanding and Using Context. Personal and Ubiquitous Computing. v5 i1.
[12]
A.K. Dey, G.D. Abowd, Towards a better understanding of context and context-awareness, in: Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing, Springer-Verlag, 1999.
[13]
M. Davis, S. King, N. Good, S. Sarvas, From context to content: leveraging context to infer media metadata, in: Proceedings of the 12th Annual ACM International Conference on Multimedia, 2004.
[14]
Goodman, R.M. and McGrath, P., Editing Digital Video: The Complete Creative and Technical Guide. 2002. 1 edition. McGraw-Hill, Inc.
[15]
Truong, B.T. and Venkatesh, S., Video abstraction: a systematic review and classification. ACM Transaction on Multimedia Computing, Communications, and Applications. v3 i1.
[16]
S. Järvinen, J. Peltola, J. Plomp, O. Ojutkangas, I. Heino, J. Lahti, J. Heinilä, Deploying mobile multimedia services for everyday experience sharing, in: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2009), 2009.
[17]
Davis, M., Editing out video editing. IEEE Transactions on Multimedia. v10 i2.
[18]
P. Pietarila, U. Westermann, S. Jarvinen, J. Korva, J. Lahti, H. Lothman, CANDELA-storage, analysis, and retrieval of video content in distributed systems, in: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2005), 2005, pp. 1557-1560.
[19]
S. Järvinen, J. Peltola, J. Lahti, A. Sachinopoulou, Multimedia service creation platform for mobile experience sharing, in: Proceedings of the 8th International Conference on Mobile and Ubiquitous Multimedia (MUM '09), 2009.
[20]
Apple iMovie video editing software, {http://www.apple.com/ilife/imovie/} (accessed 09.02.2009)
[21]
Pinnacle Studio video editing software, {http://www.pinnaclesys.com/PublicSite/us/Products/Consumer+Products/Home+Video/Studio+Family/} (accessed 09.02.2009)
[22]
Wikipedia article about Kino video editing software for Linux, {http://en.wikipedia.org/wiki/Kino_(software)} (accessed 09.02.2009)
[23]
Wikipedia article about Windows Movie Maker, {http://en.wikipedia.org/wiki/Windows_Movie_Maker} (accessed 09.02.2009)
- Location based abstraction of user generated mobile videos
Recommendations
Video summarization based on user log enhanced link analysis
MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on MultimediaEfficient video data management calls for intelligent video summarization tools that automatically generate concise video summaries for fast skimming and browsing. Traditional video summarization techniques are based on low-level feature analysis, which ...
A user attention model for video summarization
MULTIMEDIA '02: Proceedings of the tenth ACM international conference on MultimediaAutomatic generation of video summarization is one of the key techniques in video management and browsing. In this paper, we present a generic framework of video summarization based on the modeling of viewer's attention. Without fully semantic ...
What do you wish to see? A summarization system for movies based on user preferences
A novel personalized semantic movie summarization approach is proposed.User's subjective preferences are exploited for personalized movie summarization.An extensive user study demonstrates the advantages of the proposed system.A subjective study shows ...
Comments
Information & Contributors
Information
Published In
Copyright © © 2012.
Publisher
Elsevier Science Inc.
United States
Publication History
Published: 01 September 2012
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025