research-article

Automatic Generation of Road Trip Summary Video for Reminiscence and Entertainment using Dashcam Video

Authors:

Yoshio Ishiguro,

Kazuya TakedaAuthors Info & Claims

AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 181 - 190

https://doi.org/10.1145/3409118.3475151

Published: 20 September 2021 Publication History

Abstract

Vehicle dashboard cameras are becoming an increasingly popular kind of automotive accessory. While it is easy to obtain the high-definition video data recorded by dashcams using Secure Digital memory cards, this data is rarely used except for safety purposes because it takes substantial time and effort to review or edit many hours of such recorded videos. In this paper, we propose a new usage for this data through the automatic video editing system we have developed that can create enjoyable video summaries of road trips utilizing video and other data from the vehicle. We also report the results of comparisons between automatically edited videos created by the proposed system and manually edited videos created by study participants. The prototype developed in this study and the findings from our experiments will contribute to improving the driving experience by providing entertainment for automobile users after road trips, and by memorializing their travels.

Supplementary Material

MP4 File (3409118.3475151.mp4)

Supplementary video

Download
73.10 MB

References

[1]

Kiyoharu Aizawa, Ken-Ichiro Ishijima, and Makoto Shiina. 2001. Summarizing wearable video. In Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205), Vol. 3. IEEE, 398–401. https://doi.org/10.1109/ICIP.2001.958135

[2]

Daniel Buschek, Michael Spitzer, and Florian Alt. 2015. Video-Recording Your Life: User Perception and Experiences. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 2223–2228. https://doi.org/10.1145/2702613.2732743

Digital Library

[3]

Fu-Hsiang Chan, Yu-Ting Chen, Yu Xiang, and Min Sun. 2017. Anticipating Accidents in Dashcam Videos. In Computer Vision – ACCV 2016, Shang-Hong Lai, Vincent Lepetit, Ko Nishino, and Yoichi Sato(Eds.). Springer International Publishing, Cham, 136–153. https://doi.org/10.1007/978-3-319-54190-7_9

[4]

Jaco Cronje and Andries P. Engelbrecht. 2017. Training Convolutional Neural Networks with Class Based Data Augmentation for Detecting Distracted Drivers. In Proceedings of the 9th International Conference on Computer and Automation Engineering (Sydney, Australia) (ICCAE ’17). Association for Computing Machinery, New York, NY, USA, 126–130. https://doi.org/10.1145/3057039.3057070

Digital Library

[5]

Sandra Eliza Fontes de Avila, Ana Paula Brandão Lopes, Antonio da Luz, and Arnaldo de Albuquerque Araújo. 2011. VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method. Pattern Recognition Letters 32, 1 (2011), 56–68. https://doi.org/10.1016/j.patrec.2010.08.004 Image Processing, Computer Vision and Pattern Recognition in Latin America.

Digital Library

[6]

Jim Gemmell, Gordon Bell, Roger Lueder, Steven Drucker, and Curtis Wong. 2002. MyLifeBits: Fulfilling the Memex Vision. In Proceedings of the Tenth ACM International Conference on Multimedia (Juan-les-Pins, France) (MULTIMEDIA ’02). Association for Computing Machinery, New York, NY, USA, 235–238. https://doi.org/10.1145/641007.641053

Digital Library

[7]

Yihong Gong and Xin Liu. 2000. Video summarization using singular value decomposition. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), Vol. 2. IEEE, 174–180. https://doi.org/10.1109/CVPR.2000.854772

[8]

Google. [n.d.]. Google Maps Timeline. Retrieved July 18, 2021 from https://www.google.com/maps/timeline

[9]

GoPro. 2020. HERO9 Black. Retrieved July 18, 2021 from https://gopro.com/en/us/shop/cameras

[10]

GoPro. 2021. GoPro Quik version 8.9.1. Retrieved July 18, 2021 from https://gopro.com/en/us/shop/quik-app-video-photo-editor

[11]

Jennifer Healey and Rosalind W Picard. 1998. StartleCam: a cybernetic wearable camera. In Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215). IEEE, 42–49. https://doi.org/10.1109/ISWC.1998.729528

[12]

Steve Hodges, Lyndsay Williams, Emma Berry, Shahram Izadi, James Srinivasan, Alex Butler, Gavin Smyth, Narinder Kapur, and Ken Wood. 2006. SenseCam: A Retrospective Memory Aid. In Proceedings of the 8th International Conference on Ubiquitous Computing (Orange County, CA) (UbiComp’06). Springer-Verlag, Berlin, Heidelberg, 177–193. https://doi.org/10.1007/11853565_11

Digital Library

[13]

Holoride. 2019. Holoride. Retrieved July 18, 2021 from https://www.holoride.com

[14]

Insta360. 2021. Insta360 Go 2. Retrieved July 18, 2021 from https://www.insta360.com

[15]

Yano Research Institute. 2020. <Smart City> Key Device Components for ADAS/AD 2020. Retrieved July 18, 2021 from https://www.yanoresearch.com/market_reports/C61119900

[16]

Mordor Intelligence. [n.d.]. DASHBOARD CAMERA MARKET - GROWTH, TRENDS, COVID-19 IMPACT, AND FORECASTS (2021 - 2026). Retrieved July 18, 2021 from https://www.mordorintelligence.com/industry-reports/dashboard-camera-market

[17]

Akihiro Matsuda, Tomokazu Matsui, Yuki Matsuda, Hirohiko Suwa, and Keiichi Yasumoto. 2021. A Method for Detecting Street Parking Using Dashboard Camera Videos. Sensors and Materials 33, 1 (2021), 17–34. https://doi.org/10.18494/SAM.2021.2998

[18]

Kohei Matsumura and Yasuyuki Sumi. 2014. What Are You Talking About While Driving? An Analysis of In-Car Conversations Aimed at Conversation Sharing. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seattle, WA, USA) (AutomotiveUI ’14). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/2667317.2667417

Digital Library

[19]

Chong-Wah Ngo, Yu-Fei Ma, and Hong-Jiang Zhang. 2003. Automatic video summarization by graph modeling. In Proceedings Ninth IEEE International Conference on Computer Vision, Vol. 1. IEEE, 104–109. https://doi.org/10.1109/ICCV.2003.1238320

Digital Library

[20]

Kevin N. Ochsner. 2000. Are affective events richly recollected or simply familiar? The experience and process of recognizing feelings past. Journal of Experimental Psychology: General 129, 2 (2000), 242–261. https://doi.org/10.1037//0096-3445.129.2.242

[21]

Grand View Research. 2020. Dashboard Camera Market Size, Share & Trends Analysis Report By Technology (Basic, Advanced, Smart), By Product, By Video Quality, By Application, By Distribution Channel, By Region, And Segment Forecasts, 2020 - 2027.

[22]

Samsara. [n.d.]. AI Dash Cams. Retrieved July 18, 2021 from https://www.samsara.com/products/safety/dash-cam

[23]

Abigail J. Sellen, Andrew Fogg, Mike Aitken, Steve Hodges, Carsten Rother, and Ken Wood. 2007. Do Life-Logging Technologies Support Memory for the Past? An Experimental Study Using Sensecam. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). Association for Computing Machinery, New York, NY, USA, 81–90. https://doi.org/10.1145/1240624.1240636

Digital Library

[24]

Honda Developer Studio. 2019. Honda Dream Drive. Retrieved July 18, 2021 from https://developer.hondainnovations.com

[25]

Yasuyuki Sumi, Sadanori Ito, Tetsuya Matsuguchi, Sidney Fels, Shoichiro Iwasawa, Kenji Mase, Kiyoshi Kogure, and Norihiro Hagita. 2007. Collaborative Capturing, Interpreting, and Sharing of Experiences. Personal Ubiquitous Comput. 11, 4 (April 2007), 265–271. https://doi.org/10.1007/s00779-006-0088-1

Digital Library

[26]

Yasuyuki Sumi, Ryuuki Sakamoto, Keiko Nakao, and Kenji Mase. 2002. ComicDiary: Representing Individual Experiences in a Comics Style. In Proceedings of the 4th International Conference on Ubiquitous Computing (Göteborg, Sweden) (UbiComp ’02). Springer-Verlag, Berlin, Heidelberg, 16–32. https://doi.org/10.1007/3-540-45809-3_2

[27]

Yoshiaki Takimoto, Yusuke Tanaka, Takeshi Kurashima, Shuhei Yamamoto, Maya Okawa, and Hiroyuki Toda. 2019. Predicting Traffic Accidents with Event Recorder Data. In Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Prediction of Human Mobility (Chicago, IL, USA) (PredictGIS’19). Association for Computing Machinery, New York, NY, USA, 11–14. https://doi.org/10.1145/3356995.3364535

Digital Library

[28]

Vimeo. 2021. Magisto Video Editor & Maker version 6.6.1. Retrieved July 18, 2021 from https://www.magisto.com

[29]

Roto Virpi, Law Effie, Vermeeren Arnold, and Hoonhout Jettie. 2011. UX-WhitePaper. Retrieved July 18, 2021 from http://www.allaboutux.org/files/UX-WhitePaper.pdf

Cited By

Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Franchi MDey DJu W(2024)Towards Instrumented Fingerprinting of Urban Traffic: A Novel Methodology using Distributed Mobile Point-of-View CamerasProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675740(53-62)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675740
Zheng YRen X(2022)Developing a Multimodal HMI Design Framework for Automotive Wellness in Autonomous VehiclesMultimodal Technologies and Interaction10.3390/mti60900846:9(84)Online publication date: 18-Sep-2022
https://doi.org/10.3390/mti6090084

Recommendations

Schematic storyboarding for video visualization and editing
SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

We present a method for visualizing short video clips in a single static image, using the visual language of storyboards. These schematic storyboards are composed from multiple input frames and annotated using outlines, arrows, and text describing the ...
Research on Recognition Methods of Bus Front Road Condition Based on Video
ICIG '13: Proceedings of the 2013 Seventh International Conference on Image and Graphics

Among safe driving systems of intelligent transportation, the road recognition for bus driving, Especially for front road driving condition, becomes more and more important. Moreover, improving the road recognition of public transport vehicles can ...
Schematic storyboarding for video visualization and editing

We present a method for visualizing short video clips in a single static image, using the visual language of storyboards. These schematic storyboards are composed from multiple input frames and annotated using outlines, arrows, and text describing the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 2021

306 pages

ISBN:9781450380638

DOI:10.1145/3409118

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AutomotiveUI '21

Sponsor:

SIGCHI

AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 9 - 14, 2021

Leeds, United Kingdom

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
246
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)4

Reflects downloads up to 04 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Franchi MDey DJu W(2024)Towards Instrumented Fingerprinting of Urban Traffic: A Novel Methodology using Distributed Mobile Point-of-View CamerasProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675740(53-62)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675740
Zheng YRen X(2022)Developing a Multimodal HMI Design Framework for Automotive Wellness in Autonomous VehiclesMultimodal Technologies and Interaction10.3390/mti60900846:9(84)Online publication date: 18-Sep-2022
https://doi.org/10.3390/mti6090084

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten