research-article

Free access

Automatic Hierarchical Table of Contents Generation for Educational Videos

Authors:

Debabrata Mahapatra,

Ragunathan Mariappan,

Vaibhav RajanAuthors Info & Claims

WWW '18: Companion Proceedings of the The Web Conference 2018

Pages 267 - 274

https://doi.org/10.1145/3184558.3186336

Published: 23 April 2018 Publication History

All formats PDF

Abstract

The number of freely available online educational videos from universities and other organizations is growing rapidly. Accurate indexing and summarization are essential for efficient search, recommendation and effective consumption of videos. In this paper, we describe a new method of automatically creating a hierarchical table of contents for a video. It provides a summary of the video content along with a textbook--like facility for nonlinear navigation and search through the video. Our multimodal approach combines new methods for shot level video segmentation and for hierarchical summarization. Empirical results demonstrate the efficacy of our approach on many educational videos.

References

[1]

John Adcock, Matthew Cooper, Laurent Denoue, Hamed Pirsiavash, and Lawrence A Rowe. 2010. Talkminer: a lecture webcast search engine. In Proceedings of the 18th ACM international conference on Multimedia. ACM, 241--250.

Digital Library

[2]

Ghada Alharbi and Thomas Hain. 2015. Using Topic Segmentation Models for the Automatic Organisation of MOOCs resources. EDM. 524--527.

[3]

Evlampios Apostolidis and Vasileios Mezaris. 2014. Fast shot segmentation combining global and local visual descriptors Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 6583--6587.

[4]

Arijit Biswas, Ankit Gandhi, and Om Deshmukh. 2015. Mmtoc: A multimodal method for table of content creation in educational videos Proceedings of the 23rd ACM international conference on Multimedia. ACM, 621--630.

Digital Library

[5]

Jaime Carbonell and Jade Goldstein. 1998. The use of MMR, diversity-based reranking for reordering documents and producing summaries. In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 335--336.

Digital Library

[6]

Dorin Comaniciu and Peter Meer. 2002. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on pattern analysis and machine intelligence Vol. 24, 5 (2002), 603--619.

Digital Library

[7]

Costas Cotsaces, Nikos Nikolaidis, and Ioannis Pitas. 2006. Video shot detection and condensed representation. a review. IEEE signal processing magazine Vol. 23, 2 (2006), 28--37.

[8]

L. Du, W. L. Buntine, and M. Johnson. 2013. Topic segmentation with a structured topic model. In HLT-NAACL. 190--200.

[9]

Jacob Eisenstein and Regina Barzilay. 2008. Bayesian unsupervised topic segmentation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 334--343.

Digital Library

[10]

Boris Epshtein, Eyal Ofek, and Yonatan Wexler. 2010. Detecting text in natural scenes with stroke width transform Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2963--2970.

[11]

Hiroya Fujisaki and Keikichi Hirose. 1984. Analysis of voice fundamental frequency contours for declarative sentences of Japanese. Journal of the Acoustical Society of Japan (E) Vol. 5, 4 (1984), 233--242.

[12]

Theodoros Giannakopoulos. 2015. pyAudioAnalysis: An Open-Source Python Library for Audio Signal Analysis. PloS one Vol. 10, 12 (2015).

[13]

Alan Hanjalic. 2002. Shot-boundary detection: Unraveled and resolved IEEE transactions on circuits and systems for video technology Vol. 12, 2 (2002), 90--105.

Digital Library

[14]

Marti A Hearst. 1997. TextTiling: Segmenting text into multi-paragraph subtopic passages. Computational linguistics Vol. 23, 1 (1997), 33--64.

Digital Library

[15]

Wei Jyh Heng and King N Ngan. 2001. An object-based shot boundary detection using edge tracing and tracking. Journal of Visual Communication and Image Representation Vol. 12, 3 (2001), 217--239.

Digital Library

[16]

Tsutomu Hirao, Yasuhisa Yoshida, Masaaki Nishino, Norihito Yasuda, and Masaaki Nagata. 2013. Single-Document Summarization as a Tree Knapsack Problem. EMNLP, Vol. Vol. 13. 1515--1520.

[17]

Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully Convolutional Networks for Semantic Segmentation The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]

Igor Malioutov and Regina Barzilay. 2006. Minimum cut model for spoken lecture segmentation. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 25--32.

Digital Library

[19]

Mehryar Mohri, Pedro Moreno, and Eugene Weinstein. 2010. Discriminative topic segmentation of text and speech Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. 533--540.

[20]

Masaaki Nishino, Norihito Yasuda, Tsutomu Hirao, Shin-ichi Minato, and Masaaki Nagata. 2015. A Dynamic Programming Algorithm for Tree Trimming-based Text Summarization. In HLT-NAACL. 462--471.

[21]

NIST. Online. Homepage of TRECVID Evaluation. (. Online). deftempurl%http://www-nlpir.nist.gov/projects/trecvid/ tempurl

[22]

Dinh Q Phung, Thi V Duong, Svetha Venkatesh, and Hung H Bui. 2005. Topic transition detection using hierarchical hidden Markov and semi-Markov models. In Proceedings of the 13th annual ACM international conference on Multimedia. ACM, 11--20.

Digital Library

[23]

Dinh Q Phung, Svetha Venkatesh, and Chitra Dorai. 2002. High level segmentation of instructional videos based on content density Proceedings of the tenth ACM international conference on Multimedia. ACM, 295--298.

Digital Library

[24]

Dinh Q Phung, Svetha Venkatesh, and Chitra Dorai. 2003. Hierarchical topical segmentation in instructional films based on cinematic expressive functions. In Proceedings of the eleventh ACM international conference on Multimedia. ACM, 287--290.

Digital Library

[25]

Liping Ren, Zhiyi Qu, Weiqin Niu, Chaoxin Niu, and Yanqiu Cao. 2010. Key frame extraction based on information entropy and edge matching rate Future Computer and Communication (ICFCC), 2010 2nd International Conference on, Vol. Vol. 3. IEEE, V3--91.

[26]

Martin Riedl and Chris Biemann. 2012. TopicTiling: a text segmentation algorithm based on LDA Proceedings of ACL 2012 Student Research Workshop. Association for Computational Linguistics, 37--42.

Digital Library

[27]

Yossi Rubner, Carlo Tomasi, and Leonidas J Guibas. 2000. The earth mover's distance as a metric for image retrieval. International journal of computer vision Vol. 40, 2 (2000), 99--121.

Digital Library

[28]

Frank Seide and Amit Agarwal. 2016. CNTK: Microsoft's Open-Source Deep-Learning Toolkit Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2135--2135.

Digital Library

[29]

Ananya SenGupta, Dalton Meitei Thounaojam, Kh Manglem Singh, and Sudipta Roy. 2015. Video shot boundary detection: A review. In Electrical, Computer and Communication Technologies (ICECCT), 2015 IEEE International Conference on. IEEE, 1--6.

[30]

Hiroya Takamura and Manabu Okumura. 2009. Text summarization model based on maximum coverage problem and its variant Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 781--789.

Digital Library

[31]

Andreas Veit, Tomas Matera, Lukas Neumann, Jiri Matas, and Serge J. Belongie. 2016. COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Images. CoRR Vol. abs/1601.07140 (2016).

[32]

Qixiang Ye and David Doermann. 2015. Text detection and recognition in imagery: A survey. IEEE transactions on pattern analysis and machine intelligence Vol. 37, 7 (2015), 1480--1500.

[33]

Jinhui Yuan, Huiyi Wang, Lan Xiao, Wujie Zheng, Jianmin Li, Fuzong Lin, and Bo Zhang. 2007. A formal study of shot boundary detection. IEEE transactions on circuits and systems for video technology Vol. 17, 2 (2007), 168--186.

Digital Library

Cited By

Yu FZhang PDing XLu TGu N(2024)BNoteHelper: A Note-based Outline Generation Tool for Structured Learning on Video-sharing PlatformsACM Transactions on the Web10.1145/363877518:2(1-30)Online publication date: 12-Mar-2024
https://dl.acm.org/doi/10.1145/3638775
Singh S DGupta AJawahar CTapaswi M(2023)Unsupervised Audio-Visual Lecture Segmentation2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00520(5221-5230)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00520
Xu CJia WWang RHe XZhao BZhang Y(2023)Semantic Navigation of PowerPoint-Based Lecture Video for AutoNote GenerationIEEE Transactions on Learning Technologies10.1109/TLT.2022.321653516:1(1-17)Online publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1109/TLT.2022.3216535
Show More Cited By

Index Terms

Automatic Hierarchical Table of Contents Generation for Educational Videos
1. Applied computing
  1. Education
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Video segmentation
      2. Computer vision tasks
        Video summarization
    2. Natural language processing
      1. Information extraction

Recommendations

Automatic Curation of Content Tables for Educational Videos
SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval

Traditional forms of education are increasingly being replaced by online forms of learning. With many degrees being awarded without the requirement of co-location, it becomes necessary to build tools to enhance online learning interfaces. Online ...
Reusing Educational Contents in M-learning
ICALT '11: Proceedings of the 2011 IEEE 11th International Conference on Advanced Learning Technologies

There are many educational contents in digital format and it would be very good if they could be reused in mobile contexts. This paper seeks to achieve this objective by providing access to educational contents packaged in SCORM (Sharable Content Object ...
LectYS: A System for Summarizing Lecture Videos on YouTube
IUI '21 Companion: Companion Proceedings of the 26th International Conference on Intelligent User Interfaces

Students leverage online resources such as online classes and YouTube is increasing. Still, there remain challenges for students to easily find the right lecture video online at the right time. Multiple video search methods have been proposed, but to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WWW '18: Companion Proceedings of the The Web Conference 2018

April 2018

2023 pages

ISBN:9781450356404

General Chairs:
Pierre-Antoine Champin
Université Claude Bernard Lyon 1, France
,
Fabien Gandon
Inria, Université Côte d'Azur, CNRS, I3S, France
,
Lionel Médini
Université Claude Bernard Lyon 1, CNRS, LIRIS, France
,
Program Chairs:
Mounia Lalmas
Spotify, UK
,
Panagiotis G. Ipeirotis
New York University, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IW3C2: International World Wide Web Conference Committee

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

International World Wide Web Conferences Steering Committee

Republic and Canton of Geneva, Switzerland

Publication History

Published: 23 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

VideoKen

Conference

WWW '18

Sponsor:

IW3C2

WWW '18: The Web Conference 2018

April 23 - 27, 2018

Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
580
Total Downloads

Downloads (Last 12 months)89
Downloads (Last 6 weeks)9

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu FZhang PDing XLu TGu N(2024)BNoteHelper: A Note-based Outline Generation Tool for Structured Learning on Video-sharing PlatformsACM Transactions on the Web10.1145/363877518:2(1-30)Online publication date: 12-Mar-2024
https://dl.acm.org/doi/10.1145/3638775
Singh S DGupta AJawahar CTapaswi M(2023)Unsupervised Audio-Visual Lecture Segmentation2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00520(5221-5230)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00520
Xu CJia WWang RHe XZhao BZhang Y(2023)Semantic Navigation of PowerPoint-Based Lecture Video for AutoNote GenerationIEEE Transactions on Learning Technologies10.1109/TLT.2022.321653516:1(1-17)Online publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1109/TLT.2022.3216535
Seng TMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Enriching Existing Educational Video Datasets to Improve Slide Classification and AnalysisProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548758(6930-6934)Online publication date: 10-Oct-2022
https://doi.org/10.1145/3503161.3548758
Mishra PDiwan CSrinivasa SSrinivasaraghavan G(2021)Automatic Title Generation for Learning Resources and Pathways with Pre-trained Transformer ModelsInternational Journal of Semantic Computing10.1142/S1793351X2140013415:04(487-510)Online publication date: 20-Dec-2021
https://doi.org/10.1142/S1793351X21400134
Horovitz SOhayon Y(2020)Boocture: Automatic Educational Videos Hierarchical Indexing with eBooks2020 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE)10.1109/TALE48869.2020.9368461(482-489)Online publication date: 8-Dec-2020
https://doi.org/10.1109/TALE48869.2020.9368461

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents