discussion

VERL: An Ontology Framework for Representing and Annotating Video Events

Authors:

Alexandre R. J. Francois,

Ram Nevatia,

Jerry Hobbs,

Robert C. BollesAuthors Info & Claims

IEEE MultiMedia, Volume 12, Issue 4

Pages 76 - 86

https://doi.org/10.1109/MMUL.2005.87

Published: 01 October 2005 Publication History

Publisher Site

Abstract

The notion of "events" is extremely important in characterizing the contents of video. An event is typically triggered by some kind of change of state captured in the video, such as when an object starts moving.The ability to reason with events is a critical step toward video understanding.This article describes the findings of a recent workshop series that has produced an ontology framework for representing video events called Video Event Representation Language (VERL and a companion annotation framework, called Video Event Markup Language (VEML).One of the key concepts in this work is the modeling of events as composable, whereby complex events are constructed from simpler events by operations such as sequencing, iteration, and alternation.The article presents an extensible event and object ontology expressed in VERL and discusses a detailed example of applying VERL and VEML to the description of a "tailgating" event in surveillance video.

References

[1]

S. Bechhofer et al., OWL Web Ontology Language Reference, Feb. 2004,

Google Scholar

[2]

S. Narayanan, KARMA: Knowledge-Based Action Representations for Metaphor and Aspect, PhD dissertation, Univ. of California, Berkeley, 1997.

Google Scholar

[3]

B. Bolles and R. Nevatia, ARDA Event Taxonomy Challenge Project Final Report, Feb. 2004;

Google Scholar

[4]

B. Bolles and R. Nevatia, A Hierarchical Video Event Ontology in OWL, ARDA Challenge Workshop Report, 2004;

Google Scholar

[5]

R. Nevatia, J. Hobbs, and B. Bolles, "An Ontology for Video Event Representation," Proc. IEEE Workshop on Event Detection and Recognition, IEEE Press, June 2004.

Google Scholar

[6]

J.F. Allen and G. Ferguson, "Actions and Events in Interval Temporal Logic," Spatial and Temporal Reasoning, O. Stock, ed., Kluwer Academic Publishers, 1997, pp. 205-245.

Google Scholar

[7]

IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, Aug. 2000, pp. 852-872.

Digital Library

Google Scholar

[8]

R. Nevatia, T. Zhao, and S. Hongeng, "Hierarchical Language-Based Representation of Events in Video Streams," Proc. Workshop Event Mining (in conjunction with IEEE Int'l Conf. Computer Vision and Pattern Recognition {CVPR}), IEEE CS Press, 2003, p. 39.

Google Scholar

[9]

T. Vu, F. Brémond, and M. Thonnat, "Automatic Video Interpretation: A Novel Algorithm for Temporal Scenario Recognition," Proc. 18th Int'l Joint Conf. Artificial Intelligence, Springer, 2003, pp. 523-533.

Google Scholar

[10]

IEEE Intelligent Systems, vol. 16, no. 2, 2001, pp. 60-71.

Digital Library

Google Scholar

[11]

J.M. Martinez ed. MPEG-7 Overview, ISO/IEC report no. JTC1/SC29/WG11N5525, Int'l Organization for Standardization, Mar. 2003,

Google Scholar

Cited By

View all

Khan IAhmad KGul NKhan TAhmad NAl-Fuqaha A(2023)Explainable event recognitionMultimedia Tools and Applications10.1007/s11042-023-14832-082:26(40531-40557)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1007/s11042-023-14832-0
Karbalaie AAbtahi FSjöström M(2022)Event detection in surveillance videos: a reviewMultimedia Tools and Applications10.1007/s11042-021-11864-281:24(35463-35501)Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1007/s11042-021-11864-2
Gil JSantini S(2022)Matching Regular Expressions on uncertain dataAlgorithmica10.1007/s00453-021-00906-884:2(532-564)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s00453-021-00906-8
Show More Cited By

Index Terms

VERL: An Ontology Framework for Representing and Annotating Video Events
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
2. Software and its engineering
  1. Software notations and tools
    1. General programming languages
      1. Language features
        Frameworks

Recommendations

Human action recognition using weighted pooling

Pooling strategies, such as max pooling and sum pooling, have been widely used to obtain the global representations for action videos. However, these pooling strategies have several disadvantages. First, they are easily affected by unwanted background ...
Tubelets: Unsupervised Action Proposals from Spatiotemporal Super-Voxels

This paper considers the problem of localizing actions in videos as sequences of bounding boxes. The objective is to generate action proposals that are likely to include the action of interest, ideally achieving high recall with few proposals. Our ...
Video representation learning for temporal action detection using global-local attention
Highlights
- We design two representations with different properties for action classification and localization, respectively.
Abstract
Video representation is of significant importance for temporal action detection. The two sub-tasks of temporal action detection, i.e., action classification and action localization, have different requirements for video representation. ...

Comments

Information & Contributors

Information

Published In

IEEE MultiMedia Volume 12, Issue 4

October 2005

96 pages

ISSN:1070-986X

Issue’s Table of Contents

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 October 2005

Author Tags

Qualifiers

Discussion

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Khan IAhmad KGul NKhan TAhmad NAl-Fuqaha A(2023)Explainable event recognitionMultimedia Tools and Applications10.1007/s11042-023-14832-082:26(40531-40557)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1007/s11042-023-14832-0
Karbalaie AAbtahi FSjöström M(2022)Event detection in surveillance videos: a reviewMultimedia Tools and Applications10.1007/s11042-021-11864-281:24(35463-35501)Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1007/s11042-021-11864-2
Gil JSantini S(2022)Matching Regular Expressions on uncertain dataAlgorithmica10.1007/s00453-021-00906-884:2(532-564)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s00453-021-00906-8
Patel AMerlino GBruneo DPuliafito AVyas OOjha M(2021)Video representation and suspicious event detection using semantic technologiesSemantic Web10.3233/SW-20039312:3(467-491)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.3233/SW-200393
Damiano RLombardo VPizzo A(2019)The ontology of dramaApplied Ontology10.3233/AO-19020414:1(79-118)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.3233/AO-190204
Ahmad KConci N(2019)How Deep Features Have Improved Event Recognition in MultimediaACM Transactions on Multimedia Computing, Communications, and Applications10.1145/330624015:2(1-27)Online publication date: 5-Jun-2019
https://dl.acm.org/doi/10.1145/3306240
Lombardo VDamiano RPizzo A(2018)Drammar: A Comprehensive Ontological Resource on DramaThe Semantic Web – ISWC 201810.1007/978-3-030-00668-6_7(103-118)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.1007/978-3-030-00668-6_7
Greco LRitrovato PVento MAkerkar RCuzzocrea ACao JHacid M(2017)Advanced video analyticsProceedings of the 7th International Conference on Web Intelligence, Mining and Semantics10.1145/3102254.3102276(1-6)Online publication date: 19-Jun-2017
https://dl.acm.org/doi/10.1145/3102254.3102276
Lombardo VPizzo ADamiano R(2016)Safeguarding and Accessing Drama as Intangible Cultural HeritageJournal on Computing and Cultural Heritage 10.1145/28128149:1(1-26)Online publication date: 20-Feb-2016
https://dl.acm.org/doi/10.1145/2812814
Tzelepis CMa ZMezaris VIonescu BKompatsiaris IBoato GSebe NYan S(2016)Event-based media processing and analysisImage and Vision Computing10.1016/j.imavis.2016.05.00553:C(3-19)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.imavis.2016.05.005
Show More Cited By

Abstract

References

Cited By

Index Terms

Recommendations

Human action recognition using weighted pooling

Tubelets: Unsupervised Action Proposals from Spatiotemporal Super-Voxels

Video representation learning for temporal action detection using global-local attention

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations