research-article

Event Understanding in Endoscopic Surgery Videos

Authors:

Mario Guggenberger,

Michael Riegler,

Pål HalvorsenAuthors Info & Claims

HuEvent '14: Proceedings of the 1st ACM International Workshop on Human Centered Event Understanding from Multimedia

Pages 17 - 22

https://doi.org/10.1145/2660505.2660509

Published: 07 November 2014 Publication History

Abstract

Event detection and understanding is an important area in computer science and especially multimedia. The term event is very broad, and we want to propose a novel event based view on endoscopic surgeries. Thus, with the novel view on surgery in this paper, we want to provide a better understanding and possible way of segmentation of the whole event surgery but also the included sub-events. To achieve this sophisticated goal, we present an annotation tool in combination with a thinking aloud test with an experienced surgeon.

References

[1]

J. B. Battles, H. Kaplan, T. Van der Schaaf, and C. Shea. The attributes of medical event-reporting systems. Arch Pathol Lab Med, 122(3):132--8, 1998.

[2]

T. Blum, H. Feußner, and N. Navab. Modeling and segmentation of surgical workflow from laparoscopic video. In Medical Image Computing and Computer-Assisted Intervention--MICCAI 2010, pages 400--407. Springer, 2010.

Digital Library

[3]

T. Boren and J. Ramey. Thinking aloud: reconciling theory and practice. Professional Communication, IEEE Transactions on, 43(3):261--278, Sep 2000.

[4]

M. Broilo, G. Boato, and F. G. De Natale. Content-based synchronization for multiple photos galleries. In Image Processing (ICIP), 2012 19th IEEE International Conference on, pages 1945--1948. IEEE, 2012.

[5]

N. J. Durr, G. González, and V. Parot. 3d imaging techniques for improved colonoscopy. Expert review of medical devices, 11(2):105--107, 2014.

[6]

D. Hong, W. Tavanapong, J. Wong, J. Oh, and P. C. de Groen. 3d reconstruction of virtual colon structures from colonoscopy images. Computerized Medical Imaging and Graphics, 38(1):22--33, 2014.

[7]

G. Kim and E. P. Xing. Jointly aligning and segmenting multiple web photo streams for the inference of collective photo storylines. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 620--627. IEEE, 2013.

Digital Library

[8]

J. Kim. Events as property exemplifications. In Action theory, pages 159--177. Springer, 1976.

[9]

M. Lux and M. Riegler. Annotation of endoscopic videos on mobile devices: a bottom-up approach. In Proceedings of the 4th ACM Multimedia Systems Conference, pages 141--145. ACM, 2013.

Digital Library

[10]

B. Munzer, K. Schoeffmann, and L. Boszormenyi. Detection of circular content area in endoscopic videos. In Computer-Based Medical Systems (CBMS), 2013 IEEE 26th International Symposium on, pages 534--536. IEEE, 2013.

[11]

B. Munzer, K. Schoeffmann, and L. Boszormenyi. Relevance segmentation of laparoscopic videos. In Multimedia (ISM), 2013 IEEE International Symposium on, pages 84--91, Dec 2013.

Digital Library

[12]

G. Petkos, S. Papadopoulos, and Y. Kompatsiaris. Social event detection using multimodal clustering and integrating supervisory signals. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, page 23. ACM, 2012.

Digital Library

[13]

T. Reuter and P. Cimiano. Event-based classification of social media streams. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, page 22. ACM, 2012.

Digital Library

[14]

M. Riegler, M. Lux, V. Charvillat, A. Carlier, R. Vliegendhart, and M. Larson. Videojot: A multifunctional video annotation tool. In Proceedings of International Conference on Multimedia Retrieval, page 534. ACM, 2014.

Digital Library

[15]

M. Zeppelzauer, M. Zaharieva, and M. Del Fabro. Unsupervised clustering of social events. In MediaEval, 2013.

Cited By

Haddad ABailly GChoussy OTaouachi RAvellino I(2024)Using Live Tags for Summarizing Surgical Videos CollaborativelyExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650850(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650850
Avellino INozari SCanlorbe GJansen Y(2021)Surgical Video SummarizationProceedings of the ACM on Human-Computer Interaction10.1145/34492145:CSCW1(1-23)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449214
Leibetseder ASchoeffmann KGurrin CÞór Jónsson BKando NSchoeffmann KChen PO'Connor N(2020)surgXplore: Interactive Video Exploration for EndoscopyProceedings of the 2020 International Conference on Multimedia Retrieval10.1145/3372278.3391930(397-401)Online publication date: 8-Jun-2020
https://dl.acm.org/doi/10.1145/3372278.3391930
Show More Cited By

Index Terms

Event Understanding in Endoscopic Surgery Videos
1. Human-centered computing

Recommendations

Advanced Virtual Endoscopic Pituitary Surgery

Endoscopy has recently been introduced to endonasal transsphenoidal pituitary surgery as a minimally invasive procedure for the removal of various kinds of pituitary tumors. To reduce morbidity and mortality with this new technique, the surgeon must be ...
Sensing and manipulation problems in endoscopic surgery: Experiment, analysis, and observation

The minimally invasive nature of endoscopic surgery allows operations to be performed through small incisions, producing significantly less damage to good tissue than in conventional open surgery. Patient recovery times are thus greatly reduced. This ...
VR training system for endoscopic surgery robot: development of a system enabling 4d analysis of surgical technique training
AE-CAI'11: Proceedings of the 6th international conference on Augmented Environments for Computer-Assisted Interventions

Our research group is currently developing an endoscopic surgical robot for digestive organs. In the current study, we sought to train surgeons to manipulate the system we are developing for clinical applications. To this end, we are developing a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HuEvent '14: Proceedings of the 1st ACM International Workshop on Human Centered Event Understanding from Multimedia

November 2014

58 pages

ISBN:9781450331203

DOI:10.1145/2660505

General Chairs:
Ansgar Scherp
Leibniz Information Center for Economics and Kiel University, Kiel, Germany
,
Vasileios Mezaris
Centre for Research and Technology Hellas, Greece
,
Bogdan Ionescu
University Politehnica of Bucharest, Romania
,
Francesco De Natale
University of Trento, Italy

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Lakeside Labs GmbH
iAD center for Research-based Innovation

Conference

MM '14

Sponsor:

SIGMM

MM '14: 2014 ACM Multimedia Conference

November 7, 2014

Florida, Orlando, USA

Acceptance Rates

HuEvent '14 Paper Acceptance Rate 9 of 11 submissions, 82%;

Overall Acceptance Rate 9 of 11 submissions, 82%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
135
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Haddad ABailly GChoussy OTaouachi RAvellino I(2024)Using Live Tags for Summarizing Surgical Videos CollaborativelyExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650850(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650850
Avellino INozari SCanlorbe GJansen Y(2021)Surgical Video SummarizationProceedings of the ACM on Human-Computer Interaction10.1145/34492145:CSCW1(1-23)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449214
Leibetseder ASchoeffmann KGurrin CÞór Jónsson BKando NSchoeffmann KChen PO'Connor N(2020)surgXplore: Interactive Video Exploration for EndoscopyProceedings of the 2020 International Conference on Multimedia Retrieval10.1145/3372278.3391930(397-401)Online publication date: 8-Jun-2020
https://dl.acm.org/doi/10.1145/3372278.3391930
Chen YSun QZhong K(2018)Semi-supervised spatio-temporal CNN for recognition of surgical workflowEURASIP Journal on Image and Video Processing10.1186/s13640-018-0316-42018:1Online publication date: 25-Aug-2018
https://doi.org/10.1186/s13640-018-0316-4
Leibetseder ASchoeffmann KAizawa KLew MSatoh S(2018)Extracting and Using Medical Expert Knowledge to Advance in Video Processing for Gynecologic EndoscopyProceedings of the 2018 ACM on International Conference on Multimedia Retrieval10.1145/3206025.3206082(485-488)Online publication date: 5-Jun-2018
https://dl.acm.org/doi/10.1145/3206025.3206082
Münzer BSchoeffmann KBöszörmenyi L(2018)Content-based processing and analysis of endoscopic images and videosMultimedia Tools and Applications10.1007/s11042-016-4219-z77:1(1323-1362)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11042-016-4219-z
Leibetseder AMunzer BSchoeffmann KKeckstein J(2017)Endometriosis Annotation in Endoscopic Videos2017 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2017.69(364-365)Online publication date: Dec-2017
https://doi.org/10.1109/ISM.2017.69
Loukas C(2017)Video content analysis of surgical proceduresSurgical Endoscopy10.1007/s00464-017-5878-132:2(553-568)Online publication date: 26-Oct-2017
https://doi.org/10.1007/s00464-017-5878-1
Albisser ZRiegler MHalvorsen PZhou JGriwodz CBalasingham IGurrin COoi WFeng WLiu F(2015)Expert driven semi-supervised elucidation tool for medical endoscopic videosProceedings of the 6th ACM Multimedia Systems Conference10.1145/2713168.2713184(73-76)Online publication date: 18-Mar-2015
https://dl.acm.org/doi/10.1145/2713168.2713184
Guggenberger MHua KRui YSteinmetz RHanjalic ANatsev AZhu W(2014)Multimodal Alignment of VideosProceedings of the 22nd ACM international conference on Multimedia10.1145/2647868.2654862(667-670)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2647868.2654862

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents