research-article

Text Detection, Tracking and Recognition in Video: A Comprehensive Survey

Authors:

Xu-Cheng Yin,

Ze-Yu Zuo,

Shu Tian, and

Cheng-Lin LiuAuthors Info & Claims

IEEE Transactions on Image Processing, Volume 25, Issue 6

Pages 2752 - 2773

https://doi.org/10.1109/TIP.2016.2554321

Published: 01 June 2016 Publication History

Abstract

The intelligent analysis of video data is currently in wide demand because a video is a major source of sensory data in our lives. Text is a prominent and direct source of information in video, while the recent surveys of text detection and recognition in imagery focus mainly on text extraction from scene images. Here, this paper presents a comprehensive survey of text detection, tracking, and recognition in video with three major contributions. First, a generic framework is proposed for video text extraction that uniformly describes detection, tracking, recognition, and their relations and interactions. Second, within this framework, a variety of methods, systems, and evaluation protocols of video text extraction are summarized, compared, and analyzed. Existing text tracking techniques, tracking-based detection and recognition techniques are specifically highlighted. Third, related applications, prominent challenges, and future directions for video text extraction (especially from scene videos and web videos) are also thoroughly discussed.

Cited By

View all

Li BZou DHuang YNiu XPei LYu W(2024)TextSLAM: Visual SLAM With Semantic Planar Text FeaturesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332432046:1(593-610)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TPAMI.2023.3324320
Wu WZhang YHe YZhang LLou ZZhou HBai X(2024)DSText V2Pattern Recognition10.1016/j.patcog.2023.110177149:COnline publication date: 1-May-2024
https://dl.acm.org/doi/10.1016/j.patcog.2023.110177
Yang KYi JChen AJin Z(2024)Buffer-textEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107774130:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.engappai.2023.107774
Show More Cited By

Index Terms

Text Detection, Tracking and Recognition in Video: A Comprehensive Survey
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Video segmentation
      2. Computer vision tasks
        Scene understanding

Index terms have been assigned to the content through auto-classification.

Recommendations

Adaptive appearance model tracking for still-to-video face recognition

Systems for still-to-video face recognition (FR) seek to detect the presence of target individuals based on reference facial still images or mug-shots. These systems encounter several challenges in video surveillance applications due to variations in ...
Read More
A Video-Based Facial Motion Tracking and Expression Recognition System

We proposed a facial motion tracking and expression recognition system based on video data. By a 3D deformable facial model, the online statistical model (OSM) and cylinder head model (CHM) were combined to track 3D facial motion in the framework of ...
Read More
Facial Landmark Detection and Tracking for Facial Behavior Analysis
ICMR '16: Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval

The face is the most dominant and distinct communication tool of human beings. Automatic analysis of facial behavior allows machines to understand and interpret a human's states and needs for natural interactions. This research focuses on developing ...
Read More

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Image Processing

IEEE Transactions on Image Processing Volume 25, Issue 6

June 2016

451 pages

ISSN:1057-7149

Issue’s Table of Contents

Publisher

IEEE Press

Publication History

Published: 01 June 2016

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

57
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li BZou DHuang YNiu XPei LYu W(2024)TextSLAM: Visual SLAM With Semantic Planar Text FeaturesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332432046:1(593-610)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TPAMI.2023.3324320
Wu WZhang YHe YZhang LLou ZZhou HBai X(2024)DSText V2Pattern Recognition10.1016/j.patcog.2023.110177149:COnline publication date: 1-May-2024
https://dl.acm.org/doi/10.1016/j.patcog.2023.110177
Yang KYi JChen AJin Z(2024)Buffer-textEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107774130:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.engappai.2023.107774
Wang XHe ZWang KWang YZou LWu Z(2023)A survey of text detection and recognition algorithms based on deep learning technologyNeurocomputing10.1016/j.neucom.2023.126702556:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.neucom.2023.126702
Venkat Ragavan STarun AYogeeshwar SVishwath Kumar BSofana Reka S(2023)A realtime portable and accessible aiding system for the blind – a cloud based approachMultimedia Tools and Applications10.1007/s11042-023-14419-982:13(20641-20654)Online publication date: 27-Jan-2023
https://dl.acm.org/doi/10.1007/s11042-023-14419-9
Wu WZhao YLi ZLi JShou MPal UKaratzas DBai X(2023)ICDAR 2023 Competition on Video Text Reading for Dense and Small TextDocument Analysis and Recognition - ICDAR 202310.1007/978-3-031-41679-8_23(405-419)Online publication date: 21-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-41679-8_23
Zhao MLi BWang JLi WZhou WZhang LXuyang SYu ZYu XLi GDai AZhou SKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)Towards video text visual question answeringProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602846(35549-35562)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602846
Liu WWang YQiao LWang JWei YLiu HYang XFeng W(2022)Handwritten Text Recognition of Imagery Acquisition Sheet in Tobacco Industry Using an Improved CRNN NetworkProceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition10.1145/3573942.3574075(649-656)Online publication date: 23-Sep-2022
https://dl.acm.org/doi/10.1145/3573942.3574075
Qian JMa YLin CChen L(2022)Accelerating OCR-Based Widget Localization for Test Automation of GUI ApplicationsProceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering10.1145/3551349.3556966(1-13)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3551349.3556966
Wang PLi HShen C(2022)Towards End-to-End Text Spotting in Natural ScenesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2021.309591644:10_Part_2(7266-7281)Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1109/TPAMI.2021.3095916
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Cited By

Index Terms

Recommendations

Adaptive appearance model tracking for still-to-video face recognition

A Video-Based Facial Motion Tracking and Expression Recognition System

Facial Landmark Detection and Tracking for Facial Behavior Analysis

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations