Abstract
The Portable Document Format (PDF) is widely-used in the Web and searchable by search engines, but only for the text content. The goal of this work is the extraction and annotation of images in PDF-documents, to make them searchable and to perform semantic image annotation. The first step is the extraction and conversion of the images into a standard format like jpeg, and the recognition of corresponding image captions using the layout structure and geometric relationships. The second step uses linguistic-semantic analysis of the image caption text in the context of the document domain. The result on a PDF-document collection with about 3300 pages with 6500 images has a precision of 95.5% and a recall of 88.8% for the correct image captions.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Flickner, M., et al.: Query by image and video content: the QBIC system. IEEE Computer 28(9), 23–32 (1995)
Sable, C.L., Hatzivassiloglou, V.: Text-based approaches for non-topical image categorization. Int. J. Digital Libraries, 261–275 (2000)
Srihari, R.K.: Automatic Indexing and Content-Based Retrieval of Captioned Images. IEEE Computer, 49–56 (September 1995)
Kou, Z., Cohen, W.W., Wang, R., Murphy, R.F.: Extracting information from text ands images for location proteomics. In: Proceedings of the 3rd ACM SIGKDD Int. Workshop on Data Mining in Bioinformatics, Washington DC, USA, pp. 2–9 (August 2003)
Cohen, W.W., Wang, R., Murphy, R.F.: Understanding Captions in Biomedical Publications. In: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, Washington DC, USA, pp. 499–504 (August 2003)
Lovegrove, W.S., Brailsford, D.F.: Document analysis of PDF files: methods, results and implications. Electronic Publishing 8, 207–220 (1995)
Chao, H., Lin, X.: Capturing the Layout of Electronic Documents for the Reuse in Variable Data Printing. In: Proc. 7th International Conference on Document Analysis and Recognition, Seoul, Korea, pp. 940–944 (August 2005)
Rowe, N.C., Frew, B.: Automatic Caption Localization for Photographs on World Wide WebPages. Information Processing and Management 34, 95–107 (1998)
Paek, S., Sable, C.L., Hatzivassiloglou, V.: Integration of Visual and Text Based Approaches for the Content Labeling and Classification of Photographs. In: ACM SIGIR Workshop on Multimedia Indexing and Retrieval (1999)
Mao, S., Rosenfeld, A., Kanungo, T.: Document structure analysis algorithms: a literature survey. In: Proc. SPIE Electronic Imaging, vol. 5010, pp. 197–207 (January 2003)
Maderlechner, G., Suda, P., Brückner, T.: Classification of documents by form and content. Pattern Recognition Letters 18(11-13), 1225–1231 (1997)
Becker, M., Drozdzynski, W., Krieger, H.-U., Piskorski, J., Schäfer, U., Xu, F.: SProUT, Shallow Processing with Unification and Typed Feature Structures. In: Proceedings of the International Conference on NLP (ICON 2002), Mumbai, India, December 18-21 (2002)
www.google.com/help/faq_images.html (at 10.02.2006)
Mayr, P.: Das Dateiformat PDF im Web - eine statistische Erhebung. Informationswissenschaft & Praxis 53, 475–481 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maderlechner, G., Panyr, J., Suda, P. (2006). Finding Captions in PDF-Documents for Semantic Annotations of Images. In: Yeung, DY., Kwok, J.T., Fred, A., Roli, F., de Ridder, D. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2006. Lecture Notes in Computer Science, vol 4109. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11815921_46
Download citation
DOI: https://doi.org/10.1007/11815921_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37236-3
Online ISBN: 978-3-540-37241-7
eBook Packages: Computer ScienceComputer Science (R0)