research-article

A mathematics retrieval system for formulae in layout presentations

Authors:

Xiaozhong LiuAuthors Info & Claims

SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval

Pages 697 - 706

https://doi.org/10.1145/2600428.2609611

Published: 03 July 2014 Publication History

Abstract

The semantics of mathematical formulae depend on their spatial structure, and they usually exist in layout presentations such as PDF, LaTeX, and Presentation MathML, which challenges previous text index and retrieval methods. This paper proposes an innovative mathematics retrieval system along with the novel algorithms, which enables efficient formula index and retrieval from both webpages and PDF documents. Unlike prior studies, which require users to manually input formula markup language as query, the new system enables users to "copy" formula queries directly from PDF documents. Furthermore, by using a novel indexing and matching model, the system is aimed at searching for similar mathematical formulae based on both textual and spatial similarities. A hierarchical generalization technique is proposed to generate sub-trees from the semi-operator tree of formulae and support substructure match and fuzzy match. Experiments based on massive Wikipedia and CiteSeer repositories show that the new system along with novel algorithms, comparing with two representative mathematics retrieval systems, provides more efficient mathematical formula index and retrieval, while simplifying user query input for PDF documents.

References

[1]

A. Aula and M. Káki. Understanding expert search strategies for designing user-friendly search interfaces. In ICWI, pages 759--762, 2003.

[2]

X. Hu, L. Gao, X. Lin, Z. Tang, X. Lin, and J. B. Baker. Wikimirs: a mathematical information retrieval system for wikipedia. In The 13th ACM/IEEE-CS joint conf. on Digital libraries, pages 11--20, 2013.

Digital Library

[3]

K. Járvelin and J. Kekáláinen. Ir evaluation methods for retrieving highly relevant documents. In The 23rd Int. ACM SIGIR Conf., pages 41--48. ACM, 2000.

Digital Library

[4]

S. Kamali and F. W. Tompa. Retrieving documents with mathematical content. In The 36th Int. ACM SIGIR Conf., pages 353--362. ACM, 2013.

Digital Library

[5]

M. Kohlhase and I. Sucan. A search engine for mathematical formulae. In Artificial Intelligence and Symbolic Computation, pages 241--253. Springer, 2006. 8 http://ntcir-math.nii.ac.jp/

Digital Library

[6]

X. Lin, L. Gao, Z. Tang, J. Baker, and V. Sorge. Mathematical formula identification and performance evaluation in pdf documents. Int. J. Doc. Anal. Recogn. (IJDAR), 2013.

[7]

M. Líska, P. Sojka, and M. Ruzicka. Similarity search for mathematics: Masaryk university team at the ntcir-10 math task. In Proc. of the 10th NTCIR Conference, pages 686 -- 691, 2013.

[8]

X. Liu. Generating metadata for cyberlearning resources through information retrieval and meta-search. JASIST, 64(4):771--786, 2013.

[9]

B. Miller and A. Youssef. Technical aspects of the digital library of mathematical functions. Annals of Mathematics and Artificial Intelligence, 2003.

Digital Library

[10]

R. Miner and R. Munavalli. An approach to mathematical search through query formulation and data normalization. Towards Mechanized Mathematical Assistants, pages 342--355, 2007.

Digital Library

[11]

J. Misutka and L. Galambos. Extending full text search engine for mathematical content. Towards Digital Mathematics Library, pages 55--67, 2008.

[12]

T. T. Nguyen, K. Chang, and S. C. Hui. A math-aware search engine for math question answering system. In The 21st ACM Int. Conf. on Information and Knowledge Management, pages 724--733. ACM, 2012.

Digital Library

[13]

T. T. Nguyen, S. C. Hui, and K. Chang. A lattice-based approach for mathematical search using formal concept analysis. Expert Systems with Applications, 39(5):5820--5828, 2012.

Digital Library

[14]

T. Schellenberg, B. Yuan, and R. Zanibbi. Layout-based substitution tree indexing and retrieval for mathematical expressions. In IS & T/SPIE Electronic Imaging, volume 8297, page 82970I, 2012.

[15]

P. Sojka and M. Líska. Indexing and searching mathematics in digital libraries. Intelligent Computer Mathematics, pages 228--243, 2011.

Digital Library

[16]

R. Zanibbi and D. Blostein. Recognition and retrieval of mathematical expressions. Int. J. Doc. Anal. Recogn. (IJDAR), pages 1--27, 2012.

Digital Library

[17]

R. Zanibbi, D. Blostein, and J. R. Cordy. Recognizing mathematical expressions using tree transformation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(11):1455--1467, 2002.

Digital Library

[18]

J. Zhao, M.-Y. Kan, and Y. L. Theng. Math information retrieval: user requirements and prototype implementation. In The 8th ACM/IEEE-CS joint conf. on Digital libraries, pages 187--196. ACM, 2008

Digital Library

Cited By

Dadure PPakray PBandyopadhyay S(2024)Mathematical Information Retrieval: A ReviewACM Computing Surveys10.1145/369995357:3(1-34)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3699953
Mansouri BZanibbi ROard DDiaz FShah CSuel TCastells PJones RSakai T(2021)Learning to Rank for Mathematical Formula RetrievalProceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3404835.3462956(952-961)Online publication date: 11-Jul-2021
https://dl.acm.org/doi/10.1145/3404835.3462956
Yuan KGao LJiang ZTang Z(2021)Formula Citation Graph Based Mathematical Information RetrievalDocument Analysis and Recognition – ICDAR 202110.1007/978-3-030-86549-8_40(631-647)Online publication date: 2-Sep-2021
https://doi.org/10.1007/978-3-030-86549-8_40
Show More Cited By

Index Terms

A mathematics retrieval system for formulae in layout presentations
1. Information systems
  1. Information retrieval

Recommendations

WikiMirs: a mathematical information retrieval system for wikipedia
JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries

Mathematical formulae in structural formats such as MathML and LaTeX are becoming increasingly available. Moreover, repositories and websites, including ArXiv and Wikipedia, and growing numbers of digital libraries use these structural formats to ...
A Mathematical Information Retrieval System Based on RankBoost
JCDL '16: Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries

Mathematical Information Retrieval (MIR) systems are designed to help users to find related formulae and further understand the formulae in scientific documents. However, in existing MIR systems, nearly all the ranker models of MIR systems are based on ...
WikiMirs 3.0: A Hybrid MIR System Based on the Context, Structure and Importance of Formulae in a Document
JCDL '15: Proceedings of the 15th ACM/IEEE-CS Joint Conference on Digital Libraries

Nowadays, mathematical information is increasingly available in websites and repositories, such like ArXiv, Wikipedia and growing numbers of digital libraries. Mathematical formulae are highly structured and usually presented in layout presentations, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval

July 2014

1330 pages

ISBN:9781450322577

DOI:10.1145/2600428

General Chairs:
Shlomo Geva
Queensland University of Technology
,
Andrew Trotman
University of Dunedin
,
Program Chairs:
Peter Bruza
Queensland University of Technology
,
Charles L.A. Clarke
University of Waterloo
,
Kal Järvelin
University of Tampere

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

SIGIR '14

Sponsor:

SIGIR

SIGIR '14: The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 6 - 11, 2014

Queensland, Gold Coast, Australia

Acceptance Rates

SIGIR '14 Paper Acceptance Rate 82 of 387 submissions, 21%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
526
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Dadure PPakray PBandyopadhyay S(2024)Mathematical Information Retrieval: A ReviewACM Computing Surveys10.1145/369995357:3(1-34)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3699953
Mansouri BZanibbi ROard DDiaz FShah CSuel TCastells PJones RSakai T(2021)Learning to Rank for Mathematical Formula RetrievalProceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3404835.3462956(952-961)Online publication date: 11-Jul-2021
https://dl.acm.org/doi/10.1145/3404835.3462956
Yuan KGao LJiang ZTang Z(2021)Formula Citation Graph Based Mathematical Information RetrievalDocument Analysis and Recognition – ICDAR 202110.1007/978-3-030-86549-8_40(631-647)Online publication date: 2-Sep-2021
https://doi.org/10.1007/978-3-030-86549-8_40
Zhong WRohatgi SWu JGiles CZanibbi R(2020)Accelerating Substructure Similarity Search for Formula RetrievalAdvances in Information Retrieval10.1007/978-3-030-45439-5_47(714-727)Online publication date: 8-Apr-2020
https://doi.org/10.1007/978-3-030-45439-5_47
Mansouri BZanibbi ROard DDownie SZhu QHahn J(2019)Characterizing searches for mathematical conceptsProceedings of the 18th Joint Conference on Digital Libraries10.1109/JCDL.2019.00019(57-66)Online publication date: 2-Jun-2019
https://dl.acm.org/doi/10.1109/JCDL.2019.00019
Wu CZhou ZYe HYang JHe L(2019)Math Expression Image Retrieval via Attention-Based Framework2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI)10.1109/ICTAI.2019.00044(259-264)Online publication date: Nov-2019
https://doi.org/10.1109/ICTAI.2019.00044
Zhong WZanibbi R(2019)Structural Similarity Search for Formulas Using Leaf-Root Paths in Operator SubtreesAdvances in Information Retrieval10.1007/978-3-030-15712-8_8(116-129)Online publication date: 7-Apr-2019
https://doi.org/10.1007/978-3-030-15712-8_8
Asebriy ZRaghay SBencharef O(2018)An Assistive Technology for Braille Users to Support Mathematical Learning: A Semantic Retrieval SystemSymmetry10.3390/sym1011054710:11(547)Online publication date: 26-Oct-2018
https://doi.org/10.3390/sym10110547
Jiang ZGao LYuan KGao ZTang ZLiu XCuzzocrea AAllan JPaton NSrivastava DAgrawal RBroder AZaki MCandan SLabrinidis ASchuster AWang H(2018)Mathematics Content Understanding for Cyberlearning via Formula Evolution MapProceedings of the 27th ACM International Conference on Information and Knowledge Management10.1145/3269206.3271694(37-46)Online publication date: 17-Oct-2018
https://dl.acm.org/doi/10.1145/3269206.3271694
Suzuki TFujii AMcDonald RWorby NJatowt AMarshall CMilligan I(2017)Mathematical document categorization with structure of mathematical expressionsProceedings of the 17th ACM/IEEE Joint Conference on Digital Libraries10.5555/3200334.3200348(119-128)Online publication date: 19-Jun-2017
https://dl.acm.org/doi/10.5555/3200334.3200348
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten