Article

Free access

Indexing and retrieval of scientific literature

Authors:

Steve Lawrence,

Kurt Bollacker,

C. Lee GilesAuthors Info & Claims

CIKM '99: Proceedings of the eighth international conference on Information and knowledge management

Pages 139 - 146

https://doi.org/10.1145/319950.319970

Published: 01 November 1999 Publication History

Abstract

The web has greatly improved access to scientific literature. However, scientific articles on the web are largely disorganized, with research articles being spread across archive sites, institution sites, journal sites, and researcher homepages. No index covers all of the available literature, and the major web search engines typically do not index the content of Postscript/PDF documents at all. This paper discusses the creation of digital libraries of scientific literature on the web, including the efficient location of articles, full-text indexing of the articles, autonomous citation indexing, information extraction, display of query-sensitive summaries and citation context, hubs and authorities computation, similar document detection, user profiling, distributed error correction, graph analysis, and detection of overlapping documents. The software for the system is available at no cost for non-commercial use.

References

[1]

J.M. Barrie and D.E. Presti. The World Wide Web as an instructional tool. Science, 274:371-372, 1996.

[2]

K. Bharat and M.R. Henzinger. Improved algorithms for topic distillation in a hyperlinked environment. In SIGIR Conference on Research and Development in Information Retrieval, 1998.

Digital Library

[3]

Kurt Bollacker, Steve Lawrence, and C. Lee Giles. CiteSeer: An autonomous web agent for automatic retrieval and identification of interesting publications. In Katia P. Sycara and Michael Wooldridge, editors, Proceedings of the Second International Conference on Autonomous Agents, pages 116-123, New York, 1998. ACM Press.

Digital Library

[4]

Kurt Bollacker, Steve Lawrence, and C. Lee Giles. A system for automatic personalized tracking of scientific literature on the web. In Digital Libraries 99- The Fourth ACM Conference on Digital Libraries, pages 105-113, New York, 1999. ACM Press.

[5]

S. Brin, J. Davis, and H. Garcia-Molina. Copy detection mechanisms for digital documents. In Proceedings of the ACM SIGMOD Annual Conference, 1995.

Digital Library

[6]

S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. In Seventh International Worm Wide Web Conference, Brisbane, Australia, 1998.

Digital Library

[7]

Andrei Broder, Steve Glassman, Mark Manasse, and Geoffrey Zweig. Syntactic clustering of the web. In Sixth International World Wide Web Conference, pages 391-404, 1997.

Digital Library

[8]

Eric W. Brown, James P. Callan, and W. Bruce Croft. Fast incremental indexing for full-text information retrieval. In Proceedings of the 20th International Conference on Very Large Databases, pages 192-202, 1994.

Digital Library

[9]

Robert D. Cameron. A universal citation database as a catalyst for reform in scholarly communication. First Monday, 2(4), 1997.

[10]

Junghoo Cho, Hector Garcia-Molina, and Lawrence Page. Efficient crawling through URL ordering. In Proceedings of the Seventh World-Wide Web Conference, 1998.

Digital Library

[11]

Doug Cutting and Jan Pedersen. Optimizations for dynamic inverted index maintenance, in Proceedings of the I3th International ACM SIG1R Conference on Research and Development in Information Retrieval, pages 405---411, 1990.

Digital Library

[12]

Eugene Garfield. Citation Indexing: Its Theory and Application in Science, Technology, and Humanities. Wiley, New York, 1979.

[13]

C. Lee Giles, Kurt Bollacker, and Steve Lawrence. CiteSeer: An automatic citation indexing system. In Ian Witten, Rob Akscyn, and Frank M. Shipman III, editors, Digital Libraries 98- The Third ACM Conference on Digital Libraries, pages 89-98, Pittsburgh, PA, June 23-26 1998. ACM Press.

Digital Library

[14]

P. Ginsparg. First steps towards electronic research communication. Computers in Physics, 8:390-396, 1994.

Digital Library

[15]

S. Hitchcock, L. Carr, S. Harris, J.M.N. Hey, and W. Hall. Citation linking: Improving access to online journals. In Robert B. Allen and Edie Rasmussen, editors, Proceedings of the 2nd ACM International Conference on Digital Libraries, pages 115-122, New York, NY, 1997. ACM.

Digital Library

[16]

H. Kautz, B. Selman, and M. Shah. ReferralWeb: Combining social networks and collaborative filtering. Communications of the A CM, 30(3), 1997.

Digital Library

[17]

J. Kleinberg. Authoritative sources in a hyperlinked environment. In Proceedings ACM-SIAM Symposium on Discrete Algorithms, pages 668-677, San Francisco, California, 25-27 January 1998.

Digital Library

[18]

Steve Lawrence, Kurt Bollacker, and C. Lee Giles. Distributed error correction, in Digital Libraries 99 - The Fourth ACM Conference on Digital Libraries, page 232, New York, 1999. ACM Press.

Digital Library

[19]

Steve Lawrence and C. Lee Giles. Context and page analysis for improved web search. IEEE Internet Computing, 2(4):38-46, 1998.

Digital Library

[20]

Steve Lawrence and C. Lee Giles. Searching the World Wide Web. Science, 280(5360):98-t00, 1998.

[21]

Steve Lawrence and C. Lee Giles. Accessibility of information on the web. Nature, 400(6740):107-109, 1999.

[22]

L. Page, S. Brin, R. Motwani, and T. Winograd. The PageRank citation ranking: Bringing order to the web. 1998.

[23]

J. Rennie and A. McCallum. Using reinforcement learning to spider the web efficiently. In Proceedings of the Sixteenth International Conference on Machine Learning (ICML-99), 1999.

Digital Library

[24]

E. Selberg and O. Etzioni. Multi-service search and comparison using the MetaCrawler. In Proceedings of the 1995 World Wide Web Conference, 1995.

[25]

Kristie Seymore, Andrew McCallum, and Roni Rosen~ feld. Learning hidden Markov model structure for information extraction. In AAAI 99 Workshop on Machine Learning for Information Extraction, 1999.

[26]

N. Shivakumar and H. Garcia-Molina. SCAM: A copy detection mechanism for digital documents. In 2nd International Conference on the Theory and Practice of Digital Libraries, 1995.

[27]

Anthony Tomasic, Hector Garcia-Molina, and Kurt Shoens. Incremental updates of inverted lists for text document retrieval. In Proceedings of the 1994 A CM SIGMOD Conference, pages 289-300, 1994.

Digital Library

[28]

A. Tombros and M. Sanderson. Advantages of query biased summaries in information retrieval. In Proceedings of S1G1R 98, Melbourne, Australia, 1998.

Digital Library

[29]

Anastasios Tombros. Reflecting User Information Needs Through Query Biased Summaries. PhD thesis, Department of Computer Science, University of Glasgow, September 1997.

[30]

I.H. Witten, A. Moffat, and T.C. Bell. Managing Gigabytes: Compressing and indexing documents and images. Van Nostrand Reinhold, New York, NY, 1994.

Digital Library

[31]

I.H. Witten, C.G. Nevill-Manning, and S.J.Cunningham. Building a digital library for computer science research: technical issues. In Proceedings Australasian Computer Science Conference, Melbourne, Australia, January 1996.

[32]

I.H. Witten, C.G. Nevill-Manning, and S.J. Cunningham. Digital libraries based on fulltext retrieval. In Proceedings of WebNet 96, San Francisco, October 1996.

Cited By

Nogueira RJiang ZCho KLin J(2020)Navigation-based candidate expansion and pretrained language models for citation recommendationScientometrics10.1007/s11192-020-03718-9Online publication date: 10-Oct-2020
https://doi.org/10.1007/s11192-020-03718-9
Hassan SAljohani NShabbir MAli UIqbal SSarwar RMartínez-Cámara EVentura SHerrera F(2020)Tweet Coupling: a social media methodology for clustering scientific publicationsScientometrics10.1007/s11192-020-03499-1Online publication date: 18-May-2020
https://doi.org/10.1007/s11192-020-03499-1
Ahlheid SGräfe GKrebs ASchuster D(2020)Bewertung der Informationsqualität im Enterprise 2.0Daten- und Informationsqualität10.1007/978-3-658-30991-6_12(211-221)Online publication date: 20-Nov-2020
https://doi.org/10.1007/978-3-658-30991-6_12
Show More Cited By

Index Terms

Indexing and retrieval of scientific literature
1. Applied computing
  1. Physical sciences and engineering
2. Information systems
  1. Data management systems
    1. Database management system engines
  2. Information retrieval

Recommendations

Measuring social media activity of scientific literature: an exhaustive comparison of scopus and novel altmetrics big data

This paper measures social media activities of 15 broad scientific disciplines indexed in Scopus database using Altmetric.com data. First, the presence of Altmetric.com data in Scopus database is investigated, overall and across disciplines. Second, a ...
A citation-based approach to automatic topical indexing of scientific literature

Topical indexing of documents with keyphrases is a common method used for revealing the subject of scientific and research documents to both human readers and information retrieval tools, such as search engines. However, scientific documents that are ...
Bibliometric analysis of fracking scientific literature

This study uses bibliometric methods to analyze the scientific literature of fracking. Web of Science database, including the Science Citation Index, Sciences Citation Index and Conference Proceedings Citation Index--Science were used to collect the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '99: Proceedings of the eighth international conference on Information and knowledge management

November 1999

564 pages

ISBN:1581131461

DOI:10.1145/319950

Editor:
Susan Gauch

Copyright © 1999 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

CIKM99

Sponsor:

CIKM99: Conference on Information and Knowledge Management

November 2 - 6, 1999

Missouri, Kansas City, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

67
Total Citations
View Citations
1,443
Total Downloads

Downloads (Last 12 months)122
Downloads (Last 6 weeks)19

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nogueira RJiang ZCho KLin J(2020)Navigation-based candidate expansion and pretrained language models for citation recommendationScientometrics10.1007/s11192-020-03718-9Online publication date: 10-Oct-2020
https://doi.org/10.1007/s11192-020-03718-9
Hassan SAljohani NShabbir MAli UIqbal SSarwar RMartínez-Cámara EVentura SHerrera F(2020)Tweet Coupling: a social media methodology for clustering scientific publicationsScientometrics10.1007/s11192-020-03499-1Online publication date: 18-May-2020
https://doi.org/10.1007/s11192-020-03499-1
Ahlheid SGräfe GKrebs ASchuster D(2020)Bewertung der Informationsqualität im Enterprise 2.0Daten- und Informationsqualität10.1007/978-3-658-30991-6_12(211-221)Online publication date: 20-Nov-2020
https://doi.org/10.1007/978-3-658-30991-6_12
Nivash JBabu L(2019)Effective discovery of missing links in citation networks using citation relevancy check processInternational Journal of Business Intelligence and Data Mining10.1504/ijbidm.2019.09996014:4(473-488)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1504/ijbidm.2019.099960
Ibrahim NChaibi ABen Ghézala H(2019)Multi-view Navigation in a Personalized Scientometric Retrieval SystemEnterprise Information Systems10.1007/978-3-030-26169-6_13(262-282)Online publication date: 28-Jul-2019
https://doi.org/10.1007/978-3-030-26169-6_13
Meng YMa Y(2018)Innovation Ecosystem Analysis 1986-2017: A Citation-Based Literature SurveyAmerican Journal of Industrial and Business Management10.4236/ajibm.2018.81114908:11(2231-2255)Online publication date: 2018
https://doi.org/10.4236/ajibm.2018.811149
Arguello J(2017)Aggregated SearchFoundations and Trends in Information Retrieval10.1561/150000005210:5(365-502)Online publication date: 6-Mar-2017
https://dl.acm.org/doi/10.1561/1500000052
Zhao FSun ZJin H(2015)Topic-centric and semantic-aware retrieval system for internet of thingsInformation Fusion10.1016/j.inffus.2014.01.00123:C(33-42)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1016/j.inffus.2014.01.001
Lu QLiu GChen J(2014)Integrating PDF interface into Java applicationLibrary Hi Tech10.1108/LHT-01-2014-000932:3(495-508)Online publication date: 9-Sep-2014
https://doi.org/10.1108/LHT-01-2014-0009
Guy IUr SRonen IWeber SOral TKonstan JChi EHöök K(2012)Best faces forwardProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208310(1775-1784)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2208310
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents