Article

Block-level link analysis

Authors:

Wei-Ying MaAuthors Info & Claims

SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 440 - 447

https://doi.org/10.1145/1008992.1009068

Published: 25 July 2004 Publication History

Abstract

Link Analysis has shown great potential in improving the performance of web search. PageRank and HITS are two of the most popular algorithms. Most of the existing link analysis algorithms treat a web page as a single node in the web graph. However, in most cases, a web page contains multiple semantics and hence the web page might not be considered as the atomic node. In this paper, the web page is partitioned into blocks using the vision-based page segmentation algorithm. By extracting the page-to-block, block-to-page relationships from link structure and page layout analysis, we can construct a semantic graph over the WWW such that each node exactly represents a single semantic topic. This graph can better describe the semantic structure of the web. Based on block-level link analysis, we proposed two new algorithms, Block Level PageRank and Block Level HITS, whose performances we study extensively using web data.

References

[1]

B. Amento, L. Terveen, and W. Hill. Does "authority" mean quality? predicting expert quality ratings of web documents. In Proc. ACM SIGIR 2000, pages 296--303.

Digital Library

[2]

K. Bharat and M. R. Henzinger. Improved algorithms for topic distillation in a hyperlinked environment. In Proceedings of the ACM-SIGIR, 1998.

Digital Library

[3]

S. Brin and L. Page, "The anatomy of a large-scale hypertextual Web search engine", In The Seventh International World Wide Web Conference, 1998.

Digital Library

[4]

D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma, Extracting content structure for web pages based on visual representation, Proc.5th Asia Pacific Web Conference, Xi'an China, 2003.

Digital Library

[5]

D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma, VIPS: a vision-based page segmentation algorithm, Microsoft Technical Report, MSR-TR-2003-79, 2003.

[6]

S. Chakrabarti, B. Dom, D. Gibson, J. Kleinberg, P. Raghavan, and S. Rajagopalan. Automatic resource list compilation by analyzing hyperlink structure and associated text. In Proc. of the 7th Int. World Wide Web Conference, May 1998.

Digital Library

[7]

S. Chakrabarti, Integrating the Document Object Model with hyperlinks for enhanced topic distillation and information extraction, In the 10th International World Wide Web Conference, 2001.

Digital Library

[8]

S. Chakrabarti, M. Joshi, and V. Tawde, Enhanced topic distillation using text, markup tags, and hyperlinks, In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, ACM Press, 2001, pp. 208--216.

Digital Library

[9]

Brian D. Davison. Recognizing nepotistic links on the Web. In Artificial Intelligence for Web Search, pages 23--28. AAAI Press, July 2000.

[10]

N. E. Efthimiadis, Query Expansion, In Annual Review of Information Systems and Technology, Vol. 31, 1996, pp. 121--187.

[11]

G. Flake, S. Lawrence, L. Giles, and F. Coetzee, Self-organization and identification of web communities, IEEE Computer, pp. 66--71, 2002.

Digital Library

[12]

D. Gibson, J. Kleinberg, and P. Raghavan. Inferring web communities from link topology. In Proceedings of the 9th ACM Conference on Hypertext and Hypermedia (HYPER-98), pages 225--234, New York, June 20--24 1998. ACM Press.

Digital Library

[13]

T.H. Haveliwala. Topic-sensitive pagerank. In Proc. of the 11th Int. World Wide Web Conference, May 2002.

Digital Library

[14]

N. Jushmerick. Learning to remove Intemet advertisements. Proc. of 3rd International Conf. On Autonomous Agents, 1999.

Digital Library

[15]

H. Kao, S. Lin, J. Ho and M. Chen, Entropy-Based Link Analysis for Mining Web Informative Structures. CIKM'02, 2002.

Digital Library

[16]

J. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM, Vol. 46, No. 5, pp. 604--622, 1999.

Digital Library

[17]

R. Lempel and S. Moran, The stochastic approach for link-structure analysis (SALSA) and the TKC effect, Proc. 9th International World Wide Web Conference, 2000.

Digital Library

[18]

Joel C. Miller, Gregory Rae, Fred Schaefer. Modifications of Kleinberg's HITS algorithms Using Matrix Exponentiation and Web Log Records, in: Proc. of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2001.

Digital Library

[19]

L. Page, S. Brin, R. Motwani, and T. Winograd, The PageRank citation ranking: Bringing order to the web, Technical report, Stanford University, Stanford, CA, 1998.

[20]

S. E. Robertson, Overview of the okapi projects, Journal of Documentation, Vol. 53, No. 1, 1997, pp. 3--7.

[21]

R. Song, H. Liu, J. R. Wen, W. Y. Ma, "Learning Block Importance Models for Web Pages," Proc. 13th World Wide Web Conference, New York, 2004.

Digital Library

[22]

V. Vapnik, The nature of statistical learning theory, Springer, New York, 1995.

Digital Library

[23]

J. R. Wen, R. Song, D. Cai, K. Zhu, S. Yu, S. Ye, and W.-Y. Ma, Microsoft Research Asia at the web track of TREC 2003, in the twelfth Text Retrieval Conference (TREC 2003), 2003.

[24]

S. Yu, D. Cai, J.-R. Wen, and W.-Y. Ma, Improving pseudo-relevance feedback in web information retrieval using web page segmentation, Proc. 12th World Wide Web Conference, Budapest, Hungary, 2003.

Digital Library

Cited By

Ren BQian ZSun YGao CZhang C(2024)WebSAM-Adapter: Adapting Segment Anything Model for Web Page SegmentationAdvances in Information Retrieval10.1007/978-3-031-56027-9_27(439-454)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56027-9_27
Naghibi MAnvari RForghani AMinaei B(2022)Online learning agents for cost-sensitive topical data acquisition from the webIntelligent Data Analysis10.3233/IDA-20510726:3(695-722)Online publication date: 18-Apr-2022
https://doi.org/10.3233/IDA-205107
Tekli J(2022)An overview of cluster-based image search result organization: background, techniques, and ongoing challengesKnowledge and Information Systems10.1007/s10115-021-01650-9Online publication date: 11-Feb-2022
https://doi.org/10.1007/s10115-021-01650-9
Show More Cited By

Index Terms

Block-level link analysis

Recommendations

Exploiting the hierarchical structure for link analysis
SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

Link analysis algorithms have been extensively used in Web information retrieval. However, current link analysis algorithms generally work on a flat link graph, ignoring the hierarchal structure of the Web graph. They often suffer from two problems: the ...
Link analysis ranking: algorithms, theory, and experiments

The explosive growth and the widespread accessibility of the Web has led to a surge of research activity in the area of information retrieval on the World Wide Web. The seminal papers of Kleinberg [1998, 1999] and Brin and Page [1998] introduced Link ...
Block-based web search
SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval

Multiple-topic and varying-length of web pages are two negative factors significantly affecting the performance of web search. In this paper, we explore the use of page segmentation algorithms to partition web pages into blocks and investigate how to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval

July 2004

624 pages

ISBN:1581138814

DOI:10.1145/1008992

General Chair:
Mark Sanderson
University of Sheffield (UK)
,
Program Chairs:
Kalervo Järvelin
University of Tampere (Finland)
,
James Allan
University of Massachusetts (USA)
,
Peter Bruza
Distributed Systems Technology Centre (Australia)

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR04

Sponsor:

SIGIR04: The 27th ACM/SIGIR International Symposium on Information Retrieval 2004

July 25 - 29, 2004

Sheffield, United Kingdom

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

109
Total Citations
View Citations
1,520
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ren BQian ZSun YGao CZhang C(2024)WebSAM-Adapter: Adapting Segment Anything Model for Web Page SegmentationAdvances in Information Retrieval10.1007/978-3-031-56027-9_27(439-454)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56027-9_27
Naghibi MAnvari RForghani AMinaei B(2022)Online learning agents for cost-sensitive topical data acquisition from the webIntelligent Data Analysis10.3233/IDA-20510726:3(695-722)Online publication date: 18-Apr-2022
https://doi.org/10.3233/IDA-205107
Tekli J(2022)An overview of cluster-based image search result organization: background, techniques, and ongoing challengesKnowledge and Information Systems10.1007/s10115-021-01650-9Online publication date: 11-Feb-2022
https://doi.org/10.1007/s10115-021-01650-9
McBreen BSilson JBedford DMcBreen BSilson JBedford D(2021)Analysis CapabilityOrganizational Intelligence and Knowledge Analytics10.1108/978-1-80262-177-820211006(87-97)Online publication date: 29-Nov-2021
https://doi.org/10.1108/978-1-80262-177-820211006
Ali FKhusro S(2021)Content and link-structure perspective of ranking webpagesComputer Science Review10.1016/j.cosrev.2021.10039740:COnline publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.cosrev.2021.100397
Kayed MDakrory SAli A(2021)Postal address extraction from the web: a comprehensive surveyArtificial Intelligence Review10.1007/s10462-021-09983-1Online publication date: 14-Mar-2021
https://doi.org/10.1007/s10462-021-09983-1
(2019)Research on link blocks recognition of web pagesInternational Journal of High Performance Computing and Networking10.5555/3337645.333765313:3(331-339)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.5555/3337645.3337653
Gombolay MJensen RStigile JGolen TShah NSon SShah J(2019)Human-machine collaborative optimization via apprenticeship schedulingJournal of Artificial Intelligence Research10.1613/jair.1.1123363:1(1-49)Online publication date: 17-Apr-2019
https://dl.acm.org/doi/10.1613/jair.1.11233
Kravchenko A(2019)Large-scale holistic approach to Web block classificationWorld Wide Web10.1007/s11280-018-0634-622:5(1999-2015)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1007/s11280-018-0634-6
Sarode RSachdeva SChu WBhalla S(2019)Segment-Search vs Knowledge Graphs: Making a Key-Word Search Engine for Web DocumentsBig Data Analytics10.1007/978-3-030-37188-3_6(88-107)Online publication date: 12-Dec-2019
https://doi.org/10.1007/978-3-030-37188-3_6
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten