Article

A learning-based approach for fetching pages in WebVigiL

Authors:

Sharma Chakravarthy,

Anoop Sanka,

Jyoti Jacob,

Naveen PandrangiAuthors Info & Claims

SAC '04: Proceedings of the 2004 ACM symposium on Applied computing

Pages 1725 - 1731

https://doi.org/10.1145/967900.968241

Published: 14 March 2004 Publication History

Get Access

Abstract

The World Wide Web is an omni-present and an ever-expanding source of data. Data on the web is constantly increasing and changing. Many a times, users are interested in specific changes to the data on the web. Currently, in order to detect changes of interest, users have to poll the pages periodically and check for the changes of interest. WebVigiL is a general-purpose information monitoring and notification system. It handles the specification, intelligent fetch, detection, and propagation of changes as requested by a user while meeting the quality of service requirements. We use the active capability in the form of event-condition-action (ECA) rules, and a combination of push/pull paradigm for change monitoring. In this paper, we present an overview of the specification language and the run time management of sentinels. We discuss in detail the use of ECA rules for fetching and the adaptive learning algorithm used for fetching pages. We conclude with the implementation status of WebVigiL.

References

[1]

Jacob, J, A. Sachde, and S. Chakravarthy, CX-Diff: A Change Detection Algorithm for XML Content and Change Presentation Issues in WebVigiL, in the Proc. of XSDM Workshop, Chicago, 2003, pp. 273--284.

Google Scholar

[2]

Jacob, J., et al., WebVigiL: An approach to Just-In-Time Information Propagation In Large Network-Centric Environments, in Web Dynamics Book. 2003, Springer-Verlag, 2004.

Google Scholar

[3]

Changedetection, http://www.changedetection.com.

Google Scholar

[4]

Douglis, F., et al., The AT&T Internet Difference Engine: Tracking and Viewing Changes on the Web, in World Wide Web. 1998, Baltzer Science Publishers. p. 27--44.

Digital Library

Google Scholar

[5]

Bhowmick, S., et al. Detecting and Representing Relevant Web Deltas Using Web Join. in the Proc of ICDCS, 2000.

Digital Library

Google Scholar

[6]

Mind-it, http://www.netmind.com/.

Google Scholar

[7]

Liu, L., et al. Information Monitoring on the Web: A Scalable Solution. in the Int'l Journal of World Wide Web, 2002.

Digital Library

Google Scholar

[8]

Xyleme, http://www.xyleme.com/.

Google Scholar

[9]

Nguyen, B., et al. Monitoring XML Data on the Web. in the Proc. of ACM SIGMOD, 2001.

Digital Library

Google Scholar

[10]

Chakravarthy, S. and D. Mishra, Snoop: An Expressive Event Specification Language for Active Databases. Data and Knowledge Engineering, 1994. 14(10): p. 1--26.

Digital Library

Google Scholar

[11]

Anwar, E., L. Maugis, and S. Chakravarthy, A New Perspective on Rule Support for Object-Oriented Databases, in the Proc. of ACM SIGMOD, 1993, p. 99--108.

Digital Library

Google Scholar

[12]

Pandrangi, N., et al. WebVigiL: User Profile-Based Change Detection for HTML/XML Documents, in the Proc. of BNCOD, Coventry, UK, 2003, pp. 38--55.

Digital Library

Google Scholar

[13]

Deolasee, P, et al. Adaptive Push-Pull: Disseminating Dynamic Web Data. in the Proc. of WWW Conference. 2001. Hong Kong.

Digital Library

Google Scholar

Cited By

View all

Chakravarthy SSantra AKomar K(2019)Why Multilayer Networks Instead of Simple Graphs? Modeling Effectiveness and Analysis Flexibility and Efficiency!Big Data Analytics10.1007/978-3-030-37188-3_14(227-244)Online publication date: 12-Dec-2019
https://doi.org/10.1007/978-3-030-37188-3_14
Kellar MWatters CInkpen KRosson MGilmore D(2007)An exploration of web-based monitoringProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1240624.1240686(377-386)Online publication date: 29-Apr-2007
https://dl.acm.org/doi/10.1145/1240624.1240686
Kellar MWatters C(2007)An exploration of web‐based monitoring activitiesProceedings of the American Society for Information Science and Technology10.1002/meet.1450430127143:1(1-5)Online publication date: 10-Oct-2007
https://doi.org/10.1002/meet.14504301271
Show More Cited By

Recommendations

Activeweb: XML-based active rules for web view derivations and access control

In this paper, we propose an idea of using XML-based active rules for deriving Web views and for defining access control by user access behaviors. The major objective of the proposed method is to reflect author(creator)'s intention about his/her Web ...
Activeweb: XML-based active rules for web view derivations and access control
ITVE '01: Proceedings of the workshop on Information technology for virtual enterprises

In this paper, we propose an idea of using XML-based active rules for deriving Web views and for defining access control by user access behaviors. The major objective of the proposed method is to reflect author(creator)'s intention about his/her Web data ...
Temporal pre-fetching of dynamic web pages

Although caching has been shown as an efficient technique to reduce the delay in generating web pages to meet the page requests from web users, it becomes less effective if the pages are dynamic and contain dynamic contents. In this paper, instead of ...

Comments

Information & Contributors

Information

Published In

SAC '04: Proceedings of the 2004 ACM symposium on Applied computing

March 2004

1733 pages

ISBN:1581138121

DOI:10.1145/967900

Conference Chair:
Hisham M. Haddad
Kennesaw State University
,
Program Chairs:
Andrea Omicini
Università degli Studi di Bologna a Cesena
,
Roger L. Wainwright
University of Tulsa
,
Publications Chair:
Lorie M. Liebrock
New Mexico Institute of Mining and Technology

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SAC04

Sponsor:

SIGAPP

SAC04: The 2004 ACM Symposium on Applied Computing

March 14 - 17, 2004

Nicosia, Cyprus

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
237
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chakravarthy SSantra AKomar K(2019)Why Multilayer Networks Instead of Simple Graphs? Modeling Effectiveness and Analysis Flexibility and Efficiency!Big Data Analytics10.1007/978-3-030-37188-3_14(227-244)Online publication date: 12-Dec-2019
https://doi.org/10.1007/978-3-030-37188-3_14
Kellar MWatters CInkpen KRosson MGilmore D(2007)An exploration of web-based monitoringProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1240624.1240686(377-386)Online publication date: 29-Apr-2007
https://dl.acm.org/doi/10.1145/1240624.1240686
Kellar MWatters C(2007)An exploration of web‐based monitoring activitiesProceedings of the American Society for Information Science and Technology10.1002/meet.1450430127143:1(1-5)Online publication date: 10-Oct-2007
https://doi.org/10.1002/meet.14504301271
Chakravarthy SHara S(2006)Automating Change Detection and Notification of Web Pages (Invited Paper)Proceedings of the 17th International Conference on Database and Expert Systems Applications10.1109/DEXA.2006.34(465-469)Online publication date: 4-Sep-2006
https://dl.acm.org/doi/10.1109/DEXA.2006.34
Sanka AChamakura SChakravarthy S(2006)A dataflow approach to efficient change detection of HTML/XML documents in WebVigiLComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2005.10.01650:10(1547-1563)Online publication date: 14-Jul-2006
https://dl.acm.org/doi/10.1016/j.comnet.2005.10.016
Chamakura SSachde AChakravarthy SArora A(2005)WEBVIGILProceedings of the 21st International Conference on Data Engineering Workshops10.1109/ICDE.2005.306Online publication date: 5-Apr-2005
https://dl.acm.org/doi/10.1109/ICDE.2005.306
Eppili AJacob JSachde AChakravarthy S(2004)Expressive Profile Specification and Its Semantics for a Web Monitoring SystemConceptual Modeling – ER 200410.1007/978-3-540-30464-7_33(420-433)Online publication date: 2004
https://doi.org/10.1007/978-3-540-30464-7_33

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Activeweb: XML-based active rules for web view derivations and access control

Activeweb: XML-based active rules for web view derivations and access control

Temporal pre-fetching of dynamic web pages