Article

A web-based resource migration protocol using WebDAV

Authors:

Steven FurnellAuthors Info & Claims

WWW '02: Proceedings of the 11th international conference on World Wide Web

Pages 263 - 271

https://doi.org/10.1145/511446.511481

Published: 07 May 2002 Publication History

Abstract

The web's hyperlinks are notoriously brittle, and break whenever a resource migrates. One solution to this problem is a transparent resource migration mechanism, which separates a resource's location from its identity, and helps provide referential integrity. However, although several such mechanisms have been designed, they have not been widely adopted, due largely to a lack of compliance with current web standards. In addition, these mechanisms must be updated manually whenever a resource migrates, limiting their effectiveness for large web sites. Recently, however, new web protocols such as WebDAV (Web Distributed Authoring and Versioning) have emerged, which extend the HTTP protocol and provide a new level of control over web resources. In this paper, we show how we have used these protocols in the design of a new Resource Migration Protocol (RMP), which enables transparent resource migration across standard web servers. The RMP works with a new resource migration mechanism we have developed called the Resource Locator Service (RLS), and is fully backwards compatible with the web's architecture, enabling all web servers and all web content to be involved in the migration process. We describe the protocol and the new RLS in full, together with a prototype implementation and demonstration applications that we have developed. The paper concludes by presenting performance data taken from the prototype that show how the RLS will scale well beyond the size of today's web.

References

[1]

Albitz, P. and Liu, C. DNS and BIND, O'Reilly & Associates, Inc., California, USA, 1997.

Digital Library

[2]

Arms, W., Daigle, L., Daniel, R., LaLiberte, D., Mealling, M., Moore, K. and Weibel, S. Uniform Resource Names - A Progress Report, D-Lib magazine, February 1996, http://www.dlib.org/dlib/february96/02arms.html

[3]

Babich, A., Davis, J., Henderson, R., Lowry, D. and Reddy, S. DAV Searching and Locating, Internet Draft, http://www.webdav.org/dasl/protocol/draft-davis-dasl-protocol-00.html, April 20, 2000.

[4]

Berners-Lee, T., Masinter, L. and McCahill, M. Uniform Resource Locators (URL), RFC 1738.

Digital Library

[5]

Clemm, G., Hopkins, A., Sedlar, E. and Whitehead, J. WebDAV Access Control Protocol, Internet Draft, June 21, 2001, http://www.ietf.org/internet-drafts/draft-ietf-webdav-acl-06.txt

[6]

Daniel, R. and Mealling, M. Resolution of Uniform Resource Identifiers using the Domain Name System, RFC 2168, June 1997.

Digital Library

[7]

Davis, H. Referential Integrity of Links in Open Hypermedia Systems, Proceedings of ACM Hypertext 1998, pp. 207--216, 1998.

Digital Library

[8]

Evans, M., Phippen, A., Mueller, G., Furnell, S., Sanders, P. and Reynolds, P. Strategies for Content Migration on the World Wide Web, Internet Research, vol. 9, no. 1, pp. 25--34, 1999.

[9]

Evans, M.P., and Furnell, S.M. The Resource Locator Service: Fixing a Flaw in the Web, Computer Networks, Vol. 37 (3-4) (2001) pp. 307--330, November 2001.

Digital Library

[10]

Fielding, R, Gettys, J., Mogul, J.C., Nielsen, H.F., Masinter, L., Leach, P. and Berners-Lee, T. HyperText Transfer Protocol - HTTP/1.1, RFC 2616, June 1999, http://www.ietf.org/rfc/rfc2616.txt

Digital Library

[11]

Franks, J., Hallam-Baker, P., Hostetler, J., Lawrence, S., Leach, P., Luotonen, A. and Stewart, L. HTTP Authentication: Basic and Digest Access Authentication, RFC 2617, June 1999, http://www.rfc-editor.org/rfc/rfc2617.txt

Digital Library

[12]

Frier, A., Karlton, P., and Kocher, P. The SSL 3.0 Protocol, Netscape Communications Corp., Nov. 18th, 1996.

[13]

Goland, Y., Whitehead, J., Faizi, A., Carter, S. and Jensen, D. HTTP Extensions for Distributed Authoring - WebDAV, RFC 2518, February 1999, ftp://ftp.isi.edu/in-notes/rfc2518.txt

Digital Library

[14]

Ingham, D., Caughey, S. and Little, M. Fixing the 'Broken-Link' Problem: The W3Objects Approach, In The Fifth International World Wide Web Conference, Paris, France, May 6--10, 1996.

Digital Library

[15]

ISO/IEC Draft Recommendation X.901: Basic Reference Model of Open Distributed Processing - Part 1: Overview and Guide to use, ISO/IEC, 30th August 1993.

[16]

Kappe, F., A Scalable Architecture for Maintaining Referential Integrity in Distributed Information Systems, J.UCS Vol. 1, No. 2, Springer, February 1995, pp. 84--104.

[17]

Lawrence, S., Pennock, D.M., Flake, G.W., Krovetz, R., Coetzee, F.M., Glover, E., Nielsen, F.A., Kruger, A. and Giles, C.L. Persistence of Web References in Scientific Research, IEEE Computer, pp. 26--31, February 2001.

Digital Library

[18]

Microsoft Corporation Cache Array Routing Protocol (CARP) and Microsoft Proxy Server 2.0, 1997, http://msdn.microsoft.com/library/backgrnd/html/carp.htm

[19]

Moats, R. URN Syntax, RFC 2141, http://www.ietf.org/rfc/rfc2141.txt

Digital Library

[20]

Nielsen, H.F. and LaLiberte, D. Editing the Web: Detecting the Lost Update Problem Using Unreserved Checkout, W3C NOTE, May 10, 1999, http://www.w3.org/1999/04/Editing/

[21]

Ross, K.W. Hash Routing for Collections of Shared Web Caches, IEEE Network, November/December (1997), pp. 37--44.

Digital Library

[22]

Shafer, K., Weibel, S., Jul, E. and Fausey, J. Introduction to Persistent Uniform Resource Locators, In Proceedings of INET96, Montreal, Canada, 24--28 June 1996.

[23]

Slein, J., Vitali, F., Whitehead, J. and Durand, D. Requirements for a Distributed Authoring and Versioning Protocol for the World Wide Web, RFC 2291, February 1998, http://www.rfc-editor.org/rfc/rfc2291.txt

Digital Library

[24]

Sollins, K. Architectural Principles of Uniform Resource Name Resolution, RFC 2276, January 1998, ftp://ftp.isi.edu/in-notes/rfc2276.txt.

Digital Library

[25]

Stein, G. Entry on WebDAV discussion forum by Greg Stein, May 2001, http://mailman.webdav.org/pipermail/neon/2001-May/000462.html

[26]

Sun, S.X. and Lannom, L. The Handle System: A Persistent Global Name Service - Overview and Syntax, Internet-draft, February 2000, http://www.ietf.org/internet-drafts/draft-sun-handle-system-04.txt

[27]

Thaler, D.G. and Ravishankar, C.V. Using Name Based Mappings to Increase Hit Rates, IEEE/ACM Transactions on Networking, 6(1), Feb. 1998.

Digital Library

[28]

Valloppillil, V. and Ross, K.W. Cache Array Routing Protocol v1.0, Internet Draft, draft-vinod-carp-v1-02.txt, February 26, 1998, http://www.cs-ipv6.lancs.ac.uk/ipv6/documents/standards/general-comms/internet-drafts/draft-vinod-carp-v1-03.txt

[29]

Whitehead, E.J. Jr. and Goland, Y.Y. WebDAV: A Network Protocol for Remote Collaborative Authoring on the Web, Proc. Sixth European Conference on Computer-Supported Cooperative Work, Sept. 12-16, 1999, Copenhagen, Denmark, pages 291--310.

Digital Library

Cited By

Wang KShen ZHuang CWu CEide DDong YQian JKanakia AChen ARogahn R(2019)A Review of Microsoft Academic Services for Science of Science StudiesFrontiers in Big Data10.3389/fdata.2019.000452Online publication date: 3-Dec-2019
https://doi.org/10.3389/fdata.2019.00045
Laux FLaiho M(2009)SQL Access Patterns for Optimistic Concurrency ControlProceedings of the 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns10.1109/ComputationWorld.2009.63(254-258)Online publication date: 15-Nov-2009
https://dl.acm.org/doi/10.1109/ComputationWorld.2009.63
Evans MFurnell S(2003)A model for monitoring and migrating Web resourcesCampus-Wide Information Systems10.1108/1065074031046776320:2(67-74)Online publication date: 1-May-2003
https://doi.org/10.1108/10650740310467763

Index Terms

A web-based resource migration protocol using WebDAV

Recommendations

The resource locator service: fixing a flaw in the web
RFC 4918: HTTP Extensions for Web Distributed Authoring and Versioning (WebDAV)
Got 404s? Crawling and Analyzing an Institution’s Web Domain
Linking Theory and Practice of Digital Libraries
Abstract
Link rot - disappearance of web resources - is detrimental to an institution’s web presence, which is commonly used to communicate, for example, research highlights and organizational news. Organizations, especially taxpayer-funded ones such as ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '02: Proceedings of the 11th international conference on World Wide Web

May 2002

754 pages

ISBN:1581134495

DOI:10.1145/511446

Conference Chairs:
David Lassner
University of Hawaii
,
Dave De Roure
University of Southampton
,
Arun Iyengar
IBM T.J. Watson Research Center

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

WWW02

Sponsor:

ACM

WWW02: Hypermedia Track of the Eleventh International World-Wide Web Conference

May 7 - 11, 2002

Hawaii, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
575
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang KShen ZHuang CWu CEide DDong YQian JKanakia AChen ARogahn R(2019)A Review of Microsoft Academic Services for Science of Science StudiesFrontiers in Big Data10.3389/fdata.2019.000452Online publication date: 3-Dec-2019
https://doi.org/10.3389/fdata.2019.00045
Laux FLaiho M(2009)SQL Access Patterns for Optimistic Concurrency ControlProceedings of the 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns10.1109/ComputationWorld.2009.63(254-258)Online publication date: 15-Nov-2009
https://dl.acm.org/doi/10.1109/ComputationWorld.2009.63
Evans MFurnell S(2003)A model for monitoring and migrating Web resourcesCampus-Wide Information Systems10.1108/1065074031046776320:2(67-74)Online publication date: 1-May-2003
https://doi.org/10.1108/10650740310467763

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents