Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/564691.564749acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
Article

Coordinating backup/recovery and data consistency between database and file systems

Published: 03 June 2002 Publication History

Abstract

Managing a combined store consisting of database data and file data in a robust and consistent manner is a challenge for database systems and content management systems. In such a hybrid system, images, videos, engineering drawings, etc. are stored as files on a file server while meta-data referencing/indexing such files is created and stored in a relational database to take advantage of efficient search. In this paper we describe solutions for two potentially problematic aspects of such a data management system: backup/recovery and data consistency. We present algorithms for performing backup and recovery of the DBMS data in a coordinated fashion with the files on the file servers. Our algorithms for coordinated backup and recovery have been implemented in the IBM DB2/DataLinks product [1]. We also propose an efficient solution to the problem of maintaining consistency between the content of a file and the associated meta-data stored in the DBMS from a reader's point of view without holding long duration locks on meta-data tables. In the model, an object is directly accessed and edited in-place through normal file system APIs using a reference obtained via an SQL Query on the database. To relate file modifications to meta-data updates, the user issues an update through the DBMS, and commits both file and meta-data updates together.

References

[1]
IBM DB2 DataLinks, http://www.ibm.com/software/data/db2/datalinks
[2]
Object Management Group. CORBA: The Common Object Request Broker: Architecture and Specifications, July 1995. Release 2.0
[3]
Blakely, J. Data Access for the Masses through OLE DB, Proc. ACM SIGMOD International Conference on Management of Data, Montreal, June 1996
[4]
Blott, S., Relly, L., Schek, H. An Open Abstract-Object Storage System, Proc. ACM SIGMOD International Conference on Management of Data, Montreal, June 1996
[5]
Oracle Corporation: Oracle Internet File System, Features Overview, Oracle Internet File System, Frequently Asked Questions: Technical Questions, Oct 2000
[6]
Carey, M., DeWitt, D., Naughton, J., Solomon, M., et al. Shoring Up Persistent Applications, Proc. ACM SIGMOD Conference, Minneapolis, MN, pp. 383-394, May 1994.
[7]
Cabrera, L.-F., Rees, R., Hineman, W. Applying Database Technology in the ADSM Mass Storage System, Proc. 21st International Conference on Very Large Data Bases, Zurich, September 1995
[8]
Narang, I., Rees R. DataLinks - Linkage of Database and FileSystems, Proc. Sixth Int Workshop on High Performance Transaction Systems, Asilomar, September 1995
[9]
Mohan, C., Narang, I. An Efficient and Flexible Method for Archiving a Data Base, Proc. ACM SIGMOD International Conference on Management of Data, Washington, D.C., May 1993. A corrected version of this paper is available as IBM Research Report RJ9733, March 1994
[10]
ISO/IEC 9075-9-2000, Information Technology --- Database Languages --- SQL --- Part 9: Management of External Data (SQL/MED).
[11]
Hsiao, H. and Narang, I., DLFM: A Transactional Resource Manager, Proc. ACM SIGMOD Conf Dallas, Texas, May 14-19, 2000.
[12]
IBM, DB2 Universal Database V7, Administration Guide: Controlling Access to Database Objects, 2000.
[13]
Narang, I., Mohan, C., Brannon, K. and Subramanian, M. Coordinated Backup and Recovery between Database Management Systems and File Systems, IBM Research Report, RJ10231, Feb 2002.
[14]
Mohan, C., Haderle, D., Lindsay, B., Pirahesh, H., Schwarz, P. ARIES: A Transaction Recovery Method Supporting Fine-Granularity Locking and Partial Rollbacks Using Write-Ahead Logging, ACM Transactions on Database Systems, Vol. 17, No. 1, March 1992.
[15]
IBM Content Manager, http://www.ibm.com/software/data/cm
[16]
Papiani, M., Weson, J., Dunlop, A. and Nicole, D., A Distributed Scientific Archive Using the Web, XML and SQL/MED, ACM SIGMOD Record, Vol 28, No. 3, September 1999.
[17]
Bhattacharya, S., Brannon, K. W., Hsiao, H. and Narang, I., Data Consistency in a Loosely Coupled Transaction Model, IBM Research Report, RJ10232, (Feb 2002). (Available from http://www.ibm.com/research/resources)
[18]
Schneier, "Applied Cryptography 2nd Edition", J. Wiley & Sons, New York, 1996.

Cited By

View all
  • (2023)A Study on the Behavior of Machine Learning Algorithms in Healthcare DatasetsHandbook of Research on Quantum Computing for Smart Environments10.4018/978-1-6684-6697-1.ch021(388-415)Online publication date: 21-Apr-2023
  • (2022)Microsoft SQL Sunucusunda Veritabanı Kurtarma TeknikleriDatabase Recovery Techniques in Microsoft SQL ServerInternational Journal of Innovative Engineering Applications10.46460/ijiea.10703256:1(158-169)Online publication date: 28-Jun-2022
  • (2022)Authentication tokens based smart backup and recovery system for modern android systems2022 International Interdisciplinary Humanitarian Conference for Sustainability (IIHC)10.1109/IIHC55949.2022.10060572(210-214)Online publication date: 18-Nov-2022
  • Show More Cited By

Index Terms

  1. Coordinating backup/recovery and data consistency between database and file systems

                    Recommendations

                    Comments

                    Information & Contributors

                    Information

                    Published In

                    cover image ACM Conferences
                    SIGMOD '02: Proceedings of the 2002 ACM SIGMOD international conference on Management of data
                    June 2002
                    654 pages
                    ISBN:1581134975
                    DOI:10.1145/564691
                    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                    Sponsors

                    Publisher

                    Association for Computing Machinery

                    New York, NY, United States

                    Publication History

                    Published: 03 June 2002

                    Permissions

                    Request permissions for this article.

                    Check for updates

                    Author Tags

                    1. DB2
                    2. content management
                    3. database backup
                    4. database recovery
                    5. datalinks

                    Qualifiers

                    • Article

                    Conference

                    SIGMOD/PODS02

                    Acceptance Rates

                    SIGMOD '02 Paper Acceptance Rate 42 of 240 submissions, 18%;
                    Overall Acceptance Rate 785 of 4,003 submissions, 20%

                    Contributors

                    Other Metrics

                    Bibliometrics & Citations

                    Bibliometrics

                    Article Metrics

                    • Downloads (Last 12 months)56
                    • Downloads (Last 6 weeks)3
                    Reflects downloads up to 12 Feb 2025

                    Other Metrics

                    Citations

                    Cited By

                    View all
                    • (2023)A Study on the Behavior of Machine Learning Algorithms in Healthcare DatasetsHandbook of Research on Quantum Computing for Smart Environments10.4018/978-1-6684-6697-1.ch021(388-415)Online publication date: 21-Apr-2023
                    • (2022)Microsoft SQL Sunucusunda Veritabanı Kurtarma TeknikleriDatabase Recovery Techniques in Microsoft SQL ServerInternational Journal of Innovative Engineering Applications10.46460/ijiea.10703256:1(158-169)Online publication date: 28-Jun-2022
                    • (2022)Authentication tokens based smart backup and recovery system for modern android systems2022 International Interdisciplinary Humanitarian Conference for Sustainability (IIHC)10.1109/IIHC55949.2022.10060572(210-214)Online publication date: 18-Nov-2022
                    • (2020)Microservice Disaster Crash Recovery: A Weak Global Referential Integrity ManagementComputational Science – ICCS 202010.1007/978-3-030-50417-5_36(482-495)Online publication date: 15-Jun-2020
                    • (2015)Design Efficient In-Database Video Storage Approach by Learning from Performance Evaluation of BLOBAlgorithms and Architectures for Parallel Processing10.1007/978-3-319-27140-8_26(372-385)Online publication date: 16-Dec-2015
                    • (2013)Concentric layout, a new scientific data layout for matrix data-set in Hadoop file systemInternational Journal of Parallel, Emergent and Distributed Systems10.1080/17445760.2012.72098228:5(407-433)Online publication date: 1-Oct-2013
                    • (2011)A Remote Patient Monitoring System for Congestive Heart FailureJournal of Medical Systems10.1007/s10916-011-9733-y35:5(1165-1179)Online publication date: 1-Oct-2011
                    • (2010)An automated vital sign monitoring system for congestive heart failure patientsProceedings of the 1st ACM International Health Informatics Symposium10.1145/1882992.1883010(108-117)Online publication date: 11-Nov-2010
                    • (2009)A Database Approach for Accelerate Video Data AccessAdvances in Web and Network Technologies, and Information Management10.1007/978-3-642-03996-6_5(45-57)Online publication date: 19-Aug-2009
                    • (2005)SVLProceedings of the 21st International Conference on Data Engineering10.1109/ICDE.2005.138(1048-1059)Online publication date: 5-Apr-2005
                    • Show More Cited By

                    View Options

                    Login options

                    View options

                    PDF

                    View or Download as a PDF file.

                    PDF

                    eReader

                    View online with eReader.

                    eReader

                    Figures

                    Tables

                    Media

                    Share

                    Share

                    Share this Publication link

                    Share on social media