article

Multiversion-based view maintenance over distributed data sources

Authors:

Songting Chen,

Bin Liu,

Elke A. RundensteinerAuthors Info & Claims

ACM Transactions on Database Systems (TODS), Volume 29, Issue 4

Pages 675 - 709

https://doi.org/10.1145/1042046.1042049

Published: 12 December 2004 Publication History

Get Access

Abstract

Materialized views can be maintained by submitting maintenance queries to the data sources. However, the query results may be erroneous due to concurrent source updates. State-of-the-art maintenance strategies typically apply compensations to resolve such conflicts and assume all source schemata remain stable over time. In a loosely coupled dynamic environment, the sources may autonomously change not only their data but also their schema or semantics. Consequently, either the maintenance or the compensation queries may be broken. Unlike compensation-based approaches found in the literature, we instead model the complete materialized view maintenance process as a view maintenance transaction (VM_Transaction). This way, the anomaly problem can be rephrased as the serializability of VM_Transactions. To achieve VM_Transaction serializability, we propose a multiversion concurrency control algorithm, called TxnWrap, which is shown to be the appropriate design for loosely coupled environments with autonomous data sources. TxnWrap is complementary to the maintenance algorithms proposed in the literature, since it removes concurrency issues from consideration allowing the designer to focus on the maintenance logic. We show several optimizations of TxnWrap, in particular, (1) space optimizations on versioned data materialization and (2) parallel maintenance scheduling. With these optimizations, TxnWrap even outperforms state-of-the-art view maintenance solutions in terms of refresh time. Further, several design choices of TxnWrap are studied each having its respective advantages for certain environmental settings. A correctness proof based on transaction theory for TxnWrap is also provided. Last, we have implemented TxnWrap. The experimental results confirm that TxnWrap achieves predictable performance under a varying rate of concurrency.

Supplementary Material

chen-appendix (p1-chen.pdf)

Online Appendix to: Multiversion-based view maintenance over distributed data sources

Download
66.94 KB

References

[1]

Agrawal, D., Abbadi, A. E., Singh, A., and Yurek, T. 1997. Efficient view maintenance at data warehouses. In Proceedings of SIGMOD. 417--427.

Crossref

Google Scholar

[2]

Agrawal, D. and Sengupta, S. 1989. Modular synchronization in multiversion databases. In Proceedings of SIGMOD. 408--417.

Crossref

Google Scholar

[3]

Bernstein, P. A., Hadzilacos, V., and Goodman, N. 1987. Concurrency Control and Recovery in Database System. Addison-Wesley, Reading, M.A.

Digital Library

Google Scholar

[4]

Chan, A. and Gray, R. 1985. Implementing distributed read-only transactions. IEEE Trans. on Softw. Eng. 11, 205--212.

Digital Library

Google Scholar

[5]

Chen, J., Chen, S., and Rundensteiner, E. A. 2002. A transactional model for data warehouse maintenance. In Proceedings of the Conference on Conceptual Modeling. 247--262.

Crossref

Google Scholar

[6]

Chen, J., Zhang, X., Chen, S., Andreas, K., and Rundensteiner, E. A. 2001. DyDa: Data warehouse maintenance under fully concurrent environments. In Proceedings of SIGMOD Demo Session. 619.

Crossref

Google Scholar

[7]

Chen, S., Chen, J., Zhang, X., and Rundensteiner, E. A. 2004. Detection and correction of conflicting source updates for view maintenace. In Proceedings of ICDE. 436--448.

Crossref

Google Scholar

[8]

Colby, L. S., Griffin, T., Libkin, L., Mumick, I. S., and Trickey, H. 1996. Algorithms for deferred view maintenance. In Proceedings of SIGMOD. 469--480.

Crossref

Google Scholar

[9]

Gray, J. and Reuter, A. 1992. Transaction Processing: Concepts and Techniques. Morgan Kaufmann, San Francisco, CA.

Digital Library

Google Scholar

[10]

Gupta, A. and Mumick, I. 1995. Maintenance of materialized views: Problems, techniques, and applications. IEEE Data Eng. Bull. 18, 2, 3--19.

Google Scholar

[11]

Gupta, A., Mumick, I., and Ross, K. 1995. Adapting materialized views after redefinition. In Proceedings of SIGMOD. 211--222.

Crossref

Google Scholar

[12]

Lee, A. M., Nica, A., and Rundensteiner, E. A. 2002. The EVE approach: View synchronization in dynamic distributed environments. IEEE Trans. Knowl. Data Eng. 14, 5, 931--954.

Digital Library

Google Scholar

[13]

Liu, B., Chen, S., and Rundensteiner, E. A. 2002a. A transactional approach to parallel data warehouse maintenance. In Proceedings of DaWaK. 307--317.

Crossref

Google Scholar

[14]

Liu, B., Chen, S., and Rundensteiner, E. A. 2002b. Batch data warehouse maintenance in dynamic environments. In Proceedings of CIKM. 68--75.

Digital Library

Google Scholar

[15]

Lomet, D. B. and Salzberg, B. 1989. Access methods for multiversion data. In Proceedings of SIGMOD. 315--324.

Crossref

Google Scholar

[16]

Lu, J. J., Moerkotte, G., Schue, J., and Subrahmanian, V. S. 1995. Efficient maintenance of materialized mediated views. In Proceedings of SIGMOD. 340--351.

Crossref

Google Scholar

[17]

Madhavan, J., Bernstein, P. A., and Rahm, E. 2001. Generic schema matching with cupid. In Proceedings of VLDB. 49--58.

Crossref

Google Scholar

[18]

Marche, S. 1993. Measuring the stability of data models. European J. Inform. Syst. 2, 1, 37--47.

Crossref

Google Scholar

[19]

Miller, R. J., Haas, L. M., and Hernández, M. A. 2000. Schema mapping as query discovery. In Proceedings of VLDB. 77--88.

Crossref

Google Scholar

[20]

Mohan, C., Pirahesh, H., and Lorie, R. 1992. Efficient and flexible methods for transient versioning of records to avoid locking by read-only transactions. In Proceedings of SIGMOD. 124--133.

Crossref

Google Scholar

[21]

Nica, A., Lee, A. J., and Rundensteiner, E. A. 1998. The CVS algorithm for view synchronization in evolvable large-scale information systems. In Proceedings of EDBT. 359--373.

Crossref

Google Scholar

[22]

Nica, A. and Rundensteiner, E. A. 1999. View maintenance after view synchronization. In Proceedings of the Conference on International Database Engineering and Applications. 213--215.

Crossref

Google Scholar

[23]

Quass, D. Gupta, A. Mumick, I. S., and Widom, J. 1996. Making view self-maintainable for data warehousing. In Proceedings of the Conference on Parallel and Distributed Information Systems. 158--169.

Crossref

Google Scholar

[24]

Quass, D. and Widom, J. 1997. On-line warehouse view maintenance. In Proceedings of SIGMOD. 393--400.

Crossref

Google Scholar

[25]

Salem, K., Beyer, K. S., Cochrane, R., and Lindsay, B. G. 2000. How to roll a join: Asynchronous incremental view maintenance. In Proceedings of SIGMOD. 129--140.

Crossref

Google Scholar

[26]

Sjoberg, D. 1993. Quantifying schema evolution. Inform. Softw. Tech. 35, 1, 35--54.

Crossref

Google Scholar

[27]

Varde, A. S. and Rundensteiner, E. A. 2002. MEDWRAP: Consistent view maintenance over distributed multi-relation sources. In Proceedings of DEXA. 341--350.

Crossref

Google Scholar

[28]

Velegrakis, Y., Miller, R. J., and Popa, L. 2003. Mapping adaptation under evolving schemas. In Proceedings of VLDB. 584--595.

Digital Library

Google Scholar

[29]

Widom, J. 1995. Research problems in data warehousing. In Proceedings of CIKM. 25--30.

Digital Library

Google Scholar

[30]

Zaniolo, C., Ceri, S., Faloursos, C., Snodgrass, R. T., Subrahmanian, V. S., and Zicari, R. 1997. Advanced Database Systems. Morgan Kaufmann, San Francisco, CA.

Digital Library

Google Scholar

[31]

Zhang, X., Ding, L., and Rundensteiner, E. A. 2004. Parallel multi-source view maintenance. VLDB J. 13, 1, 22--48.

Digital Library

Google Scholar

[32]

Zhang, X. and Rundensteiner, E. A. 2000. DyDa: Dynamic data warehouse maintenance in a fully concurrent environment. In Proceedings of DaWaK. 94--103.

Digital Library

Google Scholar

[33]

Zhuge, Y., Gracía-Molina, H., Hammer, J., and Widom, J. 1995. View maintenance in a warehousing environment. In Proceedings of SIGMOD. 316--327.

Crossref

Google Scholar

[34]

Zhuge, Y., Gracía-Molina, H., and Wiener, J. L. 1996. The strobe algorithms for multi-source warehouse consistency. In Proceedings of the Conference on Parallel and Distributed Information Systems. 146--157.

Crossref

Google Scholar

Cited By

View all

Masmoudi MBen Abdallah Ben Lamine SKarray MArchimede BBaazaoui Zghal H(2024)Semantic Data Integration and Querying: A Survey and ChallengesACM Computing Surveys10.1145/365331756:8(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653317
Sebaa A(2022)View Materialization for Query Processing in IoT SystemsInternational Journal of Technology Diffusion10.4018/IJTD.30074613:1(1-19)Online publication date: 20-May-2022
https://dl.acm.org/doi/10.4018/IJTD.300746
Sebaa ANouicer ATari A(2019)Impact of technology evolution on the materialised viewsInternational Journal of Business Information Systems10.1504/ijbis.2019.09930530:4(427-462)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1504/ijbis.2019.099305
Show More Cited By

Index Terms

Multiversion-based view maintenance over distributed data sources

Recommendations

A Compensation-Based Approach for View Maintenance in Distributed Environments

Data integration over multiple heterogeneous data sources has become increasingly important for modern applications. The integrated data is usually stored as materialized views to allow better access, performance, and high availability. In loosely ...
Optimizing Cyclic Join View Maintenance over Distributed Data Sources

Materialized views defined over distributed data sources are critical for many applications to ensure efficient access, reliable performance, and high availability. Materialized views need to be maintained upon source updates since stale view extents ...
A comprehensive study of view maintenance approaches in data warehousing evolution

A data warehouse mainly stores integrated information over data from many different remote data sources for query and analysis. The integrated information at the data warehouse is stored in the form of materialized views. Using these materialized views, ...

Reviews

Reviewer: Elizabeth A. Unger

The integration of information from many distributed databases is a challenge of this decade. Success in this endeavor will determine the ability of many organizations to continue in the future. This paper offers one approach to meeting the various challenges of current distributed data organization architectures, based on a model for the complete materialized view maintenance process, by expressing it as a view maintenance problem, and reducing the transaction serialization space. The paper is well written, provides a solution model for the problem of maintaining distributed views of a conceptual database, accounts for differences in the schemas, and describes a physical implementation in terms of its performance against conventional view maintenance algorithms. The single processor algorithm implementation is supplemented by a parallel processor solution, and formal correctness proofs are provided. The major problems of data update and schema change anomalies are shown to be solvable, by reformulating the maintenance problem of data as a virtual transaction model. Reformulated transactions are mapped from the distributed anomalies to the problem of serializability of transactions. Serializability theory provides the formal system in which view maintenance, view adaptation, and view synchronization can be solved for the materialized view maintenance problem. In essence, the concurrency problems of multiple updates for a record value are no longer a component of the problem. This enables simplification of the problem, and also of the conceptualization of it. A pivotal idea for this is the introduction of a local identifier within each data source's scope for version management, and global identifiers for the materialized view. These two types of identifiers are related, in that the global identifier is composed from a vector of the local identifiers. The authors bring an interesting new perspective to the challenge of providing users with a consistent view of the data of an enterprise, by approaching the complex view maintenance problem through the reconceptualization of the transactions into a serialized order. This may or may not be the ultimate solution for the overall problem, but approaching it with this perspective is very thought provoking. This paper is recommended to those interested in integrating distributed databases by providing a view of them. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Database Systems

ACM Transactions on Database Systems Volume 29, Issue 4

December 2004

250 pages

ISSN:0362-5915

EISSN:1557-4644

DOI:10.1145/1042046

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2004

Published in TODS Volume 29, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
1,160
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Masmoudi MBen Abdallah Ben Lamine SKarray MArchimede BBaazaoui Zghal H(2024)Semantic Data Integration and Querying: A Survey and ChallengesACM Computing Surveys10.1145/365331756:8(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653317
Sebaa A(2022)View Materialization for Query Processing in IoT SystemsInternational Journal of Technology Diffusion10.4018/IJTD.30074613:1(1-19)Online publication date: 20-May-2022
https://dl.acm.org/doi/10.4018/IJTD.300746
Sebaa ANouicer ATari A(2019)Impact of technology evolution on the materialised viewsInternational Journal of Business Information Systems10.1504/ijbis.2019.09930530:4(427-462)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1504/ijbis.2019.099305
Sebaa ATari A(2019)Materialized View Maintenance: Issues, Classification, and Open ChallengesInternational Journal of Cooperative Information Systems10.1142/S0218843019300018Online publication date: 25-Jan-2019
https://doi.org/10.1142/S0218843019300018
Faisal SSarwar MShahzad KSarwar SJaffry WYousaf M(2017)Temporal and Evolving Data Warehouse DesignScientific Programming10.1155/2017/73923492017Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1155/2017/7392349
Lu ZLiu HYan J(2015)Delta extraction in a limited collaborative environmentInternational Journal of Intelligent Information and Database Systems10.1504/IJIIDS.2015.0708289:1(54-78)Online publication date: 1-Jul-2015
https://dl.acm.org/doi/10.1504/IJIIDS.2015.070828
Lu ZYan JWang X(2015)Using grouping strategy and pattern discovery for delta extraction in a limited collaborative environmentInternational Journal of Business Intelligence and Data Mining10.1504/IJBIDM.2015.07221310:4(378-405)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1504/IJBIDM.2015.072213
Gupta AYang FGovig JKirsch AChan KLai KWu SDhoot SKumar AAgiwal ABhansali SHong MCameron JSiddiqi MJones DShute JGubarev AVenkataraman SAgrawal D(2014)MesaProceedings of the VLDB Endowment10.14778/2732977.27329997:12(1259-1270)Online publication date: 1-Aug-2014
https://dl.acm.org/doi/10.14778/2732977.2732999
Ibáñez LSkaf-Molli HMolli PCorby O(2013)Live linked dataInternational Journal of Metadata, Semantics and Ontologies10.1504/IJMSO.2013.0566058:2(119-133)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.1504/IJMSO.2013.056605
Feng HLumineau NHacid MDomps R(2013)Update Management in Decision Support SystemsTransactions on Large-Scale Data- and Knowledge-Centered Systems XII10.1007/978-3-642-45315-1_2(27-53)Online publication date: 2013
https://doi.org/10.1007/978-3-642-45315-1_2
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A Compensation-Based Approach for View Maintenance in Distributed Environments

Optimizing Cyclic Join View Maintenance over Distributed Data Sources

A comprehensive study of view maintenance approaches in data warehousing evolution

Reviews

Access critical reviews of Computing literature here

Comments

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

A Compensation-Based Approach for View Maintenance in Distributed Environments

Optimizing Cyclic Join View Maintenance over Distributed Data Sources

A comprehensive study of view maintenance approaches in data warehousing evolution

Reviews

Access critical reviews of Computing literature here

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations