Article

Clio grows up: from research prototype to industrial tool

Authors:

Laura M. Haas,

Mauricio A. Hernández,

Howard Ho,

Lucian Popa,

Mary RothAuthors Info & Claims

SIGMOD '05: Proceedings of the 2005 ACM SIGMOD international conference on Management of data

Pages 805 - 810

https://doi.org/10.1145/1066157.1066252

Published: 14 June 2005 Publication History

Get Access

Abstract

Clio, the IBM Research system for expressing declarative schema mappings, has progressed in the past few years from a research prototype into a technology that is behind some of IBM's mapping technology. Clio provides a declarative way of specifying schema mappings between either XML or relational schemas. Mappings are compiled into an abstract query graph representation that captures the transformation semantics of the mappings. The query graph can then be serialized into different query languages, depending on the kind of schemas and systems involved in the mapping. Clio currently produces XQuery, XSLT, SQL, and SQL/XML queries. In this paper, we revisit the architecture and algorithms behind Clio. We then discuss some implementation issues, optimizations needed for scalability, and general lessons learned in the road towards creating an industrial-strength tool.

References

[1]

P. Bernstein. Applying Model Management to Classical Meta Data Problems. In CIDR, 2003.

Google Scholar

[2]

R. Fagin, P. Kolaitis, L. Popa, and W.-C. Tan. Composing Schema Mappings: Second-Order Dependencies to the Rescue. In PODS, 2004.

Digital Library

Google Scholar

[3]

R. Fagin, P. G. Kolaitis, R. J. Miller, and L. Popa. Data Exchange: Semantics and Query Answering. In ICDT, 2003.

Digital Library

Google Scholar

[4]

M. Lenzerini. Data Integration: A Theoretical Perspective. In PODS, 2002.

Digital Library

Google Scholar

[5]

S. Melnik, P. A. Bernstein, A. Halevy, and E. Rahm. Supporting Executable Mappings in Model Management. In SIGMOD, 2005.

Digital Library

Google Scholar

[6]

R. J. Miller, L. M. Haas, and M. A. Hernández. Schema Mapping as Query Discovery. In VLDB, 2000.

Digital Library

Google Scholar

[7]

L. Popa, Y. Velegrakis, R. J. Miller, M. A. Hernández, and R. Fagin. Translating Web Data. In VLDB, 2002.

Digital Library

Google Scholar

[8]

E. Rahm and P. A. Bernstein. A Survey of Approaches to Automatic Schema Matching. The VLDB Journal, 10(4):334--350, 2001.

Digital Library

Google Scholar

[9]

N. C. Shu, B. C. Housel, R. W. Taylor, S. P. Ghosh, and V. Y. Lum. EXPRESS: A Data EXtraction, Processing, and REStructuring System. TODS, 2(2):134--174, 1977.

Digital Library

Google Scholar

Cited By

View all

Fathollahzadeh SBoehm M(2023)GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by ExampleProceedings of the ACM on Management of Data10.1145/35892651:2(1-26)Online publication date: 20-Jun-2023
https://dl.acm.org/doi/10.1145/3589265
Meyers JSpivak DWisnesky R(2022)Fast Left Kan Extensions Using the ChaseJournal of Automated Reasoning10.1007/s10817-022-09634-266:4(805-844)Online publication date: 6-Jul-2022
https://doi.org/10.1007/s10817-022-09634-2
Sambasivan NKapania SHighfill HAkrong DParitosh PAroyo LKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AIProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445518(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445518
Show More Cited By

Clio grows up: from research prototype to industrial tool
1. Information systems
  1. Data management systems

Recommendations

The Clio project: managing heterogeneity

Clio is a system for managing and facilitating the complex tasks of heterogeneous data transformation and integration. In Clio, we have collected together a powerful set of data management techniques that have proven invaluable in tackling these ...
Clio: a semi-automatic tool for schema mapping
Clio: Schema Mapping Creation and Data Exchange
Conceptual Modeling: Foundations and Applications

The Clio project provides tools that vastly simplify information integration. Information integration requires data conversions to bring data in different representations into a common form. Key contributions of Clio are the definition of non-procedural ...

Comments

Information & Contributors

Information

Published In

SIGMOD '05: Proceedings of the 2005 ACM SIGMOD international conference on Management of data

June 2005

990 pages

ISBN:1595930604

DOI:10.1145/1066157

Conference Chair:
Fatma Ozcan
IBM Almaden Research Center

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGMOD/PODS05

Sponsor:

SIGMOD/PODS05: International Conference on Management of Data and Symposium on Principles Database and Systems

June 14 - 16, 2005

Maryland, Baltimore

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

168
Total Citations
View Citations
903
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)5

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Fathollahzadeh SBoehm M(2023)GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by ExampleProceedings of the ACM on Management of Data10.1145/35892651:2(1-26)Online publication date: 20-Jun-2023
https://dl.acm.org/doi/10.1145/3589265
Meyers JSpivak DWisnesky R(2022)Fast Left Kan Extensions Using the ChaseJournal of Automated Reasoning10.1007/s10817-022-09634-266:4(805-844)Online publication date: 6-Jul-2022
https://doi.org/10.1007/s10817-022-09634-2
Sambasivan NKapania SHighfill HAkrong DParitosh PAroyo LKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AIProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445518(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445518
Atzeni PBellomarini LPapotti PTorlone R(2019)Meta-mappings for schema mapping reuseProceedings of the VLDB Endowment10.14778/3303753.330376112:5(557-569)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.14778/3303753.3303761
Alotaibi RBursztyn DDeutsch AManolescu IZampetakis SBoncz PManegold SAilamaki ADeshpande AKraska T(2019)Towards Scalable Hybrid StoresProceedings of the 2019 International Conference on Management of Data10.1145/3299869.3319895(1660-1677)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3299869.3319895
Kolaitis PVan den Bussche JArenas M(2018)Reflections on Schema Mappings, Data Exchange, and Metadata ManagementProceedings of the 37th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems10.1145/3196959.3196991(107-109)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3196959.3196991
ten Cate BKolaitis PQian KTan WVan den Bussche JArenas M(2018)Active Learning of GAV Schema MappingsProceedings of the 37th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems10.1145/3196959.3196974(355-368)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3196959.3196974
Atzeni PBellomarini LBugiotti FLeonardis M(2018)Executable schema mappings for statistical data processingDistributed and Parallel Databases10.1007/s10619-017-7212-236:2(265-300)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s10619-017-7212-2
Simitsis AVassiliadis P(2018)Extraction, Transformation, and LoadingEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_158(1432-1440)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_158
Du YShen DNie TKou YYu G(2017)Discovering context-aware conditional functional dependenciesFrontiers of Computer Science: Selected Publications from Chinese Universities10.5555/3128671.312868711:4(688-701)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.5555/3128671.3128687
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

The Clio project: managing heterogeneity

Clio: a semi-automatic tool for schema mapping

Clio: Schema Mapping Creation and Data Exchange

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations