research-article

Free access

GCIP: exploiting the generation and optimization of integration processes

Authors:

Matthias Boehm,

Uwe Wloka,

Dirk Habich,

Wolfgang LehnerAuthors Info & Claims

EDBT '09: Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology

Pages 1128 - 1131

https://doi.org/10.1145/1516360.1516494

Published: 24 March 2009 Publication History

PDF eReader

Abstract

As a result of the changing scope of data management towards the management of highly distributed systems and applications, integration processes have gained in importance. Such integration processes represent an abstraction of workflow-based integration tasks. In practice, integration processes are pervasive and the performance of complete IT infrastructures strongly depends on the performance of the central integration platform that executes the specified integration processes. In this area, the three major problems are: (1) significant development efforts, (2) low portability, and (3) inefficient execution. To overcome those problems, we follow a model-driven generation approach for integration processes. In this demo proposal, we want to introduce the so-called GCIP Framework (Generation of Complex Integration Processes) which allows the modeling of integration process and the generation of different concrete integration tasks. The model-driven approach opens opportunities for rule-based and workload-based optimization techniques.

References

[1]

A. Albrecht and F. Naumann. Managing etl processes. In Workshop New Trends in Information Integration (NTII), 2008.

Google Scholar

[2]

M. Böhm, D. Habich, W. Lehner, and U. Wloka. Dipbench: An independent benchmark for data intensive integration processes. In IIMAS, 2008.

Crossref

Google Scholar

[3]

M. Böhm, D. Habich, W. Lehner, and U. Wloka. Dipbench toolsuite: A framework for benchmarking integration systems. In ICDE, 2008.

Digital Library

Google Scholar

[4]

M. Böhm, D. Habich, W. Lehner, and U. Wloka. Model-driven generation and optimization of complex integration processes. In ICEIS, 2008.

Google Scholar

[5]

M. Böhm, D. Habich, U. Wloka, J. Bittner, and W. Lehner. Towards self-optimization of message transformation processes. In ADBIS, 2007.

Google Scholar

[6]

S. Dessloch, M. A. Hernandez, R. Wisnesky, A. Radwan, and J. Zhou. Orchid: Integrating schema mapping and etl. In ICDE, 2008.

Digital Library

Google Scholar

[7]

Z. G. Ives, A. Y. Halevy, and D. S. Weld. Adapting to source properties in processing data integration queries. In SIGMOD, 2004.

Digital Library

Google Scholar

[8]

H. Li and D. Zhan. Workflow timed critical path optimization. Nature and Science, 3(2), 2005.

Google Scholar

[9]

A. Simitsis, P. Vassiliadis, and T. Sellis. Optimizing etl processes in data warehouses. In ICDE, 2005.

Digital Library

Google Scholar

[10]

U. Srivastava, K. Munagala, J. Widom, and R. Motwani. Query optimization over web services. In VLDB, 2006.

Digital Library

Google Scholar

[11]

M. Vrhovnik, H. Schwarz, O. Suhre, B. Mitschang, V. Markl, A. Maier, and T. Kraft. An approach to optimize data processing in business processes. In VLDB, 2007.

Digital Library

Google Scholar

Cited By

View all

Siddiqi SKern RBoehm M(2023)SAGA: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning ApplicationsProceedings of the ACM on Management of Data10.1145/36173381:3(1-26)Online publication date: 13-Nov-2023
https://dl.acm.org/doi/10.1145/3617338
Tomingas KKliimask MTammet T(2015)Data Integration Patterns for Data Warehouse AutomationNew Trends in Database and Information Systems II10.1007/978-3-319-10518-5_4(41-55)Online publication date: 2015
https://doi.org/10.1007/978-3-319-10518-5_4
Theodorou VAbelló ALehner WThiele M(2015)Quality measures for ETL processes: from goals to implementationConcurrency and Computation: Practice and Experience10.1002/cpe.372928:15(3969-3993)Online publication date: 16-Dec-2015
https://doi.org/10.1002/cpe.3729
Show More Cited By

Recommendations

Portlets in Action
Investigation of WSRP support in selected open-source portal frameworks: Research Articles
Workshop on Grid Computing Portals (GCE 2005)

WSRP (Web Services for Remote Portlets) is a promising Web services specification used to standardize presentation-based access to remote Web portal content. In combination with the JSR-168 standard, portlet developers are freed of doing the hard work ...
Modeling portlet aggregation through statecharts
WISE'06: Proceedings of the 7th international conference on Web Information Systems

A portal is a key component of an enterprise integration strategy. It provides integration at the user interface level, whereas other integration technologies support business process, functional or data integration. To this end, portlet syndication is ...

Comments

Information & Contributors

Information

Published In

EDBT '09: Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology

March 2009

1180 pages

ISBN:9781605584225

DOI:10.1145/1516360

Editors:
Martin Kersten
CWI, The Netherlands
,
Boris Novikov
University of Saint Petersburg, Russia
,
Jens Teubner
ETH Zurich, Switzerland
,
Vladimir Polutin
HP Labs, Russia
,
Stefan Manegold
CWI, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 March 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

EDBT/ICDT '09

EDBT/ICDT '09: EDBT/ICDT '09 joint conference

March 24 - 26, 2009

Saint Petersburg, Russia

Acceptance Rates

Overall Acceptance Rate 7 of 10 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
200
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)6

Reflects downloads up to 09 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Siddiqi SKern RBoehm M(2023)SAGA: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning ApplicationsProceedings of the ACM on Management of Data10.1145/36173381:3(1-26)Online publication date: 13-Nov-2023
https://dl.acm.org/doi/10.1145/3617338
Tomingas KKliimask MTammet T(2015)Data Integration Patterns for Data Warehouse AutomationNew Trends in Database and Information Systems II10.1007/978-3-319-10518-5_4(41-55)Online publication date: 2015
https://doi.org/10.1007/978-3-319-10518-5_4
Theodorou VAbelló ALehner WThiele M(2015)Quality measures for ETL processes: from goals to implementationConcurrency and Computation: Practice and Experience10.1002/cpe.372928:15(3969-3993)Online publication date: 16-Dec-2015
https://doi.org/10.1002/cpe.3729
Theodorou VAbelló AThiele MLehner WSong ISimitsis ACuzzocrea A(2014)A Framework for User-Centered Declarative ETLProceedings of the 17th International Workshop on Data Warehousing and OLAP10.1145/2666158.2666178(67-70)Online publication date: 7-Nov-2014
https://dl.acm.org/doi/10.1145/2666158.2666178
Jovanovic PSimitsis AWilkinson K(2014)Engine independence for logical analytic flows2014 IEEE 30th International Conference on Data Engineering10.1109/ICDE.2014.6816723(1060-1071)Online publication date: Mar-2014
https://doi.org/10.1109/ICDE.2014.6816723
Theodorou VAbelló ALehner W(2014)Quality Measures for ETL ProcessesData Warehousing and Knowledge Discovery10.1007/978-3-319-10160-6_2(9-22)Online publication date: 2014
https://doi.org/10.1007/978-3-319-10160-6_2

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations

Portlets in Action

Investigation of WSRP support in selected open-source portal frameworks: Research Articles

Modeling portlet aggregation through statecharts

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations