research-article

Integrating Big Data: A Semantic Extract-Transform-Load Framework

Authors:

Srividya K. Bansal,

Sebastian KagemannAuthors Info & Claims

Computer, Volume 48, Issue 3

Pages 42 - 50

https://doi.org/10.1109/MC.2015.76

Published: 01 March 2015 Publication History

Abstract

Current tools that facilitate the extract-transform-load (ETL) process focus on ETL workflow, not on generating meaningful semantic relationships to integrate data from multiple, heterogeneous sources. A proposed semantic ETL framework applies semantics to various data fields and so allows richer data integration.

References

[1]

E. Kandogan et al., “Data for All: A Systems Approach to Accelerate the Path from Data to Insight,” Proc. IEEE 2nd Int'l Congress Big Data (BigData 13), 2013, pp. 427–428.

[2]

C. Bizer et al., “The Meaningful Use of Big Data: Four Perspectives-Four Challenges,” SIGMOD Record, vol. 40, no.4,2012, pp. 56–60.

[3]

A. Azzini and P. Ceravolo, “Consis-tent Process Mining over Big Data Triple Stores,” in Proc. IEEE 2nd Int'l Congress Big Data (BigData 13), 2013, pp. 54–61.

[4]

C. Bizer, T. Heath, and T. Bern-ers-Lee, “Linked Data-The Story So Far,” Int'l]. Semantic Web and Information Systems, vol. 5, no. 3, 2009, pp. 1–22.

[5]

L. Ding et al., “TWC LOGD: A Portal for Linked Open Government Data Ecosystems,” J. Web Semantics, vol. 9, no. 3, 2011, pp. 325–333.

Digital Library

[6]

S. Dastgheib, A. Mesbah, and K. Kochut, “mOntage: Building Domain Ontologies from Linked Open Data,” Proc. 7th IEEE Int'l Conf. Semantic Computing (ICSC 13), 2013, pp. 70–77.

[7]

F. Lecue, S. Kotoulas, and P. Mac Aonghusa “Capturing the Pulse of Cities: Opportunity and Research Challenges for Robust Stream Data Reasoning,” Workshops at the 26th AAAI Conf. Artificial Intelligence, 2012; [Online]. Available: www.aaai.org/ocs/index.php/WS/AAAIW12/paper/view/5216.

[8]

J. Manyika et al., Big Data: The Next Frontier for Innovation, Competition, and Productivity, McKinsey Global Inst., 2014; [Online]. Available: www.mckinsey.com/insights/business_technology/big data the next frontier for innovation.

[9]

S.K. Bista, S. Nepal, and C. Paris, “Data Abstraction and Visualisation in Next Step: Experiences from a Government Services Delivery Trial,” Proc. IEEE 2nd Int'l Congress Big Data (BigData 13), 2013, pp. 263–270.

[10]

D. Hecht, P.C. Sheu, and J.P. Tsai, “SCDL Applications to Drug Discovery,” Proc. 9th IEEE Int'l Conf. Bioinformatics and BioEngineering (BIBE 09), 2009, pp. 449–454.

[11]

A. Halevy, A. Rajaraman, and J. Ordille, “Data Integration: The Teenage Years,” Proc. 32nd Int'l Conf. Very Large Data Bases (VLDB 06), 2006, pp. 9–16.

[12]

M. Lenzerini, “Data Integration: A Theoretical Perspective,” Proc. 21st ACM-SIGMOD Symp. Principles Database Systems, 2002, pp. 233–246.

[13]

A. Call et al., “Data Integration under Integrity Constraints,” Information Systems, vol. 29, no. 2,2004, pp. 147–163.

[14]

P. Vassiliadis, A. Simitsis, and E. Baikousi, “A Taxonomy of ETL Activities,” Proc. ACM 12th Int'l Workshop Data Warehousing and OLAP (DOLAP 09), 2009, pp. 25–32.

[15]

S. Bergamaschi et al., “A Semantic Approach to ETL Technologies,” Data & Knowledge Eng., vol. 70, no. 8, 2011, pp. 171–731.

Cited By

Masmoudi MBen Abdallah Ben Lamine SKarray MArchimede BBaazaoui Zghal H(2024)Semantic Data Integration and Querying: A Survey and ChallengesACM Computing Surveys10.1145/365331756:8(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653317
Roman DAlexiev VPaniagua JElvesæter Bvon Zernichow BSoylu ASimeonov BTaggart C(2022)The euBusinessGraph ontologySemantic Web10.3233/SW-21042413:1(41-68)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.3233/SW-210424
Van Assche D(2022)Balancing RDF Generation from Heterogeneous Data SourcesThe Semantic Web: ESWC 2022 Satellite Events10.1007/978-3-031-11609-4_40(264-274)Online publication date: 29-May-2022
https://dl.acm.org/doi/10.1007/978-3-031-11609-4_40
Show More Cited By

Index Terms

Integrating Big Data: A Semantic Extract-Transform-Load Framework
1. Information systems
  1. Data management systems
    1. Database management system engines
    2. Information integration
      1. Extraction, transformation and loading
  2. Information systems applications

Index terms have been assigned to the content through auto-classification.

Recommendations

Towards a Programmable Semantic Extract-Transform-Load Framework for Semantic Data Warehouses
DOLAP '15: Proceedings of the ACM Eighteenth International Workshop on Data Warehousing and OLAP

In order to create better decisions for business analytics, organizations increasingly use external data, structured, semi-structured and unstructured, in addition to the (mostly structured) internal data. Current Extract-Transform-Load (ETL) tools are ...
Towards a Semantic Extract-Transform-Load (ETL) Framework for Big Data Integration
BIGDATACONGRESS '14: Proceedings of the 2014 IEEE International Congress on Big Data

Big Data has become the new ubiquitous term used to describe massive collection of datasets that are difficult to process using traditional database and software techniques. Most of this data is inaccessible to users, as we need technology and tools to ...
Research on Extract, Transform and Load(ETL) in Land and Resources Star Schema Data Warehouse
ISCID '12: Proceedings of the 2012 Fifth International Symposium on Computational Intelligence and Design - Volume 01

The extract, transform and Load (ETL) tool is extracting data from multiple, heterogeneous data source, transforming data, and finally loading data into the data warehouse. It is the foundation of any data warehouse, data mining and business ...

Comments

Information & Contributors

Information

Published In

cover image Computer

Computer Volume 48, Issue 3

Mar. 2015

107 pages

ISSN:0018-9162

Issue’s Table of Contents

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 March 2015

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Masmoudi MBen Abdallah Ben Lamine SKarray MArchimede BBaazaoui Zghal H(2024)Semantic Data Integration and Querying: A Survey and ChallengesACM Computing Surveys10.1145/365331756:8(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653317
Roman DAlexiev VPaniagua JElvesæter Bvon Zernichow BSoylu ASimeonov BTaggart C(2022)The euBusinessGraph ontologySemantic Web10.3233/SW-21042413:1(41-68)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.3233/SW-210424
Van Assche D(2022)Balancing RDF Generation from Heterogeneous Data SourcesThe Semantic Web: ESWC 2022 Satellite Events10.1007/978-3-031-11609-4_40(264-274)Online publication date: 29-May-2022
https://dl.acm.org/doi/10.1007/978-3-031-11609-4_40
Mountasser IOuhbi BHdioud FFrikh B(2021)Semantic-based Big Data integration framework using scalable distributed ontology matching strategyDistributed and Parallel Databases10.1007/s10619-021-07321-639:4(891-937)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1007/s10619-021-07321-6
Aftab ZIqbal WAlmustafa KBukhari FAbdullah M(2020)Automatic NoSQL to Relational Database Transformation with Dynamic Schema MappingScientific Programming10.1155/2020/88133502020Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1155/2020/8813350
Soylu ACorcho OElvesæter BBadenes-Olmedo CMartínez FKovacic MPosinkovic MMakgill ITaggart CSimperl ELech TRoman D(2020)Enhancing Public Procurement in the European Union Through Constructing and Exploiting an Integrated Knowledge GraphThe Semantic Web – ISWC 202010.1007/978-3-030-62466-8_27(430-446)Online publication date: 2-Nov-2020
https://dl.acm.org/doi/10.1007/978-3-030-62466-8_27
Kupfersberger VSchaberreiter TQuirchmayr G(2018)Security-Driven Information Flow Modelling for Component Integration in Complex EnvironmentsProceedings of the 10th International Conference on Advances in Information Technology10.1145/3291280.3291797(1-8)Online publication date: 10-Dec-2018
https://dl.acm.org/doi/10.1145/3291280.3291797

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents