research-article

The next information architecture evolution: the data lake wave

Authors:

Cedrine Madera,

Anne LaurentAuthors Info & Claims

MEDES: Proceedings of the 8th International Conference on Management of Digital EcoSystems

Pages 174 - 180

https://doi.org/10.1145/3012071.3012077

Published: 01 November 2016 Publication History

Get Access

Abstract

Data warehouses and data marts have long been considered as the unique solution for providing end-users with decisional information. More recently, data lakes have been proposed in order to govern data swamps. However, no formal definition has been proposed in the literature. Existing works are not complete and miss important parts of the topic. In particular, they do not focus on the influence of the data gravity, the infrastructure role of those solutions and of course are proposing divergent definitions and positioning regarding the usage and the interaction with existing decision support system.

In this paper, we propose a novel definition of data lakes, together with a comparison with other over several criteria as the way to populate them, how to use, what is the Data Lake end user profile. We claim that data lakes are complementary components in decisional information systems and we discuss their position and interactions regarding the other components by proposing an interaction model.

References

[1]

Cloudera. Turn Your Data Lake into an Enterprise Data Hub. https://vision.cloudera.com/turn-your-data-lake-into-an-enterprise-data-hub/, 2014.

Google Scholar

[2]

M. J. Druzdzel and R. R. Flynn. Decision support systems, 2000.

Google Scholar

[3]

H. Fang. Managing data lakes in big data era: What's a data lake and why has it became popular in data management ecosystem. In International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), pages 820--824. IEEE, 2015.

Crossref

Google Scholar

[4]

Gartner. Gartner Says Beware of the Data Lake Fallacy. http://www.gartner.com/newsroom/id/2809117, 2014.

Google Scholar

[5]

Hortonworks. A Modern Data Architecture whith Apache Hadoop. http://info.hortonworks.com/rs/h2source/images/Hadoop-Data-Lake-white-paper.pdf, 2014.

Google Scholar

[6]

IBM. Governing and Managing Big Data for Analytics and Decision Makers. http://www.redbooks.ibm.com/abstracts/redp5120.html?Open, 2014.

Google Scholar

[7]

W. H. Inmon. Building the Data Warehouse. QED Information Sciences, Inc., Wellesley, MA, USA, 1992.

Digital Library

Google Scholar

[8]

R. Kimball and J. Caserta. The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming and Delivering Data. John Wiley & Sons, 2004.

Digital Library

Google Scholar

[9]

R. Kimball and M. Ross. The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling. Wiley Publishing, 3rd edition, 2013.

Digital Library

Google Scholar

[10]

J. Ladley. Data Governance: How to Design, Deploy and Sustain an Effective Data Governance Program. The Morgan Kaufmann Series on Business Intelligence. Elsevier Science, 2012.

Digital Library

Google Scholar

Cited By

View all

Dolhopolov ACastelltort ALaurent A(2024)Implementing Federated Governance in Data Mesh ArchitectureFuture Internet10.3390/fi1604011516:4(115)Online publication date: 29-Mar-2024
https://doi.org/10.3390/fi16040115
Lamer ASaint-Dizier CParis NChazard E(2024)Data Lake, Data Warehouse, Datamart, and Feature Store: Their Contributions to the Complete Data Reuse PipelineJMIR Medical Informatics10.2196/5459012(e54590-e54590)Online publication date: 17-Jul-2024
https://doi.org/10.2196/54590
Kato TFukumoto NSasaki CTagami ANakao A(2024)Challenges of CPS/IoT Network Architecture in 6G EraIEEE Access10.1109/ACCESS.2024.339536312(62804-62817)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3395363
Show More Cited By

Index Terms

The next information architecture evolution: the data lake wave
1. Information systems
  1. Information systems applications
    1. Decision support systems

Recommendations

Data Governance as Success Factor for Data Science
Responsible Design, Implementation and Use of Information and Communication Technology
Abstract
More and more, asset management organizations are introducing data science initiatives to support predictive maintenance and anomaly detection. Asset management organizations are by nature data intensive to manage their assets like bridges, dykes, ...
Tracing conceptual models' evolution in data warehouses by using the model driven architecture

Developing a data warehouse is an ongoing task where new requirements are constantly being added. A widely accepted approach for developing data warehouses is the hybrid approach, where requirements and data sources must be accommodated to a ...
Joint Management and Analysis of Textual Documents and Tabular Data Within the AUDAL Data Lake
Advances in Databases and Information Systems
Abstract
In 2010, the concept of data lake emerged as an alternative to data warehouses for big data management. Data lakes follow a schema-on-read approach to provide rich and flexible analyses. However, although trendy in both the industry and academia, ...

Comments

Information & Contributors

Information

Published In

MEDES: Proceedings of the 8th International Conference on Management of Digital EcoSystems

November 2016

243 pages

ISBN:9781450342674

DOI:10.1145/3012071

General Chair:
Richard Chbeir,
Program Chairs:
Rajeev Agrawal,
Ismail Biskri

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MEDES'16

MEDES'16: The 8th International Conference on ManagEment of Digital EcoSystems

November 1 - 4, 2016

Biarritz, France

Acceptance Rates

Overall Acceptance Rate 267 of 682 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
1,633
Total Downloads

Downloads (Last 12 months)157
Downloads (Last 6 weeks)13

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Dolhopolov ACastelltort ALaurent A(2024)Implementing Federated Governance in Data Mesh ArchitectureFuture Internet10.3390/fi1604011516:4(115)Online publication date: 29-Mar-2024
https://doi.org/10.3390/fi16040115
Lamer ASaint-Dizier CParis NChazard E(2024)Data Lake, Data Warehouse, Datamart, and Feature Store: Their Contributions to the Complete Data Reuse PipelineJMIR Medical Informatics10.2196/5459012(e54590-e54590)Online publication date: 17-Jul-2024
https://doi.org/10.2196/54590
Kato TFukumoto NSasaki CTagami ANakao A(2024)Challenges of CPS/IoT Network Architecture in 6G EraIEEE Access10.1109/ACCESS.2024.339536312(62804-62817)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3395363
Dolci TAmata LManco CAzzalini FGribaudo MTanca L(2024)Tools for Healthcare Data Lake Infrastructure BenchmarkingInformation Systems Frontiers10.1007/s10796-023-10468-5Online publication date: 17-Jan-2024
https://doi.org/10.1007/s10796-023-10468-5
Santos MLeón A(2024)A Multi-dimensional Model for the Design and Development of Analytical Information SystemsEnterprise, Business-Process and Information Systems Modeling10.1007/978-3-031-61007-3_22(291-306)Online publication date: 31-May-2024
https://doi.org/10.1007/978-3-031-61007-3_22
Ramos ISantos MJoshi DPratik S(2024)Data Mesh Adoption: A Multi-case and Multi-method Readiness ApproachInformation Systems10.1007/978-3-031-56481-9_2(16-29)Online publication date: 30-Mar-2024
https://doi.org/10.1007/978-3-031-56481-9_2
El Haddadi AEl Haddadi OCherradi MBouhafer FEl Haddadi AEl Allaoui A(2023)Data Lake Management System based on Topic ModelingData and Metadata10.56294/dm20231832(183)Online publication date: 28-Dec-2023
https://doi.org/10.56294/dm2023183
Merino JXie XMoretti NChang JParlikad A(2023)Data integration for digital twins in the built environment based on federated data modelsProceedings of the Institution of Civil Engineers - Smart Infrastructure and Construction10.1680/jsmic.23.00002176:4(194-211)Online publication date: 1-Dec-2023
https://doi.org/10.1680/jsmic.23.00002
Hai RKoutras CQuix CJarke M(2023)Data Lakes: A Survey of Functions and SystemsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.327010135:12(12571-12590)Online publication date: 1-Dec-2023
https://doi.org/10.1109/TKDE.2023.3270101
Ashraf AHassan AMahdi H(2023)Key Lessons from Microservices for Data Mesh Adoption2023 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC)10.1109/MIUCC58832.2023.10278300(1-8)Online publication date: 27-Sep-2023
https://doi.org/10.1109/MIUCC58832.2023.10278300
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Data Governance as Success Factor for Data Science

Tracing conceptual models' evolution in data warehouses by using the model driven architecture

Joint Management and Analysis of Textual Documents and Tabular Data Within the AUDAL Data Lake

Comments

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Data Governance as Success Factor for Data Science

Tracing conceptual models' evolution in data warehouses by using the model driven architecture

Joint Management and Analysis of Textual Documents and Tabular Data Within the AUDAL Data Lake

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations