Agent Based Dynamic Data Storage and Distribution in Data Warehouses
Pages 375 - 384
Abstract
In this paper, we propose a new approach to manage data storage and distribution in a data warehouse (DWH) environment. This approach deals with the dynamic data distribution of the DWH on a set of servers. The data distribution that we consider is different from the "classical" one which depends on the data use. The distribution in our approach consists in distributing data when the server reaches his storage capacity limit. This distribution assures the scalability and exploits the storage and processing resources available in the organization using the DWH. It is worth noting that our approach is based on a multi-agent model mixed with the scalability distribution proposed by the Scalable Distributed Data Structures.
The proposed multi-agent model is composed of stationary agent classes: Client, Dispatcher, Domain and Server, and a mobile agent class called Messenger. These agents collaborate and interact to achieve automatically the storage, the splitting (distribution), the redirection and the access operations on the distributed DWH.
References
[1]
W. Inmon: Building the Data Warehouse, QED Technical Publishing Group, 1992.
[2]
M. Wu and A. Buchmann, Research Issues in Data Warehousing, BTW'97, March 1997.
[3]
Kimball, R. (1996). The Data Warehouse Toolkit. New York: J. Wiley & Sons.
[4]
Kimball, R., Reeves, L., Ross, M., and Thornthwalte, W. (1998). The Data Warehouse Lifecycle Toolkit. New York: J. Wiley & Sons.
[5]
L. Bellatreche and K. Boukhalfa. An Evolutionary Approach to Schema Partitioning Selection in a Data Warehouse. DAWAK'2005.
[6]
J. Bernardino and H. Madeira. Data Warehousing and OLAP: Improving Query Performance Using Distributed Computing. 2001.
[7]
M. Costa, J. Vieira, J. Bernardino, P. Furtado, and H. Madeira. A middle layer for distributed data warehouses using the DWS-AQA technique. 2003.
[8]
P. Furtado. Experimental Evidence on Partitioning in Parallel Data Warehouses. DOLAP 04 -WORKSHOP of the Int'l Conference on Information and Knowledge Management (CIKM), Washington, November-2004.
[9]
N. Kolsi, K. Ghedira, and A. Abdellatif. Utilisation d'un Système Multi-Agents pour la Répartition et la Scalabilité des Données d'un Data Warehouse. Acts of the Fourth Scientific Days, Tome 1, pp.118-129, Borj El Amri Aviation School, Tunis, Tunisia, 21-22 May 2003.
[10]
Informatica white paper. Enterprise-Scalable Data Marts: A New Strategy for Building and Deploying Fast, Scalable Data Warehousing Systems. http://www.informatica.com, 1997.
[11]
W. Litwin, M. A. Neimat, and D. Schneider. RP*: A Family of Order-Preserving Scalable Distributed Data Structures, 20th Intl. Conf. On very Large Data Bases VLDB, 1994.
[12]
Diene and W. Litwin. Performance Measurements of RP*: A Scalable Distributed Data Structure for Range Partitioning. Int. Conf. on Information Society in the 21st Century: Emerging Techn. and New Challenges. Aizu City, Japan, 2000.
[13]
J. Arcangeli, A. Hameurlain, F. Migeon, and F. Morvan. Apport des agents mobiles à l'évaluation et l'optimisation de requêtes bases de données réparties à grande échelle. Technical Report, laboratory IRIT, Université Paul Sabatier, 2002.
- Agent Based Dynamic Data Storage and Distribution in Data Warehouses
Recommendations
Data warehouse access using multi-agent system
The new approach that we will propose, in this paper deals with the dynamic data distribution of the data warehouse (DWH) on a set of servers. This distribution is different from the "classical" one which depends on how data is used. It consists in ...
Designing data marts for data warehouses
Data warehouses are databases devoted to analytical processing. They are used to support decision-making activities in most modern business settings, when complex data sets have to be studied and analyzed. The technology for analytical processing ...
Alliance Rules for Data Warehouse Cleansing
ICSPS '09: Proceedings of the 2009 International Conference on Signal Processing SystemsData Cleansing is an activity performed on the data sets of data warehouse to enhance and maintain the quality and consistency of the data. This paper addresses the problems related with dirty data, entrance of dirty data and detection of dirty data in ...
Comments
Information & Contributors
Information
Published In
May 2007
1042 pages
ISBN:9783540728290
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 31 May 2007
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 14 Jan 2025