Abstract
Multi-granular fact tables are used to store and query data at different levels of granularity. In order to collect data in multi-granular fact tables on a resource-constrained system and to keep it for a long time, we gradually aggregate data to save space, however, still allowing analysis queries, for example, for maintenance purposes etc. to work and generate valid results even after aggregation. However, ineffective means of data aggregation is one of the main factors that can not only reduce performance of the queries but also leads to erroneous reporting. This paper presents effective methods for data reduction that are developed to perform gradual data aggregation in multi-granular fact tables on resource-constrained systems. With the gradual data aggregation mechanism, older data can be made coarse-grained while keeping the newest data fine-grained. This paper also evaluates the proposed methods based on a real world farming case study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Lopez, I.F.V., Moon, B., Snodgrass, R.T.: Spatiotemporal Aggregate Computation: A Survey. IEEE Transactions on Knowledge and Data Engineering 17(2), 271–286 (2005)
Li, J., Srivastava, J.: Efficient Aggregation Algorithms for Compressed Data Warehouses. IEEE Transactions on Knowledge and Data Engineering 14(3), 515–529 (2002)
Rasheed, F., Lee, Y.K., Lee, S.: Towards using Data Aggregation Techniques in Ubiquitous Computing Environments. In: 4th IEEE International Conference on Pervasive Computing and Communication Workshops, pp. 36–392. IEEE Press, New York (2006)
Schulze, C., Spilke, J., Lehner, W.: Data Modeling for Precision Dairy Farming within the Competitive Field of Operational and Analytical Tasks. Computers and Electronics in Agriculture 59(1-2), 39–55 (2007)
Zhang, D., Gunopulos, D., Tsotras, V.J., Seeger, B.: Temporal and Spatio-Temporal Aggregations over Data Streams using Multiple Time Granularities. Information Systems 28(1-2), 61–84 (2003)
Boly, A., Hébrail, G., Goutier, S.: Forgetting Data Intelligently in Data Warehouses. In: IEEE International Conference on Research, Innovation and Vision for the Future, pp. 220–227. IEEE Press, New York (2007)
Skyt, J., Jensen, C.S., Pedersen, T.B.: Specification-based Data Reduction in Dimensional Data Warehouses. Information Systems 33(1), 36–63 (2008)
Iftikhar, N.: Integration, Aggregation and Exchange of Farming Device Data: A High Level Perspective. In: 2nd IEEE Conference on the Applications of Digital Information and Web Technologies, pp. 14–19. IEEE Press, New York (2009)
Madden, S.R., Franklin, M.J., Hellerstein, J.M., Hong, W.: TinyDB: An Acquisitional Query Processing System for Sensor Networks. ACM Transaction on Database Systems 30(1), 122–173 (2005)
Rosenmuller, M., Siegmund, N., Schirmeier, H., Sincero, J., Apel, S., Leich, T., Spinczyk, O., Saake, G.: FAME-DBMS: Tailor-made Data Management Solutions for Embedded Systems. In: EDBT Workshop on Software Engineering for Tailor-made Data Management, pp. 1–6. ACM Press, New York (2008)
Kim, G.J., Baek, S.C., Lee, H.S., Lee, H.D., Joe, M.J.: LGeDBMS: A Small DBMS for Embedded System with Flash Memory. In: 32nd International Conference on Very Large Data Bases, pp. 1255–1258 (2006)
UTC, http://en.wikipedia.org/wiki/Coordinated_Universal_Time
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Iftikhar, N., Pedersen, T.B. (2010). Gradual Data Aggregation in Multi-granular Fact Tables on Resource-Constrained Systems. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based and Intelligent Information and Engineering Systems. KES 2010. Lecture Notes in Computer Science(), vol 6278. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15393-8_40
Download citation
DOI: https://doi.org/10.1007/978-3-642-15393-8_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15392-1
Online ISBN: 978-3-642-15393-8
eBook Packages: Computer ScienceComputer Science (R0)