Abstract
BI accelerator solutions like the SAP NetWeaver database engine TREX achieve high performance when processing complex analytic queries in large data warehouses. They do so with a combination of column-oriented data organization, memory-based processing, and a scalable multiserver architecture. The use of data compression techniques further reduces both memory consumption and processing time. In this paper we study query operators like scan and aggregation on compressed data structures implemented in TREX.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abadi, D.J., Madden, S.R., Ferreira, M.C.: Integrating compression and execution in column-oriented database systems. In: Proc. SIGMOD, pp. 671–682 (2006)
Chen, Z., Gehrke, J., Korn, F.: Query optimization in compressed database systems. In: Proc. SIGMOD, pp. 271–282 (2001)
Cockshott, W.P., McGregor, D., Wilson, J.: High-performance operations using a compressed database architecture. The Computer Journal 41(5), 283–296 (1998)
Graefe, G., Shapiro, L.D.: Data compression and database performance. In: Proc. ACM/IEEE-CS Symp. on Applied Computing, pp. 22–27 (1991)
Li, J., Srivastava, J.: Efficient aggregation algorithms for compressed data warehouses. IEEE TKDE 14(3), 515–529 (2002)
O’Connell, S.J., Winterbottom, N.: Performing joins without decompression in a compressed database system. SIGMOD Rec. 32(1), 6–11 (2003)
Raman, V., Swart, G.: How to wring a table dry: Entropy compression of relations and querying of compressed relations. In: Proc. 32nd VLDB, pp. 858–869 (2006)
Raman, V., Swart, G., Qiao, L., Reiss, F., Dialani, V., Kossmann, D., Narang, I., Sidle, R.: Constant-time query processing. In: Proc. 24th ICDE, pp. 60–69 (2008)
Stonebraker, M., et al.: C-store: A column-oriented dbms. In: Proc. 31st VLDB, pp. 553–564 (2005)
Westmann, T., Kossmann, D., Helmer, S., Moerkotte, G.: The implementation and performance of compressed databases. SIGMOD Rec. 29(3), 55–67 (2000)
Willhalm, T., Popovici, N., Boshmaf, Y., Plattner, H., Zeier, A., Schaffner, J.: Simd-scan: Ultra fast in-memory table scan using on-chip vector processing units. PVLDB 2(1), 385–394 (2009)
Zhou, J., Ross, K.A.: Implementing database operations using simd instructions. In: Proc. SIGMOD, pp. 145–156 (2002)
Zukowski, M., Héman, S., Nes, N., Boncz, P.: Super-scalar ram-cpu cache compression. In: Proc. 22nd ICDE, p. 59 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lemke, C., Sattler, KU., Faerber, F., Zeier, A. (2010). Speeding Up Queries in Column Stores. In: Bach Pedersen, T., Mohania, M.K., Tjoa, A.M. (eds) Data Warehousing and Knowledge Discovery. DaWaK 2010. Lecture Notes in Computer Science, vol 6263. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15105-7_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-15105-7_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15104-0
Online ISBN: 978-3-642-15105-7
eBook Packages: Computer ScienceComputer Science (R0)