Database engines on multicores scale: A practical approach
Pages 2335 - 2340
Editorial Notes
This paper was presented at the SAC'15 conference but omitted from publication due to an error. It was added to the ACM Digital Library in March 2018 -- almost three years following initial publication of the proceedings.
Abstract
Multicore processors are available for over a decade, being the norm for current computer systems, but general purpose database management systems (DBMS) still cannot fully explore the computational resources of these platforms. We focus on In-Memory DBMS since these are becoming widely adopted, due to the increasing amount of memory installed in today's systems, and are expected to scale on multicore machines, by not incurring in I/O bottlenecks. This paper presents a practical study on In-Memory DBMS and shows that contention imposed by concurrency control mechanisms, such as locking, are limiting factors for both performance and scalability of these systems on multicores. Additionally, we discuss a simple database engine modification that allows an almost 10 fold performance improvement, over the original engine, also allowing databases to scale on multicores.
References
[1]
H2 database engine, http://www.h2database.com (2012).
[2]
HyperSQLDB, http://hsqldb.org, (2012).
[3]
A. Baumann, P. Barham, P.-E. Dagand, T. Harris, R. Isaacs, S. Peter, T. Roscoe, A. Schupbach, and A. Singhania: The multikernel: a new os architecture for scalable multicore systems. In Proc. SOSP'09 (2009).
[4]
H. Berenson, P. Bernstein, J. Gray, J. Melton, E. O'Neil, and P. O'Neil: A critique of ansi sql isolation levels. In Proc. SIGMOD'95 (1995).
[5]
S. Blanas, Y. Li, and J. M. Patel: Design and evaluation of main memory hash join algorithms for multi-core cpus. In Proc. SIGMOD'11, (2011).
[6]
L. Camargos, F. Pedone, and M. Wieloch: Sprint: a middleware for high-performance transaction processing. In Proc. EuroSys'07 (2007).
[7]
E. Cecchet, G. Candea, and A. Ailamaki: Middleware-based database replication: the gaps between theory and practice. In Proc. SIGMOD'08 (2008).
[8]
C. Chekuri, W. Hasan, and R. Motwani: Scheduling problems in parallel query optimization. In Proc. PODS'95 (1995).
[9]
J. Cieslewicz, K. A. Ross, K. Satsumi, and Y. Ye: Automatic contention detection and amelioration for data-intensive operations. In Proc. SIGMOD'10 (2010).
[10]
G. Giannikis, G. Alonso, and D. Kossmann: Shareddb: killing one thousand queries with one stone. In Proc. VLDB'12 (2012).
[11]
W.-S. Han and J. Lee: Dependency-aware reordering for parallelizing query optimization in multi-core cpus: In Proc. SIGMOD'09 (2009).
[12]
N. Hardavellas, I. Pandis, R. Johnson, N. Mancheril, A. Ailamaki, and B. Falsa: Database servers on chip multiprocessors: Limitations and opportunities. In CIDR'07 (2007).
[13]
S. Harizopoulos, D. J. Abadi, S. Madden, and M. Stonebraker: OLTP through the looking glass, and what we found there. In Proc. SIGMOD'08 (2008).
[14]
R. Johnson, M. Athanassoulis, R. Stoica, and A. Ailamaki: A new look at the roles of spinning and blocking. In Proc. DaMoN'09 (2009).
[15]
R. Kallman, H. Kimura, J. Natkins, A. Pavlo, A. Rasin, S. Zdonik, E. P. C. Jones, S. Madden, M. Stonebraker, Y. Zhang, J. Hugg, and D. J. Abadi: H-store: a high-performance, distributed main memory transaction processing system. Proc. VLDB'08 (2008).
[16]
K. Krikellas, M. Cintra, and S. Viglas: Multithreaded query execution on multicore processors. Technical report, The University of Edinburgh School of Informatics, (2009).
[17]
K. Papadopoulos, K. Stavrou, and P. Trancoso: HelperCoreDB: Exploiting multicore technology for databases. In Proc. PACT'07 (2007).
[18]
T.-I. Salomie, I. E. Subasu, J. Giceva, and G. Alonso: Database engines on multicores, why parallelize when you can distribute? In Proc. EuroSys'11 (2011).
[19]
J. Soares, J. Lourenco, and N. Preguica: MacroDB: Scaling database engines on multicores. In Proc. Euro-Par'13 (2013).
[20]
X. Song, H. Chen, R. Chen, Y. Wang, and B. Zang: A case for scaling applications to many-core with os clustering. In Proc. EuroSys'11 (2011).
[21]
M. Stonebraker, S. Madden, D. J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland: The end of an architectural era: (it's time for a complete rewrite). In Proc. VLDB'07 (2007).
[22]
S. Tu, W. Zheng, E. Kohler, B. Liskov, and S. Madden: Speedy transactions in multicore in-memory databases. In Proc. SOSP'13 (2013).
[23]
P. Unterbrunner, G. Giannikis, G. Alonso, D. Fauser, and D. Kossmann: Predictable performance for unpredictable workloads. Proc. VLDB'09 (2009).
[24]
Y. Ye, K. A. Ross, and N. Vesdapunt: Scalable aggregation on multicore processors. In Proc. DaMoN'11 (2011).
[25]
J. Zhou, J. Cieslewicz, K. A. Ross, and M. Shah: Improving database performance on simultaneous multithreading processors. In Proc. VLDB'05 (2005).
- Database engines on multicores scale: A practical approach
Recommendations
Database engines on multicores, why parallelize when you can distribute?
EuroSys '11: Proceedings of the sixth conference on Computer systemsMulticore computers pose a substantial challenge to infrastructure software such as operating systems or databases. Such software typically evolves slower than the underlying hardware, and with multicore it faces structural limitations that can be ...
Synergistic execution of stream programs on multicores with accelerators
LCTES '09: Proceedings of the 2009 ACM SIGPLAN/SIGBED conference on Languages, compilers, and tools for embedded systemsThe StreamIt programming model has been proposed to exploit parallelism in streaming applications on general purpose multicore architectures. The StreamIt graphs describe task, data and pipeline parallelism which can be exploited on accelerators such as ...
Synergistic execution of stream programs on multicores with accelerators
LCTES '09The StreamIt programming model has been proposed to exploit parallelism in streaming applications on general purpose multicore architectures. The StreamIt graphs describe task, data and pipeline parallelism which can be exploited on accelerators such as ...
Comments
Information & Contributors
Information
Published In
April 2015
2418 pages
ISBN:9781450331968
DOI:10.1145/2695664
- Conference Chairs:
- Roger L. Wainwright,
- Juan Manuel Corchado,
- Program Chairs:
- Alessio Bechini,
- Jiman Hong
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 March 2018
Check for updates
Qualifiers
- Research-article
Conference
SAC 2015
Sponsor:
Acceptance Rates
SAC '15 Paper Acceptance Rate 291 of 1,211 submissions, 24%;
Overall Acceptance Rate 1,650 of 6,669 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 40Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in