research-article

TPC-E vs. TPC-C: characterizing the new TPC-E benchmark via an I/O comparison study

Authors:

Radu StoicaAuthors Info & Claims

ACM SIGMOD Record, Volume 39, Issue 3

Pages 5 - 10

https://doi.org/10.1145/1942776.1942778

Published: 08 February 2011 Publication History

Get Access

Abstract

TPC-E is a new OLTP benchmark recently approved by the Transaction Processing Performance Council (TPC). In this paper, we compare TPC-E with the familiar TPCC benchmark in order to understand the behavior of the new TPC-E benchmark. In particular, we compare the I/O access patterns of the two benchmarks by analyzing two OLTP disk traces. We find that (i) TPC-E is more read intensive with a 9.7:1 I/O read to write ratio, while TPC-C sees a 1.9:1 read-to-write ratio; and (ii) although TPC-E uses pseudo-realistic data, TPC-E's I/O access pattern is as random as TPC-C. The latter suggests that like TPC-C, TPC-E can benefit from SSDs, which have superior random I/O support. To verify this, we replay both disk traces on an Intel X25-E SSD and see dramatic improvements for both TPC-C and TPC-E.

References

[1]

M. Canim, B. Bhattacharjee, G. A. Mihaila, C. A. Lang, and K. A. Ross. An object placement advisor for DB2 using solid state storage. PVLDB, 2(2):1318--1329, 2009.

Digital Library

Google Scholar

[2]

S. Chen. FlashLogging: exploiting flash devices for synchronous logging performance. In SIGMOD, 2009.

Digital Library

Google Scholar

[3]

G. Graefe. The five-minute rule twenty years later. In DaMoN Workshop, 2007.

Digital Library

Google Scholar

[4]

S. Kavalanekar, B. L. Worthington, Q. Zhang, and V. Sharda. Characterization of storage workload traces from production windows servers. In 4th International Symposium on Workload Characterization (IISWC), 2008.

Crossref

Google Scholar

[5]

S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A case for flash memory SSD in enterprise database applications. In SIGMOD, 2008.

Digital Library

Google Scholar

[6]

Transaction Processing Performance Council. TPC-C Benchmark Revision 5.10.1. http://www.tpc.org/tpcc/.

Google Scholar

[7]

Transaction Processing Performance Council. TPC-E Benchmark Version 1.9.0. http://www.tpc.org/tpce/.

Google Scholar

[8]

Transaction Processing Performance Council. TPC-E Benchmark Overview. http://www.tpc.org/ tpce/spec/TPCEpresentation.ppt, February 2007.

Google Scholar

Cited By

View all

Camilleri CVella JNezval V(2024)Horizontally Scalable Implementation of a Distributed DBMS Delivering Causal Consistency via the Actor ModelElectronics10.3390/electronics1317336713:17(3367)Online publication date: 24-Aug-2024
https://doi.org/10.3390/electronics13173367
Sajal SZhu TUrgaonkar BSen S(2024)TraceUpscaler: Upscaling Traces to Evaluate Systems at High LoadProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629581(942-961)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629581
Liu SKanniwadi SSchwarzl MKogler AGruss DKhan SCalandrino JTroncoso C(2023)Side-channel attacks on optane persistent memoryProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620618(6807-6824)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620618
Show More Cited By

Index Terms

TPC-E vs. TPC-C: characterizing the new TPC-E benchmark via an I/O comparison study
1. General and reference
  1. Cross-computing tools and techniques
    1. Evaluation
    2. Metrics
2. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database transaction processing
  2. Information retrieval
    1. Evaluation of retrieval results

Recommendations

New TPC benchmarks for decision support and web commerce

For as long as there have been DBMS's and applications that use them, there has been interest in the performance characteristics that these systems exhibit. This month's column describes some of the recent work that has taken place in TPC, the ...
New Initiatives in the TPC
Performance Evaluation and Benchmarking
Abstract
TPC stands for stricter standards and tougher tests in system benchmarking for over 30 years, during which technology advanced enormously. In order to stay relevant the TPC had to adapt to the advancing technology or become obsolete. Initially, ...
Overview of TPC Benchmark E: The Next Generation of OLTP Benchmarks
Performance Evaluation and Benchmarking

Set to replace the aging TPC-C, the TPC Benchmark E is the next generation OLTP benchmark, which more accurately models client database usage. TPC-E addresses the shortcomings of TPC-C. It has a much more complex workload, requires the use of RAID-...

Comments

Information & Contributors

Information

Published In

ACM SIGMOD Record Volume 39, Issue 3

September 2010

35 pages

ISSN:0163-5808

DOI:10.1145/1942776

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 February 2011

Published in SIGMOD Volume 39, Issue 3

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
759
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)7

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Camilleri CVella JNezval V(2024)Horizontally Scalable Implementation of a Distributed DBMS Delivering Causal Consistency via the Actor ModelElectronics10.3390/electronics1317336713:17(3367)Online publication date: 24-Aug-2024
https://doi.org/10.3390/electronics13173367
Sajal SZhu TUrgaonkar BSen S(2024)TraceUpscaler: Upscaling Traces to Evaluate Systems at High LoadProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629581(942-961)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629581
Liu SKanniwadi SSchwarzl MKogler AGruss DKhan SCalandrino JTroncoso C(2023)Side-channel attacks on optane persistent memoryProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620618(6807-6824)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620618
Bu SKang HCho S(2022)Ensemble of Deep Convolutional Learning Classifier System Based on Genetic Algorithm for Database Intrusion DetectionElectronics10.3390/electronics1105074511:5(745)Online publication date: 28-Feb-2022
https://doi.org/10.3390/electronics11050745
Chiosa MMaschi FMüller IAlonso GMay N(2022)Hardware acceleration of compression and encryption in SAP HANAProceedings of the VLDB Endowment10.14778/3554821.355482215:12(3277-3291)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.14778/3554821.3554822
Wang YYu MHui YZhou FHuang YZhu RRen XLi TLu X(2022)A study of database performance sensitivity to experiment settingsProceedings of the VLDB Endowment10.14778/3523210.352322115:7(1439-1452)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.14778/3523210.3523221
Lee YPark JPark JGwak HShin DEom YLee SAnwar ASkourtis DKannan SMa X(2022)When F2FS meets address remappingProceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3538643.3539755(31-36)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3538643.3539755
Bergman SFaldu PGrot BVilanova LSilberstein MLippautz MChisnall D(2022)Reconsidering OS memory optimizations in the presence of disaggregated memoryProceedings of the 2022 ACM SIGPLAN International Symposium on Memory Management10.1145/3520263.3534650(1-14)Online publication date: 14-Jun-2022
https://dl.acm.org/doi/10.1145/3520263.3534650
Lee SLerner ARyser APark KJeon CPark JSong YCudré-Mauroux PIves ZBonifati AEl Abbadi A(2022)X-SSD: A Storage System with Native Support for Database Logging and ReplicationProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526188(988-1002)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3526188
An MSong ISong YLee SIves ZBonifati AEl Abbadi A(2022)Avoiding Read Stalls on Flash StorageProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526126(1404-1417)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3526126
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

New TPC benchmarks for decision support and web commerce

New Initiatives in the TPC

Overview of TPC Benchmark E: The Next Generation of OLTP Benchmarks

Comments

Published In

Publisher

Publication History

Check for updates

Qualifiers

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

New TPC benchmarks for decision support and web commerce

New Initiatives in the TPC

Overview of TPC Benchmark E: The Next Generation of OLTP Benchmarks

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations