article

Free access

A methodology for database system performance evaluation

Authors:

Haran Boral,

David J DeWittAuthors Info & Claims

ACM SIGMOD Record, Volume 14, Issue 2

Pages 176 - 185

https://doi.org/10.1145/971697.602283

Published: 01 June 1984 Publication History

PDF eReader

Abstract

This paper presents a methodology for evaluating the performance of database management systems and database machines in a multiuser environment. Three main factors that affect transaction throughput in a multiuser environment are identified: multiprogramming level, degree of data sharing among simultaneously executing transactions, and transaction mix. We demonstrate that only four basic query types are needed to construct a benchmark that will evaluate the performance of a system under a wide variety of workloads. Finally, we present the results of applying our techniques to the Britton-Lee IDM 500 database machine

References

[1]

{BOGD83} Bogdanowicz, R., Crocker, M., Hsiao, D, Ryder, C, Stone, V, and P Strawser, "Experiments in Benchmarking Relational Database Machines," Database Machines Springer-Verlag, 1983

Google Scholar

[2]

{BITT83} Bitton, D, DeWitt, D J, and C Turbyfil, 'Benchmarking Database Systems: A Systematic Approach," Computer Sciences Department Technical Report #526, Computer Sciences Department, University of Wisconsin, December 1983 This is a revised and expanded version of the paper that appeared under the same title in the Proceedings of the 1983 Very Large Database Conference, October, 1983

Digital Library

Google Scholar

[3]

{EPST80} Epstein, R. and P Hawthorn, "Design Decisions for the Intelligent Database Machine," Proceedings of the 1980 National Computer Conference, pp. 237--241

Google Scholar

[4]

{IDM500} IDM 500 Reference Manual, Britton-Lee Inc, Los Gatos, California.

Google Scholar

[5]

{RIES77} Ries, D, and M. Stonebraker, "Effects of Locking Granularity on Database Management System Performance," ACM Transactions on Database Systems, Vol. 2, No 3, September 1977

Digital Library

Google Scholar

[6]

{RIES79} Ries, D, and M. Stonebraker, "Locking Granularity Revisited," ACM Transactions on Database Systems, Vol. 4, No 2, June 1979

Digital Library

Google Scholar

[7]

{SACC82} Sacco, G M. and M. Schkolnick, "A Mechanism for Managing the Buffer Pool in a Relational Database System Using the Hot Set Model," Proceedings of the 1982 Very Large Database Conference, (September 1982)

Digital Library

Google Scholar

[8]

{STRA83} Strawser, Paula, "A Methodology for Benchmarking Relational Database Machines," Ph.D Dissertation, Ohio State University, December 1983

Digital Library

Google Scholar

[9]

{STON81} Stonebraker, M., "Operating System Support for Database Management,' Communications of the ACM, Vo 24, No 7, July 1981, pp. 412--418

Digital Library

Google Scholar

[10]

{UBEL81} Ubell, M., "The Intelligent Database Machine," Database Engineering, Vol. 4, No 2, Dec 1981, pp. 28--30

Google Scholar

Cited By

View all

Chen XTian JBeaver IFreeman CYan YWang JTao D(2024)FCBench: Cross-Domain Benchmarking of Lossless Compression for Floating-Point DataProceedings of the VLDB Endowment10.14778/3648160.364818017:6(1418-1431)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.14778/3648160.3648180
Bautista SSuntaxi G(2023)Exploring Horizontal Scaling Solutions to Enhance CryptDB Performance under High Concurrency on AWS2023 IEEE XXX International Conference on Electronics, Electrical Engineering and Computing (INTERCON)10.1109/INTERCON59652.2023.10326050(1-8)Online publication date: 2-Nov-2023
https://doi.org/10.1109/INTERCON59652.2023.10326050
Angles RPrat-Pérez ADominguez-Sal DLarriba-Pey JBoncz PNeumann T(2013)Benchmarking database systems for social network applicationsFirst International Workshop on Graph Data Management Experiences and Systems10.1145/2484425.2484440(1-7)Online publication date: 23-Jun-2013
https://dl.acm.org/doi/10.1145/2484425.2484440
Show More Cited By

Recommendations

A methodology for database system performance evaluation
SIGMOD '84: Proceedings of the 1984 ACM SIGMOD international conference on Management of data

This paper presents a methodology for evaluating the performance of database management systems and database machines in a multiuser environment. Three main factors that affect transaction throughput in a multiuser environment are identified: ...
Panel: Database system performance management
SIGMOD '86: Proceedings of the 1986 ACM SIGMOD international conference on Management of data
In the past few years we have seen in the literature a number of proposals for benchmarks to be used in measuring the performance of database management and transaction processing systems. The TP1 benchmark [Anon et al 1985] and the Wisconsin benchmark [...
Panel: Database system performance management
In the past few years we have seen in the literature a number of proposals for benchmarks to be used in measuring the performance of database management and transaction processing systems. The TP1 benchmark [Anon et al 1985] and the Wisconsin benchmark [...

Comments

Information & Contributors

Information

Published In

ACM SIGMOD Record Volume 14, Issue 2

June 1984

333 pages

ISSN:0163-5808

DOI:10.1145/971697

Issue’s Table of Contents

SIGMOD '84: Proceedings of the 1984 ACM SIGMOD international conference on Management of data
June 1984
339 pages
ISBN:0897911288
DOI:10.1145/602259
Conference Chair:
Diane Smith
Computer Corporation of America
,
Program Chair:
Beatrice Yormark
Yormark Enterprises, Inc., Alexandria, VA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1984

Published in SIGMOD Volume 14, Issue 2

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
858
Total Downloads

Downloads (Last 12 months)68
Downloads (Last 6 weeks)12

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chen XTian JBeaver IFreeman CYan YWang JTao D(2024)FCBench: Cross-Domain Benchmarking of Lossless Compression for Floating-Point DataProceedings of the VLDB Endowment10.14778/3648160.364818017:6(1418-1431)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.14778/3648160.3648180
Bautista SSuntaxi G(2023)Exploring Horizontal Scaling Solutions to Enhance CryptDB Performance under High Concurrency on AWS2023 IEEE XXX International Conference on Electronics, Electrical Engineering and Computing (INTERCON)10.1109/INTERCON59652.2023.10326050(1-8)Online publication date: 2-Nov-2023
https://doi.org/10.1109/INTERCON59652.2023.10326050
Angles RPrat-Pérez ADominguez-Sal DLarriba-Pey JBoncz PNeumann T(2013)Benchmarking database systems for social network applicationsFirst International Workshop on Graph Data Management Experiences and Systems10.1145/2484425.2484440(1-7)Online publication date: 23-Jun-2013
https://dl.acm.org/doi/10.1145/2484425.2484440
Cai LHuang SChen LZheng Y(2013)Performance analysis and testing of HBase based on its architecture2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS)10.1109/ICIS.2013.6607866(353-358)Online publication date: Jun-2013
https://doi.org/10.1109/ICIS.2013.6607866
Cesarini FPippolini FSoda G(2005)Chapter 10 Database machine design and performance evaluation: Annotated bibliographyDatabase Machine Performance: Modeling Methodologies and Evaluation Strategies10.1007/3-540-17942-9_20(208-250)Online publication date: 29-May-2005
https://doi.org/10.1007/3-540-17942-9_20
Cesarini FSalza S(2005)Chapter 3 Modeling and measuring methodologiesDatabase Machine Performance: Modeling Methodologies and Evaluation Strategies10.1007/3-540-17942-9_13(33-49)Online publication date: 29-May-2005
https://doi.org/10.1007/3-540-17942-9_13
Seng J(2003)A study on industry and synthetic standard benchmarks in relational and object databasesIndustrial Management & Data Systems10.1108/02635570310489214103:7(516-532)Online publication date: 1-Oct-2003
https://doi.org/10.1108/02635570310489214
Bic LHartmann R(1986)Simulated performance of a data-driven database machineJournal of Parallel and Distributed Computing10.1016/0743-7315(86)90025-03:1(1-22)Online publication date: Mar-1986
https://doi.org/10.1016/0743-7315(86)90025-0
Chou HDewitt DKatz RKlug A(1985)Design and implementation of the Wisconsin storage systemSoftware—Practice & Experience10.1002/spe.438015100315:10(943-962)Online publication date: 1-Oct-1985
https://dl.acm.org/doi/10.1002/spe.4380151003
Karwa VRaskhodnikova SSmith AYaroslavtsev G(2020)Private analysis of graph structureProceedings of the VLDB Endowment10.14778/3402707.34027494:11(1146-1157)Online publication date: 3-Jun-2020
https://dl.acm.org/doi/10.14778/3402707.3402749
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations