Article

XMark: a benchmark for XML data management

Authors:

Albrecht Schmidt,

Martin Kersten,

Michael J. Carey,

Ioana Manolescu,

Ralph BusseAuthors Info & Claims

VLDB '02: Proceedings of the 28th international conference on Very Large Data Bases

Pages 974 - 985

Published: 20 August 2002 Publication History

Abstract

While standardization efforts for XML query languages have been progressing, researchers and users increasingly focus on the database technology that has to deliver on the new challenges that the abundance of XML documents poses to data management: validation, performance evaluation and optimization of XML query processors are the upcoming issues. Following a long tradition in database research, we provide a framework to assess the abilities of an XML database to cope with a broad range of different query types typically encountered in real-world scenarios. The benchmark can help both implementors and users to compare XML databases in a standardized application scenario. To this end, we offer a set of queries where each query is intended to challenge a particular aspect of the query processor. The overall workload we propose consists of a scalable document database and a concise, yet comprehensive set of queries which covers the major aspects of XML query processing ranging from textual features to data analysis queries and ad hoc queries. We complement our research with results we obtained from running the benchmark on several XML database platforms. These results are intended to give a first baseline and illustrate the state of the art.

References

[1]

{1} T. Anderson, A. Berre, M. Mallison, H. Porter, and B. Schneider. The HyperModel Benchmark. In International Conference on Extending Database Technology, volume 416 of Lecture Notes in Computer Science, pages 317-331, 1990.

Digital Library

[2]

{2} T. Böhme and E. Rahm. XMach-1: A Benchmark for XML Data Management. In Proceedings of BTW2001, 2001.

Digital Library

[3]

{3} A. Bonifati and S. Ceri. Comparative Analysis of Five XML Query Languages. ACM SIGMOD Record, 29(1):68-79, 2000.

Digital Library

[4]

{4} R. Bourett. XML Database Products. available at http://www.rpbourret.com/xml/ XMLDatabaseProds.htm, 2000.

[5]

{5} J. Boyer. Canonical XML Version 1.0, 1 2001. available at http://www.w3.org/ TR/xml-c14n.

[6]

{6} T. Bray, J. Paoli, C. M. Sperberg-McQueen, and E. Maler. Extensible Markup Language (XML) 1.0 (Second Edition). available at http:// www.w3.org/TR/REC-xml, 2000.

[7]

{7} S. Bressan, G. Dobbie, Z. Lacroix, M. Lee, Y. Li, and U. Nambiar. X007: Applying 007 Benchmark to XML Query Processing Tools. In International Conference on Information and Knowledge Management, pages 167-174, 2001.

Digital Library

[8]

{8} M. Carey, D. DeWitt, and J. Naughton. The OO7 Benchmark. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 12-21, 1993.

Digital Library

[9]

{9} M. Carey, D. DeWitt, J. Naughton, M. Asgarian, P. Brown, J. Gehrke, and D. Shah. The BUCKY Object-Relational Benchmark. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 135-146, 1997.

Digital Library

[10]

{10} R. Cattell and J. Skeen. Object Operations Benchmark. TODS, 17(1):1-31, 1992.

Digital Library

[11]

{11} D. Chamberlin, D. Florescu, J. Robie, J. Siméeon, and M. Stefanescu. XQuery: A Query Language for XML, February 2001. available at http:// www.w3.org/TR/xquery.

[12]

{12} D. Chamberlin, J. Robie, and D. Florescu. Quilt: An XML Query Language for Heterogeneous Data Sources. In International Workshop on the Web and Databases (WebDB), pages 53-62, 2000.

Digital Library

[13]

{13} James Clark et al. Expat XML Parser. available at http://sourceforge.net/ projects/expat/, 2001.

[14]

{14} D. Florescu and D. Kossmann. Storing and Querying XML Data using an RDMBS. IEEE Data Engineering Bulletin, 22(3):27-34, 1999.

[15]

{15} J. Gray. Database and Transaction Processing Performance Handbook. available at http://www.benchmarkresources. com/handbook/contents.asp, 1993.

[16]

{16} M. Klettke and H. Meyer. XML and Object-Relational Database Systems - Enhancing Structural Mappings Based on Statistics. In International Workshop on the Web and Databases (WebDB), pages 63-68, 2000.

Digital Library

[17]

{17} K. Ramasamy, J. Patel, J. Naughton, and R. Kaushik. Set Containment Joins: The Good, The Bad and The Ugly. In Proceedings of the International Conference on Very Large Data Bases, pages 351-362, 2000.

Digital Library

[18]

{18} A. Schmidt, M. Kersten, D. Florescu, M. Carey, I. Manolescu, and F. Waas. The XML Store Benchmark Project, 2000. http://www. xml-benchmark.org.

[19]

{19} A. Schmidt, M. Kersten, D. Florescu, M. Carey, I. Manolescu, and F. Waas. Example Snippet and Queries, 2002. available at http: //monetdb.cwi.nl/xml/snippet.txt and http://monetdb.cwi.nl/xml/ queries.txt.

[20]

{20} A. Schmidt, M. Kersten, M. Windhouwer, and F. Waas. Efficient Relational Storage and Retrieval of XML Documents. In International Workshop on the Web and Databases (WebDB), pages 47-52, Dallas, TX, USA, 2000.

Digital Library

[21]

{21} A. Schmidt, F. Waas, M. Kersten, D. Florescu, M. Carey, I. Manolescu, and R. Busse. Why And How To Benchmark XML Databases. ACM SIGMOD Record, 30(3):27-32, 2001.

Digital Library

[22]

{22} A. Schmidt, F. Waas, M. Kersten, D. Florescu, I. Manolescu, M. Carey, and R. Busse. The XML Benchmark Project. Technical Report INS- R0103, April 2001.

Digital Library

[23]

{23} J. Shanmugasundaram, K. Tufte, C. Zhang, G. He, D. J. DeWitt, and J. F. Naughton. Relational Databases for Querying XML Documents: Limitations and Opportunities. In Proceedings of the International Conference on Very Large Data Bases, pages 302-314, 1999.

Digital Library

[24]

{24} D. R. Slutz. Massive Stochastic Testing of SQL. In Proceedings of the International Conference on Very Large Data Bases, pages 618-622, 1998.

Digital Library

[25]

{25} W3C. W3C XML Schema. http://www.w3. org/XML/Schema, 2001.

[26]

{26} C. Zhang, J. Naughton, D. DeWitt, Q. Luo, and G. Lohman. On Supporting Containment Queries in Relational Database Management Systems. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 2001.

Digital Library

Cited By

Lin YHe YChaudhuri S(2023)Auto-BI: Automatically Build BI-Models Leveraging Local Join Prediction and Global Schema GraphProceedings of the VLDB Endowment10.14778/3603581.360359616:10(2578-2590)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.14778/3603581.3603596
Trofimov ASokolov NMarshalkin NKuralenok INovikov BZhou YChrysanthis PGulisano V(2022)Substream management in distributed streaming dataflowsProceedings of the 16th ACM International Conference on Distributed and Event-Based Systems10.1145/3524860.3539809(55-66)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3524860.3539809
Wellenzohn KBöhlen MHelmer S(2021)Dynamic interleaving of content and structure for robust indexing of semi-structured hierarchical dataProceedings of the VLDB Endowment10.14778/3401960.340196313:10(1641-1653)Online publication date: 10-Mar-2021
https://dl.acm.org/doi/10.14778/3401960.3401963
Show More Cited By

Index Terms

XMark: a benchmark for XML data management

Recommendations

An XML/XPath Query Language and XMark Performance Study
SAINT '03: Proceedings of the 2003 Symposium on Applications and the Internet

An XML/XPath query language that operates overXML documents and produces XML documents as resultsis introduced and illustrated. It provides a basis for viewdefinition, view integration, query processing, andoptimization. The XMark Benchmark for XML ...
Querying relational databases through XSLT

XML has been accepted as a universal format for data interchange and publication. It can be applied in the applications in which the data of a database needs to be viewed in XML format so that the data being viewed takes more semantics and is easily ...
Assessing XML Data Management with XMark
Proceedings of the VLDB 2002 Workshop EEXTT and CAiSE 2002 Workshop DTWeb on Efficiency and Effectiveness of XML Tools and Techniques and Data Integration over the Web-Revised Papers

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

VLDB '02: Proceedings of the 28th international conference on Very Large Data Bases

August 2002

1110 pages

Publisher

VLDB Endowment

Publication History

Published: 20 August 2002

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

245
Total Citations
View Citations
825
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lin YHe YChaudhuri S(2023)Auto-BI: Automatically Build BI-Models Leveraging Local Join Prediction and Global Schema GraphProceedings of the VLDB Endowment10.14778/3603581.360359616:10(2578-2590)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.14778/3603581.3603596
Trofimov ASokolov NMarshalkin NKuralenok INovikov BZhou YChrysanthis PGulisano V(2022)Substream management in distributed streaming dataflowsProceedings of the 16th ACM International Conference on Distributed and Event-Based Systems10.1145/3524860.3539809(55-66)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3524860.3539809
Wellenzohn KBöhlen MHelmer S(2021)Dynamic interleaving of content and structure for robust indexing of semi-structured hierarchical dataProceedings of the VLDB Endowment10.14778/3401960.340196313:10(1641-1653)Online publication date: 10-Mar-2021
https://dl.acm.org/doi/10.14778/3401960.3401963
Begoli EAkidau THueske FHyde JKnight KKnowles KBoncz PManegold SAilamaki ADeshpande AKraska T(2019)One SQL to Rule Them All - an Efficient and Syntactically Idiomatic Approach to Management of Streams and TablesProceedings of the 2019 International Conference on Management of Data10.1145/3299869.3314040(1757-1772)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3299869.3314040
Baelde DLick ASchmitz SSuciu DSkritek SKoch C(2019)Decidable XPath Fragments in the Real WorldProceedings of the 38th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems10.1145/3294052.3319685(285-302)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3294052.3319685
Kim SLee KLee Y(2017)Multi-query processing of XML data streams on multicoreThe Journal of Supercomputing10.1007/s11227-016-1919-073:6(2339-2368)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11227-016-1919-0
Abul-Basher ZChignell MGodfrey PYakovets NMindel MMüller HOnut V(2016)TGDBProceedings of the 26th Annual International Conference on Computer Science and Software Engineering10.5555/3049877.3049905(257-267)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.5555/3049877.3049905
Sankari SBose S(2016)Efficient Identification of Structural Relationships for XML Queries using Secure Labeling SchemesInternational Journal of Intelligent Information Technologies10.4018/IJIIT.201610010412:4(63-80)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.4018/IJIIT.2016100104
Kuramitsu KVisser EMurphy-Hill ELopes C(2016)Nez: practical open grammar languageProceedings of the 2016 ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software10.1145/2986012.2986019(29-42)Online publication date: 20-Oct-2016
https://dl.acm.org/doi/10.1145/2986012.2986019
Qtaish AAhmad K(2016)XAncestorKnowledge-Based Systems10.1016/j.knosys.2016.10.009114:C(167-192)Online publication date: 15-Dec-2016
https://dl.acm.org/doi/10.1016/j.knosys.2016.10.009
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents