Abstract
We present a benchmark that facilitates the evaluation of DAML+OIL repositories in a standard and systematic way. This benchmark is intended to evaluate the performance of DAML+OIL repositories with respect to extensional queries over a large data set that commits to a single realistic ontology. It consists of the ontology, customizable synthetic data, a set of test queries, and several performance metrics. Main features of the benchmark include a plausible ontology for the university domain, a repeatable data set that can be scaled to an arbitrary size, and an approach for measuring the degree to which a repository returns complete query answers. We also show a benchmark experiment for the evaluation of DLDB, a DAML+OIL repository that extends a relational database management system with description logic inference capabilities.
Chapter PDF
Similar content being viewed by others
References
Agrawal, R., Somani, A., Xu, Y.: Storage and Querying of E-Commerce Data. In: Proc. of VLDB 2001, the 27th International Conference on Very Large Data Bases (2001)
Alexaki, S., et al.: On Storing Voluminous RDF Description: The case of Web Portal Catalogs. In: Proc. of the 4th International Workshop on the Web and Databases (WebDB 2001) in conjunction with ACM SIGMOD 2001 Conference (2001)
Bitton, D., DeWitt, D., Turbyfill, C.: Benchmarking Database Systems, a Systematic Approach. In: Proc. of the 9th International Conference on Very Large Data Bases (1983)
Bitton, D., Turbyfill, C.: A Retrospective on the Wisconsin Benchmark. In: Readings in Database Systems, 2nd edn. (1994)
Cattell, R.G.G.: An Engineering Database Benchmark. In: Readings in Database Systems, 2nd edn. (1994)
Connolly, D., et al.: DAML+OIL Reference Description (March 2001), http://www.w3.org/TR/daml+oil-reference
Dean, M., et al.: Web Ontology Language (OWL) Reference Version 1.0. W3C Working Draft, November 12 (2002), http://www.w3.org/TR/2002/WD-owl-ref-20021112
Elhaik, Q., Rousset, M.-C., Ycart, B.: Generating Random Benchmarks for Description Logics. In: Proceedings of DL 1998 (1998)
Fikes, R., et al.: DAML Query Language (April 2003), http://www.daml.org/2003/04/dql
Gensereth, M., Fikes, R.: Knowledge Interchange Format. Stanford Logic Report Logic-92- 1, Stanford Univ., http://logic.stanford.edu/kif/kif.html
Gertz, M., Sattler, K.: A Model and Architecture for Conceptualized Data Annotations. Technical Report, Dept. of Computer Science, University of California, Davis (2001)
Heflin, J.: Univ1.0 Ontology, http://www.cs.umd.edu/projects/plus/DAML/onts/univ1.0.daml
Heflin, J., Pan, Z.: Univ-Bench Ontology, http://www.lehigh.edu/~zhp2/univ-bench.daml
Horrocks, I.: Benchmark Analysis with FaCT. In: Dyckhoff, R. (ed.) TABLEAUX 2000. LNCS, vol. 1847. Springer, Heidelberg (2000)
Horrocks, I.: The FaCT System. In: de Swart, H. (ed.) TABLEAUX 1998. LNCS (LNAI), vol. 1397, p. 307. Springer, Heidelberg (1998)
Horrocks, I., Patel-Schneider, P.: DL systems comparison. In: Proceedings of DL 1998 (1998)
Karvounarakis, G., Christophides, V., Plexousakis, D., Alexaki, S.: Querying Community Web Portals. Technical report, Institute of Computer Science, FORTH, Heraklion, Greece (2000), http://www.ics.forth.gr/proj/isst/RDF/RQL/rql.pdf
Magkanaraki, A., et al.: Benchmarking RDF schemas for the Semantic Web. In: Horrocks, I., Hendler, J. (eds.) ISWC 2002. LNCS, vol. 2342, p. 132. Springer, Heidelberg (2002)
Melnik, S.: Storing RDF in a relational database, http://www-db.stanford.edu/~melnik/rdf/db.html
Pan, Z., Heflin, J.: DLDB: Extending Relational Databases to Support Semantic Web Queries. Submitted to Workshop on Practical and Scaleable Semantic Systems, International Semantic Web Conference (2003)
Sintek, M., Decker, S.: TRIPLE – A Query, Inference, and Transformation Language for the Semantic Web. In: Horrocks, I., Hendler, J. (eds.) ISWC 2002. LNCS, vol. 2342, p. 364. Springer, Heidelberg (2002)
Stonebraker, M., et al.: The SEQUIOA 2000 Storage Benchmark. In: Readings in Database Systems, 2nd edn. (1994)
World Wide Web Consortium: Resource Description Framework (RDF), http://www.w3.org/RDF/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guo, Y., Heflin, J., Pan, Z. (2003). Benchmarking DAML+OIL Repositories. In: Fensel, D., Sycara, K., Mylopoulos, J. (eds) The Semantic Web - ISWC 2003. ISWC 2003. Lecture Notes in Computer Science, vol 2870. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39718-2_39
Download citation
DOI: https://doi.org/10.1007/978-3-540-39718-2_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20362-9
Online ISBN: 978-3-540-39718-2
eBook Packages: Springer Book Archive