research-article

FedQPL: A Language for Logical Query Plans over Heterogeneous Federations of RDF Data Sources

Authors:

Sijin Cheng and

Olaf HartigAuthors Info & Claims

iiWAS '20: Proceedings of the 22nd International Conference on Information Integration and Web-based Applications & Services

November 2020

Pages 436 - 445

https://doi.org/10.1145/3428757.3429120

Published: 27 January 2021 Publication History

Abstract

Federations of RDF data sources provide great potential when queried for answers and insights that cannot be obtained from one data source alone. A challenge for planning the execution of queries over such a federation is that the federation may be heterogeneous in terms of the types of data access interfaces provided by the federation members. This challenge has not received much attention in the literature. This paper provides a solid formal foundation for future approaches that aim to address this challenge. Our main conceptual contribution is a formal language for representing query execution plans; additionally, we identify a fragment of this language that can be used to capture the result of selecting relevant data sources for different parts of a given query. As technical contributions, we show that this fragment is more expressive than what is supported by existing source selection approaches, which effectively highlights an inherent limitation of these approaches. Moreover, we show that the source selection problem is NP-hard and in σP2, and we provide an extensive set of rewriting rules that can be used as a basis for query optimization.

References

[1]

Ibrahim Abdelaziz, Essam Mansour, Mourad Ouzzani, Ashraf Aboulnaga, and Panos Kalnis. 2017. Lusail: A System for Querying Linked Data at Scale. Proceedings of the VLDB Endowment (PVLDB) 11, 4 (2017).

Digital Library

[2]

Maribel Acosta, Olaf Hartig, and Juan F. Sequeda. 2019. Federated RDF Query Processing. In Encyclopedia of Big Data Technologies. Springer.

[3]

Maribel Acosta, Maria-Esther Vidal, Tomas Lampo, Julio Castillo, and Edna Ruckhaus. 2011. ANAPSID: An Adaptive Query Processing Engine for SPARQL Endpoints. In Proc. of the 11th International Semantic Web Conference (ISWC).

Digital Library

[4]

Amr Azzam, Javier D. Fernández, Maribel Acosta, Martin Beno, and Axel Polleres. 2020. SMART-KG: Hybrid Shipping for SPARQL Querying on the Web. In Proceedings of The Web Conference (WWW).

Digital Library

[5]

Philip A. Bernstein, Nathan Goodman, Eugene Wong, Christopher L. Reeve, and James B. Rothnie Jr. 1981. Query Processing in a System for Distributed Databases (SDD-1). ACM Trans. Database Syst. 6, 4 (1981).

Digital Library

[6]

Carlos Buil-Aranda, Aidan Hogan, Jürgen Umbrich, and Pierre-Yves Vandenbussche. 2013. SPARQL Web-Querying Infrastructure: Ready for Action?. In Proceedings of the 12th International Semantic Web Conference (ISWC).

Digital Library

[7]

Angelos Charalambidis, Antonis Troumpoukis, and Stasinos Konstantopoulos. 2015. SemaGrow: Optimizing Federated SPARQL Queries. In Proc. of the 11th International Conference on Semantic Systems (SEMANTICS).

Digital Library

[8]

Sijin Cheng and Olaf Hartig. 2020. FedQPL: A Language for Logical Query Plans over Heterogeneous Federations of RDF Data Sources (Extended Version). Online at http://olafhartig.de/FedQPL.ext.pdf.

[9]

Lee Feigenbaum, Gregory Todd Williams, Kendall Grant Clark, and Elias Torres. 2013. SPARQL 1.1 Protocol. W3C Recommendation.

[10]

Olaf Görlitz and Steffen Staab. 2011. Federated Data Management and Query Optimization for Linked Open Data. In New Directions in Web Data Management 1.

[11]

Olaf Görlitz and Steffen Staab. 2011. SPLENDID: SPARQL Endpoint Federation Exploiting VOID Descriptions. In Proc. of the 2nd International Workshop on Consuming Linked Data (COLD).

Digital Library

[12]

Laura M. Haas, Donald Kossmann, Edward L. Wimmers, and Jun Yang. 1997. Optimizing Queries Across Diverse Data Sources. In Proc. of the 23rd International Conference on Very Large Data Bases (VLDB).

Digital Library

[13]

Steve Harris, Andy Seaborne, and Eric Prud'hommeaux. 2013. SPARQL 1.1 Query Language. W3C Recommendation, Online at http://www.w3.org/TR/sparql11-query/.

[14]

Olaf Hartig, Christian Bizer, and Johann Christoph Freytag. 2009. Executing SPARQL Queries over the Web of Linked Data. In Proc. of the 8th International Semantic Web Conf. (ISWC).

Digital Library

[15]

Olaf Hartig and Carlos Buil-Aranda. 2016. Bindings-Restricted Triple Pattern Fragments. In 15th Ontologies, Databases, and Applications of Semantics (ODBASE).

[16]

Olaf Hartig, Ian Letter, and Jorge Pérez.2017. A Formal Framework for Comparing Linked Data Fragments. In Proc. of the 16th Int. Semantic Web Conf. (ISWC).

[17]

Richard M. Karp. 1972. Reducibility Among Combinatorial Problems. In Proceedings of a Symposium on the Complexity of Computer Computations.

[18]

Günter Ladwig and Thanh Tran. 2010. Linked Data Query Processing Strategies. In Proceedings of the 9th International Semantic Web Conference (ISWC).

Digital Library

[19]

Thomas Minier, Hala Skaf-Molli, and Pascal Molli. 2019. SaGe: Web Preemption for Public SPARQL Query Services. In Proceedings of the Web Conference (WWW).

Digital Library

[20]

Damla Oguz, Belgin Ergenc, Shaoyi Yin, Oguz Dikenelli, and Abdelkader Hameurlain. 2015. Federated Query Processing on Linked Data: A Qualitative Survey and Open Challenges. Knowledge Eng. Review 30, 5 (2015).

[21]

Jorge Pérez, Marcelo Arenas, and Claudio Gutierrez. 2009. Semantics and Complexity of SPARQL. ACM Trans. Database Syst. 34, 3 (2009).

Digital Library

[22]

Bastian Quilitz and Ulf Leser. 2008. Querying Distributed RDF Data Sources with SPARQL. In Proceedings of the 5th European Semantic Web Conference (ESWC).

Digital Library

[23]

Muhammad Saleem, Alexander Potocki, Tommaso Soru, Olaf Hartig, and Axel-Cyrille Ngonga Ngomo. 2018. CostFed: Cost-Based Query Optimization for SPARQL Endpoint Federation. In Proc. of the 14th Int. Conf. on Semantic Systems.

[24]

Michael Schmidt, Olaf Görlitz, Peter Haase, Günter Ladwig, Andreas Schwarte, and Thanh Tran. 2011. FedBench: A Benchmark Suite for Federated Semantic Data Query Processing. In Proc. of the 10th Int. Semantic Web Conference (ISWC).

Digital Library

[25]

Michael Schmidt, Michael Meier, and Georg Lausen. 2010. Foundations of SPARQL Query Optimization. In Proc. of the 13th Int. Conference on Database Theory (ICDT).

Digital Library

[26]

Andreas Schwarte, Peter Haase, Katja Hose, Ralf Schenkel, and Michael Schmidt. 2011. FedX: Optimization Techniques for Federated Query Processing on Linked Data. In Proceedings of the 10th International Semantic Web Conference (ISWC).

Digital Library

[27]

Jürgen Umbrich, Katja Hose, Marcel Karnstedt, Andreas Harth, and Axel Polleres. 2011. Data Summaries for Processing Live Queries over Linked Data. World Wide Web 14, 5-6 (2011).

Digital Library

[28]

Ruben Verborgh, Miel Vander Sande, Olaf Hartig, Joachim Van Herwegen, Laurens De Vocht, Ben De Meester, Gerald Haesendonck, and Pieter Colpaert. 2016. Triple Pattern Fragments: A Low-Cost Knowledge Graph Interface for the Web. Journal of Web Semantics 37 (2016).

Digital Library

[29]

Maria-Esther Vidal, Simón Castillo, Maribel Acosta, Gabriela Montoya, and Guillermo Palma. 2016. On the Selection of SPARQL Endpoints to Efficiently Execute Federated SPARQL Queries. Trans. Large-Scale Data- and Knowledge-Centered Systems 25 (2016).

Digital Library

[30]

Maria-Esther Vidal, Edna Ruckhaus, Tomas Lampo, Amadís Martínez, Javier Sierra, and Axel Polleres. 2010. Efficiently Joining Group Patterns in SPARQL Queries. In Proceedings of the 7th Extended Semantic Web Conference (ESWC).

Digital Library

Cited By

Dang MAimonier-Davat JMolli PHartig OSkaf-Molli HLe Crom Y(2023)FedShop: A Benchmark for Testing the Scalability of SPARQL Federation EnginesThe Semantic Web – ISWC 202310.1007/978-3-031-47243-5_16(285-301)Online publication date: 27-Oct-2023
https://doi.org/10.1007/978-3-031-47243-5_16
Taelman RVerborgh R(2023)Link Traversal Query Processing Over Decentralized Environments with Structural AssumptionsThe Semantic Web – ISWC 202310.1007/978-3-031-47240-4_1(3-22)Online publication date: 27-Oct-2023
https://doi.org/10.1007/978-3-031-47240-4_1
Cheng SFerrada SHartig O(2023)Considering Vocabulary Mappings in Query Plans for Federations of RDF Data SourcesCooperative Information Systems10.1007/978-3-031-46846-9_2(21-40)Online publication date: 25-Oct-2023
https://doi.org/10.1007/978-3-031-46846-9_2
Show More Cited By

Index Terms

FedQPL: A Language for Logical Query Plans over Heterogeneous Federations of RDF Data Sources
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database query processing
        Query planning
    2. Information integration
      1. Federated databases
      2. Mediators and data integration
  2. World Wide Web
    1. Web interfaces

Recommendations

Federated SPARQL Query Processing over Heterogeneous Linked Data Fragments
WWW '22: Proceedings of the ACM Web Conference 2022

Linked Data Fragments (LDFs) are Web interfaces that enable querying knowledge graphs on the Web. These interfaces, such as SPARQL endpoints or Triple Pattern Fragment servers, differ in the SPARQL expressions they can evaluate and the metadata they ...
Read More
Enabling Live SPARQL Queries over ConceptNet Using Triple Pattern Fragments
The Semantic Web
Abstract
We describe how we used a Triple Pattern Fragments (TPF) interface and the Comunica knowledge graph querying framework to enable live SPARQL queries over ConceptNet, one of largest knowledge graphs for commonsense reasoning publicly available on ...
Read More
Using the relation ontology Metarel for modelling Linked Data as multi-digraphs
Linked Data for Health Care and the Life Sciences

The Semantic Web standards OWL and RDF are often used to represent biomedical information as Linked Data; however, the OWL/RDF syntax, which combines both, was never optimised for querying. By combining two formal paradigms for modelling Linked Data, ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

iiWAS '20: Proceedings of the 22nd International Conference on Information Integration and Web-based Applications & Services

November 2020

492 pages

ISBN:9781450389228

DOI:10.1145/3428757

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Johannes Kepler University, Linz, Austria

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 January 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Swedish Research Council

Conference

iiWAS '20

iiWAS '20: The 22nd International Conference on Information Integration and Web-based Applications & Services

November 30 - December 2, 2020

Chiang Mai, Thailand

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
90
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Dang MAimonier-Davat JMolli PHartig OSkaf-Molli HLe Crom Y(2023)FedShop: A Benchmark for Testing the Scalability of SPARQL Federation EnginesThe Semantic Web – ISWC 202310.1007/978-3-031-47243-5_16(285-301)Online publication date: 27-Oct-2023
https://doi.org/10.1007/978-3-031-47243-5_16
Taelman RVerborgh R(2023)Link Traversal Query Processing Over Decentralized Environments with Structural AssumptionsThe Semantic Web – ISWC 202310.1007/978-3-031-47240-4_1(3-22)Online publication date: 27-Oct-2023
https://doi.org/10.1007/978-3-031-47240-4_1
Cheng SFerrada SHartig O(2023)Considering Vocabulary Mappings in Query Plans for Federations of RDF Data SourcesCooperative Information Systems10.1007/978-3-031-46846-9_2(21-40)Online publication date: 25-Oct-2023
https://doi.org/10.1007/978-3-031-46846-9_2
Mohammed HDoğdu EChoupani RZarbega T(2023)Distributed Query Processing and Reasoning Over Linked Big DataThe Recent Advances in Transdisciplinary Data Science10.1007/978-3-031-23387-6_11(158-170)Online publication date: 29-Jan-2023
https://doi.org/10.1007/978-3-031-23387-6_11
Troumpoukis AKonstantopoulos SProkopaki-Kostopoulou N(2022)A geospatial source selector for federated GeoSPARQL queryingOpen Research Europe10.12688/openreseurope.14605.22(48)Online publication date: 6-Oct-2022
https://doi.org/10.12688/openreseurope.14605.2
Cheng SHartig O(2022)Towards Query Processing over Heterogeneous Federations of RDF Data SourcesThe Semantic Web: ESWC 2022 Satellite Events10.1007/978-3-031-11609-4_11(57-62)Online publication date: 20-Jul-2022
https://doi.org/10.1007/978-3-031-11609-4_11

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents