StarMR: An Efficient Star-Decomposition Based Query Processor for SPARQL Basic Graph Patterns Using MapReduce

Qiang Xu, Xin Wang, Jianxin Li, Ying Gan, Lele Chai, Junhu Wang

Research output: Chapter in Book/Conference paperConference paper

Abstract

With the proliferation of knowledge graphs, large amounts of RDF graphs have been released, which raises the need for addressing the challenge of distributed SPARQL queries. In this paper, we propose an efficient distributed method, called, to answer the SPARQL basic graph pattern (BGP) queries on big RDF graphs using MapReduce. In our method, query graphs are decomposed into a set of stars that utilize the semantic and structural information embedded RDF graphs as heuristics. Two optimization techniques are proposed to further improve the efficiency of our algorithms. One filters out invalid input data, the other postpones the Cartesian product operations. The extensive experiments on both synthetic and real-world datasets show that our method outperforms the state-of-the-art method S2X by an order of magnitude.

Original languageEnglish
Title of host publicationWeb and Big Data: Second International Joint Conference, APWeb-WAIM 2018
Subtitle of host publicationMacau, China, July 23-25, 2018: Proceedings, Part I
EditorsYi Cai, Yoshiharu Ishikawa, Jianliang Xu
Place of PublicationCham, Switzerland
PublisherSpringer-Verlag London Ltd.
Pages415-430
ISBN (Electronic)9783319968902
ISBN (Print)9783319968896
DOIs
Publication statusPublished - 2018
Event2nd Asia Pacific Web and Web-Age Information Management Joint Conference on Web and Big Data, APWeb-WAIM 2018 - Macau, China
Duration: 23 Jul 201825 Jul 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10987 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference2nd Asia Pacific Web and Web-Age Information Management Joint Conference on Web and Big Data, APWeb-WAIM 2018
CountryChina
CityMacau
Period23/07/1825/07/18

    Fingerprint

Cite this

Xu, Q., Wang, X., Li, J., Gan, Y., Chai, L., & Wang, J. (2018). StarMR: An Efficient Star-Decomposition Based Query Processor for SPARQL Basic Graph Patterns Using MapReduce. In Y. Cai, Y. Ishikawa, & J. Xu (Eds.), Web and Big Data: Second International Joint Conference, APWeb-WAIM 2018: Macau, China, July 23-25, 2018: Proceedings, Part I (pp. 415-430). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10987 LNCS). Cham, Switzerland: Springer-Verlag London Ltd.. https://doi.org/10.1007/978-3-319-96890-2_34