LargeRDFBench: A billion triples benchmark for SPARQL endpoint federation
View/ Open
Date
2018-01-12Author
Saleem, Muhammad
Hasnain, Ali
Ngonga Ngomo, Axel-Cyrille
Metadata
Show full item recordUsage
This item's downloads: 424 (view details)
Cited 19 times in Scopus (view citations)
Recommended Citation
Saleem, Muhammad, Hasnain, Ali, & Ngonga Ngomo, Axel-Cyrille. (2018). LargeRDFBench: A billion triples benchmark for SPARQL endpoint federation. Journal of Web Semantics, 48, 85-125. doi: https://doi.org/10.1016/j.websem.2017.12.005
Published Version
Abstract
Gathering information from the distributed Web of Data is commonly carried out by using SPARQL query federation approaches. However, the fitness of current SPARQL query federation approaches for real applications is difficult to evaluate with current benchmarks as they are either synthetic, too small in size and complexity or do not provide means for a fine-grained evaluation. We propose LargeRDFBench, a billion-triple benchmark for SPARQL query federation which encompasses real data as well as real queries pertaining to real bio-medical use cases. We evaluate state-of-the-art SPARQL endpoint federation approaches on this benchmark with respect to their query runtime, triple pattern-wise source selection, number of endpoints requests, and result completeness and correctness. Our evaluation results suggest that the performance of current SPARQL query federation systems on simple queries (in terms of total triple patterns, query result set sizes, execution time, use of SPARQL features etc.) does not reflect the systems performance on more complex queries. Moreover, current federation systems seem unable to deal with real queries that involve processing large intermediate result sets or lead to large result sets.