Orri Erling
Hassan Chafi
ABSTRACT
The Linked Data Benchmark Council (LDBC) is now two years underway and has gathered strong industrial participation for its mission to establish benchmarks, and benchmarking practices for evaluating graph data management systems. The LDBC introduced a new choke-point driven methodology for developing benchmark workloads, which combines user input with input from expert systems architects, which we outline. This paper describes the LDBC Social Network Benchmark (SNB), and presents database benchmarking innovation in terms of graph query functionality tested, correlated graph generation techniques, as well as a scalable benchmark driver on a workload with complex graph dependencies. SNB has three query workloads under development: Interactive, Business Intelligence, and Graph Algorithms. We describe the SNB Interactive Workload in detail and illustrate the workload with some early results, as well as the goals for the two other workloads.
- T. G. Armstrong, V. Ponnekanti, D. Borthakur, and M. Callaghan. LinkBench: A Database Benchmark Based on the Facebook Social Graph. SIGMOD '13, 2013. Google Scholar
Digital Library
- S. Barahmand and S. Ghandeharizadeh. Bg: A benchmark to evaluate interactive social networking actions. In CIDR, 2013.Google Scholar
- P. A. Boncz, T. Neumann, and O. Erling. TPC-H analyzed: Hidden messages and lessons learned from an influential benchmark. In TPCTC, pages 61--76, 2013.Google Scholar
- A. Clauset, C. R. Shalizi, and M. E. Newman. Power-law distributions in empirical data. SIAM review, 2009. Google ScholarDigital Library
- A. Gubichev. Benchmarking transactions. http://ldbc.eu/sites/default/files/LDBC_D2.2.3_final.pdf.Google Scholar
- A. Gubichev and P. Boncz. Parameter curation for benchmark queries. TPCTC'14.Google Scholar
- J. Leskovec et al. Meme-tracking and the dynamics of the news cycle. In SIGKDD, 2009. Google ScholarDigital Library
- M. McPherson et al. Birds of a feather: Homophily in social networks. Annual review of sociology, 2001.Google Scholar
- G. Moerkotte. Building Query Compilers. http://pi3.informatik.uni-mannheim.de/ moer/querycompiler.pdf.Google Scholar
- M.-D. Pham, P. Boncz, and O. Erling. S3G2: a Scalable Structure-correlated Social Graph Generator. In TPCTC, 2012.Google Scholar
- A. Prat and A. Averbuch. Benchmark design for navigational pattern matching benchmarking. http://ldbcouncil.org/sites/default/files/LDBC_D3.3.34.pdf.Google Scholar
- A. Prat and A. Averbuch. Benchmark design for navigational pattern matching benchmarking - Benchmark Executions. http://ldbcouncil.org/sites/default/files/LDBC_D3.3.34_appendix.pdf.Google Scholar
- A. Prat-Pérez and D. Domínguez-Sal. How community-like is the structure of synthetically generated graphs? In GRADES, 2014.Google ScholarDigital Library
- J. Ugander et al. The anatomy of the facebook social graph. arXiv preprint arXiv:1111.4503, 2011.Google Scholar
- J. Wiener and N. Bronson. Facebook's top open data problems. https://research.facebook.com/blog/1522692927972019/facebook-s-top-open-data-problems/, 2014.Google Scholar
Index Terms
- The LDBC Social Network Benchmark: Interactive Workload
Recommendations
The LDBC Social Network Benchmark: Business Intelligence Workload
The Social Network Benchmark's Business Intelligence workload (SNB BI) is a comprehensive graph OLAP benchmark targeting analytical data systems capable of supporting graph workloads. This paper marks the finalization of almost a decade of research in ...
A Benchmark Characterization of the EEMBC Benchmark Suite
Benchmark consumers expect benchmark suites to be complete, accurate, and consistent, and benchmark scores serve as relative measures of performance. However, it is important to understand how benchmarks stress the processors that they aim to test. This ...
An early look at the LDBC social network benchmark's business intelligence workload
GRADES-NDA '18: Proceedings of the 1st ACM SIGMOD Joint International Workshop on Graph Data Management Experiences & Systems (GRADES) and Network Data Analytics (NDA)In this short paper, we provide an early look at the LDBC Social Network Benchmark's Business Intelligence (BI) workload which tests graph data management systems on a graph business analytics workload. Its queries involve complex aggregations and ...
Comments