Richard Cole
ABSTRACT
While standardized and widely used benchmarks address either operational or real-time Business Intelligence (BI) workloads, the lack of a hybrid benchmark led us to the definition of a new, complex, mixed workload benchmark, called mixed workload CH-benCHmark. This benchmark bridges the gap between the established single-workload suites of TPC-C for OLTP and TPC-H for OLAP, and executes a complex mixed workload: a transactional workload based on the order entry processing of TPC-C and a corresponding TPC-H-equivalent OLAP query suite run in parallel on the same tables in a single database system. As it is derived from these two most widely used TPC benchmarks, the CH-benCHmark produces results highly relevant to both hybrid and classic single-workload systems.
- A. Bog, K. Sachs, and A. Zeier. Benchmarking Database Design for Mixed OLTP and OLAP Workloads. In ICPE'11, 2011. Google Scholar
Digital Library
- A. Bog, J. Schaffiner, and J. Krüger. A Composite Benchmark for Online Transaction Processing and Operational Reporting. In IEEE Symposium on Advanced Management of Information for Globalized Enterprises (AMIGE), 2008.Google ScholarCross Ref
- D. Feinberg and M. A. Beyer. Magic Quadrant for Data Warehouse Database Management Systems. http://www.gartner.com/technology/media-products/reprints/teradata/vol3/article1/article1.html, 2011.Google Scholar
- F. Funke, A. Kemper, and T. Neumann. Benchmarking Hybrid OLTP&OLAP Database Systems. In Database Systems for Business, Technology and Web (BTW), 2011.Google Scholar
- M. Poess and C. Floyd. New TPC Benchmarks for Decision Support and Web Commerce. SIGMOD Record, 29(4):64--71, 2000. Google ScholarDigital Library
- Transaction Processing Performance Council. TPC Benchmark C (Standard Specification), 2010.Google Scholar
- Transaction Processing Performance Council. TPC Benchmark H (Standard Specification), 2010.Google Scholar
- VoltDB. TPC-C-like Benchmark Comparison-Benchmark Description. http://community.voltdb.com/node/134.Google Scholar
Index Terms
- The mixed workload CH-benCHmark
Recommendations
Subsetting the SPEC CPU2006 benchmark suite
On August 24, 2006, the Standard Performance Evaluation Corporation (SPEC) announced CPU2006 -- the next generation of industry-standardized CPU-intensive benchmark suite. The SPEC CPU benchmark suite has become the most frequently used suite for ...
A generic construct based workload model for business intelligence benchmark
Benchmarks are vital tools in the performance measurement and evaluation of computer hardware and software systems. Standard benchmarks such as the TREC, TPC, SPEC, SAP, Oracle, Microsoft, IBM, Wisconsin, AS^3AP, OO1, OO7, XOO7 benchmarks have been used ...
A Benchmark Characterization of the EEMBC Benchmark Suite
Benchmark consumers expect benchmark suites to be complete, accurate, and consistent, and benchmark scores serve as relative measures of performance. However, it is important to understand how benchmarks stress the processors that they aim to test. This ...
Comments