Albert Heinle
Abstract
In this paper we will present SDeval, a software project that contains tools for creating and running benchmarks with a focus on problems in computer algebra. It is built on top of the Symbolic Data project, able to translate problems in the database into executable code for various computer algebra systems. The included tools are designed to be very flexible to use and to extend, such that they can be easily deployed even in contexts of other communities. We also address particularities of benchmarking in the field of computer algebra.
Furthermore, with SDEval, we provide a feasible and automatable way of reproducing benchmarks published in current research works, which appears to be a difficult task in general due to the customizability of the available programs.
- {BST10} Clark Barrett, Aaron Stump, and Cesare Tinelli. The smt-lib standard: Version 2.0. In Proceedings of the 8th International Workshop on Satisfiability Modulo Theories (Edinburgh, England), volume 13, 2010.Google Scholar
- {DMB08} Leonardo De Moura and Nikolaj Bjørner. Z3: An efficient SMT solver. In Tools and Algorithms for the Construction and Analysis of Systems, pages 337--340. Springer, 2008. Google ScholarDigital Library
- {BCD+11} Clark Barrett, Christopher L. Conway, Morgan Deters, Liana Hadarean, Dejan Jovanović, Tim King, Andrew Reynolds, and Cesare Tinelli. Cvc4. In Computer Aided Verification, pages 171--177. Springer, 2011.Google ScholarDigital Library
- {Neu12} Severin Neumann. Parallel reduction of matrices in Gröbner bases computations. In Vladimir P. Gerdt, Wolfram Koepf, Ernst W. Mayr, and Evgenii V. Vorozhtsov, editors, Computer Algebra in Scientific Computing, volume 7442 of Lecture Notes in Computer Science, pages 260--270. Springer Berlin Heidelberg, 2012. URL http://dx.doi.org/10.1007/978-3-642-32973-9_22. Google ScholarDigital Library
- {KFI+87} S. Katsura, W. Fukuda, S. Inawashiro, N. M. Fujiki, and R. Gebauer. Distribution of effective field in the Ising spin glass of the ±j model at T =0. Cell Biophysics, 11(1): 309--319, 1987.Google ScholarCross Ref
- {BH08} Goran Bjorck and Uffe Haagerup. All cyclic p-roots of index 3, found by symmetry-preserving calculations. arXiv preprint arXiv:0803.2506, 2008.Google Scholar
- {LRP07} V. Levandovskyy, C. Rosenkranz, and T. Povalyayeva. Online database gröbner bases implementations. functionality check and comparison, 2007. URL http://www.risc.uni-linz.ac.at/Groebner-Bases-Implementations/.Google Scholar
- {Grä09} Hans-Gert Gräbe. The SymbolicData project. Technical report, Technical report (2000--2009), 2009. URL http://www.symbolicdata.org.Google Scholar
- {GNJ13} Hans-Gert Gräbe, Andreas Nareike, and Simon Johanning. The SymbolicData project--towards a computer algebra social network. 2013.Google Scholar
- {HLN13} Albert Heinle, Viktor Levandovskyy, and Andreas Nareike. SymbolicData: SDEval - benchmarking for everyone. arXiv preprint arXiv:1310.5551, 2013.Google Scholar
- {CCH+11} Svetlana Cojocaru, Alexandru Colesnicov, Albert Heinle, Viktor Levandovskyy, Ludmila Malahov, Grischa Studzinski, and Victor Ufnarovski. Creation of a knowledge framework for non-commutative computer algebra. In Proc. 7th International Conference on Microelectronics and Computer Science, Chişinău, Republic of Moldova, pages 166--169, 2011.Google Scholar
- {HL13} Albert Heinle and Viktor Levandovskyy. Factorization of Z-homogeneous polynomials in the first (q)-Weyl algebra. arXiv preprint arXiv:1302.5674, 2013.Google Scholar
- {GHL14} Mark Giesbrecht, Albert Heinle, and Viktor Levandovskyy. Factoring linear differential operators in n variables. In Proceedings of the 39th International Symposium on Symbolic and Algebraic Computation, pages 194--201. ACM, 2014. Google ScholarDigital Library
- {AGK96} Beatrice Amrhein, Oliver Gloor, and Wolfgang Küchlin. Walking faster. In Design and Implementation of Symbolic Computation Systems, pages 150--161. Springer, 1996.Google Scholar
- {SST12} Aaron Stump, Geoff Sutcliffe, and Cesare Tinelli. Introducing StarExec: a cross-community infrastructure for logic solving. Comparative Empirical Evaluation of Reasoning Systems, page 2, 2012.Google Scholar
- {BR08} Mohamed Barakat and Daniel Robertz. homalg --- a meta-package for homological algebra. Journal of Algebra and its Applications, 7(03): 299--317, 2008.Google ScholarCross Ref
- {GAP13} GAP. GAP -- Groups, Algorithms, and Programming, Version 4.6.3. The GAP Group, 2013. URL http://www.gap-system.org.Google Scholar
- {S+08} William Stein et al. Sage: Open source mathematical software, 2008. URL http://www.sagemath.org.Google Scholar
- {SEW12} Satya Swarup Samal, Hassan Errami, and Andreas Weber. PoCaB: a software infrastructure to explore algebraic methods for bio-chemical reaction networks. In Computer Algebra in Scientific Computing, pages 294--307. Springer, 2012. Google ScholarDigital Library
- {KG00} Minoru Kanehisa and Susumu Goto. KEGG: Kyoto encyclopedia of genes and genomes. Nucleic acids research, 28(1): 27--30, 2000.Google Scholar
- {LNBB+06} Nicolas Le Novere, Benjamin Bornstein, Alexander Broicher, Melanie Courtot, Marco Donizelli, Harish Dharuri, Lu Li, Herbert Sauro, Maria Schilstra, Bruce Shapiro, et al. BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems. Nucleic acids research, 34(suppl 1): D689--D691, 2006.Google Scholar
Index Terms
- The SDEval benchmarking toolkit
Recommendations
Benchmarking simple database operations
SIGMOD '87: Proceedings of the 1987 ACM SIGMOD international conference on Management of dataThere are two widely-known benchmarks for database management systems the TP1 benchmarks (Anon et al [1985]), designed to measure transaction throughout, and the Wisconsin benchmarks (Bitton, Dewitt, & Turbyfil [1984]), designed to measure the ...
Benchmarking data warehouses
Database benchmarks can either help users in comparing the performances of different systems, or help engineers in testing the effect of various design choices. In the field of data warehouses, the Transaction Processing Performance Council's standard ...
Comments