The SDEval benchmarking toolkit. In this paper we will present SDeval, a software project that contains tools for creating and running benchmarks with a focus on problems in computer algebra. It is built on top of the Symbolic Data project, able to translate problems in the database into executable code for various computer algebra systems. The included tools are designed to be very flexible to use and to extend, such that they can be easily deployed even in contexts of other communities. We also address particularities of benchmarking in the field of computer algebra. Furthermore, with SDEval, we provide a feasible and automatable way of reproducing benchmarks published in current research works, which appears to be a difficult task in general due to the customizability of the available programs.
Keywords for this software
References in zbMATH (referenced in 10 articles )
Showing results 1 to 10 of 10.
- England, Matthew; Florescu, Dorian: Comparing machine learning models to choose the variable ordering for cylindrical algebraic decomposition (2019)
- Huang, Zongyan; England, Matthew; Wilson, David J.; Bridge, James; Davenport, James H.; Paulson, Lawrence C.: Using machine learning to improve cylindrical algebraic decomposition (2019)
- Heinle, Albert; Levandovskyy, Viktor: Factorization of ( \mathbbZ)-homogeneous polynomials in the first (q)-Weyl algebra (2017)
- Minimair, Manfred: Computing the Dixon resultant with the Maple package DR (2017)
- Minimair, Manfred: Collaborative computer algebra (2017)
- Giesbrecht, Mark; Heinle, Albert; Levandovskyy, Viktor: Factoring linear partial differential operators in (n) variables (2016)
- Gräbe, Hans-Gert: Semantic-aware fingerprints of symbolic research data (2016)
- Heinle, Albert; Levandovskyy, Viktor: The \textscSDEvalbenchmarking toolkit (2015)
- Giesbrecht, Mark; Heinle, Albert; Levandovskyy, Viktor: Factoring linear differential operators in (n) variables (2014)
- Levandovskyy, Viktor; Studzinski, Grischa; Schnitzler, Benjamin: Enhanced computations of Gröbner bases in free algebras as a new application of the letterplace paradigm (2013)