Reproducing SV-COMP Results

A description on how we make the results of the competition reproducible can be found in the competition report; the components that are listed below in the table are described in Sect. 4 "Reproducibility".

Here is the list of components that were used for SV-COMP 2020:

Component Repository Release Tag
Verifier Archives git@gitlab.com:sosy-lab/sv-comp/archives-2020.git svcomp20
Verification Tasks git@github.com:sosy-lab/sv-benchmarks.git svcomp20
Benchmark Definitions git@github.com:sosy-lab/sv-comp.git svcomp20
BenchExec git@github.com:sosy-lab/benchexec.git 2.5.1

Verifiers

Verifier Lang. Jury member Affiliation Archive Bechmark definition Publication
Overview Chair Dirk Beyer LMU Munich, Germany
2LS C Viktor Malík Brno University of Technology, Czechia Download 2ls.xml ...
BRICK C Lei Bu Nanjing University, China Download brick.xml ...
CBMC C Michael Tautschnig Amazon Web Services, UK Download cbmc.xml ...
COASTAL Java Willem Visser Stellenbosch University, South Africa Download coastal.xml ...
CPA-BAM-BnB C Vadim Mutilin ISP RAS, Russia Download cpa-bam-bnb.xml ...
CPA-Seq C Martin Spiessl LMU Munich, Germany Download cpa-seq.xml ...
CPALockator C Pavel Andrianov ISP RAS, Russia Download cpa-lockator.xml ...
Dartagnan C Hernán Ponce de León Bundeswehr University Munich, Germany Download dartagnan.xml ...
DIVINE C Henrich Lauko Masaryk University, Czechia Download divine.xml ...
ESBMC C Felipe R. Monteiro Federal University of Amazonas, Brazil Download esbmc.xml ...
GACAL C Benjamin Quiring Northeastern University, USA Download gacal.xml ...
Java-Ranger Java Vaibhav Sharma University of Minnesota, USA Download java-ranger.xml ...
JayHorn Java Philipp Ruemmer Uppsala University, Sweden Download jayhorn.xml ...
JBMC Java Peter Schrammel University of Sussex, UK Download jbmc.xml ...
JDart Java Falk Howar TU Dortmund, Germany Download jdart.xml ...
Lazy-CSeq C Omar Inverso Gran Sasso Science Institute, Italy Download lazycseq.xml ...
Map2Check C Herbert Rocha Federal University of Roraima, Brazil Download map2check.xml ...
PeSCo C Cedric Richter Paderborn University, Germany Download pesco.xml ...
Pinaka C Saurabh Joshi IIT Hyderabad, India Download pinaka.xml ...
PredatorHP C Veronika Šoková Brno University of Technology, Czechia Download predatorhp.xml ...
SPF Java Willem Visser Amazon, USA Download spf.xml ...
Symbiotic C Marek Chalupa Masaryk University, Czechia Download symbiotic.xml ...
UAutomizer C Matthias Heizmann University of Freiburg, Germany Download uautomizer.xml ...
UKojak C Alexander Nutz University of Freiburg, Germany Download ukojak.xml ...
UTaipan C Daniel Dietsch University of Freiburg, Germany Download utaipan.xml ...
VeriAbs C Priyanka Darke Tata Consultancy Services, India Download veriabs.xml ...
VeriFuzz C Raveendra Kumar Medicherla Tata Consultancy Services, India Download verifuzz.xml ...
Yogar-CBMC C Liangze Yin National University of Defense Technology, China Download yogar-cbmc.xml ...

Validators

Validator Contact Affiliation Archive
Validator CPAchecker Karlheinz Friedberger, Martin Spießl LMU Munich, Germany Download
Validator Ultimate Automizer Daniel Dietsch, Matthias Heizmann Univesity of Freiburg, Germany Download
Validator CPA-witness2test Matthias Dangl, Thomas Lemberger LMU Munich, Germany Download
Validator FShell-witness2test Michael Tautschnig Queen Mary University of London, UK Download
Validator MetaVal Martin Spießl LMU Munich, Germany Download
Validator NITWIT Philipp Berger RWTH Aachen, Germany Download