A description on how we make the results of the competition reproducible
can be found in the
competition report;
the components that are listed below in the table are described in Sect. 4 "Reproducibility".
| Verifier |
Jury member |
Affiliation |
Archive |
Tool-info module |
Bechmark definition |
System description |
|
2LS
|
Peter Schrammel
|
University of Sussex, UK
|
1d64b376
|
two_ls.py
|
2ls.xml
|
...
|
|
AProVE
|
Jera Hensel
|
RWTH Aachen, Germany
|
cdf44d50
|
aprove.py
|
aprove.xml
|
...
|
|
BLAST
|
Vadim Mutilin
|
ISP RAS, Russia
|
78c5dc67
|
blast.py
|
blast.xml
|
...
|
|
CBMC
|
Michael Tautschnig
|
Queen Mary, UK
|
387e7cb0
|
cbmc.py
|
cbmc.xml
|
...
|
|
Ceagle
|
Guang Chen
|
Tsinghua University, China
|
cb96d3af
|
ceagle.py
|
ceagle.xml
|
...
|
|
CIVL
|
Stephen Siegel
|
University of Delaware, USA
|
81253841
|
civl.py
|
civl.xml
|
...
|
|
ConSequence
|
Anand Yeolekar
|
TCS, India
|
bf1616b0
|
consequence.py
|
consequence.xml
|
...
|
|
CPA-BAM-BnB
|
Pavel Andrianov
|
ISP RAS, Russia
|
53e9adef
|
cpachecker.py
|
cpa-bam-bnb.xml
|
...
|
|
CPA-kInd
|
Matthias Dangl
|
University of Passau, Germany
|
bbd2e382
|
cpachecker.py
|
cpa-kind.xml
|
...
|
|
CPA-Seq
|
Karlheinz Friedberger
|
University of Passau, Germany
|
1b29b355
|
cpachecker.py
|
cpa-seq.xml
|
...
|
|
DepthK
|
Herbert Oliveira Rocha
|
Federal University of Roraima, Brazil
|
b90f5e2a
|
depthk.py
|
depthk.xml
|
...
|
|
ESBMC
|
Lucas Cordeiro
|
University of Oxford, UK
|
6526f5da
|
esbmc.py
|
esbmc.xml
|
...
|
|
ESBMC-falsi
|
Bernd Fischer
|
Stellenbosch University, ZA
|
6526f5da
|
esbmc.py
|
esbmc-falsi.xml
|
...
|
|
ESBMC-incr
|
Denis Nicole
|
University of Southampton, UK
|
6526f5da
|
esbmc.py
|
esbmc-incr.xml
|
...
|
|
ESBMC-kind
|
Mikhail Ramalho
|
University of Southampton, UK
|
6526f5da
|
esbmc.py
|
esbmc-kind.xml
|
...
|
|
Forester
|
Martin Hruska
|
Brno University of Technology, Czechia
|
b44b8bd6
|
forester.py
|
forester.xml
|
...
|
|
HipTNT+
|
Ton Chanh Le
|
National University of Singapore, Singapore
|
e91179c3
|
hiptnt.py
|
hiptnt.xml
|
...
|
|
Lazy-CSeq
|
Omar Inverso
|
Gran Sasso Science Institute, Italy
|
0e4b695b
|
lazycseq.py
|
lazycseq.xml
|
...
|
|
Lazy-CSeq-Abs
|
Bernd Fischer
|
Stellenbosch University, ZA
|
0be19d3e
|
lazycseqabs.py
|
lazycseqabs.xml
|
...
|
|
Lazy-CSeq-Swarm
|
Truc Nguyen Lam
|
University of Southampton, UK
|
2217093e
|
lazycseqswarm.py
|
lazycseqswarm.xml
|
...
|
|
MU-CSeq
|
Salvatore La Torre
|
University of Salerno, Italy
|
23a41a3e
|
mucseq.py
|
mucseq.xml
|
...
|
|
PredatorHP
|
Tomas Vojnar
|
Brno University of Technology, Czechia
|
6ec477b4
|
predatorhp.py
|
predatorhp.xml
|
...
|
|
Skink
|
Franck Cassez
|
Macquarie University at Sydney, Australia
|
679e98f2
|
skink.py
|
skink.xml
|
...
|
|
SMACK
|
Zvonimir Rakamaric
|
University of Utah, USA
|
9c240b3d
|
smack.py
|
smack.xml
|
...
|
|
Symbiotic
|
Jan Strejček
|
Masaryk University, Czechia
|
903d8f7b
|
symbiotic4.py
|
symbiotic4.xml
|
...
|
|
SymDIVINE
|
Jiří Barnat
|
Masaryk University, Czechia
|
5ab0a23c
|
symdivine.py
|
symdivine.xml
|
...
|
|
UAutomizer
|
Matthias Heizmann
|
University of Freiburg, Germany
|
72b561e0
|
ultimateautomizer.py
|
uautomizer.xml
|
...
|
|
UKojak
|
Daniel Dietsch
|
University of Freiburg, Germany
|
e3a317e8
|
ultimatekojak.py
|
ukojak.xml
|
...
|
|
UL-CSeq
|
Gennaro Parlato
|
University of Southampton, UK
|
0d0c5328
|
ulcseq.py
|
ulcseq.xml
|
...
|
|
UTaipan
|
Marius Greitschus
|
University of Freiburg, Germany
|
eb90ef59
|
ultimatetaipan.py
|
utaipan.xml
|
...
|
|
VeriAbs
|
Priyanka Darke
|
TCS, India
|
44aec391
|
veriabs.py
|
veriabs.xml
|
...
|
|
Yogar-CBMC
|
Liangze Yin
|
National University of Defense Technology, China
|
bb215242
|
yogar-cbmc.py
|
yogar-cbmc.xml
|
...
|
