Competition Artifacts (DOIs)
For reproducibility, it is important to store snapshots of the used components in a long-term archive.
Edition | Verifier and Validator Archives | Verification Tasks | Competition Results | Verification Witnesses | BenchExec | CoVeriTeam |
2023 | 10. 5281/ zenodo. 7627829 | 10. 5281/ zenodo. 7627783 | 10. 5281/ zenodo. 7627787 | 10. 5281/ zenodo. 7627791 | 10. 5281/ zenodo. 7612021 | 10. 5281/ zenodo. 7635975 |
2022 | 10. 5281/ zenodo. 5959149 | 10. 5281/ zenodo. 5831003 | 10. 5281/ zenodo. 5831008 | 10. 5281/ zenodo. 5838498 | 10. 5281/ zenodo. 5720267 | 10. 5281/ zenodo. 7298960 |
2021 | 10. 5281/ zenodo. 4459126 | 10. 5281/ zenodo. 4458215 | 10. 5281/ zenodo. 4459196 | 10. 5281/ zenodo. 4317433 | 10. 5281/ zenodo. 7298918 | |
2020 | 10. 5281/ zenodo. 3633334 | 10. 5281/ zenodo. 3630205 | 10. 5281/ zenodo. 3630188 | 10. 5281/ zenodo. 3574420 | ||
2019 | 10. 5281/ zenodo. 2598729 | 10. 5281/ zenodo. 2559175 | ||||
2018 | ||||||
2017 | ||||||
2016 | 10. 5281/ zenodo. 1158644 |
Competition Repositories
For reproducibility, it is important to make all used components publicly available.
Repository Locations
Component | Repository |
Verification Tasks | https://gitlab.com/sosy-lab/benchmarking/sv-benchmarks |
Benchmark Definitions | https://gitlab.com/sosy-lab/sv-comp/bench-defs |
BenchExec | https://github.com/sosy-lab/benchexec |
Tool-Info Modules | https://github.com/sosy-lab/benchexec/tree/main/benchexec/tools |
Witness Format | https://gitlab.com/sosy-lab/benchmarking/sv-witnesses |
CoVeriTeam | https://gitlab.com/sosy-lab/software/coveriteam |
Tool Archives 2023 | https://gitlab.com/sosy-lab/sv-comp/archives-2023 |
Tool Archives 2022 | https://gitlab.com/sosy-lab/sv-comp/archives-2022 |
Tool Archives 2021 | https://gitlab.com/sosy-lab/sv-comp/archives-2021 |
Tool Archives 2020 | https://gitlab.com/sosy-lab/sv-comp/archives-2020 |
Tool Archives 2019 | https://gitlab.com/sosy-lab/sv-comp/archives-2019 |
Tool Archives 2018 | https://gitlab.com/sosy-lab/sv-comp/archives-2018 |
Repository Tags
Edition | Verifier Archives | Verification Tasks | Benchmark Definitions | BenchExec | Tool-Info Modules | Witness Format | CoVeriTeam |
2023 | svcomp23 | svcomp23 | svcomp23 | 3.16 | 3.16 | svcomp23 | 1.0 |
2022 | svcomp22 | svcomp22 | svcomp22 | 3.10 | 3.10 | svcomp22 | svcomp22 |
2021 | svcomp21 | svcomp21 | svcomp21 | 3.6 | 3.6 | svcomp21 | svcomp21 |
2020 | svcomp20 | svcomp20 | svcomp20 | 2.5.1 | 2.5.1 | svcomp20 | |
2019 | svcomp19 | svcomp19 | svcomp19 | 1.17 | 1.17 | svcomp19 | |
2018 | svcomp18 | svcomp18 | svcomp18 | 1.14 | 1.14 | svcomp18 | |
2017 | svcomp17 | svcomp17 | 1.10 | 1.10 | svcomp17 | ||
2016 | svcomp16 | svcomp16 | 1.7 | 1.7 | |||
2015 | svcomp15 | ||||||
2014 | svcomp14 | ||||||
2013 | svcomp13 | ||||||
2012 | svcomp12 |