TACAS 2022
11th Competition on Software Verification (SV-COMP 2022)

Results of the Competition

This web page presents the results of SV-COMP 2022 - 11th International Competition on Software Verification.

• Competition Report of SV-COMP 2022
• The benchmarks and rules are also available from the competition web site.
• Statistics on validation results are also available.

The background color is gold for the winner, silver for the second, and bronze for the third.

Here some brief directions for reading the score-based quantile plots:

• The right end of the graph displays the achieved score. The score is SV-COMP's definition of quality. You can read the ranking on the top from right to left.
• The left end of the graph displays the amount of wrong results that a verifier produced. Left-most start means worst.
• The length of the graph displays the amount of correct verification work. Long is good.
• More about what you can learn from a score-based quantile plot and how to interpret it, is described in the SV-COMP 2015 report, on pages 12 and 13.

Here some brief directions for navigating in the BenchExec-generated tables with the results:

• Please note the header with the menu "Select Columns, Filter Rows, etc.", which loads only after all data are retrieved from the server.
• The tables contain all information that I thought you could be interested in. If there are too many columns, you can get rid of some with "Select Columns". You can also investigate special classes of rows using "Filter Rows".
• If you want to see more data, including the time and memory needed for witness validation, please click on the score value in a table cell (works only for base categories). In those tables, there is also a link available to get the witness that the verifier generated.
• In all results tables, the sources of the verification task is available via click on the name of the verification task. The log files are available via click on the status (result).
• If you want to investigate even more, you can download the SV-COMP 2022 results archive, which contains all data that I obtained with BenchExec and from which I compiled all the tables and aggregated data displays. For the most detailed tables, which end on ".xml.bz2.table.html", you can obtain the raw data by accessing the URL with the ".table.html" removed.
• Falsification: Here only bug hunting matters and proof generation is ignored. There are no different results tables for the Falsification category because all verification tasks (except Termination) are included, but the TRUE results are ignored (no score assigned). If you want to remove for a particular verifier the TRUE results, proceed as follows: Click in the menu on "Filter Rows". Then select "status" for the verifier you are interested in for row selection, then a choose box with all the status-values appears. There you choose "true" and then click "invert filter".
• More on table generation is described here.
• Column "score" shows the (not normalized) score assigned to the result of the verification task.
• Column "witness" contains a link to the witness file for download/display.
• Column "inspect witness" opens a new page that displays information about the witness an a list of witnesses that other verifiers produced for the same program.
• Column "cpu" shows the consumed CPU time.
• Column "wall" shows the elapsed wall time.
• Column "energy" shows the energy consumed by the CPU.
• Column "mem" shows the peak memory usage.
• Column "blkio-w" shows the accumulated amount of information written to block devices.
• Column "blkio-r" shows the accumulated amount of information read from block devices.
• More information on results.

Ranking by Category (with Score-Based Quantile Plots)

ReachSafety 1. VeriAbs 2. CPAchecker 2.1 3. PeSCo	MemSafety 1. Symbiotic 2. CPA-BAM-SMG 3. CPAchecker 2.1	ConcurrencySafety 1. Deagle 2. CSeq 3. UGemCutter
NoOverflows 1. CPAchecker 2.1 2. UAutomizer 3. UTaipan	Termination 1. UAutomizer 2. AProVE 3. 2LS	SoftwareSystems 1. Symbiotic 2. CPAchecker 2.1 3. Graves-CPA
FalsificationOverall 1. CPAchecker 2.1 2. PeSCo 3. Symbiotic	Overall 1. Symbiotic 2. CPAchecker 2.1 3. UAutomizer
JavaOverall 1. JDart 2. JBMC 3. Java-Ranger

Table of All Results

In every table cell for competition results, we list the points in the first row and the CPU time (rounded to two significant digits) for successful runs in the second row.

The entry 'Hors Concours' in the row for 'Representing Jury Member' means that the tool was added at the organizer's disposition and does not participate in the rankings or prize allocation.
The entry '–' means that the competition candidate opted-out in the category.
The definition of the scoring schema and the categories is given on the respective SV-COMP web pages.

Hide base categories

Participants	Plots	2LS	AProVE	BRICK	CBMC	CoVeriTeam-Verifier-AlgoSelection	CoVeriTeam-Verifier-ParallelPortfolio	CPA-BAM-BnB	CPA-BAM-SMG	CPALockator	CPAchecker 2.1	Crux	CSeq	Dartagnan	Deagle	DIVINE	EBF	ESBMC-incr	ESBMC-kind	Frama-C-SV	Gazer-Theta	Goblint	Graves-CPA	Infer	Korn	LART	Lazy-CSeq	Locksmith	PeSCo	Pinaka	PredatorHP	SESL	SMACK	Symbiotic	Theta	UAutomizer	UGemCutter	UKojak	UTaipan	VeriAbs	VeriFuzz	COASTAL	GDart	Java-Ranger	JayHorn	JBMC	JDart	SPF
Representing Jury Member		Viktor Malík	Jera Hensel	Lei Bu	Michael Tautschnig	Hors Concours	Hors Concours	Hors Concours	Anton Vasilyev	Hors Concours	Thomas Bunk	Ryan Scott	Emerson Sales	Hernán Ponce de León	Fei He	Hors Concours	Fatimah Aljaafari	Hors Concours	Rafael Sá Menezes	Martin Spiessl	Hors Concours	Simmo Saan	Will Leeson	Hors Concours	Gidon Ernst	Henrich Lauko	Hors Concours	Vesal Vojdani	Cedric Richter	Hors Concours	Hors Concours	Xie Li	Hors Concours	Marek Chalupa	Vince Molnár	Matthias Heizmann	Dominik Klumpp	Frank Schüssele	Daniel Dietsch	Priyanka Darke	Raveendra Kumar Medicherla	Hors Concours	Falk Howar	Soha Hussein	Ali Shamakhi	Peter Schrammel	Falk Howar	Hors Concours
Affiliation		Brno University of Technology, Czechia	RWTH Aachen, Germany	Nanjing University, China	Queen Mary University of London, UK	--, --	--, --	--, --	ISP RAS, Russia	--, --	LMU Munich, Germany	Galois, USA	Gran Sasso Science Institute, Italy	Bundeswehr University Munich, Germany	Tsinghua University, China	--, --	University of Manchester, UK	--, --	University of Manchester, UK	LMU Munich, Germany	--, --	University of Tartu, Estonia	University of Virginia, United States of America	--, --	LMU Munich, Germany	Masaryk University, Brno, Czechia	--, --	University of Tartu, Estonia	University of Oldenburg, Germany, Germany	--, --	--, --	Academy of Sciences, China	--, --	Masaryk University, Brno, Czechia	Budapest University of Technology and Economics, Hungary	University of Freiburg, Germany	University of Freiburg, Germany	University of Freiburg, Germany	University of Freiburg, Germany	Tata Consultancy Services, India	Tata Consultancy Services, India	--, --	TU Dortmund, Germany	University of Minnesota, USA	Tehran Institute for Advanced Studies, Iran	University of Sussex and Diffblue, UK	TU Dortmund, Germany	--, --
ReachSafety 5400 tasks, max. score: 8631		3585			3808	5438	5904				5572	1408				110			4959			858	4520	-50415		3034			5080	3710				4571	1132	3969		2058	3634	6923	1518
CPU time		110000 s			74000 s	470000 s	360000 s				460000 s	6000 s				130000 s			150000 s			920 s	350000 s	58 s		73000 s			230000 s	25000 s				88000 s	120000 s	190000 s		95000 s	160000 s	600000 s	83000 s
unreach-call.ReachSafety-Arrays 436 tasks, max. score: 759		-28			-66	220	251				77	-224		8		59			234	52		40	-21	-4930		126			81	125				174	13	92		79	97	729	109
CPU time		94 s			930 s	10000 s	5500 s				11000 s	100 s		640 s		2100 s			2500 s	4600 s		6.5 s	1700 s	3.8 s		570 s			4200 s	2000 s				3300 s	1000 s	2000 s		1800 s	5500 s	12000 s	910 s
unreach-call.ReachSafety-BitVectors 49 tasks, max. score: 83		55			41	56	75				71	48		49		44			55	34	63	8	70	-654		40			53	40				47	22	52		22	44	76	15
CPU time		64 s			300 s	2600 s	4700 s				4300 s	73 s		1900 s		720 s			310 s	860 s	380 s	0.21 s	1500 s	0.27 s		170 s			2400 s	65 s				480 s	330 s	1800 s		190 s	2700 s	3200 s	150 s
unreach-call.ReachSafety-ControlFlow 94 tasks, max. score: 146		70			67	123	141				133	-62				-536			64		61	0	88	-832	76	38			143	25				78	68	76		49	79	128	40
CPU time		1800 s			260 s	12000 s	14000 s				12000 s	150 s				1500 s			2400 s		37 s	0 s	3100 s	0 s	4900 s	3800 s			5800 s	57 s				3200 s	2900 s	2900 s		5800 s	6300 s	16000 s	650 s
unreach-call.ReachSafety-ECA 1265 tasks, max. score: 2050		624			170	1017	1021				930	1				146			1098	4	393	2	914	-12748		144			1026	261				275	474	799		581	356	1312	429
CPU time		73000 s			29000 s	130000 s	110000 s				140000 s	31 s				50000 s			87000 s	340 s	27000 s	21 s	140000 s	29 s		22000 s			98000 s	6300 s				5300 s	82000 s	75000 s		50000 s	23000 s	210000 s	55000 s
unreach-call.ReachSafety-Floats 469 tasks, max. score: 893		626		835	782	767	828				749	584				257			779		337	2	722			396			767	801				615	-94	645		2	641	827	-64
CPU time		2100 s		1000 s	6900 s	31000 s	9300 s				11000 s	120 s				7300 s			7500 s		300 s	0.070 s	14000 s			2400 s			14000 s	2300 s				1100 s	580 s	32000 s		13 s	30000 s	18000 s	76 s
unreach-call.ReachSafety-Heap 241 tasks, max. score: 408		137			292	285	244				282	7				202			226			120	194	-2458		265			284	229				310	-19	235		219	226	304	57
CPU time		1000 s			910 s	7900 s	690 s				4600 s	100 s				820 s			690 s			24 s	2500 s	5.5 s		400 s			5000 s	12 s				200 s	26 s	4700 s		4600 s	5600 s	11000 s	390 s
unreach-call.ReachSafety-Loops 765 tasks, max. score: 1298		527			637	838	767				696	434		442		703			609	422	627	92	660	-8048	622	751			410	705				905	562	779		458	685	1044	209
CPU time		13000 s			12000 s	33000 s	36000 s				22000 s	520 s		19000 s		18000 s			15000 s	7000 s	8700 s	650 s	48000 s	9.6 s	10000 s	12000 s			13000 s	5000 s				35000 s	26000 s	27000 s		17000 s	28000 s	57000 s	4400 s
unreach-call.ReachSafety-ProductLines 597 tasks, max. score: 929		816			256	905	911				903	225				794			783	514	865	316	808			411			845	131				453	0	554		298	572	903	216
CPU time		8600 s			330 s	75000 s	30000 s				80000 s	3100 s				16000 s			610 s	3000 s	22000 s	210 s	13000 s			5600 s			12000 s	18 s				4500 s	0 s	8400 s		5800 s	23000 s	140000 s	1900 s
unreach-call.ReachSafety-Recursive 105 tasks, max. score: 162		0			100	62	84				92	41				110			109	6	102	52	13	-804	143	105			59	95				123	0	127		82	128	125	43
CPU time		0 s			120 s	3600 s	880 s				780 s	39 s				1100 s			810 s	4.3 s	510 s	4.7 s	82 s	1.5 s	790 s	32 s			1400 s	61 s				2200 s	0 s	5500 s		2300 s	6200 s	6800 s	760 s
unreach-call.ReachSafety-Sequentialized 589 tasks, max. score: 775		97			152	408	377				464	-69				-16			180			2	451	-2864		190			439	234				340	29	55		40	-66	540	92
CPU time		4500 s			3300 s	99000 s	61000 s				99000 s	920 s				21000 s			2000 s			0.36 s	72000 s	0 s		18000 s			27000 s	2400 s				11000 s	2100 s	8500 s		7500 s	5400 s	82000 s	3800 s
unreach-call.ReachSafety-XCSP 119 tasks, max. score: 179		148			158	152	153				153	96				9			158		147	0	144	-960	0	12			151	147				135	45	43		7	46	152	55
CPU time		2500 s			1200 s	4900 s	2600 s				3900 s	160 s				1800 s			2200 s		450 s	0 s	4000 s	0 s	0 s	300 s			7600 s	1900 s				5700 s	5100 s	6900 s		300 s	5700 s	6000 s	1600 s
unreach-call.ReachSafety-Combinations 671 tasks, max. score: 912		204			169	225	453				314	16				45			292	20	13	0	232			54			233	223				222	38	99		30	122	320	195
CPU time		7400 s			19000 s	61000 s	93000 s				72000 s	640 s				11000 s			30000 s	49 s	44 s	0 s	55000 s			7900 s			34000 s	5100 s				16000 s	1200 s	18000 s		780 s	23000 s	43000 s	13000 s
MemSafety 3321 tasks, max. score: 5003		810			-262		3700		3101		3057					99			2162												2205	345		4051		2350		1573	2336		-777
CPU time		1300 s			2800 s		48000 s		26000 s		28000 s					180 s			47000 s												3500 s	9700 s		9300 s		200000 s		86000 s	130000 s		69 s
valid-memsafety.MemSafety-Arrays 85 tasks, max. score: 145		9			-57		43		4		5					0			19			0	5						5		24	9		105		68		36	54		0
CPU time		36 s			20 s		510 s		21 s		27 s					0 s			3.1 s			0 s	28 s						27 s		60 s	66 s		380 s		5300 s		990 s	2300 s		0 s
valid-memsafety.MemSafety-Heap 184 tasks, max. score: 275		9			92		135		199		183					-58			83			0	179						179		215	29		237		98		82	101		0
CPU time		360 s			1100 s		5000 s		2400 s		1200 s					110 s			2200 s			0 s	1100 s						1100 s		2900 s	93 s		2300 s		4600 s		8000 s	5800 s		0 s
valid-memsafety.MemSafety-LinkedLists 103 tasks, max. score: 178		13			116		159		127		114					84			107			0	114						114		150	4		160		8		12	10		1
CPU time		590 s			49 s		3900 s		780 s		780 s					59 s			290 s			0 s	820 s						790 s		72 s	110 s		1200 s		890 s		2500 s	1900 s		3.5 s
valid-memsafety.MemSafety-Other 56 tasks, max. score: 88		55			33		78		51		53					-18			46			0	53						53		50	3		83		63		22	65		-80
CPU time		13 s			38 s		4000 s		790 s		460 s					9.7 s			42 s			0 s	430 s						440 s		510 s	0.70 s		2400 s		2000 s		2500 s	1300 s		0 s
valid-memcleanup.MemSafety-MemCleanup 65 tasks, max. score: 67		13			-210		65		59		59					0			4			0	0						59		12	7		41		44		46	44		1
CPU time		330 s			4.7 s		470 s		430 s		430 s					0 s			0.41 s			0 s	0 s						420 s		2.5 s	530 s		38 s		1700 s		3500 s	1900 s		66 s
valid-memsafety.MemSafety-Juliet 2828 tasks, max. score: 4266		0			3429		4266		4021		4266					0			3704			0	4266						4266		0	450		3193		2922		2135	3113		0
CPU time		0 s			1600 s		34000 s		22000 s		25000 s					0 s			44000 s			0 s	26000 s						26000 s		0 s	8900 s		3000 s		190000 s		69000 s	120000 s		0 s
ConcurrencySafety 763 tasks, max. score: 1160		0			460	314	-551			-1154	498		655	481	757	-136	496	-74	-74			106		-5890			571							105	-14	493	612	0	535		-32
CPU time		0 s			5700 s	19000 s	22000 s			450 s	24000 s		18000 s	21000 s	1800 s	19000 s	12000 s	11000 s	11000 s			7.3 s		12 s			12000 s							5100 s	3200 s	20000 s	18000 s	0 s	16000 s		0 s
unreach-call.ConcurrencySafety-Main 763 tasks, max. score: 1160		0			460	314	-551			-1154	498		655	481	757	-136	496	-74	-74			106	0	-5890			571		425					105	-14	493	612	0	535		-32
CPU time		0 s			5700 s	19000 s	22000 s			450 s	24000 s		18000 s	21000 s	1800 s	19000 s	12000 s	11000 s	11000 s			7.3 s	0 s	12 s			12000 s		27000 s					5100 s	3200 s	20000 s	18000 s	0 s	16000 s		0 s
NoOverflows 454 tasks, max. score: 685		428			284		553				531	290				0			318	213		159		-5982						-200				370		506		445	501		136
CPU time		260 s			140 s		3400 s				4500 s	3500 s				0 s			500 s	17000 s		6.3 s		50 s						110 s				960 s		7200 s		5300 s	8000 s		700 s
no-overflow.NoOverflows-BitVectors 281 tasks, max. score: 404		281			186		334				319	183				0			190	150		116	319	-4556					319	32				202		336		296	339		104
CPU time		120 s			37 s		2400 s				2200 s	2400 s				0 s			140 s	9400 s		4.1 s	2200 s	28 s					2200 s	11 s				440 s		5200 s		3900 s	6200 s		480 s
no-overflow.NoOverflows-Other 173 tasks, max. score: 273		153			102		216				208	108				0			125	70		50	208	-1754					208	-172				158		179		157	173		40
CPU time		140 s			100 s		1000 s				2300 s	1100 s				0 s			350 s	7700 s		2.2 s	2300 s	22 s					2300 s	98 s				520 s		2000 s		1500 s	1700 s		210 s
Termination 2293 tasks, max. score: 4144		2178	2305		1800		2351				1270					0			1389											1259				2030		2552		0	0		-129
CPU time		10000 s	140000 s		4900 s		32000 s				37000 s					0 s			5300 s											1200 s				14000 s		47000 s		0 s	0 s		40000 s
termination.Termination-BitVectors 3 tasks, max. score: 6		6	2		6		6				2					0			4			0	2						2	4				6		2		0	0		0
CPU time		1.4 s	10 s		1.2 s		8.3 s				4.8 s					0 s			0.26 s			0 s	4.9 s						4.7 s	0.068 s				1.3 s		11 s		0 s	0 s		0 s
termination.Termination-MainControlFlow 316 tasks, max. score: 541		283	412		62		156				279					0			62			0	207						207	56				94		395		0	0		-62
CPU time		65 s	5000 s		38 s		9200 s				2700 s					0 s			940 s			0 s	3600 s						3600 s	74 s				190 s		4200 s		0 s	0 s		1200 s
termination.Termination-MainHeap 260 tasks, max. score: 503		0	340		24		98				0					0			24			0	0						0	56				54		381		0	0		0
CPU time		0 s	10000 s		23 s		810 s				0 s					0 s			920 s			0 s	0 s						0 s	160 s				13 s		6100 s		0 s	0 s		0 s
termination.Termination-Other 1714 tasks, max. score: 2711		1549	1273		1458		2109				1141					0			1374			0	1357						1357	806				1775		1834		0	0		-49
CPU time		10000 s	120000 s		4800 s		22000 s				34000 s					0 s			3400 s			0 s	58000 s						58000 s	960 s				13000 s		36000 s		0 s	0 s		39000 s
SoftwareSystems 3417 tasks, max. score: 5898		83			-198		1282	504	776		809					112			633			340	802	-29566		573			-273				1181	2704		712		382	486		0
CPU time		93 s			2000 s		150000 s	88000 s	94000 s		190000 s					10000 s			28000 s			17000 s	69000 s	250 s		39 s			110000 s				61000 s	4200 s		120000 s		51000 s	120000 s		0 s
unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety 177 tasks, max. score: 347		22			6	136	195	2	20		43	-493				10			157			32	80			0			115				278	285		90		8	22		0
CPU time		27 s			610 s	3300 s	5700 s	670 s	290 s		2900 s	210 s				260 s			950 s			6.3 s	4700 s			0 s			5000 s				15000 s	470 s		4100 s		100 s	3300 s		0 s
unreach-call.SoftwareSystems-BusyBox-ReachSafety 9 tasks, max. score: 13		0			0	2	-28	0	0		2					0			2			0	1	-32		0			-30				8	2		2		2	2		0
CPU time		0 s			0 s	41 s	8.2 s	0 s	0 s		100 s					0 s			6.2 s			0 s	80 s	0 s		0 s			22 s				250 s	670 s		28 s		25 s	110 s		0 s
valid-memsafety.SoftwareSystems-BusyBox-MemSafety 42 tasks, max. score: 74		0			-15		0	0	0		0					0			0				0	-504					0				1	7		0		0	0		0
CPU time		0 s			7.3 s		0 s	0 s	0 s		0 s					0 s			0 s				0 s	33 s					0 s				38 s	230 s		0 s		0 s	0 s		0 s
no-overflow.SoftwareSystems-BusyBox-NoOverflows 67 tasks, max. score: 100		0			0		0	0	0		4	-48				0			0	0		0	4	-670					4				0	0		4		4	0		0
CPU time		0 s			0 s		0 s	0 s	0 s		1100 s	0 s				0 s			0 s	0 s		0 s	1100 s	0.35 s					1100 s				0 s	0 s		91 s		100 s	0 s		0 s
unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety 2718 tasks, max. score: 5089		326			-3257	2806	2830	3434	3435		3114	-24407				739			2020			2210	2798			66			3068				2648	1416		2944		2152	2926		0
CPU time		66 s			1200 s	210000 s	140000 s	87000 s	92000 s		180000 s	81 s				9700 s			27000 s			17000 s	63000 s			16 s			110000 s				46000 s	1600 s		120000 s		50000 s	110000 s		0 s
unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety 10 tasks, max. score: 20		0			0	0	0	2	2		0	-96				0			0			0	0			0			0				0	0		0		0	0		0
CPU time		0 s			0 s	0 s	0 s	560 s	500 s		0 s	0 s				0 s			0 s			0 s	0 s			0 s			0 s				0 s	0 s		0 s		0 s	0 s		0 s
valid-memsafety.SoftwareSystems-OpenBSD-MemSafety 4 tasks, max. score: 5		0			3		2	0	0		0					0			0				0	-15					0				0	4		0		0	0		0
CPU time		0 s			1.6 s		26 s	0 s	0 s		0 s					0 s			0 s				0 s	5.3 s					0 s				0 s	61 s		0 s		0 s	0 s		0 s
valid-memsafety.SoftwareSystems-uthash-MemSafety 138 tasks, max. score: 204		0			12		180	0	96		96					0			0				96	-2172					96				0	204		0		0	0		0
CPU time		0 s			23 s		3800 s	0 s	610 s		620 s					0 s			0 s				720 s	190 s					720 s				0 s	1000 s		0 s		0 s	0 s		0 s
no-overflow.SoftwareSystems-uthash-NoOverflows 114 tasks, max. score: 228		0			12		144	0	0		0	36				0			0	0		0	0	-372					0				0	144		24		0	0		0
CPU time		0 s			140 s		620 s	0 s	0 s		0 s	4.6 s				0 s			0 s	0 s		0 s	0 s	23 s					0 s				0 s	64 s		2800 s		0 s	0 s		0 s
unreach-call.SoftwareSystems-uthash-ReachSafety 138 tasks, max. score: 276		0			0	228	228	0	0		0	60				0			0			0	0	-2208		228			0				0	228		0		0	0		0
CPU time		0 s			0 s	4700 s	890 s	0 s	0 s		0 s	9.0 s				0 s			0 s			0 s	0 s	0 s		23 s			0 s				0 s	90 s		0 s		0 s	0 s		0 s
FalsificationOverall 13355 tasks, max. score: 5718		1462			2024		1087				3835					-1253			1841				2400						3683					3274		3089		2056	3049		817
CPU time		46000 s			49000 s		260000 s				290000 s					110000 s			90000 s				210000 s						160000 s					49000 s		150000 s		44000 s	90000 s		84000 s
Overall 15648 tasks, max. score: 25209		7366			6733		10704				11904					-248			7727			1951	9218						10515					12249		11802		5078	8666
CPU time		130000 s			89000 s		620000 s				740000 s					160000 s			240000 s			18000 s	520000 s						460000 s					120000 s		590000 s		240000 s	440000 s
JavaOverall 586 tasks, max. score: 828																																										-2541	640	670	376	700	714	430
CPU time																																										2300 s	13000 s	16000 s	23000 s	1500 s	4400 s	2600 s
assert_java.ReachSafety-Java 586 tasks, max. score: 828																																										-2541	640	670	376	700	714	430
CPU time																																										2300 s	13000 s	16000 s	23000 s	1500 s	4400 s	2600 s
Participants	Plots	2LS	AProVE	BRICK	CBMC	CoVeriTeam-Verifier-AlgoSelection	CoVeriTeam-Verifier-ParallelPortfolio	CPA-BAM-BnB	CPA-BAM-SMG	CPALockator	CPAchecker 2.1	Crux	CSeq	Dartagnan	Deagle	DIVINE	EBF	ESBMC-incr	ESBMC-kind	Frama-C-SV	Gazer-Theta	Goblint	Graves-CPA	Infer	Korn	LART	Lazy-CSeq	Locksmith	PeSCo	Pinaka	PredatorHP	SESL	SMACK	Symbiotic	Theta	UAutomizer	UGemCutter	UKojak	UTaipan	VeriAbs	VeriFuzz	COASTAL	GDart	Java-Ranger	JayHorn	JBMC	JDart	SPF

Note on meta-categories: The score is not the sum of scores of the sub-categories (normalization). The run time is the sum of run times of the sub-categories, rounded to two significant digits.

If you did not find what you are looking for, please do not hesitate to contact Dirk Beyer (competition chair).