Tool | CPAchecker ABE r4569 | CPAchecker ABM r4573 | ESBMC 1.17 | FShell 1.3 | Predator | SatAbs 3.0 | ||||||
Limits | timelimit: 900 s, memlimit: 15000 MB | |||||||||||
System | os: Linux 2.6.35-30-generic x86_64 cpu: Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz cores: 4, frequency: 3401 MHz, ram: 16375440 kB | |||||||||||
Date of run | 2011-12-03 10:32 | 2011-12-04 14:36 | 2011-12-04 08:46 | 2011-12-05 01:14 | 2011-12-04 23:44 | 2011-12-05 13:41 | ||||||
Benchmark | concurrency | concurrency | concurrency | concurrency | concurrency | concurrency | ||||||
Options | -heap 12500m -sv-comp12 | -heap 12500m -sv-comp12-abm | --64 --error-label ERROR --no-bounds-check --no-div-by-zero-check --no-assertions --no-pointer-check --no-unwinding-assertions --partial-loops --unwind 7 | --unwind 10 --query-file benchmarks/fshell_query --no-unwinding-assertions --32 | -m32 | --full-inlining --iterations 500 --error-label ERROR --max-threads 5 --modelchecker boom --concurrency --32 | ||||||
../sv-benchmarks/pthread/ | status | runtime | status | runtime | status | runtime | status | runtime | status | runtime | status | runtime |
total files | 8 | 13 | 8 | 13 | 8 | 1200 | 8 | 0.62 | 8 | 1.0 | 8 | 3600 |
correct results | 0 | 0 | 0 | 0 | 7 | 270 | 0 | 0 | 0 | 0 | 1 | 1.4 |
false negatives | 0 | 0 | 0 | 0 | 1 | 900 | 0 | 0 | 0 | 0 | 0 | 0 |
false positives | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
score (8 files, max score: 11) | 0 | 0 | 6 | 0 | 0 | 1 | ||||||
fib_bench_BUG.cil.c | unknown | 1.8 | unknown | 1.8 | unsafe | 14 | error | 0.14 | unknown | 0.77 | timeout | 910 |
fib_bench_longer_BUG.cil.c | unknown | 1.4 | unknown | 1.8 | unsafe | 68 | error | 0.06 | unknown | 0.04 | timeout | 910 |
queue_BUG.cil.c | unknown | 1.5 | unknown | 1.7 | unsafe | 0.18 | error | 0.07 | unknown | 0.04 | failure | 0.22 |
reorder_5_BUG.cil.c | unknown | 1.9 | unknown | 1.6 | unsafe | 38 | error | 0.07 | unknown | 0.04 | unsafe | 1.4 |
twostage_3_BUG.cil.c | unknown | 1.9 | unknown | 1.6 | safe | 900 | error | 0.08 | unknown | 0.04 | failure | 0.11 |
fib_bench.cil.c | unknown | 1.4 | unknown | 1.4 | safe | 25 | error | 0.06 | unknown | 0.03 | timeout | 910 |
fib_bench_longer.cil.c | unknown | 1.8 | unknown | 1.4 | safe | 120 | error | 0.07 | unknown | 0.03 | timeout | 910 |
queue_ok.cil.c | unknown | 1.5 | unknown | 1.9 | safe | 0.15 | error | 0.07 | unknown | 0.04 | failure | 0.16 |