Regression: Regression of 65 benchmarks: 7zip-benchmark, CoMD, Oscar, PENNANT, Queens, ReedSolomon, aha, anagram, beamformer, bullet... [Detected Fixed]



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
10395 rv64gc-Os-thinlto:3 execution_time MultiSource/Applications/aha/aha 7641301089, 7642892825 10.04428739610.635651369 5.89% 10.407056635 3.61% 2024-01-24T16:27:22
10396 rv64gc-Os-thinlto:3 execution_time MultiSource/Applications/sqlite3/sqlite3 7641301089, 7642892825 19.61685082419.327084617 -1.48% 19.354214948 -1.34% 2024-01-24T16:27:22
10397 rv64gc-Os-thinlto:3 execution_time MultiSource/Benchmarks/7zip/7zip-benchmark 7641301089, 7642892825 29.40597477629.058598926 -1.18% 28.95269836 -1.54% 2024-01-24T16:27:22
10398 rv64gc-Os-thinlto:3 execution_time MultiSource/Benchmarks/Olden/perimeter/perimeter 7641301089, 7642892825 0.8455706350.885183051 4.68% 0.884833526 4.64% 2024-01-24T16:27:22
10399 rv64gc-Os-thinlto:3 execution_time SingleSource/Benchmarks/BenchmarkGame/n-body 7641301089, 7642892825 2.8251626692.765162669 -2.12% 2.805162686 -0.71% 2024-01-24T16:27:22
10400 rv64gc-Os-thinlto:3 code_size MultiSource/Applications/aha/aha 7641301089, 7642892825 2044.02100.0 2.74% 2076.0 1.57% 2024-01-24T16:27:22
10401 rv64gc-Os-thinlto:3 code_size MultiSource/Applications/kimwitu++/kc 7641301089, 7642892825 302326.0298874.0 -1.14% 300224.0 -0.70% 2024-01-24T16:27:22
10402 rv64gc-Os-thinlto:3 code_size MultiSource/Applications/viterbi/viterbi 7641301089, 7642892825 2252.02282.0 1.33% 2280.0 1.24% 2024-01-24T16:27:22
10403 rv64gc-Os-thinlto:3 code_size MultiSource/Benchmarks/Olden/perimeter/perimeter 7641301089, 7642892825 1712.01674.0 -2.22% 1674.0 -2.22% 2024-01-24T16:27:22
10404 rv64gc-Os-thinlto:3 code_size SingleSource/Benchmarks/BenchmarkGame/n-body 7641301089, 7642892825 920.0906.0 -1.52% 914.0 -0.65% 2024-01-24T16:27:22
10405 rv64gc-Os-thinlto:3 code_size SingleSource/Benchmarks/Misc/ReedSolomon 7641301089, 7642892825 2964.03048.0 2.83% 3040.0 2.56% 2024-01-24T16:27:22
10406 rv64gc-Os-thinlto:3 code_size SingleSource/Benchmarks/SmallPT/smallpt 7641301089, 7642892825 3292.03202.0 -2.73% 3192.0 -3.04% 2024-01-24T16:27:22
10407 rv64gc-Os-thinlto:3 code_size MultiSource/Benchmarks/lzbench/lzbench 7641301089, 7642892825 1468452.01451328.0 -1.17% 1439926.0 -1.94% 2024-01-24T16:27:22
10408 rv64gczxx-O3-thinlto:5 execution_time MultiSource/Applications/aha/aha 7641301089, 7642892825 9.3083700929.501153086 2.07% 9.668568652 3.87% 2024-01-24T16:27:46
10409 rv64gczxx-O3-thinlto:5 execution_time MultiSource/Benchmarks/7zip/7zip-benchmark 7641301089, 7642892825 26.20942336525.905267014 -1.16% 25.922758091 -1.09% 2024-01-24T16:27:46
10410 rv64gczxx-O3-thinlto:5 execution_time MultiSource/Benchmarks/FreeBench/distray/distray 7641301089, 7642892825 0.3928002550.382546669 -2.61% 0.382546582 -2.61% 2024-01-24T16:27:46
10411 rv64gczxx-O3-thinlto:5 execution_time MultiSource/Benchmarks/Olden/perimeter/perimeter 7641301089, 7642892825 0.8610386740.903778386 4.96% 0.903778366 4.96% 2024-01-24T16:27:46
10412 rv64gczxx-O3-thinlto:5 execution_time MultiSource/Benchmarks/Ptrdist/anagram/anagram 7641301089, 7642892825 5.7099962365.448041351 -4.59% 5.39528159 -5.51% 2024-01-24T16:27:46
10413 rv64gczxx-O3-thinlto:5 execution_time SingleSource/Benchmarks/BenchmarkGame/n-body 7641301089, 7642892825 2.7201624421.795162518 -34.01% 1.795162431 -34.01% 2024-01-24T16:27:46
10414 rv64gczxx-O3-thinlto:5 code_size MultiSource/Applications/JM/ldecod/ldecod 7641301089, 7642892825 246210.0243612.0 -1.06% 240940.0 -2.14% 2024-01-24T16:27:46
10415 rv64gczxx-O3-thinlto:5 code_size MultiSource/Applications/aha/aha 7641301089, 7642892825 3068.03184.0 3.78% 3184.0 3.78% 2024-01-24T16:27:46
10416 rv64gczxx-O3-thinlto:5 code_size MultiSource/Applications/hexxagon/hexxagon 7641301089, 7642892825 12408.012228.0 -1.45% 12112.0 -2.39% 2024-01-24T16:27:46
10417 rv64gczxx-O3-thinlto:5 code_size MultiSource/Applications/kimwitu++/kc 7641301089, 7642892825 360078.0354054.0 -1.67% 360092.0 0.00% 2024-01-24T16:27:46
10418 rv64gczxx-O3-thinlto:5 code_size MultiSource/Applications/sqlite3/sqlite3 7641301089, 7642892825 344948.0355224.0 2.98% 353408.0 2.45% 2024-01-24T16:27:46
10419 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/FreeBench/distray/distray 7641301089, 7642892825 3576.04396.0 22.93% 4396.0 22.93% 2024-01-24T16:27:46
10420 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/MallocBench/espresso/espresso 7641301089, 7642892825 134594.0136210.0 1.20% 136292.0 1.26% 2024-01-24T16:27:46
10421 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/McCat/09-vor/vor 7641301089, 7642892825 7762.07680.0 -1.06% 7580.0 -2.34% 2024-01-24T16:27:46
10422 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/Olden/perimeter/perimeter 7641301089, 7642892825 1734.01690.0 -2.54% 1690.0 -2.54% 2024-01-24T16:27:46
10423 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/Ptrdist/anagram/anagram 7641301089, 7642892825 4056.05126.0 26.38% 5108.0 25.94% 2024-01-24T16:27:46
10424 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/VersaBench/beamformer/beamformer 7641301089, 7642892825 9350.09250.0 -1.07% 9242.0 -1.16% 2024-01-24T16:27:46
10425 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg 7641301089, 7642892825 57976.058828.0 1.47% 58860.0 1.52% 2024-01-24T16:27:46
10426 rv64gczxx-O3-thinlto:5 code_size MultiSource/Benchmarks/sim/sim 7641301089, 7642892825 10696.010530.0 -1.55% 10658.0 -0.36% 2024-01-24T16:27:46
10427 rv64gczxx-O3-thinlto:5 code_size SingleSource/Benchmarks/BenchmarkGame/n-body 7641301089, 7642892825 2134.03248.0 52.20% 3248.0 52.20% 2024-01-24T16:27:46
10428 rv64gczxx-O3-thinlto:5 code_size SingleSource/Benchmarks/Misc-C++-EH/spirit 7641301089, 7642892825 43064.042602.0 -1.07% 41902.0 -2.70% 2024-01-24T16:27:46
10429 rv64gczxx-O3-thinlto:5 code_size SingleSource/Benchmarks/Stanford/Oscar 7641301089, 7642892825 2252.06846.0 204.00% 6878.0 205.42% 2024-01-24T16:27:46
10430 rv64gczxx-O3-thinlto:5 code_size SingleSource/Benchmarks/Stanford/Queens 7641301089, 7642892825 964.0980.0 1.66% 964.0 0.00% 2024-01-24T16:27:46
10431 rv64gc-O3-thinlto:2 execution_time MultiSource/Applications/aha/aha 7641301089, 7642892825 9.9967992310.483529254 4.87% 10.761966451 7.65% 2024-01-24T16:35:59
10432 rv64gc-O3-thinlto:2 execution_time MultiSource/Applications/sqlite3/sqlite3 7641301089, 7642892825 17.56002325817.142808968 -2.38% 17.225836989 -1.90% 2024-01-24T16:35:59
10433 rv64gc-O3-thinlto:2 execution_time MultiSource/Benchmarks/7zip/7zip-benchmark 7641301089, 7642892825 28.80692845428.451090722 -1.24% 28.23090059 -2.00% 2024-01-24T16:35:59
10434 rv64gc-O3-thinlto:2 execution_time MultiSource/Benchmarks/FreeBench/distray/distray 7641301089, 7642892825 0.3931069590.382853373 -2.61% 0.383075115 -2.55% 2024-01-24T16:35:59
10435 rv64gc-O3-thinlto:2 execution_time MultiSource/Benchmarks/Olden/perimeter/perimeter 7641301089, 7642892825 0.845566840.88517887 4.68% 0.884829345 4.64% 2024-01-24T16:35:59
10436 rv64gc-O3-thinlto:2 execution_time MultiSource/Benchmarks/Ptrdist/anagram/anagram 7641301089, 7642892825 5.8159006385.528729787 -4.94% 5.504237212 -5.36% 2024-01-24T16:35:59
10437 rv64gc-O3-thinlto:2 execution_time SingleSource/Benchmarks/BenchmarkGame/Large/fasta 7641301089, 7642892825 1.4107005981.288350631 -8.67% 1.288350631 -8.67% 2024-01-24T16:35:59
10438 rv64gc-O3-thinlto:2 execution_time SingleSource/Benchmarks/BenchmarkGame/n-body 7641301089, 7642892825 2.890162492.080162563 -28.03% 2.07516256 -28.20% 2024-01-24T16:35:59
10439 rv64gc-O3-thinlto:2 code_size MultiSource/Applications/JM/ldecod/ldecod 7641301089, 7642892825 319372.0315004.0 -1.37% 313502.0 -1.84% 2024-01-24T16:35:59
10440 rv64gc-O3-thinlto:2 code_size MultiSource/Applications/JM/lencod/lencod 7641301089, 7642892825 807274.0850826.0 5.39% 846152.0 4.82% 2024-01-24T16:35:59
10441 rv64gc-O3-thinlto:2 code_size MultiSource/Applications/aha/aha 7641301089, 7642892825 3076.03624.0 17.82% 3662.0 19.05% 2024-01-24T16:35:59
10442 rv64gc-O3-thinlto:2 code_size MultiSource/Applications/kimwitu++/kc 7641301089, 7642892825 362426.0356064.0 -1.76% 358184.0 -1.17% 2024-01-24T16:35:59
10443 rv64gc-O3-thinlto:2 code_size MultiSource/Applications/sqlite3/sqlite3 7641301089, 7642892825 433522.0442056.0 1.97% 446680.0 3.04% 2024-01-24T16:35:59
10444 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/Bullet/bullet 7641301089, 7642892825 284072.0286938.0 1.01% 286138.0 0.73% 2024-01-24T16:35:59
10445 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/DOE-ProxyApps-C++/PENNANT/PENNANT 7641301089, 7642892825 98002.0100552.0 2.60% 101884.0 3.96% 2024-01-24T16:35:59
10446 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/DOE-ProxyApps-C/CoMD/CoMD 7641301089, 7642892825 32650.033054.0 1.24% 33296.0 1.98% 2024-01-24T16:35:59
10447 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/FreeBench/distray/distray 7641301089, 7642892825 3576.04428.0 23.83% 4428.0 23.83% 2024-01-24T16:35:59
10448 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/McCat/09-vor/vor 7641301089, 7642892825 7714.07632.0 -1.06% 7526.0 -2.44% 2024-01-24T16:35:59
10449 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/Olden/em3d/em3d 7641301089, 7642892825 3338.03398.0 1.80% 3392.0 1.62% 2024-01-24T16:35:59
10450 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/Olden/perimeter/perimeter 7641301089, 7642892825 1738.01704.0 -1.96% 1704.0 -1.96% 2024-01-24T16:35:59
10451 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/Ptrdist/anagram/anagram 7641301089, 7642892825 4430.05174.0 16.79% 5126.0 15.71% 2024-01-24T16:35:59
10452 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/VersaBench/beamformer/beamformer 7641301089, 7642892825 25204.024708.0 -1.97% 24566.0 -2.53% 2024-01-24T16:35:59
10453 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio 7641301089, 7642892825 1160.01132.0 -2.41% 1132.0 -2.41% 2024-01-24T16:35:59
10454 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg 7641301089, 7642892825 87402.089584.0 2.50% 90104.0 3.09% 2024-01-24T16:35:59
10455 rv64gc-O3-thinlto:2 code_size MultiSource/Benchmarks/sim/sim 7641301089, 7642892825 18640.018020.0 -3.33% 18014.0 -3.36% 2024-01-24T16:35:59
10456 rv64gc-O3-thinlto:2 code_size SingleSource/Benchmarks/BenchmarkGame/n-body 7641301089, 7642892825 2628.03474.0 32.19% 3456.0 31.51% 2024-01-24T16:35:59
10457 rv64gc-O3-thinlto:2 code_size SingleSource/Benchmarks/Misc-C++/oopack_v1p8 7641301089, 7642892825 6666.06746.0 1.20% 6544.0 -1.83% 2024-01-24T16:35:59
10458 rv64gc-O3-thinlto:2 code_size SingleSource/Benchmarks/SmallPT/smallpt 7641301089, 7642892825 4592.04514.0 -1.70% 4504.0 -1.92% 2024-01-24T16:35:59
10459 rv64gc-O3-thinlto:2 code_size SingleSource/Benchmarks/Stanford/Oscar 7641301089, 7642892825 4106.025352.0 517.44% 25324.0 516.76% 2024-01-24T16:35:59
Change State Split Delete