Result Overview
- Number of Run Configurations
- 50
- Change of Run time
- median 0% (min. -1%, max. 1%)
Changes in Benchmark Set
| Commit | Executor | Suite | Benchmark | Variable Values | Cores | Input Size | Extra Arguments |
|---|---|---|---|---|---|---|---|
| 17c377 | som-rs-ast | interpreter | ArgRead | 1 | |||
| 17c377 | som-rs-ast | interpreter | ArrayReadConst | 1 | |||
| 17c377 | som-rs-ast | interpreter | ArrayWriteConstConst | 1 | |||
| 17c377 | som-rs-ast | interpreter | BlockSend0ConstReturn | 1 | |||
| 17c377 | som-rs-ast | interpreter | Const | 1 | |||
| 17c377 | som-rs-ast | interpreter | FieldConstWrite | 1 | |||
| 17c377 | som-rs-ast | interpreter | FieldRead | 1 | |||
| 17c377 | som-rs-ast | interpreter | FieldReadIncWrite | 1 | |||
| 17c377 | som-rs-ast | interpreter | FieldReadWrite | 1 | |||
| 17c377 | som-rs-ast | interpreter | GlobalRead | 1 | |||
| 17c377 | som-rs-ast | interpreter | LocalConstWrite | 1 | |||
| 17c377 | som-rs-ast | interpreter | LocalRead | 1 | |||
| 17c377 | som-rs-ast | interpreter | LocalReadIncWrite | 1 | |||
| 17c377 | som-rs-ast | interpreter | LocalReadWrite | 1 | |||
| 17c377 | som-rs-ast | interpreter | SelfSend0 | 1 | |||
| 17c377 | som-rs-ast | interpreter | SelfSend0BlockConstNonLocalReturn | 1 | |||
| 17c377 | som-rs-bc | interpreter | ArgRead | 1 | |||
| 17c377 | som-rs-bc | interpreter | ArrayReadConst | 1 | |||
| 17c377 | som-rs-bc | interpreter | ArrayWriteConstConst | 1 | |||
| 17c377 | som-rs-bc | interpreter | BlockSend0ConstReturn | 1 | |||
| 17c377 | som-rs-bc | interpreter | Const | 1 | |||
| 17c377 | som-rs-bc | interpreter | FieldConstWrite | 1 | |||
| 17c377 | som-rs-bc | interpreter | FieldRead | 1 | |||
| 17c377 | som-rs-bc | interpreter | FieldReadIncWrite | 1 | |||
| 17c377 | som-rs-bc | interpreter | FieldReadWrite | 1 | |||
| 17c377 | som-rs-bc | interpreter | GlobalRead | 1 | |||
| 17c377 | som-rs-bc | interpreter | LocalConstWrite | 1 | |||
| 17c377 | som-rs-bc | interpreter | LocalRead | 1 | |||
| 17c377 | som-rs-bc | interpreter | LocalReadIncWrite | 1 | |||
| 17c377 | som-rs-bc | interpreter | LocalReadWrite | 1 | |||
| 17c377 | som-rs-bc | interpreter | SelfSend0 | 1 | |||
| 17c377 | som-rs-bc | interpreter | SelfSend0BlockConstNonLocalReturn | 1 | |||
| show more | |||||||
Performance Changes between Versions
interpreter
Executor: som-rs-ast
| #M | median time in ms |
time diff % | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ArgRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| ArrayReadConst | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| ArrayWriteConstConst | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| BlockSend0ConstReturn | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| Const | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldConstWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldReadIncWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldReadWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| GlobalRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalConstWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalReadIncWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalReadWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| SelfSend0 | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| SelfSend0BlockConstNonLocalReturn | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
macro
Executor: som-rs-ast
| #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|
| GraphSearch | 5 | 277.43 | 0 | ||
| JsonSmall | 5 | 68.80 | 0 | ||
| NBody | 5 | 291.47 | -1 | ||
| PageRank | 5 | 540.79 | 1 |
micro
Executor: som-rs-ast
| #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|
| Bounce | 5 | 590.94 | 1 | ||
| BubbleSort | 5 | 798.64 | 0 | ||
| Dispatch | 5 | 468.29 | 1 | ||
| Fannkuch | 5 | 577.10 | -1 | ||
| Fibonacci | 5 | 669.90 | 0 | ||
| FieldLoop | 5 | 187.33 | 0 | ||
| IntegerLoop | 5 | 552.45 | -1 | ||
| List | 5 | 101.34 | 0 | ||
| Loop | 5 | 4088.26 | 0 | ||
| Permute | 5 | 648.60 | 0 | ||
| Queens | 5 | 789.35 | 0 | ||
| QuickSort | 5 | 631.11 | 0 | ||
| Recurse | 5 | 861.72 | 0 | ||
| Sieve | 5 | 1103.64 | 0 | ||
| Storage | 5 | 439.91 | 0 | ||
| Sum | 5 | 1588.89 | 1 | ||
| Towers | 5 | 202.49 | 0 | ||
| TreeSort | 5 | 503.23 | 0 | ||
| WhileLoop | 5 | 340.03 | 0 |
micro-som-rs
Executor: som-rs-ast
| #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|
| LoadClass | 5 | 49.34 | 1 | ||
| Mandelbrot | 5 | 431.99 | 0 |
interpreter
Executor: som-rs-bc
| #M | median time in ms |
time diff % | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ArgRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| ArrayReadConst | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| ArrayWriteConstConst | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| BlockSend0ConstReturn | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| Const | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldConstWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldReadIncWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| FieldReadWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| GlobalRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalConstWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalRead | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalReadIncWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| LocalReadWrite | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| SelfSend0 | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
| SelfSend0BlockConstNonLocalReturn | No matching configuration for 17c377dc902cf8e2b742a0dff0c3a0d29be88294: Allocated, Compile time, GC count, GC time, total |
|||||||||||||||||||
macro
Executor: som-rs-bc
| #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|
| GraphSearch | 5 | 90.54 | 0 | ||
| JsonSmall | 5 | 27.09 | 0 | ||
| NBody | 5 | 126.83 | 0 | ||
| PageRank | 5 | 141.77 | 1 |
micro
Executor: som-rs-bc
| #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|
| Bounce | 5 | 198.07 | -1 | ||
| BubbleSort | 5 | 237.95 | 0 | ||
| Dispatch | 5 | 100.94 | 0 | ||
| Fannkuch | 5 | 140.84 | 0 | ||
| Fibonacci | 5 | 165.94 | 1 | ||
| FieldLoop | 5 | 70.97 | -1 | ||
| IntegerLoop | 5 | 0.02 | 0 | ||
| List | 5 | 45.28 | -1 | ||
| Loop | 5 | 430.63 | 1 | ||
| Permute | 5 | 205.28 | 0 | ||
| Queens | 5 | 261.13 | 0 | ||
| QuickSort | 5 | 173.54 | 0 | ||
| Recurse | 5 | 312.48 | 0 | ||
| Sieve | 5 | 285.17 | -1 | ||
| Storage | 5 | 120.52 | 0 | ||
| Sum | 5 | 250.47 | 1 | ||
| Towers | 5 | 93.63 | 1 | ||
| TreeSort | 5 | 120.42 | 0 | ||
| WhileLoop | 5 | 115.42 | 0 |
micro-som-rs
Executor: som-rs-bc
| #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|
| LoadClass | 5 | 26.74 | 0 | ||
| Mandelbrot | 5 | 172.10 | 0 |
Executor Comparisons
macro
Baseline: som-rs-ast
| Exe | #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|---|
| GraphSearch |
ast
bc |
5
5 |
277.43
90.54 |
0
-67 |
||
| JsonSmall |
ast
bc |
5
5 |
68.80
27.09 |
0
-61 |
||
| NBody |
ast
bc |
5
5 |
291.47
126.83 |
0
-56 |
||
| PageRank |
ast
bc |
5
5 |
540.79
141.77 |
0
-74 |
micro
Baseline: som-rs-ast
| Exe | #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|---|
| Bounce |
ast
bc |
5
5 |
590.94
198.07 |
0
-66 |
||
| BubbleSort |
ast
bc |
5
5 |
798.64
237.95 |
0
-70 |
||
| Dispatch |
ast
bc |
5
5 |
468.29
100.94 |
0
-78 |
||
| Fannkuch |
ast
bc |
5
5 |
577.10
140.84 |
0
-76 |
||
| Fibonacci |
ast
bc |
5
5 |
669.90
165.94 |
0
-75 |
||
| FieldLoop |
ast
bc |
5
5 |
187.33
70.97 |
0
-62 |
||
| IntegerLoop |
ast
bc |
5
5 |
552.45
0.02 |
0
-100 |
||
| List |
ast
bc |
5
5 |
101.34
45.28 |
0
-55 |
||
| Loop |
ast
bc |
5
5 |
4088.26
430.63 |
0
-89 |
||
| Permute |
ast
bc |
5
5 |
648.60
205.28 |
0
-68 |
||
| Queens |
ast
bc |
5
5 |
789.35
261.13 |
0
-67 |
||
| QuickSort |
ast
bc |
5
5 |
631.11
173.54 |
0
-73 |
||
| Recurse |
ast
bc |
5
5 |
861.72
312.48 |
0
-64 |
||
| Sieve |
ast
bc |
5
5 |
1103.64
285.17 |
0
-74 |
||
| Storage |
ast
bc |
5
5 |
439.91
120.52 |
0
-73 |
||
| Sum |
ast
bc |
5
5 |
1588.89
250.47 |
0
-84 |
||
| Towers |
ast
bc |
5
5 |
202.49
93.63 |
0
-54 |
||
| TreeSort |
ast
bc |
5
5 |
503.23
120.42 |
0
-76 |
||
| WhileLoop |
ast
bc |
5
5 |
340.03
115.42 |
0
-66 |
micro-som-rs
Baseline: som-rs-ast
| Exe | #M | median time in ms |
time diff % | |||
|---|---|---|---|---|---|---|
| LoadClass |
ast
bc |
5
5 |
49.34
26.74 |
0
-46 |
||
| Mandelbrot |
ast
bc |
5
5 |
431.99
172.10 |
0
-60 |