Result Overview

Number of Run Configurations
83
Change of Allocated
median 0% (min. -21%, max. 8%)
Change of GC count
median 0% (min. 0%, max. 0%)
Change of GC time
median 0% (min. 0%, max. 1%)
Change of Run time
median -3% (min. -27%, max. 3%)

Changes in Benchmark Set

Commit Executor Suite Benchmark Variable Values Cores Input Size Extra Arguments
3f5c75 som-rs-ast micro IntegerLoop 1 500
show more

Performance Changes between Versions

interpreter

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
ArgRead 5 15.22 -11 2MB -16 0 0 0 0
ArrayReadConst 5 48.54 -5 2MB -16 0 0 0 0
ArrayWriteConstConst 5 54.30 -4 2MB -16 0 0 0 0
BlockSend0ConstReturn 5 84.17 -27 35MB -21 0 0 0 0
Const 5 17.80 -12 2MB -16 0 0 0 0
FieldConstWrite 5 22.31 -10 2MB -16 0 0 0 0
FieldRead 5 16.08 -10 2MB -16 0 0 0 0
FieldReadIncWrite 5 56.70 -7 2MB -16 0 0 0 0
FieldReadWrite 5 22.52 -6 2MB -16 0 0 0 0
GlobalRead 5 38.65 -3 2MB -16 0 0 0 0
LocalConstWrite 5 21.55 -8 2MB -16 0 0 0 0
LocalRead 5 16.07 -13 2MB -16 0 0 0 0
LocalReadIncWrite 5 51.63 -1 2MB -16 0 0 0 0
LocalReadWrite 5 20.06 -9 2MB -16 0 0 0 0
SelfSend0 5 37.19 -8 2MB -16 0 0 0 0
SelfSend0BlockConstNonLocalReturn 5 128.57 -26 54MB -20 0 0 0 0

macro

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
DeltaBlue 5 13.11 -10 2MB -14 0 0 0 0
GraphSearch 5 60.28 -11 8MB -14 0 0 0 0
JsonSmall 5 15.39 -10 2MB -9 0 0 0 0
NBody 5 33.73 -3 660kb -8 0 0 0 0
PageRank 5 81.93 -7 5MB -17 0 0 0 0
Richards 5 265.28 -10 26MB -16 0 0 0 0

micro

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Bounce 5 87.93 -14 16MB -14 0 0 0 0
BubbleSort 5 103.68 -12 13MB -15 0 0 0 0
Dispatch 5 30.05 -17 8MB -15 0 0 0 0
Fannkuch 5 46.11 -7 4MB -11 0 0 0 0
Fibonacci 5 127.51 -17 26MB -17 0 0 0 0
FieldLoop 5 56.67 -8 2MB -16 0 0 0 0
IntegerLoop No matching configuration for
3f5c7528aad4c57b371b2dbddc8d93c1870e7ef9: Allocated, Compile time, GC count, GC time, total
List 5 12.25 -6 692kb -11 0 0 0 0
Loop 5 147.81 -6 988kb 8 0 0 0 0
Permute 5 86.48 -14 15MB -14 0 0 0 0
Queens 5 107.29 -12 17MB -14 0 0 0 0
QuickSort 5 77.89 -9 8MB -15 0 0 0 0
Recurse 5 158.14 -16 31MB -15 0 0 0 0
Sieve 5 130.20 -10 16MB -16 0 0 0 0
Storage 5 60.08 -14 10MB -16 0 0 0 0
Sum 5 53.74 -5 0b 0 0 0 0 0
Towers 5 28.57 -12 4MB -14 0 0 0 0
TreeSort 5 45.29 -12 8MB -15 0 0 0 0
WhileLoop 5 71.44 -1 32kb 0 0 0 0 0

micro-som-rs

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Mandelbrot 5 87.82 -10 6MB -15 0 0 0 0

interpreter

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
ArgRead 5 18.84 -1 9MB 0 0 0 0 0
ArrayReadConst 5 31.41 -1 9MB 0 0 0 0 0
ArrayWriteConstConst 5 39.02 0 9MB 0 0 0 0 0
BlockSend0ConstReturn 5 130.87 0 108MB 0 0 0 0 0
Const 5 22.81 0 9MB 0 0 0 0 0
FieldConstWrite 5 19.55 1 9MB 0 0 0 0 0
FieldRead 5 19.35 1 9MB 0 0 0 0 0
FieldReadIncWrite 5 23.36 -2 9MB 0 0 0 0 0
FieldReadWrite 5 20.77 -1 9MB 0 0 0 0 0
GlobalRead 5 32.01 0 9MB 0 0 0 0 0
LocalConstWrite 5 19.21 1 9MB 0 0 0 0 0
LocalRead 5 18.79 0 9MB 0 0 0 0 0
LocalReadIncWrite 5 22.07 2 9MB 0 0 0 0 0
LocalReadWrite 5 19.40 -1 9MB 0 0 0 0 0
SelfSend0 5 66.60 0 56MB 0 0 0 0 0
SelfSend0BlockConstNonLocalReturn 5 166.25 3 122MB 0 0 0 0 0

macro

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
DeltaBlue 5 13.24 -1 7MB 0 0 0 0 0
GraphSearch 5 54.43 -2 17MB 0 0 0 0 0
JsonSmall 5 14.30 0 4MB 0 0 0 0 0
NBody 5 44.73 -2 25MB 0 0 0 0 0
PageRank 5 58.96 -3 9MB 0 0 0 0 0
Richards 5 286.19 -1 44MB 0 1 0 2986 1

micro

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Bounce 5 94.92 0 53MB 0 0 0 0 0
BubbleSort 5 85.61 -2 47MB 0 0 0 0 0
Dispatch 5 29.57 -1 17MB 0 0 0 0 0
Fannkuch 5 32.52 1 9MB 0 0 0 0 0
Fibonacci 5 133.81 -1 93MB 0 0 0 0 0
FieldLoop 5 23.35 -2 9MB 0 0 0 0 0
IntegerLoop 5 6018.92 -3 71MB 0 29 0 29276 0
List 5 19.92 -2 14MB 0 0 0 0 0
Loop 5 66.19 -1 3MB 0 0 0 0 0
Permute 5 107.27 0 69MB 0 0 0 0 0
Queens 5 101.56 0 52MB 0 0 0 0 0
QuickSort 5 61.22 1 23MB 0 0 0 0 0
Recurse 5 155.25 0 107MB 0 0 0 0 0
Sieve 5 92.78 -4 40MB 0 0 0 0 0
Storage 5 50.34 -2 29MB 0 0 0 0 0
Sum 5 47.78 -8 32kb 0 0 0 0 0
Towers 5 32.27 -1 22MB 0 0 0 0 0
TreeSort 5 52.09 2 31MB 0 0 0 0 0
WhileLoop 5 34.86 -1 68kb 0 0 0 0 0

micro-som-rs

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Mandelbrot 5 67.32 -4 22MB 0 0 0 0 0

Executor Comparisons

interpreter

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
ArgRead ast
bc 		5
5 		15.22
18.84 		0
24 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
ArrayReadConst ast
bc 		5
5 		48.54
31.41 		0
-35 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
ArrayWriteConstConst ast
bc 		5
5 		54.30
39.02 		0
-28 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
BlockSend0ConstReturn ast
bc 		5
5 		84.17
130.87 		0
55 		35MB
108MB 		0
205 		0
0 		0
0 		0
0 		0
0
Const ast
bc 		5
5 		17.80
22.81 		0
28 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldConstWrite ast
bc 		5
5 		22.31
19.55 		0
-12 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldRead ast
bc 		5
5 		16.08
19.35 		0
20 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldReadIncWrite ast
bc 		5
5 		56.70
23.36 		0
-59 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldReadWrite ast
bc 		5
5 		22.52
20.77 		0
-8 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
GlobalRead ast
bc 		5
5 		38.65
32.01 		0
-17 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalConstWrite ast
bc 		5
5 		21.55
19.21 		0
-11 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalRead ast
bc 		5
5 		16.07
18.79 		0
17 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalReadIncWrite ast
bc 		5
5 		51.63
22.07 		0
-57 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalReadWrite ast
bc 		5
5 		20.06
19.40 		0
-3 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
SelfSend0 ast
bc 		5
5 		37.19
66.60 		0
79 		2MB
56MB 		0
2283 		0
0 		0
0 		0
0 		0
0
SelfSend0BlockConstNonLocalReturn ast
bc 		5
5 		128.57
166.25 		0
29 		54MB
122MB 		0
125 		0
0 		0
0 		0
0 		0
0

macro

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
DeltaBlue ast
bc 		5
5 		13.11
13.24 		0
1 		2MB
7MB 		0
308 		0
0 		0
0 		0
0 		0
0
GraphSearch ast
bc 		5
5 		60.28
54.43 		0
-10 		8MB
17MB 		0
104 		0
0 		0
0 		0
0 		0
0
JsonSmall ast
bc 		5
5 		15.39
14.30 		0
-7 		2MB
4MB 		0
143 		0
0 		0
0 		0
0 		0
0
NBody ast
bc 		5
5 		33.73
44.73 		0
33 		660kb
25MB 		0
3725 		0
0 		0
0 		0
0 		0
0
PageRank ast
bc 		5
5 		81.93
58.96 		0
-28 		5MB
9MB 		0
83 		0
0 		0
0 		0
0 		0
0
Richards ast
bc 		5
5 		265.28
286.19 		0
8 		26MB
44MB 		0
70 		0
1 		0
0 		0
2986 		0
0

micro

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Bounce ast
bc 		5
5 		87.93
94.92 		0
8 		16MB
53MB 		0
235 		0
0 		0
0 		0
0 		0
0
BubbleSort ast
bc 		5
5 		103.68
85.61 		0
-17 		13MB
47MB 		0
259 		0
0 		0
0 		0
0 		0
0
Dispatch ast
bc 		5
5 		30.05
29.57 		0
-2 		8MB
17MB 		0
121 		0
0 		0
0 		0
0 		0
0
Fannkuch ast
bc 		5
5 		46.11
32.52 		0
-29 		4MB
9MB 		0
148 		0
0 		0
0 		0
0 		0
0
Fibonacci ast
bc 		5
5 		127.51
133.81 		0
5 		26MB
93MB 		0
260 		0
0 		0
0 		0
0 		0
0
FieldLoop ast
bc 		5
5 		56.67
23.35 		0
-59 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
List ast
bc 		5
5 		12.25
19.92 		0
63 		692kb
14MB 		0
1941 		0
0 		0
0 		0
0 		0
0
Loop ast
bc 		5
5 		147.81
66.19 		0
-55 		988kb
3MB 		0
181 		0
0 		0
0 		0
0 		0
0
Permute ast
bc 		5
5 		86.48
107.27 		0
24 		15MB
69MB 		0
354 		0
0 		0
0 		0
0 		0
0
Queens ast
bc 		5
5 		107.29
101.56 		0
-5 		17MB
52MB 		0
199 		0
0 		0
0 		0
0 		0
0
QuickSort ast
bc 		5
5 		77.89
61.22 		0
-21 		8MB
23MB 		0
178 		0
0 		0
0 		0
0 		0
0
Recurse ast
bc 		5
5 		158.14
155.25 		0
-2 		31MB
107MB 		0
245 		0
0 		0
0 		0
0 		0
0
Sieve ast
bc 		5
5 		130.20
92.78 		0
-29 		16MB
40MB 		0
142 		0
0 		0
0 		0
0 		0
0
Storage ast
bc 		5
5 		60.08
50.34 		0
-16 		10MB
29MB 		0
181 		0
0 		0
0 		0
0 		0
0
Sum ast
bc 		5
5 		53.74
47.78 		0
-11 		0b
32kb 		0
0 		0
0 		0
0 		0
0 		0
0
Towers ast
bc 		5
5 		28.57
32.27 		0
13 		4MB
22MB 		0
425 		0
0 		0
0 		0
0 		0
0
TreeSort ast
bc 		5
5 		45.29
52.09 		0
15 		8MB
31MB 		0
289 		0
0 		0
0 		0
0 		0
0
WhileLoop ast
bc 		5
5 		71.44
34.86 		0
-51 		32kb
68kb 		0
113 		0
0 		0
0 		0
0 		0
0

micro-som-rs

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Mandelbrot ast
bc 		5
5 		87.82
67.32 		0
-23 		6MB
22MB 		0
240 		0
0 		0
0 		0
0 		0
0