oilshell.org
OSH Runtime Performance
Source code: benchmarks/osh-runtime.sh
Raw files
Elapsed Time by Shell (milliseconds)
Some benchmarks call many external tools, while some exercise the shell
interpreter itself.
workload |
host name |
bash |
dash |
osh-cpython |
osh-native |
py bash ratio |
native bash ratio |
abuild-print-help |
no-host |
19 |
9 |
474 |
22 |
25.12 |
1.16 |
bin-true |
no-host |
645 |
531 |
2,296 |
805 |
3.56 |
1.25 |
configure.cpython |
no-host |
14,781 |
14,773 |
29,254 |
15,325 |
1.98 |
1.04 |
configure.ocaml |
no-host |
3,865 |
3,726 |
4,679 |
3,788 |
1.21 |
0.98 |
configure.tcc |
no-host |
47 |
41 |
195 |
48 |
4.12 |
1.02 |
configure.util-linux |
no-host |
13,734 |
14,835 |
31,756 |
14,202 |
2.31 |
1.03 |
configure.yash |
no-host |
1,831 |
1,801 |
2,525 |
1,811 |
1.38 |
0.99 |
hello-world |
no-host |
1 |
1 |
52 |
3 |
39.54 |
2.17 |
Minor Page Faults
workload |
host name |
bash |
dash |
osh-cpython |
osh-native |
py bash ratio |
native bash ratio |
abuild-print-help |
no-host |
2,566 |
1,100 |
22,962 |
3,174 |
8.95 |
1.24 |
bin-true |
no-host |
103,368 |
66,434 |
763,881 |
128,127 |
7.39 |
1.24 |
configure.cpython |
no-host |
2,000,741 |
2,020,119 |
5,943,834 |
2,001,078 |
2.97 |
1.00 |
configure.ocaml |
no-host |
373,594 |
353,965 |
604,022 |
376,908 |
1.62 |
1.01 |
configure.tcc |
no-host |
6,085 |
5,007 |
22,791 |
6,556 |
3.75 |
1.08 |
configure.util-linux |
no-host |
1,904,057 |
2,067,103 |
5,132,595 |
1,805,224 |
2.70 |
0.95 |
configure.yash |
no-host |
232,381 |
221,705 |
361,980 |
235,603 |
1.56 |
1.01 |
hello-world |
no-host |
145 |
77 |
3,690 |
349 |
25.45 |
2.41 |
Memory Usage (Max Resident Set Size in MB)
Memory usage is measured in MB (powers of 10), not MiB (powers of 2).
GC Stats
workload |
host name |
elapsed ms |
max gc millis |
total gc millis |
allocated MB |
max rss MB |
num allocated |
num live |
max survived |
num in heap |
num in pool 1 |
num in pool 2 |
num gc points |
num gc done |
gc threshold |
num growths |
hello-world |
no-host |
3 |
0 |
0 |
0.3 |
6.2 |
3,749 |
3,749 |
0 |
684 |
1,892 |
1,173 |
2 |
0 |
50,000 |
0 |
bin-true |
no-host |
805 |
1 |
2 |
2.6 |
8.0 |
154,714 |
13,066 |
2,818 |
9,734 |
78,361 |
66,619 |
3,008 |
3 |
50,000 |
0 |
configure.cpython |
no-host |
15,325 |
1 |
67 |
15.0 |
29.2 |
1,772,690 |
49,108 |
28,528 |
86,381 |
908,113 |
778,196 |
22,694 |
60 |
50,000 |
0 |
configure.util-linux |
no-host |
14,202 |
3 |
67 |
21.3 |
30.3 |
2,703,426 |
42,745 |
65,812 |
109,643 |
1,320,611 |
1,273,172 |
27,391 |
41 |
131,624 |
1 |
configure.ocaml |
no-host |
3,788 |
1 |
2 |
2.6 |
22.6 |
150,060 |
10,993 |
5,163 |
7,513 |
71,649 |
70,898 |
1,448 |
3 |
50,000 |
0 |
configure.tcc |
no-host |
48 |
0 |
0 |
1.3 |
19.7 |
30,549 |
30,549 |
0 |
1,504 |
14,816 |
14,229 |
226 |
0 |
50,000 |
0 |
configure.yash |
no-host |
1,811 |
1 |
2 |
2.6 |
26.4 |
139,717 |
7,961 |
6,620 |
6,320 |
70,321 |
63,076 |
1,803 |
3 |
50,000 |
0 |
abuild-print-help |
no-host |
22 |
1 |
2 |
2.8 |
8.8 |
116,292 |
64,471 |
42,681 |
4,555 |
54,561 |
57,176 |
270 |
3 |
85,362 |
1 |
rusage Details
task id |
host name |
workload |
elapsed ms |
user ms |
sys ms |
max rss MB |
shell label |
7 |
no-host |
abuild-print-help |
19 |
10 |
10 |
4.5 |
bash |
15 |
no-host |
abuild-print-help |
9 |
4 |
6 |
3.4 |
dash |
23 |
no-host |
abuild-print-help |
474 |
406 |
72 |
21.9 |
osh-cpython |
31 |
no-host |
abuild-print-help |
22 |
13 |
10 |
8.8 |
osh-native |
1 |
no-host |
bin-true |
645 |
315 |
364 |
3.0 |
bash |
9 |
no-host |
bin-true |
531 |
273 |
269 |
1.4 |
dash |
17 |
no-host |
bin-true |
2,296 |
773 |
1,804 |
17.4 |
osh-cpython |
25 |
no-host |
bin-true |
805 |
299 |
523 |
8.0 |
osh-native |
2 |
no-host |
configure.cpython |
14,781 |
6,540 |
8,647 |
29.3 |
bash |
10 |
no-host |
configure.cpython |
14,773 |
6,731 |
8,472 |
29.1 |
dash |
18 |
no-host |
configure.cpython |
29,254 |
14,678 |
16,540 |
29.2 |
osh-cpython |
26 |
no-host |
configure.cpython |
15,325 |
6,768 |
8,832 |
29.2 |
osh-native |
4 |
no-host |
configure.ocaml |
3,865 |
1,334 |
1,564 |
22.6 |
bash |
12 |
no-host |
configure.ocaml |
3,726 |
1,289 |
1,459 |
22.6 |
dash |
20 |
no-host |
configure.ocaml |
4,679 |
1,890 |
2,002 |
22.6 |
osh-cpython |
28 |
no-host |
configure.ocaml |
3,788 |
1,368 |
1,460 |
22.6 |
osh-native |
5 |
no-host |
configure.tcc |
47 |
22 |
26 |
19.6 |
bash |
13 |
no-host |
configure.tcc |
41 |
22 |
20 |
19.7 |
dash |
21 |
no-host |
configure.tcc |
195 |
130 |
69 |
19.5 |
osh-cpython |
29 |
no-host |
configure.tcc |
48 |
25 |
24 |
19.7 |
osh-native |
3 |
no-host |
configure.util-linux |
13,734 |
5,842 |
8,351 |
30.4 |
bash |
11 |
no-host |
configure.util-linux |
14,835 |
6,020 |
9,328 |
30.2 |
dash |
19 |
no-host |
configure.util-linux |
31,756 |
18,021 |
14,862 |
30.3 |
osh-cpython |
27 |
no-host |
configure.util-linux |
14,202 |
5,777 |
8,645 |
30.3 |
osh-native |
6 |
no-host |
configure.yash |
1,831 |
880 |
961 |
26.2 |
bash |
14 |
no-host |
configure.yash |
1,801 |
896 |
909 |
26.4 |
dash |
22 |
no-host |
configure.yash |
2,525 |
1,392 |
1,180 |
26.2 |
osh-cpython |
30 |
no-host |
configure.yash |
1,811 |
945 |
871 |
26.4 |
osh-native |
0 |
no-host |
hello-world |
1 |
0 |
1 |
2.8 |
bash |
8 |
no-host |
hello-world |
1 |
1 |
0 |
1.6 |
dash |
16 |
no-host |
hello-world |
52 |
34 |
18 |
17.3 |
osh-cpython |
24 |
no-host |
hello-world |
3 |
1 |
1 |
6.2 |
osh-native |
More Details
task id |
host name |
workload |
minor faults |
major faults |
swaps |
in block |
out block |
signals |
voluntary ctx |
involuntary ctx |
shell label |
7 |
no-host |
abuild-print-help |
2,566 |
0 |
0 |
0 |
16 |
0 |
41 |
0 |
bash |
15 |
no-host |
abuild-print-help |
1,100 |
0 |
0 |
0 |
8 |
0 |
39 |
0 |
dash |
23 |
no-host |
abuild-print-help |
22,962 |
0 |
0 |
0 |
8 |
0 |
45 |
6 |
osh-cpython |
31 |
no-host |
abuild-print-help |
3,174 |
0 |
0 |
0 |
16 |
0 |
39 |
5 |
osh-native |
1 |
no-host |
bin-true |
103,368 |
0 |
0 |
0 |
8 |
0 |
1,983 |
76 |
bash |
9 |
no-host |
bin-true |
66,434 |
0 |
0 |
0 |
8 |
0 |
1,982 |
156 |
dash |
17 |
no-host |
bin-true |
763,881 |
0 |
0 |
0 |
8 |
0 |
1,990 |
368 |
osh-cpython |
25 |
no-host |
bin-true |
128,127 |
0 |
0 |
0 |
16 |
0 |
1,980 |
224 |
osh-native |
2 |
no-host |
configure.cpython |
2,000,741 |
1 |
0 |
0 |
32,928 |
0 |
14,284 |
1,287 |
bash |
10 |
no-host |
configure.cpython |
2,020,119 |
0 |
0 |
0 |
32,992 |
0 |
14,367 |
1,214 |
dash |
18 |
no-host |
configure.cpython |
5,943,834 |
0 |
0 |
0 |
27,512 |
0 |
13,071 |
1,153 |
osh-cpython |
26 |
no-host |
configure.cpython |
2,001,078 |
0 |
0 |
0 |
27,520 |
0 |
13,073 |
1,062 |
osh-native |
4 |
no-host |
configure.ocaml |
373,594 |
0 |
0 |
0 |
5,120 |
0 |
1,959 |
209 |
bash |
12 |
no-host |
configure.ocaml |
353,965 |
0 |
0 |
0 |
5,112 |
0 |
1,940 |
174 |
dash |
20 |
no-host |
configure.ocaml |
604,022 |
0 |
0 |
0 |
5,112 |
0 |
1,849 |
205 |
osh-cpython |
28 |
no-host |
configure.ocaml |
376,908 |
0 |
0 |
0 |
5,120 |
0 |
1,920 |
190 |
osh-native |
5 |
no-host |
configure.tcc |
6,085 |
0 |
0 |
0 |
104 |
0 |
48 |
3 |
bash |
13 |
no-host |
configure.tcc |
5,007 |
0 |
0 |
0 |
96 |
0 |
47 |
1 |
dash |
21 |
no-host |
configure.tcc |
22,791 |
0 |
0 |
0 |
96 |
0 |
53 |
5 |
osh-cpython |
29 |
no-host |
configure.tcc |
6,556 |
0 |
0 |
0 |
104 |
0 |
46 |
3 |
osh-native |
3 |
no-host |
configure.util-linux |
1,904,057 |
0 |
0 |
0 |
42,400 |
0 |
18,544 |
1,279 |
bash |
11 |
no-host |
configure.util-linux |
2,067,103 |
1 |
0 |
0 |
42,584 |
0 |
17,419 |
1,504 |
dash |
19 |
no-host |
configure.util-linux |
5,132,595 |
9 |
0 |
0 |
39,112 |
0 |
17,042 |
1,445 |
osh-cpython |
27 |
no-host |
configure.util-linux |
1,805,224 |
0 |
0 |
0 |
39,120 |
0 |
17,137 |
1,164 |
osh-native |
6 |
no-host |
configure.yash |
232,381 |
0 |
0 |
0 |
4,120 |
0 |
870 |
80 |
bash |
14 |
no-host |
configure.yash |
221,705 |
0 |
0 |
0 |
3,720 |
0 |
871 |
157 |
dash |
22 |
no-host |
configure.yash |
361,980 |
0 |
0 |
0 |
3,728 |
0 |
858 |
116 |
osh-cpython |
30 |
no-host |
configure.yash |
235,603 |
0 |
0 |
0 |
3,736 |
0 |
853 |
91 |
osh-native |
0 |
no-host |
hello-world |
145 |
0 |
0 |
0 |
8 |
0 |
1 |
0 |
bash |
8 |
no-host |
hello-world |
77 |
0 |
0 |
0 |
8 |
0 |
1 |
0 |
dash |
16 |
no-host |
hello-world |
3,690 |
0 |
0 |
0 |
8 |
0 |
7 |
1 |
osh-cpython |
24 |
no-host |
hello-world |
349 |
0 |
0 |
0 |
16 |
0 |
1 |
1 |
osh-native |
Shell and Host