oilshell.org
OSH Runtime Performance
Source code: benchmarks/osh-runtime.sh
Raw files
Elapsed Time by Shell (milliseconds)
Some benchmarks call many external tools, while some exercise the shell
interpreter itself.
workload |
host name |
bash |
dash |
osh-cpython |
osh-native |
py bash ratio |
native bash ratio |
abuild-print-help |
no-host |
19 |
10 |
459 |
22 |
24.05 |
1.17 |
bin-true |
no-host |
681 |
539 |
2,764 |
1,033 |
4.06 |
1.52 |
configure.cpython |
no-host |
15,267 |
15,067 |
28,959 |
15,187 |
1.90 |
0.99 |
configure.ocaml |
no-host |
3,856 |
3,764 |
4,621 |
3,828 |
1.20 |
0.99 |
configure.tcc |
no-host |
48 |
42 |
194 |
49 |
4.05 |
1.03 |
configure.util-linux |
no-host |
14,378 |
15,011 |
31,345 |
14,339 |
2.18 |
1.00 |
configure.yash |
no-host |
1,843 |
1,786 |
2,501 |
1,835 |
1.36 |
1.00 |
hello-world |
no-host |
2 |
1 |
49 |
3 |
31.78 |
1.84 |
Minor Page Faults
workload |
host name |
bash |
dash |
osh-cpython |
osh-native |
py bash ratio |
native bash ratio |
abuild-print-help |
no-host |
2,559 |
1,092 |
22,822 |
3,204 |
8.92 |
1.25 |
bin-true |
no-host |
107,352 |
65,495 |
894,119 |
230,196 |
8.33 |
2.14 |
configure.cpython |
no-host |
2,224,111 |
2,239,787 |
6,174,098 |
2,226,416 |
2.78 |
1.00 |
configure.ocaml |
no-host |
409,951 |
391,536 |
640,448 |
413,313 |
1.56 |
1.01 |
configure.tcc |
no-host |
6,552 |
5,474 |
23,229 |
7,009 |
3.55 |
1.07 |
configure.util-linux |
no-host |
2,098,811 |
2,266,445 |
5,309,303 |
1,994,448 |
2.53 |
0.95 |
configure.yash |
no-host |
256,334 |
245,293 |
387,801 |
261,263 |
1.51 |
1.02 |
hello-world |
no-host |
153 |
84 |
3,692 |
350 |
24.13 |
2.29 |
Memory Usage (Max Resident Set Size in MB)
Memory usage is measured in MB (powers of 10), not MiB (powers of 2).
GC Stats
workload |
host name |
elapsed ms |
max gc millis |
total gc millis |
allocated MB |
max rss MB |
num allocated |
num live |
max survived |
num in heap |
num in pool 1 |
num in pool 2 |
num gc points |
num gc done |
gc threshold |
num growths |
hello-world |
no-host |
3 |
0 |
0 |
0.3 |
6.3 |
3,749 |
3,749 |
0 |
684 |
1,892 |
1,173 |
2 |
0 |
50,000 |
0 |
bin-true |
no-host |
1,033 |
0 |
2 |
2.6 |
8.0 |
202,738 |
13,857 |
2,818 |
9,734 |
106,375 |
86,629 |
3,008 |
4 |
50,000 |
0 |
configure.cpython |
no-host |
15,187 |
1 |
62 |
15.0 |
28.3 |
1,772,719 |
49,108 |
28,528 |
86,381 |
908,132 |
778,206 |
22,694 |
60 |
50,000 |
0 |
configure.util-linux |
no-host |
14,339 |
3 |
59 |
21.3 |
30.1 |
2,703,551 |
42,745 |
65,832 |
109,643 |
1,320,686 |
1,273,222 |
27,391 |
41 |
131,664 |
1 |
configure.ocaml |
no-host |
3,828 |
1 |
2 |
2.6 |
20.6 |
150,084 |
10,993 |
5,163 |
7,513 |
71,663 |
70,908 |
1,448 |
3 |
50,000 |
0 |
configure.tcc |
no-host |
49 |
0 |
0 |
1.3 |
19.3 |
30,573 |
30,573 |
0 |
1,504 |
14,830 |
14,239 |
226 |
0 |
50,000 |
0 |
configure.yash |
no-host |
1,835 |
1 |
2 |
2.6 |
24.4 |
142,960 |
10,576 |
6,510 |
6,320 |
72,214 |
64,426 |
1,803 |
3 |
50,000 |
0 |
abuild-print-help |
no-host |
22 |
1 |
2 |
2.8 |
8.9 |
116,292 |
64,471 |
42,681 |
4,555 |
54,561 |
57,176 |
270 |
3 |
85,362 |
1 |
rusage Details
task id |
host name |
workload |
elapsed ms |
user ms |
sys ms |
max rss MB |
shell label |
7 |
no-host |
abuild-print-help |
19 |
14 |
5 |
4.5 |
bash |
15 |
no-host |
abuild-print-help |
10 |
9 |
1 |
3.4 |
dash |
23 |
no-host |
abuild-print-help |
459 |
414 |
48 |
21.8 |
osh-cpython |
31 |
no-host |
abuild-print-help |
22 |
20 |
3 |
8.9 |
osh-native |
1 |
no-host |
bin-true |
681 |
492 |
221 |
3.0 |
bash |
9 |
no-host |
bin-true |
539 |
413 |
133 |
1.4 |
dash |
17 |
no-host |
bin-true |
2,764 |
1,885 |
1,146 |
19.3 |
osh-cpython |
25 |
no-host |
bin-true |
1,033 |
737 |
314 |
8.0 |
osh-native |
2 |
no-host |
configure.cpython |
15,267 |
9,195 |
6,487 |
27.4 |
bash |
10 |
no-host |
configure.cpython |
15,067 |
8,995 |
6,502 |
27.4 |
dash |
18 |
no-host |
configure.cpython |
28,959 |
17,766 |
13,086 |
27.5 |
osh-cpython |
26 |
no-host |
configure.cpython |
15,187 |
8,889 |
6,570 |
28.3 |
osh-native |
4 |
no-host |
configure.ocaml |
3,856 |
1,697 |
1,201 |
20.4 |
bash |
12 |
no-host |
configure.ocaml |
3,764 |
1,647 |
1,137 |
20.6 |
dash |
20 |
no-host |
configure.ocaml |
4,621 |
2,253 |
1,579 |
20.4 |
osh-cpython |
28 |
no-host |
configure.ocaml |
3,828 |
1,551 |
1,316 |
20.6 |
osh-native |
5 |
no-host |
configure.tcc |
48 |
27 |
21 |
19.3 |
bash |
13 |
no-host |
configure.tcc |
42 |
29 |
13 |
19.3 |
dash |
21 |
no-host |
configure.tcc |
194 |
164 |
33 |
19.4 |
osh-cpython |
29 |
no-host |
configure.tcc |
49 |
27 |
23 |
19.3 |
osh-native |
3 |
no-host |
configure.util-linux |
14,378 |
8,895 |
5,972 |
30.1 |
bash |
11 |
no-host |
configure.util-linux |
15,011 |
9,169 |
6,351 |
30.3 |
dash |
19 |
no-host |
configure.util-linux |
31,345 |
20,916 |
11,534 |
30.0 |
osh-cpython |
27 |
no-host |
configure.util-linux |
14,339 |
8,695 |
5,864 |
30.1 |
osh-native |
6 |
no-host |
configure.yash |
1,843 |
1,103 |
748 |
24.4 |
bash |
14 |
no-host |
configure.yash |
1,786 |
1,036 |
754 |
24.4 |
dash |
22 |
no-host |
configure.yash |
2,501 |
1,541 |
1,004 |
24.2 |
osh-cpython |
30 |
no-host |
configure.yash |
1,835 |
1,057 |
782 |
24.4 |
osh-native |
0 |
no-host |
hello-world |
2 |
2 |
0 |
2.9 |
bash |
8 |
no-host |
hello-world |
1 |
1 |
0 |
1.4 |
dash |
16 |
no-host |
hello-world |
49 |
25 |
24 |
17.6 |
osh-cpython |
24 |
no-host |
hello-world |
3 |
3 |
0 |
6.3 |
osh-native |
More Details
task id |
host name |
workload |
minor faults |
major faults |
swaps |
in block |
out block |
signals |
voluntary ctx |
involuntary ctx |
shell label |
7 |
no-host |
abuild-print-help |
2,559 |
0 |
0 |
0 |
16 |
0 |
41 |
3 |
bash |
15 |
no-host |
abuild-print-help |
1,092 |
0 |
0 |
0 |
8 |
0 |
39 |
0 |
dash |
23 |
no-host |
abuild-print-help |
22,822 |
0 |
0 |
0 |
8 |
0 |
45 |
8 |
osh-cpython |
31 |
no-host |
abuild-print-help |
3,204 |
0 |
0 |
0 |
16 |
0 |
39 |
1 |
osh-native |
1 |
no-host |
bin-true |
107,352 |
0 |
0 |
0 |
8 |
0 |
1,992 |
51 |
bash |
9 |
no-host |
bin-true |
65,495 |
0 |
0 |
0 |
8 |
0 |
1,993 |
35 |
dash |
17 |
no-host |
bin-true |
894,119 |
0 |
0 |
0 |
8 |
0 |
1,995 |
303 |
osh-cpython |
25 |
no-host |
bin-true |
230,196 |
0 |
0 |
0 |
16 |
0 |
1,983 |
54 |
osh-native |
2 |
no-host |
configure.cpython |
2,224,111 |
0 |
0 |
0 |
32,928 |
0 |
14,546 |
1,059 |
bash |
10 |
no-host |
configure.cpython |
2,239,787 |
1 |
0 |
0 |
32,992 |
0 |
14,590 |
1,096 |
dash |
18 |
no-host |
configure.cpython |
6,174,098 |
1 |
0 |
0 |
27,512 |
0 |
13,304 |
1,357 |
osh-cpython |
26 |
no-host |
configure.cpython |
2,226,416 |
0 |
0 |
0 |
27,520 |
0 |
13,183 |
1,035 |
osh-native |
4 |
no-host |
configure.ocaml |
409,951 |
0 |
0 |
0 |
5,120 |
0 |
1,943 |
174 |
bash |
12 |
no-host |
configure.ocaml |
391,536 |
0 |
0 |
0 |
5,112 |
0 |
1,917 |
164 |
dash |
20 |
no-host |
configure.ocaml |
640,448 |
0 |
0 |
0 |
5,112 |
0 |
1,853 |
171 |
osh-cpython |
28 |
no-host |
configure.ocaml |
413,313 |
0 |
0 |
0 |
5,120 |
0 |
1,928 |
174 |
osh-native |
5 |
no-host |
configure.tcc |
6,552 |
0 |
0 |
0 |
104 |
0 |
49 |
12 |
bash |
13 |
no-host |
configure.tcc |
5,474 |
0 |
0 |
0 |
96 |
0 |
47 |
4 |
dash |
21 |
no-host |
configure.tcc |
23,229 |
0 |
0 |
0 |
96 |
0 |
53 |
8 |
osh-cpython |
29 |
no-host |
configure.tcc |
7,009 |
0 |
0 |
0 |
104 |
0 |
47 |
4 |
osh-native |
3 |
no-host |
configure.util-linux |
2,098,811 |
2 |
0 |
0 |
42,400 |
0 |
18,570 |
1,065 |
bash |
11 |
no-host |
configure.util-linux |
2,266,445 |
0 |
0 |
0 |
42,584 |
0 |
17,456 |
1,078 |
dash |
19 |
no-host |
configure.util-linux |
5,309,303 |
10 |
0 |
0 |
39,120 |
0 |
16,963 |
1,166 |
osh-cpython |
27 |
no-host |
configure.util-linux |
1,994,448 |
0 |
0 |
0 |
39,128 |
0 |
17,022 |
1,093 |
osh-native |
6 |
no-host |
configure.yash |
256,334 |
0 |
0 |
0 |
4,120 |
0 |
870 |
89 |
bash |
14 |
no-host |
configure.yash |
245,293 |
0 |
0 |
0 |
3,720 |
0 |
870 |
77 |
dash |
22 |
no-host |
configure.yash |
387,801 |
0 |
0 |
0 |
3,728 |
0 |
853 |
96 |
osh-cpython |
30 |
no-host |
configure.yash |
261,263 |
0 |
0 |
0 |
3,736 |
0 |
852 |
105 |
osh-native |
0 |
no-host |
hello-world |
153 |
0 |
0 |
0 |
8 |
0 |
1 |
0 |
bash |
8 |
no-host |
hello-world |
84 |
0 |
0 |
0 |
8 |
0 |
1 |
0 |
dash |
16 |
no-host |
hello-world |
3,692 |
0 |
0 |
0 |
8 |
0 |
7 |
6 |
osh-cpython |
24 |
no-host |
hello-world |
350 |
0 |
0 |
0 |
16 |
0 |
1 |
0 |
osh-native |
Shell and Host