OSH Compute Performance

Running time and memory usage of programs that test data structures (as opposed to I/O).

Memory usage is measured in MB (powers of 10), not MiB (powers of 2).

Source code: oil/benchmarks/compute

hello (minimal startup)

host name arg1 arg2 runtime label elapsed ms user ms sys ms max rss MB
broome _ _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 3 0 3 4.1
broome _ _ dash 1 1 0 1.8
broome _ _ bash 2 2 0 3.4
broome _ _ python2 17 13 4 7.3
lenny _ _ dash 1 1 0 1.7
lenny _ _ bash 1 1 0 3.2
lenny _ _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1 1 0 4.1
lenny _ _ python2 7 7 0 7.3

fibonacci (integers)

host name arg1 arg2 runtime label elapsed ms user ms sys ms max rss MB
broome 200 44 python2 19 15 4 7.2
broome 200 44 dash 39 35 4 1.8
broome 200 44 bash 116 112 4 3.4
broome 200 44 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 727 420 308 679.4
lenny 200 44 python2 7 4 4 7.4
lenny 200 44 dash 18 18 0 1.7
lenny 200 44 bash 64 60 4 3.4
lenny 200 44 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 421 231 191 679.3

word_freq (associative arrays / hash tables)

host name arg1 arg2 runtime label elapsed ms user ms sys ms max rss MB
broome 10 configure python2 37 28 12 7.5
broome 10 configure bash 145 132 19 3.6
broome 10 configure /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 478 318 166 419.6
lenny 10 configure python2 14 9 6 7.4
lenny 10 configure bash 84 80 6 3.5
lenny 10 configure /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 273 132 144 419.5

parse_help (strings, real code)

host name arg1 runtime label elapsed ms user ms sys ms max rss MB
broome ls bash 37 29 9 3.8
broome ls /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 77 65 13 29.6
broome ls-short bash 18 15 2 3.6
broome ls-short /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 20 15 5 6.2
broome mypy bash 44 41 3 3.7
broome mypy /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 100 69 32 39.8
lenny ls bash 15 15 0 3.6
lenny ls /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 35 28 8 29.5
lenny ls-short /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 7 2 5 6.0
lenny ls-short bash 6 6 0 3.6
lenny mypy bash 19 19 0 3.6
lenny mypy /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 46 28 18 39.8

bubble_sort (array of integers, arrays of strings)

host name arg1 arg2 runtime label elapsed ms user ms sys ms max rss MB
broome bytes 200 python2 37 33 5 7.2
broome bytes 200 bash 391 389 3 3.6
broome bytes 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,710 1,046 664 1,840.9
broome int 200 python2 60 54 7 7.3
broome int 200 bash 402 398 5 3.5
broome int 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,637 953 685 1,681.8
lenny bytes 200 python2 14 14 0 7.3
lenny bytes 200 bash 257 257 0 3.6
lenny bytes 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,160 698 461 1,863.2
lenny int 200 python2 32 32 0 7.3
lenny int 200 bash 247 248 0 3.5
lenny int 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,118 588 529 1,802.2

Interpreter and Host Details

shell label shell id
bash bash-9af8f89f
dash dash-9ff48631
/home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped-b4a35663
python2 python2-e809d907
host label host id
broome broome-8a85d07d
lenny lenny-c6bbd9ee

Details

host name task name arg1 arg2 runtime label elapsed ms user ms sys ms max rss MB
broome bubble_sort bytes 200 python2 37.3 32.8 5.2 7.2
broome bubble_sort bytes 200 bash 391.0 388.5 3.1 3.6
broome bubble_sort bytes 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,710.0 1,046.3 664.0 1,840.9
broome bubble_sort int 200 python2 60.4 54.4 6.7 7.3
broome bubble_sort int 200 bash 402.2 397.7 5.2 3.5
broome bubble_sort int 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,637.2 953.3 684.6 1,681.8
broome fib 200 44 python2 19.3 15.5 3.9 7.2
broome fib 200 44 dash 39.0 35.1 3.9 1.8
broome fib 200 44 bash 115.7 111.7 4.0 3.4
broome fib 200 44 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 727.4 419.6 307.7 679.4
broome hello _ _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 2.9 0.0 2.9 4.1
broome hello _ _ dash 1.0 1.0 0.0 1.8
broome hello _ _ bash 2.1 2.1 0.0 3.4
broome hello _ _ python2 17.0 12.7 4.2 7.3
broome palindrome bytes _ python2 34.9 19.5 16.0 7.4
broome palindrome bytes _ bash 245.3 221.1 24.9 3.6
broome palindrome bytes _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,391.3 879.2 512.8 1,144.1
broome palindrome unicode _ python2 38.8 30.2 9.2 7.6
broome palindrome unicode _ bash 303.3 293.5 10.4 3.7
broome palindrome unicode _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,393.2 941.2 451.9 1,143.8
broome parse_help ls _ bash 37.4 28.9 9.1 3.8
broome parse_help ls _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 76.7 64.5 12.9 29.6
broome parse_help ls-short _ bash 18.2 15.1 2.0 3.6
broome parse_help ls-short _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 19.6 15.2 5.0 6.2
broome parse_help mypy _ bash 43.6 41.5 2.8 3.7
broome parse_help mypy _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 100.3 69.1 31.8 39.8
broome word_freq 10 configure python2 37.2 28.0 11.8 7.5
broome word_freq 10 configure bash 144.9 132.2 18.8 3.6
broome word_freq 10 configure /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 478.2 318.3 165.9 419.6
lenny bubble_sort bytes 200 python2 13.5 13.8 0.0 7.3
lenny bubble_sort bytes 200 bash 257.0 257.2 0.0 3.6
lenny bubble_sort bytes 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,160.4 698.3 461.2 1,863.2
lenny bubble_sort int 200 python2 32.0 32.3 0.0 7.3
lenny bubble_sort int 200 bash 247.3 247.5 0.0 3.5
lenny bubble_sort int 200 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1,117.5 587.8 529.1 1,802.2
lenny fib 200 44 python2 7.1 3.5 3.5 7.4
lenny fib 200 44 dash 17.9 17.9 0.0 1.7
lenny fib 200 44 bash 63.6 59.6 4.0 3.4
lenny fib 200 44 /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 421.5 230.6 190.8 679.3
lenny hello _ _ dash 0.6 0.6 0.0 1.7
lenny hello _ _ bash 0.7 0.7 0.0 3.2
lenny hello _ _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 1.2 1.2 0.0 4.1
lenny hello _ _ python2 7.0 7.0 0.0 7.3
lenny palindrome bytes _ python2 13.3 13.5 0.0 7.4
lenny palindrome bytes _ bash 149.6 142.9 6.9 3.5
lenny palindrome bytes _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 835.7 536.5 299.4 1,143.9
lenny palindrome unicode _ python2 16.6 13.1 3.8 7.5
lenny palindrome unicode _ bash 160.2 156.0 4.4 3.6
lenny palindrome unicode _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 871.3 535.7 335.9 1,144.0
lenny parse_help ls _ bash 15.3 15.2 0.4 3.6
lenny parse_help ls _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 35.3 27.8 7.7 29.5
lenny parse_help ls-short _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 6.7 1.8 5.2 6.0
lenny parse_help ls-short _ bash 5.6 5.8 0.0 3.6
lenny parse_help mypy _ bash 18.9 19.2 0.0 3.6
lenny parse_help mypy _ /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 45.7 27.9 18.0 39.8
lenny word_freq 10 configure python2 14.3 9.1 6.1 7.4
lenny word_freq 10 configure bash 83.7 80.3 5.6 3.5
lenny word_freq 10 configure /home/andy/git/oilshell/oil/../benchmark-data/src/oil-native-0.12.9/_bin/cxx-opt-sh/osh_eval.stripped 273.1 132.1 143.9 419.5