Spec Test Results Summary

name	# cases	osh # passed	osh # failed	osh failures allowed	osh ALT delta	Elapsed Seconds
TOTAL (91 rows)	1858	1645	111	0	0	440.76
alias	46	41	0	0	0	31.17
append	11	9	0	0	0	1.65
arith-context	10	10	0	0	0	1.56
arith	62	57	0	0	0	9.60
array-compat	10	7	0	0	0	1.59
array	66	65	0	0	0	10.94
assign-deferred	9	0	9	0	0	1.28
assign-dialects	2	1	1	0	0	0.36
assign-extended	34	32	0	0	0	8.45
assign	44	41	2	0	0	7.92
assoc	38	31	4	0	0	7.37
assoc-zsh	7	1	6	0	0	1.18
background	16	14	2	0	0	6.52
ble-features	13	5	0	0	0	2.58
ble-idioms	11	11	0	0	0	1.91
blog1	8	4	0	0	0	2.16
blog2	8	8	0	0	0	1.25
brace-expansion	55	48	0	0	0	8.54
bugs	3	3	0	0	0	0.46
builtin-bash	19	19	0	0	0	3.23
builtin-bracket	44	44	0	0	0	8.25
builtin-completion	37	36	1	0	0	12.19
builtin-dirs	14	14	0	0	0	4.16
builtin-eval-source	19	19	0	0	0	5.10
builtin-getopts	22	19	0	0	0	3.59
builtin-io	70	63	7	0	0	21.68
builtin-printf	43	29	1	0	0	8.38
builtins2	13	12	1	0	0	2.90
builtin-special	7	3	4	0	0	1.17
builtins	34	33	1	0	0	10.34
builtin-times	1	1	0	0	0	0.51
builtin-trap	22	16	5	0	0	7.25
builtin-vars	41	37	1	0	0	7.66
case_	11	8	3	0	0	2.11
command-parsing	5	2	0	0	0	1.29
command-sub	28	26	0	0	0	11.66
command_	15	14	0	0	0	5.94
comments	2	2	0	0	0	0.59
dbracket	50	47	0	0	0	8.63
dparen	15	14	0	0	0	2.92
empty-bodies	3	3	0	0	0	0.61
errexit-oil	22	20	2	0	0	7.49
errexit	28	27	1	0	0	6.04
exit-status	5	4	1	0	0	1.58
explore-parsing	2	2	0	0	0	0.39
extglob-match	26	25	0	0	0	4.25
for-expr	6	6	0	0	0	1.19
func-parsing	15	14	0	0	0	2.51
glob	37	30	7	0	0	6.90
here-doc	34	31	2	0	0	12.52
if_	4	4	0	0	0	0.81
interactive	7	7	0	0	0	2.43
introspect	10	10	0	0	0	3.38
let	2	0	2	0	0	0.53
loop	24	23	0	0	0	5.38
nameref	25	22	3	0	0	3.93
nocasematch-match	6	3	3	0	0	1.04
osh-only	4	4	0	0	0	1.55
parse-errors	26	22	3	0	0	4.10
pipeline	21	20	0	0	0	6.65
posix	15	15	0	0	0	3.40
process-sub	4	4	0	0	0	1.78
prompt	20	18	1	0	0	5.04
quote	31	31	0	0	0	5.44
redirect	55	53	1	0	0	17.71
regex	28	26	2	0	0	5.03
serialize	10	7	0	0	0	2.84
sh-func	8	8	0	0	0	1.44
sh-options	44	38	2	0	0	12.23
sh-usage	11	11	0	0	0	3.28
smoke	18	18	0	0	0	4.69
special-vars	30	24	6	0	0	9.23
strict-options	14	14	0	0	0	2.99
subshell	2	2	0	0	0	0.72
tilde	13	12	0	0	0	2.11
toysh-posix	22	17	3	0	0	5.25
toysh	8	6	1	0	0	1.74
type-compat	4	0	4	0	0	0.74
var-num	7	7	0	0	0	3.62
var-op-bash	16	8	3	0	0	4.41
var-op-len	8	8	0	0	0	2.25
var-op-patsub	25	22	2	0	0	3.77
var-op-slice	21	19	1	0	0	4.81
var-op-strip	29	29	0	0	0	4.98
var-op-test	24	21	0	0	0	4.05
var-ref	13	8	3	0	0	3.81
var-sub-quote	39	39	0	0	0	4.93
var-sub	7	7	0	0	0	1.62
word-eval	8	8	0	0	0	1.30
word-split	40	33	7	0	0	4.61
xtrace	12	9	3	0	0	1.62
TOTAL (91 rows)	1858	1645	111	0	0	440.76

Version Information

Wed Sep  2 17:47:59 PDT 2020

oil repo: 3ec9c3f2976d222a54271cbcbc8c5c1a2e462329 on branch release/0.8.pre11

---
$ /home/andy/git/oilshell/oil/bin/osh --version
Oil version 0.8.pre11
Release Date: -
Arch: x86_64
OS: Linux
Platform: #113~16.04.1-Ubuntu SMP Fri Jul 10 04:37:08 UTC 2020
Compiler: GCC 5.4.0 20160609
Interpreter: CPython
Interpreter version: 2.7.12
Bytecode: -

---
$ /home/andy/git/oilshell/oil/_tmp/oil-tar-test/oil-0.8.pre11/_bin/osh --version
Oil version 0.8.pre11
Release Date: 2020-09-03 00:15:42+00:00
Arch: x86_64
OS: Linux
Platform: #113~16.04.1-Ubuntu SMP Fri Jul 10 04:37:08 UTC 2020
Compiler: GCC 5.4.0 20160609
Interpreter: OVM
Interpreter version: 2.7.13
Bytecode: bytecode-opy.zip