Results for builtin-bracket.test.sh

status	osh	osh_.py	osh_.cc
pass	43	33	31
FAIL	0	10	12
total	43	43	43

case	osh	osh_.py	osh_.cc	description
0	pass	pass	pass	zero args: [ ]
1	pass	pass	pass	one arg: [ x ] where x is one of '=' '!' '(' ']'
2	pass	pass	pass	one arg: empty string is false. Equivalent to -n.
3	pass	pass	pass	-a as unary operator (alias of -e)
4	pass	pass	pass	two args: -z with = ! ( ]
5	pass	pass	pass	three args
6	pass	pass	pass	four args
7	pass	pass	pass	test with extra args is syntax error
8	pass	pass	pass	] syntax errors
9	pass	pass	pass	-n
10	pass	pass	pass	! -a
11	pass	pass	pass	-o
12	pass	pass	pass	( )
13	pass	pass	pass	( ) ! -a -o with system version of [
14	pass	pass	pass	== is alias for =
15	pass	pass	pass	== and = does not do glob
16	pass	pass	pass	[ with op variable
17	pass	pass	pass	[ with unquoted empty var
18	pass	pass	pass	[ compare with literal -f
19	pass	pass	pass	[ '(' foo ] is runtime syntax error
20	pass	pass	FAIL	-z '>' implies two token lookahead
			details
21	pass	pass	pass	operator/operand ambiguity with ]
22	pass	pass	pass	operator/operand ambiguity with -a
23	pass	pass	pass	-d
24	pass	FAIL	FAIL	-x
		details	details
25	pass	FAIL	FAIL	-r
		details	details
26	pass	FAIL	FAIL	-w
		details	details
27	pass	pass	pass	-k for sticky bit
28	pass	FAIL	FAIL	-h and -L test for symlink
		details	details
29	pass	pass	pass	-t 1 for stdout
30	pass	pass	pass	[ -t invalid ]
31	pass	FAIL	FAIL	-ot and -nt
		details	details
32	pass	pass	pass	[ a -eq b ]
33	pass	FAIL	FAIL	test -s
		details	details
34	pass	pass	pass	test -b -c -S (block, character, socket)
35	pass	FAIL	FAIL	test -p named pipe
		details	details
36	pass	FAIL	FAIL	-G and -O for effective user ID and group ID
		details	details
37	pass	FAIL	FAIL	-u for setuid, -g too
		details	details
38	pass	pass	pass	-v to test variable
39	pass	pass	pass	test -o for options
40	pass	pass	pass	-nt -ot
41	pass	FAIL	FAIL	-ef
		details	details
42	pass	pass	FAIL	Overflow error
			details

107 passed, 0 OK, 0 not implemented, 0 BUG, 22 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

osh_.cc	20 -z '>' implies two token lookahead [osh_.cc stdout] Expected 'true\nfalse\ntrue\n', got 'true\nfalse\n' [osh_.cc status] Expected 0, got 1 stdout: true false stderr:
osh_.py	24 -x [osh_.py stdout] Expected 'no\nyes\nbad\n', got "(cmd_value.Argv argv:[rm -f '/x'] arg_spids:[0 2 4])\necho hi\nno\n(cmd_value.Argv argv:[chmod '+x' '/x'] arg_spids:[33 35 38])\nbad\n" stdout: (cmd_value.Argv argv:[rm -f '/x'] arg_spids:[0 2 4]) echo hi no (cmd_value.Argv argv:[chmod '+x' '/x'] arg_spids:[33 35 38]) bad stderr: Unhandled SimpleCommand Unhandled SimpleCommand
osh_.cc	24 -x [osh_.cc stdout] Expected 'no\nyes\nbad\n', got "(cmd_value.Argv argv:[rm -f '/x'] arg_spids:[0 2 4])\necho hi\nno\n(cmd_value.Argv argv:[chmod '+x' '/x'] arg_spids:[33 35 38])\nbad\n" stdout: (cmd_value.Argv argv:[rm -f '/x'] arg_spids:[0 2 4]) echo hi no (cmd_value.Argv argv:[chmod '+x' '/x'] arg_spids:[33 35 38]) bad stderr: Unhandled SimpleCommand Unhandled SimpleCommand
osh_.py	25 -r [osh_.py stdout] Expected 'yes\nno\n', got "1\n2\n(cmd_value.Argv argv:[chmod -r '/testr_no'] arg_spids:[22 24 26])\nno\n" stdout: 1 2 (cmd_value.Argv argv:[chmod -r '/testr_no'] arg_spids:[22 24 26]) no stderr: Unhandled SimpleCommand
osh_.cc	25 -r [osh_.cc stdout] Expected 'yes\nno\n', got "1\n2\n(cmd_value.Argv argv:[chmod -r '/testr_no'] arg_spids:[22 24 26])\nno\n" stdout: 1 2 (cmd_value.Argv argv:[chmod -r '/testr_no'] arg_spids:[22 24 26]) no stderr: Unhandled SimpleCommand
osh_.py	26 -w [osh_.py stdout] Expected 'yes\nno\n', got "(cmd_value.Argv argv:[rm -f '/testw_'] arg_spids:[0 2 4])\n1\n2\n(cmd_value.Argv argv:[chmod -w '/testw_no'] arg_spids:[30 32 34])\nno\n" stdout:* (cmd_value.Argv argv:[rm -f '/testw_'] arg_spids:[0 2 4]) 1 2 (cmd_value.Argv argv:[chmod -w '/testw_no'] arg_spids:[30 32 34]) no stderr:* Unhandled SimpleCommand Unhandled SimpleCommand
osh_.cc	26 -w [osh_.cc stdout] Expected 'yes\nno\n', got "(cmd_value.Argv argv:[rm -f '/testw_'] arg_spids:[0 2 4])\n1\n2\n(cmd_value.Argv argv:[chmod -w '/testw_no'] arg_spids:[30 32 34])\nno\n" stdout:* (cmd_value.Argv argv:[rm -f '/testw_'] arg_spids:[0 2 4]) 1 2 (cmd_value.Argv argv:[chmod -w '/testw_no'] arg_spids:[30 32 34]) no stderr:* Unhandled SimpleCommand Unhandled SimpleCommand
osh_.py	28 -h and -L test for symlink [osh_.py stdout] Expected 'no\nno\nis-file\nsymlink\nsymlink\ndangling\ndangling\ndangling is not file\n', got "(cmd_value.Argv argv:[mkdir -p '/builtin-test-1'] arg_spids:[4 6 8])\n(cmd_value.Argv argv:[touch '/builtin-test-1/zz'] arg_spids:[10 12])\n(cmd_value.Argv\n argv: [ln -s -f '/builtin-test-1/zz' '/builtin-test-1/symlink']\n arg_spids: [15 17 19 21 24]\n)\n(cmd_value.Argv\n argv: [ln -s -f '/builtin-test-1/__nonexistent_ZZ__' '/builtin-test-1/dangling']\n arg_spids: [27 29 31 33 36]\n)\nno\nno\ndangling is not file\n" stdout: (cmd_value.Argv argv:[mkdir -p '/builtin-test-1'] arg_spids:[4 6 8]) (cmd_value.Argv argv:[touch '/builtin-test-1/zz'] arg_spids:[10 12]) (cmd_value.Argv argv: [ln -s -f '/builtin-test-1/zz' '/builtin-test-1/symlink'] arg_spids: [15 17 19 21 24] ) (cmd_value.Argv argv: [ln -s -f '/builtin-test-1/__nonexistent_ZZ__' '/builtin-test-1/dangling'] arg_spids: [27 29 31 33 36] ) no no dangling is not file stderr: Unhandled SimpleCommand Unhandled SimpleCommand Unhandled SimpleCommand Unhandled SimpleCommand
osh_.cc	28 -h and -L test for symlink [osh_.cc stdout] Expected 'no\nno\nis-file\nsymlink\nsymlink\ndangling\ndangling\ndangling is not file\n', got "(cmd_value.Argv argv:[mkdir -p '/builtin-test-1'] arg_spids:[4 6 8])\n(cmd_value.Argv argv:[touch '/builtin-test-1/zz'] arg_spids:[10 12])\n(cmd_value.Argv\n argv: [ln -s -f '/builtin-test-1/zz' '/builtin-test-1/symlink']\n arg_spids: [15 17 19 21 24]\n)\n(cmd_value.Argv\n argv: [ln -s -f '/builtin-test-1/__nonexistent_ZZ__' '/builtin-test-1/dangling']\n arg_spids: [27 29 31 33 36]\n)\nno\nno\ndangling is not file\n" stdout: (cmd_value.Argv argv:[mkdir -p '/builtin-test-1'] arg_spids:[4 6 8]) (cmd_value.Argv argv:[touch '/builtin-test-1/zz'] arg_spids:[10 12]) (cmd_value.Argv argv: [ln -s -f '/builtin-test-1/zz' '/builtin-test-1/symlink'] arg_spids: [15 17 19 21 24] ) (cmd_value.Argv argv: [ln -s -f '/builtin-test-1/__nonexistent_ZZ__' '/builtin-test-1/dangling'] arg_spids: [27 29 31 33 36] ) no no dangling is not file stderr: Unhandled SimpleCommand Unhandled SimpleCommand Unhandled SimpleCommand Unhandled SimpleCommand
osh_.py	31 -ot and -nt [osh_.py stdout] Expected 'older\nnot newer\nnot older than itself\nnot newer than itself\n', got "(cmd_value.Argv argv:[touch -d '2017/12/31' '/x'] arg_spids:[0 2 4 6])\n(cmd_value.Argv argv:[touch -d '2018/01/01'] arg_spids:[9 11 13])\nnot newer\nnot older than itself\nnot newer than itself\n" stdout: (cmd_value.Argv argv:[touch -d '2017/12/31' '/x'] arg_spids:[0 2 4 6]) (cmd_value.Argv argv:[touch -d '2018/01/01'] arg_spids:[9 11 13]) not newer not older than itself not newer than itself stderr: Unhandled SimpleCommand Unhandled SimpleCommand
osh_.cc	31 -ot and -nt [osh_.cc stdout] Expected 'older\nnot newer\nnot older than itself\nnot newer than itself\n', got "(cmd_value.Argv argv:[touch -d '2017/12/31' '/x'] arg_spids:[0 2 4 6])\n(cmd_value.Argv argv:[touch -d '2018/01/01'] arg_spids:[9 11 13])\nnot newer\nnot older than itself\nnot newer than itself\n" stdout: (cmd_value.Argv argv:[touch -d '2017/12/31' '/x'] arg_spids:[0 2 4 6]) (cmd_value.Argv argv:[touch -d '2018/01/01'] arg_spids:[9 11 13]) not newer not older than itself not newer than itself stderr: Unhandled SimpleCommand Unhandled SimpleCommand
osh_.py	33 test -s [osh_.py stdout] Expected 'status=1\nstatus=1\nstatus=0\n', got "status=1\n(cmd_value.Argv argv:[touch '/empty'] arg_spids:[11 13])\nstatus=1\nnonempty\nstatus=1\n" stdout: status=1 (cmd_value.Argv argv:[touch '/empty'] arg_spids:[11 13]) status=1 nonempty status=1 stderr: Unhandled SimpleCommand
osh_.cc	33 test -s [osh_.cc stdout] Expected 'status=1\nstatus=1\nstatus=0\n', got "status=1\n(cmd_value.Argv argv:[touch '/empty'] arg_spids:[11 13])\nstatus=1\nnonempty\nstatus=1\n" stdout: status=1 (cmd_value.Argv argv:[touch '/empty'] arg_spids:[11 13]) status=1 nonempty status=1 stderr: Unhandled SimpleCommand
osh_.py	35 test -p named pipe [osh_.py stdout] Expected 'status=0\nstatus=1\n', got "(cmd_value.Argv argv:[mkfifo '/fifo'] arg_spids:[0 2])\nstatus=1\nstatus=1\n" stdout: (cmd_value.Argv argv:[mkfifo '/fifo'] arg_spids:[0 2]) status=1 status=1 stderr: Unhandled SimpleCommand
osh_.cc	35 test -p named pipe [osh_.cc stdout] Expected 'status=0\nstatus=1\n', got "(cmd_value.Argv argv:[mkfifo '/fifo'] arg_spids:[0 2])\nstatus=1\nstatus=1\n" stdout: (cmd_value.Argv argv:[mkfifo '/fifo'] arg_spids:[0 2]) status=1 status=1 stderr: Unhandled SimpleCommand
osh_.py	36 -G and -O for effective user ID and group ID [osh_.py stdout] Expected 'status=0\nstatus=1\nstatus=0\nstatus=1\n', got 'status=1\nstatus=1\nstatus=1\nstatus=1\n' stdout: status=1 status=1 status=1 status=1 stderr:
osh_.cc	36 -G and -O for effective user ID and group ID [osh_.cc stdout] Expected 'status=0\nstatus=1\nstatus=0\nstatus=1\n', got '' [osh_.cc status] Expected 0, got -6 stdout: stderr: osh_eval.dbg: cpp/osh_bool_stat.h:37: bool bool_stat::DoUnaryOp(id_kind_asdl::Id_t, Str *): Assertion `0' failed.
osh_.py	37 -u for setuid, -g too [osh_.py stdout] Expected 'status=1\nstatus=0\nstatus=1\nstatus=1\n', got 'status=1\nstatus=0\nstatus=1\nstatus=0\n' stdout: status=1 status=0 status=1 status=0 stderr:
osh_.cc	37 -u for setuid, -g too [osh_.cc stdout] Expected 'status=1\nstatus=0\nstatus=1\nstatus=1\n', got '' [osh_.cc status] Expected 0, got -6 stdout: stderr: osh_eval.dbg: cpp/osh_bool_stat.h:37: bool bool_stat::DoUnaryOp(id_kind_asdl::Id_t, Str *): Assertion `0' failed.
osh_.py	41 -ef [osh_.py stdout] Expected 'same\nsame\ndifferent\ndifferent\n', got "(cmd_value.Argv argv:[touch '/left' '/right'] arg_spids:[8 10 12])\n(cmd_value.Argv argv:[ln -f '/left' '/hardlink'] arg_spids:[14 16 18 21])\ndifferent\ndifferent\n" stdout: (cmd_value.Argv argv:[touch '/left' '/right'] arg_spids:[8 10 12]) (cmd_value.Argv argv:[ln -f '/left' '/hardlink'] arg_spids:[14 16 18 21]) different different stderr: Unhandled SimpleCommand Unhandled SimpleCommand
osh_.cc	41 -ef [osh_.cc stdout] Expected 'same\nsame\ndifferent\ndifferent\n', got "(cmd_value.Argv argv:[touch '/left' '/right'] arg_spids:[8 10 12])\n(cmd_value.Argv argv:[ln -f '/left' '/hardlink'] arg_spids:[14 16 18 21])\n" [osh_.cc status] Expected 0, got -6 stdout: (cmd_value.Argv argv:[touch '/left' '/right'] arg_spids:[8 10 12]) (cmd_value.Argv argv:[ln -f '/left' '/hardlink'] arg_spids:[14 16 18 21]) stderr: Unhandled SimpleCommand Unhandled SimpleCommand osh_eval.dbg: cpp/osh_bool_stat.h:63: bool bool_stat::DoBinaryOp(id_kind_asdl::Id_t, Str , Str ): Assertion `0' failed.
osh_.cc	42 Overflow error [osh_.cc stdout] Expected 'status=2\n', got 'status=1\n' stdout: status=1 stderr: