Results for arith.test.sh

statusdashbashmkshzshoshosh_ALT
pass 213935314747
ok 465855
N-I 2427500
BUG 355800
total525252525252
casedashbashmkshzshoshosh_ALTdescription
0N-I pass pass ok pass pass Side Effect in Array Indexing
detailsdetails
1pass pass pass pass pass pass Add one to var
2pass pass pass pass pass pass $ is optional
3pass pass pass pass pass pass SimpleVarSub within arith
4pass pass pass pass pass pass BracedVarSub within ArithSub
5pass pass pass pass pass pass Arith word part
6pass pass pass pass pass pass Arith sub with word parts
7N-I N-I pass N-I pass pass Constant with quotes like '1'
detailsdetailsdetails
8pass pass pass pass pass pass Arith sub within arith sub
9pass pass pass pass pass pass Backticks within arith sub
10ok ok ok ok ok ok Invalid string to int
detailsdetailsdetailsdetailsdetailsdetails
11ok N-I N-I N-I pass pass Invalid string to int with strict_arith
detailsdetailsdetailsdetails
12pass pass pass pass pass pass Newline in the middle of expression
13pass pass pass pass pass pass Ternary operator
14N-I pass pass pass pass pass Preincrement
details
15N-I pass pass pass pass pass Postincrement
details
16N-I pass pass pass pass pass Increment undefined variables
details
17N-I pass pass BUG pass pass Increment and decrement array elements
detailsdetails
18ok pass BUG BUG pass pass Increment undefined variables with nounset
detailsdetailsdetails
19N-I pass pass pass pass pass Comma operator (borrowed from C)
details
20pass pass pass pass pass pass Augmented assignment
21pass pass pass pass pass pass Comparison Ops
22pass pass pass pass pass pass Logical Ops
23N-I pass pass pass pass pass Logical Ops Short Circuit
details
24pass pass pass pass pass pass Bitwise ops
25pass pass pass pass pass pass Unary minus and plus
26pass ok ok BUG pass pass No floating point
detailsdetailsdetails
27N-I pass pass ok pass pass Array indexing in arith
detailsdetails
28N-I pass pass pass pass pass Constants in base 36
details
29N-I pass N-I N-I pass pass Constants in bases 2 to 64
detailsdetailsdetails
30N-I pass pass pass pass pass Dynamic base constants
details
31pass pass N-I N-I pass pass Octal constant
detailsdetails
32pass pass N-I N-I pass pass Dynamic octal constant
detailsdetails
33pass pass pass pass pass pass Dynamic hex constants
34pass pass pass pass ok ok Dynamic var names - result of runtime parse/eval
detailsdetails
35N-I pass pass pass ok ok Bizarre recursive name evaluation - result of runtime parse/eval
detailsdetailsdetails
36BUG pass BUG BUG pass pass nounset with arithmetic
detailsdetailsdetails
37BUG BUG BUG BUG pass pass Integer Overflow
detailsdetailsdetailsdetails
38N-I ok ok ok pass pass Invalid LValue
detailsdetailsdetailsdetails
39N-I ok ok ok pass pass Invalid LValue that looks like array
detailsdetailsdetailsdetails
40N-I ok ok ok pass pass Invalid LValue: two sets of brackets
detailsdetailsdetailsdetails
41pass pass pass pass pass pass Operator Precedence
42N-I pass N-I pass pass pass Exponentiation with **
detailsdetails
43N-I pass N-I pass pass pass Exponentiation operator has buggy precedence
detailsdetails
44N-I pass pass ok pass pass Negative exponent
detailsdetails
45ok ok pass pass ok ok Comment not allowed in the middle of multiline arithmetic
detailsdetailsdetailsdetails
46N-I BUG pass pass pass pass Can't add integer to indexed array
detailsdetails
47BUG BUG BUG BUG pass pass Can't add integer to associative array
detailsdetailsdetailsdetails
48N-I pass pass ok ok ok Double subscript
detailsdetailsdetailsdetails
49N-I BUG BUG pass pass pass result of ArithSub is array
detailsdetailsdetails
50N-I BUG N-I BUG pass pass result of ArithSub is assoc array
detailsdetailsdetailsdetails
51N-I pass pass BUG pass pass comma operator
detailsdetails
220 passed, 33 OK, 38 not implemented, 21 BUG, 0 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

dash0 Side Effect in Array Indexing

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
zsh0 Side Effect in Array Indexing

stdout:
5 b=2
stderr:
dash7 Constant with quotes like '1'

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: arithmetic expression: expecting primary: "'1' + 2"
bash7 Constant with quotes like '1'

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 1: '1' + 2: syntax error: operand expected (error token is "'1' + 2")
zsh7 Constant with quotes like '1'

stdout:
stderr: 
zsh: bad math expression: illegal character: '
dash10 Invalid string to int

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: shopt: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 3: Illegal number: foo
bash10 Invalid string to int

stdout:
5
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 1: shopt: strict_arith: invalid shell option name
mksh10 Invalid string to int

stdout:
5
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]: shopt: not found
zsh10 Invalid string to int

stdout:
5
stderr:
zsh: command not found: shopt
osh10 Invalid string to int

stdout:
5
stderr:
[??? no location ???] warning: Invalid integer constant 'foo'
osh_ALT10 Invalid string to int

stdout:
5
stderr:
[??? no location ???] warning: Invalid integer constant 'foo'
dash11 Invalid string to int with strict_arith

stdout:
foo
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: shopt: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 4: Illegal number: foo
bash11 Invalid string to int with strict_arith

stdout:
foo
5
should not get here
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 1: shopt: strict_arith: invalid shell option name
mksh11 Invalid string to int with strict_arith

stdout:
foo
5
should not get here
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]: shopt: not found
zsh11 Invalid string to int with strict_arith

stdout:
foo
5
should not get here
stderr:
zsh: command not found: shopt
dash14 Preincrement

stdout:
4
4
stderr:
dash15 Postincrement

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: arithmetic expression: expecting primary: "a++"
dash16 Increment undefined variables

stdout:
[][]
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: shopt: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: undef1++: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 3: ++undef2: not found
dash17 Increment and decrement array elements

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: shopt: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: Syntax error: "(" unexpected
zsh17 Increment and decrement array elements

stdout:
5 6 7 8 -
stderr:
zsh: command not found: shopt
zsh: a: assignment to invalid subscript range
zsh: undef: assignment to invalid subscript range
dash18 Increment undefined variables with nounset

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: undef1++: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 3: ++undef2: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 4: undef1: parameter not set
mksh18 Increment undefined variables with nounset

stdout:
[1][1]
stderr:
zsh18 Increment undefined variables with nounset

stdout:
[1][1]
stderr:
dash19 Comma operator (borrowed from C)

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 3: arithmetic expression: expecting EOF: "a,(b+1)"
dash23 Logical Ops Short Circuit

stdout:
11
11
11
11
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: 1: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: x: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 4: 0: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 4: x: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 6: 0: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 8: 1: not found
bash26 No floating point

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 1: 1 + 2.3: syntax error: invalid arithmetic operator (error token is ".3")
mksh26 No floating point

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]: 1 + 2.3: unexpected '.'
zsh26 No floating point

stdout:
3.2999999999999998
stderr:
dash27 Array indexing in arith

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
zsh27 Array indexing in arith

stdout:
7
stderr:
dash28 Constants in base 36

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: arithmetic expression: expecting EOF: "36#a"
dash29 Constants in bases 2 to 64

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: arithmetic expression: expecting EOF: "64#a"
mksh29 Constants in bases 2 to 64

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]: 64#a: bad number '64#a'
zsh29 Constants in bases 2 to 64

stdout:
stderr: 
zsh: invalid base (must be 2 to 36 inclusive): 64
dash30 Dynamic base constants

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: arithmetic expression: expecting EOF: " 16#a "
mksh31 Octal constant

stdout:
11
stderr:
zsh31 Octal constant

stdout:
11
stderr:
mksh32 Dynamic octal constant

stdout:
11
stderr:
zsh32 Dynamic octal constant

stdout:
11
stderr:
osh34 Dynamic var names - result of runtime parse/eval

stdout:
6
stderr:
  echo $(( foo + f$x + 1 ))
                 ^
[ stdin ]:3: warning: Invalid integer constant 'foo'
osh_ALT34 Dynamic var names - result of runtime parse/eval

stdout:
6
stderr:
  echo $(( foo + f$x + 1 ))
                 ^
[ stdin ]:3: warning: Invalid integer constant 'foo'
dash35 Bizarre recursive name evaluation - result of runtime parse/eval

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 5: Illegal number: foo
osh35 Bizarre recursive name evaluation - result of runtime parse/eval

stdout:
6 1 1 1
stderr:
[??? no location ???] warning: Invalid integer constant 'foo'
[??? no location ???] warning: Invalid integer constant 'bar'
[??? no location ???] warning: Invalid integer constant 'spam'
osh_ALT35 Bizarre recursive name evaluation - result of runtime parse/eval

stdout:
6 1 1 1
stderr:
[??? no location ???] warning: Invalid integer constant 'foo'
[??? no location ???] warning: Invalid integer constant 'bar'
[??? no location ???] warning: Invalid integer constant 'spam'
dash36 nounset with arithmetic

stdout:
should not get here: x=5
stderr:
mksh36 nounset with arithmetic

stdout:
should not get here: x=5
stderr:
zsh36 nounset with arithmetic

stdout:
should not get here: x=5
stderr:
dash37 Integer Overflow

stdout:
-1996229794797103359
stderr:
bash37 Integer Overflow

stdout:
-1996229794797103359
stderr:
mksh37 Integer Overflow

stdout:
-15640831
stderr:
zsh37 Integer Overflow

stdout:
-1996229794797103359
stderr:
dash38 Invalid LValue

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: Syntax error: word unexpected (expecting ")")
bash38 Invalid LValue

stdout:
9
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 2: ((: (a + 2) = 3 : attempted assignment to non-variable (error token is "= 3 ")
mksh38 Invalid LValue

stdout:
9
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[2]:  (a + 2) = 3 : = requires lvalue
zsh38 Invalid LValue

stdout:
9
stderr:
zsh: bad math expression: lvalue required
dash39 Invalid LValue that looks like array

stdout:
status=127
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: 1[2]: not found
bash39 Invalid LValue that looks like array

stdout:
status=1
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 1: ((: 1[2] = 3 : syntax error: invalid arithmetic operator (error token is "[2] = 3 ")
mksh39 Invalid LValue that looks like array

stdout:
status=2
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]:  1[2] = 3 : unexpected '['
zsh39 Invalid LValue that looks like array

stdout:
status=2
stderr:
zsh: bad base syntax
dash40 Invalid LValue: two sets of brackets

stdout:
status=127
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: a[1][2]: not found
bash40 Invalid LValue: two sets of brackets

stdout:
status=1
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 1: ((: a[1][2] = 3 : syntax error: invalid arithmetic operator (error token is "[2] = 3 ")
mksh40 Invalid LValue: two sets of brackets

stdout:
status=2
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]:  a[1][2] = 3 : unexpected '['
zsh40 Invalid LValue: two sets of brackets

stdout:
status=2
stderr:
zsh: bad base syntax
dash42 Exponentiation with **

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: arithmetic expression: expecting primary: " 3 ** 0 "
mksh42 Exponentiation with **

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]:  3 ** 0 : unexpected '*'
dash43 Exponentiation operator has buggy precedence

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: arithmetic expression: expecting primary: " -3 ** 2 "
mksh43 Exponentiation operator has buggy precedence

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]:  -3 ** 2 : unexpected '*'
dash44 Negative exponent

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: arithmetic expression: expecting primary: " 2**-1 * 5 "
zsh44 Negative exponent

stdout:
2.5
stderr:
dash45 Comment not allowed in the middle of multiline arithmetic

stdout:
6
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 6: arithmetic expression: expecting EOF: "
1 + 2  # not a comment
"
bash45 Comment not allowed in the middle of multiline arithmetic

stdout:
6
[]
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 8: 
1 + 2  # not a comment
: syntax error: invalid arithmetic operator (error token is "# not a comment
")
/home/andy/git/oilshell/oil/_tmp/spec-bin/bash: line 10: ((: a = 3 + 4  # comment
: syntax error: invalid arithmetic operator (error token is "# comment
")
osh45 Comment not allowed in the middle of multiline arithmetic

stdout:
6
stderr:
  1 + 2  # not a comment
          ^
[ stdin ]:7: Expected first ) to end arith sub
osh_ALT45 Comment not allowed in the middle of multiline arithmetic

stdout:
6
stderr:
  1 + 2  # not a comment
          ^
[ stdin ]:7: Expected first ) to end arith sub
dash46 Can't add integer to indexed array

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
bash46 Can't add integer to indexed array

stdout:
6
stderr:
dash47 Can't add integer to associative array

stdout:
5
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: typeset: not found
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 2: assoc[0]=42: not found
bash47 Can't add integer to associative array

stdout:
47
stderr:
mksh47 Can't add integer to associative array

stdout:
47
stderr:
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]: typeset: -A: unknown option
zsh47 Can't add integer to associative array

stdout:
47
stderr:
dash48 Double subscript

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
zsh48 Double subscript

stdout:
1
stderr:
zsh: bad base syntax
osh48 Double subscript

stdout:
2
stderr:
  echo $(( a[1][1] ))
               ^
[ stdin ]:3: The [ operarator doesn't apply to this expression
osh_ALT48 Double subscript

stdout:
2
stderr:
  echo $(( a[1][1] ))
               ^
[ stdin ]:3: The [ operarator doesn't apply to this expression
dash49 result of ArithSub is array

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
bash49 result of ArithSub is array

stdout:
declared
4
stderr:
mksh49 result of ArithSub is array

stdout:
declared
4
stderr:
dash50 result of ArithSub is assoc array

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
bash50 result of ArithSub is assoc array

stdout:
declared
0
stderr:
mksh50 result of ArithSub is assoc array

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/mksh: <stdin>[1]: syntax error: '(' unexpected
zsh50 result of ArithSub is assoc array

stdout:
declared
0
stderr:
zsh: no matches found: [foo]=bar
dash51 comma operator

stdout:
stderr: 
/home/andy/git/oilshell/oil/_tmp/spec-bin/dash: 1: Syntax error: "(" unexpected
zsh51 comma operator

stdout:
stderr: 
zsh: bad math expression: operator expected at `5 6'