Results for ysh-builtin-eval.test.sh

status	ysh	ysh-cpp
pass	23	23
FAIL	4	4
total	27	27

case	ysh	ysh-cpp	description
0	pass	pass	eval builtin does not take a literal block - can restore this later
1	pass	pass	Eval a block within a proc
2	pass	pass	Eval block created by calling a proc
3	pass	pass	io->eval with argv bindings
4	pass	pass	eval lines with argv bindings
5	pass	pass	eval lines with var bindings
6	pass	pass	eval with custom dollar0
7	pass	pass	eval with vars bindings
8	pass	pass	dynamic binding names and mutation
9	pass	pass	binding procs in the eval-ed namespace
10	pass	pass	vars initializes the variable frame, but does not remember it
11	pass	pass	eval pos_args must be strings
12	pass	pass	eval with vars follows same scoping as without
13	pass	pass	eval 'mystring' vs. call io->eval(myblock)
14	pass	pass	io->evalToDict() - local and global
15	pass	pass	parseCommand then io->evalToDict() - in global scope
16	pass	pass	parseCommand with syntax error
17	FAIL	FAIL	Dict (&d) { ... } converts frame to dict
	details	details
18	pass	pass	block in Dict (&d) { ... } can read from outer scope
19	pass	pass	block in yb-capture Dict (&d) can read from outer scope
20	pass	pass	Dict (&d) and setvar
21	pass	pass	Dict (&d) and setglobal
22	pass	pass	bindings created shvar persist, which is different than evalToDict()
23	FAIL	FAIL	io->evalInFrame() can express try, cd builtins
	details	details
24	FAIL	FAIL	parseCommand(), io->evalInFrame(frag, frame) can behave like eval $mystr
	details	details
25	FAIL	FAIL	eval should have a sandboxed mode
	details	details
26	pass	pass	io->evalExpr() with vars, dollar0, pos_args

46 passed, 0 OK, 0 not implemented, 0 BUG, 4 failed, 0 timeouts, 0 cases skipped
4 failed under osh

Details on runs that didn't PASS

ysh	17 Dict (&d) { ... } converts frame to dict [ysh stdout] Expected '', got '(Dict) {"bare":42,"k3":"k3"}\n' stdout: (Dict) {"bare":42,"k3":"k3"} stderr:
ysh-cpp	17 Dict (&d) { ... } converts frame to dict [ysh-cpp stdout] Expected '', got '(Dict) {"bare":42,"k3":"k3"}\n' stdout: (Dict) {"bare":42,"k3":"k3"} stderr:
ysh	23 io->evalInFrame() can express try, cd builtins [ysh stdout] Expected 'x: i = 0, j = 2\nx: i = 1, j = 3\nx: i = 2, j = 4\n' Got '/tmp /home/uke/oil/_tmp/spec-tmp/ysh-builtin-eval.test.sh.27175/23-ysh\n' [ysh status] Expected 0, got 1 stdout: /tmp /home/uke/oil/_tmp/spec-tmp/ysh-builtin-eval.test.sh.27175/23-ysh stderr: var frag = getCommandFrag(block) ^~~~~~~~~~~~~~ [ stdin ]:8: fatal: Undefined variable 'getCommandFrag'
ysh-cpp	23 io->evalInFrame() can express try, cd builtins [ysh-cpp stdout] Expected 'x: i = 0, j = 2\nx: i = 1, j = 3\nx: i = 2, j = 4\n' Got '/tmp /home/uke/oil/_tmp/spec-tmp/ysh-builtin-eval.test.sh.27175/23-ysh-cpp\n' [ysh-cpp status] Expected 0, got 1 stdout: /tmp /home/uke/oil/_tmp/spec-tmp/ysh-builtin-eval.test.sh.27175/23-ysh-cpp stderr: var frag = getCommandFrag(block) ^~~~~~~~~~~~~~ [ stdin ]:8: fatal: Undefined variable 'getCommandFrag'
ysh	24 parseCommand(), io->evalInFrame(frag, frame) can behave like eval $mystr [ysh stdout] Expected 'mylocal=42\nmylocal=99\n', got 'mylocal=42\n' [ysh status] Expected 0, got 1 stdout: mylocal=42 stderr: echo mylocal=$mylocal ^~~~~~~~ [ stdin ]:15: fatal: Undefined variable 'mylocal'
ysh-cpp	24 parseCommand(), io->evalInFrame(frag, frame) can behave like eval $mystr [ysh-cpp stdout] Expected 'mylocal=42\nmylocal=99\n', got 'mylocal=42\n' [ysh-cpp status] Expected 0, got 1 stdout: mylocal=42 stderr: echo mylocal=$mylocal ^~~~~~~~ [ stdin ]:15: fatal: Undefined variable 'mylocal'
ysh	25 eval should have a sandboxed mode [ysh stdout] Expected 'TODO\n', got '' stdout: stderr: push-frame { ^ [ stdin ]:4: fatal: 'push-frame' appears to be external. External commands don't accept typed args (OILS-ERR-200)
ysh-cpp	25 eval should have a sandboxed mode [ysh-cpp stdout] Expected 'TODO\n', got '' stdout: stderr: push-frame { ^ [ stdin ]:4: fatal: 'push-frame' appears to be external. External commands don't accept typed args (OILS-ERR-200)