Results for ysh-purity.test.sh

statusoshosh-cpp
pass 66
FAIL 1010
total1616
caseoshosh-cppdescription
0pass pass eval() is a pure function
1pass pass evalExpr() is a pure function
2FAIL FAIL Idiom to handle purity errors from untrusted config files
detailsdetails
3pass pass Executor: can run user-defined Procs
4FAIL FAIL Executor: can run Hay (for now)
detailsdetails
5FAIL FAIL Executor: External Commands not allowed
detailsdetails
6pass pass Command subs, pipelines not allowed with --eval-pure
7pass pass Process subs, subshells not allowed with eval()
8pass pass Background job &
9FAIL FAIL Are any builtins allowed? true, false
detailsdetails
10FAIL FAIL Are source or use builtins allowed?
detailsdetails
11FAIL FAIL Can log to stderr in pure mode
detailsdetails
12FAIL FAIL io and vm are not allowed
detailsdetails
13FAIL FAIL Can't make an alias of io->eval and call it, etc.
detailsdetails
14FAIL FAIL $RANDOM $SECONDS
detailsdetails
15FAIL FAIL Purely-evaluated code can't set traps for later
detailsdetails
12 passed, 0 OK, 0 not implemented, 0 BUG, 10 failed, 0 timeouts, 0 cases skipped
10 failed under osh

Details on runs that didn't PASS

osh2 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '', got "TODO: what's the idiom?\n"

stdout: 
TODO: what's the idiom?
stderr: 
osh-cpp2 Idiom to handle purity errors from untrusted config files


[osh-cpp stdout] Expected '', got "TODO: what's the idiom?\n"



stdout: 


TODO: what's the idiom?

stderr: 


osh4 Executor: can run Hay (for now)


[osh stdout] Expected 'd\n', got ''



stdout: 


stderr: 


osh-cpp4 Executor: can run Hay (for now)


[osh-cpp stdout] Expected 'd\n', got ''



stdout: 


stderr: 


osh5 Executor: External Commands not allowed


[osh status] Expected 0, got 127



stdout: 


stderr: 


  var cmd = ^(seq 3)
              ^~~
[ stdin ]:1: Command 'seq' not found in pure mode (OILS-ERR-102)

osh-cpp5 Executor: External Commands not allowed


[osh-cpp status] Expected 0, got 127



stdout: 


stderr: 


  var cmd = ^(seq 3)
              ^~~
[ stdin ]:1: Command 'seq' not found in pure mode (OILS-ERR-102)

osh9 Are any builtins allowed?  true, false


[osh stdout] Expected 'true\nbuiltin true\ncommand true\n', got ''

[osh status] Expected 1, got 127



stdout: 


stderr: 


    true
    ^~~~
[ stdin ]:2: Command 'true' not found in pure mode (OILS-ERR-102)

osh-cpp9 Are any builtins allowed?  true, false


[osh-cpp stdout] Expected 'true\nbuiltin true\ncommand true\n', got ''

[osh-cpp status] Expected 1, got 127



stdout: 


stderr: 


    true
    ^~~~
[ stdin ]:2: Command 'true' not found in pure mode (OILS-ERR-102)

osh10 Are source or use builtins allowed?


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp10 Are source or use builtins allowed?


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh11 Can log to stderr in pure mode


[osh stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh-cpp11 Can log to stderr in pure mode


[osh-cpp stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh12 io and vm are not allowed


[osh stdout] Expected '', got '<Frame 0x7f96546e36c8>\n(Int)   140283638331080\n<Stdin>\n'



stdout: 


<Frame 0x7f96546e36c8>
(Int)   140283638331080
<Stdin>

stderr: 


osh-cpp12 io and vm are not allowed


[osh-cpp stdout] Expected '', got '<Frame 0x189d>\n(Int)   6057\n<Stdin>\n'



stdout: 


<Frame 0x189d>
(Int)   6057
<Stdin>

stderr: 


osh13 Can't make an alias of io->eval and call it, etc.


[osh stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh-cpp13 Can't make an alias of io->eval and call it, etc.


[osh-cpp stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh14 $RANDOM $SECONDS


[osh stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh-cpp14 $RANDOM $SECONDS


[osh-cpp stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh15 Purely-evaluated code can't set traps for later


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp15 Purely-evaluated code can't set traps for later


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: