Results for ysh-purity.test.sh

statusoshosh_ALT
pass 88
FAIL 99
total1717
caseoshosh_ALTdescription
0pass pass eval() is a pure function
1pass pass evalExpr() is a pure function
2FAIL FAIL Idiom to handle purity errors from untrusted config files
detailsdetails
3pass pass Executor: can run user-defined Procs
4pass pass Executor: can run Hay (while Hay is hard-coded)
5pass pass Executor: External Commands not allowed
6pass pass Command subs, pipelines not allowed with --eval-pure
7pass pass Process subs, subshells not allowed with eval()
8pass pass Background job &
9FAIL FAIL Are any builtins allowed? true, false
detailsdetails
10FAIL FAIL Are source or use builtins allowed?
detailsdetails
11FAIL FAIL Can log to stderr in pure mode
detailsdetails
12FAIL FAIL io and vm are not allowed
detailsdetails
13FAIL FAIL Can't make an alias of io->eval and call it, etc.
detailsdetails
14FAIL FAIL Globbing not allowed
detailsdetails
15FAIL FAIL $RANDOM $SECONDS
detailsdetails
16FAIL FAIL Purely-evaluated code can't set traps for later
detailsdetails
16 passed, 0 OK, 0 not implemented, 0 BUG, 9 failed, 0 timeouts, 0 cases skipped
9 failed under osh

Details on runs that didn't PASS

osh2 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '', got "TODO: what's the idiom?\n"

stdout: 
TODO: what's the idiom?
stderr: 
osh_ALT2 Idiom to handle purity errors from untrusted config files


[osh_ALT stdout] Expected '', got "TODO: what's the idiom?\n"



stdout: 


TODO: what's the idiom?

stderr: 


osh9 Are any builtins allowed?  true, false


[osh status] Expected 0, got 1



stdout: 


true
builtin true
command true

stderr: 


    builtin false
    ^~~~~~~
[ stdin ]:13: errexit PID 7981: command.Simple failed with status 1

osh_ALT9 Are any builtins allowed?  true, false


[osh_ALT status] Expected 0, got 1



stdout: 


true
builtin true
command true

stderr: 


    builtin false
    ^~~~~~~
[ stdin ]:13: errexit PID 7984: command.Simple failed with status 1

osh10 Are source or use builtins allowed?


[osh status] Expected 0, got 127



stdout: 


stderr: 


    source foo.ysh
    ^~~~~~
[ stdin ]:5: Command 'source' not found in pure mode (OILS-ERR-102)
[ stdin ]:5: errexit PID 7985: command.Simple failed with status 127

osh_ALT10 Are source or use builtins allowed?


[osh_ALT status] Expected 0, got 127



stdout: 


stderr: 


    source foo.ysh
    ^~~~~~
[ stdin ]:5: Command 'source' not found in pure mode (OILS-ERR-102)
[ stdin ]:5: errexit PID 7988: command.Simple failed with status 127

osh11 Can log to stderr in pure mode


[osh status] Expected 0, got 127



stdout: 


stderr: 


    log "hi $name"
    ^~~
[ stdin ]:7: Command 'log' not found (OILS-ERR-100)
[ stdin ]:7: errexit PID 7989: command.Simple failed with status 127

osh_ALT11 Can log to stderr in pure mode


[osh_ALT status] Expected 0, got 127



stdout: 


stderr: 


    log "hi $name"
    ^~~
[ stdin ]:7: Command 'log' not found (OILS-ERR-100)
[ stdin ]:7: errexit PID 7992: command.Simple failed with status 127

osh12 io and vm are not allowed


[osh stdout] Expected '', got '<Frame 0x7f02f9e42128>\n(Int)   139650759139624\n<Stdin>\n<Frame 0x7f02f9e421b8>\n(Int)   139650759139768\n<Stdin>\n'



stdout: 


<Frame 0x7f02f9e42128>
(Int)   139650759139624
<Stdin>
<Frame 0x7f02f9e421b8>
(Int)   139650759139768
<Stdin>

stderr: 


osh_ALT12 io and vm are not allowed


[osh_ALT stdout] Expected '', got '<Frame 0x7ff40555a088>\n(Int)   140686038245512\n<Stdin>\n<Frame 0x7ff40555a088>\n(Int)   140686038245512\n<Stdin>\n'



stdout: 


<Frame 0x7ff40555a088>
(Int)   140686038245512
<Stdin>
<Frame 0x7ff40555a088>
(Int)   140686038245512
<Stdin>

stderr: 


osh13 Can't make an alias of io->eval and call it, etc.


[osh stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh_ALT13 Can't make an alias of io->eval and call it, etc.


[osh_ALT stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh14 Globbing not allowed


[osh stdout] Expected '', got '*.txt\n'

[osh status] Expected 0, got 127



stdout: 


*.txt

stderr: 


    echo *.txt
    ^~~~
[ stdin ]:2: Command 'echo' not found in pure mode (OILS-ERR-102)

osh_ALT14 Globbing not allowed


[osh_ALT stdout] Expected '', got '*.txt\n'

[osh_ALT status] Expected 0, got 127



stdout: 


*.txt

stderr: 


    echo *.txt
    ^~~~
[ stdin ]:2: Command 'echo' not found in pure mode (OILS-ERR-102)

osh15 $RANDOM $SECONDS


[osh status] Expected 0, got 1



stdout: 


stderr: 


    echo not-implemented=$RANDOM
                         ^~~~~~~
[ stdin ]:4: fatal: Undefined variable 'RANDOM'

osh_ALT15 $RANDOM $SECONDS


[osh_ALT status] Expected 0, got 1



stdout: 


stderr: 


    echo not-implemented=$RANDOM
                         ^~~~~~~
[ stdin ]:4: fatal: Undefined variable 'RANDOM'

osh16 Purely-evaluated code can't set traps for later


[osh status] Expected 0, got 127



stdout: 


stderr: 


    trap 'echo INT' INT
    ^~~~
[ stdin ]:2: Command 'trap' not found in pure mode (OILS-ERR-102)

osh_ALT16 Purely-evaluated code can't set traps for later


[osh_ALT status] Expected 0, got 127



stdout: 


stderr: 


    trap 'echo INT' INT
    ^~~~
[ stdin ]:2: Command 'trap' not found in pure mode (OILS-ERR-102)