Results for ysh-purity.test.sh

statusoshosh-cpp
pass 88
FAIL 1010
total1818
caseoshosh-cppdescription
0pass pass eval() is a pure function
1pass pass evalExpr() is a pure function
2FAIL FAIL Idiom to handle purity errors from untrusted config files
detailsdetails
3pass pass Executor: can run user-defined Procs
4pass pass Executor: can run Hay (while Hay is hard-coded)
5pass pass Executor: External Commands not allowed
6pass pass Command subs, pipelines not allowed with --eval-pure
7pass pass Process subs, subshells not allowed with eval()
8pass pass Background job &
9FAIL FAIL Redirects
detailsdetails
10FAIL FAIL Are any builtins allowed? true, false
detailsdetails
11FAIL FAIL Are source or use builtins allowed?
detailsdetails
12FAIL FAIL Can log to stderr in pure mode
detailsdetails
13FAIL FAIL io and vm are not allowed
detailsdetails
14FAIL FAIL Can't make an alias of io->eval and call it, etc.
detailsdetails
15FAIL FAIL Globbing not allowed
detailsdetails
16FAIL FAIL $RANDOM $SECONDS
detailsdetails
17FAIL FAIL Purely-evaluated code can't set traps for later
detailsdetails
16 passed, 0 OK, 0 not implemented, 0 BUG, 10 failed, 0 timeouts, 0 cases skipped
10 failed under osh

Details on runs that didn't PASS

osh2 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '' Got "TODO: what's the idiom?\n"

stdout: 
TODO: what's the idiom?
stderr: 
osh-cpp2 Idiom to handle purity errors from untrusted config files



[osh-cpp stdout]
Expected ''
Got      "TODO: what's the idiom?\n"




stdout: 


TODO: what's the idiom?

stderr: 


osh9 Redirects



[osh stdout]
Expected 'TODO\n'
Got      "removed 'out.txt'\n"




stdout: 


removed 'out.txt'

stderr: 


osh-cpp9 Redirects



[osh-cpp stdout]
Expected 'TODO\n'
Got      "removed 'out.txt'\n"




stdout: 


removed 'out.txt'

stderr: 


osh10 Are any builtins allowed?  true, false



[osh status]
Expected 0
Got      1




stdout: 


true
builtin true
command true

stderr: 


    builtin false
    ^~~~~~~
[ stdin ]:13: errexit PID 40782: Command failed with status 1

osh-cpp10 Are any builtins allowed?  true, false



[osh-cpp status]
Expected 0
Got      1




stdout: 


true
builtin true
command true

stderr: 


    builtin false
    ^~~~~~~
[ stdin ]:13: errexit PID 40795: Command failed with status 1

osh11 Are source or use builtins allowed?



[osh status]
Expected 0
Got      127




stdout: 


stderr: 


    source foo.ysh
    ^~~~~~
[ stdin ]:5: Command 'source' not found in pure mode (OILS-ERR-102)
[ stdin ]:5: errexit PID 40799: Command failed with status 127

osh-cpp11 Are source or use builtins allowed?



[osh-cpp status]
Expected 0
Got      127




stdout: 


stderr: 


    source foo.ysh
    ^~~~~~
[ stdin ]:5: Command 'source' not found in pure mode (OILS-ERR-102)
[ stdin ]:5: errexit PID 40817: Command failed with status 127

osh12 Can log to stderr in pure mode



[osh status]
Expected 0
Got      127




stdout: 


stderr: 


    log "hi $name"
    ^~~
[ stdin ]:7: Command 'log' not found (OILS-ERR-100)
[ stdin ]:7: errexit PID 40824: Command failed with status 127

osh-cpp12 Can log to stderr in pure mode



[osh-cpp status]
Expected 0
Got      127




stdout: 


stderr: 


    log "hi $name"
    ^~~
[ stdin ]:7: Command 'log' not found (OILS-ERR-100)
[ stdin ]:7: errexit PID 40837: Command failed with status 127

osh13 io and vm are not allowed



[osh stdout]
Expected ''
Got      '<Frame 0x7f6d0067a9b0>\n(Int)   140106134956464\n<Stdin>\n<Frame 0x7f6d00676c30>\n(Int)   140106134938320\n<Stdin>\n'




stdout: 


<Frame 0x7f6d0067a9b0>
(Int)   140106134956464
<Stdin>
<Frame 0x7f6d00676c30>
(Int)   140106134938320
<Stdin>

stderr: 


osh-cpp13 io and vm are not allowed



[osh-cpp stdout]
Expected ''
Got      '<Frame 0x16c5>\n(Int)   5681\n<Stdin>\n<Frame 0x29e5>\n(Int)   10577\n<Stdin>\n'




stdout: 


<Frame 0x16c5>
(Int)   5681
<Stdin>
<Frame 0x29e5>
(Int)   10577
<Stdin>

stderr: 


osh14 Can't make an alias of io->eval and call it, etc.



[osh stdout]
Expected ''
Got      'hi\n'




stdout: 


hi

stderr: 


osh-cpp14 Can't make an alias of io->eval and call it, etc.



[osh-cpp stdout]
Expected ''
Got      'hi\n'




stdout: 


hi

stderr: 


osh15 Globbing not allowed



[osh stdout]
Expected ''
Got      '*.txt\n'



[osh status]
Expected 0
Got      127




stdout: 


*.txt

stderr: 


    echo *.txt
    ^~~~
[ stdin ]:2: Command 'echo' not found in pure mode (OILS-ERR-102)

osh-cpp15 Globbing not allowed



[osh-cpp stdout]
Expected ''
Got      '*.txt\n'



[osh-cpp status]
Expected 0
Got      127




stdout: 


*.txt

stderr: 


    echo *.txt
    ^~~~
[ stdin ]:2: Command 'echo' not found in pure mode (OILS-ERR-102)

osh16 $RANDOM $SECONDS



[osh status]
Expected 0
Got      1




stdout: 


stderr: 


    echo not-implemented=$RANDOM
                         ^~~~~~~
[ stdin ]:4: fatal: Undefined variable 'RANDOM'

osh-cpp16 $RANDOM $SECONDS



[osh-cpp status]
Expected 0
Got      1




stdout: 


stderr: 


    echo not-implemented=$RANDOM
                         ^~~~~~~
[ stdin ]:4: fatal: Undefined variable 'RANDOM'

osh17 Purely-evaluated code can't set traps for later



[osh status]
Expected 0
Got      127




stdout: 


stderr: 


    trap 'echo INT' INT
    ^~~~
[ stdin ]:2: Command 'trap' not found in pure mode (OILS-ERR-102)

osh-cpp17 Purely-evaluated code can't set traps for later



[osh-cpp status]
Expected 0
Got      127




stdout: 


stderr: 


    trap 'echo INT' INT
    ^~~~
[ stdin ]:2: Command 'trap' not found in pure mode (OILS-ERR-102)