Results for ysh-purity.test.sh

statusoshosh_ALT
pass 55
FAIL 1010
total1515
caseoshosh_ALTdescription
0pass pass eval() is a pure function
1pass pass evalExpr() is a pure function
2FAIL FAIL Idiom to handle purity errors from untrusted config files
detailsdetails
3FAIL FAIL Can log to stderr in pure mode
detailsdetails
4FAIL FAIL Executor: can run user-defined Procs (and Hay, for now)
detailsdetails
5FAIL FAIL Executor: External Commands not allowed
detailsdetails
6pass pass Command subs, pipelines not allowed with --eval-pure
7pass pass Process subs, subshells not allowed with eval()
8pass pass Background job &
9FAIL FAIL Are any builtins allowed? true, false
detailsdetails
10FAIL FAIL Are source or use builtins allowed?
detailsdetails
11FAIL FAIL io and vm are not allowed
detailsdetails
12FAIL FAIL Can't make an alias of io->eval and call it, etc.
detailsdetails
13FAIL FAIL $RANDOM $SECONDS
detailsdetails
14FAIL FAIL Purely-evaluated code can't set traps for later
detailsdetails
10 passed, 0 OK, 0 not implemented, 0 BUG, 10 failed, 0 timeouts, 0 cases skipped
10 failed under osh

Details on runs that didn't PASS

osh2 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '', got "TODO: what's the idiom?\n"

stdout: 
TODO: what's the idiom?
stderr: 
osh_ALT2 Idiom to handle purity errors from untrusted config files


[osh_ALT stdout] Expected '', got "TODO: what's the idiom?\n"



stdout: 


TODO: what's the idiom?

stderr: 


osh3 Can log to stderr in pure mode


[osh stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh_ALT3 Can log to stderr in pure mode


[osh_ALT stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh4 Executor: can run user-defined Procs (and Hay, for now)


[osh stdout] Expected '', got "(Dict)\n{\n    source: null,\n    children: [\n        {\n            type: 'Package',\n            args: ['foo'],\n            children: [\n                {\n                    type: 'INSTALL',\n                    args: [],\n                    location_str: '[ stdin ]',\n                    location_start_line: 7,\n                    code_str: '            echo hi '\n                }\n            ],\n            attrs: {version: '1.1'}\n        }\n    ]\n}\nmyproc\n"



stdout: 


(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc

stderr: 


osh_ALT4 Executor: can run user-defined Procs (and Hay, for now)


[osh_ALT stdout] Expected '', got "(Dict)\n{\n    source: null,\n    children: [\n        {\n            type: 'Package',\n            args: ['foo'],\n            children: [\n                {\n                    type: 'INSTALL',\n                    args: [],\n                    location_str: '[ stdin ]',\n                    location_start_line: 7,\n                    code_str: '            echo hi '\n                }\n            ],\n            attrs: {version: '1.1'}\n        }\n    ]\n}\nmyproc\n"



stdout: 


(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc

stderr: 


osh5 Executor: External Commands not allowed


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh_ALT5 Executor: External Commands not allowed


[osh_ALT stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh9 Are any builtins allowed?  true, false


[osh stdout] Expected 'true\nbuiltin true\ncommand true\n', got ''

[osh status] Expected 1, got 0



stdout: 


stderr: 


RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand

osh_ALT9 Are any builtins allowed?  true, false


[osh_ALT stdout] Expected 'true\nbuiltin true\ncommand true\n', got ''

[osh_ALT status] Expected 1, got 0



stdout: 


stderr: 


RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand
RunSimpleCommand

osh10 Are source or use builtins allowed?


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh_ALT10 Are source or use builtins allowed?


[osh_ALT stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh11 io and vm are not allowed


[osh stdout] Expected '', got '<Frame 0x7f4a051307a0>\n(Int)   139955889440672\n<Stdin>\n'



stdout: 


<Frame 0x7f4a051307a0>
(Int)   139955889440672
<Stdin>

stderr: 


osh_ALT11 io and vm are not allowed


[osh_ALT stdout] Expected '', got '<Frame 0x7f2092f2b6c8>\n(Int)   139777881061064\n<Stdin>\n'



stdout: 


<Frame 0x7f2092f2b6c8>
(Int)   139777881061064
<Stdin>

stderr: 


osh12 Can't make an alias of io->eval and call it, etc.


[osh stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh_ALT12 Can't make an alias of io->eval and call it, etc.


[osh_ALT stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh13 $RANDOM $SECONDS


[osh stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh_ALT13 $RANDOM $SECONDS


[osh_ALT stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh14 Purely-evaluated code can't set traps for later


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh_ALT14 Purely-evaluated code can't set traps for later


[osh_ALT stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: