Results for ysh-purity.test.sh

statusoshosh-cpp
pass 33
FAIL 1010
total1313
caseoshosh-cppdescription
0pass pass eval() is a pure function
1pass pass evalExpr() is a pure function
2FAIL FAIL Idiom to handle purity errors from untrusted config files
detailsdetails
3FAIL FAIL Can log to stderr in pure mode
detailsdetails
4FAIL FAIL Executor: can run user-defined Procs (and Hay, for now)
detailsdetails
5FAIL FAIL Executor: External Commands not allowed
detailsdetails
6pass pass Executor: Command subs, pipelines, etc. not allowed
7FAIL FAIL Executor: Builtins not allowed
detailsdetails
8FAIL FAIL Are source or use builtins allowed?
detailsdetails
9FAIL FAIL io and vm are not allowed
detailsdetails
10FAIL FAIL Can't make an alias of io->eval and call it, etc.
detailsdetails
11FAIL FAIL $RANDOM $SECONDS
detailsdetails
12FAIL FAIL Purely-evaluated code can't set traps for later
detailsdetails
6 passed, 0 OK, 0 not implemented, 0 BUG, 10 failed, 0 timeouts, 0 cases skipped
10 failed under osh

Details on runs that didn't PASS

osh2 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '', got "TODO: what's the idiom?\n"

stdout: 
TODO: what's the idiom?
stderr: 
osh-cpp2 Idiom to handle purity errors from untrusted config files


[osh-cpp stdout] Expected '', got "TODO: what's the idiom?\n"



stdout: 


TODO: what's the idiom?

stderr: 


osh3 Can log to stderr in pure mode


[osh stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh-cpp3 Can log to stderr in pure mode


[osh-cpp stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh4 Executor: can run user-defined Procs (and Hay, for now)


[osh stdout] Expected '', got "(Dict)\n{\n    source: null,\n    children: [\n        {\n            type: 'Package',\n            args: ['foo'],\n            children: [\n                {\n                    type: 'INSTALL',\n                    args: [],\n                    location_str: '[ stdin ]',\n                    location_start_line: 7,\n                    code_str: '            echo hi '\n                }\n            ],\n            attrs: {version: '1.1'}\n        }\n    ]\n}\nmyproc\n"



stdout: 


(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc

stderr: 


osh-cpp4 Executor: can run user-defined Procs (and Hay, for now)


[osh-cpp stdout] Expected '', got "(Dict)\n{\n    source: null,\n    children: [\n        {\n            type: 'Package',\n            args: ['foo'],\n            children: [\n                {\n                    type: 'INSTALL',\n                    args: [],\n                    location_str: '[ stdin ]',\n                    location_start_line: 7,\n                    code_str: '            echo hi '\n                }\n            ],\n            attrs: {version: '1.1'}\n        }\n    ]\n}\nmyproc\n"



stdout: 


(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc

stderr: 


osh5 Executor: External Commands not allowed


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp5 Executor: External Commands not allowed


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh7 Executor: Builtins not allowed


[osh stdout] Expected '', got '1\n 2\n 3\n\n'



stdout: 


1
 2
 3


stderr: 


osh-cpp7 Executor: Builtins not allowed


[osh-cpp stdout] Expected '', got '1\n 2\n 3\n\n'



stdout: 


1
 2
 3


stderr: 


osh8 Are source or use builtins allowed?


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp8 Are source or use builtins allowed?


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh9 io and vm are not allowed


[osh stdout] Expected '', got '<Frame 0x7fa48460b638>\n(Int)   140344572294712\n<Stdin>\n'



stdout: 


<Frame 0x7fa48460b638>
(Int)   140344572294712
<Stdin>

stderr: 


osh-cpp9 io and vm are not allowed


[osh-cpp stdout] Expected '', got '<Frame 0x1899>\n(Int)   6053\n<Stdin>\n'



stdout: 


<Frame 0x1899>
(Int)   6053
<Stdin>

stderr: 


osh10 Can't make an alias of io->eval and call it, etc.


[osh stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh-cpp10 Can't make an alias of io->eval and call it, etc.


[osh-cpp stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh11 $RANDOM $SECONDS


[osh stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh-cpp11 $RANDOM $SECONDS


[osh-cpp stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh12 Purely-evaluated code can't set traps for later


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp12 Purely-evaluated code can't set traps for later


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: