Results for ysh-purity.test.sh

statusoshosh-cpp
pass 11
FAIL 1010
total1111
caseoshosh-cppdescription
0FAIL FAIL Idiom to handle purity errors from untrusted config files
detailsdetails
1FAIL FAIL Can log to stderr in pure mode
detailsdetails
2FAIL FAIL Executor: can run user-defined Procs (and Hay, for now)
detailsdetails
3FAIL FAIL Executor: External Commands not allowed
detailsdetails
4pass pass Executor: Command subs, pipelines, etc. not allowed
5FAIL FAIL Executor: Builtins not allowed
detailsdetails
6FAIL FAIL Are source or use builtins allowed?
detailsdetails
7FAIL FAIL io and vm are not allowed
detailsdetails
8FAIL FAIL Can't make an alias of io->eval and call it, etc.
detailsdetails
9FAIL FAIL $RANDOM $SECONDS
detailsdetails
10FAIL FAIL Purely-evaluated code can't set traps for later
detailsdetails
2 passed, 0 OK, 0 not implemented, 0 BUG, 10 failed, 0 timeouts, 0 cases skipped
10 failed under osh

Details on runs that didn't PASS

osh0 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '', got "TODO: what's the idiom?\n"

stdout: 
TODO: what's the idiom?
stderr: 
osh-cpp0 Idiom to handle purity errors from untrusted config files


[osh-cpp stdout] Expected '', got "TODO: what's the idiom?\n"



stdout: 


TODO: what's the idiom?

stderr: 


osh1 Can log to stderr in pure mode


[osh stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh-cpp1 Can log to stderr in pure mode


[osh-cpp stdout] Expected '', got 'TODO: log builtin?\n'



stdout: 


TODO: log builtin?

stderr: 


osh2 Executor: can run user-defined Procs (and Hay, for now)


[osh stdout] Expected '', got "(Dict)\n{\n    source: null,\n    children: [\n        {\n            type: 'Package',\n            args: ['foo'],\n            children: [\n                {\n                    type: 'INSTALL',\n                    args: [],\n                    location_str: '[ stdin ]',\n                    location_start_line: 7,\n                    code_str: '            echo hi '\n                }\n            ],\n            attrs: {version: '1.1'}\n        }\n    ]\n}\nmyproc\n"



stdout: 


(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc

stderr: 


osh-cpp2 Executor: can run user-defined Procs (and Hay, for now)


[osh-cpp stdout] Expected '', got "(Dict)\n{\n    source: null,\n    children: [\n        {\n            type: 'Package',\n            args: ['foo'],\n            children: [\n                {\n                    type: 'INSTALL',\n                    args: [],\n                    location_str: '[ stdin ]',\n                    location_start_line: 7,\n                    code_str: '            echo hi '\n                }\n            ],\n            attrs: {version: '1.1'}\n        }\n    ]\n}\nmyproc\n"



stdout: 


(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc

stderr: 


osh3 Executor: External Commands not allowed


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp3 Executor: External Commands not allowed


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh5 Executor: Builtins not allowed


[osh stdout] Expected '', got '1\n 2\n 3\n\n'



stdout: 


1
 2
 3


stderr: 


osh-cpp5 Executor: Builtins not allowed


[osh-cpp stdout] Expected '', got '1\n 2\n 3\n\n'



stdout: 


1
 2
 3


stderr: 


osh6 Are source or use builtins allowed?


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp6 Are source or use builtins allowed?


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh7 io and vm are not allowed


[osh stdout] Expected '', got '<Frame 0x7ff68b5d8680>\n(Int)   140696876844672\n<Stdin>\n'



stdout: 


<Frame 0x7ff68b5d8680>
(Int)   140696876844672
<Stdin>

stderr: 


osh-cpp7 io and vm are not allowed


[osh-cpp stdout] Expected '', got '<Frame 0x18a1>\n(Int)   6061\n<Stdin>\n'



stdout: 


<Frame 0x18a1>
(Int)   6061
<Stdin>

stderr: 


osh8 Can't make an alias of io->eval and call it, etc.


[osh stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh-cpp8 Can't make an alias of io->eval and call it, etc.


[osh-cpp stdout] Expected '', got 'hi\n'



stdout: 


hi

stderr: 


osh9 $RANDOM $SECONDS


[osh stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh-cpp9 $RANDOM $SECONDS


[osh-cpp stdout] Expected '', got 'not-implemented=\n0\n'



stdout: 


not-implemented=
0

stderr: 


osh10 Purely-evaluated code can't set traps for later


[osh stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: 


osh-cpp10 Purely-evaluated code can't set traps for later


[osh-cpp stdout] Expected '', got 'TODO\n'



stdout: 


TODO

stderr: