Results for ysh-purity.test.sh

statusosh
pass 3
FAIL 10
total13
caseoshdescription
0pass eval() is a pure function
1pass evalExpr() is a pure function
2FAIL Idiom to handle purity errors from untrusted config files
details
3FAIL Can log to stderr in pure mode
details
4FAIL Executor: can run user-defined Procs (and Hay, for now)
details
5FAIL Executor: External Commands not allowed
details
6pass Executor: Command subs, pipelines, etc. not allowed
7FAIL Executor: Builtins not allowed
details
8FAIL Are source or use builtins allowed?
details
9FAIL io and vm are not allowed
details
10FAIL Can't make an alias of io->eval and call it, etc.
details
11FAIL $RANDOM $SECONDS
details
12FAIL Purely-evaluated code can't set traps for later
details
3 passed, 0 OK, 0 not implemented, 0 BUG, 10 failed, 0 timeouts, 0 cases skipped
10 failed under osh

Details on runs that didn't PASS

osh2 Idiom to handle purity errors from untrusted config files

[osh stdout] Expected '', got "TODO: what's the idiom?\n"

stdout:
TODO: what's the idiom?
stderr:
osh3 Can log to stderr in pure mode

[osh stdout] Expected '', got 'TODO: log builtin?\n'

stdout:
TODO: log builtin?
stderr:
osh4 Executor: can run user-defined Procs (and Hay, for now)

[osh stdout] Expected '', got "(Dict)\n{\n source: null,\n children: [\n {\n type: 'Package',\n args: ['foo'],\n children: [\n {\n type: 'INSTALL',\n args: [],\n location_str: '[ stdin ]',\n location_start_line: 7,\n code_str: ' echo hi '\n }\n ],\n attrs: {version: '1.1'}\n }\n ]\n}\nmyproc\n"

stdout:
(Dict)
{
    source: null,
    children: [
        {
            type: 'Package',
            args: ['foo'],
            children: [
                {
                    type: 'INSTALL',
                    args: [],
                    location_str: '[ stdin ]',
                    location_start_line: 7,
                    code_str: '            echo hi '
                }
            ],
            attrs: {version: '1.1'}
        }
    ]
}
myproc
stderr:
osh5 Executor: External Commands not allowed

[osh stdout] Expected '', got 'TODO\n'

stdout:
TODO
stderr:
osh7 Executor: Builtins not allowed

[osh stdout] Expected '', got '1\n 2\n 3\n\n'

stdout:
1
 2
 3

stderr:
osh8 Are source or use builtins allowed?

[osh stdout] Expected '', got 'TODO\n'

stdout:
TODO
stderr:
osh9 io and vm are not allowed

[osh stdout] Expected '', got '<Frame 0x7fd3d7a2b638>\n(Int) 140547832591928\n<Stdin>\n'

stdout:
<Frame 0x7fd3d7a2b638>
(Int)   140547832591928
<Stdin>
stderr:
osh10 Can't make an alias of io->eval and call it, etc.

[osh stdout] Expected '', got 'hi\n'

stdout:
hi
stderr:
osh11 $RANDOM $SECONDS

[osh stdout] Expected '', got 'not-implemented=\n0\n'

stdout:
not-implemented=
0
stderr:
osh12 Purely-evaluated code can't set traps for later

[osh stdout] Expected '', got 'TODO\n'

stdout:
TODO
stderr: