Results for hay-isolation.test.sh

statusoshosh_ALT
pass 50
FAIL 16
total66
caseoshosh_ALTdescription
0pass FAIL Turn off external binaries with shvar PATH='' {}
details
1pass FAIL More shvar PATH=''
details
2pass FAIL builtins and externals not available in hay eval
details
3pass FAIL procs in hay eval
details
4pass FAIL variables mutated within hay eval don't persist
details
5FAIL FAIL hay at top level allows arbitrary commands
detailsdetails
5 passed, 0 OK, 0 not implemented, 0 BUG, 1 failed, 0 timeouts, 0 cases skipped
1 failed under osh

Details on runs that didn't PASS

osh_ALT0 Turn off external binaries with shvar PATH='' {}

[osh_ALT stdout] Expected 'status=0\nstatus=127\nstatus=127\nstatus=0\n' Got ''
[osh_ALT status] Expected 0, got 1
[osh_ALT stderr] Found 'Traceback (most recent'

stdout: 
stderr: 


Could not import bin.oil
Traceback (most recent call last):
  File "/home/uke/oil/bin/oil.py", line 22, in <module>
    from _devbuild.gen import id_kind
  File "/home/uke/oil/_devbuild/gen/id_kind.py", line 2, in <module>
    from _devbuild.gen.id_kind_asdl import Id, Kind
  File "/home/uke/oil/_devbuild/gen/id_kind_asdl.py", line 1, in <module>
    from asdl import pybase
  File "/home/uke/oil/asdl/pybase.py", line 5, in <module>
    from mycpp import mylib
  File "/home/uke/oil/mycpp/mylib.py", line 17, in <module>
    from pylib import collections_
  File "/home/uke/oil/pylib/collections_.py", line 9, in <module>
    from typing import Any
  File "/home/uke/oil/vendor/typing.py", line 3, in <module>
    import abc
  File "/home/uke/tmp/Python-2.7.13/Lib/abc.py", line 6, in <module>
    import types
  File "/home/uke/tmp/Python-2.7.13/Lib/types.py", line 86, in <module>
    __all__ = list(n for n in globals() if n[:1] != '_')
NameError: name 'globals' is not defined
FATAL: couldn't import from app bundle '/home/uke/oil/_tmp/oil-tar-test/oil-0.24.0/_bin/osh' (1)
Stripping the oil.ovm binary may cause this error.
See https://github.com/oilshell/oil/issues/47

osh_ALT1 More shvar PATH=''


[osh_ALT stdout] Expected 'status=127\nstatus=127\n_status 127\n', got ''

[osh_ALT status] Expected 0, got 1

[osh_ALT stderr] Found 'Traceback (most recent'



stdout: 


stderr: 


Could not import bin.oil
Traceback (most recent call last):
  File "/home/uke/oil/bin/oil.py", line 22, in <module>
    from _devbuild.gen import id_kind
  File "/home/uke/oil/_devbuild/gen/id_kind.py", line 2, in <module>
    from _devbuild.gen.id_kind_asdl import Id, Kind
  File "/home/uke/oil/_devbuild/gen/id_kind_asdl.py", line 1, in <module>
    from asdl import pybase
  File "/home/uke/oil/asdl/pybase.py", line 5, in <module>
    from mycpp import mylib
  File "/home/uke/oil/mycpp/mylib.py", line 17, in <module>
    from pylib import collections_
  File "/home/uke/oil/pylib/collections_.py", line 9, in <module>
    from typing import Any
  File "/home/uke/oil/vendor/typing.py", line 3, in <module>
    import abc
  File "/home/uke/tmp/Python-2.7.13/Lib/abc.py", line 6, in <module>
    import types
  File "/home/uke/tmp/Python-2.7.13/Lib/types.py", line 86, in <module>
    __all__ = list(n for n in globals() if n[:1] != '_')
NameError: name 'globals' is not defined
FATAL: couldn't import from app bundle '/home/uke/oil/_tmp/oil-tar-test/oil-0.24.0/_bin/osh' (1)
Stripping the oil.ovm binary may cause this error.
See https://github.com/oilshell/oil/issues/47

osh_ALT2 builtins and externals not available in hay eval


[osh_ALT stdout] Expected 'status 127\nstatus 127\n', got ''

[osh_ALT status] Expected 0, got 1

[osh_ALT stderr] Found 'Traceback (most recent'



stdout: 


stderr: 


Could not import bin.oil
Traceback (most recent call last):
  File "/home/uke/oil/bin/oil.py", line 22, in <module>
    from _devbuild.gen import id_kind
  File "/home/uke/oil/_devbuild/gen/id_kind.py", line 2, in <module>
    from _devbuild.gen.id_kind_asdl import Id, Kind
  File "/home/uke/oil/_devbuild/gen/id_kind_asdl.py", line 1, in <module>
    from asdl import pybase
  File "/home/uke/oil/asdl/pybase.py", line 5, in <module>
    from mycpp import mylib
  File "/home/uke/oil/mycpp/mylib.py", line 17, in <module>
    from pylib import collections_
  File "/home/uke/oil/pylib/collections_.py", line 9, in <module>
    from typing import Any
  File "/home/uke/oil/vendor/typing.py", line 3, in <module>
    import abc
  File "/home/uke/tmp/Python-2.7.13/Lib/abc.py", line 6, in <module>
    import types
  File "/home/uke/tmp/Python-2.7.13/Lib/types.py", line 86, in <module>
    __all__ = list(n for n in globals() if n[:1] != '_')
NameError: name 'globals' is not defined
FATAL: couldn't import from app bundle '/home/uke/oil/_tmp/oil-tar-test/oil-0.24.0/_bin/osh' (1)
Stripping the oil.ovm binary may cause this error.
See https://github.com/oilshell/oil/issues/47

osh_ALT3 procs in hay eval


[osh_ALT stdout] Expected 'outside\ninside\n1 OUT\n', got ''

[osh_ALT status] Expected 0, got 1

[osh_ALT stderr] Found 'Traceback (most recent'



stdout: 


stderr: 


Could not import bin.oil
Traceback (most recent call last):
  File "/home/uke/oil/bin/oil.py", line 22, in <module>
    from _devbuild.gen import id_kind
  File "/home/uke/oil/_devbuild/gen/id_kind.py", line 2, in <module>
    from _devbuild.gen.id_kind_asdl import Id, Kind
  File "/home/uke/oil/_devbuild/gen/id_kind_asdl.py", line 1, in <module>
    from asdl import pybase
  File "/home/uke/oil/asdl/pybase.py", line 5, in <module>
    from mycpp import mylib
  File "/home/uke/oil/mycpp/mylib.py", line 17, in <module>
    from pylib import collections_
  File "/home/uke/oil/pylib/collections_.py", line 9, in <module>
    from typing import Any
  File "/home/uke/oil/vendor/typing.py", line 3, in <module>
    import abc
  File "/home/uke/tmp/Python-2.7.13/Lib/abc.py", line 6, in <module>
    import types
  File "/home/uke/tmp/Python-2.7.13/Lib/types.py", line 86, in <module>
    __all__ = list(n for n in globals() if n[:1] != '_')
NameError: name 'globals' is not defined
FATAL: couldn't import from app bundle '/home/uke/oil/_tmp/oil-tar-test/oil-0.24.0/_bin/osh' (1)
Stripping the oil.ovm binary may cause this error.
See https://github.com/oilshell/oil/issues/47

osh_ALT4 variables mutated within hay eval don't persist


[osh_ALT stdout] Expected 'x = 42\n', got ''

[osh_ALT status] Expected 0, got 1

[osh_ALT stderr] Found 'Traceback (most recent'



stdout: 


stderr: 


Could not import bin.oil
Traceback (most recent call last):
  File "/home/uke/oil/bin/oil.py", line 22, in <module>
    from _devbuild.gen import id_kind
  File "/home/uke/oil/_devbuild/gen/id_kind.py", line 2, in <module>
    from _devbuild.gen.id_kind_asdl import Id, Kind
  File "/home/uke/oil/_devbuild/gen/id_kind_asdl.py", line 1, in <module>
    from asdl import pybase
  File "/home/uke/oil/asdl/pybase.py", line 5, in <module>
    from mycpp import mylib
  File "/home/uke/oil/mycpp/mylib.py", line 17, in <module>
    from pylib import collections_
  File "/home/uke/oil/pylib/collections_.py", line 9, in <module>
    from typing import Any
  File "/home/uke/oil/vendor/typing.py", line 3, in <module>
    import abc
  File "/home/uke/tmp/Python-2.7.13/Lib/abc.py", line 6, in <module>
    import types
  File "/home/uke/tmp/Python-2.7.13/Lib/types.py", line 86, in <module>
    __all__ = list(n for n in globals() if n[:1] != '_')
NameError: name 'globals' is not defined
FATAL: couldn't import from app bundle '/home/uke/oil/_tmp/oil-tar-test/oil-0.24.0/_bin/osh' (1)
Stripping the oil.ovm binary may cause this error.
See https://github.com/oilshell/oil/issues/47

osh5 hay at top level allows arbitrary commands


[osh stdout] Expected '3\n4\ninside\n', got '3\n4\n--- -\t2024-11-19 05:36:55.222665000 +0000\n+++ actual.txt\t2024-11-19 05:36:55.215712796 +0000\n@@ -1,4 +0,0 @@\n-[\n-  "1",\n-  "2"\n-]\ninside\n'



stdout: 


3
4
--- -	2024-11-19 05:36:55.222665000 +0000
+++ actual.txt	2024-11-19 05:36:55.215712796 +0000
@@ -1,4 +0,0 @@
-[
-  "1",
-  "2"
-]
inside

stderr: 


  json write (_hay()) | jq '.children[0].args' > actual.txt
                        ^~
[ stdin ]:9: 'jq' not found (OILS-ERR-100)
    Package $(seq 2) {
              ^~~
[ stdin ]:20: Unknown command 'seq' while running hay
[ stdin ]:20: errexit PID 38366: command.Simple failed with status 127

osh_ALT5 hay at top level allows arbitrary commands


[osh_ALT stdout] Expected '3\n4\ninside\n', got ''

[osh_ALT status] Expected 127, got 1

[osh_ALT stderr] Found 'Traceback (most recent'



stdout: 


stderr: 


Could not import bin.oil
Traceback (most recent call last):
  File "/home/uke/oil/bin/oil.py", line 22, in <module>
    from _devbuild.gen import id_kind
  File "/home/uke/oil/_devbuild/gen/id_kind.py", line 2, in <module>
    from _devbuild.gen.id_kind_asdl import Id, Kind
  File "/home/uke/oil/_devbuild/gen/id_kind_asdl.py", line 1, in <module>
    from asdl import pybase
  File "/home/uke/oil/asdl/pybase.py", line 5, in <module>
    from mycpp import mylib
  File "/home/uke/oil/mycpp/mylib.py", line 17, in <module>
    from pylib import collections_
  File "/home/uke/oil/pylib/collections_.py", line 9, in <module>
    from typing import Any
  File "/home/uke/oil/vendor/typing.py", line 3, in <module>
    import abc
  File "/home/uke/tmp/Python-2.7.13/Lib/abc.py", line 6, in <module>
    import types
  File "/home/uke/tmp/Python-2.7.13/Lib/types.py", line 86, in <module>
    __all__ = list(n for n in globals() if n[:1] != '_')
NameError: name 'globals' is not defined
FATAL: couldn't import from app bundle '/home/uke/oil/_tmp/oil-tar-test/oil-0.24.0/_bin/osh' (1)
Stripping the oil.ovm binary may cause this error.
See https://github.com/oilshell/oil/issues/47