Why Sponsor Oils? | source | all docs for version 0.23.0 | all versions | oilshell.org

Warning: Work in progress! Leave feedback on Zulip or Github if you'd like this doc to be updated.

YSH I/O Builtins

POSIX shell has overlapping and quirky constructs for doing I/O:

• the builtins echo, printf, and read
• the $(command sub) construct
• Bash has mapfile and readarray

YSH rationalizes I/O with:

• A new write builtin
• Long flags to read, like --all
• The distinction between $(string sub) and @(array sub)
• A set of data languages called J8 Notation.

YSH also has orthogonal mechanisms for string processing:

• ${.myproc arg} and @{.myproc arg} are an optimization (TODO)
• ${x %.2f} as a static version of the printf builtin (TODO)
• ${x|html} for safe escaping (TODO)

These are discussed in more detail the strings doc.

Problems With Shell

• echo is flaky because echo $x is a bug. $x could be -n.
  • YSH write accepts --.
• read is non-obvious because the -r flag to ignore \ line continuations isn't the default. The \ creates a mini-language that isn't understood by other line-based tools like grep and awk.
  • TODO: YSH should have a mechanism to read buffered lines.
• There's no way to tell if $() strips the trailing newline,.
  • YSH has read --all, as well as lastpipe being on.

Example:

hostname | read --all (&x)
write -- $x

Summary of YSH features

• write: --qsn, --sep, --end
• read: --all (future: --line, --all-lines?)
• $(string sub) removes the trailing newline, if any
• @(array sub) splits by IFS
  • TODO: should it split by IFS=$'\n'?

write

• -sep: Characters to separate each argument. (Default: newline)
• -end: Characters to terminate the whole invocation. (Default: newline)
• -n: A synonym for -end ''.

Buffered vs. Unbuffered

• The POSIX flags to read issue many read(0, 1) calls. They do it byte-by-byte.
• The --long flags to read use buffered I/O.

Invariants

Here are some design notes on making the I/O builtins orthogonal and composable. There should be clean ways to "round trip" data between the OS and YSH data structures.

File -> String -> File

cat input.txt | read --all

# suppress the newline
write --end '' $_reply > output.txt

diff input.txt output.txt  # should be equal

File -> Array -> File

TODO

cat input.txt | read --all-lines :myarray

# suppress the newline
write --sep '' --end '' -- @myarray > output.txt

diff input.txt output.txt  # should be equal

Array -> J8 Lines -> Array

TODO

Related

• JSON support.