OILS / doc / ref / chap-builtin-cmd.md View on Github | oils.pub

1750 lines, 1117 significant
1---
2title: Builtin Commands (Oils Reference)
3all_docs_url: ..
4body_css_class: width40
5default_highlighter: oils-sh
6preserve_anchor_case: yes
7---
8
9<div class="doc-ref-header">
10
11[Oils Reference](index.html) &mdash; Chapter **Builtin Commands**
12
13</div>
14
15This chapter in the [Oils Reference](index.html) describes builtin commands for OSH and YSH.
16
17<span class="in-progress">(in progress)</span>
18
19<div id="dense-toc">
20</div>
21
22## Memory
23
24### cmd/append
25
26Append word arguments to a list:
27
28 var mylist = :| hello |
29
30 append *.py (mylist) # append all Python files
31
32 var myflags = []
33 append -- -c 'echo hi' (myflags) # -- to avoid ambiguity
34
35It's a shortcut for:
36
37 call myflags->append('-c')
38 call myflags->append('echo hi')
39
40Similar names: [append][]
41
42[append]: chap-index.html#append
43
44### pp
45
46The `pp` builtin pretty prints values and interpreter state.
47
48Pretty printing expressions is the most common:
49
50 $ var x = 42
51 $ pp (x + 5)
52 myfile.ysh:1: (Int) 47 # print value with code location
53
54You can pass an unevaluated expression:
55
56 $ pp [x + 5]
57 myfile.ysh:1: (Int) 47 # evaluate first
58
59The `value` command is a synonym for the interactive `=` operator:
60
61 $ pp value (x)
62 (Int) 42
63
64 $ = x
65 (Int) 42
66
67Print proc names and doc comments:
68
69 $ pp proc # subject to change
70
71You can also print low-level interpreter state. The trailing `_` indicates
72that the exact format may change:
73
74Examples:
75
76 $ var x = :| one two |
77
78 $ pp asdl_ (x) # dump the ASDL "guts"
79
80 $ pp test_ (x) # single-line stable format, for spec tests
81
82 # dump the ASDL representation of a "Cell", which is a location for a value
83 # (not the value itself)
84 $ pp cell_ x
85
86
87## Handle Errors
88
89### error
90
91The `error` builtin interrupts shell execution.
92
93If there's a surrounding `try` block, the `_error` register is set, and
94execution proceeds after the block.
95
96Otherwise, the shell exits with a non-zero status.
97
98Examples:
99
100 error 'Missing /tmp' # program fails with status 10
101
102 try {
103 error 'Another problem'
104 }
105 echo $[error.code] # => 10
106
107Override the default error code of `10` with a named argument:
108
109 error 'Missing /tmp' (code=99) # program fails with status 99
110
111Named arguments add arbitrary properties to the resulting `_error` register:
112
113 error 'Oops' (path='foo.json')
114
115See [YSH Error Handling](../ysh-error-handling.html) for more examples.
116
117### failed
118
119A shortcut for `(_error.code !== 0)`:
120
121 try {
122 ls /tmp
123 }
124 if failed {
125 echo 'ls failed'
126 }
127
128It saves you 7 punctuation characters: `( _ . !== )`
129
130See [YSH Error Handling](../ysh-error-handling.html) for more examples.
131
132### try
133
134Run a block of code, stopping at the first error. (This is implemented with
135`shopt --set errexit`)
136
137`try` sets the `_error` register to a dict, and always returns 0.
138
139 try {
140 ls /nonexistent
141 }
142 if (_error.code !== 0) {
143 echo 'ls failed'
144 }
145
146Handle expression errors:
147
148 try {
149 var x = 42 / 0
150 }
151
152And errors from compound commands:
153
154 try {
155 ls | wc -l
156 diff <(sort left.txt) <(sort right.txt)
157 }
158
159The case statement can be useful:
160
161 try {
162 grep PATTERN FILE.txt
163 }
164 case (_error.code) {
165 (0) { echo 'found' }
166 (1) { echo 'not found' }
167 (else) { echo "grep returned status $[_error.code]" }
168 }
169
170See [YSH Error Handling](../ysh-error-handling.html) for more examples.
171
172### boolstatus
173
174Runs a command, and requires the exit code to be 0 or 1.
175
176 if boolstatus egrep '[0-9]+' myfile { # e.g. aborts on status 2
177 echo 'found' # status 0 means found
178 } else {
179 echo 'not found' # status 1 means not found
180 }
181
182It's meant for external commands that "return" more than 2 values, like true /
183false / fail, rather than pass / fail.
184
185### assert
186
187Evaluates and expression, and fails if it is not truthy.
188
189 assert (false) # fails
190 assert [false] # also fails (the expression is evaluated)
191
192It's common to pass an unevaluated expression with `===`:
193
194 func f() { return (42) }
195
196 assert [43 === f()]
197
198In this special case, you get a nicer error message:
199
200> Expected: 43
201> Got: 42
202
203That is, the left-hand side should be the expected value, and the right-hand
204side should be the actual value.
205
206## Shell State
207
208### ysh-cd
209
210It takes a block:
211
212 cd / {
213 echo $PWD
214 }
215
216### ysh-shopt
217
218Sets shell options, e.g.
219
220 shopt --unset errexit
221 shopt --set errexit
222
223You can set or unset multiple options with the groups `strict:all`,
224`ysh:upgrade`, and `ysh:all`. Example:
225
226 shopt --set ysh:upgrade
227
228If a block is passed, then:
229
2301. the mutated options are pushed onto a stack
2312. the block is executed
2323. the options are restored to their original state (even if the block fails to
233 execute)
234
235Example:
236
237 shopt --unset errexit {
238 false
239 echo 'ok'
240 }
241
242Note that setting `ysh:upgrade` or `ysh:all` may initialize the [ENV][] dict.
243
244Related: [shopt](#shopt)
245
246[ENV]: chap-special-var.html#ENV
247
248### shvar
249
250Execute a block with a global variable set.
251
252 shvar IFS=/ {
253 echo "ifs is $IFS"
254 }
255 echo "ifs restored to $IFS"
256
257### ctx
258
259Execute a block with a shared "context" that can be updated using the `ctx`
260built-in.
261
262 var mydict = {}
263 ctx push (mydict) {
264 # = mydict => {}
265 ctx set (mykey='myval')
266 }
267 # = mydict => { mykey: 'myval' }
268
269The context can be modified with `ctx set (key=val)`, which updates or inserts
270the value at the given key.
271
272The context can also be updated with `ctx emit field (value)`.
273
274 ctx push (mydict) {
275 # = mydict => {}
276 ctx emit mylist (0)
277 # = mydict => { mylist: [0] }
278 ctx emit mylist (1)
279 }
280 # = mydict => { mylist: [0, 1] }
281
282Contexts can be nested, resulting in a stack of contexts.
283
284 ctx push (mydict1) {
285 ctx set (dict=1)
286 ctx push (mydict2) {
287 ctx set (dict=2)
288 }
289 }
290 # = mydict1 => { dict: 1 }
291 # = mydict2 => { dict: 2 }
292
293`ctx` is useful for creating DSLs, such as a mini-parseArgs.
294
295 proc parser (; place ; ; block_def) {
296 var p = {}
297 ctx push (p, block_def)
298 call place->setValue(p)
299 }
300
301 proc flag (short_name, long_name; type; help) {
302 ctx emit flag ({short_name, long_name, type, help})
303 }
304
305 proc arg (name) {
306 ctx emit arg ({name})
307 }
308
309 parser (&spec) {
310 flag -t --tsv (Bool, help='Output as TSV')
311 flag -r --recursive (Bool, help='Recurse into the given directory')
312 flag -N --count (Int, help='Process no more than N files')
313 arg path
314 }
315
316### push-registers
317
318Save global registers like $? on a stack. It's useful for preventing plugins
319from interfering with user code. Example:
320
321 status_42 # returns 42 and sets $?
322 push-registers { # push a new frame
323 status_43 # top of stack changed here
324 echo done
325 } # stack popped
326 echo $? # 42, read from new top-of-stack
327
328Current list of registers:
329
330 Regex data underlying BASH_REMATCH, _group(), _start(), _end()
331 $?
332 _error # set by the try builtin
333 PIPESTATUS # aka _pipeline_status
334 _process_sub_status
335
336
337## Modules
338
339### source-guard
340
341Registers a name in the global "module" dict. Returns 0 if it doesn't exist,
342or 1 if it does.
343
344Use it like this in executable files:
345
346 source-guard main || return 0
347
348And like this in libraries:
349
350 source-guard myfile.ysh || return 0
351
352### is-main
353
354The `is-main` builtin returns 1 (false) if the current file was executed with
355the `source` builtin.
356
357In the "main" file, including `-c` or `stdin` input, it returns 0 (true).
358
359Use it like this:
360
361 if is-main {
362 runproc @ARGV
363 }
364
365### use
366
367The `use` builtin evaluates a source file in a new `Frame`, and then creates an
368`Obj` that is a namespace.
369
370 use my-dir/mymodule.ysh
371
372 echo $[mymodule.my_integer] # the module Obj has attributes
373 mymodule my-proc # the module Obj is invokable
374
375The evaluation of such files is cached, so it won't be re-evaluated if `use` is
376called again.
377
378To import a specific name, use the `--pick` flag:
379
380 use my-dir/mymodule.ysh --pick my-proc other-proc
381
382 my-proc 1 2
383 other-proc 3 4
384
385Note: the `--pick` flag must come *after* the module, so this isn't valid:
386
387 use --pick my-proc mymodule.sh # INVALID
388
389<!--
390# TODO:
391
392use mod.ysh --all-provided # relies on __provide__ or provide builtin
393use mod.ysh --all-for-testing
394-->
395
396---
397
398The `--extern` flag means that `use` does nothing. These commands can be used
399by tools to analyze names.
400
401 use --extern grep sed awk
402
403---
404
405Notes:
406
407- To get a reference to `module-with-hyphens`, you may need to use
408 `getVar('module-with-hyphens')`.
409 - TODO: consider backtick syntax as well
410- `use` must be used at the top level, not within a function.
411 - This behavior is unlike Python.
412- The `use` builtin populates the new module with references to these values in
413 the calling module:
414 - [ENV][] - to mutate and set environment vars
415 - [PS4][] - for cross-module tracing in OSH
416
417[ENV]: chap-special-var.html#ENV
418[PS4]: chap-plugin.html#PS4
419
420Warnings:
421
422- `use` **copies** the module bindings into a new `Obj`. This means that if
423 you rebind `mymodule.my_integer`, it will **not** be visible to code in the
424 module.
425 - This behavior is unlike Python.
426- `use` allows "circular imports". That is `A.ysh` can `use B.ysh`, and vice
427 versa.
428 - To eliminate confusion over uninitialized names, use **only** `const`,
429 `func`, and `proc` at the top level of `my-module.ysh`. Don't run
430 commands, use `setvar`, etc.
431
432## I/O
433
434### ysh-read
435
436YSH adds long flags to shell's `read`. These two flags are fast and
437recommended:
438
439 read --all # whole file including trailing \n, fills $_reply
440 read --all (&x) # fills $x
441
442 read --num-bytes 3 # read N bytes, fills _reply
443 read --num-bytes 3 (&x) # fills $x
444
445---
446
447This flag replaces shell's `IFS= read -r` idiom, reading one byte a time in an
448unbuffered fashion:
449
450 read --raw-line # unbuffered read of line, omitting trailing \n
451 read --raw-line (&x) # fills $x
452
453 read --raw-line --with-eol # include the trailing \n
454
455A loop over [io.stdin][] allows buffered reading of lines, which is faster.
456
457[io.stdin]: chap-type-method.html#stdin
458
459You may want to use `fromJson8()` or `fromJson()` after reading a line.
460
461---
462
463The `-0` flag also reads one byte at a time:
464
465 read -0 # read until NUL, synonym for read -r -d ''
466
467Notes:
468
469- Unlike OSH [read](#read), none of these features remove NUL bytes.
470- Performance summary: [YSH Input/Output > Three Types of I/O][ysh-io-three]
471
472[ysh-io-three]: ../ysh-io.html#three-types-of-io
473
474<!--
475
476TODO:
477
478- read --netstr
479- io.stdin0 coudl be a buffered version of read -0 ?
480- JSON
481 - @() is related - it reads J8 lines
482 - JSON lines support?
483 - fromJ8Line() is different than from fromJson8() ? It's like @()
484
485-->
486
487<!--
488
489What about write? These would be the same:
490
491 write --json -- $s
492 write --j8 -- $s
493
494 write -- $[toJson(s)]
495 write -- $[toJson8(s)]
496
497 write --json -- @strs
498 write --j8 -- @strs
499
500 write -- @[toJson(s) for s in strs]
501 write -- @[toJson8(s) for s in strs]
502
503It's an argument for getting rid --json and --j8? I already implemented them,
504but it makes the API smaller.
505
506I guess the main thing would be to AVOID quoting sometimes?
507
508 $ write --j8 -- unquoted
509 unquoted
510
511 $ write --j8 -- $'\'' '"'
512 "'"
513 "\""
514
515I think this could be the shell style?
516
517 $ write --shell-str -- foo bar baz
518
519Or it could be
520
521 $ write -- @[toShellString(s) for s in strs]
522
523I want this to be "J8 Lines", but it can be done in pure YSH. It's not built
524into the interpreter.
525
526 foo/bar
527 "hi"
528b'hi'
529u'hi'
530
531But what about
532
533 Fool's Gold
534a'hi' # This feels like an error?
535a"hi" # what about this?
536
537Technically we CAN read those as literal strings
538-->
539
540### ysh-echo
541
542Print arguments to stdout, separated by a space.
543
544 ysh$ echo hi there
545 hi there
546
547The [simple_echo][] option means that flags aren't accepted, and `--` is not
548accepted.
549
550 ysh$ echo -n
551 -n
552
553See the [YSH FAQ entry on echo][echo-en] for details.
554
555[simple_echo]: chap-option.html#ysh:all
556[echo-en]: ../ysh-faq.html#how-do-i-write-the-equivalent-of-echo-e-or-echo-n
557
558### ysh-test
559
560The YSH [test](#test) builtin supports these long flags:
561
562 --dir same as -d
563 --exists same as -e
564 --file same as -f
565 --symlink same as -L
566
567 --true Is the argument equal to the string "true"?
568 --false Is the argument equal to the string "false"?
569
570The `--true` and `--false` flags can be used to combine commands and
571expressions:
572
573 if test --file a && test --true $[bool(mydict)] {
574 echo ok
575 }
576
577This works because the boolean `true` *stringifies* to `"true"`, and likewise
578with `false`.
579
580That is, `$[true] === "true"` and `$[false] === "false"`.
581
582### write
583
584write fixes problems with shell's `echo` builtin.
585
586The default separator is a newline, and the default terminator is a
587newline.
588
589Examples:
590
591 write -- ale bean # write two lines
592
593 write -n -- ale bean # synonym for --end '', like echo -n
594 write --sep '' --end '' -- a b # write 2 bytes
595 write --sep $'\t' --end $'\n' -- a b # TSV line
596
597You may want to use `toJson8()` or `toJson()` before writing:
598
599 write -- $[toJson8(mystr)]
600 write -- $[toJson(mystr)]
601
602
603<!--
604 write --json -- ale bean # JSON encode, guarantees two lines
605 write --j8 -- ale bean # J8 encode, guarantees two lines
606-->
607
608
609### fork
610
611Run a command, but don't wait for it to finish.
612
613 fork { sleep 1 }
614 wait -n
615
616In YSH, use `fork` rather than shell's `&` ([ampersand][]).
617
618[ampersand]: chap-cmd-lang.html#ampersand
619
620### forkwait
621
622The preferred alternative to shell's `()`. Prefer `cd` with a block if possible.
623
624 forkwait {
625 not_mutated=zzz
626 }
627 echo $not_mutated
628
629### redir
630
631Runs a block passed to it. It's designed to enable a **prefix** syntax when
632redirecting:
633
634 redir >out.txt {
635 echo 1
636 echo 2
637 }
638
639When a block is long, it's more readable than shell's postfix style:
640
641 { echo 1
642 echo 2
643 } >out.txt
644
645## Private
646
647Private builtins are not enabled by default:
648
649 sleep 0.1 # runs external process; private builtin not found
650 builtin sleep 0.1 # runs private builtin
651
652### cat
653
654`cat` is a *private* builtin that reads from files and writes to stdout.
655
656 cat FILE+ # Read from each file, and write to stdout
657 # If the file is -, read from stdin (not the file called -)
658 cat # equivalent to cat -
659
660- Related: [rewrite_extern][]
661
662[rewrite_extern]: chap-option.html#rewrite_extern
663
664### rm
665
666`rm` is a *private* builtin that removes files.
667
668 rm FLAG* FILE*
669
670Flags:
671
672 -f Don't fail if the file exist, and don't fail if no arguments are
673 passed.
674
675Return 0 on success, and non-zero otherwise.
676
677- Related: [rewrite_extern][]
678
679### sleep
680
681`sleep` is a *private* builtin that puts the shell process to sleep for the
682given number of seconds.
683
684Example:
685
686 builtin sleep 0.1 # wait 100 milliseconds
687
688It respects signals:
689
690- `SIGINT` / Ctrl-C cancels the command, with the standard behavior:
691 - in an interactive shell, you return to the prompt
692 - a non-interactive shell is cancelled
693- Upon receiving other signals, Oils run pending traps, and then continues to
694 sleep.
695
696It's compatible with the POSIX `sleep` utility:
697
698 sleep 2 # wait 2 seconds
699
700## Hay Config
701
702### hay
703
704### haynode
705
706
707## Data Formats
708
709### json
710
711Write JSON:
712
713 var d = {name: 'bob', age: 42}
714 json write (d) # default indent of 2, type errors
715 json write (d, space=0) # no indent
716 json write (d, type_errors=false) # non-serializable types become null
717 # (e.g. Obj, Proc, Eggex)
718
719Read JSON:
720
721 echo hi | json read # fills $_reply by default
722
723Or use an explicit place:
724
725 var x = ''
726 json read (&x) < myfile.txt
727
728Related: [err-json-encode][] and [err-json-decode][]
729
730[err-json-encode]: chap-errors.html#err-json-encode
731[err-json-decode]: chap-errors.html#err-json-decode
732
733### json8
734
735Like `json`, but on the encoding side:
736
737- Falls back to `b'\yff'` instead of lossy Unicode replacement char
738
739On decoding side:
740
741- Understands `b'' u''` strings
742
743Related: [err-json8-encode]() and [err-json8-decode]()
744
745[err-json8-encode]: chap-errors.html#err-json8-encode
746[err-json8-decode]: chap-errors.html#err-json8-decode
747
748## I/O
749
750These builtins take input and output. They're often used with redirects.
751
752### read
753
754 read FLAG* VAR*
755
756Read input from `stdin`, and assign pieces of input to variables. Without
757flags, `read` uses this algorithm:
758
7591. Read bytes from `stdin`, one at a time, until a newline `\n`.
760 - Respect `\` escapes and line continuations.
761 - Any NUL bytes are removed from the input.
7621. Use the `$IFS` algorithm to split the line into N pieces, where `N` is the
763 number of `VAR` specified. Each piece is assigned to the corresponding
764 variable.
765 - If no VARs are given, assign to the `$REPLY` var.
766
767The `-r` flag is useful to disable backslash escapes.
768
769POSIX mandates the slow behavior of reading one byte at a time. In YSH, you
770can avoid this by using [io.stdin][], or a `--long-flag` documented in
771[ysh-read](#ysh-read).
772
773Flags:
774
775 -a ARRAY assign the tokens to elements of this array
776 -d CHAR use DELIM as delimiter, instead of newline
777 -n NUM read up to NUM characters, respecting delimiters. When -r is not
778 specified, backslash escape of the form "\?" is counted as one
779 character. This is the Bash behavior, but other shells such as
780 ash and mksh count the number of bytes with "-n" without
781 considering backslash escaping.
782 -p STR print the string PROMPT before reading input
783 -r raw mode: don't let backslashes escape characters
784 -s silent: do not echo input coming from a terminal
785 -t NUM time out and fail after TIME seconds
786 -t 0 returns whether any input is available
787 -u FD read from file descriptor FD instead of 0 (stdin)
788
789 <!-- -N NUM read up to NUM characters, ignoring delimiters -->
790 <!-- -e use readline to obtain the line
791 -i STR use STR as the initial text for readline -->
792
793Performance summary: [YSH Input/Output > Three Types of I/O][ysh-io-three]
794
795### echo
796
797 echo FLAG* ARG*
798
799Prints ARGs to stdout, separated by a space, and terminated by a newline.
800
801Flags:
802
803 -e enable interpretation of backslash escapes
804 -n omit the trailing newline
805<!-- -E -->
806
807`echo` in YSH does **not** accept these flags. See [ysh-echo](#ysh-echo) and
808[the FAQ entry][echo-en]. (This is unusual because YSH doesn't usually "break"
809OSH.)
810
811See [char-escapes](chap-mini-lang.html#char-escapes) to see what's supported
812when `-e` is passed.
813
814### printf
815
816 printf FLAG* FMT ARG*
817
818Formats values and prints them. The FMT string contain three types of objects:
819
8201. Literal Characters
8212. Character escapes like `\t`. See [char-escapes](chap-mini-lang.html#char-escapes).
8223. Percent codes like `%s` that specify how to format each each ARG.
823
824If not enough ARGS are passed, the empty string is used. If too many are
825passed, the FMT string will be "recycled".
826
827Flags:
828
829 -v VAR Write output in variable VAR instead of standard output.
830
831Format specifiers:
832
833 %% Prints a single "%".
834 %b Interprets backslash escapes while printing.
835 %q Prints the argument escaping the characters needed to make it reusable
836 as shell input.
837 %d Print as signed decimal number.
838 %i Same as %d.
839 %o Print as unsigned octal number.
840 %u Print as unsigned decimal number.
841 %x Print as unsigned hexadecimal number with lower-case hex-digits (a-f).
842 %X Same as %x, but with upper-case hex-digits (A-F).
843 %f Print as floating point number.
844 %e Print as a double number, in "±e" format (lower-case e).
845 %E Same as %e, but with an upper-case E.
846 %g Interprets the argument as double, but prints it like %f or %e.
847 %G Same as %g, but print it like %E.
848 %c Print as a single char, only the first character is printed.
849 %s Print as string
850 %n The number of characters printed so far is stored in the variable named
851 in the argument.
852 %a Interprets the argument as double, and prints it like a C99 hexadecimal
853 floating-point literal.
854 %A Same as %a, but print it like %E.
855 %(FORMAT)T Prints date and time, according to FORMAT as a format string
856 for strftime(3). The argument is the number of seconds since
857 epoch. It can also be -1 (current time, also the default value
858 if there is no argument) or -2 (shell startup time).
859
860### readarray
861
862Alias for `mapfile`.
863
864### mapfile
865
866 mapfile FLAG* ARRAY?
867
868Reads lines from stdin into the variable named ARRAY (default
869`${MAPFILE[@]}`).
870
871Flags:
872
873 -t Remove the trailing newline from every line
874<!--
875 -d CHAR use CHAR as delimiter, instead of the default newline
876 -n NUM copy up to NUM lines
877 -O NUM begins copying lines at the NUM element of the array
878 -s NUM discard the first NUM lines
879 -u FD read from FD file descriptor instead of the standard input
880 -C CMD run CMD every NUM lines specified in -c
881 -c NUM every NUM lines, the CMD command in C will be run
882-->
883
884## Run Code
885
886These builtins accept shell code and run it.
887
888### source
889
890 source SCRIPT ARG*
891
892Execute SCRIPT with the given ARGs, in the context of the current shell. That is,
893existing variables will be modified.
894
895---
896
897Oils extension: If the SCRIPT starts with `///`, we look for scripts embedded in
898the `oils-for-unix` binary. Example:
899
900 source ///osh/two.sh # load embedded script
901
902 : ${LIB_OSH=fallback/dir}
903 source $LIB_OSH/two.sh # same thing
904
905The [LIB_OSH][] form is useful for writing a script that works under both bash
906and OSH.
907
908- Related: the [cat-em][] tool prints embedded scripts.
909
910[LIB_OSH]: chap-special-var.html#LIB_OSH
911[cat-em]: chap-front-end.html#cat-em
912
913
914### cmd/eval
915
916 eval ARG+
917
918Creates a string by joining ARGs with a space, then runs it as a shell command.
919
920Example:
921
922 # Create the string echo "hello $name" and run it.
923 a='echo'
924 b='"hello $name"'
925 eval $a $b
926
927Tips:
928
929- Using `eval` can confuse code and user-supplied data, leading to [security
930issues][].
931- Prefer passing single string ARG to `eval`.
932
933[security issues]: https://mywiki.wooledge.org/BashFAQ/048
934
935### trap
936
937The `trap` builtin lets you run shell code when events happen. Events are
938signals or shell interpreter hooks.
939
940These forms print the current `trap` state:
941
942 trap -l # List all events and their number
943 trap -p # Print the current trap state: events and handlers
944
945These forms modify the `trap` state:
946
947 trap CMD EVENT* # Register handler for the given events
948 trap - EVENT* # Remove handler for the given events (SIG_DFL)
949 trap '' EVENT* # Do nothing for the given events (SIG_IGN)
950
951Examples:
952
953 trap 'echo hi' EXIT INT # Register
954 trap - EXIT INT # Remove
955 trap '' EXIT INT # Ignore
956
957OSH also support legacy syntax, which is not recommended:
958
959 trap 'echo hi' 0 # 0 is the exit trap
960 trap INT # remove signal handler
961 trap 0 # remove exit trap
962 trap 0 INT # remove both
963
964Tips:
965
966- Prefer passing the name of a shell function to `trap`.
967 - See [ysh-trap](#ysh-trap) for even nicer idioms.
968- See [Chapter: Plugins and Hooks > Traps](chap-plugin.html#Traps) for a list
969 of traps, like `trap '' EXIT`.
970
971### ysh-trap
972
973The `trap` builtin lets you run shell code when events happen. YSH improves
974the syntax of the trap builtin, and removes legacy.
975
976These forms print the current `trap` state:
977
978 trap -l # List all events and their number
979 trap -p # Print the current trap state: events and handlers
980
981These forms modify the `trap` state:
982
983 trap --add EVENT* BLOCK # Register handlers
984 trap --remove EVENT* # Remove handlers (SIG_DFL)
985 trap --ignore EVENT* # Remove handlers (SIG_IGN)
986
987Examples:
988
989 trap --add EXIT INT {
990 echo 'either exit'
991 echo 'or int'
992 }
993
994 trap --remove EXIT INT
995 trap --ignore EXIT INT
996
997Note: the block argument to `trap --add` doesn't capture variables -- it's not
998a closure. So YSH behaves like OSH, but the syntax doesn't encourage putting
999source code in strings.
1000
1001## Set Options
1002
1003The `set` and `shopt` builtins set global shell options. YSH code should use
1004the more natural `shopt`.
1005
1006### set
1007
1008 set FLAG* ARG*
1009
1010Sets global shell options. Short style:
1011
1012 set -e
1013
1014Long style:
1015
1016 set -o errexit
1017
1018Set the arguments array:
1019
1020 set -- 1 2 3
1021
1022See [Chapter: Global Shell Options](chap-option.html) for a list of options.
1023
1024### shopt
1025
1026 shopt FLAG* OPTION* BLOCK?
1027
1028Sets global shell options.
1029
1030Flags:
1031
1032 -s --set Turn the named options on
1033 -u --unset Turn the named options off
1034 -p Print option values, and 1 if any option is unset
1035 -o Use older set of options, normally controlled by 'set -o'
1036 -q Return 0 if the option is true, else 1
1037
1038This command is compatible with `shopt` in bash. See [ysh-shopt](#ysh-shopt) for
1039details on YSH enhancements.
1040
1041See [Chapter: Global Shell Options](chap-option.html) for a list of options.
1042
1043## Working Dir
1044
1045These 5 builtins deal with the working directory of the shell.
1046
1047### cd
1048
1049 cd FLAG* DIR
1050
1051Changes the working directory of the current shell process to DIR.
1052
1053If DIR isn't specified, change to `$HOME`. If DIR is `-`, change to `$OLDPWD`
1054(a variable that the sets to the previous working directory.)
1055
1056Flags:
1057
1058 -L Follow symbolic links, i.e. change to the TARGET of the symlink.
1059 (default).
1060 -P Don't follow symbolic links.
1061
1062### chdir
1063
1064`chdir` is a synonym for `cd`. Shells like `busybox ash` support it, so OSH
1065does too.
1066
1067### pwd
1068
1069 pwd FLAG*
1070
1071Prints the current working directory.
1072
1073Flags:
1074
1075 -L Follow symbolic links if present (default)
1076 -P Don't follow symbolic links. Print the link instead of the target.
1077
1078### pushd
1079
1080<!--pushd FLAGS DIR-->
1081 pushd DIR
1082<!--pushd +/-NUM-->
1083
1084Add DIR to the directory stack, then change the working directory to DIR.
1085Typically used with `popd` and `dirs`.
1086
1087<!--FLAGS:
1088 -n Don't change the working directory, just manipulate the stack
1089NUM:
1090 Rotates the stack the number of places specified. Eg, given the stack
1091 '/foo /bar /baz', where '/foo' is the top of the stack, pushd +1 will move
1092 it to the bottom, '/bar /baz /foo'-->
1093
1094### popd
1095
1096 popd
1097
1098Removes a directory from the directory stack, and changes the working directory
1099to it. Typically used with `pushd` and `dirs`.
1100
1101### dirs
1102
1103 dirs FLAG*
1104
1105Shows the contents of the directory stack. Typically used with `pushd` and
1106`popd`.
1107
1108Flags:
1109
1110 -c Clear the dir stack.
1111 -l Show the dir stack, but with the real path instead of ~.
1112 -p Show the dir stack, but formatted as one line per entry.
1113 -v Like -p, but numbering each line.
1114
1115## Completion
1116
1117These builtins implement our bash-compatible autocompletion system.
1118
1119### complete
1120
1121Registers completion policies for different commands.
1122
1123### compgen
1124
1125Generates completion candidates inside a user-defined completion function.
1126
1127It can also be used in scripts, i.e. outside a completion function.
1128
1129### compopt
1130
1131Changes completion options inside a user-defined completion function.
1132
1133### compadjust
1134
1135Adjusts `COMP_ARGV` according to specified delimiters, and optionally set
1136variables cur, prev, words (an array), and cword. May also set 'split'.
1137
1138This is an OSH extension that makes it easier to run the bash-completion
1139project.
1140
1141### compexport
1142
1143Complete an entire shell command string. For example,
1144
1145 compexport -c 'echo $H'
1146
1147will complete variables like `$HOME`. And
1148
1149 compexport -c 'ha'
1150
1151will complete builtins like `hay`, as well as external commands.
1152
1153
1154## Shell Process
1155
1156These builtins mutate the state of the shell process.
1157
1158### exec
1159
1160 exec BIN_PATH ARG*
1161
1162Replaces the running shell with the binary specified, which is passed ARGs.
1163BIN_PATH must exist on the file system; i.e. it can't be a shell builtin or
1164function.
1165
1166### umask
1167
1168 umask MODE?
1169
1170Sets the bit mask that determines the permissions for new files and
1171directories. The mask is subtracted from 666 for files and 777 for
1172directories.
1173
1174Oils currently supports writing masks in octal.
1175
1176If no MODE, show the current mask.
1177
1178### ulimit
1179
1180 ulimit --all
1181 ulimit -a
1182 ulimit FLAGS* -RESOURCE_FLAG VALUE?
1183
1184 ulimit FLAGS* VALUE? # discouraged
1185
1186Show and modify process resource limits.
1187
1188Flags:
1189
1190 -S for soft limit
1191 -H for hard limit
1192
1193 -c -d -f ... # ulimit --all shows all resource flags
1194
1195Show a table of resources:
1196
1197 ulimit --all
1198 ulimit -a
1199
1200For example, the table shows that `-n` is the flag that controls the number
1201file descriptors, the soft and hard limit for `-n`, and the multiplication
1202"factor" for the integer VALUE you pass.
1203
1204---
1205
1206Here are examples of using resource flags.
1207
1208Get the soft limit for the number of file descriptors:
1209
1210 ulimit -S -n
1211 ulimit -n # same thing
1212
1213Get the hard limit:
1214
1215 ulimit -H -n
1216
1217Set the soft or hard limit:
1218
1219 ulimit -S -n 100
1220 ulimit -H -n 100
1221
1222Set both limits:
1223
1224 ulimit -n 100
1225
1226A special case that's discouraged: with no resource flag, `-f` is assumed:
1227
1228 ulimit # equivalent to ulimit -f
1229 ulimit 100 # equivalent to ulimit -f 100
1230
1231### times
1232
1233 times
1234
1235Shows the user and system time used by the shell and its child processes.
1236
1237## Child Process
1238
1239### jobs
1240
1241 jobs
1242
1243Shows all jobs running in the shell and their status.
1244
1245### wait
1246
1247Wait for jobs to finish, in a few different ways. (A job is a process or a
1248pipeline.)
1249
1250 wait # no arguments
1251
1252Wait for all jobs to terminate. The exit status is 0, unless a signal occurs.
1253
1254 wait -n
1255
1256Wait for the next job to terminate, and return its status.
1257
1258 wait $pid1 $pid2 ...
1259
1260Wait for the jobs specified by PIDs to terminate. Return the status of the
1261last one.
1262
1263 wait %3 %2 ...
1264
1265Wait for the jobs specified by "job specs" to terminate. Return the status of
1266the last one.
1267
1268---
1269
1270If wait is interrupted by a signal, the exit status is the signal number + 128.
1271
1272---
1273
1274When using `set -e` aka `errexit`, `wait --all` is useful. See topic
1275[ysh-wait](#ysh-wait).
1276
1277<!--
1278The ARG can be a PID (tracked by the kernel), or a job number (tracked by the
1279shell). Specify jobs with the syntax `%jobnumber`.
1280-->
1281
1282### ysh-wait
1283
1284YSH extends the `wait` builtin with 2 flags:
1285
1286 wait --all # wait for all jobs, like 'wait'
1287 # but exit 1 if any job exits non-zero
1288
1289 wait --verbose # show a message on each job completion
1290
1291 wait --all --verbose # show a message, and also respect failure
1292
1293### fg
1294
1295 fg JOB?
1296
1297Continues a stopped job in the foreground. This means it can receive signals
1298from the keyboard, like Ctrl-C and Ctrl-Z.
1299
1300If no JOB is specified, use the latest job.
1301
1302### bg
1303
1304UNIMPLEMENTED
1305
1306 bg JOB?
1307
1308Continues a stopped job, while keeping it in the background. This means it
1309**can't** receive signals from the keyboard, like Ctrl-C and Ctrl-Z.
1310
1311If no JOB is specified, use the latest job.
1312
1313### kill
1314
1315The `kill` builtin sends a signal to one or more processes. Usage:
1316
1317 kill (-s SIG | -SIG)? WHAT+ # send SIG to the given processes
1318
1319where
1320
1321 SIG = NAME | NUMBER # e.g. USR1 or 10
1322 WHAT = PID | JOBSPEC # e.g. 789 or %%
1323
1324Examples:
1325
1326 kill -s USR1 789 # send SIGUSR1 to PID 789
1327
1328 kill -s USR1 789 %% # send signal to PID 789 and the current job
1329 kill -s 10 789 %% # specify SIGUSR1 by number instead
1330
1331 kill -USR1 789 %% # shortcut syntax
1332 kill -10 789 %% # shortcut using a number
1333
1334 kill -n USR1 789 %% # -n is a synonym for -s
1335 kill 789 %% # if not specified, the default is SIGTERM
1336
1337---
1338
1339It can also list signals:
1340
1341 kill -L # List all signals
1342 kill -L SIG+ # Translate signals from name to number, and vice versa
1343
1344Examples:
1345
1346 kill -l # List all signals; -l is a synonym for -L
1347 kill -L USR1 USR2 # prints '10 12'
1348 kill -L USR1 15 # prints '10 TERM'
1349 kill -L 134 # you can also pass exit codes, this prints 'ABRT'
1350
1351## External
1352
1353### test
1354
1355 test OP ARG
1356 test ARG OP ARG
1357 [ OP ARG ] # [ is an alias for test that requires closing ]
1358 [ ARG OP ARG ]
1359
1360Evaluates a conditional expression and returns 0 (true) or 1 (false).
1361
1362Note that `[` is the name of a builtin, not an operator in the language. Use
1363`test` to avoid this confusion.
1364
1365String expressions:
1366
1367 -n STR True if STR is not empty.
1368 'test STR' is usually equivalent, but discouraged.
1369 -z STR True if STR is empty.
1370 STR1 = STR2 True if the strings are equal.
1371 STR1 != STR2 True if the strings are not equal.
1372 STR1 < STR2 True if STR1 sorts before STR2 lexicographically.
1373 STR1 > STR2 True if STR1 sorts after STR2 lexicographically.
1374 Note: < and > should be quoted like \< and \>
1375
1376File expressions:
1377
1378 -a FILE Synonym for -e.
1379 -b FILE True if FILE is a block special file.
1380 -c FILE True if FILE is a character special file.
1381 -d FILE True if FILE is a directory.
1382 -e FILE True if FILE exists.
1383 -f FILE True if FILE is a regular file.
1384 -g FILE True if FILE has the sgid bit set.
1385 -G FILE True if current user's group is also FILE's group.
1386 -h FILE True if FILE is a symbolic link.
1387 -L FILE True if FILE is a symbolic link.
1388 -k FILE True if FILE has the sticky bit set.
1389 -O FILE True if current user is the file owner.
1390 -p FILE True if FILE is a named pipe (FIFO).
1391 -r FILE True if FILE is readable.
1392 -s FILE True if FILE has size bigger than 0.
1393 -S FILE True if FILE is a socket file.
1394 -t FD True if file descriptor FD is open and refers to a terminal.
1395 -u FILE True if FILE has suid bit set.
1396 -w FILE True if FILE is writable.
1397 -x FILE True if FILE is executable.
1398 FILE1 -nt FILE2 True if FILE1 is newer than FILE2 (mtime).
1399 FILE1 -ot FILE2 True if FILE1 is older than FILE2 (mtime).
1400 FILE1 -ef FILE2 True if FILE1 is a hard link to FILE2.
1401<!-- -N FILE True if FILE was modified since last read (mtime newer than atime).-->
1402
1403Arithmetic expressions coerce arguments to integers, then compare:
1404
1405 INT1 -eq INT2 True if they're equal.
1406 INT1 -ne INT2 True if they're not equal.
1407 INT1 -lt INT2 True if INT1 is less than INT2.
1408 INT1 -le INT2 True if INT1 is less or equal than INT2.
1409 INT1 -gt INT2 True if INT1 is greater than INT2.
1410 INT1 -ge INT2 True if INT1 is greater or equal than INT2.
1411
1412Other expressions:
1413
1414 -o OPTION True if the shell option OPTION is set.
1415 -v VAR True if the variable VAR is set.
1416
1417The test builtin also supports POSIX conditionals like -a, -o, !, and ( ), but
1418these are discouraged.
1419
1420<!-- -R VAR True if the variable VAR has been set and is a nameref variable. -->
1421
1422---
1423
1424See [ysh-test](#ysh-test) for log flags like `--file` and `--true`.
1425
1426### getopts
1427
1428 getopts SPEC VAR ARG*
1429
1430A single iteration of flag parsing. The SPEC is a sequence of flag characters,
1431with a trailing `:` to indicate that the flag takes an argument:
1432
1433 ab # accept -a and -b
1434 xy:z # accept -x, -y arg, and -z
1435
1436The input is `"$@"` by default, unless ARGs are passed.
1437
1438On each iteration, the flag character is stored in VAR. If the flag has an
1439argument, it's stored in `$OPTARG`. When an error occurs, VAR is set to `?`
1440and `$OPTARG` is unset.
1441
1442Returns 0 if a flag is parsed, or 1 on end of input or another error.
1443
1444Example:
1445
1446 while getopts "ab:" flag; do
1447 case $flag in
1448 a) flag_a=1 ;;
1449 b) flag_b=$OPTARG" ;;
1450 '?') echo 'Invalid Syntax'; break ;;
1451 esac
1452 done
1453
1454Notes:
1455- `$OPTIND` is initialized to 1 every time a shell starts, and is used to
1456 maintain state between invocations of `getopts`.
1457- The characters `:` and `?` can't be flags.
1458
1459
1460## Conditional
1461
1462### cmd/true
1463
1464Do nothing and return status 0.
1465
1466 if true; then
1467 echo hello
1468 fi
1469
1470### cmd/false
1471
1472Do nothing and return status 1.
1473
1474 if false; then
1475 echo 'not reached'
1476 else
1477 echo hello
1478 fi
1479
1480<h3 id="colon" class="osh-topic">colon :</h3>
1481
1482Like `true`: do nothing and return status 0.
1483
1484## Introspection
1485
1486<h3 id="help" class="osh-topic ysh-topic" oils-embed="1">
1487 help
1488</h3>
1489
1490<!-- pre-formatted for help builtin -->
1491
1492```
1493Usage: help TOPIC?
1494
1495Examples:
1496
1497 help # this help
1498 help echo # help on the 'echo' builtin
1499 help command-sub # help on command sub $(date)
1500
1501 help oils-usage # identical to oils-for-unix --help
1502 help osh-usage # osh --help
1503 help ysh-usage # ysh --help
1504```
1505
1506### hash
1507
1508 hash
1509
1510Display information about remembered commands.
1511
1512 hash FLAG* CMD+
1513
1514Determine the locations of commands using `$PATH`, and remember them.
1515
1516Flag:
1517
1518 -r Discard all remembered locations.
1519<!-- -d Discard the remembered location of each NAME.
1520 -l Display output in a format reusable as input.
1521 -p PATH Inhibit path search, PATH is used as location for NAME.
1522 -t Print the full path of one or more NAME.-->
1523
1524### cmd/type
1525
1526 type FLAG* NAME+
1527
1528Print the type of each NAME, if it were the first word of a command. Is it a
1529shell keyword, builtin command, shell function, alias, or executable file on
1530$PATH?
1531
1532Flags:
1533
1534 -a Show all possible candidates, not just the first one
1535 -f Don't search for shell functions
1536 -P Only search for executable files
1537 -t Print a single word: alias, builtin, file, function, proc, keyword
1538
1539Note: [`invoke --show`][invoke] is more general than `type`.
1540
1541Similar names: [type][]
1542
1543[type]: chap-index.html#type
1544
1545<!-- TODO:
1546- procs are counted as shell functions, should be their own thing
1547- Hay nodes ('hay define x') also live in the first word namespace, and should
1548 be recognized
1549-->
1550
1551Modeled after the [bash `type`
1552builtin](https://www.gnu.org/software/bash/manual/bash.html#index-type).
1553
1554## Word Lookup
1555
1556### invoke
1557
1558The `invoke` builtin allows more control over name lookup than [simple
1559commands][simple-command].
1560
1561[simple-command]: chap-cmd-lang.html#simple-command
1562
1563Usage:
1564
1565 invoke --show NAME* # Show info about EACH name
1566 invoke NAMESPACE_FLAG+ ARG* # Run a single command with this arg array
1567
1568Namespace flags:
1569
1570 --proc Run YSH procs
1571 including invokable obj
1572 --sh-func Run shell functions
1573 --builtin Run builtin commands (of any kind)
1574 eval : POSIX special
1575 cd : normal
1576 sleep: private (Oils)
1577 --extern Run external commands, like /bin/ls
1578
1579Multiple namespace flags may be passed. They are searched in that order:
1580procs, shell functions, builtins, then extern. The first one wins. (This is
1581different than [command-lookup-order][].)
1582
1583[command-lookup-order]: chap-cmd-lang.html#command-lookup-order
1584
1585If the name isn't found, then `invoke` returns status 127.
1586
1587---
1588
1589Run `invoke --show NAME` to see all categories a name is found in.
1590
1591- The `--show` flag respects the [command-lookup-order][]
1592- Shell keywords and aliases are shown, but `invoke` doesn't run them.
1593
1594---
1595
1596Examples:
1597
1598 invoke ls # usage error: no namespace flags
1599
1600 invoke --builtin echo hi # like builtin echo hi
1601 invoke --builtin --extern ls /tmp # like command ls /tmp (no function lookup)
1602
1603 invoke --show true sleep ls # similar to type -a true sleep ls
1604
1605Related:
1606
1607- [builtin][] - like `--builtin`
1608- [command][] - like `--builtin --extern`
1609- [runproc][] - like `--proc --sh-func`
1610- [type][cmd/type] - like `--show`
1611
1612[builtin]: chap-builtin-cmd.html#builtin
1613[command]: chap-builtin-cmd.html#command
1614[runproc]: chap-builtin-cmd.html#runproc
1615[cmd/type]: chap-builtin-cmd.html#cmd/type
1616[command-lookup-order]: chap-cmd-lang.html#command-lookup-order
1617
1618### runproc
1619
1620Runs a named proc with the given arguments. It's often useful as the only top
1621level statement in a "task file":
1622
1623 proc p {
1624 echo hi
1625 }
1626 runproc @ARGV
1627
1628Like 'builtin' and 'command', it affects the lookup of the first word.
1629
1630### command
1631
1632 command FLAG* CMD ARG*
1633
1634Look up CMD as a shell builtin or executable file, and execute it with the
1635given ARGs.
1636
1637Flags:
1638
1639 -v Instead of executing CMD, print a description of it.
1640<!-- -p Use a default value for PATH that is guaranteed to find all of the
1641 standard utilities.
1642 -V Print a more verbose description of CMD.-->
1643
1644Note: [`invoke --show`][invoke] is more general than `command -v`.
1645
1646[invoke]: chap-builtin-cmd.html#invoke
1647
1648### builtin
1649
1650 builtin CMD ARG*
1651
1652Look up CMD as a shell builtin, and execute it with the given ARGs.
1653
1654## Interactive
1655
1656### alias
1657
1658 alias NAME=CODE
1659
1660Make NAME a shortcut for executing CODE, e.g. `alias hi='echo hello'`.
1661
1662 alias NAME
1663
1664Show the value of this alias.
1665
1666 alias
1667
1668Show a list of all aliases.
1669
1670Tips:
1671
1672Prefer shell functions like:
1673
1674 ls() {
1675 command ls --color "$@"
1676 }
1677
1678to aliases like:
1679
1680 alias ls='ls --color'
1681
1682Functions are less likely to cause parsing problems.
1683
1684- Quoting like `\ls` or `'ls'` disables alias expansion
1685- To remove an existing alias, use [unalias](chap-builtin-cmd.html#unalias).
1686
1687### unalias
1688
1689 unalias NAME
1690
1691Remove the alias NAME.
1692
1693<!--Flag:
1694
1695 -a Removes all existing aliases.-->
1696
1697### history
1698
1699 history FLAG*
1700
1701Display and manipulate the shell's history entries.
1702
1703 history NUM
1704
1705Show the last NUM history entries.
1706
1707Flags:
1708
1709 -c Clears the history.
1710 -d POS Deletes the history entry at position POS.
1711<!-- -a
1712 -n
1713 -r
1714 -w
1715 -p
1716 -s -->
1717
1718### fc
1719
1720 fc FLAG* FIRST? LAST?
1721
1722"Fix a command" from the shell's history.
1723
1724`fc -l` displays commands. FIRST and LAST specify a range of command numbers,
1725where:
1726
1727- A positive number is an index into the history list.
1728- A negative number is an offset from the current command.
1729- If FIRST is omitted, the value `-16` is used.
1730- If LAST is omitted, the current command is used.
1731
1732Flags:
1733
1734 -l List commands (rather than editing)
1735 -n Omit line numbers
1736 -r Use reverse order (newest first)
1737
1738<!--
1739Not implemented
1740
1741-e EDITOR
1742-s
1743-->
1744
1745## Unsupported
1746
1747### enable
1748
1749Bash has this, but OSH won't implement it.
1750