Python vs C++

Here is the total number of passing tests. TODO: we should also verify tests that do not pass.

Another view: index.html.

name osh py osh cpp delta cpp num failed cpp failures allowed
TOTAL 2,450 2,271 179 0 0
alias 43 38 5 5 0
append 19 19 0 0 0
arg-parse 3 3 0 0 0
arith 71 70 1 1 0
arith-context 16 16 0 0 0
arith-dynamic 1 1 0 3 3
array 76 74 2 4 2
array-assign 1 1 0 9 9
array-assoc 38 37 1 3 2
array-basic 5 5 0 0 0
array-compat 7 7 0 2 2
array-literal 19 18 1 1 0
array-sparse 40 38 2 2 2
assign 47 43 4 4 0
assign-deferred 4 4 0 5 5
assign-dialects 1 1 0 3 3
assign-extended 36 34 2 3 1
background 24 22 2 5 4
ble-features 5 5 0 0 0
ble-idioms 21 21 0 5 5
ble-unset 3 3 0 0 0
blog1 5 4 1 1 0
blog2 8 8 0 0 0
bool-parse 7 7 0 1 1
brace-expansion 51 50 1 1 0
bugs 27 25 2 2 0
builtin-bash 9 9 0 4 4
builtin-bind 9 2 7 7 7
builtin-bracket 52 52 0 0 0
builtin-cd 27 20 7 10 3
builtin-completion 48 47 1 4 3
builtin-dirs 18 17 1 1 0
builtin-echo 27 27 0 0 0
builtin-eval-source 23 22 1 1 0
builtin-fc 12 12 0 2 2
builtin-getopts 28 28 0 3 3
builtin-history 7 9 -2 7 7
builtin-kill 17 17 0 2 2
builtin-meta 18 17 1 1 0
builtin-meta-assign 11 11 0 0 0
builtin-misc 7 6 1 1 0
builtin-printf 48 42 6 9 1
builtin-process 25 23 2 5 3
builtin-read 62 59 3 4 1
builtin-set 23 22 1 1 0
builtin-special 10 10 0 0 0
builtin-times 1 0 1 1 0
builtin-trap 29 27 2 4 2
builtin-trap-bash 16 15 1 3 2
builtin-trap-err 20 16 4 6 2
builtin-type 6 6 0 0 0
builtin-type-bash 29 29 0 0 0
builtin-vars 37 36 1 2 1
case_ 12 10 2 2 0
command-parsing 2 2 0 0 0
command-sub 30 19 11 11 0
command-sub-ksh 0 0 0 4 4
command_ 15 15 0 0 0
comments 2 2 0 0 0
dbracket 49 48 1 1 0
divergence 1 1 0 3 3
dparen 14 13 1 1 0
empty-bodies 3 3 0 0 0
errexit 35 34 1 1 0
errexit-osh 35 12 23 23 0
exit-status 11 9 2 2 0
explore-parsing 5 5 0 0 0
extglob-files 18 17 1 2 1
extglob-match 25 25 0 3 3
fatal-errors 5 5 0 0 0
for-expr 9 9 0 0 0
func-parsing 14 14 0 0 0
glob 35 35 0 4 3
glob-bash 7 7 0 0 0
globignore 18 18 0 0 0
globstar 1 1 0 4 4
here-doc 33 30 3 5 2
if_ 5 5 0 0 0
interactive 18 18 0 0 0
introspect 13 13 0 0 0
known-differences 2 2 0 0 0
let 0 0 0 0 0
loop 29 24 5 5 0
nameref 25 25 0 7 7
nix-idioms 5 5 0 0 0
nocasematch-match 6 6 0 0 0
nul-bytes 10 6 4 6 1
osh-bugs 4 2 2 2 0
paren-ambiguity 6 5 1 4 3
parse-errors 24 24 0 3 3
pipeline 24 24 0 1 1
posix 15 14 1 1 0
print-source-code 4 0 4 4 0
process-sub 9 0 9 9 0
prompt 25 21 4 12 8
quote 33 33 0 2 2
redir-order 5 5 0 0 0
redirect 38 35 3 5 2
redirect-command 23 18 5 5 0
redirect-multi 13 13 0 0 0
regex 37 37 0 0 0
serialize 7 6 1 2 0
sh-func 11 11 0 1 1
sh-options 37 37 0 1 1
sh-options-bash 6 6 0 2 2
sh-usage 16 15 1 1 0
smoke 18 16 2 2 0
strict-options 17 16 1 1 0
subshell 2 2 0 0 0
temp-binding 4 4 0 0 0
tilde 13 13 0 0 0
toysh 4 4 0 3 3
toysh-posix 19 19 0 2 2
type-compat 2 2 0 0 0
unicode 7 4 3 3 0
var-num 7 7 0 0 0
var-op-bash 18 18 0 7 7
var-op-len 8 5 3 4 1
var-op-patsub 26 26 0 2 2
var-op-slice 20 16 4 4 0
var-op-strip 29 29 0 0 0
var-op-test 34 34 0 0 0
var-ref 31 26 5 5 0
var-sub 6 5 1 1 0
var-sub-quote 41 41 0 0 0
vars-bash 0 0 0 1 1
vars-special 38 31 7 10 3
whitespace 3 0 3 5 0
word-eval 8 7 1 1 0
word-split 53 51 2 4 2
xtrace 15 15 0 1 1
zsh-assoc 0 0 0 0 0
zsh-idioms 1 1 0 2 0

Generated by test/spec-cpp.sh.

Raw TSV