Release v1.5.0
Changes
-
This release requires Go 1.19 to build.
-
Add quite a lot of new test.
-
Only "pass" an invalid test if the decoder exits with exactly exit 1, rather than any exit >0. This catches segfaults, panics, and other crashes which shouldn't be considered "passing".
-
Tests are now run in parallel, defaulting to the number of available cores. Use the
-parallel
flag to set the number of cores to use. -
Few small improvements to toml-test runner output.
New features
-
The
-copy
flag copies all tests to the given directory (taking the-toml
flag in to account). This is much easier than manually copying the files. -
Add
-errors
flag to test expected error messages for invalid tests. See-help
for details. -
Add
-print-skip
, to print out a small bash/zsh script with-skip
flags for tests that failed. Useful to get a list of "known failures" for CI integrations and such. -
Add
-timeout
flag to set the maximum execution time per test, to catch infinite loops and/or pathological cases. This defaults to 1s, but can probably be set (much) lower for most implementations. -
Add
-int-as-float
flag, for implementations that treat all numbers as floats. -
Add
-cat
flag to create a large (valid) TOML document, for benchmarks and such.