v0.20.0

[0.20.0] - 2024-04-08

• Show stdout, stderr when system command fails.

• Support matching stdout for system

  system ok
  echo "Hello, world!"
  ----
  Hello, world!
  

  Currently, only exact match is supported. Besides, the output cannot contain more than one blank lines in between. The record ends with two consecutive blank lines.

  Some minor Breaking changes:

  • Add field stdout to parser::Record::System and runner::RecordOutput::System, and mark them as #[non_exhaustive].
  • Change trait method AsyncDB::run_command's return type from std::process::ExitStatus to std::process::Output.

v0.19.1

[0.19.1] - 2024-01-04

• parser: include now returns error if no file is matched.

v0.19.0

[0.19.0] - 2023-11-11

• parser: refactor expect field in sqllogictest parser to make it easier to work with.

v0.18.0

[0.18.0] - 2023-11-08

• Support matching multiline error message under ---- for both statement error and query error.

  query error
  SELECT 1/0;
  ----
  db error: ERROR: Failed to execute query
  
  Caused by these errors:
    1: Failed to evaluate expression: 1/0
    2: Division by zero
  

  The output error message must be the exact match of the expected one to pass the test, except for the leading and trailing whitespaces. Users may use --override to let the runner update the test files with the actual output.

  Empty lines are allowed in the expected error message. As a result, the message must end with two consecutive empty lines.

  Breaking changes in the parser:

  • Add new variants to ParseErrorKind. Mark it as #[non_exhaustive].
  • Change the type of expected_error from Regex to ExpectedError, which is either a inline Regex or multiline String.

v0.17.2

[0.17.2] - 2023-11-01

• fix(runner): fix parallel testing db name duplication. Now we use full file path instead of filename as the temporary db name in run_parallel_async.

v0.17.1

[0.17.1] - 2023-09-20

• bin: support envvars SLT_HOST/PORT/DB/USER/PASSWORD

v0.17.0

[0.17.0] - 2023-09-19

• Support environment variables substituion for SQL and system commands.
  For compatibility, this feature is by default disabled, and can be enabled by adding control substitution on to the test file.

  control substitution on
  
  query TTTT
  SELECT
      '$foo'                -- short
    , '${foo}'              -- long
    , '${bar:default}'      -- default value
    , '${bar:$foo-default}' -- recursive default value
  FROM baz;
  ----
  ...
  

  Besides, there's a special variable $__TEST_DIR__ which is the path to a temporary directory specific to the current test case.
  This can be helpful if you need to manipulate some external resources during the test.

  control substitution on
  
  statement ok
  COPY (SELECT * FROM foo) TO '$__TEST_DIR__/foo.txt';
  
  system ok
  echo "foo" > "$__TEST_DIR__/foo.txt"
  

  Changes:

  • (parser) Breaking change: Add Control::Substitution. Mark Control as #[non_exhaustive].
  • (runner) Breaking change: Remove enable_testdir. For migration, one should now enable general substitution by the control statement and use a dollar-prefixed $__TEST_DIR__.

v0.16.0

[0.16.0] - 2023-09-15

• Support running external system commands with the syntax below. This is useful for manipulating some external resources during the test.

  system ok
  echo "Hello, world!"
  

  The runner will check the exit code of the command, and the output will be ignored. Currently, only ok is supported.

  Changes:

  • (parser) Breaking change: Add Record::System, and corresponding TestErrorKind and RecordOutput. Mark TestErrorKind and RecordOutput as #[non_exhaustive].
  • (runner) Add run_command to AsyncDB trait. The default implementation will run the command with std::process::Command::status. Implementors can override this method to utilize an asynchronous runtime such as tokio.

• fix(runner): fix database name duplication for parallel tests by using the full path of the test file (instead of the file name) as the database name.

v0.15.3

[0.15.3] - 2023-08-02

• fix(bin): fix error context display. To avoid stack backtrace being printed, unset RUST_BACKTRACE environment variable, or use pre-built binaries built with stable toolchain instead.

Release: v0.15.2

• fix(bin): do not print stack backtrace on error