SQL Smith Awareness of Stream User Errors

[jon-chuang]

Is your feature request related to a problem? Please describe.

Currently, we are only aware of batch errors. Once we have stream errors collection setup, SQL smith should report those errors to us.

To do so, we should fail CI if there are ANY errors not in the ignore list (user error whitelist).

Then, we should print out a list of all the error types and messages that occured. Unfortunately, according to the current plan, we may not be able to get a backtrace.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

[fuyufjh]

👀 Does SQL smith support streaming queries?

[jon-chuang]

It does. cc @kwannoel

To my understanding, we construct some base tables, MVs, and then several streaming queries and batch queries on top of these in a sequential fashion.

[kwannoel]

It does. cc @kwannoel

To my understanding, we construct some base tables, MVs, and then several streaming queries and batch queries on top of these in a sequential fashion.

Yes that is correct.