Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🪲 Considerable number of tests failing #2132

Closed
joocer opened this issue Dec 18, 2024 · 10 comments
Closed

🪲 Considerable number of tests failing #2132

joocer opened this issue Dec 18, 2024 · 10 comments
Labels
Bug 🪲 Something isn't working

Comments

@joocer
Copy link
Contributor

joocer commented Dec 18, 2024

changes to the execution engine have led to broad failures across the regression suite - the failures are so catastrophic that the suite currently doesn't run.

this should have been done in a feature branch before being merged to main.

@joocer joocer added the Bug 🪲 Something isn't working label Dec 18, 2024
joocer added a commit that referenced this issue Dec 18, 2024
joocer added a commit that referenced this issue Dec 19, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 19, 2024

147 failed, 4608 passed, 75 warnings in 406.14s (0:06:46)

@joocer
Copy link
Contributor Author

joocer commented Dec 19, 2024

New tests have been added to the SQLite suite.

119 failed, 4719 passed, 75 warnings in 291.23s (0:04:51)

joocer added a commit that referenced this issue Dec 19, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 20, 2024

103 failed, 4811 passed, 75 warnings in 430.09s (0:07:10)

joocer added a commit that referenced this issue Dec 20, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 20, 2024

90 failed, 4824 passed, 75 warnings in 281.83s (0:04:41)

joocer added a commit that referenced this issue Dec 20, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 20, 2024

TPCH regression suite failing x3
Memcached suite failing x1
Syntax suite failing x1
Short suite failing for the rest

Down to four suites with failures (of about 50)

79 failed, 4835 passed, 75 warnings in 297.06s (0:04:57)

joocer added a commit that referenced this issue Dec 20, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 20, 2024

30 failed, 4885 passed, 79 warnings in 385.99s (0:06:25)

joocer added a commit that referenced this issue Dec 20, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 20, 2024

19 failed, 4896 passed, 79 warnings in 314.54s (0:05:14)

All in the Short Suite (which is about 1900 tests)

joocer added a commit that referenced this issue Dec 20, 2024
joocer added a commit that referenced this issue Dec 20, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 20, 2024

6 failed, 4907 passed, 90 warnings in 338.02s (0:05:38)

Just straggler edge cases left.

joocer added a commit that referenced this issue Dec 20, 2024
joocer added a commit that referenced this issue Dec 21, 2024
@joocer
Copy link
Contributor Author

joocer commented Dec 21, 2024

100% pass locally, checking the same result on GitHub Actions.

@joocer
Copy link
Contributor Author

joocer commented Dec 21, 2024

Mac suite runs with 100% pass rate, Ubuntu test doesn't load, suspect it's a problem with valkey.

joocer added a commit that referenced this issue Dec 21, 2024
joocer added a commit that referenced this issue Dec 21, 2024
joocer added a commit that referenced this issue Dec 21, 2024
joocer added a commit that referenced this issue Dec 21, 2024
@joocer joocer closed this as completed Dec 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug 🪲 Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant