Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tracking: deterministic fuzzing test stability #7978

Closed
3 tasks
kwannoel opened this issue Feb 16, 2023 · 0 comments · Fixed by #8068
Closed
3 tasks

Tracking: deterministic fuzzing test stability #7978

kwannoel opened this issue Feb 16, 2023 · 0 comments · Fixed by #8068
Labels
priority/high type/feature
Milestone
release-0.18

Comments

@kwannoel
Copy link
Contributor

kwannoel commented Feb 16, 2023 •
edited
Loading

Track: #7901
@kwannoel kwannoel mentioned this issue Feb 16, 2023
Closed
@github-actions github-actions bot added this to the release-0.1.18 milestone Feb 16, 2023
@kwannoel kwannoel added priority/high help wanted Issues that need help from contributors labels Feb 16, 2023
@kwannoel kwannoel mentioned this issue Feb 16, 2023
Merged
6 tasks
@kwannoel kwannoel removed the help wanted Issues that need help from contributors label Feb 20, 2023
@kwannoel kwannoel mentioned this issue Feb 21, 2023
Merged
6 tasks
@mergify mergify bot closed this as completed in #8068 Feb 21, 2023
mergify bot pushed a commit that referenced this issue Feb 21, 2023
@kwannoel
feat(sqlsmith): use ChaChaRng for determinism (#8068)
fbaf524 
- Use a reproducible prng so that deterministic fuzz test results can be reproduced locally too.
- Adds dependency of `rand_chacha`.

<img width="1127" alt="Screenshot 2023-02-21 at 10 45 11 AM" src="https://user-images.githubusercontent.com/47273164/220234742-363d7c87-6ebc-4ce0-8877-3d5250b2f0ce.png">

closes #7978

Approved-By: wangrunji0408
Approved-By: jon-chuang

Co-Authored-By: Noel Kwan <noelkwan1998@gmail.com>
Co-Authored-By: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
mergify bot pushed a commit that referenced this issue Feb 24, 2023
@kwannoel
feat(sqlsmith, deterministic-test): deterministic fuzz stability (#7967)
d257b5f 
#7978

- Adds 32 different sets of ddl + queries. This is run by deterministic test.
- Daily cron will still run the usual seeded deterministic test.
- PR and main workflow will run with the queries in `freeze.zip` in deterministic test environment.
- Adds `generate` + `run_pre_generated commands` to sqlsmith.

Approved-By: fuyufjh

Co-Authored-By: Noel Kwan <noelkwan1998@gmail.com>
Co-Authored-By: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
@kwannoel kwannoel changed the title Tracking: deterministic test stability Tracking: deterministic fuzzing test stability Mar 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
priority/high type/feature
Projects
None yet
Milestone
release-0.18
Development

Successfully merging a pull request may close this issue.

feat(sqlsmith): use ChaChaRng for determinism risingwavelabs/risingwave
1 participant
@kwannoel