New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add regression testing #1

Open

justinlubin opened this issue Jun 28, 2020 · 0 comments

Labels

Collaborator

justinlubin commented Jun 28, 2020

Add a suite of regression tests that checks each of the benchmarks against the previous version of Smyth to see if the synthesis outputs change.

It would be useful to have modes for this feature that allow for:

Checking to see if the synthesis output is the exact same string as before
Checking to see if the synthesis output is the exact same AST as before
Checking to see if the synthesis output is in the same ranked order as before

justinlubin added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment