Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove old performance-test tool #9796

Merged
merged 3 commits into from
Mar 22, 2020
Merged

Conversation

alexey-milovidov
Copy link
Member

Changelog category (leave one):

  • Build/Testing/Packaging Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Remove old performance-test tool that is no longer used in CI. clickhouse-performance-test is great but now we are using way superior tool that is doing comparison testing with sophisticated statistical formulas to achieve confident results regardless to various changes in environment.

@alexey-milovidov alexey-milovidov added pr-build Pull request with build/testing/packaging improvement no-docs-needed labels Mar 21, 2020
@filimonov
Copy link
Contributor

Is there a way to run performance test locally now?

@alexey-milovidov
Copy link
Member Author

Yes, it's described in:
/docker/test/performance-comparison/performance_comparison.md

I will be happy if you will try.

@akuzm
Copy link
Contributor

akuzm commented Mar 21, 2020

Is there a way to run performance test locally now?

There is a simple python script that will run a single test on the servers you specify and output raw times. For analysis, it's really unwieldy now -- it's a sequence of clickhouse-local queries ran by a bash script. There -is- a way to run a full comparison script locally and get a report like in CI, but it's tricky. I'll simplify it and add to the readme.

@alexey-milovidov alexey-milovidov merged commit 673e38f into master Mar 22, 2020
@alexey-milovidov alexey-milovidov deleted the remove-old-performance-test branch March 22, 2020 00:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-docs-needed pr-build Pull request with build/testing/packaging improvement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants