-
Notifications
You must be signed in to change notification settings - Fork 120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Removed old test files, fixed tests for script features and mlperf #1291
Conversation
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Interesting.
Actually, it seems that we still need all these tests here if we do changes in CM?
Is there a way to trigger cm4mlops tests if we do a change in this core CM repo?
Otherwise, if we remove all these tests, we will not be able to detect a problem with the main CM workflows when we update CM?
That's correct @gfursin . But currently these test files are not effective as they were supposed to run only when changes are made to "cm-mlops" directory. I think we should make separate test for testing CM scripts (no need for the whole MLPerf pipeline?) when CM core changes are made. |
I think it's still useful to test just 1 MLPerf pipeline here (no need for comprehensive MLPerf tests though) besides the code CM functionality just to avoid some obvious mistakes ;) ... |
Sure @gfursin . I have added the script features test and also the R50 test. Currently some tests are failing on Windows and macOS which needs fix in the cm4mlops repository. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Actually, I just saw the problem with certificates on Windows when downloading a dataset... Is it possible to fix it, please? Thanks! |
yes Grigori. That should be fixed in this PR |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
No description provided.