-
Notifications
You must be signed in to change notification settings - Fork 97
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cmd actions bench & fmt #406
cmd actions bench & fmt #406
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good work, thanks! I mostly skimmed it but i think this is one of the things where we just need to experiment a bit.
Only point is that there should be a commands.md
or bot.md
with some overview of how the bot works, what commands are available and how the components make it work.
The weight-generation file seems to be specific already.
Co-authored-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
Review required! Latest push from author must always be reviewed |
1 similar comment
Review required! Latest push from author must always be reviewed |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
best to be able to only allow fellowship members to trigger the bot to prevent abuses especially with self hosted runners
.github/workflows/cmd.yml
Outdated
|
||
jobs: | ||
acknowledge: | ||
if: ${{ startsWith(github.event.comment.body, '/cmd') }} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
anyone can trigger this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yep good point, will add a similar check as for /merge
and cmd.md guide
thanks
I don't know what's the plan for the self hosted runners but for ORML we are using github webhook to create new AWS EC2 instance upon request and autoscale it down when idle. In that way we don't need to run idle instance and able to scale up as many runners as needed. |
CMD: ${{ steps.get-pr-comment.outputs.group2 }} # to avoid "" around the command | ||
run: | | ||
echo 'help<<EOF' >> $GITHUB_OUTPUT | ||
python3 .github/scripts/cmd/cmd.py $CMD >> $GITHUB_OUTPUT |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This line doesn't look safe, I'll write in Element.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
…ech-stg/runtimes into mak-testing-benchmarks-2
fbdf2d6
to
0bed466
Compare
2d4f52b
to
b2d273d
Compare
While this is being prepared, what is the standard way to generate weight files? I suppose I need access to a 'standard machine'? Asking for #364 |
if it waits until early next week, i'd recommend to wait a bit. @tugytur was going to spawn a runner as soon as @bkchr provides details, hope today or early next week 🤞 If not, then you can follow this guidance https://github.com/polkadot-fellows/runtimes/blob/main/docs/weight-generation.md and find |
Not super rushed from my side, but thanks for the context :) |
/merge |
Enabled Available commands
For more information see the documentation |
16d2db7
into
polkadot-fellows:main
Closes #128
Closes https://github.com/paritytech/infrastructure/issues/41
Adds ability to run some standard helper commands, for now only for benchmarks and fmt (with taplo)
It will commit the result of operation back into PR with some reports and/or links to logs
bench uses
gitrun-001
runner which corresponds to Validator Reference HardwareExamples (screenshots):
Benchmarks
Bench results with Subweight report
/cmd [command] --clean - removing bot's and author's command runs to clean up PR
/cmd [command] --help - outputs the usage instructions