Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

async viable tasks to speed up provision (security) #473

Merged
merged 1 commit into from
Oct 7, 2019

Conversation

maxamillion
Copy link
Collaborator

Signed-off-by: Adam Miller admiller@redhat.com

SUMMARY
  • Async various EC2 operations because they can run in parallel
  • Async package installs
  • Async select downloads

This appears to achieve roughly a 1 minute per student environment
speed increase which can be rather impactful for larger workshops
(AnsibleFest notably).

Before this patchset with 10 students

real 39m48.828s
user 5m52.074s
sys 1m19.715s

After this patchset with 10 students

real 31m13.664s
user 4m29.428s
sys 1m25.586s

Before this patchset with 20 students

real 65m3.124s
user 9m9.207s
sys 2m25.135s

After this patchset with 20 students

real 45m13.722s
user 8m31.238s
sys 2m29.468s

For posterity, I did run Roland's verifier playbook against the
provisioned environment that results from these changes to ensure
sanity checking and the verifier playbook was successful.

ISSUE TYPE
  • Feature Pull Request
COMPONENT NAME
  • provisioner
ADDITIONAL INFORMATION

There are other changes I'd like to make, as well as others that Roland has planned, that will continue to significantly speed the provision of the security workshop up to make but they are outside the scope of this particular change set.


- Async various EC2 operations because they can run in parallel
- Async package installs
- Async select downloads

This appears to achieve roughly a 1 minute per student environment
speed increase which can be rather impactful for larger workshops
(AnsibleFest notably).

Before this patchset with 10 students
---
real    39m48.828s
user    5m52.074s
sys     1m19.715s

After this patchset with 10 students
---
real    31m13.664s
user    4m29.428s
sys     1m25.586s

Before this patchset with 20 students
---
real    65m3.124s
user    9m9.207s
sys     2m25.135s

After this patchset with 20 students
---
real    45m13.722s
user    8m31.238s
sys     2m29.468s

For posterity, I did run Roland's verifier playbook against the
provisioned environment that results from these changes to ensure
sanity checking and the verifier playbook was successful.

Signed-off-by: Adam Miller <admiller@redhat.com>

Signed-off-by: Adam Miller <admiller@redhat.com>

Signed-off-by: Adam Miller <admiller@redhat.com>
@IPvSean IPvSean merged commit c1d102a into ansible:devel Oct 7, 2019
@IPvSean IPvSean mentioned this pull request Oct 7, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants