Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

All Workflows Use ASG Self-Hosted Runners #1496

Merged
merged 9 commits into from
Mar 6, 2023

Conversation

olivereri
Copy link
Contributor

@olivereri olivereri commented Mar 3, 2023

Description

The Content-Release workflow depends on self-hosted runners that were created, on-demand, by a third-party Github Action (GHA). This action failed to deregister, stop, and terminate on-demand instances leading to 127 EC2 instances accumulating in the DSVA AWS account. It is estimated to currently cost the Department of Veteran Affairs over $94,909 dollars a month. Migrating the content-release workflow to use Auto-Scaling Group (ASG) created runners prevents the creation of new on-demand runners.

Furthermore, all other content-build related workflows that use self-hosted GHA runners are set to explicitly use ASG runners. This will prevent workflows from running on existing registered on-demand runners and allow of the completion of this clean-up ticket.

closes:
department-of-veterans-affairs/va.gov-cms#11402
department-of-veterans-affairs/va.gov-team#44319
relates
department-of-veterans-affairs/va.gov-cms#11405
department-of-veterans-affairs/va.gov-team#50148
department-of-veterans-affairs/va.gov-cms#12435

Testing done & Screenshots

Content-Release build phase is using an ASG hosted run, and successfully checks out repository code without error.
image

image

image

QA steps

What needs to be checked to prove this works?
Content-Build GHA workflows continue to work normally.
What needs to be checked to prove it didn't break any related things?
Content-build repo Github Action workflows.

Acceptance criteria

  • All Content-build GHA Workflows explicitly use ASG created self-hosted runners
  • Affected Content-build GHA Workflows continue to execute normally.

@olivereri olivereri requested review from a team as code owners March 3, 2023 21:47
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 3, 2023 21:48 Inactive
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 3, 2023 22:02 Inactive
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 3, 2023 22:45 Inactive
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 3, 2023 23:13 Inactive
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 3, 2023 23:57 Inactive
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 4, 2023 00:21 Inactive
@olivereri olivereri changed the title Content-Release Workflow Uses ASG Self-Hosted Runners All Workflows Use ASG Self-Hosted Runners Mar 4, 2023
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 4, 2023 00:29 Inactive
@va-vfs-bot va-vfs-bot temporarily deployed to master/main/eo-content-release-use-asg-runners March 4, 2023 01:37 Inactive
Copy link
Contributor

@timcosgrove timcosgrove left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved; Upon merge, let's roll a revert PR immediately to have at hand.

@olivereri olivereri merged commit 90327db into main Mar 6, 2023
@olivereri olivereri deleted the eo-content-release-use-asg-runners branch March 6, 2023 19:52
olivereri added a commit that referenced this pull request Mar 6, 2023
olivereri added a commit that referenced this pull request Mar 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants