Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CORS-2899: capi-aws - Local Zones network provisioning #8173

Merged
merged 1 commit into from
Apr 26, 2024

Conversation

mtulio
Copy link
Contributor

@mtulio mtulio commented Mar 17, 2024

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Mar 17, 2024
@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Mar 17, 2024

@mtulio: This pull request references CORS-2899 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

In response to this:

WIP for https://issues.redhat.com/browse/CORS-2899

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Copy link
Contributor

openshift-ci bot commented Mar 17, 2024

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Mar 17, 2024
@mtulio
Copy link
Contributor Author

mtulio commented Mar 17, 2024

/test ?

Copy link
Contributor

openshift-ci bot commented Mar 17, 2024

@mtulio: The following commands are available to trigger required jobs:

  • /test agent-integration-tests
  • /test altinfra-e2e-gcp-capi-ovn
  • /test altinfra-images
  • /test aro-unit
  • /test e2e-agent-compact-ipv4
  • /test e2e-aws-ovn
  • /test e2e-aws-ovn-edge-zones-manifest-validation
  • /test e2e-aws-ovn-upi
  • /test e2e-azure-ovn
  • /test e2e-azure-ovn-upi
  • /test e2e-gcp-ovn
  • /test e2e-gcp-ovn-upi
  • /test e2e-metal-ipi-ovn-ipv6
  • /test e2e-openstack-ovn
  • /test e2e-vsphere-ovn
  • /test e2e-vsphere-upi
  • /test gofmt
  • /test golint
  • /test govet
  • /test images
  • /test okd-images
  • /test okd-scos-images
  • /test okd-unit
  • /test okd-verify-codegen
  • /test openstack-manifests
  • /test shellcheck
  • /test terraform-images
  • /test terraform-verify-vendor
  • /test tf-lint
  • /test unit
  • /test verify-codegen
  • /test verify-vendor
  • /test yaml-lint

The following commands are available to trigger optional jobs:

  • /test altinfra-e2e-aws-custom-security-groups
  • /test altinfra-e2e-aws-ovn
  • /test altinfra-e2e-aws-ovn-fips
  • /test altinfra-e2e-aws-ovn-imdsv2
  • /test altinfra-e2e-aws-ovn-localzones
  • /test altinfra-e2e-aws-ovn-proxy
  • /test altinfra-e2e-aws-ovn-public-ipv4-pool
  • /test altinfra-e2e-aws-ovn-shared-vpc
  • /test altinfra-e2e-aws-ovn-shared-vpc-edge-zones
  • /test altinfra-e2e-aws-ovn-single-node
  • /test altinfra-e2e-aws-ovn-wavelengthzones
  • /test altinfra-e2e-azure-capi-ovn
  • /test altinfra-e2e-ibmcloud-capi-ovn
  • /test altinfra-e2e-nutanix-capi-ovn
  • /test altinfra-e2e-openstack-capi-ovn
  • /test altinfra-e2e-vsphere-capi-ovn
  • /test altinfra-e2e-vsphere-capi-static-ovn
  • /test altinfra-e2e-vsphere-capi-zones
  • /test azure-ovn-marketplace-images
  • /test e2e-agent-compact-ipv4-appliance
  • /test e2e-agent-compact-ipv4-appliance-diskimage
  • /test e2e-agent-compact-ipv4-none-platform
  • /test e2e-agent-ha-dualstack
  • /test e2e-agent-sno-ipv4-pxe
  • /test e2e-agent-sno-ipv6
  • /test e2e-aws-custom-security-groups
  • /test e2e-aws-overlay-mtu-ovn-1200
  • /test e2e-aws-ovn-edge-zones
  • /test e2e-aws-ovn-fips
  • /test e2e-aws-ovn-imdsv2
  • /test e2e-aws-ovn-proxy
  • /test e2e-aws-ovn-public-ipv4-pool
  • /test e2e-aws-ovn-public-subnets
  • /test e2e-aws-ovn-shared-vpc
  • /test e2e-aws-ovn-shared-vpc-edge-zones
  • /test e2e-aws-ovn-single-node
  • /test e2e-aws-ovn-upgrade
  • /test e2e-aws-ovn-workers-rhel8
  • /test e2e-aws-upi-proxy
  • /test e2e-azure-ovn-resourcegroup
  • /test e2e-azure-ovn-shared-vpc
  • /test e2e-azurestack
  • /test e2e-azurestack-upi
  • /test e2e-crc
  • /test e2e-gcp-ovn-shared-vpc
  • /test e2e-gcp-ovn-xpn
  • /test e2e-gcp-secureboot
  • /test e2e-gcp-upgrade
  • /test e2e-gcp-upi-xpn
  • /test e2e-ibmcloud-ovn
  • /test e2e-metal-assisted
  • /test e2e-metal-ipi-ovn
  • /test e2e-metal-ipi-ovn-dualstack
  • /test e2e-metal-ipi-ovn-swapped-hosts
  • /test e2e-metal-ipi-ovn-virtualmedia
  • /test e2e-metal-single-node-live-iso
  • /test e2e-nutanix-ovn
  • /test e2e-openstack-ccpmso
  • /test e2e-openstack-ccpmso-zone
  • /test e2e-openstack-dualstack
  • /test e2e-openstack-dualstack-upi
  • /test e2e-openstack-externallb
  • /test e2e-openstack-nfv-intel
  • /test e2e-openstack-proxy
  • /test e2e-vsphere-static-ovn
  • /test e2e-vsphere-upi-zones
  • /test e2e-vsphere-zones
  • /test e2e-vsphere-zones-techpreview
  • /test okd-e2e-agent-compact-ipv4
  • /test okd-e2e-agent-ha-dualstack
  • /test okd-e2e-agent-sno-ipv6
  • /test okd-e2e-aws-ovn
  • /test okd-e2e-aws-ovn-upgrade
  • /test okd-e2e-gcp
  • /test okd-e2e-gcp-ovn-upgrade
  • /test okd-e2e-vsphere
  • /test okd-scos-e2e-aws-ovn
  • /test okd-scos-e2e-aws-upgrade
  • /test okd-scos-e2e-gcp
  • /test okd-scos-e2e-gcp-ovn-upgrade
  • /test okd-scos-e2e-vsphere
  • /test okd-scos-unit
  • /test okd-scos-verify-codegen
  • /test tf-fmt

Use /test all to run the following jobs that were automatically triggered:

  • pull-ci-openshift-installer-master-altinfra-e2e-aws-custom-security-groups
  • pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn
  • pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn-fips
  • pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn-localzones
  • pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn-shared-vpc-edge-zones
  • pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn-single-node
  • pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn-wavelengthzones
  • pull-ci-openshift-installer-master-altinfra-images
  • pull-ci-openshift-installer-master-aro-unit
  • pull-ci-openshift-installer-master-e2e-aws-custom-security-groups
  • pull-ci-openshift-installer-master-e2e-aws-ovn
  • pull-ci-openshift-installer-master-e2e-aws-ovn-edge-zones
  • pull-ci-openshift-installer-master-e2e-aws-ovn-edge-zones-manifest-validation
  • pull-ci-openshift-installer-master-e2e-aws-ovn-fips
  • pull-ci-openshift-installer-master-e2e-aws-ovn-imdsv2
  • pull-ci-openshift-installer-master-e2e-aws-ovn-shared-vpc
  • pull-ci-openshift-installer-master-e2e-aws-ovn-shared-vpc-edge-zones
  • pull-ci-openshift-installer-master-e2e-aws-ovn-single-node
  • pull-ci-openshift-installer-master-gofmt
  • pull-ci-openshift-installer-master-golint
  • pull-ci-openshift-installer-master-govet
  • pull-ci-openshift-installer-master-images
  • pull-ci-openshift-installer-master-okd-e2e-aws-ovn-upgrade
  • pull-ci-openshift-installer-master-okd-images
  • pull-ci-openshift-installer-master-okd-scos-images
  • pull-ci-openshift-installer-master-okd-scos-unit
  • pull-ci-openshift-installer-master-okd-scos-verify-codegen
  • pull-ci-openshift-installer-master-okd-unit
  • pull-ci-openshift-installer-master-okd-verify-codegen
  • pull-ci-openshift-installer-master-shellcheck
  • pull-ci-openshift-installer-master-tf-fmt
  • pull-ci-openshift-installer-master-tf-lint
  • pull-ci-openshift-installer-master-unit
  • pull-ci-openshift-installer-master-verify-codegen
  • pull-ci-openshift-installer-master-verify-vendor
  • pull-ci-openshift-installer-master-yaml-lint

In response to this:

/test ?

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@mtulio mtulio force-pushed the CORS-2899-edge-zones branch from 7cbf306 to 7d6ba98 Compare March 17, 2024 01:10
@mtulio
Copy link
Contributor Author

mtulio commented Mar 17, 2024

/test altinfra-e2e-aws-ovn-localzones

@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Mar 17, 2024

@mtulio: This pull request references CORS-2899 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

In response to this:

WIP for https://issues.redhat.com/browse/CORS-2899
Upstream issue: https://github.com/kubernetes-sigs/cluster-api-provider-aws/issues/4874

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@mtulio
Copy link
Contributor Author

mtulio commented Mar 17, 2024

/test altinfra-e2e-aws-ovn-localzones

1 similar comment
@mtulio
Copy link
Contributor Author

mtulio commented Mar 17, 2024

/test altinfra-e2e-aws-ovn-localzones

@mtulio mtulio force-pushed the CORS-2899-edge-zones branch from f02826b to 14e913c Compare March 18, 2024 02:50
@mtulio mtulio marked this pull request as ready for review March 18, 2024 11:19
@mtulio
Copy link
Contributor Author

mtulio commented Mar 18, 2024

Two success cluster creation on Local Zones. Triggering other jobs.

@mtulio mtulio force-pushed the CORS-2899-edge-zones branch 3 times, most recently from 0fd9ede to d5dd2c6 Compare March 19, 2024 03:52
@mtulio mtulio changed the title WIP | CORS-2899: CAPA Local Zones network provisioning CORS-2899: CAPA Local Zones network provisioning Mar 19, 2024
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Mar 19, 2024
@mtulio mtulio changed the title CORS-2899: CAPA Local Zones network provisioning CORS-2899: AWS/CAPI Local Zones network provisioning Mar 19, 2024
@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Mar 19, 2024

@mtulio: This pull request references CORS-2899 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

In response to this:

WIP for https://issues.redhat.com/browse/CORS-2899
Upstream tracking:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@mtulio mtulio marked this pull request as draft March 19, 2024 05:41
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Mar 19, 2024
@mtulio
Copy link
Contributor Author

mtulio commented Mar 19, 2024

/test altinfra-e2e-aws-ovn-localzones

@mtulio mtulio force-pushed the CORS-2899-edge-zones branch from cfa703b to 0dc1eaf Compare March 19, 2024 13:40
@mtulio
Copy link
Contributor Author

mtulio commented Mar 19, 2024

/test altinfra-e2e-aws-ovn-localzones

@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Apr 25, 2024

@mtulio: This pull request references CORS-2899 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

In response to this:

CORS-2899

This PR introduce support of AWS Local Zones using CAPA as infrastructure provisioner for managed (automated VPC) and unmanaged (BYO VPC) deployments.

References:

Blocked by:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@mtulio mtulio marked this pull request as draft April 25, 2024 16:27
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Apr 25, 2024
@mtulio
Copy link
Contributor Author

mtulio commented Apr 25, 2024

Converting to draft to address the review feedback, and adding more scenarios in the unit tests for cluster CAPA zones.

@mtulio mtulio force-pushed the CORS-2899-edge-zones branch from 1c9f90d to 854f286 Compare April 25, 2024 16:30
@mtulio
Copy link
Contributor Author

mtulio commented Apr 25, 2024

/test unit
/test golint

@mtulio
Copy link
Contributor Author

mtulio commented Apr 25, 2024

@r4f4 thanks for your review.

I found one "issue" (mentioned on Slack) which was specifically here (when the worker pool isn't defined, the zone wasn't added). In the practice, it will not generate any issue for the provisioner as the default zones are set earlier, instead a issue caught in the unit validation. I am checking if we'll need to simplify/drop some validations considering the goal is only discover which zones should be used to create subnets, regardless it was added from pools, defaults, or metadata.

The ZonesCAPI had been exported and generated a lot of changes in the whole zone code in favor of getting better unit tests feedback using go-cmp.

The remaining changes are addressing your feedback.

The subnet structure created in managed VPC by CAPA is created with
SubnetSpec, without providing the valid ID, so CAPA will understand that
the subnet does not exists and will created it following the zone
specified/discovered in the install config.
@mtulio mtulio force-pushed the CORS-2899-edge-zones branch from 854f286 to 7cebd6a Compare April 25, 2024 17:03
@mtulio mtulio marked this pull request as ready for review April 25, 2024 17:03
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Apr 25, 2024
@mtulio
Copy link
Contributor Author

mtulio commented Apr 25, 2024

/test altinfra-e2e-aws-ovn-localzones
/test altinfra-e2e-aws-ovn-shared-vpc-local-zones

@openshift-ci openshift-ci bot requested a review from rna-afk April 25, 2024 17:04
@mtulio
Copy link
Contributor Author

mtulio commented Apr 25, 2024

/uncc rna-afk sadasu barbacbd
/assign @r4f4 @patrickdillon

Copy link
Contributor

@r4f4 r4f4 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Apr 25, 2024
@mtulio
Copy link
Contributor Author

mtulio commented Apr 25, 2024

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Apr 25, 2024
@patrickdillon
Copy link
Contributor

/approve

Copy link
Contributor

openshift-ci bot commented Apr 25, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: patrickdillon

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 25, 2024
@openshift-merge-bot openshift-merge-bot bot merged commit 59cc24d into openshift:master Apr 26, 2024
33 checks passed
@openshift-bot
Copy link
Contributor

[ART PR BUILD NOTIFIER]

This PR has been included in build ose-installer-altinfra-container-v4.16.0-202404251943.p0.g59cc24d.assembly.stream.el8 for distgit ose-installer-altinfra.
All builds following this will include this PR.

@mtulio mtulio deleted the CORS-2899-edge-zones branch April 26, 2024 12:23
@mtulio mtulio changed the title CORS-2899: AWS/CAPI Local Zones network provisioning CORS-2899: capi-aws - Local Zones network provisioning Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants