Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Crossplane forgets an already created resource by itself (Subnet, SubnetCidrReservation, SecurityGroupRule, NetworkACLRule) #1482

Open
1 task done
woranhun opened this issue Sep 5, 2024 · 5 comments
Open
1 task done

[Bug]: Crossplane forgets an already created resource by itself (Subnet, SubnetCidrReservation, SecurityGroupRule, NetworkACLRule) #1482

woranhun opened this issue Sep 5, 2024 · 5 comments
Labels
bug Something isn't working needs:triage

Comments

@woranhun
Copy link

woranhun commented Sep 5, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Affected Resource(s)

ec2.aws.upbound.io/v1beta1 - Subnet
ec2.aws.upbound.io/v1beta1 - SubnetCidrReservation
ec2.aws.upbound.io/v1beta1 - SecurityGroupRule
ec2.aws.upbound.io/v1beta1 - NetworkACLRule

Resource MRs required to reproduce the bug

        {
            "apiVersion": "ec2.aws.upbound.io/v1beta1",
            "kind": "Subnet",
            "metadata": {
                "annotations": {
                    "crossplane.io/composition-resource-name": "subnet-100.64.4.0/28-1-nd-cmg-vrf-pcc-vpc-main-gp0821v-rk4qg-p7wtg",
                    "crossplane.io/external-create-pending": "2024-08-30T12:11:21Z",
                    "crossplane.io/external-create-succeeded": "2024-08-30T12:11:21Z"
                },
                "creationTimestamp": "2024-08-30T12:07:24Z",
                "finalizers": [
                    "finalizer.managedresource.crossplane.io"
                ],
                "generateName": "gp0821v-rk4qg-",
                "generation": 2,
                "labels": {
                    "accountId": "123456789000",
                    "crossplane.io/claim-name": "gp0821v",
                    "crossplane.io/claim-namespace": "default",
                    "crossplane.io/composite": "gp0821v-rk4qg"
                },
                "name": "gp0821v-rk4qg-6km8s",
                "ownerReferences": [
                    {
                        "apiVersion": "saas.nokia.com/v1alpha1",
                        "blockOwnerDeletion": true,
                        "controller": true,
                        "kind": "XNetworkDomain",
                        "name": "gp0821v-rk4qg-p7wtg",
                        "uid": "f45e5bb9-8802-4874-8522-725f6bba20d4"
                    }
                ],
                "resourceVersion": "5578758",
                "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d"
            },
            "spec": {
                "deletionPolicy": "Delete",
                "forProvider": {
                    "availabilityZone": "eu-north-1a",
                    "cidrBlock": "100.64.4.0/28",
                    "mapPublicIpOnLaunch": false,
                    "region": "eu-north-1",
                    "tags": {
                        "Name": "tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg",
                        "crossplane-kind": "subnet.ec2.aws.upbound.io",
                        "crossplane-name": "gp0821v-rk4qg-6km8s",
                        "crossplane-providerconfig": "123456789000",
                        "subnetExposure": "tra",
                        "subnetName": "1",
                        "subnetType": "multus",
                        "subnetVrf": "pcc",
                        "vpcName": "main"
                    },
                    "vpcId": "vpc-0ca7c49c0e6dbb400"
                },
                "initProvider": {},
                "managementPolicies": [
                    "*"
                ],
                "providerConfigRef": {
                    "name": "123456789000"
                }
            },
            "status": {
                "atProvider": {},
                "conditions": [
                    {
                        "lastTransitionTime": "2024-08-30T12:07:27Z",
                        "reason": "Creating",
                        "status": "False",
                        "type": "Ready"
                    },
                    {
                        "lastTransitionTime": "2024-08-30T12:07:27Z",
                        "reason": "ReconcileSuccess",
                        "status": "True",
                        "type": "Synced"
                    },
                    {
                        "lastTransitionTime": "2024-08-30T12:07:29Z",
                        "reason": "Success",
                        "status": "True",
                        "type": "LastAsyncOperation"
                    }
                ]
            }
        },

Steps to Reproduce

We were not able to deterministically reproduce this issue. This issue happens randomly when creating multiple resources of the above.

What happened?

Sometimes when we create a MR via Crossplane the tfID returned from AWS after a successful resource creation is not saved to the "crossplane.io/external-name" annotation. During the next reconciliation a Diff is again detected with the same content as previously. Therefore, Crossplane sends another request to AWS but it fails because the resource already exists on AWS side.

See subnet-create-fail.log for further details. We observed the same behavior with the creation of Subnet, SubnetCidrReservation, SecurityGroupRule, NetworkACLRule.

We also provided a working example subnet-create-ok.log. As you can see the same MR manifest sometimes provides a failed result.

Relevant logs:

Relevant Error Output Snippet

provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:25Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z	DEBUG	provider-aws	Observing the external resource	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z	DEBUG	provider-aws	Diff detected	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z	DEBUG	provider-aws	Async create starting...	{"trackerUID": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "resourceName": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "tfID": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:27Z	DEBUG	provider-aws	Creating the external resource	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:27Z	DEBUG	provider-aws	Successfully requested creation of external resource	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5574795", "external-name": "", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:27Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z	DEBUG	provider-aws	Calling the inner handler for Update event.	{"gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "name": "gp0821v-rk4qg-6km8s", "queueLength": 0}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z	DEBUG	provider-aws	ongoing async operation	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "opType": "create"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z	DEBUG	provider-aws	External resource is up to date	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575071", "external-name": "", "requeue-after": "2024-08-30T12:12:35Z"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Async create ended.	{"trackerUID": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "resourceName": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "error": null, "tfID": "subnet-085bfcb6fda3cebf5"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Observing the external resource	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Diff detected	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Waiting for external resource existence to be confirmed	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575071", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z	DEBUG	provider-aws	Reconcile request has been requeued.	{"gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "name": "gp0821v-rk4qg-6km8s", "rateLimiterName": "", "when": "0s"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z	DEBUG	provider-aws	Observing the external resource	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z	DEBUG	provider-aws	Diff detected	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z	DEBUG	provider-aws	Waiting for external resource existence to be confirmed	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575212", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:31Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z	DEBUG	provider-aws	Observing the external resource	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z	DEBUG	provider-aws	Diff detected	{"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z	DEBUG	provider-aws	Waiting for external resource existence to be confirmed	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575212", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}

Crossplane Version

v1.16.0

Provider Version

v1.11.0; v1.13.0

Kubernetes Version

v1.29.7-eks-a18cd3a

Kubernetes Distribution

EKS

Additional Info

FYI:
@janosdubovszky
@bobh66
@woranhun woranhun added bug Something isn't working needs:triage labels Sep 5, 2024
@bobh66
Copy link
Contributor

bobh66 commented Sep 6, 2024 •
edited
Loading

Another example:

apiVersion: ec2.aws.upbound.io/v1beta1
kind: NetworkACLRule
metadata:
  annotations:
    crossplane.io/composition-resource-name: rule-nacl-permit-all-ingress-10.254.1.0/24-all-0-65535-nacl-acl-0fe2a88c9076d3be6-vrf-sigext-vpc-main-rg-network-k2rbw-5f4bbf59d5
    crossplane.io/external-create-failed: "2024-09-06T15:25:47Z"
    crossplane.io/external-create-pending: "2024-09-06T15:25:47Z"
    crossplane.io/external-create-succeeded: "2024-09-06T14:55:51Z"
  creationTimestamp: "2024-09-06T14:55:20Z"
  finalizers:
  - finalizer.managedresource.crossplane.io
  generateName: rg-network-k2rbw-
  generation: 1
  labels:
    accountId: "xxxxxxxx"
    crossplane.io/claim-name: rg-network
    crossplane.io/claim-namespace: claims-66db15b61bc75e2143e08048
    crossplane.io/composite: rg-network-k2rbw
  name: rg-network-k2rbw-f2shz

the external-name is missing so the provider doesn't know that it created the resource already.

@bobh66
Copy link
Contributor

bobh66 commented Sep 6, 2024 

2024-09-06T14:55:20Z	DEBUG	provider-aws	Calling the inner handler for Create event.	{"gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "name": "rg-network-k2rbw-f2shz", "queueLength": 0}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Observing the external resource	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Diff detected	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"10.254.1.0/24\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"egress\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"from_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"0\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"network_acl_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"acl-0fe2a88c9076d3be6\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"protocol\":*terraform.ResourceAttrDiff{Old:\"\", New:\"-1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_action\":*terraform.ResourceAttrDiff{Old:\"\", New:\"allow\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_number\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"to_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"65535\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Async create starting...	{"trackerUID": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "resourceName": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "tfID": ""}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Creating the external resource	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Successfully requested creation of external resource	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}, "uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "version": "1590732", "external-name": "", "external-name": ""}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Calling the inner handler for Update event.	{"gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "name": "rg-network-k2rbw-f2shz", "queueLength": 0}
2024-09-06T14:55:20Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	ongoing async operation	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "opType": "create"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	External resource is up to date	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}, "uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "version": "1590781", "external-name": "", "requeue-after": "2024-09-06T15:00:19Z"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Connecting to the service provider	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Async create ended.	{"trackerUID": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "resourceName": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "error": null, "tfID": "nacl-989123708"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Instance state not found in cache, reconstructing...	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Observing the external resource	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Diff detected	{"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"10.254.1.0/24\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"egress\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"from_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"0\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"network_acl_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"acl-0fe2a88c9076d3be6\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"protocol\":*terraform.ResourceAttrDiff{Old:\"\", New:\"-1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_action\":*terraform.ResourceAttrDiff{Old:\"\", New:\"allow\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_number\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"to_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"65535\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Waiting for external resource existence to be confirmed	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}, "uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "version": "1590781", "external-name": ""}
2024-09-06T14:55:21Z	DEBUG	provider-aws	Reconciling	{"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}

@bobh66
Copy link
Contributor

bobh66 commented Sep 6, 2024

@ulucinar this seems to be a timing issue where the external-name annotation is never added to the resource, or the update fails and the name gets lost is the process.

Can you think of anything that we could try to collect more information, or are there known upjet issues in this area that need to be addressed? Thanks!

@bobh66
Copy link
Contributor

bobh66 commented Sep 11, 2024

Related issues and code:

#1346 (comment)

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_subnet.go#L202

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_subnet_cidr_reservation.go#L100

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_security_group_rule.go#L253

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_network_acl_rule.go#L185

@duanshiqiang
Copy link

We face the same issue as well, it happens randomly and very annoying...

@karloscarrijozup karloscarrijozup mentioned this issue Oct 2, 2024
Open
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working needs:triage
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@duanshiqiang @bobh66 @woranhun