Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix selection of kustomization resource from multi doc yaml #4131

Merged
merged 1 commit into from
Aug 7, 2023

Conversation

mraerino
Copy link
Contributor

@mraerino mraerino commented Aug 5, 2023

Fixes #4132

@mraerino mraerino force-pushed the fix/diff-with-multiobj branch from 394f35b to b7aa190 Compare August 5, 2023 20:49
@mraerino mraerino changed the title Fix kustomization diff when yaml has multiple resources with the same name Fix selection of kustomization resource from multi doc yaml Aug 5, 2023
@mraerino mraerino force-pushed the fix/diff-with-multiobj branch from b7aa190 to 3bdc46b Compare August 5, 2023 21:20
@mraerino mraerino marked this pull request as ready for review August 5, 2023 21:21
@stefanprodan stefanprodan added the area/diff Diff related issues and pull requests label Aug 7, 2023
Copy link
Member

@stefanprodan stefanprodan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Thanks @mraerino, please squash and rebase with main.

@mraerino
Copy link
Contributor Author

mraerino commented Aug 7, 2023

i don't have merge privileges in this repo, you need to merge it

@mraerino
Copy link
Contributor Author

mraerino commented Aug 7, 2023

i suspected you meant the squash merge method. or do you expect me to rewrite the branch so you can fast-forward merge?

@hiddeco
Copy link
Member

hiddeco commented Aug 7, 2023

The latter: squash into a single commit and rebase with main, so it can be merged :-).

Signed-off-by: Marcus Weiner <marcus.weiner@gmail.com>
@mraerino mraerino force-pushed the fix/diff-with-multiobj branch from 2707834 to 56b1e80 Compare August 7, 2023 10:05
@mraerino
Copy link
Contributor Author

mraerino commented Aug 7, 2023

done!

@stefanprodan stefanprodan merged commit 12efb19 into fluxcd:main Aug 7, 2023
@mraerino mraerino deleted the fix/diff-with-multiobj branch August 7, 2023 11:21
nrdufour added a commit to nrdufour/home-ops that referenced this pull request Aug 25, 2023
This PR contains the following updates:

| Package | Type | Update | Change |
|---|---|---|---|
| [fluxcd/flux2](https://github.com/fluxcd/flux2) | Kustomization | minor | `v2.0.1` -> `v2.1.0` |

---

### Release Notes

<details>
<summary>fluxcd/flux2 (fluxcd/flux2)</summary>

### [`v2.1.0`](https://github.com/fluxcd/flux2/releases/tag/v2.1.0)

[Compare Source](fluxcd/flux2@v2.0.1...v2.1.0)

#### Highlights

Flux v2.1.0 is a feature release. Users are encouraged to upgrade for the best experience.

The [Flux APIs](#api-changes) were extended with new opt-in features in a backwards-compatible manner.

The Flux Git capabilities have been improved with support for Git push options, Git refspec, Gerrit, HTTP/S and SOCKS5 proxies.

The Flux alerting capabilities have been extended with [Datadog](https://fluxcd.io/flux/components/notification/provider/#pagerduity) support.

The Flux controllers come with performance improvements when reconciling Helm repositories with large indexes (80% memory reduction), and when reconciling Flux Kustomizations with thousands of resources (x4 faster server-side apply). The load distribution has been improved when reconciling Flux objects in parallel to reduce CPU and memory spikes.

:heart: Big thanks to all the Flux contributors that helped us with this release!

#### Deprecations

Flux v2.1.0 comes with support for Kubernetes TLS Secrets when referring to secrets containing TLS certs, and deprecates the usage of `caFile`, `keyFile` and `certFile` keys.

For more details about the TLS changes please see the [Kubernetes TLS Secrets section](#kubernetes-tls-secrets).

Flux v2.1.0 comes with major improvements to the Prometheus monitoring stack. Starting with this version, Flux is leveraging the `kube-state-metrics` CRD exporter to report metrics containing rich information about Flux reconciliation status e.g. Git revision, Helm chart version, OCI artifacts digests, etc. The `gotk_reconcile_condition` metrics was deprecated in favor of the `gotk_resource_info`.

For more details about the new monitoring stack please see the [Flux Prometheus metrics documentation](https://fluxcd.io/flux/monitoring/metrics) and the [flux2-monitoring-example repository](https://github.com/fluxcd/flux2-monitoring-example).

#### API changes

##### GitRepository v1

The [GitRepository](https://fluxcd.io/flux/components/source/gitrepositories/) API was extended with the following fields:

-   `.spec.proxySecretRef.name` is an optional field used to specify the name of a Kubernetes Secret that contains the HTTP/S or SOCKS5 proxy settings.
-   `.spec.verify.mode` now support one of the following values `HEAD`, `Tag`, `TagAndHEAD`.

##### Kustomization v1

The [Kustomization](https://fluxcd.io/flux/components/kustomize/kustomization/) API was extended with two apply policies `IfNotPresent` and `Ignore`.

Changing the apply behaviour for specific Kubernetes resources, can be done using the following annotations:

| Annotation                          | Default    | Values                                                         | Role            |
|-------------------------------------|------------|----------------------------------------------------------------|-----------------|
| `kustomize.toolkit.fluxcd.io/ssa`   | `Override` | - `Override`<br/>- `Merge`<br/>- `IfNotPresent`<br/>- `Ignore` | Apply policy    |
| `kustomize.toolkit.fluxcd.io/force` | `Disabled` | - `Enabled`<br/>- `Disabled`                                   | Recreate policy |
| `kustomize.toolkit.fluxcd.io/prune` | `Enabled`  | - `Enabled`<br/>- `Disabled`                                   | Delete policy   |

The `IfNotPresent` policy instructs the controller to only apply the Kubernetes resources if they are not present on the cluster.
This policy can be used for Kubernetes `Secrets` and `ValidatingWebhookConfigurations` managed by cert-manager,
where Flux creates the resources with fields that are later on mutated by other controllers.

##### ImageUpdateAutomation v1beta1

The [ImageUpdateAutomation](https://fluxcd.io/flux/components/image/imageupdateautomations/) was extended with the following fields:

-   `.spec.git.push.refspec` is an optional field used to specify a Git refspec used when pushing commits upstream.
-   `.spec.git.push.options` is an optional field used to specify the Git push options to be sent to the Git server when pushing commits upstream.

##### Kubernetes TLS Secrets

All the Flux APIs that accept TLS data have been modified to adopt Secrets of type
`kubernetes.io/tls`. This includes:

-   **HelmRepository**: The field `.spec.secretRef` has been deprecated in favor of a new field [`.spec.certSecretRef`](https://fluxcd.io/flux/components/source/helmrepositories/#cert-secret-reference).
-   **OCIRepository**: Support for the `caFile`, `keyFile` and `certFile` keys in the Secret specified in [`.spec.certSecretRef`](https://fluxcd.io/flux/components/source/ocirepositories/#cert-secret-reference) have been deprecated in favor of `ca.crt`, `tls.key` and `tls.crt`.
-   **ImageRepository**: Support for the`caFile`, `keyFile` and `certFile` keys in the Secret specified in [`.spec.certSecretRef`](https://fluxcd.io/flux/components/source/imagerepositories/#cert-secret-reference) have been deprecated in favor of `ca.crt`, `tls.key` and `tls.crt`.
-   **GitRepository**: CA certificate can now be provided in the Secret specified in `.spec.secretRef` using the `ca.crt` key, which takes precedence over the `caFile` key.

#### Upgrade procedure

Upgrade Flux from `v2.0.x` to `v2.1.0` either by [rerunning bootstrap](https://fluxcd.io/flux/installation/#bootstrap-upgrade) or by using the [Flux GitHub Action](https://github.com/fluxcd/flux2/tree/main/action).

To upgrade Flux from `v0.x` to `v2.1.0` please follow the [Flux GA upgrade procedure](https://github.com/fluxcd/flux2/releases/tag/v2.0.0#upgrade).

#### Kubernetes compatibility

This release is compatible with the following Kubernetes versions:

| Kubernetes version | Minimum required |
|--------------------|------------------|
| `v1.25`            | `>= 1.25.0`      |
| `v1.26`            | `>= 1.26.0`      |
| `v1.27`            | `>= 1.27.1`      |
| `v1.28`            | `>= 1.28.0`      |

Note that Flux may work on older versions of Kubernetes e.g. 1.21, but we don't recommend running end-of-life versions in production nor do we offer support for these versions.

#### New Documentation

-   [Flux installation](https://fluxcd.io/flux/installation/)
-   [Flux bootstrap](https://fluxcd.io/flux/installation/bootstrap/)
-   [Flux configuration](https://fluxcd.io/flux/installation/configuration/)
-   [Flux Prometheus metrics](https://fluxcd.io/flux/monitoring/metrics/)
-   [Flux custom Prometheus metrics](https://fluxcd.io/flux/monitoring/custom-metrics/)
-   [Flux logs](https://fluxcd.io/flux/monitoring/logs/)
-   [Flux events](https://fluxcd.io/flux/monitoring/events/)

#### Components changelog

-   source-controller [v1.1.0](https://github.com/fluxcd/source-controller/blob/v1.1.0/CHANGELOG.md)
-   kustomize-controller [v1.1.0](https://github.com/fluxcd/kustomize-controller/blob/v1.1.0/CHANGELOG.md)
-   notification-controller [v1.1.0](https://github.com/fluxcd/notification-controller/blob/v1.1.0/CHANGELOG.md)
-   helm-controller [v0.36.0](https://github.com/fluxcd/helm-controller/blob/v0.36.0/CHANGELOG.md)
-   image-reflector-controller [v0.30.0](https://github.com/fluxcd/image-reflector-controller/blob/v0.30.0/CHANGELOG.md)
-   image-automation-controller [v0.36.0](https://github.com/fluxcd/image-automation-controller/blob/v0.36.0/CHANGELOG.md)

#### CLI Changelog

-   PR [#&#8203;4189](fluxcd/flux2#4189) - [@&#8203;hiddeco](https://github.com/hiddeco) - Update dependencies
-   PR [#&#8203;4186](fluxcd/flux2#4186) - [@&#8203;fluxcdbot](https://github.com/fluxcdbot) - Update toolkit components
-   PR [#&#8203;4183](fluxcd/flux2#4183) - [@&#8203;somtochiama](https://github.com/somtochiama) - Fix autocompletion for helm chart
-   PR [#&#8203;4182](fluxcd/flux2#4182) - [@&#8203;hiddeco](https://github.com/hiddeco) - manifestgen/install: use clean default HTTP client
-   PR [#&#8203;4181](fluxcd/flux2#4181) - [@&#8203;hiddeco](https://github.com/hiddeco) - cmd/events: handle error value
-   PR [#&#8203;4180](fluxcd/flux2#4180) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - Fix controller version info
-   PR [#&#8203;4177](fluxcd/flux2#4177) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - Set min value for the `--ssh-rsa-bits` flag
-   PR [#&#8203;4176](fluxcd/flux2#4176) - [@&#8203;hiddeco](https://github.com/hiddeco) - ci: disable fail-fast for ARM end-to-end
-   PR [#&#8203;4175](fluxcd/flux2#4175) - [@&#8203;hiddeco](https://github.com/hiddeco) - build: update securejoin dependency
-   PR [#&#8203;4169](fluxcd/flux2#4169) - [@&#8203;darkowlzz](https://github.com/darkowlzz) - Add monitoring configuration deprecation notice
-   PR [#&#8203;4167](fluxcd/flux2#4167) - [@&#8203;dependabot](https://github.com/dependabot)\[bot] - build(deps): bump the ci group with 2 updates
-   PR [#&#8203;4166](fluxcd/flux2#4166) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - e2e: Add Kubernetes v1.28.0 to conformance tests
-   PR [#&#8203;4151](fluxcd/flux2#4151) - [@&#8203;hiddeco](https://github.com/hiddeco) - ci: enable security-and-quality CodeQL query
-   PR [#&#8203;4147](fluxcd/flux2#4147) - [@&#8203;aryan9600](https://github.com/aryan9600) - Adopt Kubernetes style TLS Secrets and add relevant flags
-   PR [#&#8203;4142](fluxcd/flux2#4142) - [@&#8203;dependabot](https://github.com/dependabot)\[bot] - build(deps): bump the ci group with 2 updates
-   PR [#&#8203;4140](fluxcd/flux2#4140) - [@&#8203;somtochiama](https://github.com/somtochiama) - Disable azure e2e test
-   PR [#&#8203;4134](fluxcd/flux2#4134) - [@&#8203;sestegra](https://github.com/sestegra) - monitoring: add OCIRepository in cluster dashboard and new source panels in control-plane dashboard
-   PR [#&#8203;4131](fluxcd/flux2#4131) - [@&#8203;mraerino](https://github.com/mraerino) - Fix selection of kustomization resource from multi doc yaml
-   PR [#&#8203;4126](fluxcd/flux2#4126) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - Set Kubernetes min version to 1.25
-   PR [#&#8203;4077](fluxcd/flux2#4077) - [@&#8203;dependabot](https://github.com/dependabot)\[bot] - build(deps): bump the ci group with 2 updates
-   PR [#&#8203;4068](fluxcd/flux2#4068) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - Update dependencies
-   PR [#&#8203;4065](fluxcd/flux2#4065) - [@&#8203;hiddeco](https://github.com/hiddeco) - action: support `openssl` and `sha256sum`
-   PR [#&#8203;4062](fluxcd/flux2#4062) - [@&#8203;souleb](https://github.com/souleb) - diff: Take into account the server-side inventory for local Flux Kustomizations
-   PR [#&#8203;4061](fluxcd/flux2#4061) - [@&#8203;hiddeco](https://github.com/hiddeco) - action: re-allow configuration of non-default token
-   PR [#&#8203;4057](fluxcd/flux2#4057) - [@&#8203;fluxcdbot](https://github.com/fluxcdbot) - Update toolkit components
-   PR [#&#8203;4052](fluxcd/flux2#4052) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - docs: Link to the Flux GitHub Action documentation
-   PR [#&#8203;4051](fluxcd/flux2#4051) - [@&#8203;hiddeco](https://github.com/hiddeco) - action: use `$RUNNER_TOOL_CACHE`, support MacOS and Windows, validate checksum
-   PR [#&#8203;4046](fluxcd/flux2#4046) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - ci: backport: set write permissions
-   PR [#&#8203;4043](fluxcd/flux2#4043) - [@&#8203;stefanprodan](https://github.com/stefanprodan) - ci: release: extract the image tag from GITHUB_REF
-   PR [#&#8203;4041](fluxcd/flux2#4041) - [@&#8203;hiddeco](https://github.com/hiddeco) - ci: release: disable interpretation backslash esc

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNi4yMy4yIiwidXBkYXRlZEluVmVyIjoiMzYuMjMuMiIsInRhcmdldEJyYW5jaCI6Im1haW4ifQ==-->

Reviewed-on: https://git.home/nrdufour/home-ops/pulls/58
Co-authored-by: Renovate <renovate@ptinem.io>
Co-committed-by: Renovate <renovate@ptinem.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/diff Diff related issues and pull requests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Flux Kustomization diff fails with local kustomization file that has multiple resources with the same name
3 participants