Release 2023-10-01 #3931

stl327 · 2023-10-02T23:55:42Z

No description provided.

palma21 · 2023-10-03T04:21:36Z

CHANGELOG.md

+
+* Features
+  * [H100 GPUs (accelerated compute instances)](https://learn.microsoft.com/en-us/azure/virtual-machines/nd-h100-v5-series) are now supported on AKS, with two current SKU offerings: Standard_ND96isr_v5 and Standard_ND96is_v5.
+  * Support for IP address changes for [Azure Blob NFS mounts](https://github.com/Azure/AZNFS-mount) on AKS 1.27+.


Azure docs link. @andyzhangx @AllenWen-at-Azure could you add this to our docs?

here it is:

AZNFS is mentioned in Azure docs here: https://learn.microsoft.com/en-us/azure/storage/blobs/network-file-system-protocol-support-how-to#step-5-install-the-aznfs-mount-helper-package

This also points out to https://github.com/Azure/AZNFS-mount/#aznfs-mount-helper for complete description.

palma21 · 2023-10-03T04:23:10Z

CHANGELOG.md

+
+* Behavioral Changes
+  * The pod CPU request from [ama-metrics](https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/prometheus-metrics-overview) daemonsets will be reduced in Windows from 500m to 150m and in Linux from 75m to 50m.
+  * If your VM SKU does not support ephemeral or Premium SSD OS disks, AKS will now use Standard SSD as the default OS disk type as compared to Standard HDD previously.


This was already in the previous notes?

CHANGELOG.md

PixelRobots · 2023-10-03T07:11:52Z

CHANGELOG.md

+### Announcements
+
+* No new clusters can be created with [Azure AD Integration (legacy)](https://learn.microsoft.com/azure/aks/azure-ad-integration-cli). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to [AKS-managed Azure AD](https://learn.microsoft.com/azure/aks/managed-azure-ad) automatically starting from 1st Dec. 2023. We recommend updating your cluster with AKS-managed Azure AD before 1 Dec 2023. This way you can manage the API server downtime during non-business hours.
+


I have noticed there has been no GA announcement for VPA in the AKS release notes. Maybe we could get it added to this release note as it seems to have gone to GA 27th September. https://azure.microsoft.com/en-gb/updates/ga-vertical-pod-autoscaling-addon-for-aks/

Thanks for adding. I just noticed we need to remove the en-us from the URL.

Also check the other URLs as the new ones in this pr have en-us also and should be removed.

aritraghosh · 2023-10-04T00:22:03Z

CHANGELOG.md

+  * If the ama-logs add-on is enabled, host port 28330 will be mounted to the ama-logs daemonset in order to facilitate syslog collection.
+  * To reduce vertical pod autoscaling (VPA) out of memory (OOM) errors, the vpa-recommender CPU limit will increase to 1000m, memory limit to 2000Mi, and memory request to 800Mi from 200m, 1000m, and 500Mi respectively.
+  * All control plane upgrades to AKS 1.26+ will enforce deprecated API usage validation. You can bypass this check and frontend pdb validation with [forceUpgrade](https://learn.microsoft.com/azure/aks/upgrade-cluster?tabs=azure-cli#stop-cluster-upgrades-automatically-on-api-breaking-changes-preview).
+  * The default [max surge](https://learn.microsoft.com/azure/virtual-machines/nd-h100-v5-series) value during upgrades will be changed from 1 to 10% for AKS 1.28+ on new clusters to improve upgrade latency. 


Is the link for default max surge correct?

palma21 · 2023-10-05T22:12:22Z

CHANGELOG.md

+* Bug Fixes 
+  * Fix for some events during an upgrade such as "Deleting node" not appearing in kubectl get events.
+  * Fix for metricsDefinition operation not exposed in Azure China.
+  * Fix for [Cluster Autoscaler](https://github.com/kubernetes/autoscaler/releases) condition where nodes that VPA pods are scheduled to could not be evicted.


This is the general release page, when people click this link they will go to the latest

palma21 · 2023-10-05T22:13:28Z

CHANGELOG.md

+### Announcements
+
+* No new clusters can be created with [Azure AD Integration (legacy)](https://learn.microsoft.com/azure/aks/azure-ad-integration-cli). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to [AKS-managed Azure AD](https://learn.microsoft.com/azure/aks/managed-azure-ad) automatically starting from 1st Dec. 2023. We recommend updating your cluster with AKS-managed Azure AD before 1 Dec 2023. This way you can manage the API server downtime during non-business hours.
+* The [vertical pod autoscaling (VPA)](https://learn.microsoft.com/azure/aks/vertical-pod-autoscaler) add-on for AKS is now generally available. 


This should be in feature

palma21 · 2023-10-05T22:15:27Z

CHANGELOG.md

+  * To reduce vertical pod autoscaling (VPA) out of memory (OOM) errors, the vpa-recommender CPU limit will increase to 1000m, memory limit to 2000Mi, and memory request to 800Mi from 200m, 1000m, and 500Mi respectively.
+  * All control plane upgrades to AKS 1.26+ will enforce deprecated API usage validation. You can bypass this check and frontend pdb validation with [forceUpgrade](https://learn.microsoft.com/azure/aks/upgrade-cluster?tabs=azure-cli#stop-cluster-upgrades-automatically-on-api-breaking-changes-preview).
+  * The default [max surge](https://learn.microsoft.com/azure/aks/upgrade-cluster?tabs=azure-cli#customize-node-surge-upgrade) value during upgrades will be changed from 1 to 10% for AKS 1.28+ on new clusters to improve upgrade latency. 
+  * Enabled support worklflows with update/patch access to validating and mutating webhookconfigurations, list/get access to volumeattachments, and get access to image integrity CRDs - policy, certificatestore, verifier, and store.


What is this? Also typo on workflows
This doesn't sound like a behavior change or a public piece, also image integrity announcement was already done or not?

palma21 · 2023-10-06T02:58:30Z

CHANGELOG.md

+
+* Behavioral Changes
+  * The pod CPU request from [ama-metrics](https://learn.microsoft.com/azure/azure-monitor/essentials/prometheus-metrics-overview) daemonsets will be reduced in Windows from 500m to 150m and in Linux from 75m to 50m.
+  * Public CIDRs, including those from placing the service/pod CIDR in the multicast address space, will be validated during creation by AKS to improve cluster connectivity. 


Per the thread we need to improve this lingo.

AKS will now validate/block the usage of the following multicast address spaces XXXXX.

Also this needs to be added to the docs explicitly just in case. @chasewilson @phealy

palma21 · 2023-10-06T03:02:21Z

CHANGELOG.md

+  * Public CIDRs, including those from placing the service/pod CIDR in the multicast address space, will be validated during creation by AKS to improve cluster connectivity. 
+  * If the ama-logs add-on is enabled, host port 28330 will be mounted to the ama-logs daemonset in order to facilitate syslog collection.
+  * To reduce vertical pod autoscaling (VPA) out of memory (OOM) errors, the vpa-recommender CPU limit will increase to 1000m, memory limit to 2000Mi, and memory request to 800Mi from 200m, 1000m, and 500Mi respectively.
+  * All control plane upgrades to AKS 1.26+ will enforce deprecated API usage validation. You can bypass this check and frontend pdb validation with [forceUpgrade](https://learn.microsoft.com/azure/aks/upgrade-cluster?tabs=azure-cli#stop-cluster-upgrades-automatically-on-api-breaking-changes-preview).


This means this feature is GA and that doc needs to be updated @shashankbarsin

Is the LRB finished?

pavneeta · 2023-10-06T03:54:31Z

CHANGELOG.md

+
+* Bug Fixes 
+  * Fix for some events during an upgrade such as "Deleting node" not appearing in kubectl get events.
+  * Fix for metricsDefinition operation not exposed in Azure China.


What is this metricsDefinition operation, do we have a link to docs?

pavneeta · 2023-10-06T04:00:33Z

CHANGELOG.md

+  * AKS will now validate, and block if necessary, service CIDRs placed in [public and multicast IP address ranges](https://learn.microsoft.com/azure/virtual-network/virtual-networks-faq#what-address-ranges-can-i-use-in-my-virtual-networks).
+  * If the ama-logs add-on is enabled, host port 28330 will be mounted to the ama-logs daemonset in order to facilitate syslog collection.
+  * To reduce vertical pod autoscaling (VPA) out of memory (OOM) errors, the vpa-recommender CPU limit will increase to 1000m, memory limit to 2000Mi, and memory request to 800Mi from 200m, 1000m, and 500Mi respectively.
+  * All control plane upgrades to AKS 1.26+ will enforce deprecated API usage validation. You can bypass this check and frontend pdb validation with [forceUpgrade](https://learn.microsoft.com/azure/aks/upgrade-cluster?tabs=azure-cli#stop-cluster-upgrades-automatically-on-api-breaking-changes-preview).


This sounds like a feature, why is it the behavior chance section, and it should then be accompanied by docs and LRB approval as Jorge tagged

miwithro · 2023-10-06T12:03:30Z

CHANGELOG.md

+
+### Release notes 
+
+* Features


@stl327 add
GA of BYOK for ephemeral disk

This reverts commit 80f2064.

Release 2023-10-01

fa0dde3

stl327 requested review from sabbour, aritraghosh, shashankbarsin, palma21, qpetraroia, justindavies, allyford, miwithro, pavneeta and kaysieyu October 2, 2023 23:55

stl327 self-assigned this Oct 2, 2023

palma21 requested changes Oct 3, 2023

View reviewed changes

PixelRobots reviewed Oct 3, 2023

View reviewed changes

stl327 added 2 commits October 3, 2023 12:06

Fix for 2023-10-01

6845a11

Fix 2 for 2023-10-01

54b251f

aritraghosh reviewed Oct 4, 2023

View reviewed changes

Fix 3 for 2023-10-01

c7e537c

palma21 reviewed Oct 5, 2023

View reviewed changes

palma21 requested changes Oct 5, 2023

View reviewed changes

stl327 added 2 commits October 5, 2023 15:25

Fix 4 for 2023-10-01

a596990

Fix 5 for 2023-10-01

655fe6e

palma21 reviewed Oct 6, 2023

View reviewed changes

palma21 approved these changes Oct 6, 2023

View reviewed changes

palma21 reviewed Oct 6, 2023

View reviewed changes

Fix 6 for 2023-10-01

02aa05e

pavneeta reviewed Oct 6, 2023

View reviewed changes

miwithro reviewed Oct 6, 2023

View reviewed changes

CHANGELOG.md

### Release notes

* Features

Copy link

Contributor

miwithro Oct 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@stl327 add
GA of BYOK for ephemeral disk

Fix 7 for 2023-10-01

13911df

miwithro approved these changes Oct 6, 2023

View reviewed changes

stl327 merged commit 80f2064 into Azure:master Oct 6, 2023
2 checks passed

stl327 added a commit that referenced this pull request Oct 6, 2023

Revert "Release 2023-10-01 (#3931)"

612c5d8

This reverts commit 80f2064.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release 2023-10-01 #3931

Release 2023-10-01 #3931

stl327 commented Oct 2, 2023

palma21 Oct 3, 2023

This comment was marked as outdated.

andyzhangx Oct 3, 2023

palma21 Oct 3, 2023

PixelRobots Oct 3, 2023

PixelRobots Oct 3, 2023

PixelRobots Oct 3, 2023

aritraghosh Oct 4, 2023 •

edited

Loading

palma21 Oct 5, 2023

palma21 Oct 5, 2023

palma21 Oct 5, 2023

palma21 Oct 6, 2023

palma21 Oct 6, 2023

pavneeta Oct 6, 2023

pavneeta Oct 6, 2023

miwithro Oct 6, 2023

		### Announcements

		* No new clusters can be created with [Azure AD Integration (legacy)](https://learn.microsoft.com/azure/aks/azure-ad-integration-cli). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to [AKS-managed Azure AD](https://learn.microsoft.com/azure/aks/managed-azure-ad) automatically starting from 1st Dec. 2023. We recommend updating your cluster with AKS-managed Azure AD before 1 Dec 2023. This way you can manage the API server downtime during non-business hours.

Release 2023-10-01 #3931

Release 2023-10-01 #3931

Conversation

stl327 commented Oct 2, 2023

Choose a reason for hiding this comment

This comment was marked as outdated.

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

aritraghosh Oct 4, 2023 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

aritraghosh Oct 4, 2023 •

edited

Loading