Managed Certificates

Managed Certificates simplify user flow in managing HTTPS traffic. Instead of manually acquiring an SSL certificate from a Certificate Authority, configuring it on the load balancer and renewing it on time, now it is only necessary to create a Managed Certificate Custom Resource object and provide the domains for which you want to obtain a certificate. The certificate will be auto-renewed when necessary.

For that to work you need to run your cluster on a platform with Google Cloud Load Balancer, that is a cluster in GKE or your own cluster in GCP.

In GKE all the components are already installed. Follow the how-to for more information. For a GCP setup follow the instructions below.

This feature status is GA.

Installation

Managed Certificates consist of two parts:

• managed-certificate-controller which uses GCP Compute API to manage certificates securing your traffic,
• Managed Certificate CRD which is needed to tell the controller what domains you want to secure.

Limitations

• Managed Certificates support multi-SAN non-wildcard certificates.
• Managed Certificates are compatible only with GKE Ingress.
• A single ManagedCertificate supports up to 100 domain names.
• A single Ingress supports up to 15 certificates, and all types of certificates count towards the limit.
• A GCP project supports up to ssl_certificates quota of certificates.

Prerequisites

1. You need to use a Kubernetes cluster with GKE-Ingress v1.5.1+.
   • Managed Certificates have been tested against Kubernetes v1.19.0.
   • Kubernetes v1.15+ most likely will work as well.
   • Kubernetes v1.13-v1.15 most likely will work if you enable the CustomResourceWebhookConversion feature, otherwise Managed Certificate CRD validation will not work properly.
2. You need to grant permissions to the controller so that it is allowed to use the GCP Compute API.
   • When creating the cluster, add scope compute-rw to the node where you will run the pod with managed-certificate-controller.
   • Alternatively:
     • Create a dedicated service account with minimal roles.

       export NODE_SA_NAME=mcrt-controller-sa
       gcloud iam service-accounts create $NODE_SA_NAME --display-name "managed-certificate-controller service account"
       export NODE_SA_EMAIL=`gcloud iam service-accounts list --format='value(email)' \
       --filter='displayName:managed-certificate-controller'`
       
       export PROJECT=`gcloud config get-value project`
       gcloud projects add-iam-policy-binding $PROJECT --member serviceAccount:$NODE_SA_EMAIL \
       --role roles/monitoring.metricWriter
       gcloud projects add-iam-policy-binding $PROJECT --member serviceAccount:$NODE_SA_EMAIL \
       --role roles/monitoring.viewer
       gcloud projects add-iam-policy-binding $PROJECT --member serviceAccount:$NODE_SA_EMAIL \
       --role roles/logging.logWriter

     • Grant additional role roles/compute.loadBalancerAdmin to your service account.

       gcloud projects add-iam-policy-binding $PROJECT --member serviceAccount:$NODE_SA_EMAIL \
       --role roles/compute.loadBalancerAdmin

     • Export a service account key to a JSON file.

       gcloud iam service-accounts keys create ./key.json --iam-account $NODE_SA_EMAIL

     • Create a Kubernetes Secret that holds the service account key stored in key.json.

       kubectl create secret generic sa-key --from-file=./key.json

     • Mount the sa-key secret to managed-certificate-controller pod. In file deploy/managed-certificate-controller.yaml add:
       • Above section volumeMounts

         env:
           - name: GOOGLE_APPLICATION_CREDENTIALS
             value: "/etc/gcp/key.json"
         

       • In section volumeMounts

         - name: sa-key-volume
           mountPath: /etc/gcp
           readOnly: true
         

       • In section volumes

         - name: sa-key-volume
           secret:
             secretName: sa-key
             items:
             - key: key.json
               path: key.json
         

3. Configure your domain example.com so that it points at the load balancer created for your cluster by Ingress. If you add a CAA record to restrict the CAs that are allowed to provision certificates for your domain, note that Managed Certificates currently support:
   • Google Trust Services,
   • Let's Encrypt. In the future additional CAs may be available and a CAA record may make it impossible for you to take advantage of them.

Steps

To install Managed Certificates in your own cluster in GCP, you need to:

1. Deploy the Managed Certificate CRD

   $ kubectl create -f deploy/managedcertificates-crd.yaml

2. Deploy the managed-certificate-controller You may want to build your own managed-certificate-controller image and reference it in the deploy/managed-certificate-controller.yaml file. The default image is periodically built by a CI system and may not be stable. Alternatively you may use gcr.io/gke-release/managed-certificate-controller:v1.2.11 which is deployed in GKE, however this README likely will not be kept up to date with future GKE updates, and so this image may become stale.

   $ kubectl create -f deploy/managed-certificate-controller.yaml

Usage

1. Create a Managed Certificate custom object, specifying up to 100 non-wildcard domains not longer than 63 characters each, for which you want to obtain a certificate:

   apiVersion: networking.gke.io/v1
   kind: ManagedCertificate
   metadata:
     name: example-certificate
   spec:
     domains:
     - example1.com
     - example2.com

2. Configure Ingress to use this custom object to terminate SSL connections:

   $ kubectl annotate ingress [your-ingress-name] networking.gke.io/managed-certificates=example-certificate

If you need, you can specify multiple managed certificates here, separating their names with commas.

Clean up

You can do the below steps in any order to turn SSL off:

• Remove annotation from Ingress

  $ kubectl annotate ingress [your-ingress-name] networking.gke.io/managed-certificates-

  (note the minus sign at the end of annotation name)
• Tear down the controller

  $ kubectl delete -f deploy/managed-certificate-controller.yaml

• Tear down the Managed Certificate CRD

  $ kubectl delete -f deploy/managedcertificates-crd.yaml

Troubleshooting

1. Check Kubernetes events attached to ManagedCertificate and Ingress resources for information on temporary failures.

2. Use the same ManagedCertificate resource at every endpoint to which your domain resolves to.

   A real life example is when your example.com domain points at two IP addresses, one for IPv4 and one for IPv6. You deploy two Ingress objects to handle IPv4 and IPv6 traffic separately. If you create two separate ManagedCertificate resources and attach each of them to one of the Ingresses, one of the ManagedCertificate resources may not be provisioned. The reason is that the Certificate Authority is free to verify challenges on any of the IP addresses the domain resolves to.

3. Managed Certificates communicate with GKE Ingress using annotation kubernetes.io/pre-shared-cert. Problems may arise for instance if you:

   • forcibly keep clearing this annotation,
   • store a snapshot of Ingress, tear it down and restore Ingress from the snapshot. In the meantime an SslCertificate resource listed in the pre-shared-cert annotation may not be available any more. Ingress has all-or-nothing semantics and will not work if a certificate it references is missing.