Skip to content

Latest commit

 

History

History
70 lines (51 loc) · 3.21 KB

README.md

File metadata and controls

70 lines (51 loc) · 3.21 KB
Raw

Monitoring with Prometheus

Prometheus is an open-source systems monitoring and alerting toolkit. Below is the overview of the different helpers that exist in Operator SDK to help setup metrics in the generated operator.

Metrics in Operator SDK

The func ExposeMetricsPort(ctx context.Context, port int32) (*v1.Service, error) function exposes general metrics about the running program. These metrics are inherited from controller-runtime. This helper function creates a Service object with the metrics port exposed, which can then be accessed by Prometheus. The Service object is garbage collected when the leader pod's root owner is deleted.

By default, the metrics are served on 0.0.0.0:8383/metrics. To modify the port the metrics are exposed on, change the var metricsPort int32 = 8383 variable in the cmd/manager/main.go file of the generated operator.

Usage:

    import(
        "github.com/operator-framework/operator-sdk/pkg/metrics"
        "sigs.k8s.io/controller-runtime/pkg/manager"
    )

    func main() {

        ...

        // Change the below variables to serve metrics on different host or port.
        var metricsHost = "0.0.0.0"
        var metricsPort int32 = 8383

        // Pass metrics address to controller-runtime manager
        mgr, err := manager.New(cfg, manager.Options{
            Namespace:          namespace,
            MetricsBindAddress: fmt.Sprintf("%s:%d", metricsHost, metricsPort),
        })

        ...

        // Create Service object to expose the metrics port.
        _, err = metrics.ExposeMetricsPort(ctx, metricsPort)
        if err != nil {
            // handle error
            log.Info(err.Error())
        }

        ...
    }

Note: The above example is already present in cmd/manager/main.go in all the operators generated with Operator SDK from v0.5.0 onwards.

Garbage collection

The metrics Service is garbage collected when the resource used to deploy the operator is deleted (e.g. Deployment). This resource is determined when the metrics Service is created, at that time the resource owner reference is added to the Service.

In Kubernetes clusters where OwnerReferencesPermissionEnforcement is enabled (on by default in all OpenShift clusters), the role requires a <RESOURCE-KIND>/finalizers rule to be added. By default when creating the operator with the Operator SDK, this is done automatically under the assumption that the Deployment object was used to create the operator pods. In case another method of deploying the operator is used, replace the - deployments/finalizers in the deploy/role.yaml file. Example rule from deploy/role.yaml file for deploying operator with a StatefulSet:

...
- apiGroups:
  - apps
  resourceNames:
  - <STATEFULSET-NAME>
  resources:
  - statefulsets/finalizers
  verbs:
  - update
...