Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[extensions/headerssetter] fatal error: concurrent map writes - collector crashes when multiple exporters uses headers_setter #31289

Closed
tdarwin opened this issue Feb 15, 2024 · 6 comments
Closed

[extensions/headerssetter] fatal error: concurrent map writes - collector crashes when multiple exporters uses headers_setter #31289

tdarwin opened this issue Feb 15, 2024 · 6 comments
Labels
bug Something isn't working extension/headerssetter

Comments

@tdarwin
Copy link

tdarwin commented Feb 15, 2024

Component(s)

No response

What happened?

Description

Daemonset collector instances have been crashing and restarting when having multiple exporters using the same instance of the headers_setter extension. Collectors eventually crash with the following error:
fatal error: concurrent map writes

Steps to Reproduce

  1. Setup a collector to receive OTLP metrics
  2. Use the headers_setter extension to transmit a header via exporter Honeycomb blog for example
  3. Apply a header via the HS extension to multiple exporters (the more exporters, the faster you get crashes)
  4. Send OTLP metrics through the collector for several minutes
  5. Watch for the collector to crash

Expected Result

Collector does not crash

Actual Result

Collector crashes

Collector version

0.94.0

Environment information

Environment

Kubernetes deployment via helm chart version 0.81.1.
Running in AWS/EKS, on Graviton3 processors

OpenTelemetry Collector configuration

mode: daemonset
service:
  enabled: true

resources:
  limits:
    cpu: 200m
    memory: 512Mi
  requests:
    cpu: 100m
    memory: 256Mi

presets:
  kubernetesAttributes:
    enabled: true
  logsCollection:
    enabled: false
  kubeletMetrics:
    enabled: true

# Adding a comment here to trigger the helm deployment
config:
  extensions:
    headers_setter:
      headers:
        - action: upsert
          key: x-honeycomb-dataset
          from_context: x-honeycomb-dataset
  receivers:
    jaeger: null
    zipkin: null
    otlp:
      protocols:
        grpc:
          endpoint: ${env:MY_POD_IP}:4317
          include_metadata: true
        http:
          endpoint: ${env:MY_POD_IP}:4318
          include_metadata: true
    kubeletstats:
      collection_interval: 30s
      metrics:
        k8s.node.uptime:
          enabled: true
        k8s.pod.uptime:
          enabled: true
        container.uptime:
          enabled: true
        k8s.container.cpu_limit_utilization:
          enabled: true
        k8s.container.cpu_request_utilization:
          enabled: true
        k8s.container.memory_limit_utilization:
          enabled: true
        k8s.container.memory_request_utilization:
          enabled: true
        k8s.pod.cpu_limit_utilization:
          enabled: true
        k8s.pod.cpu_request_utilization:
          enabled: true
        k8s.pod.memory_limit_utilization:
          enabled: true
        k8s.pod.memory_request_utilization:
          enabled: true
    prometheus:
      config:
        scrape_configs:
        - job_name: opentelemetry-collector
          scrape_interval: 30s
          static_configs:
          - targets:
            - ${env:MY_POD_IP}:8888
  processors:
    batch:
      metadata_keys: 
        - x-honeycomb-dataset
      metadata_cardinality_limit: 30
    k8sattributes:
      extract:
        annotations:
        - from: pod
          key_regex: (.*)
          tag_name: $$1
        - from: node
          key_regex: (.*)
          tag_name: $$1
        labels:
        - from: pod
          key_regex: (.*)
          tag_name: $$1
        - from: node
          key_regex: (.*)
          tag_name: $$1
      passthrough: false
      pod_association:
      - sources:
        - from: resource_attribute
          name: k8s.pod.ip
      - sources:
        - from: resource_attribute
          name: k8s.pod.uid
      - sources:
        - from: connection
    attributes:
      include:
        match_type: strict
        services:
          - frontend-proxy
      actions:
        - key: net.component
          value: proxy
          action: insert
    transform:
      error_mode: ignore
      trace_statements:
        - context: span
          statements:
            - set(attributes["k8s.cluster.name"], "cs-k8s-sandbox")
            - set(attributes["http.response.status_code"], attributes["http.status_code"]) where attributes["http.status_code"] != nil and attributes["http.response.status_code"] == nil
        - context: spanevent
          statements:
            - set(attributes["k8s.cluster.name"], "cs-k8s-sandbox")
  exporters:
    otlp/unrefined:
      endpoint: "api.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/refined:
      # sends to prrrod sampled environment on the ca team slack
      endpoint: "refinery.carefinery:4317"
      tls:
        insecure: true
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/dogfood-unrefined:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/eu-unrefined:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/eu-refined:
      # sends to eu-prrrod sampled environment on the EU1 ca team slack
      endpoint: "hnytest.refinery.eu1.honeydemo.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/dataset_hs_traffic:
      endpoint: "api.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/dataset_hs_traffic2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/dataset_hs_traffic-dogfood:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/eu-dataset_hs_traffic:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/eu-dataset_hs_traffic2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/k8sMetrics:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/dogfood-k8sMetrics:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/k8sMetrics2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/eu-k8sMetrics:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/eu-k8sMetrics2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/otelColMetrics:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/dogfood-otelColMetrics:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/otelColMetrics2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/eu-otelColMetrics:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/eu-otelColMetrics2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/k8slogs:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/dogfood-k8slogs:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/k8slogs2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/eu-k8slogs:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/eu-k8slogs2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
  service:
    telemetry:
      logs:
        level: DEBUG
        initial_fields:
          service: otel-daemonset
    extensions:
      - headers_setter
      - health_check
      - memory_ballast
    pipelines:
      traces:
        receivers: [ otlp ]
        processors: [ k8sattributes, transform, attributes, batch]
        exporters: [ otlp/unrefined, otlp/eu-unrefined, otlp/refined, otlp/eu-refined, otlp/dogfood-unrefined ]
      metrics:
        receivers: [ otlp ]
        processors: [ k8sattributes, batch ]
        exporters: [ otlp/dataset_hs_traffic, otlp/dataset_hs_traffic2, otlp/eu-dataset_hs_traffic, otlp/eu-dataset_hs_traffic2, otlp/dataset_hs_traffic-dogfood ]
      logs:
        receivers: [ otlp ]
        processors: [ k8sattributes, batch ]
        exporters: [ otlp/dataset_hs_traffic, otlp/dataset_hs_traffic2, otlp/eu-dataset_hs_traffic, otlp/eu-dataset_hs_traffic2, otlp/dataset_hs_traffic-dogfood ]
      metrics/k8s:
        receivers: [ kubeletstats ]
        processors: [ k8sattributes, transform, batch ]
        exporters: [ otlp/k8sMetrics, otlp/k8sMetrics2, otlp/eu-k8sMetrics, otlp/eu-k8sMetrics2, otlp/dogfood-k8sMetrics ]
      metrics/otelcol:
        receivers: [ prometheus ]
        processors: [ k8sattributes, transform, batch ]
        exporters: [ otlp/otelColMetrics, otlp/otelColMetrics2, otlp/eu-otelColMetrics, otlp/eu-otelColMetrics2, otlp/dogfood-otelColMetrics ]
      # logs/k8s:
      #   receivers: [ filelog ]
      #   processors: [ k8sattributes, batch ]
      #   exporters: [ otlp/k8slogs, otlp/k8slogs2, otlp/eu-k8slogs, otlp/eu-k8slogs2, otlp/dogfood-k8slogs ]

ports:
  otlp:
    enabled: true
    containerPort: 4317
    servicePort: 4317
    hostPort: 4317
    protocol: TCP
    appProtocol: grpc
  otlp-http:
    enabled: true
    containerPort: 4318
    servicePort: 4318
    hostPort: 4318
    protocol: TCP
  jaeger-compact:
    enabled: false
  jaeger-thrift:
    enabled: false
  jaeger-grpc:
    enabled: false
  zipkin:
    enabled: false
  metrics:
    # The metrics port is disabled by default. However you need to enable the port
    # in order to use the ServiceMonitor (serviceMonitor.enabled) or PodMonitor (podMonitor.enabled).
    enabled: true
    containerPort: 8888
    servicePort: 8888
    protocol: TCP

clusterRole:
  create: true
  rules:
    - apiGroups: 
        - ""
      resources:
        - nodes/proxy
      verbs:
        - get
    - apiGroups:
        - ""
      resources:
        - nodes
      verbs:
        - get
        - watch
        - list

Log output

Will add stack trace as comments, as it's 7200 lines long and causes this submission to fail.

Additional context

Have tried duplicating the extension and using the second extension for a second exporter, but still got a crash/restart of the pod.
@tdarwin tdarwin added bug Something isn't working needs triage New item requiring triage labels Feb 15, 2024
@tdarwin
Copy link
Author

tdarwin commented Feb 15, 2024

Log output part 1

fatal error: concurrent map writes

goroutine 616 [running]:
go.opentelemetry.io/collector/client.Metadata.Get({0x0?}, {0x4002a01488, 0x13})
	go.opentelemetry.io/collector@v0.94.1/client/client.go:158 +0x13c
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension/internal/source.(*ContextSource).Get(0x4002dbea20, {0x85cbe38?, 0x40054a02a0?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension@v0.94.0/internal/source/context.go:21 +0xd0
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension.(*headersPerRPC).GetRequestMetadata(0x40033439c8, {0x85cbe38, 0x40054a02a0}, {0x30?, 0x30?, 0x6f0e5c0?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension@v0.94.0/extension.go:90 +0xc4
google.golang.org/grpc/internal/transport.(*http2Client).getTrAuthData(0x40038d1440, {0x85cbe38, 0x40054a02a0}, {0x4005233f80, 0x52})
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:630 +0x114
google.golang.org/grpc/internal/transport.(*http2Client).createHeaderFields(0x40038d1440, {0x85cbe38, 0x40054a0270}, 0x40031c6ec8)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:512 +0xd0
google.golang.org/grpc/internal/transport.(*http2Client).NewStream(0x40038d1440, {0x85cbe38, 0x40054a01e0}, 0x40053f84e0)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:721 +0x144
google.golang.org/grpc.(*csAttempt).newStream(0x40053c8b60)
	google.golang.org/grpc@v1.61.0/stream.go:504 +0x94
google.golang.org/grpc.newClientStreamWithParams.func2(0x40053c8b60)
	google.golang.org/grpc@v1.61.0/stream.go:354 +0x34
google.golang.org/grpc.(*clientStream).withRetry(0x4005279b00, 0x4007814af0, 0x40031c7268)
	google.golang.org/grpc@v1.61.0/stream.go:778 +0x188
google.golang.org/grpc.newClientStreamWithParams({0x85cbe38, 0x40053d1fb0}, 0xde3e560, 0x40035fe380, {0x783f923, 0x39}, {0x0, 0x0, 0x0, 0x0, ...}, ...)
	google.golang.org/grpc@v1.61.0/stream.go:363 +0x9d4
google.golang.org/grpc.newClientStream.func3({0x85cbe38?, 0x40053d1fb0?}, 0x40053d1fb0?)
	google.golang.org/grpc@v1.61.0/stream.go:220 +0x6c
google.golang.org/grpc.newClientStream({0x85cbe38, 0x40053d1fb0}, 0xde3e560, 0x40035fe380, {0x783f923, 0x39}, {0x4002dff320, 0x2, 0x1?})
	google.golang.org/grpc@v1.61.0/stream.go:255 +0x628
google.golang.org/grpc.invoke({0x85cbe38?, 0x40053d1fb0?}, {0x783f923?, 0x4003602630?}, {0x7242c80, 0x4006739f80}, {0x7242dc0, 0x40068213c8}, 0x40068213c8?, {0x4002dff320?, ...})
	google.golang.org/grpc@v1.61.0/call.go:66 +0x68
google.golang.org/grpc.(*ClientConn).Invoke(0x40035fe380?, {0x85cbe38?, 0x40053d1fb0?}, {0x783f923?, 0x39?}, {0x7242c80?, 0x4006739f80?}, {0x7242dc0?, 0x40068213c8?}, {0x4003602ba0?, ...})
	google.golang.org/grpc@v1.61.0/call.go:37 +0x1a4
go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/logs/v1.(*logsServiceClient).Export(0x4002f77710, {0x85cbe38, 0x40053d1fb0}, 0xde95160?, {0x4003602ba0, 0x1, 0x1})
	go.opentelemetry.io/collector/pdata@v1.1.0/internal/data/protogen/collector/logs/v1/logs_service.pb.go:272 +0x8c
go.opentelemetry.io/collector/pdata/plog/plogotlp.(*grpcClient).Export(0x10?, {0x85cbe38?, 0x40053d1fb0?}, {0x4006739f80?, 0x40050d2148?}, {0x4003602ba0?, 0x40031c76c8?, 0xb4f38?})
	go.opentelemetry.io/collector/pdata@v1.1.0/plog/plogotlp/grpc.go:42 +0x48
go.opentelemetry.io/collector/exporter/otlpexporter.(*baseExporter).pushLogs(0x4002d75b00, {0x85cbee0?, 0x4001b60e00?}, {0x4006739f80?, 0x40050d2148?})
	go.opentelemetry.io/collector/exporter/otlpexporter@v0.94.1/otlp.go:127 +0x8c
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsRequest).Export(0x85cbe38?, {0x85cbee0?, 0x4001b60e00?})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/logs.go:59 +0x40
go.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send(0x40053f2c00?, {0x85cbe38?, 0x40053d1f80?}, {0x8582b98, 0x4006821380})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/timeout_sender.go:49 +0xa0
go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send(0x4002dd25a0, {0x85cbe38, 0x40053d1f80}, {0x8582b98, 0x4006821380})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/retry_sender.go:89 +0x334
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsExporterWithObservability).send(0x4002de3920, {0x85cc310?, 0x4007814a00?}, {0x8582b98?, 0x4006821380?})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/logs.go:171 +0x74
go.opentelemetry.io/collector/exporter/exporterhelper.newQueueSender.func1({0x85cc310?, 0x4007814a00?}, {0x8582b98?, 0x4006821380?})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/queue_sender.go:95 +0x78
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:57 +0xa4
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 1 [select, 1 minutes]:
go.opentelemetry.io/collector/otelcol.(*Collector).Run(0x40028a19a0, {0x85ca9c0, 0xde95160})
	go.opentelemetry.io/collector/otelcol@v0.94.1/collector.go:245 +0x1e8
go.opentelemetry.io/collector/otelcol.NewCommand.func1(0x400006af00, {0x7693196?, 0x7?, 0x768b84b?})
	go.opentelemetry.io/collector/otelcol@v0.94.1/command.go:27 +0x8c
github.com/spf13/cobra.(*Command).execute(0x400006af00, {0x40001ba090, 0x1, 0x1})
	github.com/spf13/cobra@v1.8.0/command.go:983 +0x840
github.com/spf13/cobra.(*Command).ExecuteC(0x400006af00)
	github.com/spf13/cobra@v1.8.0/command.go:1115 +0x344
github.com/spf13/cobra.(*Command).Execute(0x7a194e0?)
	github.com/spf13/cobra@v1.8.0/command.go:1039 +0x1c
main.runInteractive({0x7a194e0, {{0x76bed6c, 0xf}, {0x775685a, 0x1f}, {0x768f95a, 0x6}}, 0x0, {0x0, 0x0}, ...})
	github.com/open-telemetry/opentelemetry-collector-releases/contrib/main.go:27 +0x90
main.run(...)
	github.com/open-telemetry/opentelemetry-collector-releases/contrib/main_others.go:10
main.main()
	github.com/open-telemetry/opentelemetry-collector-releases/contrib/main.go:20 +0xe0

goroutine 19 [chan receive]:
k8s.io/klog.(*loggingT).flushDaemon(0x0?)
	k8s.io/klog@v1.0.0/klog.go:1010 +0x5c
created by k8s.io/klog.init.0 in goroutine 1
	k8s.io/klog@v1.0.0/klog.go:411 +0x110

goroutine 6 [select]:
go.opencensus.io/stats/view.(*worker).start(0x4000128c00)
	go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x88
created by go.opencensus.io/stats/view.init.0 in goroutine 1
	go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x98

goroutine 7 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x40018b8910, 0x0)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40018b8900)
	sync/cond.go:70 +0xcc
github.com/cihub/seelog.(*asyncLoopLogger).processItem(0x400010c510)
	github.com/cihub/seelog@v0.0.0-20170130134532-f561c5e57575/behavior_asynclooplogger.go:50 +0x90
github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0x400010c510)
	github.com/cihub/seelog@v0.0.0-20170130134532-f561c5e57575/behavior_asynclooplogger.go:63 +0x38
created by github.com/cihub/seelog.NewAsyncLoopLogger in goroutine 1
	github.com/cihub/seelog@v0.0.0-20170130134532-f561c5e57575/behavior_asynclooplogger.go:40 +0xc8

goroutine 8 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x40018b8a90, 0x0)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40018b8a80)
	sync/cond.go:70 +0xcc
github.com/cihub/seelog.(*asyncLoopLogger).processItem(0x400010c630)
	github.com/cihub/seelog@v0.0.0-20170130134532-f561c5e57575/behavior_asynclooplogger.go:50 +0x90
github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0x400010c630)
	github.com/cihub/seelog@v0.0.0-20170130134532-f561c5e57575/behavior_asynclooplogger.go:63 +0x38
created by github.com/cihub/seelog.NewAsyncLoopLogger in goroutine 1
	github.com/cihub/seelog@v0.0.0-20170130134532-f561c5e57575/behavior_asynclooplogger.go:40 +0xc8

goroutine 9 [select]:
github.com/DataDog/datadog-agent/pkg/trace/metrics/timing.(*Set).Autoreport.func1()
	github.com/DataDog/datadog-agent/pkg/trace@v0.50.2/metrics/timing/timing.go:59 +0xd0
created by github.com/DataDog/datadog-agent/pkg/trace/metrics/timing.(*Set).Autoreport in goroutine 1
	github.com/DataDog/datadog-agent/pkg/trace@v0.50.2/metrics/timing/timing.go:54 +0xa0

goroutine 64 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0xffff5e042220, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002256a80?, 0x35350?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x4002256a80)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x4002256a80)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x400222d600)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x400222d600)
	net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4001d5a5a0, {0x85ab140, 0x400222d600})
	net/http/server.go:3056 +0x2b8
net/http.(*Server).ListenAndServe(0x4001d5a5a0)
	net/http/server.go:2985 +0x84
go.opentelemetry.io/collector/service/internal/proctelemetry.InitPrometheusServer.func1()
	go.opentelemetry.io/collector/service@v0.94.1/internal/proctelemetry/config.go:150 +0x28
created by go.opentelemetry.io/collector/service/internal/proctelemetry.InitPrometheusServer in goroutine 1
	go.opentelemetry.io/collector/service@v0.94.1/internal/proctelemetry/config.go:149 +0x1ac

goroutine 81 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e042128, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002e89180?, 0x0?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x4002e89180)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x4002e89180)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x400316ba20)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x400316ba20)
	net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4001d5ab40, {0x85ab140, 0x400316ba20})
	net/http/server.go:3056 +0x2b8
github.com/open-telemetry/opentelemetry-collector-contrib/extension/healthcheckextension.(*healthCheckExtension).Start.func1()
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/healthcheckextension@v0.94.0/healthcheckextension.go:56 +0x6c
created by github.com/open-telemetry/opentelemetry-collector-contrib/extension/healthcheckextension.(*healthCheckExtension).Start in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/healthcheckextension@v0.94.0/healthcheckextension.go:52 +0x698

goroutine 82 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3550, {0x85cbe70, 0x40031aee60})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 83 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3580, {0x85cbe70, 0x40031aeeb0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 84 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e35b0, {0x85cbe70, 0x40031aef00})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 847 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d1f90, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a380)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 623
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 86 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 87 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 88 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 89 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 90 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 91 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 92 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 93 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 94 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 95 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 900 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda9b0, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b9d0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 324
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 96 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3e80, {0x85cbe70, 0x40031af130})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 97 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3eb0, {0x85cbe70, 0x40031af180})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 98 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3ee0, {0x85cbe70, 0x40031af1d0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 916 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40029c8300, 0x4001c4eb00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400370001c?, 0x40036707b0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 526
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 100 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 101 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 102 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 103 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 104 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 105 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 106 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 107 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 108 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 109 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 927 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4001c8c040)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 925
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 254 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2f00, 0x85cbe38?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 261
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 167 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247e90, {0x85cbe70, 0x400327a410})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 111 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032466c0, {0x85cbe70, 0x40031af590})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 112 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032466f0, {0x85cbe70, 0x40031af5e0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 113 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246720, {0x85cbe70, 0x40031af630})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 907 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c378, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a5800?, 0x400267a800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a5800, {0x400267a800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a5800, {0x400267a800?, 0x4002fe1828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77040, {0x400267a800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x40067f3b78, {0x400267a800?, 0x40067f3b78?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b7ea8, {0x8550b20, 0x40067f3b78})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b7c00, {0x854dee0?, 0x4002f77040}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b7c00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b7c00, {0x4003142000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c87260, {0x4003693540, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c87260}, {0x4003693540, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693540, 0x9, 0x12c06ac236?}, {0x854a860?, 0x4002c87260?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003693500)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40022c8900, 0x4002a758c0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 576
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 115 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 116 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 117 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 118 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 119 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 120 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 121 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 122 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 123 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 124 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 861 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d5680, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038bafc0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 489
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 168 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247ec0, {0x85cbe70, 0x400327a460})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 909 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c568, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a5700?, 0x4002679000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a5700, {0x4002679000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a5700, {0x4002679000?, 0x40037ac828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77050, {0x4002679000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x40067f3b90, {0x4002679000?, 0x40067f3b90?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4002084628, {0x8550b20, 0x40067f3b90})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4002084380, {0x854dee0?, 0x4002f77050}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4002084380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4002084380, {0x400275e000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c873e0, {0x4003693620, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c873e0}, {0x4003693620, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693620, 0x9, 0x12c07236dc?}, {0x854a860?, 0x4002c873e0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036935e0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40022c8b40, 0x4002f77e58?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 653
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 951 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002260648, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002260638)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002260630, {0x40037fa001, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fa001?, 0x4007c99ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052dfa40)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052dfa40)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052dfa40, {0x65704e0, 0x4001bbe798})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af290, {0x4003071000, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96550, 0x4004470000?, {0x8587d88, 0x400444acc0})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d220)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c56b00)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 256
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 243 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041d48, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003316100?, 0x400331a000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003316100, {0x400331a000, 0x8000, 0x8000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003316100, {0x400331a000?, 0x1?, 0x801010601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f76f88, {0x400331a000?, 0xffff5dd97360?, 0x8594130?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4003312600, {0x4003202740, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003312600}, {0x4003202740, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003202740, 0x9, 0x13395f9906?}, {0x854a860?, 0x4003312600?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003202700)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003232240, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 85
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 128 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246f60, {0x85cbe70, 0x40031afa90})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 129 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246f90, {0x85cbe70, 0x40031afae0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 130 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246fc0, {0x85cbe70, 0x40031afb30})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 886 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4000112460, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a5b0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 271
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 79 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 80 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 145 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 146 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 147 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 148 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 149 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 150 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 151 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 152 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 816 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d4870, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038ba9a0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 475
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 319 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c829c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c829b8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c829a0, 0x40033b3520)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab540)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398a68?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032a41a0?, {0x8554bc0, 0x400351c090}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032dfa40?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab540, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8c9a0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:188 +0x298

goroutine 304 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003273728?, {0x8554bc0, 0x4003331470}, 0x1, 0x40033251a0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003273778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad320)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 254
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 131 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247430, {0x85cbe70, 0x40031afc70})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 132 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247460, {0x85cbe70, 0x40031afcc0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 133 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247490, {0x85cbe70, 0x40031afd10})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 946 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4004e94c00, 0x4000164b00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400365ca38?, 0x40036457b0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 734
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 135 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 136 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 137 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 138 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 139 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 140 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 141 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 142 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 143 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 144 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 956 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x400662e780, 0x400358a400)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002de001c?, 0x4003641fb0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 295
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 795 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de36000, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521580?, 0x40036da000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521580, {0x40036da000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521580, {0x40036da000?, 0x400384e828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77aa8, {0x40036da000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd608, {0x40036da000?, 0x4002dbd608?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ff7a8, {0x8550b20, 0x4002dbd608})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ff500, {0x854dee0?, 0x4002f77aa8}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ff500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ff500, {0x4003816000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40036fede0, {0x40036922e0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40036fede0}, {0x40036922e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036922e0, 0x9, 0xe633e6323?}, {0x854a860?, 0x40036fede0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036922a0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40036958c0, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 352
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 166 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247e60, {0x85cbe70, 0x400327a3c0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 156 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228b670, {0x85cbe70, 0x40022da9b0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 157 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228b6a0, {0x85cbe70, 0x40022daa00})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 158 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228b6d0, {0x85cbe70, 0x40022daa50})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 949 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40052fa7c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40052fa7b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40052fa7b0, {0x40037ca001, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037ca001?, 0x4007c27ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052df7c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052df7c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052df7c0, {0x65704e0, 0x4001bbe7f8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af140, {0x4002f7d000, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96460, 0x40052c2b00?, {0x8587d88, 0x400444aec0})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d1e0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c569c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 714
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 160 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 177 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 178 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 179 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 180 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 181 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 182 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 183 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 184 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 185 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 186 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228bf10, {0x85cbe70, 0x40022dadc0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 187 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228bf40, {0x85cbe70, 0x40022dae10})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 188 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228bf70, {0x85cbe70, 0x40022dae60})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 898 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda7d0, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b960)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 99
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 190 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 191 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 192 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 193 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 194 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 195 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 196 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 197 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 198 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 199 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 200 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032ce690, {0x85cbe70, 0x40022db090})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 201 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032ce6c0, {0x85cbe70, 0x40022db0e0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 202 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032ce6f0, {0x85cbe70, 0x40022db130})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 859 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d5590, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038baf50)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 609
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 204 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 205 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 206 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 207 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 208 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 209 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 210 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 211 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 212 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 213 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 996 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041a60, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40027eaf00?, 0x4006e00000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40027eaf00, {0x4006e00000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40027eaf00, {0x4006e00000?, 0x4006739830?, 0x401000301?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000115290, {0x4006e00000?, 0x4003afebb8?, 0x18124?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006c7c540, {0x40065f5380, 0x9, 0x400362e780?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006c7c540}, {0x40065f5380, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40065f5380, 0x9, 0x40067f2180?}, {0x854a860?, 0x4006c7c540?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40065f5340)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x400326a340, {0x85cbe38, 0x4006d30bd0}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x400326a340}, {0x85f1f18?, 0x4000115290?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 984
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 855 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d4c30, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038baa80)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 203
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 215 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 216 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 217 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 218 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 219 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 220 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 221 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 222 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 223 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 224 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 225 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032cf310, {0x85cbe70, 0x40022db720})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 226 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032cf340, {0x85cbe70, 0x40022db770})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 227 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032cf370, {0x85cbe70, 0x40022db7c0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 971 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041968, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40025c3b00?, 0x4006b38000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40025c3b00, {0x4006b38000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40025c3b00, {0x4006b38000?, 0x40049dda58?, 0xf95dc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002960770, {0x4006b38000?, 0x40049ddaa8?, 0x4006b2cfc8?})
	net/net.go:179 +0x34
net/http.(*connReader).Read(0x4006b2cfc0, {0x4006b38000, 0x1000, 0x1000})
	net/http/server.go:791 +0x224
bufio.(*Reader).fill(0x4006b0aba0)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x4006b0aba0, 0x4)
	bufio/bufio.go:151 +0x60
net/http.(*conn).serve(0x40067f5c20, {0x85cbe38, 0x40037050b0})
	net/http/server.go:2044 +0x64c
created by net/http.(*Server).Serve in goroutine 667
	net/http/server.go:3086 +0x4cc

goroutine 229 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 230 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 231 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 232 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 233 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 234 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 235 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 236 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 237 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 238 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 422 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003514000)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 409
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 239 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x40032fe9c0, 0x83394?, 0x40032d8840?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:93 +0x26c

goroutine 299 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033bbf28?, {0x8554bc0, 0x40033312f0}, 0x1, 0x4003324f60)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40033bbf78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad440)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 265
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 257 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033b21d0, {0x85cbe70, 0x40033a2ff0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 258 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033b2200, {0x85cbe70, 0x40033a3040})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 259 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033b2230, {0x85cbe70, 0x40033a3090})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 260 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82708, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c826f8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c826e0, 0x40033b2a30)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033aadc0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40033985e8?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032ffa00?, {0x8554bc0, 0x40033aedb0}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032df260?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033aadc0, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c822c0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:188 +0x298

goroutine 261 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8c708, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8c6f8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8c6e0, 0x4003322250)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x4003201680)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40031ddef0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032ffba0?, {0x8554bc0, 0x40033304b0}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40031f1b30?, 0x3b9aca00, 0x0, 0x20?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x4003201680, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c82370, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:198 +0x514

goroutine 262 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8c868, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8c858)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8c840, 0x4003322630)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40032017c0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003342048?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032ffd40?, {0x8554bc0, 0x4003330960}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40031f1d00?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40032017c0, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c82420, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:209 +0x79c

goroutine 263 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c825a8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82598)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82580, 0x40033b2390)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033aab40)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398468?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033ce000?, {0x8554bc0, 0x40033ae750}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032def40?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033aab40, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c824d0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:221 +0xa04

goroutine 265 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2fa0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 263
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 244 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x400327a820, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40032172d0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 85
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 266 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 263
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 267 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x400208e1c0}, {0xffff5de359d0, 0x4001c82580}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019260, {0x0?, 0x0?}, 0x40032bfbc0, 0x40033bb548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019260, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82580?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4002233a80?, {0x8554be0, 0x40033a30e0}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019260, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 263
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 862 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019260, 0x40032bfbc0, 0x4002b0d620, 0x4003694480?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 267
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 878 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4001f98048, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001f98038)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4001f98030, {0x400268c001, 0x3dff, 0x3dff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x400268c001?, 0x40078ffca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40031a6a00)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40031a6a00)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40031a6a00, {0x65704e0, 0x400305a540})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4f60, {0x4002690000, 0x4000, 0x5000})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400183c0a0, 0x400308d4d0?, {0x8587d88, 0x40045c3d40})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40025d60a0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c7c9c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 544
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 936 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40060ef248, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40060ef238)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40060ef230, {0x4002b68601, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002b68601?, 0x4007c1dca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40060d7180)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40060d7180)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40060d7180, {0x65704e0, 0x400318b6e0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40060db260, {0x40032a2400, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400203f950, 0x4000155600?, {0x8587d88, 0x4001fe3680})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400621c820)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x40032efa80)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 411
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 903 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35b28, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40038da000?, 0x400264c800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40038da000, {0x400264c800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40038da000, {0x400264c800?, 0x4003686828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6170, {0x400264c800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006810570, {0x400264c800?, 0x4006810570?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x400205e628, {0x8550b20, 0x4006810570})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x400205e380, {0x854dee0?, 0x40022c6170}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x400205e380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x400205e380, {0x4002806000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276a900, {0x4003693460, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276a900}, {0x4003693460, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693460, 0x9, 0x12bcb3341d?}, {0x854a860?, 0x400276a900?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003693420)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a758c0, 0x4003686fb0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 530
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 272 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 273 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 274 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 275 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 276 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 277 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 278 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 279 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 280 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 281 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 305 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033dff28?, {0x8554bc0, 0x40033af230}, 0x1, 0x40033c0a20)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40033dff78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad290)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 283
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 283 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2eb0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 260
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 284 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 260
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 285 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x40001383c0}, {0xffff5de359d0, 0x4001c826e0}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019420, {0x0?, 0x0?}, 0x40032bfbc0, 0x4003384548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019420, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c826e0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4002233cc0?, {0x8554be0, 0x40033a32c0}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019420, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 260
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 869 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019420, 0x40032bfbc0, 0x40032beb40, 0x4002f77e48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 285
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 255 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 261
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 256 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c56b00}, {0xffff5de359d0, 0x4002e8c6e0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40032027e0, {0x0?, 0x0?}, 0x40032bfbc0, 0x40033ba548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40032027e0, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8c6e0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003153a00?, {0x8554be0, 0x400327ab40}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40032027e0, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 261
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 838 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40032027e0, 0x40032bfbc0, 0x400018e840, 0x4003504fb0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 256
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 1005 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x400719e5c0)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 983
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 924 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002dcad80, 0x400377e400)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400365dfc8?, 0x400375f7b0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 558
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 858 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041e40, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521d80?, 0x40037ec800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521d80, {0x40037ec800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521d80, {0x40037ec800?, 0x400385a828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6920, {0x40037ec800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006810438, {0x40037ec800?, 0x4006810438?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b70a8, {0x8550b20, 0x4006810438})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6e00, {0x854dee0?, 0x40022c6920}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6e00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6e00, {0x4002020000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4001b29e00, {0x4003736580, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4001b29e00}, {0x4003736580, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736580, 0x9, 0x12bc672537?}, {0x854a860?, 0x4001b29e00?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736540)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d1440, 0x40038d1200?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 609
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 306 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad290)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 283
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 839 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002260600, 0x400382cd00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 256
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 322 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003272728?, {0x8554bc0, 0x40033314a0}, 0x1, 0x4003325200)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003272778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad3b0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 293
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 293 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2f50, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 262
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 294 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 262
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 295 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x40033edf40}, {0xffff5de359d0, 0x4002e8c840}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40032029a0, {0x0?, 0x0?}, 0x40032bfbc0, 0x40033bad48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40032029a0, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8c840?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003153a80?, {0x8554be0, 0x400327abe0}, 0x1, 0x40032bfbc0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40032029a0, 0x40032bfbc0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 262
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 955 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40032029a0, 0x40032bfbc0, 0x400357fda0, 0x400360cfb0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 295
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 995 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x400326a340)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 984
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 830 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de362e8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521280?, 0x40036db800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521280, {0x40036db800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521280, {0x40036db800?, 0x4003863828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77aa0, {0x40036db800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400662cc30, {0x40036db800?, 0x400662cc30?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ff428, {0x8550b20, 0x400662cc30})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ff180, {0x854dee0?, 0x4002f77aa0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ff180, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ff180, {0x4001f9c000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003867620, {0x4003692040, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003867620}, {0x4003692040, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692040, 0x9, 0x13397609f4?}, {0x854a860?, 0x4003867620?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692000)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003694000, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 78
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 300 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad440)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 265
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 301 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003322ee0, {0x85cbe70, 0x400327af00})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 302 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003322f10, {0x85cbe70, 0x400327af50})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 303 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003322f40, {0x85cbe70, 0x400327afa0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 321 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad320)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 254
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 323 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad3b0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 293
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 913 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002d51cc8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002d51cb8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002d51cb0, {0x40020da001, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40020da001?, 0x4007c25ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d49040)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d49040)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d49040, {0x65704e0, 0x400318a198})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0600, {0x40037be800, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af310, 0x4002104180?, {0x8587d88, 0x4007793a40})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f900c0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc340)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 684
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 325 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 326 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 327 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 328 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 329 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 330 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 331 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 332 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 333 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 334 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 335 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033237b0, {0x85cbe70, 0x400327b310})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 336 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033237e0, {0x85cbe70, 0x400327b360})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 337 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003323810, {0x85cbe70, 0x400327b3b0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 877 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x400284ec48, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x400284ec38)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x400284ec30, {0x4002606001, 0x3dff, 0x3dff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002606001?, 0x4007bfdca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40031a63c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40031a63c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40031a63c0, {0x65704e0, 0x400305a558})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4ab0, {0x400261b000, 0x4000, 0x5000})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400018d4f0, 0x400308d560?, {0x8587d88, 0x40045c3d80})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001c01dc0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c6e840)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 397
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 339 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 340 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 341 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 342 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 343 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 344 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 345 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 346 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 347 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 348 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 349 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366040, {0x85cbe70, 0x400327b720})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 350 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366070, {0x85cbe70, 0x400327b770})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 351 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033660a0, {0x85cbe70, 0x400327b7c0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 967 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40031da000)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 965
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 353 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 354 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 355 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 356 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 357 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 358 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 359 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 360 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 361 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 362 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 363 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033668e0, {0x85cbe70, 0x400327bb30})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 364 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366910, {0x85cbe70, 0x400327bb80})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 365 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366940, {0x85cbe70, 0x400327bbd0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 810 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d44b0, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038baa10)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 825
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 367 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 368 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 369 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 370 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 371 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 372 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 373 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 374 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 375 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 376 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 377 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003375ba0, 0x83394?, 0x4003249080?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:93 +0x26c

goroutine 415 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40033e2680?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003384728?, {0x8554bc0, 0x400351cdb0}, 0x1, 0x4003540060)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40033847a8?, 0x3b9aca00, 0x0, 0x38?, 0x4003384778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003514090)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 388
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 379 [select]:
go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1()
	go.opentelemetry.io/collector/receiver@v0.94.1/scraperhelper/scrapercontroller.go:174 +0x108
created by go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping in goroutine 1
	go.opentelemetry.io/collector/receiver@v0.94.1/scraperhelper/scrapercontroller.go:158 +0x5c

goroutine 320 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82b28, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82b18)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82b00, 0x40033b3900)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab680)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398bb8?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e31e0?, {0x8554bc0, 0x400351c540}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032dfd00?, 0x3b9aca00, 0x0, 0x40?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab680, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8ca50, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:198 +0x514

goroutine 385 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82c88, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82c78)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82c60, 0x40033b3ce0)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab7c0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398d08?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e3380?, {0x8554bc0, 0x400351c9f0}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032dfed0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab7c0, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cb00, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:209 +0x79c

goroutine 386 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82868, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82858)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82840, 0x40033b3140)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab400)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398918?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e3520?, {0x8554bc0, 0x40033afbc0}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032df780?, 0x3b9aca00, 0x0, 0x40?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab400, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cbb0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:221 +0xa04

goroutine 388 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034993b0, 0x83394?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 386
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 389 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 386
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 390 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc2c0}, {0xffff5de359d0, 0x4001c82840}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40000195e0, {0x0?, 0x0?}, 0x40033767e0, 0x40033ba548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40000195e0, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82840?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a000?, {0x8554be0, 0x40033a39f0}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40000195e0, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 386
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 871 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40000195e0, 0x40033767e0, 0x40033c0b40, 0x40032717b0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 390
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 1092 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8bda8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40030f4580?, 0x40042c8000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40030f4580, {0x40042c8000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40030f4580, {0x40042c8000?, 0x40028b2be8?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40001b7700, {0x40042c8000?, 0x40028b2d38?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4003697020, {0x4003202200, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003697020}, {0x4003202200, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003202200, 0x9, 0x40029793c8?}, {0x854a860?, 0x4003697020?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40032021c0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40001829c0, {0x85cbe38, 0x4002de30b0}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40001829c0}, {0x85f1f18?, 0x40001b7700?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 1089
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 815 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8bf98, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a4180?, 0x4001aec800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a4180, {0x4001aec800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a4180, {0x4001aec800?, 0x4003860828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c67a0, {0x4001aec800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451d10, {0x4001aec800?, 0x4004451d10?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b6628, {0x8550b20, 0x4004451d10})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6380, {0x854dee0?, 0x40022c67a0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6380, {0x4003af0000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40038d8720, {0x40037362e0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40038d8720}, {0x40037362e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40037362e0, 0x9, 0xfe763fc4a?}, {0x854a860?, 0x40038d8720?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40037362a0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d0b40, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 475
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 417 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e1f28?, {0x8554bc0, 0x400351cde0}, 0x1, 0x40035400c0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40033e1f78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ade60)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 395
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 395 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034992c0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 319
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 396 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 319
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 397 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c6e840}, {0xffff5de359d0, 0x4001c829a0}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40000197a0, {0x0?, 0x0?}, 0x40033767e0, 0x400348ed48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40000197a0, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c829a0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a180?, {0x8554be0, 0x40033a3a90}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40000197a0, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 319
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 917 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40000197a0, 0x40033767e0, 0x4003541500, 0x4002f77e58?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 397
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 966 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4002c2f900, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001cd4e00)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 965
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 1001 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c470, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002e89c00?, 0x4006ef0000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4002e89c00, {0x4006ef0000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4002e89c00, {0x4006ef0000?, 0x4003587a58?, 0xf95dc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002960cb0, {0x4006ef0000?, 0x4003587aa8?, 0x4006eee068?})
	net/net.go:179 +0x34
net/http.(*connReader).Read(0x4006eee060, {0x4006ef0000, 0x1000, 0x1000})
	net/http/server.go:791 +0x224
bufio.(*Reader).fill(0x4006d7f740)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x4006d7f740, 0x4)
	bufio/bufio.go:151 +0x60
net/http.(*conn).serve(0x4006b6e7e0, {0x85cbe38, 0x4002268f00})
	net/http/server.go:2044 +0x64c
created by net/http.(*Server).Serve in goroutine 64
	net/http/server.go:3086 +0x4cc

goroutine 419 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003489728?, {0x8554bc0, 0x400351ce10}, 0x1, 0x4003540120)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003489778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033adef0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 402
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 402 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003499310, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 320
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 403 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 320
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 404 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c56b80}, {0xffff5de359d0, 0x4001c82b00}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019960, {0x0?, 0x0?}, 0x40033767e0, 0x400336bd48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019960, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82b00?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a2c0?, {0x8554be0, 0x40033a3b30}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019960, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 320
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 836 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019960, 0x40033767e0, 0x400018e1e0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 404
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 834 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c090, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a4080?, 0x40036dd000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a4080, {0x40036dd000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a4080, {0x40036dd000?, 0x4003aeb828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6898, {0x40036dd000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd4d0, {0x40036dd000?, 0x4002dbd4d0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b6d28, {0x8550b20, 0x4002dbd4d0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6a80, {0x854dee0?, 0x40022c6898}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6a80, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6a80, {0x4001c5c000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003ad1620, {0x4003692580, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad1620}, {0x4003692580, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692580, 0x9, 0xe61896a8b?}, {0x854a860?, 0x4003ad1620?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692540)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40036946c0, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 338
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 854 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c188, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521f80?, 0x40036de800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521f80, {0x40036de800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521f80, {0x40036de800?, 0x400385f828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6890, {0x40036de800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305a0a8, {0x40036de800?, 0x400305a0a8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b69a8, {0x8550b20, 0x400305a0a8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6700, {0x854dee0?, 0x40022c6890}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6700, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6700, {0x4001fbe000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40038d9da0, {0x40037363c0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40038d9da0}, {0x40037363c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40037363c0, 0x9, 0xe59f6ef2a?}, {0x854a860?, 0x40038d9da0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736380)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d1200, 0x40038d0900?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 203
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 421 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400348af28?, {0x8554bc0, 0x400351ce40}, 0x1, 0x4003540180)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400348af78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003514000)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 409
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 409 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003499360, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 385
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 410 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 385
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 411 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x40032efa80}, {0xffff5de359d0, 0x4001c82c60}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019b20, {0x0?, 0x0?}, 0x40033767e0, 0x40033bad48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019b20, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82c60?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a340?, {0x8554be0, 0x40033a3bd0}, 0x1, 0x40033767e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019b20, 0x40033767e0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 385
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 932 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019b20, 0x40033767e0, 0x4005742fc0, 0x4001c83c30?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 411
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 885 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de365d0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520d00?, 0x4002676000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520d00, {0x4002676000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520d00, {0x4002676000?, 0x4003854828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e60, {0x4002676000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305abb8, {0x4002676000?, 0x400305abb8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cd0a8, {0x8550b20, 0x400305abb8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cce00, {0x854dee0?, 0x4002f77e60}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cce00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cce00, {0x4002b58000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276af60, {0x4003692c80, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276af60}, {0x4003692c80, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692c80, 0x9, 0xe657e694c?}, {0x854a860?, 0x400276af60?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692c40)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74240, 0x40038d1680?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 271
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 832 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041f38, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521e80?, 0x40037e8000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521e80, {0x40037e8000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521e80, {0x40037e8000?, 0x40038a7828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77af0, {0x40037e8000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006821140, {0x40037e8000?, 0x4006821140?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ffea8, {0x8550b20, 0x4006821140})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ffc00, {0x854dee0?, 0x4002f77af0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ffc00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ffc00, {0x40024ea000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003ad1080, {0x4003692120, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad1080}, {0x4003692120, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692120, 0x9, 0x13398fe69a?}, {0x854a860?, 0x4003ad1080?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036920e0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003694480, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 114
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 416 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003514090)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 388
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 418 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ade60)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 395
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 420 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033adef0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 402
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 888 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4000112550, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b7a0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 189
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 948 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40052fa780, 0x400382de00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4001c8c040?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 714
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 380 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367700, {0x85cbe70, 0x4003499400})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 381 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367730, {0x85cbe70, 0x4003499450})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 382 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367760, {0x85cbe70, 0x40034994a0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 894 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda230, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b880)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 159
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 384 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 433 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 434 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 435 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 436 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 437 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 438 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 439 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 440 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 441 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 442 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367f90, {0x85cbe70, 0x4003499810})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 443 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367fc0, {0x85cbe70, 0x4003499860})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 444 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367ff0, {0x85cbe70, 0x40034998b0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 944 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c758, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4001cab100?, 0x400646a000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4001cab100, {0x400646a000, 0xa000, 0xa000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4001cab100, {0x400646a000?, 0x40035c9828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f76d20, {0x400646a000?, 0x40035c9878?, 0x25acbc?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4001bbe978, {0x400646a000?, 0x4001bbe978?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4001fb1b28, {0x8550b20, 0x4001bbe978})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4001fb1880, {0x854dee0?, 0x4002f76d20}, 0xa000?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4001fb1880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4001fb1880, {0x4002cb4000, 0x1000, 0x2f4c8c?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400622d5c0, {0x40060e0c80, 0x9, 0xddb2030?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400622d5c0}, {0x40060e0c80, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
net/http.http2readFrameHeader({0x40060e0c80, 0x9, 0x40067b34a0?}, {0x854a860?, 0x400622d5c0?})
	net/http/h2_bundle.go:1635 +0x58
net/http.(*http2Framer).ReadFrame(0x40060e0c40)
	net/http/h2_bundle.go:1899 +0x78
net/http.(*http2clientConnReadLoop).run(0x40035c9f88)
	net/http/h2_bundle.go:9339 +0xf8
net/http.(*http2ClientConn).readLoop(0x40060ef380)
	net/http/h2_bundle.go:9234 +0x5c
created by net/http.(*http2Transport).newClientConn in goroutine 943
	net/http/h2_bundle.go:7906 +0xabc

goroutine 446 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 447 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 448 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

@tdarwin
Copy link
Author

tdarwin commented Feb 15, 2024

Log output part 2


goroutine 465 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 466 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 467 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 468 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 469 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 470 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 471 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 472 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6700, {0x85cbe70, 0x4003499ae0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 473 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6730, {0x85cbe70, 0x4003499b30})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 474 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6760, {0x85cbe70, 0x4003499b80})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 846 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041398, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fdf00?, 0x400264b000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40035fdf00, {0x400264b000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40035fdf00, {0x400264b000?, 0x4003aed828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6160, {0x400264b000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006810450, {0x400264b000?, 0x4006810450?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x400205e2a8, {0x8550b20, 0x4006810450})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x400205e000, {0x854dee0?, 0x40022c6160}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x400205e000, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x400205e000, {0x400285a000, 0x8000, 0x1f7dc?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276aa20, {0x4003692820, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276aa20}, {0x4003692820, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692820, 0x9, 0x12bc714c5c?}, {0x854a860?, 0x400276aa20?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036927e0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40001638c0, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 623
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 476 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 477 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 478 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 479 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 480 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 481 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 482 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 483 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 484 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 485 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 486 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6f90, {0x85cbe70, 0x4003499ef0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 487 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6fc0, {0x85cbe70, 0x4003499f40})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 488 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6ff0, {0x85cbe70, 0x4003499f90})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 864 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4001d57848, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001d57838)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4001d57830, {0x4003091201, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4003091201?, 0x4007c33ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x400011e640)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x400011e640)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x400011e640, {0x65704e0, 0x400306d5d8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x4001ab1620, {0x40037bf800, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af040, 0x40021b6180?, {0x8587d88, 0x400786f900})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400012a8c0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x400208e1c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 267
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 490 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 491 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 492 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 493 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 494 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 495 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 496 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 497 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 498 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 499 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 500 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c7820, {0x85cbe70, 0x40034ee320})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 501 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c7850, {0x85cbe70, 0x40034ee370})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 502 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c7880, {0x85cbe70, 0x40034ee3c0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 904 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fdaa50, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383ba40)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 530
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 912 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002c46948, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002c46938)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002c46930, {0x4003090c01, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4003090c01?, 0x400364fca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d48f00)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d48f00)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d48f00, {0x65704e0, 0x400306d578})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0570, {0x40037be400, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af2c0, 0x40021b6000?, {0x8587d88, 0x400786f100})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f900a0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc2c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 390
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 914 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x400284e1c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x400284e1b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x400284e1b0, {0x4002b68001, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002b68001?, 0x40033d7ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d49400)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d49400)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d49400, {0x65704e0, 0x400318b620})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0930, {0x40037bec00, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af360, 0x4002104600?, {0x8587d88, 0x4001fe3600})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f90280)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc680)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 694
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 504 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 505 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 506 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 507 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 508 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 509 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 510 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 511 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 512 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 513 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 896 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda690, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b8f0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 134
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 514 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003588b60, 0x83394?, 0x40034f02c0?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:93 +0x26c

goroutine 950 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4004e94c48, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4004e94c38)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4004e94c30, {0x4002b68c01, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002b68c01?, 0x4007c09ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052df900)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052df900)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052df900, {0x65704e0, 0x400318b770})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af1d0, {0x4003070c00, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96500, 0x4000155700?, {0x8587d88, 0x4001fe3700})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d200)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c56a80)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 734
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 973 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d45a0, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001ca3650)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 828
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 968 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041490, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40025c2580?, 0x4006a80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40025c2580, {0x4006a80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40025c2580, {0x4006a80000?, 0x4006811a40?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002960698, {0x4006a80000?, 0x4006811e30?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006831da0, {0x40060e19a0, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006831da0}, {0x40060e19a0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40060e19a0, 0x9, 0x4002cf6768?}, {0x854a860?, 0x4006831da0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40060e1960)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40031da000, {0x85cbe38, 0x40068a33e0}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40031da000}, {0x85f1f18?, 0x4002960698?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 965
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 811 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40036aaea0)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 825
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 876 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40029c8348, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40029c8338)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40029c8330, {0x40037fa601, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fa601?, 0x4007c89ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40031a6280)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40031a6280)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40031a6280, {0x65704e0, 0x4001bbe7b0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4a20, {0x4003ad3c00, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400018d4a0, 0x40021b6300?, {0x8587d88, 0x400444ad40})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001c01da0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c6e7c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 526
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 562 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035abf28?, {0x8554bc0, 0x40035c56e0}, 0x1, 0x4003600300)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035abf78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035b4120)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 524
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 516 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359c650, {0x85cbe70, 0x40034efbd0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 517 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359c680, {0x85cbe70, 0x40034efc20})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 518 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359c6b0, {0x85cbe70, 0x40034efc70})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 519 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8d0a8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8d098)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8d080, 0x400359cea0)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359b860)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40033433e0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003589d40?, {0x8554bc0, 0x40035c4300}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a25c0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359b860, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cc60, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:188 +0x298

goroutine 520 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8d208, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8d1f8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8d1e0, 0x400359d280)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359b9a0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003343530?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035b6000?, {0x8554bc0, 0x40035c47b0}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a2880?, 0x3b9aca00, 0x0, 0xe0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359b9a0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cd10, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:198 +0x514

goroutine 521 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8d368, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8d358)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8d340, 0x400359d660)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359bae0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003343680?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035b61a0?, {0x8554bc0, 0x40035c4c60}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a2a50?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359bae0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cdc0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:209 +0x79c

goroutine 522 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8cf48, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8cf38)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8cf20, 0x400359c810)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359b5e0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003343260?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035b6340?, {0x8554bc0, 0x4003597ce0}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a22b0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359b5e0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8ce70, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:221 +0xa04

goroutine 524 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efb80, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 522
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 525 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 522
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 526 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c6e7c0}, {0xffff5de359d0, 0x4002e8cf20}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003202ee0, {0x0?, 0x0?}, 0x40034fc780, 0x40035ab548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003202ee0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8cf20?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337cc80?, {0x8554be0, 0x40034efcc0}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003202ee0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 522
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 915 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003202ee0, 0x40034fc780, 0x4003540600, 0x4003694480?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 526
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 975 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35c20, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fdc00?, 0x4003c80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40035fdc00, {0x4003c80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40035fdc00, {0x4003c80000?, 0x400384cb80?, 0x17ad4?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77f10, {0x4003c80000?, 0x40068113f8?, 0x4001cc1da0?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x40038d8360, {0x4003736200, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40038d8360}, {0x4003736200, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736200, 0x9, 0x4002cf6210?}, {0x854a860?, 0x40038d8360?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40037361c0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40036ab040, {0x85cbe38, 0x4006b66630}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40036ab040}, {0x85f1f18?, 0x4002f77f10?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 828
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 974 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40036ab040)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 828
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 908 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fdad70, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383bb90)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 576
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 531 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 532 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 533 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 534 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 535 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 536 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 537 [runnable]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 538 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 539 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 540 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 570 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035d5f28?, {0x8554bc0, 0x40035c5950}, 0x1, 0x4003600600)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035d5f78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035a1ef0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 542
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 542 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efa90, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 519
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 543 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 519
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 544 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c7c9c0}, {0xffff5de359d0, 0x4002e8d080}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40032030a0, {0x0?, 0x0?}, 0x40034fc780, 0x40034f8548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40032030a0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8d080?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337cec0?, {0x8554be0, 0x40034efea0}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40032030a0, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 519
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 919 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40032030a0, 0x40034fc780, 0x400370a780, 0x40036707b0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 544
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 895 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de367c0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520a00?, 0x4002648000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520a00, {0x4002648000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520a00, {0x4002648000?, 0x4003859828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e50, {0x4002648000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400662cf00, {0x4002648000?, 0x400662cf00?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cc9a8, {0x8550b20, 0x400662cf00})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cc700, {0x854dee0?, 0x4002f77e50}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cc700, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cc700, {0x4002fa8000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86180, {0x4003693000, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86180}, {0x4003693000, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693000, 0x9, 0x133d888208?}, {0x854a860?, 0x4002c86180?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692fc0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74b40, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 134
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 897 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041778, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a5000?, 0x4002649800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a5000, {0x4002649800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a5000, {0x4002649800?, 0x40035cb828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e48, {0x4002649800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400662cee8, {0x4002649800?, 0x400662cee8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cc628, {0x8550b20, 0x400662cee8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cc380, {0x854dee0?, 0x4002f77e48}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cc380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cc380, {0x4002fb0000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86300, {0x40036930e0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86300}, {0x40036930e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036930e0, 0x9, 0x133d6ef597?}, {0x854a860?, 0x4002c86300?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036930a0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74d80, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 99
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 572 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035d7728?, {0x8554bc0, 0x40035c5980}, 0x1, 0x4003600660)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035d7778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035b4000)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 549
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 549 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efae0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 520
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 550 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 520
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 551 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4000138f40}, {0xffff5de359d0, 0x4002e8d1e0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003203260, {0x0?, 0x0?}, 0x40034fc780, 0x40035aa548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003203260, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8d1e0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337d000?, {0x8554be0, 0x40034eff40}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003203260, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 520
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 865 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003203260, 0x40034fc780, 0x40000bd200, 0x4002f77e50?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 551
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 814 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d4780, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038ba930)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 214
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 812 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de369b0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fdb80?, 0x4002300000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40035fdb80, {0x4002300000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40035fdb80, {0x4002300000?, 0x40067f2bd0?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e80, {0x4002300000?, 0x40067f31b8?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4003ad0ea0, {0x4003736040, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad0ea0}, {0x4003736040, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736040, 0x9, 0x4002ca92c0?}, {0x854a860?, 0x4003ad0ea0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736000)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40036aaea0, {0x85cbe38, 0x40038c7350}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40036aaea0}, {0x85f1f18?, 0x4002f77e80?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 825
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 574 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035d0f28?, {0x8554bc0, 0x40035c59b0}, 0x1, 0x40036006c0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035d0f78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035b4090)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 556
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 556 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efb30, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 521
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 557 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 521
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 558 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x400260f9c0}, {0xffff5de359d0, 0x4002e8d340}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003203420, {0x0?, 0x0?}, 0x40034fc780, 0x40035aad48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003203420, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8d340?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337d080?, {0x8554be0, 0x40035ec000}, 0x1, 0x40034fc780)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003203420, 0x40034fc780)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 521
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 923 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003203420, 0x40034fc780, 0x400379d560, 0x400366c7b0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 558
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 796 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0a00, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40036c7420)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 352
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 794 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0910, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40036c73b0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 228
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 563 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035b4120)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 524
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 884 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4000112370, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a540)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 445
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 809 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d1310, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b730)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 366
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 899 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de364d8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520e00?, 0x4002677800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520e00, {0x4002677800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520e00, {0x4002677800?, 0x4003865828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e58, {0x4002677800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305abd0, {0x4002677800?, 0x400305abd0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037ccd28, {0x8550b20, 0x400305abd0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cca80, {0x854dee0?, 0x4002f77e58}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cca80, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cca80, {0x4002fba000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86480, {0x40036931c0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86480}, {0x40036931c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036931c0, 0x9, 0xe65c13cef?}, {0x854a860?, 0x4002c86480?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003693180)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74fc0, 0x4002a74000?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 324
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 578 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041588, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003316680?, 0x400189e000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003316680, {0x400189e000, 0xc000, 0xc000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003316680, {0x400189e000?, 0x40032f3828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c64b0, {0x400189e000?, 0x40032f3798?, 0x26908?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305a528, {0x400189e000?, 0x400305a528?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40032dd7a8, {0x8550b20, 0x400305a528})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40032dd500, {0x854dee0?, 0x40022c64b0}, 0xc000?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40032dd500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40032dd500, {0x400356d000, 0x1000, 0x40038fc0a3?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400355da40, {0x4000019ee0, 0x9, 0xa8?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400355da40}, {0x4000019ee0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4000019ee0, 0x9, 0x6a0d500?}, {0x854a860?, 0x400355da40?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4000019ea0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
golang.org/x/net/http2.(*clientConnReadLoop).run(0x40032f3f88)
	golang.org/x/net@v0.20.0/http2/transport.go:2275 +0xf8
golang.org/x/net/http2.(*ClientConn).readLoop(0x4002260a80)
	golang.org/x/net@v0.20.0/http2/transport.go:2170 +0x5c
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 577
	golang.org/x/net@v0.20.0/http2/transport.go:821 +0xabc

goroutine 567 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359def0, {0x85cbe70, 0x40035ec410})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 568 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359df20, {0x85cbe70, 0x40035ec460})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 569 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359df50, {0x85cbe70, 0x40035ec4b0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 571 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035a1ef0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 542
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 573 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035b4000)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 549
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 575 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035b4090)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 556
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 863 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4001d57800, 0x4001c86b00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 267
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 911 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40029c99c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40029c99b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40029c99b0, {0x40038ea001, 0x3dff, 0x3dff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40038ea001?, 0x4007c19ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d48c80)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d48c80)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d48c80, {0x65704e0, 0x4002dbccd8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0480, {0x4002bb1000, 0x4000, 0x5000})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af220, 0x4002ed81b0?, {0x8587d88, 0x40044dcf80})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f90080)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc240)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 702
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 593 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 594 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 595 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 596 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 597 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 598 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 599 [runnable]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 600 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 601 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 870 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002c46480, 0x40001c1b00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 285
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 602 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 952 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40022601c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40022601b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40022601b0, {0x40020da601, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40020da601?, 0x4007c21ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052dfb80)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052dfb80)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052dfb80, {0x65704e0, 0x400318b590})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af3e0, {0x4003071400, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96640, 0x4002cc7a00?, {0x8587d88, 0x4001fe3500})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d2a0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c56b80)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 404
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 928 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002dcadc8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002dcadb8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002dcadb0, {0x40037fac01, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fac01?, 0x4003585ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40045ea3c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40045ea3c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40045ea3c0, {0x65704e0, 0x4001bbe7c8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x4002d42090, {0x40037bf000, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f03810, 0x40052c2900?, {0x8587d88, 0x400444adc0})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4002ab2180)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x400260f9c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 558
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 872 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002c46900, 0x4001c4e900)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 390
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 803 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0f00, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a620)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 503
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 802 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041b58, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521180?, 0x40031e5800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521180, {0x40031e5800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521180, {0x40031e5800?, 0x40038a6828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6720, {0x40031e5800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451dd0, {0x40031e5800?, 0x4004451dd0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4003557b28, {0x8550b20, 0x4004451dd0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4003557880, {0x854dee0?, 0x40022c6720}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4003557880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4003557880, {0x400383e000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003827d40, {0x40036923c0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003827d40}, {0x40036923c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036923c0, 0x9, 0xfe7973837?}, {0x854a860?, 0x4003827d40?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692380)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003695b00, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 503
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 918 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x400284ec00, 0x40025f2300)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400370001c?, 0x40036707b0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 397
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 837 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002260180, 0x400382ca00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 404
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 931 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002260948, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002260938)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002260930, {0x4003091801, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4003091801?, 0x4007c13ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40054a5400)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40054a5400)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40054a5400, {0x65704e0, 0x4001bbe780})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x400351d530, {0x40032a2000, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400183c550, 0x40031abf80?, {0x8587d88, 0x400444ac80})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40032346c0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002a3f100)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 728
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 875 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002c46048, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002c46038)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002c46030, {0x40025d0001, 0x3dff, 0x3dff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40025d0001?, 0x4007c83ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4002591b80)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4002591b80)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4002591b80, {0x65704e0, 0x4002dbccf0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4510, {0x4002616000, 0x4000, 0x5000})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400018d400, 0x4002ed8240?, {0x8587d88, 0x40044dcfc0})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001c01ae0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c6e0c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 722
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 920 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4001f98000, 0x40025f2900)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400365c998?, 0x4003671fb0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 544
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 866 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4000069500, 0x4001c87f00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 551
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 606 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003602830, {0x85cbe70, 0x40035ec960})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 607 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003602860, {0x85cbe70, 0x40035ec9b0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 608 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003602890, {0x85cbe70, 0x40035eca00})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 860 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35e10, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521780?, 0x40031e8800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521780, {0x40031e8800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521780, {0x40031e8800?, 0x4003864828?, 0x155?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77ab0, {0x40031e8800?, 0x21?, 0xffff5de09850?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451de8, {0x40031e8800?, 0x4004451de8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ffb28, {0x8550b20, 0x4004451de8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ff880, {0x854dee0?, 0x4002f77ab0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ff880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ff880, {0x400215a000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4001c047e0, {0x4003736740, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4001c047e0}, {0x4003736740, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736740, 0x9, 0xfe79cb175?}, {0x854a860?, 0x4001c047e0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736700)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d1680, 0x4003694000?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 489
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 610 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 611 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 612 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 613 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 614 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 615 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 617 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 618 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 619 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 620 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603120, {0x85cbe70, 0x40035ecdc0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 621 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603150, {0x85cbe70, 0x40035ece10})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 622 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603180, {0x85cbe70, 0x40035ece60})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 848 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002c464c8, 0x2)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002c464b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002c464b0, {0x4002818001, 0x3dff, 0x3dff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002818001?, 0x4007c97ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001fd37c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001fd37c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001fd37c0, {0x65704e0, 0x400318b4e8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x400212dfb0, {0x4002bac000, 0x4000, 0x5000})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4000112190, 0x4002ed8120?, {0x8587d88, 0x4001fe34c0})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4003ac1ac0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x40001383c0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 285
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 624 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 641 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 642 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 643 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 644 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 645 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 646 [running]:
	goroutine running on other thread; stack unavailable
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 647 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 648 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 649 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 650 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40036039b0, {0x85cbe70, 0x40035ed1d0})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 651 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40036039e0, {0x85cbe70, 0x40035ed220})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 652 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603a10, {0x85cbe70, 0x40035ed270})
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/grpc@v1.61.0/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 925 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35d18, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40038da400?, 0x4002801000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40038da400, {0x4002801000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40038da400, {0x4002801000?, 0x4004df9a58?, 0xf95dc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000114670, {0x4002801000?, 0x4004df9aa8?, 0x400282c308?})
	net/net.go:179 +0x34
net/http.(*connReader).Read(0x400282c300, {0x4002801000, 0x1000, 0x1000})
	net/http/server.go:791 +0x224
bufio.(*Reader).fill(0x400276acc0)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x400276acc0, 0x4)
	bufio/bufio.go:151 +0x60
net/http.(*conn).serve(0x400307e6c0, {0x85cbe38, 0x40037050b0})
	net/http/server.go:2044 +0x64c
created by net/http.(*Server).Serve in goroutine 667
	net/http/server.go:3086 +0x4cc

goroutine 654 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 655 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 656 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 657 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 658 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 659 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 660 [runnable]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 661 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 662 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 663 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

goroutine 664 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003650820, 0x83394?, 0x40034f1340?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:93 +0x26c

goroutine 717 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400366cf28?, {0x8554bc0, 0x400377cc30}, 0x1, 0x400379c120)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400366cf78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40037025a0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 682
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 666 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041870, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fca00?, 0x0?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x40035fca00)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x40035fca00)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x4003647940)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x4003647940)
	net/tcpsock.go:315 +0x2c
google.golang.org/grpc.(*Server).Serve(0x400358ca00, {0x85ab140?, 0x4003647940})
	google.golang.org/grpc@v1.61.0/server.go:885 +0x458
go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startGRPCServer.func1()
	go.opentelemetry.io/collector/receiver/otlpreceiver@v0.94.1/otlp.go:112 +0x64
created by go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startGRPCServer in goroutine 1
	go.opentelemetry.io/collector/receiver/otlpreceiver@v0.94.1/otlp.go:109 +0x4dc

goroutine 667 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0xffff5dd8c280, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fca80?, 0x0?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x40035fca80)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x40035fca80)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x4003647a40)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x4003647a40)
	net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4001d5ac30, {0x85ab140, 0x4003647a40})
	net/http/server.go:3056 +0x2b8
go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startHTTPServer.func4()
	go.opentelemetry.io/collector/receiver/otlpreceiver@v0.94.1/otlp.go:162 +0x64
created by go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startHTTPServer in goroutine 1
	go.opentelemetry.io/collector/receiver/otlpreceiver@v0.94.1/otlp.go:159 +0x58c

goroutine 668 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003651380, 0x0?, 0x0?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:93 +0x26c

goroutine 737 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400366c728?, {0x8554bc0, 0x400377cc60}, 0x1, 0x400379c180)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400366c778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702c60)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 692
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 670 [chan receive, 1 minutes]:
github.com/prometheus/prometheus/discovery.(*Manager).Run(0x4002e8da20)
	github.com/prometheus/prometheus@v0.48.1/discovery/manager.go:183 +0x78
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents.func1()
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver@v0.94.0/metrics_receiver.go:241 +0x54
created by github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver@v0.94.0/metrics_receiver.go:239 +0xc0

goroutine 671 [select, 1 minutes]:
github.com/prometheus/prometheus/scrape.(*Manager).Run(0x400362f7a0, 0x4003601f80)
	github.com/prometheus/prometheus@v0.48.1/scrape/manager.go:167 +0xc4
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents.func2()
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver@v0.94.0/metrics_receiver.go:283 +0x6c
created by github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver@v0.94.0/metrics_receiver.go:279 +0x4c8

goroutine 739 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x400370ade0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003671f28?, {0x8554bc0, 0x400377cc90}, 0x1, 0x400379c1e0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003671f18?, 0x3b9aca00, 0x0, 0x38?, 0x4003671f78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40037023f0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 700
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 674 [chan receive, 1 minutes]:
github.com/prometheus/prometheus/discovery.(*Manager).updater(0x4002e8da20, {0x85cbe70, 0x40037082d0}, 0x4003675030, 0x400370a180)
	github.com/prometheus/prometheus@v0.48.1/discovery/manager.go:323 +0x328
created by github.com/prometheus/prometheus/discovery.(*Manager).startProvider in goroutine 1
	github.com/prometheus/prometheus@v0.48.1/discovery/manager.go:294 +0x358

goroutine 676 [syscall, 1 minutes]:
os/signal.signal_recv()
	runtime/sigqueue.go:152 +0x30
os/signal.loop()
	os/signal/signal_unix.go:23 +0x1c
created by os/signal.Notify.func1.1 in goroutine 1
	os/signal/signal.go:151 +0x28

goroutine 677 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8dc58, 0x2)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dc48)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dc30, 0x4003655c00)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f720)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666b28?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003714820?, {0x8554bc0, 0x4003705620}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003676e90?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f720, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d4a0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:188 +0x298

goroutine 678 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8dd08, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dcf8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dce0, 0x4003655f70)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f7c0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666c60?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40037149c0?, {0x8554bc0, 0x4003705a10}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677110?, 0x3b9aca00, 0x0, 0xc0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f7c0, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d550, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:198 +0x514

goroutine 679 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8ddb8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dda8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dd90, 0x400376c2e0)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f860)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666d98?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003714b60?, {0x8554bc0, 0x4003705e00}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677290?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f860, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d600, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:209 +0x79c

goroutine 680 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8daf8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dae8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dad0, 0x4003655280)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f540)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40036667c8?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003714d00?, {0x8554bc0, 0x4003704c00}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003676960?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f540, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d6b0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:221 +0xa04

goroutine 682 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365ca50, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 680
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 683 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 680
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 684 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc340}, {0xffff5de359d0, 0x4002e8dad0}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003203ea0, {0x0?, 0x0?}, 0x4003601d40, 0x400366c548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003203ea0, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dad0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337db80?, {0x8554be0, 0x4003708370}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003203ea0, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 680
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 901 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003203ea0, 0x4003601d40, 0x40033775c0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 684
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 902 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002d51c80, 0x400382dd00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x400366c708?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 684
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 687 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8de68, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8de58)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8de40, 0x400376c5d0)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f900)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666f00?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715860?, {0x8554bc0, 0x400377c150}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677400?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f900, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d760, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:188 +0x298

goroutine 688 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8df18, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8df08)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8def0, 0x400376c940)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f9a0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003667038?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715a00?, {0x8554bc0, 0x400377c540}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677670?, 0x3b9aca00, 0x0, 0xe0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f9a0, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d810, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:198 +0x514

goroutine 689 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4003794028, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4003794018)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4003794000, 0x400376ccb0)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367fa40)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003667170?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715ba0?, {0x8554bc0, 0x400377c930}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40036777f0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367fa40, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d8c0, 0x400366f7b0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:209 +0x79c

goroutine 690 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8dba8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8db98)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8db80, 0x40036557d0)
	k8s.io/client-go@v0.28.4/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f680)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40036669a8?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715d40?, {0x8554bc0, 0x40037051d0}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003676c20?, 0x3b9aca00, 0x0, 0xc0?, 0xffff5de359d0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f680, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d970, 0x400366efb0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor@v0.94.0/internal/kube/client.go:221 +0xa04

goroutine 692 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40037080a0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 690
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 693 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 690
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 694 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc680}, {0xffff5de359d0, 0x4002e8db80}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40037360e0, {0x0?, 0x0?}, 0x4003601ec0, 0x400366ed48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40037360e0, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8db80?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337dd40?, {0x8554be0, 0x40037084b0}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40037360e0, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 690
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 905 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40037360e0, 0x4003601ec0, 0x40034fdf80, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 694
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 906 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x400284e180, 0x40021d2600)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x400366ef08?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 694
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 697 [select]:
github.com/prometheus/prometheus/discovery.(*Manager).sender(0x4002e8da20)
	github.com/prometheus/prometheus@v0.48.1/discovery/manager.go:346 +0xa4
created by github.com/prometheus/prometheus/discovery.(*Manager).Run in goroutine 670
	github.com/prometheus/prometheus@v0.48.1/discovery/manager.go:182 +0x5c

goroutine 698 [select, 1 minutes]:
github.com/prometheus/prometheus/scrape.(*Manager).reloader(0x400362f7a0)
	github.com/prometheus/prometheus@v0.48.1/scrape/manager.go:197 +0x104
created by github.com/prometheus/prometheus/scrape.(*Manager).Run in goroutine 671
	github.com/prometheus/prometheus@v0.48.1/scrape/manager.go:165 +0x60

goroutine 700 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365c960, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 677
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 701 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 677
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 702 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc240}, {0xffff5de359d0, 0x4002e8dc30}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736460, {0x0?, 0x0?}, 0x4003601d40, 0x4003642548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736460, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dc30?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337df40?, {0x8554be0, 0x40037085f0}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736460, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 677
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 873 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736460, 0x4003601d40, 0x40033c1b00, 0x4002f77ab0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 702
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 874 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40029c9980, 0x4001c4ef00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x4003642708?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 702
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 741 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003642728?, {0x8554bc0, 0x400377ccc0}, 0x1, 0x400379c240)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003642778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702480)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 706
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 706 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365c9b0, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 678
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 707 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 678
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 708 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4000138ec0}, {0xffff5de359d0, 0x4002e8dce0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736620, {0x0?, 0x0?}, 0x4003601d40, 0x4003645548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736620, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dce0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a080?, {0x8554be0, 0x4003708640}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736620, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 678
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 867 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736620, 0x4003601d40, 0x40000bd620, 0x40022c6898?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 708
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 868 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4000069800, 0x4000164600)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x4003645708?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 708
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 743 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003645728?, {0x8554bc0, 0x400377ccf0}, 0x1, 0x400379c2a0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003645778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702510)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 712
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 712 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365ca00, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 679
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 713 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 679
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 714 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c569c0}, {0xffff5de359d0, 0x4002e8dd90}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40037367e0, {0x0?, 0x0?}, 0x4003601d40, 0x400366bd48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40037367e0, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dd90?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a100?, {0x8554be0, 0x4003708690}, 0x1, 0x4003601d40)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40037367e0, 0x4003601d40)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 679
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 947 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40037367e0, 0x4003601d40, 0x40033258c0, 0x4003608fb0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 714
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 963 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x400682d5c0)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 379
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 718 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40037025a0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 682
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 745 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400375f728?, {0x8554bc0, 0x400377cd20}, 0x1, 0x400379c300)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400375f778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702ab0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 720
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 720 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365df90, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 687
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 721 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 687
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 722 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c6e0c0}, {0xffff5de359d0, 0x4002e8de40}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40037369a0, {0x0?, 0x0?}, 0x4003601ec0, 0x4003670548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40037369a0, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8de40?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a180?, {0x8554be0, 0x4003708780}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40037369a0, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 687
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 921 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40037369a0, 0x4003601ec0, 0x400370baa0, 0x4003671fb0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 722
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 922 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002c46000, 0x40025f2f00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x40037080d8?, 0x400366c7b0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 722
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 747 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003670728?, {0x8554bc0, 0x400377cd50}, 0x1, 0x400379c360)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003670778?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702b40)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 726
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 726 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003708000, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 688
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 727 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 688
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 728 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002a3f100}, {0xffff5de359d0, 0x4002e8def0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736b60, {0x0?, 0x0?}, 0x4003601ec0, 0x400366fd48?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736b60, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8def0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a2c0?, {0x8554be0, 0x40037087d0}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736b60, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 688
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 840 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736b60, 0x4003601ec0, 0x400018f020, 0x40020c8fb0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 728
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 841 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002260900, 0x400382d000)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x400366ff08?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 728
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 749 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400366ff28?, {0x8554bc0, 0x400377cd80}, 0x1, 0x400379c3c0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400366ff78?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702bd0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 732
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 732 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003708050, 0x0?)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 689
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 733 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 689
	k8s.io/client-go@v0.28.4/tools/cache/controller.go:131 +0x94

goroutine 734 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c56a80}, {0xffff5de359d0, 0x4003794000}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736d20, {0x0?, 0x0?}, 0x4003601ec0, 0x400366f548?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736d20, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003794000?)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a340?, {0x8554be0, 0x4003708820}, 0x1, 0x4003601ec0)
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736d20, 0x4003601ec0)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 689
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 945 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736d20, 0x4003601ec0, 0x400303f020, 0x400375f7b0?)
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 734
	k8s.io/client-go@v0.28.4/tools/cache/reflector.go:357 +0x2c4

goroutine 964 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4006860840)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 379
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 738 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702c60)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 692
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 740 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40037023f0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 700
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 742 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702480)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 706
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 744 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702510)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 712
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 746 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702ab0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 720
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 748 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702b40)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 726
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 793 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de360f8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521480?, 0x40031e7000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521480, {0x40031e7000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521480, {0x40031e7000?, 0x40038b3828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6718, {0x40031e7000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbce10, {0x40031e7000?, 0x4002dbce10?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035577a8, {0x8550b20, 0x4002dbce10})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4003557500, {0x854dee0?, 0x40022c6718}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4003557500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4003557500, {0x400380e000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40036fec60, {0x4003692200, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40036fec60}, {0x4003692200, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692200, 0x9, 0xe5ddfff87?}, {0x854a860?, 0x40036fec60?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036921c0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003695680, 0x0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 228
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 750 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702bd0)
	k8s.io/client-go@v0.28.4/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 732
	k8s.io/apimachinery@v0.28.4/pkg/util/wait/wait.go:70 +0x7c

goroutine 910 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fdaeb0, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383bc00)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 653
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 857 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x40037d8d40)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 856
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 835 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0d70, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a230)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 338
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 933 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40060ef200, 0x4002dd8a00)
	golang.org/x/net@v0.20.0/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002a3f100?, 0x40032597b0?)
	golang.org/x/net@v0.20.0/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 411
	golang.org/x/net@v0.20.0/http2/transport.go:1232 +0x2d4

goroutine 808 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35f08, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521680?, 0x40037eb000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521680, {0x40037eb000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521680, {0x40037eb000?, 0x40038a4828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6750, {0x40037eb000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd848, {0x40037eb000?, 0x4002dbd848?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b62a8, {0x8550b20, 0x4002dbd848})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6000, {0x854dee0?, 0x40022c6750}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6000, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6000, {0x4003ad6000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003ad0de0, {0x40036924a0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad0de0}, {0x40036924a0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036924a0, 0x9, 0xe65aad999?}, {0x854a860?, 0x4003ad0de0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692460)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003695d40, 0x4003695680?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 366
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 893 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041c50, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520b00?, 0x40023cc800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520b00, {0x40023cc800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520b00, {0x40023cc800?, 0x400385b828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e68, {0x40023cc800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd4e8, {0x40023cc800?, 0x4002dbd4e8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cd428, {0x8550b20, 0x4002dbd4e8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cd180, {0x854dee0?, 0x4002f77e68}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cd180, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cd180, {0x4002d36000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86000, {0x4003692f20, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86000}, {0x4003692f20, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692f20, 0x9, 0xe5de85ab9?}, {0x854a860?, 0x4002c86000?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692ee0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74900, 0x4002a74480?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 159
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 887 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de366c8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520c00?, 0x40023cb000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520c00, {0x40023cb000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520c00, {0x40023cb000?, 0x4003aec828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e70, {0x40023cb000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd500, {0x40023cb000?, 0x4002dbd500?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cd7a8, {0x8550b20, 0x4002dbd500})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cd500, {0x854dee0?, 0x4002f77e70}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cd500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cd500, {0x4002c30000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276b0e0, {0x4003692d60, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276b0e0}, {0x4003692d60, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692d60, 0x9, 0xe5dec296e?}, {0x854a860?, 0x400276b0e0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692d20)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74480, 0x40036946c0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 189
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 883 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e042030, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520900?, 0x40023c8000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520900, {0x40023c8000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520900, {0x40023c8000?, 0x4003aff828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e78, {0x40023c8000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451e48, {0x40023c8000?, 0x4004451e48?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cdb28, {0x8550b20, 0x4004451e48})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cd880, {0x854dee0?, 0x4002f77e78}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cd880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cd880, {0x4002ab4000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276ade0, {0x4003692ba0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276ade0}, {0x4003692ba0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692ba0, 0x9, 0xfeb65af35?}, {0x854a860?, 0x400276ade0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692b60)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74000, 0x40022c6160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 445
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 813 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de361f0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521380?, 0x40037e9800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521380, {0x40037e9800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521380, {0x40037e9800?, 0x4003861828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6748, {0x40037e9800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305aa98, {0x40037e9800?, 0x400305aa98?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4003557ea8, {0x8550b20, 0x400305aa98})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4003557c00, {0x854dee0?, 0x40022c6748}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4003557c00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4003557c00, {0x4003870000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003867500, {0x4003737540, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003867500}, {0x4003737540, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003737540, 0x9, 0xe6032caec?}, {0x854a860?, 0x4003867500?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003737500)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d0900, 0x4002f77f10?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 214
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 889 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de363e0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520f00?, 0x40023c9800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520f00, {0x40023c9800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520f00, {0x40023c9800?, 0x40038a5828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e88, {0x40023c9800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x40054759e0, {0x40023c9800?, 0x40054759e0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cdea8, {0x8550b20, 0x40054759e0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cdc00, {0x854dee0?, 0x4002f77e88}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cdc00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cdc00, {0x4002c48000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276b260, {0x4003692e40, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276b260}, {0x4003692e40, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692e40, 0x9, 0xfeb688a3c?}, {0x854a860?, 0x400276b260?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692e00)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a746c0, 0x40032737b0?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 383
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:400 +0x16fc

goroutine 994 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001bd1b80, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001cd5d50)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 984
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 831 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0050, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a000)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 78
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 833 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0230, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a070)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 114
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 890 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x400208ae10, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b810)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 383
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:452 +0x1b50

goroutine 891 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4000069848, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4000069838)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4000069830, {0x4002461801, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002461801?, 0x4003617ca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001b70dc0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001b70dc0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001b70dc0, {0x65704e0, 0x400318b5c0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40024b7c80, {0x4003ad3400, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001fda140, 0x4002cc7b00?, {0x8587d88, 0x4001fe3580})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40000b10e0)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4000138ec0)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 708
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 892 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4000069548, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4000069538)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4000069530, {0x4002461201, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002461201?, 0x4007c0fca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d017c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d017c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d017c0, {0x65704e0, 0x400318b5a8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40024b7d40, {0x4003ad3800, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001fda190, 0x4002cc7a80?, {0x8587d88, 0x4001fe3540})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40000b1100)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4000138f40)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 551
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 957 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x400662e7c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x400662e7b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x400662e7b0, {0x40037fb201, 0x5ff, 0x5ff})
	golang.org/x/net@v0.20.0/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fb201?, 0x4007c2bca8?, 0x181f0?})
	golang.org/x/net@v0.20.0/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40065fd7c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40065fd7c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40065fd7c0, {0x65704e0, 0x4001bbe7e0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x4006624900, {0x4003071800, 0x400, 0x400})
	k8s.io/apimachinery@v0.28.4/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f97450, 0x40052c2a00?, {0x8587d88, 0x400444ae40})
	k8s.io/apimachinery@v0.28.4/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4006105820)
	k8s.io/client-go@v0.28.4/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x40033edf40)
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 295
	k8s.io/apimachinery@v0.28.4/pkg/watch/streamwatcher.go:76 +0x120

goroutine 979 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4002cf3f90, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001ca36c0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 978
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 959 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4002cf3590, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001ca32d0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 958
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 960 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x4001c9b520)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 958
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 977 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c660, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x400267cd80?, 0x4006b80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x400267cd80, {0x4006b80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x400267cd80, {0x4006b80000?, 0x4003533b78?, 0x401000801?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000114ea8, {0x4006b80000?, 0x4003533bb8?, 0x18124?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006a6e2a0, {0x40065f50e0, 0x9, 0x40035f3680?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006a6e2a0}, {0x40065f50e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40065f50e0, 0x9, 0x40050d39d0?}, {0x854a860?, 0x4006a6e2a0?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40065f50a0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x4001c9b520, {0x85cbe38, 0x4006a70750}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x4001c9b520}, {0x85f1f18?, 0x4000114ea8?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 958
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 980 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x4001c9bba0)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 978
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 981 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041680, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x400267db00?, 0x4006c80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x400267db00, {0x4006c80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x400267db00, {0x4006c80000?, 0x40037a7b80?, 0x17ad4?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000114fd0, {0x4006c80000?, 0x40068205a0?, 0x40071f42a0?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006a6eb40, {0x40065f51c0, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006a6eb40}, {0x40065f51c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40065f51c0, 0x9, 0x4002ca96b0?}, {0x854a860?, 0x4006a6eb40?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40065f5180)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x4001c9bba0, {0x85cbe38, 0x4006a71aa0}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x4001c9bba0}, {0x85f1f18?, 0x4000114fd0?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 978
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 983 [select]:
github.com/prometheus/prometheus/scrape.(*scrapeLoop).run(0x40066030e0, 0x0?)
	github.com/prometheus/prometheus@v0.48.1/scrape/scrape.go:1308 +0x2ec
created by github.com/prometheus/prometheus/scrape.(*scrapePool).sync in goroutine 982
	github.com/prometheus/prometheus@v0.48.1/scrape/scrape.go:648 +0x930

goroutine 1068 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4001c2e140)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1067
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 990 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de368b8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002256900?, 0x4006f21000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4002256900, {0x4006f21000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4002256900, {0x4006f21000?, 0x1?, 0x1?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000115728, {0x4006f21000?, 0x4002fdac28?, 0x18124?})
	net/net.go:179 +0x34
net/http.(*persistConn).Read(0x4006dcd200, {0x4006f21000?, 0x17fd0?, 0x4006c79b60?})
	net/http/transport.go:1954 +0x50
bufio.(*Reader).fill(0x4006df6f00)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x4006df6f00, 0x1)
	bufio/bufio.go:151 +0x60
net/http.(*persistConn).readLoop(0x4006dcd200)
	net/http/transport.go:2118 +0x14c
created by net/http.(*Transport).dialConn in goroutine 988
	net/http/transport.go:1776 +0x1144

goroutine 991 [select]:
net/http.(*persistConn).writeLoop(0x4006dcd200)
	net/http/transport.go:2421 +0x9c
created by net/http.(*Transport).dialConn in goroutine 988
	net/http/transport.go:1777 +0x118c

goroutine 1053 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x40033ec400)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1084
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 1091 [select]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40001829c0)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1089
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 1046 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4001c88d40)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1045
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 1081 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40027eeb40, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40020a09a0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1080
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 1090 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4003110370, 0x1)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40001751f0)
	google.golang.org/grpc@v1.61.0/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1089
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:322 +0x12f8

goroutine 1082 [select]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x4001c9a680)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1080
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:328 +0x1338

goroutine 1083 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8bea0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x400719b880?, 0x4004080000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x400719b880, {0x4004080000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x400719b880, {0x4004080000?, 0x4002cc9fb0?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4001f42690, {0x4004080000?, 0x40025a6228?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x40037b2180, {0x4000018f20, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40037b2180}, {0x4000018f20, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4000018f20, 0x9, 0x4002d2b878?}, {0x854a860?, 0x40037b2180?})
	golang.org/x/net@v0.20.0/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4000018ee0)
	golang.org/x/net@v0.20.0/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x4001c9a680, {0x85cbe38, 0x4002cc9b90}, 0xde95160?)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x4001c9a680}, {0x85f1f18?, 0x4001f42690?})
	google.golang.org/grpc@v1.61.0/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/grpc@v1.61.0/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 1080
	google.golang.org/grpc@v1.61.0/server.go:958 +0x1d0

goroutine 1106 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4006c115c0)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1105
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 1115 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4007820b40)
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1114
	go.opentelemetry.io/collector/processor/batchprocessor@v0.94.1/batch_processor.go:160 +0x19c

goroutine 646 [running]:
go.opentelemetry.io/collector/client.Metadata.Get({0x0?}, {0x4002a01488, 0x13})
	go.opentelemetry.io/collector@v0.94.1/client/client.go:158 +0x13c
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension/internal/source.(*ContextSource).Get(0x4002dbea20, {0x85cbe38?, 0x400545bc80?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension@v0.94.0/internal/source/context.go:21 +0xd0
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension.(*headersPerRPC).GetRequestMetadata(0x4003343b30, {0x85cbe38, 0x400545bc80}, {0x30?, 0x30?, 0x6f0e5c0?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension@v0.94.0/extension.go:90 +0xc4
google.golang.org/grpc/internal/transport.(*http2Client).getTrAuthData(0x40001638c0, {0x85cbe38, 0x400545bc80}, {0x40032ca960, 0x4a})
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:630 +0x114
google.golang.org/grpc/internal/transport.(*http2Client).createHeaderFields(0x40001638c0, {0x85cbe38, 0x400545bc50}, 0x40037b6ec8)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:512 +0xd0
google.golang.org/grpc/internal/transport.(*http2Client).NewStream(0x40001638c0, {0x85cbe38, 0x400545bbc0}, 0x40052eb740)
	google.golang.org/grpc@v1.61.0/internal/transport/http2_client.go:721 +0x144
google.golang.org/grpc.(*csAttempt).newStream(0x40054624e0)
	google.golang.org/grpc@v1.61.0/stream.go:504 +0x94
google.golang.org/grpc.newClientStreamWithParams.func2(0x40054624e0)
	google.golang.org/grpc@v1.61.0/stream.go:354 +0x34
google.golang.org/grpc.(*clientStream).withRetry(0x40052dd7a0, 0x40077a3b80, 0x40037b7268)
	google.golang.org/grpc@v1.61.0/stream.go:778 +0x188
google.golang.org/grpc.newClientStreamWithParams({0x85cbe38, 0x400545b9b0}, 0xde3e560, 0x40035fe700, {0x783f923, 0x39}, {0x0, 0x0, 0x0, 0x0, ...}, ...)
	google.golang.org/grpc@v1.61.0/stream.go:363 +0x9d4
google.golang.org/grpc.newClientStream.func3({0x85cbe38?, 0x400545b9b0?}, 0x400545b9b0?)
	google.golang.org/grpc@v1.61.0/stream.go:220 +0x6c
google.golang.org/grpc.newClientStream({0x85cbe38, 0x400545b9b0}, 0xde3e560, 0x40035fe700, {0x783f923, 0x39}, {0x4002f35de0, 0x2, 0x1?})
	google.golang.org/grpc@v1.61.0/stream.go:255 +0x628
google.golang.org/grpc.invoke({0x85cbe38?, 0x400545b9b0?}, {0x783f923?, 0x4003602f20?}, {0x7242c80, 0x4006739f80}, {0x7242dc0, 0x400662cf30}, 0x400662cf30?, {0x4002f35de0?, ...})
	google.golang.org/grpc@v1.61.0/call.go:66 +0x68
google.golang.org/grpc.(*ClientConn).Invoke(0x40035fe700?, {0x85cbe38?, 0x400545b9b0?}, {0x783f923?, 0x39?}, {0x7242c80?, 0x4006739f80?}, {0x7242dc0?, 0x400662cf30?}, {0x4003603430?, ...})
	google.golang.org/grpc@v1.61.0/call.go:37 +0x1a4
go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/logs/v1.(*logsServiceClient).Export(0x4002f77790, {0x85cbe38, 0x400545b9b0}, 0xde95160?, {0x4003603430, 0x1, 0x1})
	go.opentelemetry.io/collector/pdata@v1.1.0/internal/data/protogen/collector/logs/v1/logs_service.pb.go:272 +0x8c
go.opentelemetry.io/collector/pdata/plog/plogotlp.(*grpcClient).Export(0x10?, {0x85cbe38?, 0x400545b9b0?}, {0x4006739f80?, 0x40050d2148?}, {0x4003603430?, 0x40037b76c8?, 0xb4f38?})
	go.opentelemetry.io/collector/pdata@v1.1.0/plog/plogotlp/grpc.go:42 +0x48
go.opentelemetry.io/collector/exporter/otlpexporter.(*baseExporter).pushLogs(0x4002d75d40, {0x85cbee0?, 0x4001b2b7a0?}, {0x4006739f80?, 0x40050d2148?})
	go.opentelemetry.io/collector/exporter/otlpexporter@v0.94.1/otlp.go:127 +0x8c
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsRequest).Export(0x85cbe38?, {0x85cbee0?, 0x4001b2b7a0?})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/logs.go:59 +0x40
go.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send(0x4005464980?, {0x85cbe38?, 0x400545b980?}, {0x8582b98, 0x40068212c0})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/timeout_sender.go:49 +0xa0
go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send(0x4002dd26e0, {0x85cbe38, 0x400545b980}, {0x8582b98, 0x40068212c0})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/retry_sender.go:89 +0x334
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsExporterWithObservability).send(0x4002de3a10, {0x85cc310?, 0x4007814900?}, {0x8582b98?, 0x40068212c0?})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/logs.go:171 +0x74
go.opentelemetry.io/collector/exporter/exporterhelper.newQueueSender.func1({0x85cc310?, 0x4007814900?}, {0x8582b98?, 0x40068212c0?})
	go.opentelemetry.io/collector/exporter@v0.94.1/exporterhelper/queue_sender.go:95 +0x78
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/bounded_memory_queue.go:57 +0xa4
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/exporter@v0.94.1/internal/queue/consumers.go:39 +0x8c

@TylerHelmuth TylerHelmuth added extension/headerssetter and removed needs triage New item requiring triage labels Feb 15, 2024
@github-actions GitHub Actions
Copy link
Contributor

Pinging code owners for extension/headerssetter: @jpkrohling. See Adding Labels via Comments if you do not have permissions to add labels yourself.

@TylerHelmuth TylerHelmuth mentioned this issue Feb 16, 2024
Closed
@TylerHelmuth
Copy link
Member

TylerHelmuth commented Feb 16, 2024 •
edited
Loading

I think I know why this is happening.

A request comes in to receiver A. The data (and the request context) flows down the pipeline to exporter X and exporter Y. Both extensions independently access the context in their own threads here. Since 2 threads are access a map it panics.

@jpkrohling
Copy link
Member

Thank you for the investigation, @TylerHelmuth!

This was referenced Feb 20, 2024
Closed
Open
@TylerHelmuth
Copy link
Member

Closed via open-telemetry/opentelemetry-collector#9595

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working extension/headerssetter
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jpkrohling @tdarwin @TylerHelmuth