-
Notifications
You must be signed in to change notification settings - Fork 2.4k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[processor/interval] Create the initial structure for the new process…
…or (#30756)
- Loading branch information
1 parent
01af3c7
commit b1c9374
Showing
21 changed files
with
1,000 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| # One of 'breaking', 'deprecation', 'new_component', 'enhancement', 'bug_fix' | ||
| change_type: new_component | ||
|
|
||
| # The name of the component, or a single word describing the area of concern, (e.g. filelogreceiver) | ||
| component: processor/interval | ||
|
|
||
| # A brief description of the change. Surround your text with quotes ("") if it needs to start with a backtick (`). | ||
| note: Adds the initial structure for a new processor that aggregates metrics and periodically forwards the latest values to the next component in the pipeline. | ||
|
|
||
| # One or more tracking issues related to the change | ||
| issues: [29461] | ||
|
|
||
| # (Optional) One or more lines of additional information to render under the primary note. | ||
| # These lines will be padded with 2 spaces and then inserted directly into the document. | ||
| # Use pipe (|) for multiline entries. | ||
| subtext: | | ||
| As per the CONTRIBUTING.md recommendations, this PR only creates the basic structure of the processor. The concrete implementation will come as a separate followup PR |
Validating CODEOWNERS rules …
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| include ../../Makefile.Common |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,35 @@ | ||
| # Interval Processor | ||
|
|
||
| <!-- status autogenerated section --> | ||
| | Status | | | ||
| | ------------- |-----------| | ||
| | Stability | [development]: metrics | | ||
| | Distributions | [contrib] | | ||
| | Warnings | [Statefulness](#warnings) | | ||
| | Issues | [](https://github.com/open-telemetry/opentelemetry-collector-contrib/issues?q=is%3Aopen+is%3Aissue+label%3Aprocessor%2Finterval) [](https://github.com/open-telemetry/opentelemetry-collector-contrib/issues?q=is%3Aclosed+is%3Aissue+label%3Aprocessor%2Finterval) | | ||
| | [Code Owners](https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/CONTRIBUTING.md#becoming-a-code-owner) | [@RichieSams](https://www.github.com/RichieSams) | | ||
|
|
||
| [development]: https://github.com/open-telemetry/opentelemetry-collector#development | ||
| [contrib]: https://github.com/open-telemetry/opentelemetry-collector-releases/tree/main/distributions/otelcol-contrib | ||
| <!-- end autogenerated section --> | ||
|
|
||
| ## Description | ||
|
|
||
| The interval processor (`intervalprocessor`) aggregates metrics and periodically forwards the latest values to the next component in the pipeline. The processor supports aggregating the following metric types: | ||
|
|
||
| * Monotonically increasing, cumulative sums | ||
| * Monotonically increasing, cumulative histograms | ||
| * Monotonically increasing, cumulative exponential histograms | ||
|
|
||
| The following metric types will *not* be aggregated, and will instead be passed, unchanged, to the next component in the pipeline: | ||
|
|
||
| * All delta metrics | ||
| * Non-monotonically increasing sums | ||
| * Gauges | ||
| * Summaries | ||
|
|
||
| ## Configuration | ||
|
|
||
| The following settings can be optionally configured: | ||
|
|
||
| - `max_staleness`: The total time a state entry will live past the time it was last seen. Set to 0 to retain state indefinitely. Default: 0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,24 @@ | ||
| // Copyright The OpenTelemetry Authors | ||
| // SPDX-License-Identifier: Apache-2.0 | ||
|
|
||
| package intervalprocessor // import "github.com/open-telemetry/opentelemetry-collector-contrib/processor/intervalprocessor" | ||
|
|
||
| import ( | ||
| "time" | ||
|
|
||
| "go.opentelemetry.io/collector/component" | ||
| ) | ||
|
|
||
| var _ component.Config = (*Config)(nil) | ||
|
|
||
| // Config defines the configuration for the processor. | ||
| type Config struct { | ||
| // MaxStaleness is the total time a state entry will live past the time it was last seen. Set to 0 to retain state indefinitely. | ||
| MaxStaleness time.Duration `mapstructure:"max_staleness"` | ||
| } | ||
|
|
||
| // Validate checks whether the input configuration has all of the required fields for the processor. | ||
| // An error is returned if there are any invalid inputs. | ||
| func (config *Config) Validate() error { | ||
| return nil | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| // Copyright The OpenTelemetry Authors | ||
| // SPDX-License-Identifier: Apache-2.0 | ||
|
|
||
| //go:generate mdatagen metadata.yaml | ||
|
|
||
| // package intervalprocessor implements a processor which aggregates cumulative | ||
| // metrics over time, and periodically exports the latest values | ||
| package intervalprocessor // import "github.com/open-telemetry/opentelemetry-collector-contrib/processor/intervalprocessor" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,36 @@ | ||
| // Copyright The OpenTelemetry Authors | ||
| // SPDX-License-Identifier: Apache-2.0 | ||
|
|
||
| package intervalprocessor // import "github.com/open-telemetry/opentelemetry-collector-contrib/processor/intervalprocessor" | ||
|
|
||
| import ( | ||
| "context" | ||
| "fmt" | ||
|
|
||
| "go.opentelemetry.io/collector/component" | ||
| "go.opentelemetry.io/collector/consumer" | ||
| "go.opentelemetry.io/collector/processor" | ||
|
|
||
| "github.com/open-telemetry/opentelemetry-collector-contrib/processor/intervalprocessor/internal/metadata" | ||
| ) | ||
|
|
||
| // NewFactory returns a new factory for the Metrics Generation processor. | ||
| func NewFactory() processor.Factory { | ||
| return processor.NewFactory( | ||
| metadata.Type, | ||
| createDefaultConfig, | ||
| processor.WithMetrics(createMetricsProcessor, metadata.MetricsStability)) | ||
| } | ||
|
|
||
| func createDefaultConfig() component.Config { | ||
| return &Config{} | ||
| } | ||
|
|
||
| func createMetricsProcessor(_ context.Context, set processor.CreateSettings, cfg component.Config, nextConsumer consumer.Metrics) (processor.Metrics, error) { | ||
| processorConfig, ok := cfg.(*Config) | ||
| if !ok { | ||
| return nil, fmt.Errorf("configuration parsing error") | ||
| } | ||
|
|
||
| return newProcessor(processorConfig, set.Logger, nextConsumer), nil | ||
| } |
108 changes: 108 additions & 0 deletions
108
processor/intervalprocessor/generated_component_test.go
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,71 @@ | ||
| module github.com/open-telemetry/opentelemetry-collector-contrib/processor/intervalprocessor | ||
|
|
||
| go 1.20 | ||
|
|
||
| require ( | ||
| github.com/open-telemetry/opentelemetry-collector-contrib/internal/coreinternal v0.92.0 | ||
| github.com/stretchr/testify v1.8.4 | ||
| go.opentelemetry.io/collector/component v0.93.1-0.20240124123350-9047c0e373f9 | ||
| go.opentelemetry.io/collector/confmap v0.93.1-0.20240124123350-9047c0e373f9 | ||
| go.opentelemetry.io/collector/consumer v0.93.1-0.20240124123350-9047c0e373f9 | ||
| go.opentelemetry.io/collector/pdata v1.0.2-0.20240124123350-9047c0e373f9 | ||
| go.opentelemetry.io/collector/processor v0.93.1-0.20240124123350-9047c0e373f9 | ||
| go.opentelemetry.io/otel/metric v1.22.0 | ||
| go.opentelemetry.io/otel/trace v1.22.0 | ||
| go.uber.org/zap v1.26.0 | ||
| ) | ||
|
|
||
| require ( | ||
| contrib.go.opencensus.io/exporter/prometheus v0.4.2 // indirect | ||
| github.com/beorn7/perks v1.0.1 // indirect | ||
| github.com/cespare/xxhash/v2 v2.2.0 // indirect | ||
| github.com/davecgh/go-spew v1.1.1 // indirect | ||
| github.com/go-kit/log v0.2.1 // indirect | ||
| github.com/go-logfmt/logfmt v0.5.1 // indirect | ||
| github.com/go-logr/logr v1.4.1 // indirect | ||
| github.com/go-logr/stdr v1.2.2 // indirect | ||
| github.com/gogo/protobuf v1.3.2 // indirect | ||
| github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect | ||
| github.com/golang/protobuf v1.5.3 // indirect | ||
| github.com/hashicorp/go-version v1.6.0 // indirect | ||
| github.com/json-iterator/go v1.1.12 // indirect | ||
| github.com/knadh/koanf/maps v0.1.1 // indirect | ||
| github.com/knadh/koanf/providers/confmap v0.1.0 // indirect | ||
| github.com/knadh/koanf/v2 v2.0.1 // indirect | ||
| github.com/mitchellh/copystructure v1.2.0 // indirect | ||
| github.com/mitchellh/mapstructure v1.5.1-0.20231216201459-8508981c8b6c // indirect | ||
| github.com/mitchellh/reflectwalk v1.0.2 // indirect | ||
| github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect | ||
| github.com/modern-go/reflect2 v1.0.2 // indirect | ||
| github.com/pmezard/go-difflib v1.0.0 // indirect | ||
| github.com/prometheus/client_golang v1.18.0 // indirect | ||
| github.com/prometheus/client_model v0.5.0 // indirect | ||
| github.com/prometheus/common v0.46.0 // indirect | ||
| github.com/prometheus/procfs v0.12.0 // indirect | ||
| github.com/prometheus/statsd_exporter v0.22.7 // indirect | ||
| go.opencensus.io v0.24.0 // indirect | ||
| go.opentelemetry.io/collector v0.93.1-0.20240124123350-9047c0e373f9 // indirect | ||
| go.opentelemetry.io/collector/config/configtelemetry v0.93.1-0.20240124123350-9047c0e373f9 // indirect | ||
| go.opentelemetry.io/collector/featuregate v1.0.2-0.20240124123350-9047c0e373f9 // indirect | ||
| go.opentelemetry.io/otel v1.22.0 // indirect | ||
| go.opentelemetry.io/otel/exporters/prometheus v0.45.0 // indirect | ||
| go.opentelemetry.io/otel/sdk v1.22.0 // indirect | ||
| go.opentelemetry.io/otel/sdk/metric v1.22.0 // indirect | ||
| go.uber.org/multierr v1.11.0 // indirect | ||
| golang.org/x/net v0.20.0 // indirect | ||
| golang.org/x/sys v0.16.0 // indirect | ||
| golang.org/x/text v0.14.0 // indirect | ||
| google.golang.org/genproto/googleapis/rpc v0.0.0-20231002182017-d307bd883b97 // indirect | ||
| google.golang.org/grpc v1.60.1 // indirect | ||
| google.golang.org/protobuf v1.32.0 // indirect | ||
| gopkg.in/yaml.v2 v2.4.0 // indirect | ||
| gopkg.in/yaml.v3 v3.0.1 // indirect | ||
| ) | ||
|
|
||
| replace github.com/open-telemetry/opentelemetry-collector-contrib/internal/coreinternal => ../../internal/coreinternal | ||
|
|
||
| replace github.com/open-telemetry/opentelemetry-collector-contrib/pkg/pdatautil => ../../pkg/pdatautil | ||
|
|
||
| replace github.com/open-telemetry/opentelemetry-collector-contrib/pkg/pdatatest => ../../pkg/pdatatest | ||
|
|
||
| replace github.com/open-telemetry/opentelemetry-collector-contrib/pkg/golden => ../../pkg/golden |
Oops, something went wrong.