Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Some metricbeat modules are incorrectly reporting module fields #13432

Closed
jsoriano opened this issue Aug 30, 2019 · 1 comment · Fixed by #13433 or #13544
Closed

Some metricbeat modules are incorrectly reporting module fields #13432

jsoriano opened this issue Aug 30, 2019 · 1 comment · Fixed by #13433 or #13544
Assignees
@jsoriano
Labels
bug containers Related to containers use case in progress Pull request is currently in progress. Metricbeat Metricbeat module Team:Integrations Label for the Integrations team v7.4.0

Comments

@jsoriano
Copy link
Member

Some Metricbeat modules are reporting module fields under an incorrect path, for example the Kubernetes container metricset is reporting labels under kubernetes.container._module.labels, when they should be under kubernetes.labels.

_module is an internal key used for module fields before mb.Event was introduced, so the issue could be related to the migrations done during #10774

Seen in:
@jsoriano jsoriano added bug module Metricbeat Metricbeat containers Related to containers use case Team:Integrations Label for the Integrations team labels Aug 30, 2019
@jsoriano jsoriano self-assigned this Aug 30, 2019
@jsoriano jsoriano added [zube]: In Progress in progress Pull request is currently in progress. labels Aug 30, 2019
jsoriano added a commit to jsoriano/beats that referenced this issue Aug 30, 2019
@jsoriano
Fix conversions of events with module fields
41ee469 
Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432
@jsoriano jsoriano mentioned this issue Aug 30, 2019
Merged
jsoriano added a commit that referenced this issue Aug 30, 2019
@jsoriano
Fix conversions of events with module fields (#13433)
310a96e 
Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix #13432
@jsoriano jsoriano mentioned this issue Aug 30, 2019
Merged
jsoriano added a commit to jsoriano/beats that referenced this issue Aug 30, 2019
@jsoriano
Fix conversions of events with module fields (elastic#13433)
6c5a8f5 
Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432

(cherry picked from commit 310a96e)
jsoriano added a commit to jsoriano/beats that referenced this issue Aug 30, 2019
@jsoriano
Fix conversions of events with module fields (elastic#13433)
771176e 
Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432

(cherry picked from commit 310a96e)
@jsoriano jsoriano mentioned this issue Aug 30, 2019
Merged
jsoriano added a commit to jsoriano/beats that referenced this issue Aug 30, 2019
@jsoriano
Fix conversions of events with module fields (elastic#13433)
121edbf 
Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432

(cherry picked from commit 310a96e)
@jsoriano jsoriano mentioned this issue Aug 30, 2019
Merged
jsoriano added a commit that referenced this issue Aug 31, 2019
@jsoriano
Cherry-pick #13433 to 7.4: Fix conversions of events with module fiel…
db6da10 
…ds (#13440)

Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix #13432

(cherry picked from commit 310a96e)
jsoriano added a commit that referenced this issue Sep 3, 2019
@jsoriano
Cherry-pick #13433 to 7.3: Fix conversions of events with module fiel…
0959879 
…ds (#13441)

Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix #13432

(cherry picked from commit 310a96e)
jsoriano added a commit that referenced this issue Sep 3, 2019
@jsoriano
Cherry-pick #13433 to 7.2: Fix conversions of events with module fiel…
45018e4 
…ds (#13442)

Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix #13432

(cherry picked from commit 310a96e)
@jsoriano
Copy link
Member Author

jsoriano commented Sep 6, 2019 •
edited
Loading

Reopening as it is still happening for kubernetes.state_node.

@jsoriano jsoriano reopened this Sep 6, 2019
@jsoriano jsoriano added the v7.4.0 label Sep 6, 2019
jsoriano added a commit to jsoriano/beats that referenced this issue Sep 8, 2019
@jsoriano
Fix conversion of events with module fields
0d5a931 
Apply elastic#13433 also to the kubernetes `state_node` metricset.

Fix elastic#13432
@jsoriano jsoriano mentioned this issue Sep 8, 2019
Merged
jsoriano added a commit that referenced this issue Sep 9, 2019
@jsoriano
Fix conversion of events with module fields (#13544)
b2ead08 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in #13433 with
other metricsets.

Fix #13432
@jsoriano jsoriano mentioned this issue Sep 9, 2019
Merged
jsoriano added a commit to jsoriano/beats that referenced this issue Sep 9, 2019
@jsoriano
Fix conversion of events with module fields (elastic#13544)
4088ef6 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in elastic#13433 with
other metricsets.

Fix elastic#13432

(cherry picked from commit b2ead08)
@jsoriano jsoriano mentioned this issue Sep 9, 2019
Merged
@jsoriano jsoriano mentioned this issue Sep 9, 2019
Merged
jsoriano added a commit to jsoriano/beats that referenced this issue Sep 9, 2019
@jsoriano
Fix conversion of events with module fields (elastic#13544)
4f96543 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in elastic#13433 with
other metricsets.

Fix elastic#13432

(cherry picked from commit b2ead08)
jsoriano added a commit that referenced this issue Sep 9, 2019
@jsoriano
Fix conversion of events with module fields (#13544) (#13552)
e0bb1c1 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in #13433 with
other metricsets.

Fix #13432

(cherry picked from commit b2ead08)
jsoriano added a commit to jsoriano/beats that referenced this issue Sep 9, 2019
@jsoriano
Fix conversion of events with module fields (elastic#13544)
46ede79 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in elastic#13433 with
other metricsets.

Fix elastic#13432

(cherry picked from commit b2ead08)
jsoriano added a commit that referenced this issue Sep 10, 2019
@jsoriano
Fix conversion of events with module fields (#13544) (#13553)
048aacd 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in #13433 with
other metricsets.

Fix #13432

(cherry picked from commit b2ead08)
jsoriano added a commit that referenced this issue Sep 10, 2019
@jsoriano
Fix conversion of events with module fields (#13544) (#13554)
153c5c9 
Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in #13433 with
other metricsets.

Fix #13432

(cherry picked from commit b2ead08)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@jsoriano
Cherry-pick elastic#13433 to 7.2: Fix conversions of events with modu…
1d0c15b 
…le fields (elastic#13442)

Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432

(cherry picked from commit 71fb53e)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@jsoriano
Fix conversion of events with module fields (elastic#13544) (elastic#…
b41478f 
…13554)

Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in elastic#13433 with
other metricsets.

Fix elastic#13432

(cherry picked from commit 54860f7)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@jsoriano
Cherry-pick elastic#13433 to 7.4: Fix conversions of events with modu…
0b46303 
…le fields (elastic#13440)

Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432

(cherry picked from commit 71fb53e)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@jsoriano
Fix conversion of events with module fields (elastic#13544) (elastic#…
990cba4 
…13552)

Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in elastic#13433 with
other metricsets.

Fix elastic#13432

(cherry picked from commit 54860f7)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@jsoriano
Cherry-pick elastic#13433 to 7.3: Fix conversions of events with modu…
7362aa6 
…le fields (elastic#13441)

Metricsets that use special fields like `ModuleDataKey` cannot be
directly used as metricset fields of `mb.Event`, they need to be
converted using something like the `mb.TransformMapStrToEvent()`
helper.

Fix elastic#13432

(cherry picked from commit 71fb53e)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@jsoriano
Fix conversion of events with module fields (elastic#13544) (elastic#…
631bfcc 
…13553)

Use `TransformMapStrToEvent` also to convert events in the
kubernetes `state_node` metricset, as was done in elastic#13433 with
other metricsets.

Fix elastic#13432

(cherry picked from commit 54860f7)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jsoriano jsoriano

Labels
bug containers Related to containers use case in progress Pull request is currently in progress. Metricbeat Metricbeat module Team:Integrations Label for the Integrations team v7.4.0
Projects
None yet
Milestone
No milestone
2 participants
@jsoriano @andresrc