You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PR #5844 adds the new document_id setting for json decoding. This configures the field in the JSON document, that is read into @metadata.id.
The elasticsearch output sets the document id @metadata.id if present and uses the create operation -> if ID exists already, event is not indexed again.
For other outputs the @metadata.id field is added to the event so it can be used by logstash.
The original PR mentions the new setting, but we have to add some more documentation about the impact.
The text was updated successfully, but these errors were encountered:
We need to add a topic (all under the umbrella of de-duplication) that describes the various ways to configure document IDs: ES chooses, via JSON input, random, fingerprinting,
PR #5844 adds the new document_id setting for json decoding. This configures the field in the JSON document, that is read into
@metadata.id
.The elasticsearch output sets the document id
@metadata.id
if present and uses the create operation -> if ID exists already, event is not indexed again.For other outputs the
@metadata.id
field is added to the event so it can be used by logstash.The original PR mentions the new setting, but we have to add some more documentation about the impact.
The text was updated successfully, but these errors were encountered: