Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Observability RAC] Remove indexing of rule evaluation documents #104970

Merged
merged 4 commits into from
Jul 19, 2021

Conversation

weltenwort
Copy link
Member

@weltenwort weltenwort commented Jul 8, 2021

📝 Summary

This removes the indexing of evaluation documents in the lifecycle executor helper until the the requirements and schema have been specified.

closes #104671

🕵️ Testing notes

  • The following settings enable writing any alert-as-data documents and the alerts table in the UI:
    xpack.ruleRegistry.write.enabled: true
    xpack.observability.unsafe.alertingExperience.enabled: true
    
  • Behavioral changes to specifically pay attention to:
    • No documents with event.kind: "event" should be indexed in the respective alerts-as-data indices even if the write flag is enabled.
    • The alerts table doesn't show any duplicates.

@weltenwort weltenwort added Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services release_note:skip Skip the PR/issue when compiling release notes Theme: rac label obsolete v7.15.0 labels Jul 8, 2021
@weltenwort weltenwort self-assigned this Jul 8, 2021
@spalger
Copy link
Contributor

spalger commented Jul 8, 2021

jenkins, test this

(had to abort for Jenkins upgrade)

@weltenwort weltenwort changed the title [Observability] Remove indexing of rule evaluation documents [Observability RAC] Remove indexing of rule evaluation documents Jul 12, 2021
@weltenwort weltenwort force-pushed the rac-remove-evaluation-documents branch from 2243989 to d1fa059 Compare July 12, 2021 19:52
@weltenwort weltenwort force-pushed the rac-remove-evaluation-documents branch from d1fa059 to 3aeb120 Compare July 13, 2021 14:26
@weltenwort weltenwort marked this pull request as ready for review July 13, 2021 17:04
@elasticmachine
Copy link
Contributor

Pinging @elastic/logs-metrics-ui (Team:logs-metrics-ui)

@Kerry350 Kerry350 self-requested a review July 14, 2021 10:01
@mgiota mgiota self-requested a review July 14, 2021 12:00
@@ -188,44 +188,6 @@ describe('createLifecycleRuleTypeFactory', () => {

expect(documents.map((doc) => omit(doc, 'kibana.rac.alert.uuid'))).toMatchInlineSnapshot(`
Array [
Object {
"@timestamp": "2021-06-16T09:01:00.000Z",
"event.action": "open",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

More like a general comment. event.action is basically the status of the document, right? Action sounds confusing at least to me.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok thanks makes more sense now. Felix wrote a test as part of this PR and looks like event.action is different from event.status.

@mgiota
Copy link
Contributor

mgiota commented Jul 14, 2021

LGTM! You covered it with tests and works as expected

@mgiota mgiota self-requested a review July 14, 2021 12:49
elasticsearchServiceMock,
savedObjectsClientMock,
} from '../../../../../src/core/server/mocks';
import {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would move this import after the mock imports

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The imports are sorted automatically by the typescript language server.

@weltenwort
Copy link
Member Author

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

merge conflict between base and head

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @weltenwort

@weltenwort weltenwort added the auto-backport Deprecated - use backport:version if exact versions are needed label Jul 19, 2021
@weltenwort weltenwort merged commit 44f7a99 into elastic:master Jul 19, 2021
@weltenwort weltenwort deleted the rac-remove-evaluation-documents branch July 19, 2021 17:56
@kibanamachine
Copy link
Contributor

💚 Backport successful

Status Branch Result
7.x

This backport PR will be merged automatically after passing CI.

kibanamachine added a commit that referenced this pull request Jul 19, 2021
…4970) (#106138)

Co-authored-by: Felix Stürmer <weltenwort@users.noreply.github.com>
jloleysens added a commit to jloleysens/kibana that referenced this pull request Jul 20, 2021
…y-show-migrate-to-authzd-users

* 'master' of github.com:elastic/kibana: (187 commits)
  Space management page UX improvements (elastic#100448)
  [Reporting] Unskip flaky test when downloading CSV with "no data" (elastic#105252)
  Update dependency @elastic/charts to v33 (master) (elastic#105633)
  [Observability RAC] Improve alerts table columns (elastic#105446)
  Introduce `preboot` lifecycle stage (elastic#103636)
  [Security Solution] Invalid kql query timeline refresh bug (elastic#105525)
  skip flaky suite (elastic#106121)
  [Security Solution][Endpoint] Fix UI inconsistency between isolation forms and remove display of Pending isolation statuses (elastic#106118)
  docs: APM RUM Source map API (elastic#105332)
  [CTI] Adds indicator match rule improvements (elastic#97310)
  [Security Solution] update text for Isolation action submissions (elastic#105956)
  EP Meta Telemetry Perf (elastic#104396)
  [Metrics UI] Drop partial buckets from ALL Metrics UI queries (elastic#104784)
  Remove beta admonitions for Fleet docs (elastic#106010)
  [Observability RAC] Remove indexing of rule evaluation documents (elastic#104970)
  Parameterize migration test for kibana version (elastic#105417)
  [Alerting] Allow rule to execute if the value is 0 and that mets the condition (elastic#105626)
  [ML] Fix Index data visualizer sometimes shows wrong doc count for saved searches (elastic#106007)
  [Security Solution] UX fixes for Policy page and Case Host Isolation comment (elastic#106027)
  [Security Solution]Memory protection configuration card for policies integration. (elastic#101365)
  ...

# Conflicts:
#	x-pack/plugins/reporting/public/management/report_listing.test.tsx
#	x-pack/plugins/reporting/public/management/report_listing.tsx
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Deprecated - use backport:version if exact versions are needed release_note:skip Skip the PR/issue when compiling release notes Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services Theme: rac label obsolete v7.15.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Observability] [RAC] Remove indexing of evaluation documents from lifecycle helper
6 participants