Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SIEM] Updates cosumer in export_rule archive #71117

Merged
merged 1 commit into from
Jul 9, 2020
Merged

[SIEM] Updates cosumer in export_rule archive #71117

merged 1 commit into from
Jul 9, 2020

Conversation

MadameSheema
Copy link
Member

@MadameSheema MadameSheema commented Jul 8, 2020 •
edited by gmmorris
Loading

Summary

In this PR we are updating the consumer of the export_rule archive to siem.

This should fix a failing test seen in The Alerting PR #67157

@MadameSheema MadameSheema added Team:SIEM v8.0.0 release_note:skip Skip the PR/issue when compiling release notes v7.9.0 labels Jul 8, 2020
@MadameSheema MadameSheema self-assigned this Jul 8, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/siem (Team:SIEM)

gmmorris
gmmorris approved these changes Jul 8, 2020
View reviewed changes
Copy link
Contributor

@gmmorris gmmorris left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I saw the fix in real time so feel comfortable saying 👍

Thanks Glo

dhurley14
dhurley14 approved these changes Jul 8, 2020
View reviewed changes
Copy link
Contributor

@dhurley14 dhurley14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified the change from "consumer": "securitySolution" in the zipped json to "consumer": "siem". LGTM! Thanks :)

@kibanamachine
Copy link
Contributor

💛 Build succeeded, but was flaky

Test Failures

Firefox UI Functional Tests.test/functional/apps/visualize/_tsvb_chart·ts.visualize app visual builder "before each" hook for "should verify topN label and count display"

Link to Jenkins

Standard Out

[00:00:00]       │
[00:12:24]         └-: visualize app
[00:12:24]           └-> "before all" hook
[00:12:24]           └-> "before all" hook
[00:12:24]             │ debg Starting visualize before method
[00:12:25]             │ info [logstash_functional] Loading "mappings.json"
[00:12:25]             │ info [logstash_functional] Loading "data.json.gz"
[00:12:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [logstash-2015.09.22] creating index, cause [api], templates [], shards [1]/[0]
[00:12:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.22][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.22][0]]"
[00:12:25]             │ info [logstash_functional] Created index "logstash-2015.09.22"
[00:12:25]             │ debg [logstash_functional] "logstash-2015.09.22" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [logstash-2015.09.20] creating index, cause [api], templates [], shards [1]/[0]
[00:12:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.20][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.20][0]]"
[00:12:25]             │ info [logstash_functional] Created index "logstash-2015.09.20"
[00:12:25]             │ debg [logstash_functional] "logstash-2015.09.20" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [logstash-2015.09.21] creating index, cause [api], templates [], shards [1]/[0]
[00:12:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.21][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.21][0]]"
[00:12:25]             │ info [logstash_functional] Created index "logstash-2015.09.21"
[00:12:25]             │ debg [logstash_functional] "logstash-2015.09.21" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:35]             │ info progress: 13545
[00:12:35]             │ info [logstash_functional] Indexed 4633 docs into "logstash-2015.09.22"
[00:12:35]             │ info [logstash_functional] Indexed 4757 docs into "logstash-2015.09.20"
[00:12:35]             │ info [logstash_functional] Indexed 4614 docs into "logstash-2015.09.21"
[00:12:35]             │ info [long_window_logstash] Loading "mappings.json"
[00:12:35]             │ info [long_window_logstash] Loading "data.json.gz"
[00:12:35]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [long-window-logstash-0] creating index, cause [api], templates [], shards [1]/[0]
[00:12:35]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[long-window-logstash-0][0]]])." previous.health="YELLOW" reason="shards started [[long-window-logstash-0][0]]"
[00:12:35]             │ info [long_window_logstash] Created index "long-window-logstash-0"
[00:12:35]             │ debg [long_window_logstash] "long-window-logstash-0" settings {"index":{"analysis":{"analyzer":{"makelogs_url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:45]             │ info progress: 12040
[00:12:47]             │ info [long_window_logstash] Indexed 14005 docs into "long-window-logstash-0"
[00:12:47]             │ info [visualize] Loading "mappings.json"
[00:12:47]             │ info [visualize] Loading "data.json"
[00:12:47]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/Q5Ogh-ASSO6_GUZReRM-9g] deleting index
[00:12:47]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_1/UIJJNfTBSCyj0KeXnXSG_Q] deleting index
[00:12:47]             │ info [visualize] Deleted existing index [".kibana_2",".kibana_1"]
[00:12:47]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:12:47]             │ info [visualize] Created index ".kibana"
[00:12:47]             │ debg [visualize] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:12:47]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana/Par3N9sXTYiJLsxO3Ues0Q] update_mapping [_doc]
[00:12:47]             │ info [visualize] Indexed 12 docs into ".kibana"
[00:12:47]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana/Par3N9sXTYiJLsxO3Ues0Q] update_mapping [_doc]
[00:12:47]             │ debg Migrating saved objects
[00:12:47]             │ proc [kibana]   log   [16:44:30.530] [info][savedobjects-service] Creating index .kibana_2.
[00:12:47]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:12:47]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] updating number_of_replicas to [0] for indices [.kibana_2]
[00:12:48]             │ proc [kibana]   log   [16:44:30.581] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:12:48]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:12:48]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] updating number_of_replicas to [0] for indices [.kibana_1]
[00:12:48]             │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] 9077 finished with response BulkByScrollResponse[took=26.6ms,timed_out=false,sliceId=null,updated=0,created=12,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:12:48]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana/Par3N9sXTYiJLsxO3Ues0Q] deleting index
[00:12:48]             │ proc [kibana]   log   [16:44:30.918] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:12:48]             │ proc [kibana]   log   [16:44:30.936] [error][savedobjects-service] Error: Unable to migrate the corrupt Saved Object document index-pattern:test_index*. To prevent Kibana from performing a migration on every restart, please delete or fix this document by ensuring that the namespace and type in the document's id matches the values in the namespace and type fields.
[00:12:48]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/3vf-bigEQUeNGkDljqoe6w] update_mapping [_doc]
[00:12:48]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/3vf-bigEQUeNGkDljqoe6w] update_mapping [_doc]
[00:12:48]             │ proc [kibana]   log   [16:44:31.019] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:12:48]             │ proc [kibana]   log   [16:44:31.074] [info][savedobjects-service] Finished in 545ms.
[00:12:48]             │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:12:48]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/3vf-bigEQUeNGkDljqoe6w] update_mapping [_doc]
[00:12:50]             │ debg replacing kibana config doc: {"defaultIndex":"logstash-*","format:bytes:defaultPattern":"0,0.[000]b"}
[00:13:24]           └-: 
[00:13:24]             └-> "before all" hook
[00:13:24]             └-: visual builder
[00:13:24]               └-> "before all" hook

Stack Trace

Error: retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="createVisualizationPromptButton"])
Wait timed out after 10007ms
    at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at process._tickCallback (internal/process/next_tick.js:68:7)
    at onFailure (test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (test/common/services/retry/retry_for_success.ts:68:13)
    at onFailure (test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (test/common/services/retry/retry_for_success.ts:68:13)

Build metrics

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@MadameSheema MadameSheema merged commit 716d56e into elastic:master Jul 9, 2020
@MadameSheema MadameSheema mentioned this pull request Jul 9, 2020
Merged
MadameSheema added a commit to MadameSheema/kibana that referenced this pull request Jul 9, 2020
@MadameSheema
updates consumer to siem (elastic#71117)
27e2b5d
gmmorris added a commit to gmmorris/kibana that referenced this pull request Jul 9, 2020
@gmmorris
Merge branch 'master' into alerting/consumer-based-rbac
9e74773 
* master: (39 commits)
  [APM] Add warning to notify user about legacy ML jobs (elastic#71030)
  updates consumer to siem (elastic#71117)
  Index pattern creation flow - fix spelling (elastic#71192)
  [Security Solution][Endpoint] User Manifest Cleanup + Artifact Compression (elastic#70759)
  [SECURITY] Rearrange rule name's column in Alert Table (elastic#71020)
  [SECURITY] Alerts back to Detections (elastic#71142)
  [Security Solution][Exceptions Builder] - Fixes operator selection bug (elastic#71178)
  [SIEM][Detection Engine] Speeds up value list imports by enabling streaming of files.
  [APM] Update ML job ID in data telemetry tasks (elastic#71044)
  [Resolver] Remove `currentPanelView` selector (elastic#71154)
  add meta.managed to index templates (elastic#71135)
  Clarify trial subscription levels (elastic#70900)
  [Security Solution] fix panel links (elastic#71148)
  skip flaky suite (elastic#69632)
  skip suite failing ES Promotion (elastic#71018)
  [ML] DF Analytics: add results field to wizard and show regression stats (elastic#70893)
  [SIEM] update wordings (elastic#71119)
  [SECURITY SOLUTION] Rename to hosts and administration (elastic#70913)
  [ML] Improvements for urlState hook. (elastic#70576)
  Removing uptime guide (elastic#71124)
  ...
MadameSheema added a commit that referenced this pull request Jul 9, 2020
@MadameSheema
updates consumer to siem (#71117) (#71201)
abcbdfe
@MadameSheema MadameSheema deleted the updates-export-archive branch July 14, 2021 10:41
@MindyRS MindyRS added the Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. label Sep 23, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dhurley14 dhurley14 dhurley14 approved these changes

@gmmorris gmmorris gmmorris approved these changes

Assignees

@MadameSheema MadameSheema

Labels
release_note:skip Skip the PR/issue when compiling release notes Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:SIEM v7.9.0 v8.0.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@MadameSheema @elasticmachine @kibanamachine @gmmorris @dhurley14 @MindyRS