[Ingest Manager] Update package registry docker image for CI. #70716

skh · 2020-07-03T13:46:20Z

Summary

Updates the docker image in CI to today's distribution build.

The image is tagged with a commit hash of the package-registry repository. The contents of this image will not change when newer distribution images are built, as they will come with a newer commit hash.

Updating the docker image we use in CI is a manual process by intention, as we only want to introduce a changed package registry on purpose, and not by accident.

How to test this

inspect the CI result
run ingest management api integration tests locally as described in dev_docs/api_integration_tests.md

elasticmachine · 2020-07-06T07:30:05Z

Pinging @elastic/ingest-management (Team:Ingest Management)

x-pack/test/ingest_manager_api_integration/apis/file.ts

skh · 2020-07-06T15:07:36Z

@elasticmachine merge upstream

jonathan-buttner

I tested this locally 👍

kibanamachine · 2020-07-06T16:56:53Z

💛 Build succeeded, but was flaky

continuous-integration/kibana-ci/pull-request
Commit: 74c1446
Flaky suites:
- xpack-kibana-ciGroup7

Test Failures

Kibana Pipeline / kibana-xpack-agent / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/dashboard/_async_dashboard·ts.dashboard sample data dashboard "before all" hook for "should launch sample flights data set dashboard"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 2 times on tracked branches: https://github.com/elastic/kibana/issues/70715

[00:00:00]       │
[00:00:00]         └-: dashboard
[00:00:00]           └-> "before all" hook
[00:09:17]           └-: sample data dashboard
[00:09:17]             └-> "before all" hook
[00:09:17]             └-> "before all" hook
[00:09:17]               │ debg ... sleep(5000) start
[00:09:22]               │ debg ... sleep(5000) end
[00:09:22]               │ debg navigateToActualUrl http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg browser[INFO] http://localhost:6181/app/home?_t=1594050820136#/tutorial_directory/sampleData 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:23]               │
[00:09:23]               │ debg browser[INFO] http://localhost:6181/bundles/app/core/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:23]               │ debg currentUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │          appUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg TestSubjects.find(kibanaChrome)
[00:09:23]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:25]               │ debg isGlobalLoadingIndicatorVisible
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:09:25]               │ debg browser[INFO] http://localhost:6181/34342/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js 452:106112 "INFO: 2020-07-06T15:53:41Z
[00:09:25]               │        Adding connection to http://localhost:6181/elasticsearch
[00:09:25]               │
[00:09:25]               │      "
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:09:25]               │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:09:25]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:25]               │ debg TestSubjects.click(addSampleDataSetflights)
[00:09:25]               │ debg Find.clickByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg TestSubjects.find(sampleDataSetCardflights)
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="sampleDataSetCardflights"]') with timeout=10000
[00:09:27]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:27]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:27]               │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/dashboard sample data dashboard _before all_ hook.png"
[00:09:27]               │ info Current URL is: http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]               │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/dashboard sample data dashboard _before all_ hook.html
[00:09:27]               └- ✖ fail: "dashboard sample data dashboard "before all" hook for "should launch sample flights data set dashboard""
[00:09:27]               │

Stack Trace

Error: expected false to equal true
    at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.be.Assertion.equal (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:227:8)
    at Assertion.be (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:69:22)
    at Context.before (test/functional/apps/dashboard/_async_dashboard.ts:39:30)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Kibana Pipeline / kibana-xpack-agent / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/dashboard/_async_dashboard·ts.dashboard sample data dashboard "after all" hook for "toggle from Discover to Dashboard attempt 2"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 15 times on tracked branches: https://github.com/elastic/kibana/issues/65949

[00:00:00]       │
[00:00:00]         └-: dashboard
[00:00:00]           └-> "before all" hook
[00:09:17]           └-: sample data dashboard
[00:09:17]             └-> "before all" hook
[00:09:17]             └-> "before all" hook
[00:09:17]               │ debg ... sleep(5000) start
[00:09:22]               │ debg ... sleep(5000) end
[00:09:22]               │ debg navigateToActualUrl http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg browser[INFO] http://localhost:6181/app/home?_t=1594050820136#/tutorial_directory/sampleData 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:23]               │
[00:09:23]               │ debg browser[INFO] http://localhost:6181/bundles/app/core/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:23]               │ debg currentUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │          appUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg TestSubjects.find(kibanaChrome)
[00:09:23]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:25]               │ debg isGlobalLoadingIndicatorVisible
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:09:25]               │ debg browser[INFO] http://localhost:6181/34342/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js 452:106112 "INFO: 2020-07-06T15:53:41Z
[00:09:25]               │        Adding connection to http://localhost:6181/elasticsearch
[00:09:25]               │
[00:09:25]               │      "
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:09:25]               │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:09:25]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:25]               │ debg TestSubjects.click(addSampleDataSetflights)
[00:09:25]               │ debg Find.clickByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg TestSubjects.find(sampleDataSetCardflights)
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="sampleDataSetCardflights"]') with timeout=10000
[00:09:27]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:27]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:27]               │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/dashboard sample data dashboard _before all_ hook.png"
[00:09:27]               │ info Current URL is: http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]               │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/dashboard sample data dashboard _before all_ hook.html
[00:09:27]               └- ✖ fail: "dashboard sample data dashboard "before all" hook for "should launch sample flights data set dashboard""
[00:09:27]               │
[00:09:27]               └-> "after all" hook
[00:09:27]                 │ debg navigateToActualUrl http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]                 │ debg browser[INFO] http://localhost:6181/app/home?_t=1594050824576#/tutorial_directory/sampleData 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:27]                 │
[00:09:27]                 │ debg browser[INFO] http://localhost:6181/bundles/app/core/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:27]                 │ debg currentUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]                 │          appUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]                 │ debg TestSubjects.find(kibanaChrome)
[00:09:27]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:29]                 │ debg isGlobalLoadingIndicatorVisible
[00:09:29]                 │ debg TestSubjects.exists(globalLoadingIndicator)
[00:09:29]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:09:29]                 │ debg browser[INFO] http://localhost:6181/34342/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js 452:106112 "INFO: 2020-07-06T15:53:45Z
[00:09:29]                 │        Adding connection to http://localhost:6181/elasticsearch
[00:09:29]                 │
[00:09:29]                 │      "
[00:09:29]                 │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:09:29]                 │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:09:29]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:09:29]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:09:39]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:09:39]                 │      Wait timed out after 10081ms
[00:09:40]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:09:40]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:09:50]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:09:50]                 │      Wait timed out after 10060ms
[00:09:50]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:09:50]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:00]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:00]                 │      Wait timed out after 10018ms
[00:10:01]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:01]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:11]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:11]                 │      Wait timed out after 10032ms
[00:10:12]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:12]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:22]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:22]                 │      Wait timed out after 10013ms
[00:10:22]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:22]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:32]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:32]                 │      Wait timed out after 10011ms
[00:10:33]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:33]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:43]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:43]                 │      Wait timed out after 10013ms
[00:10:43]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:43]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:53]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:53]                 │      Wait timed out after 10055ms
[00:10:54]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:54]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:04]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:04]                 │      Wait timed out after 10021ms
[00:11:04]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:11:04]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:14]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:14]                 │      Wait timed out after 10014ms
[00:11:15]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:11:15]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:25]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:25]                 │      Wait timed out after 10036ms
[00:11:25]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:11:25]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:35]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:35]                 │      Wait timed out after 10030ms
[00:11:36]                 │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/dashboard sample data dashboard _after all_ hook.png"
[00:11:36]                 │ info Current URL is: http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:11:36]                 │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/dashboard sample data dashboard _after all_ hook.html
[00:11:36]                 └- ✖ fail: "dashboard sample data dashboard "after all" hook for "toggle from Discover to Dashboard attempt 2""
[00:11:36]                 │

Stack Trace

Error: retry.tryForTime timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
Wait timed out after 10030ms
    at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at process._tickCallback (internal/process/next_tick.js:68:7)
    at onFailure (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:68:13)

Build metrics

✅ unchanged

History

💚 Build #58691 succeeded 31e15b1

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

…c#70716) * Update package registry docker image for CI. * Adapt to new registry filesystem layout. * Adjust tests to changed registry behavior. Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

#70836) * Update package registry docker image for CI. * Adapt to new registry filesystem layout. * Adjust tests to changed registry behavior. Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Update package registry docker image for CI.

1dee045

skh self-assigned this Jul 3, 2020

skh added release_note:skip Skip the PR/issue when compiling release notes Team:Fleet Team label for Observability Data Collection Fleet team v7.9.0 v8.0.0 labels Jul 3, 2020

skh added 2 commits July 3, 2020 16:25

Adapt to new registry filesystem layout.

df2346e

Adjust tests to changed registry behavior.

31e15b1

skh marked this pull request as ready for review July 6, 2020 07:30

jfsiii reviewed Jul 6, 2020

View reviewed changes

x-pack/test/ingest_manager_api_integration/apis/file.ts Show resolved Hide resolved

jfsiii self-requested a review July 6, 2020 14:21

jfsiii approved these changes Jul 6, 2020

View reviewed changes

Merge branch 'master' into update-registry-in-ci

74c1446

jonathan-buttner approved these changes Jul 6, 2020

View reviewed changes

jonathan-buttner mentioned this pull request Jul 6, 2020

[EPM][Security Solution] Implementing dataset component templates #70517

Merged

skh merged commit 89dcdbb into elastic:master Jul 6, 2020

skh mentioned this pull request Jul 6, 2020

[7.x] [Ingest Manager] Update package registry docker image for CI. (#70716) #70836

Merged

jen-huang mentioned this pull request Jul 6, 2020

[Ingest Manager] Support limiting integrations on an agent config #70542

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Ingest Manager] Update package registry docker image for CI. #70716

[Ingest Manager] Update package registry docker image for CI. #70716

skh commented Jul 3, 2020 •

edited

Loading

elasticmachine commented Jul 6, 2020

skh commented Jul 6, 2020

jonathan-buttner left a comment

kibanamachine commented Jul 6, 2020

Standard Out

Stack Trace

Standard Out

Stack Trace

[Ingest Manager] Update package registry docker image for CI. #70716

[Ingest Manager] Update package registry docker image for CI. #70716

Conversation

skh commented Jul 3, 2020 • edited Loading

Summary

How to test this

elasticmachine commented Jul 6, 2020

skh commented Jul 6, 2020

jonathan-buttner left a comment

Choose a reason for hiding this comment

kibanamachine commented Jul 6, 2020

💛 Build succeeded, but was flaky

Test Failures

Standard Out

Stack Trace

Standard Out

Stack Trace

Build metrics

History

skh commented Jul 3, 2020 •

edited

Loading