Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Heartbeat] Build elastic agent with synthetics support / offline mode (backport #27052) (backport #27324) #27468

Merged
merged 4 commits into from
Aug 18, 2021

Conversation

mergify[bot]
Copy link
Contributor

@mergify mergify bot commented Aug 18, 2021

This is an automatic backport of pull request #27324 done by Mergify.
Cherry-pick of f9b2610 has failed:

On branch mergify/bp/7.15/pr-27324
Your branch is up to date with 'origin/7.15'.

You are currently cherry-picking commit f9b261058.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   dev-tools/mage/dockerbuilder.go

no changes added to commit (use "git add" and/or "git commit -a")

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/github/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally


Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

  • @Mergifyio refresh will re-evaluate the rules
  • @Mergifyio rebase will rebase this PR on its base branch
  • @Mergifyio update will merge the base branch into this PR
  • @Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

  • look at your merge queues
  • generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.io/

#27052) (#27324)

Creates a new offline tagged docker image that includes the dependencies required for synthetics. Building elastic-agent docker images will now create additional -offline tagged images with these extras. We may need to do additional work to ensure that these additional images are incorporated into the release process and onto the public website.

These changes also set the ELASTIC_SYNTHETICS_CAPABLE env flag, as done in heartbeat, to enable synthetics features in the docker environment. This dovetails with the work @dominiqueclarke is doing in elastic/integrations#1064 and elsewhere

Fixes #22932

(cherry picked from commit 4727470)

Co-authored-by: Andrew Cholakian <andrew@andrewvc.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
(cherry picked from commit f9b2610)

# Conflicts:
#	dev-tools/mage/dockerbuilder.go
@mergify mergify bot added the conflicts There is a conflict in the backported pull request label Aug 18, 2021
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Aug 18, 2021
@botelastic
Copy link

botelastic bot commented Aug 18, 2021

This pull request doesn't have a Team:<team> label.

@elasticmachine
Copy link
Collaborator

elasticmachine commented Aug 18, 2021

❕ Build Aborted

There is a new build on-going so the previous on-going builds have been aborted.

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Reason: Aborted from #4

  • Start Time: 2021-08-18T15:03:40.803+0000

  • Duration: 38 min 14 sec

  • Commit: 3016bb0

Test stats 🧪

Test Results
Failed 0
Passed 13553
Skipped 459
Total 14012

Trends 🧪

Image of Build Times

Image of Tests

Steps errors 1

Expand to view the steps failures

Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'org.jenkinsci.plugins.workflow.steps.FlowInterruptedException'

Log output

Expand to view the last 100 lines of log output

[2021-08-18T15:40:47.872Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-08-18T15:40:48.126Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-08-18T15:40:48.337Z] + gcloud auth activate-service-account --key-file ****
[2021-08-18T15:40:48.370Z] Failed in branch x-pack/filebeat-goIntegTest
[2021-08-18T15:40:48.465Z] Failed in branch metricbeat-crosscompile
[2021-08-18T15:40:48.483Z] + gcloud auth activate-service-account --key-file ****
[2021-08-18T15:40:48.548Z] 
[2021-08-18T15:40:48.548Z] C:\Users\jenkins\workspace\PR-27468-3-5dcd39ba-729d-4fe6-957a-5bc838eaf8cf\src\github.com\elastic\beats>gsutil --version  1>NUL 
[2021-08-18T15:40:49.054Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-08-18T15:40:49.276Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-08-18T15:40:49.644Z] + gsutil -m -q cp -a public-read x-pack-auditbeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-27468-3
[2021-08-18T15:40:49.863Z] + gsutil -m -q cp -a public-read test-build-artifacts-x-pack-filebeat-pythonIntegTest-tgz gs://beats-ci-temp/Beats/beats/PR-27468-3
[2021-08-18T15:40:51.125Z] Masking supported pattern matches of %FILE_CREDENTIAL%
[2021-08-18T15:40:51.446Z] 
[2021-08-18T15:40:51.447Z] C:\Users\jenkins\workspace\PR-27468-3-5dcd39ba-729d-4fe6-957a-5bc838eaf8cf\src\github.com\elastic\beats>gcloud auth activate-service-account --key-file **** 
[2021-08-18T15:40:51.941Z] + go clean -modcache
[2021-08-18T15:40:52.385Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-08-18T15:40:53.527Z] + python .ci/scripts/search_system_tests.py
[2021-08-18T15:40:53.547Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2021-08-18T15:40:53.894Z] + tar --version
[2021-08-18T15:40:54.178Z] + gsutil --version
[2021-08-18T15:40:54.248Z] + tar --exclude=x-pack-filebeat--system-tests-linux-tgz -czf x-pack-filebeat--system-tests-linux-tgz build/x-pack/filebeat/build/system-tests
[2021-08-18T15:40:55.279Z] Timeout set to expire in 5 min 0 sec
[2021-08-18T15:40:55.583Z] Cleaning up /var/lib/jenkins/workspace/PR-27468-3-32e0c673-076b-42f5-bb74-9253314ed7b7
[2021-08-18T15:40:55.583Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-08-18T15:40:55.583Z] ++ id -u
[2021-08-18T15:40:55.583Z] ++ id -g
[2021-08-18T15:40:55.583Z] + docker run -v /var/lib/jenkins/workspace/PR-27468-3-32e0c673-076b-42f5-bb74-9253314ed7b7:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1168:1169 {} \;'
[2021-08-18T15:40:55.705Z] 
[2021-08-18T15:40:55.705Z] C:\Users\jenkins\workspace\PR-27468-3-5dcd39ba-729d-4fe6-957a-5bc838eaf8cf\src\github.com\elastic\beats>go clean -modcache 
[2021-08-18T15:40:56.524Z] + set -e
[2021-08-18T15:40:56.524Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-08-18T15:40:56.524Z] Change permissions with write access of all files inside the specific folder
[2021-08-18T15:40:56.524Z] + chmod -R +w /var/lib/jenkins/workspace/PR-27468-3-32e0c673-076b-42f5-bb74-9253314ed7b7
[2021-08-18T15:40:56.837Z] Running in /var/lib/jenkins/workspace/PR-27468-3-32e0c673-076b-42f5-bb74-9253314ed7b7
[2021-08-18T15:40:57.217Z] + gsutil --version
[2021-08-18T15:40:57.543Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-08-18T15:40:58.015Z] + gcloud auth activate-service-account --key-file ****
[2021-08-18T15:40:58.643Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-08-18T15:40:58.957Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-08-18T15:40:58.961Z] + gcloud auth activate-service-account --key-file ****
[2021-08-18T15:40:59.532Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-08-18T15:40:59.557Z] + gsutil -m -q cp -a public-read test-build-artifacts-x-pack-metricbeat-pythonIntegTest-tgz gs://beats-ci-temp/Beats/beats/PR-27468-3
[2021-08-18T15:41:00.120Z] + gsutil -m -q cp -a public-read x-pack-filebeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-27468-3
[2021-08-18T15:41:00.224Z] Failed in branch x-pack/auditbeat-build
[2021-08-18T15:41:02.428Z] + go clean -modcache
[2021-08-18T15:41:03.421Z] + python .ci/scripts/search_system_tests.py
[2021-08-18T15:41:03.440Z] [INFO] system-tests='build/x-pack/metricbeat/build/system-tests'. If no empty then let's create a tarball
[2021-08-18T15:41:03.779Z] + tar --version
[2021-08-18T15:41:04.114Z] + tar --exclude=x-pack-metricbeat--system-tests-linux-tgz -czf x-pack-metricbeat--system-tests-linux-tgz build/x-pack/metricbeat/build/system-tests
[2021-08-18T15:41:04.746Z] + gsutil --version
[2021-08-18T15:41:05.821Z] Timeout set to expire in 5 min 0 sec
[2021-08-18T15:41:06.181Z] Cleaning up /var/lib/jenkins/workspace/PR-27468-3-31828667-1468-472b-b278-f87474d377a4
[2021-08-18T15:41:06.181Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-08-18T15:41:06.181Z] ++ id -u
[2021-08-18T15:41:06.181Z] ++ id -g
[2021-08-18T15:41:06.181Z] + docker run -v /var/lib/jenkins/workspace/PR-27468-3-31828667-1468-472b-b278-f87474d377a4:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1168:1169 {} \;'
[2021-08-18T15:41:06.216Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-08-18T15:41:06.626Z] + gcloud auth activate-service-account --key-file ****
[2021-08-18T15:41:07.150Z] + set -e
[2021-08-18T15:41:07.150Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-08-18T15:41:07.150Z] Change permissions with write access of all files inside the specific folder
[2021-08-18T15:41:07.150Z] + chmod -R +w /var/lib/jenkins/workspace/PR-27468-3-31828667-1468-472b-b278-f87474d377a4
[2021-08-18T15:41:07.223Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-08-18T15:41:07.306Z] Running in /var/lib/jenkins/workspace/PR-27468-3-31828667-1468-472b-b278-f87474d377a4
[2021-08-18T15:41:07.729Z] + gsutil -m -q cp -a public-read x-pack-metricbeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-27468-3
[2021-08-18T15:41:10.163Z] + go clean -modcache
[2021-08-18T15:41:10.808Z] Failed in branch x-pack/filebeat-pythonIntegTest
[2021-08-18T15:41:13.514Z] Timeout set to expire in 5 min 0 sec
[2021-08-18T15:41:13.824Z] Cleaning up /var/lib/jenkins/workspace/PR-27468-3-7f1c18b2-4247-45cc-a0b7-8a4205408513
[2021-08-18T15:41:13.824Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-08-18T15:41:13.824Z] ++ id -u
[2021-08-18T15:41:13.824Z] ++ id -g
[2021-08-18T15:41:13.824Z] + docker run -v /var/lib/jenkins/workspace/PR-27468-3-7f1c18b2-4247-45cc-a0b7-8a4205408513:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1168:1169 {} \;'
[2021-08-18T15:41:14.765Z] + set -e
[2021-08-18T15:41:14.765Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-08-18T15:41:14.765Z] Change permissions with write access of all files inside the specific folder
[2021-08-18T15:41:14.765Z] + chmod -R +w /var/lib/jenkins/workspace/PR-27468-3-7f1c18b2-4247-45cc-a0b7-8a4205408513
[2021-08-18T15:41:14.831Z] Running in /var/lib/jenkins/workspace/PR-27468-3-7f1c18b2-4247-45cc-a0b7-8a4205408513
[2021-08-18T15:41:17.506Z] Failed in branch x-pack/metricbeat-pythonIntegTest
[2021-08-18T15:41:20.798Z] Failed in branch x-pack/filebeat-windows-windows-2019
[2021-08-18T15:41:20.988Z] Failed in branch x-pack/metricbeat-windows-windows-2019
[2021-08-18T15:41:31.624Z] Failed in branch metricbeat-windows-windows-2019
[2021-08-18T15:41:36.976Z] Failed in branch packetbeat-windows-windows-2019
[2021-08-18T15:41:53.318Z] Failed in branch filebeat-windows-windows-2019
[2021-08-18T15:41:53.508Z] Stage "Extended" skipped due to earlier failure(s)
[2021-08-18T15:41:53.570Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-08-18T15:41:53.628Z] Stage "Packaging-Pipeline" skipped due to earlier failure(s)
[2021-08-18T15:41:53.715Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-27468/src/github.com/elastic/beats
[2021-08-18T15:41:54.185Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-27468
[2021-08-18T15:41:54.241Z] [INFO] getVaultSecret: Getting secrets
[2021-08-18T15:41:54.291Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-08-18T15:41:55.098Z] + chmod 755 generate-build-data.sh
[2021-08-18T15:41:55.098Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-27468/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-27468/runs/3 ABORTED 2294026
[2021-08-18T15:41:55.098Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-27468/runs/3/steps/?limit=10000 -o steps-info.json

@cachedout cachedout requested a review from jsoriano August 18, 2021 15:55
@andrewvc andrewvc merged commit c4f3907 into 7.15 Aug 18, 2021
@mergify mergify bot deleted the mergify/bp/7.15/pr-27324 branch August 18, 2021 18:23
@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2021-08-18T15:36:29.016+0000

  • Duration: 227 min 57 sec

  • Commit: f4326e0

Test stats 🧪

Test Results
Failed 0
Passed 52825
Skipped 5267
Total 58092

Trends 🧪

Image of Build Times

Image of Tests

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 52825
Skipped 5267
Total 58092

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
conflicts There is a conflict in the backported pull request needs_team Indicates that the issue/PR needs a Team:* label
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants