Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cherry-pick #18802 to 7.8: Add memory metrics into compute googlecloud #18832

Merged
merged 1 commit into from
May 29, 2020
Merged

Cherry-pick #18802 to 7.8: Add memory metrics into compute googlecloud #18832

merged 1 commit into from
May 29, 2020

Conversation

kaiyan-sheng
Copy link
Contributor

Cherry-pick of PR #18802 to 7.8 branch. Original message:

This PR is to add 4 memory metrics(only for e2 family VMs) into googlecloud compute metricset and also added the missing network.sent_packets_count metric.

@kaiyan-sheng
Add memory metrics into compute googlecloud (#18802)
683a0bb 
* Add memory metrics into compute googlecloud

* update unit test and data.json for memory metrics

(cherry picked from commit 1eb4e79)
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label May 28, 2020
@kaiyan-sheng kaiyan-sheng self-assigned this May 28, 2020
@kaiyan-sheng kaiyan-sheng added the Team:Platforms Label for the Integrations - Platforms team label May 28, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label May 28, 2020
@elasticmachine
Copy link
Collaborator

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #18832 opened]

  • Start Time: 2020-05-28T20:58:52.004+0000

  • Duration: 60 min 36 sec

Test stats 🧪

Test Results
Failed 0
Passed 2115
Skipped 465
Total 2580

Steps errors

Expand to view the steps failures

  • Name: Mage goIntegTest

    • Description: mage goIntegTest

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-28T21:23:56.771+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-05-28T21:58:00.177Z] 		at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-05-28T21:58:00.177Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-05-28T21:58:00.177Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-05-28T21:58:00.177Z] 		at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-05-28T21:58:00.177Z] 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-05-28T21:58:00.177Z] 		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-05-28T21:58:00.177Z] 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-05-28T21:58:00.177Z] 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-05-28T21:58:00.177Z] Caused: hudson.FilePath$TunneledInterruptedException
[2020-05-28T21:58:00.177Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3075)
[2020-05-28T21:58:00.177Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
[2020-05-28T21:58:00.177Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
[2020-05-28T21:58:00.177Z] 	at hudson.remoting.Request$2.run(Request.java:369)
[2020-05-28T21:58:00.177Z] 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-05-28T21:58:00.177Z] 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
[2020-05-28T21:58:00.177Z] Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
[2020-05-28T21:58:00.177Z] 	at hudson.FilePath.act(FilePath.java:1071)
[2020-05-28T21:58:00.177Z] 	at hudson.FilePath.act(FilePath.java:1058)
[2020-05-28T21:58:00.177Z] 	at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-05-28T21:58:00.177Z] 	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-05-28T21:58:00.177Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-05-28T21:58:00.177Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-05-28T21:58:00.177Z] 	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-05-28T21:58:00.177Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-05-28T21:58:00.177Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-05-28T21:58:00.177Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-05-28T21:58:00.714Z] + curl -sSLo codecov https://codecov.io/bash
[2020-05-28T21:58:00.976Z] + FILE=auditbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=filebeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=heartbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=libbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=metricbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=packetbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-05-28T21:58:00.976Z] + FILE=journalbeat/build/coverage/full.cov
[2020-05-28T21:58:00.976Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-05-28T21:58:03.999Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats
[2020-05-28T21:58:04.342Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-28T21:58:04.364Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Lint
[2020-05-28T21:58:04.516Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-05-28T21:58:04.662Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-05-28T21:58:04.812Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-05-28T21:58:04.952Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-Windows
[2020-05-28T21:58:05.095Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-05-28T21:58:05.245Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-05-28T21:58:05.384Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-05-28T21:58:05.862Z] + cat
[2020-05-28T21:58:05.862Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-28T21:58:05.862Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-28T21:58:12.464Z] runbld>>> runbld started
[2020-05-28T21:58:12.464Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-28T21:58:13.852Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18832' in order of occurrence in the config (last value wins).
[2020-05-28T21:58:15.236Z] runbld>>> Debug logging enabled.
[2020-05-28T21:58:15.236Z] runbld>>> Storing result
[2020-05-28T21:58:15.236Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-28T21:58:15.236Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200528215814-D5B49144
[2020-05-28T21:58:15.236Z] runbld>>> Adding system facts.
[2020-05-28T21:58:16.178Z] runbld>>> Adding vcs info for the latest commit:  683a0bba2bf5e49dd3e15c07660a4aac6c08d553
[2020-05-28T21:58:16.442Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-28T21:58:16.442Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-28T21:58:16.442Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-28T21:58:16.442Z] Processing JUnit reports with runbld...
[2020-05-28T21:58:17.013Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-28T21:58:17.013Z] runbld>>> DURATION: 20ms
[2020-05-28T21:58:17.013Z] runbld>>> STDOUT: 40 bytes
[2020-05-28T21:58:17.013Z] runbld>>> STDERR: 49 bytes
[2020-05-28T21:58:17.013Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-28T21:58:17.013Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats
[2020-05-28T21:58:18.400Z] runbld>>> Storing build metadata: 
[2020-05-28T21:58:18.400Z] runbld>>> Adding test report.
[2020-05-28T21:58:18.400Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832/src/github.com/elastic/beats
[2020-05-28T21:58:19.341Z] runbld>>> Found 11 test output files
[2020-05-28T21:58:19.913Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 2580 Skipped: 413
[2020-05-28T21:58:20.173Z] runbld>>> Storing result
[2020-05-28T21:58:20.173Z] runbld>>> FAILURES: 0
[2020-05-28T21:58:20.434Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-28T21:58:20.434Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200528215814-D5B49144
[2020-05-28T21:58:20.434Z] runbld>>> Email notification disabled by environment variable.
[2020-05-28T21:58:20.434Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-28T21:58:26.545Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18832
[2020-05-28T21:58:26.874Z] [INFO] getVaultSecret: Getting secrets
[2020-05-28T21:58:26.938Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-28T21:58:27.909Z] + chmod 755 generate-build-data.sh
[2020-05-28T21:58:27.909Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18832/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18832/runs/1 FAILURE 3575629
[2020-05-28T21:58:27.909Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18832/runs/1/steps/?limit=10000 -o steps-info.json
[2020-05-28T21:58:28.460Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18832/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-05-28T21:58:28.710Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18832/runs/1/log/ -o pipeline-log.txt

@kaiyan-sheng kaiyan-sheng merged commit f5863c5 into elastic:7.8 May 29, 2020
@kaiyan-sheng kaiyan-sheng deleted the backport_18802_7.8 branch May 29, 2020 13:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ChrsMark ChrsMark ChrsMark approved these changes

Assignees

@kaiyan-sheng kaiyan-sheng

Labels
backport review Team:Platforms Label for the Integrations - Platforms team
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@kaiyan-sheng @elasticmachine @ChrsMark