Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fleet] Fix agent enrollment script to not create a new enrollment token #18365

Merged
merged 4 commits into from
May 13, 2020

Conversation

nchaulet
Copy link
Member

@nchaulet nchaulet commented May 7, 2020

Description

This script is creating a new enrollment token associated to a non existing config (default is not a valid id, the id of the default config is a random uuid)

I updated this script to get the default enrollment token created during fleet setup instead.

Related to elastic/kibana#65669

Also created an issue on kibana elastic/kibana#65752 to not allow the creation of an enrollment token for a non existing agent config id.

@elasticmachine
Copy link
Collaborator

Pinging @elastic/ingest-management (Team:Ingest Management)

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label May 7, 2020
@@ -30,19 +30,31 @@ function enroll(){
if [[ -n "${FLEET_ENROLLMENT_TOKEN}" ]] && [[ ${FLEET_ENROLLMENT_TOKEN} == 1 ]]; then
apikey = "${FLEET_ENROLLMENT_TOKEN}"
else
enrollResp=$(curl -X POST ${KIBANA_HOST:-http://localhost:5601}/api/ingest_manager/fleet/enrollment-api-keys \
enrollResp=$(curl -X GET ${KIBANA_HOST:-http://localhost:5601}/api/ingest_manager/fleet/enrollment-api-keys \
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this response return the list of API keys but not the secret API key that you can only get doing a specific request to the ressource

@elasticmachine
Copy link
Collaborator

elasticmachine commented May 7, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

Test stats 🧪

Test Results
Failed 0
Passed 7660
Skipped 1231
Total 8891

Steps errors

Expand to view the steps failures

  • Name: Make -C libbeat testsuite
    • Description: make -C libbeat testsuite

    • Result: FAILURE

    • Duration: 5 min 48 sec

    • Start Time: 2020-05-13T13:46:47.350+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-05-13T14:31:50.440Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-05-13T14:31:50.440Z] + FILE=libbeat/build/coverage/full.cov
[2020-05-13T14:31:50.440Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-05-13T14:31:50.440Z] + FILE=metricbeat/build/coverage/full.cov
[2020-05-13T14:31:50.440Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-05-13T14:31:50.440Z] + FILE=packetbeat/build/coverage/full.cov
[2020-05-13T14:31:50.440Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-05-13T14:31:50.440Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-05-13T14:31:50.440Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-05-13T14:31:50.440Z] + FILE=journalbeat/build/coverage/full.cov
[2020-05-13T14:31:50.440Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-05-13T14:31:50.926Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats
[2020-05-13T14:31:51.246Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-13T14:31:51.263Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Lint
[2020-05-13T14:31:51.357Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-05-13T14:31:51.435Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-05-13T14:31:51.519Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-05-13T14:31:51.596Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Winlogbeat-oss
[2020-05-13T14:31:51.670Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Dockerlogbeat
[2020-05-13T14:31:51.744Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Journalbeat-oss
[2020-05-13T14:31:51.821Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Libbeat-oss
[2020-05-13T14:31:51.906Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-05-13T14:31:51.982Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-05-13T14:31:52.058Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-05-13T14:31:52.141Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Heartbeat-oss
[2020-05-13T14:31:52.215Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-05-13T14:31:52.300Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-05-13T14:31:52.375Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-05-13T14:31:52.458Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-05-13T14:31:52.544Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Libbeat-x-pack
[2020-05-13T14:31:52.653Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Filebeat-Windows
[2020-05-13T14:31:52.736Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Auditbeat-Linux
[2020-05-13T14:31:52.823Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-05-13T14:31:52.911Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-05-13T14:31:52.983Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-05-13T14:31:53.053Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Packetbeat-oss
[2020-05-13T14:31:53.122Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-Windows
[2020-05-13T14:31:53.197Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Filebeat-x-pack
[2020-05-13T14:31:53.269Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Auditbeat-Mac-OS-X
[2020-05-13T14:31:53.352Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-05-13T14:31:53.446Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-05-13T14:31:53.527Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-05-13T14:31:53.654Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Filebeat-oss
[2020-05-13T14:31:53.746Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Heartbeat-Windows
[2020-05-13T14:31:53.861Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Auditbeat-Windows
[2020-05-13T14:31:53.963Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-05-13T14:31:54.046Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Functionbeat-Windows
[2020-05-13T14:31:54.116Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-05-13T14:31:54.205Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-05-13T14:31:54.300Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-05-13T14:31:54.392Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-05-13T14:31:54.758Z] + cat
[2020-05-13T14:31:54.758Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-13T14:31:54.758Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-13T14:32:02.935Z] runbld>>> runbld started
[2020-05-13T14:32:02.935Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-13T14:32:03.509Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18365' in order of occurrence in the config (last value wins).
[2020-05-13T14:32:04.897Z] runbld>>> Debug logging enabled.
[2020-05-13T14:32:04.897Z] runbld>>> Storing result
[2020-05-13T14:32:05.161Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-13T14:32:05.161Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200513143204-9C9B59D0
[2020-05-13T14:32:05.161Z] runbld>>> Adding system facts.
[2020-05-13T14:32:06.106Z] runbld>>> Adding vcs info for the latest commit:  c5ec8514f4b6d25d59167ac2dec05993cbddac8e
[2020-05-13T14:32:06.369Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-13T14:32:06.369Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-13T14:32:06.369Z] Processing JUnit reports with runbld...
[2020-05-13T14:32:06.369Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-13T14:32:06.631Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-13T14:32:06.631Z] runbld>>> DURATION: 20ms
[2020-05-13T14:32:06.631Z] runbld>>> STDOUT: 40 bytes
[2020-05-13T14:32:06.631Z] runbld>>> STDERR: 49 bytes
[2020-05-13T14:32:06.631Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-13T14:32:06.631Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats
[2020-05-13T14:32:08.021Z] runbld>>> Storing build metadata: 
[2020-05-13T14:32:08.021Z] runbld>>> Adding test report.
[2020-05-13T14:32:08.021Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats
[2020-05-13T14:32:09.422Z] runbld>>> Found 102 test output files
[2020-05-13T14:32:10.000Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-05-13T14:32:10.000Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-05-13T14:32:10.000Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-05-13T14:32:10.000Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-05-13T14:32:10.000Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-05-13T14:32:10.000Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-cloudfoundry.xml
[2020-05-13T14:32:10.948Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-05-13T14:32:10.949Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-05-13T14:32:11.211Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 8741 Skipped: 1015
[2020-05-13T14:32:11.478Z] runbld>>> Storing result
[2020-05-13T14:32:11.478Z] runbld>>> FAILURES: 0
[2020-05-13T14:32:11.741Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-13T14:32:11.741Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200513143204-9C9B59D0
[2020-05-13T14:32:11.741Z] runbld>>> Email notification disabled by environment variable.
[2020-05-13T14:32:11.741Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-13T14:32:18.028Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18365
[2020-05-13T14:32:18.216Z] [INFO] getVaultSecret: Getting secrets
[2020-05-13T14:32:18.322Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-13T14:32:21.031Z] + chmod 755 generate-build-data.sh
[2020-05-13T14:32:21.031Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18365/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18365/runs/6 FAILURE 4469175
[2020-05-13T14:32:21.031Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18365/runs/6/steps/?limit=10000 -o steps-info.json
[2020-05-13T14:32:22.495Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18365/runs/6/tests/?status=FAILED -o tests-errors.json
[2020-05-13T14:32:23.960Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18365/runs/6/log/ -o pipeline-log.txt

@andresrc andresrc removed the needs_team Indicates that the issue/PR needs a Team:* label label May 9, 2020
@ruflin
Copy link
Member

ruflin commented May 11, 2020

Is this a bug that should also be backported to 7.8?

@nchaulet
Copy link
Member Author

Yes this should probably backported 👍

@michalpristas
Copy link
Contributor

testing this today

Copy link
Contributor

@michalpristas michalpristas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, tested on ubuntu and enrolled correctly
please just bring this even with master you might have a conflicts here

@nchaulet
Copy link
Member Author

@michalpristas I am not sure why test are failing here, can I get some help?

@michalpristas
Copy link
Contributor

@nchaulet probably flakyness i restarted test, try merging with master

@nchaulet
Copy link
Member Author

@elasticmachine merge upstream

@michalpristas
Copy link
Contributor

failures do not seem related, locally libbeat passes, i think it's ok to get this in

@nchaulet nchaulet merged commit 342d5b5 into elastic:master May 13, 2020
@nchaulet nchaulet deleted the feature-fix-agent-enrollment-script branch May 13, 2020 15:24
nchaulet added a commit to nchaulet/beats that referenced this pull request May 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants