Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix CI pipeline #26013

Merged
merged 5 commits into from
Jun 1, 2021
Merged

Fix CI pipeline #26013

merged 5 commits into from
Jun 1, 2021

Conversation

urso
Copy link

@urso urso commented May 31, 2021

  • Fix

What does this PR do?

Add missing updates from make update.

Why is it important?

Try to fix lint step in master and PRs targeting master.

@urso urso added review Team:Elastic-Agent Label for the Agent team labels May 31, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/agent (Team:Agent)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels May 31, 2021
@elasticmachine
Copy link
Collaborator

elasticmachine commented May 31, 2021

❕ Build Aborted

There is a new build on-going so the previous on-going builds have been aborted.

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts

Expand to view the summary

Build stats

  • Build Cause: andresrc commented: /test

  • Reason: Aborted from #7

  • Start Time: 2021-06-01T07:47:51.875+0000

  • Duration: 76 min 4 sec

  • Commit: 3dec688

Test stats 🧪

Test Results
Failed 1
Passed 1596
Skipped 428
Total 2025

Trends 🧪

Image of Build Times

Image of Tests

Test errors 1

Expand to view the tests failures

Extended / metricbeat-windows-10-windows-10 / test_processors – metricbeat.tests.system.test_lightmodules.Test
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     self = <test_lightmodules.Test testMethod=test_processors>
    
        def test_processors(self):
            shutil.copytree(
                os.path.join(self.beat_path, "mb/testing/testdata/lightmodules"),
                os.path.join(self.working_dir, "module"),
            )
        
            with http_test_server() as server:
                self.render_config_template(modules=[{
                    "name": "test",
                    "metricsets": ["json"],
                    "namespace": "test",
                    # Hard-coding 'localhost' because hostname in server.server_name doesn't always work.
                    "hosts": [f"localhost:{server.server_port}"],
                }])
        
                proc = self.start_beat()
        
    >           self.wait_until(lambda: self.output_lines() > 0)
    
    tests\system\test_lightmodules.py:32: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
    
    self = <test_lightmodules.Test testMethod=test_processors>
    cond = <function Test.test_processors.<locals>.<lambda> at 0x0000018CD1F73B80>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
    >               raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
                                       "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ..\libbeat\tests\system\beat\beat.py:362: TimeoutError 
    

Steps errors 1

Expand to view the steps failures

Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'org.jenkinsci.plugins.workflow.steps.FlowInterruptedException'

Log output

Expand to view the last 100 lines of log output

[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:53:28] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:53:36] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:53:48] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:53:58] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:54:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:54:18] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:54:28] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:54:38] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:54:46] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:54:58] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:55:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:55:16] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:55:28] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.038Z] 127.0.0.1 - - [01/Jun/2021 08:55:38] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:55:48] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:55:56] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:56:08] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:56:18] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:56:26] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:56:36] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:56:48] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:56:56] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:57:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:57:16] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:57:28] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:57:36] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:57:46] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:57:56] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:58:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:58:18] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:58:26] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:58:36] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:58:48] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:58:58] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:59:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:59:18] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:59:26] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:59:38] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:59:46] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 08:59:58] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:00:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:00:16] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:00:26] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:00:38] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:00:46] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:00:58] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:01:06] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:01:18] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:01:28] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:01:36] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:01:46] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:00.039Z] 127.0.0.1 - - [01/Jun/2021 09:01:56] "GET / HTTP/1.1" 200 -
[2021-06-01T09:02:19.638Z] Sending interrupt signal to process
[2021-06-01T09:02:20.121Z] Sending interrupt signal to process
[2021-06-01T09:02:22.028Z] script returned exit code -1
[2021-06-01T09:02:22.380Z] 
[2021-06-01T09:02:22.380Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>FOR / %d IN ("ve") DO @IF EXIST "%d" rmdir /s /q "%d" 
[2021-06-01T09:02:24.612Z] 
[2021-06-01T09:02:24.612Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>python .ci/scripts/pre_archive_test.py 
[2021-06-01T09:02:26.000Z] Copy .\metricbeat\build into build\metricbeat\build
[2021-06-01T09:02:26.000Z] Copy .\metricbeat\null\build into build\metricbeat\null\build
[2021-06-01T09:02:26.014Z] Running in C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats\build
[2021-06-01T09:02:26.032Z] Recording test results
[2021-06-01T09:02:28.059Z] [Checks API] No suitable checks publisher found.
[2021-06-01T09:02:28.379Z] 
[2021-06-01T09:02:28.379Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats\build>tar --version  1>NUL 
[2021-06-01T09:02:28.712Z] 
[2021-06-01T09:02:28.712Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats\build>tar --exclude=test-build-artifacts-metricbeat-windows-10-windows-10-tgz -czf test-build-artifacts-metricbeat-windows-10-windows-10-tgz . 
[2021-06-01T09:02:32.423Z] 
[2021-06-01T09:02:32.423Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats\build>gsutil --version  1>NUL 
[2021-06-01T09:02:34.636Z] Click here to forcibly terminate running steps
[2021-06-01T09:02:42.469Z] Masking supported pattern matches of %FILE_CREDENTIAL%
[2021-06-01T09:02:43.029Z] 
[2021-06-01T09:02:43.029Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats\build>gcloud auth activate-service-account --key-file **** 
[2021-06-01T09:02:43.981Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-06-01T09:02:48.007Z] [INFO] system-tests='build\metricbeat\build\system-tests'. If no empty then let's create a tarball
[2021-06-01T09:02:48.393Z] 
[2021-06-01T09:02:48.393Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>tar --version  1>NUL 
[2021-06-01T09:02:48.727Z] 
[2021-06-01T09:02:48.728Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>tar --exclude=metricbeat--system-tests-windows-tgz -czf metricbeat--system-tests-windows-tgz build\metricbeat\build\system-tests 
[2021-06-01T09:02:51.012Z] 
[2021-06-01T09:02:51.012Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>gsutil --version  1>NUL 
[2021-06-01T09:02:52.952Z] Masking supported pattern matches of %FILE_CREDENTIAL%
[2021-06-01T09:02:53.270Z] 
[2021-06-01T09:02:53.270Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>gcloud auth activate-service-account --key-file **** 
[2021-06-01T09:02:54.211Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-06-01T09:02:57.202Z] 
[2021-06-01T09:02:57.202Z] C:\Users\jenkins\workspace\PR-26013-6-4b6e2b6f-9bcf-467d-a87e-322c71b5f40f\src\github.com\elastic\beats>go clean -modcache 
[2021-06-01T09:03:54.741Z] Failed in branch metricbeat-windows-10-windows-10
[2021-06-01T09:03:54.812Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-06-01T09:03:54.843Z] Stage "Packaging-Pipeline" skipped due to earlier failure(s)
[2021-06-01T09:03:54.890Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-26013/src/github.com/elastic/beats
[2021-06-01T09:03:55.245Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-26013
[2021-06-01T09:03:55.333Z] [INFO] getVaultSecret: Getting secrets
[2021-06-01T09:03:55.367Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-06-01T09:03:56.019Z] + chmod 755 generate-build-data.sh
[2021-06-01T09:03:56.019Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26013/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26013/runs/6 ABORTED 4563882
[2021-06-01T09:03:56.019Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26013/runs/6/steps/?limit=10000 -o steps-info.json
[2021-06-01T09:03:57.362Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26013/runs/6/tests/?status=FAILED -o tests-errors.json
[2021-06-01T09:03:58.273Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26013/runs/6/log/ -o pipeline-log.txt

@urso urso requested a review from a team as a code owner May 31, 2021 20:27
@botelastic botelastic bot added the Team:Automation Label for the Observability productivity team label May 31, 2021
cmd(label: "make notice", script: "make notice")
cmd(label: "make check-go", script: "make check-go")
cmd(label: "Check for changes", script: "make check-no-changes")
Copy link
Author

@urso urso May 31, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update order to match make check. The make notice command can download dependencies, which results in go.sum being updated. The make check-go seems to clean the go.sum again. Depending on order of make notice and make check-go the lint checks are currently not satisfiable without requiring a fixed order. make check-go just runs go mod tidy, which seems to clean up the 'polution' from make notice.

@@ -110,6 +110,7 @@ check-go:
## ccheck-no-changes : Check there is no local changes.
.PHONY: check-no-changes
check-no-changes:
@go mod tidy
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Per Beats lint runs make check; make update; make check-no-changes. The make update call touches go.sum when indirectly calling make notice. Try to be more aggressive before checking and clean up intermediary updates to go.sum before checking via git diff.

@andresrc
Copy link
Contributor

andresrc commented Jun 1, 2021

The linting part seems to pass, let's re-run the tests

@andresrc
Copy link
Contributor

andresrc commented Jun 1, 2021

/test

Copy link
Contributor

@cachedout cachedout left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: Add comment so we don't forget about this ordering in the future.

Jenkinsfile Show resolved Hide resolved
Co-authored-by: cachedout <mike.place@elastic.co>
@urso urso added the backport-v7.14.0 Automated backport with mergify label Jun 1, 2021
@urso urso changed the title Update indirect dependencies Fix CI pipeline Jun 1, 2021
@urso urso merged commit c69dfb3 into elastic:master Jun 1, 2021
@urso urso deleted the master-make-update branch June 1, 2021 10:39
mergify bot pushed a commit that referenced this pull request Jun 1, 2021
Try to fix lint step in master and PRs targeting master.

Co-authored-by: cachedout <mike.place@elastic.co>
(cherry picked from commit c69dfb3)
@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #26013 updated

  • Start Time: 2021-06-01T09:00:10.370+0000

  • Duration: 131 min 37 sec

  • Commit: a298f07

Test stats 🧪

Test Results
Failed 0
Passed 47426
Skipped 5253
Total 52679

Trends 🧪

Image of Build Times

Image of Tests

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 47426
Skipped 5253
Total 52679

urso pushed a commit that referenced this pull request Jun 1, 2021
Try to fix lint step in master and PRs targeting master.

Co-authored-by: cachedout <mike.place@elastic.co>
(cherry picked from commit c69dfb3)

Co-authored-by: Steffen Siering <steffen.siering@elastic.co>
@@ -110,6 +110,7 @@ check-go:
## ccheck-no-changes : Check there is no local changes.
.PHONY: check-no-changes
check-no-changes:
@go mod tidy
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we run go mod tidy here we need to run also go mod download to be consistent with make notice. I have opened a PR for this: #26241

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-v7.14.0 Automated backport with mergify review Team:Automation Label for the Observability productivity team Team:Elastic-Agent Label for the Agent team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants