x-pack/filebeat/input/etw: New input #36915

chemamartinez · 2023-10-19T15:46:31Z

Description

This pull request adds a new Filebeat input to collect ETW events. It is the second stage of #36914 where the ETW reader is added to Libbeat.

The ETW input provides support to Filebeat to collect ETW events and publish them in JSON format. Available configuration options are:

file
provider.name
provider.guid
session_name
trace_level
match_any_keyword
match_all_keyword
session

How to use these options is detailed in the docs file for the input.

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

Added tests to config validation
Added tests to ETW input

How to test this PR locally

Next steps can be followed to test the input locally:

Prepare environment
In case we want test the collection of DNS Server analytical logs next steps should be followed, otherwise the test can be done with a current provider.

In a Windows host, configure an static IP for one of the interfaces and disable DHCP.
Install DNS Server following this guide.
Enable analytical logs for DNS Server in EventViewer.

Build Filebeat
In my case, it is built from macOS by running GOOS=windows GOARCH=amd64 mage build. Then move the binary filebeat.exe and the config file filebeat.yml to the Windows host.

Configure the input
To configure the input, follow the examples provides in the input doc file included in this PR. For instance, to collect DNS Server analytical logs add the following configuration:

filebeat.inputs:
- type: etw
  id: my-etw-id
  enabled: true
  provider.name: Microsoft-Windows-DNSServer
  session_name: FilebeatDNSServer
  trace_level: verbose
  # Bitmask to filter analytical logs from DNS Server
  match_any_keyword: 0x8000000000000000
  match_all_keyword: 0

To simplify the testing I also configure the console output:

output.console:
  enabled: true
  pretty: true

Run Filebeat
Execute .\filebeat.exe -e to start collecting ETW logs. If a provider were configured, a new session should be created which can be queried by running logman query -ets.

That session should be closed once Filebeat is stopped.

You can also configure the input to read from a different provider, an existing session or a log file. See the doc file to apply the proper configuration for these cases.

Related issues

Related to [Windows] DNS Analytical and Audit event support integrations#6586
Related to Microsoft ETW (Event Tracing for Windows) Listener. Look for a Beats to deal with Service Fabric Logging! #2073
More information at RFC https://github.com/elastic/security-external-integrations/pull/70

Logs

An ETW record delivered by the input looks like:

{
  "@metadata": {
    "beat": "filebeat",
    "type": "_doc",
    "version": "8.13.0"
  },
  "@timestamp": "2024-02-12T16:20:23.516Z",
  "agent": {
    "ephemeral_id": "4844f3b9-3743-464a-9685-b7a7cb33dbb9",
    "id": "2db249fc-8c2d-43ef-b11a-6cf09b842996",
    "name": "windows",
    "type": "filebeat",
    "version": "8.13.0"
  },
  "ecs": {
    "version": "8.0.0"
  },
  "event": {
    "code": "1001",
    "created": "2024-02-12T16:20:25.598Z",
    "kind": "event",
    "provider": "Microsoft-Windows-DNS-Client",
    "severity": 4
  },
  "host": {
    "name": "windows"
  },
  "input": {
    "type": "etw"
  },
  "log": {
    "level": "information"
  },
  "winlog": {
    "activity_guid": "{00000000-0000-0000-0000-000000000000}",
    "channel": "16",
    "event_data": {
      "Address": "10.128.0.1",
      "AddressLength": "16",
      "DynamicAddress": "dynamic ",
      "Index": "1",
      "Interface": "Ethernet",
      "TotalServerCount": "1"
    },
    "flags": "576",
    "keywords": "9223372036854775808",
    "opcode": "0",
    "process_id": "712",
    "provider_guid": "{1C95126E-7EEA-49A9-A3FE-A378B03DDB4D}",
    "session": "Elastic-Microsoft-Windows-DNS-Client",
    "task": "1001",
    "thread_id": "1168",
    "version": 0
  }
}

Some info and debug logs during the input execution:

{"log.level":"info","@timestamp":"2023-11-28T18:09:45.539Z","log.logger":"input.etw","log.origin":{"file.name":"compat/compat.go","file.line":121},"message":"Input 'etw' starting","service.name":"filebeat","id":"my-etw-id","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T18:09:45.730Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":74},"message":"Starting etw input","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T18:09:45.739Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":94},"message":"created session","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T18:09:45.741Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":142},"message":"starting to listen ETW events","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T18:09:50.040Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":111},"message":"received event 260 with length 214","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
...
{"log.level":"debug","@timestamp":"2023-11-28T18:10:19.264Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":146},"message":"stopped to read ETW events from session","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T18:10:19.265Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":163},"message":"successfully shutdown","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T18:10:19.266Z","log.logger":"input.etw","log.origin":{"file.name":"etw/input.go","file.line":101},"message":"etw input stopped","service.name":"filebeat","id":"my-etw-id","session":"FilebeatDNSServer","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T18:10:19.268Z","log.logger":"input.etw","log.origin":{"file.name":"compat/compat.go","file.line":134},"message":"Input 'etw' stopped (goroutine)","service.name":"filebeat","id":"my-etw-id","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T18:10:19.268Z","log.logger":"input.etw","log.origin":{"file.name":"compat/compat.go","file.line":142},"message":"Input 'etw' stopped (runner)","service.name":"filebeat","id":"my-etw-id","ecs.version":"1.6.0"}

mergify · 2023-10-19T15:47:09Z

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @chemamartinez? 🙏.
For such, you'll need to label your PR with:

The upcoming major version of the Elastic Stack
The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

backport-v8./d.0 is the label to automatically backport to the 8./d branch. /d is the digit

elasticmachine · 2023-10-19T16:54:42Z

💔 Build Failed

Expand to view the summary

Build stats

Start Time: 2023-10-26T17:07:49.040+0000
Duration: 61 min 24 sec

Test stats 🧪

Test	Results
Failed	0
Passed	10973
Skipped	401
Total	11374

Steps errors

Expand to view the steps failures

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 7 min 8 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 3 min 41 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 3 min 43 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-unitTest - mage build unitTest`

Took 1 min 21 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-unitTest - mage build unitTest`

Took 0 min 17 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-unitTest - mage build unitTest`

Took 0 min 10 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-goIntegTest - mage goIntegTest`

Took 2 min 51 sec . View more details here
Description: mage goIntegTest

`x-pack/libbeat-goIntegTest - mage goIntegTest`

Took 1 min 50 sec . View more details here
Description: mage goIntegTest

`x-pack/libbeat-goIntegTest - mage goIntegTest`

Took 1 min 46 sec . View more details here
Description: mage goIntegTest

`Error signal`

Took 0 min 0 sec . View more details here
Description: Error 'hudson.AbortException: script returned exit code 1'

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

mergify · 2023-10-27T09:07:19Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b dev-etw-filebeat-input upstream/dev-etw-filebeat-input
git merge upstream/main
git push upstream dev-etw-filebeat-input

x-pack/filebeat/input/etw/config.go

x-pack/filebeat/input/etw/input.go

x-pack/filebeat/input/etw/config.go

x-pack/libbeat/reader/etw/consumer.go

x-pack/libbeat/reader/etw/event.go

elasticmachine · 2023-11-20T12:57:35Z

💚 Build Succeeded

Expand to view the summary

Build stats

Start Time: 2023-11-20T10:36:39.994+0000
Duration: 141 min 45 sec

Test stats 🧪

Test	Results
Failed	0
Passed	8450
Skipped	381
Total	8831

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2023-11-28T14:01:18Z

💔 Tests Failed

Expand to view the summary

Build stats

Start Time: 2023-11-28T11:59:03.474+0000
Duration: 122 min 1 sec

Test stats 🧪

Test	Results
Failed	8
Passed	11494
Skipped	405
Total	11907

Test errors

Expand to view the tests failures

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestFilebeat
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701174541
    init.go:62: Resetting fleet manager...
    filebeat_v2_test.go:90: waiting for events...
    filebeat_v2_test.go:84: Running beats...
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.715Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\logs]","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.719Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: 589f187a-ce8d-47c0-b400-7e874641869d","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:01.741Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:01.741Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.742Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-c\",\"instance\":{\"id\":\"8429371821224650248\",\"name\":\"beats-ci-immutable-windows-2022-1701173462034163833\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.743Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.743Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"filebeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149","data":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\logs"},"type":"filebeat","uuid":"589f187a-ce8d-47c0-b400-7e874641869d"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.744Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"filebeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.744Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"filebeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.750Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"filebeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-28T12:13:15Z","name":"beats-ci-immutable-windows-2022-1701173462034163833","ip":["10.224.1.18","::1","127.0.0.1"],"kernel_version":"10.0.20348.2110 (WinBuild.160101.0800)","mac":["42:01:0a:e0:01:12"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2022 Standard","version":"10.0","major":10,"minor":0,"patch":0,"build":"20348.2113"},"timezone":"GMT","timezone_offset_sec":0,"id":"188d13db-b0a4-4198-8bb5-85eba82300a2"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.751Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"filebeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\fbtest.test.exe","name":"fbtest.test.exe","pid":5824,"ppid":468,"start_time":"2023-11-28T12:29:01.512Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.751Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: filebeat; Version: 8.12.0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.756Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.762Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2022-1701173462034163833","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:01.763Z","log.logger":"modules","log.origin":{"file.name":"fileset/modules.go","file.line":152},"message":"Not loading modules. Module directory not found: C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\module","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.763Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"filebeat start running.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.763Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.764Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.769Z","log.origin":{"file.name":"memlog/store.go","file.line":134},"message":"Finished loading transaction log file for 'C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1149\\data\\registry\\filebeat'. Active transaction id=0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-28T12:29:01.769Z","log.origin":{"file.name":"beater/filebeat.go","file.line":331},"message":"Filebeat is unable to load the ingest pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the ingest pipelines or are using Logstash pipelines, you can ignore this warning.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.769Z","log.logger":"input","log.origin":{"file.name":"shipper/input.go","file.line":55},"message":"creating new InputManager","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.770Z","log.logger":"registrar","log.origin":{"file.name":"registrar/registrar.go","file.line":107},"message":"States Loaded from registrar: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.770Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":71},"message":"Loading Inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.770Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":106},"message":"Loading and starting Inputs completed. Enabled inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:29:01.771Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.775Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(16c905b2-a8db-4988-adaf-1c51cf076d94), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:01.775Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(e508a551-79e2-4a56-bcb3-a7ea8d9fb559), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:29:02.775Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:02.782Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701174541\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-28T12:29:02.784Z","log.logger":"cfgwarn","log.origin":{"file.name":"log/input.go","file.line":90},"message":"DEPRECATED: Log input. Use Filestream input instead.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:02.784Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages]","service.name":"filebeat","input_id":"19d45319-22f6-459d-a7bb-f7f8ecbc6558","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:02.785Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure*]","service.name":"filebeat","input_id":"c9e8be8f-139e-480a-b4b6-e9f4e707d1a9","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:02.785Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/messages]","service.name":"filebeat","input_id":"19d45319-22f6-459d-a7bb-f7f8ecbc6558","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages","state_id":"native::196608-539370-3836337016","finished":false,"os_id":"196608-539370-3836337016","harvester_id":"c73029a6-0c49-4772-a455-863c35877b9f","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:02.786Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/secure*]","service.name":"filebeat","input_id":"c9e8be8f-139e-480a-b4b6-e9f4e707d1a9","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure","state_id":"native::196608-539371-3836337016","finished":false,"os_id":"196608-539371-3836337016","harvester_id":"34db80ed-0dfd-4259-9de6-140695ef6e47","ecs.version":"1.6.0"}
    filebeat_v2_test.go:96: stopping filebeat after 91 events
{"log.level":"error","@timestamp":"2023-11-28T12:29:13.676Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:13.676Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
    filebeat_v2_test.go:103: Reading events...
    filebeat_v2_test.go:80: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:80
        	            				C:/Users/jenkins/workspace/PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:131
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701174541\beat-out-20231128.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestFilebeat
--- FAIL: TestFilebeat (12.03s)

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestSingleMetricbeatMetricsetWithProcessors
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701174550
    init.go:62: Resetting fleet manager...
    metricbeat_v2_test.go:81: Running beats...
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.620Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721\\logs]","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.625Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: 5d459c52-fb4a-4682-a851-908c428e75b0","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:10.654Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:10.655Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:10.655Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:10.656Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:10.656Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.659Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-c\",\"instance\":{\"id\":\"8429371821224650248\",\"name\":\"beats-ci-immutable-windows-2022-1701173462034163833\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.659Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.659Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"metricbeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721","data":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721\\logs"},"type":"metricbeat","uuid":"5d459c52-fb4a-4682-a851-908c428e75b0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.660Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"metricbeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.660Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"metricbeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.667Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"metricbeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-28T12:13:15Z","name":"beats-ci-immutable-windows-2022-1701173462034163833","ip":["10.224.1.18","::1","127.0.0.1"],"kernel_version":"10.0.20348.2110 (WinBuild.160101.0800)","mac":["42:01:0a:e0:01:12"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2022 Standard","version":"10.0","major":10,"minor":0,"patch":0,"build":"20348.2113"},"timezone":"GMT","timezone_offset_sec":0,"id":"188d13db-b0a4-4198-8bb5-85eba82300a2"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.667Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"metricbeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\mbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b\\go-build1338104412\\b1721\\mbtest.test.exe","name":"mbtest.test.exe","pid":740,"ppid":468,"start_time":"2023-11-28T12:29:09.529Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.668Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: metricbeat; Version: 8.12.0","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.676Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.685Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2022-1701173462034163833","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.685Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"metricbeat start running.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.685Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:29:10.686Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.686Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.690Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(ac6880b9-3769-466f-ba82-72124cbf71bc), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:10.690Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(6b3bf3c0-3863-43bd-9f3b-02c1a627abe8), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:29:11.692Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.693Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701174550\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.694Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.699Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":80},"message":"Metricbeat process and system info: {\"OSVersion\":{\"Major\":6,\"Minor\":2,\"Build\":9200},\"Arch\":\"amd64\",\"NumCPU\":8,\"User\":{\"SID\":\"S-1-5-21-2428258690-3183672606-2194930724-1192\",\"Account\":\"jenkins\",\"Domain\":\"BEATS-CI-IMMUTA\",\"Type\":1},\"ProcessPrivs\":{\"SeBackupPrivilege\":{\"enabled\":false},\"SeChangeNotifyPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreateGlobalPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreatePagefilePrivilege\":{\"enabled\":false},\"SeCreateSymbolicLinkPrivilege\":{\"enabled\":false},\"SeDebugPrivilege\":{\"enabled\":true},\"SeDelegateSessionUserImpersonatePrivilege\":{\"enabled\":false},\"SeImpersonatePrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeIncreaseBasePriorityPrivilege\":{\"enabled\":false},\"SeIncreaseQuotaPrivilege\":{\"enabled\":false},\"SeIncreaseWorkingSetPrivilege\":{\"enabled\":false},\"SeLoadDriverPrivilege\":{\"enabled\":false},\"SeManageVolumePrivilege\":{\"enabled\":false},\"SeProfileSingleProcessPrivilege\":{\"enabled\":false},\"SeRemoteShutdownPrivilege\":{\"enabled\":false},\"SeRestorePrivilege\":{\"enabled\":false},\"SeSecurityPrivilege\":{\"enabled\":false},\"SeShutdownPrivilege\":{\"enabled\":false},\"SeSystemEnvironmentPrivilege\":{\"enabled\":false},\"SeSystemProfilePrivilege\":{\"enabled\":false},\"SeSystemtimePrivilege\":{\"enabled\":false},\"SeTakeOwnershipPrivilege\":{\"enabled\":false},\"SeTimeZonePrivilege\":{\"enabled\":false},\"SeUndockPrivilege\":{\"enabled\":false}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.699Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":88},"message":"SeDebugPrivilege is enabled. SeDebugPrivilege=(Enabled)","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.699Z","log.logger":"system.cpu","log.origin":{"file.name":"cpu/cpu.go","file.line":106},"message":"got DiagnosticSetup request for system/cpu","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.700Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:29:11.700Z","log.logger":"system.memory","log.origin":{"file.name":"memory/memory.go","file.line":76},"message":"got DiagnosticSetup request for system/memory","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
{"log.level":"error","@timestamp":"2023-11-28T12:29:22.624Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:29:22.624Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:117: Reading events...
    metricbeat_v2_test.go:119: Got 20 events
    metricbeat_v2_test.go:77: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:77
        	            				C:/Users/jenkins/workspace/PR-36915-6-36004166-bd20-4fc9-b647-35d34c5f0b8b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:156
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701174550\beat-out-20231128.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestSingleMetricbeatMetricsetWithProcessors
--- FAIL: TestSingleMetricbeatMetricsetWithProcessors (12.04s)

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestFilebeat
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701174670
    init.go:62: Resetting fleet manager...
    filebeat_v2_test.go:90: waiting for events...
    filebeat_v2_test.go:84: Running beats...
{"log.level":"info","@timestamp":"2023-11-28T12:31:10.915Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\logs]","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.051Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: b7fa5929-7e19-4b2e-bb24-efd8205a47cd","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:11.070Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:11.070Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:11.071Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.072Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-f\",\"instance\":{\"id\":\"5625518210054383114\",\"name\":\"beats-ci-immutable-windows-2016-1701173462034195438\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.072Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.072Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"filebeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149","data":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\logs"},"type":"filebeat","uuid":"b7fa5929-7e19-4b2e-bb24-efd8205a47cd"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.072Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"filebeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.072Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"filebeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.079Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"filebeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-28T12:17:16Z","name":"beats-ci-immutable-windows-2016-1701173462034195438","ip":["fe80::9885:64f0:1416:c486","10.224.1.11","::1","127.0.0.1","fe80::5efe:ae0:10b","2001:0:34f1:8072:2c8f:2e02:f51f:fef4","fe80::2c8f:2e02:f51f:fef4"],"kernel_version":"10.0.14393.6451 (rs1_release.231103-1737)","mac":["42:01:0a:e0:01:0b","00:00:00:00:00:00:00:e0","00:00:00:00:00:00:00:e0"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2016 Datacenter","version":"10.0","major":10,"minor":0,"patch":0,"build":"14393.6452"},"timezone":"GMT","timezone_offset_sec":0,"id":"4703650b-96a6-447c-8e1d-680f026bf9c1"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.079Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"filebeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\fbtest.test.exe","name":"fbtest.test.exe","pid":2708,"ppid":4680,"start_time":"2023-11-28T12:31:10.730Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.079Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: filebeat; Version: 8.12.0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.084Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.090Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2016-1701173462034195438","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:11.090Z","log.logger":"modules","log.origin":{"file.name":"fileset/modules.go","file.line":152},"message":"Not loading modules. Module directory not found: C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\module","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.090Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"filebeat start running.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.090Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.091Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.094Z","log.origin":{"file.name":"memlog/store.go","file.line":134},"message":"Finished loading transaction log file for 'C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1149\\data\\registry\\filebeat'. Active transaction id=0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-28T12:31:11.094Z","log.origin":{"file.name":"beater/filebeat.go","file.line":331},"message":"Filebeat is unable to load the ingest pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the ingest pipelines or are using Logstash pipelines, you can ignore this warning.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.094Z","log.logger":"input","log.origin":{"file.name":"shipper/input.go","file.line":55},"message":"creating new InputManager","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.094Z","log.logger":"registrar","log.origin":{"file.name":"registrar/registrar.go","file.line":107},"message":"States Loaded from registrar: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.094Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":71},"message":"Loading Inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.094Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":106},"message":"Loading and starting Inputs completed. Enabled inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:31:11.095Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.098Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(73df0570-795d-4a52-9cf2-00169d08ab34), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:11.098Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(6b0791b9-8105-4f4d-873e-8af0310dfb5d), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:31:12.099Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:12.100Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701174670\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-28T12:31:12.101Z","log.logger":"cfgwarn","log.origin":{"file.name":"log/input.go","file.line":90},"message":"DEPRECATED: Log input. Use Filestream input instead.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:12.101Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages]","service.name":"filebeat","input_id":"a994675c-6816-481d-aef6-c14753d9b41a","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:12.102Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure*]","service.name":"filebeat","input_id":"165d14a5-69ac-4e56-b2c0-c0f865477ecc","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:12.102Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/messages]","service.name":"filebeat","input_id":"a994675c-6816-481d-aef6-c14753d9b41a","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages","state_id":"native::262144-423062-212358640","finished":false,"os_id":"262144-423062-212358640","harvester_id":"1dd090d4-ae84-43ac-abe5-7c3f57dae71c","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:12.103Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/secure*]","service.name":"filebeat","input_id":"165d14a5-69ac-4e56-b2c0-c0f865477ecc","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure","state_id":"native::262144-423063-212358640","finished":false,"os_id":"262144-423063-212358640","harvester_id":"c49a0343-e1ac-4c86-bbed-348e1bd6f76c","ecs.version":"1.6.0"}
    filebeat_v2_test.go:96: stopping filebeat after 91 events
{"log.level":"error","@timestamp":"2023-11-28T12:31:22.894Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:22.894Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
    filebeat_v2_test.go:103: Reading events...
    filebeat_v2_test.go:80: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:80
        	            				C:/Users/jenkins/workspace/PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:131
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701174670\beat-out-20231128.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestFilebeat
--- FAIL: TestFilebeat (12.03s)

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestSingleMetricbeatMetricsetWithProcessors
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701174679
    init.go:62: Resetting fleet manager...
    metricbeat_v2_test.go:81: Running beats...
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.646Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721\\logs]","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.650Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: a6532e60-a078-4ad7-86df-0369694d589e","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:19.669Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.670Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-f\",\"instance\":{\"id\":\"5625518210054383114\",\"name\":\"beats-ci-immutable-windows-2016-1701173462034195438\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.671Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.671Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"metricbeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721","data":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721\\logs"},"type":"metricbeat","uuid":"a6532e60-a078-4ad7-86df-0369694d589e"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.671Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"metricbeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.671Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"metricbeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.677Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"metricbeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-28T12:17:16Z","name":"beats-ci-immutable-windows-2016-1701173462034195438","ip":["fe80::9885:64f0:1416:c486","10.224.1.11","::1","127.0.0.1","fe80::5efe:ae0:10b","2001:0:34f1:8072:2c8f:2e02:f51f:fef4","fe80::2c8f:2e02:f51f:fef4"],"kernel_version":"10.0.14393.6451 (rs1_release.231103-1737)","mac":["42:01:0a:e0:01:0b","00:00:00:00:00:00:00:e0","00:00:00:00:00:00:00:e0"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2016 Datacenter","version":"10.0","major":10,"minor":0,"patch":0,"build":"14393.6452"},"timezone":"GMT","timezone_offset_sec":0,"id":"4703650b-96a6-447c-8e1d-680f026bf9c1"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.677Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"metricbeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\mbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057\\go-build506706985\\b1721\\mbtest.test.exe","name":"mbtest.test.exe","pid":3728,"ppid":4680,"start_time":"2023-11-28T12:31:18.423Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.677Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: metricbeat; Version: 8.12.0","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.682Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.688Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2016-1701173462034195438","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.689Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"metricbeat start running.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.689Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.689Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:31:19.690Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.695Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(10b3bbd4-8e4a-45ad-ad9d-110afc4db003), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:19.695Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(83c521c6-f7b4-4eed-bd3b-13c903c74fb1), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-28T12:31:20.695Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.696Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701174679\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.697Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.701Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":80},"message":"Metricbeat process and system info: {\"OSVersion\":{\"Major\":6,\"Minor\":2,\"Build\":9200},\"Arch\":\"amd64\",\"NumCPU\":8,\"User\":{\"SID\":\"S-1-5-21-1806055504-2029734007-1385354570-1148\",\"Account\":\"jenkins\",\"Domain\":\"BEATS-CI-IMMUTA\",\"Type\":1},\"ProcessPrivs\":{\"SeBackupPrivilege\":{\"enabled\":false},\"SeChangeNotifyPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreateGlobalPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreatePagefilePrivilege\":{\"enabled\":false},\"SeCreateSymbolicLinkPrivilege\":{\"enabled\":false},\"SeDebugPrivilege\":{\"enabled\":true},\"SeDelegateSessionUserImpersonatePrivilege\":{\"enabled\":false},\"SeImpersonatePrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeIncreaseBasePriorityPrivilege\":{\"enabled\":false},\"SeIncreaseQuotaPrivilege\":{\"enabled\":false},\"SeIncreaseWorkingSetPrivilege\":{\"enabled\":false},\"SeLoadDriverPrivilege\":{\"enabled\":false},\"SeManageVolumePrivilege\":{\"enabled\":false},\"SeProfileSingleProcessPrivilege\":{\"enabled\":false},\"SeRemoteShutdownPrivilege\":{\"enabled\":false},\"SeRestorePrivilege\":{\"enabled\":false},\"SeSecurityPrivilege\":{\"enabled\":false},\"SeShutdownPrivilege\":{\"enabled\":false},\"SeSystemEnvironmentPrivilege\":{\"enabled\":false},\"SeSystemProfilePrivilege\":{\"enabled\":false},\"SeSystemtimePrivilege\":{\"enabled\":false},\"SeTakeOwnershipPrivilege\":{\"enabled\":false},\"SeTimeZonePrivilege\":{\"enabled\":false},\"SeUndockPrivilege\":{\"enabled\":false}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.701Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":88},"message":"SeDebugPrivilege is enabled. SeDebugPrivilege=(Enabled)","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.701Z","log.logger":"system.cpu","log.origin":{"file.name":"cpu/cpu.go","file.line":106},"message":"got DiagnosticSetup request for system/cpu","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.701Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-28T12:31:20.702Z","log.logger":"system.memory","log.origin":{"file.name":"memory/memory.go","file.line":76},"message":"got DiagnosticSetup request for system/memory","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
{"log.level":"error","@timestamp":"2023-11-28T12:31:31.675Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-28T12:31:31.675Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:117: Reading events...
    metricbeat_v2_test.go:119: Got 20 events
    metricbeat_v2_test.go:77: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:77
        	            				C:/Users/jenkins/workspace/PR-36915-6-05643470-cd26-4186-9cba-df1c8e94f057/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:156
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701174679\beat-out-20231128.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestSingleMetricbeatMetricsetWithProcessors
--- FAIL: TestSingleMetricbeatMetricsetWithProcessors (12.06s)

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig/valid_config
    config_test.go:125: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-6-94cc8f92-71d8-40fb-9a6c-859955b3871f/src/github.com/elastic/beats/x-pack/filebeat/input/etw/config_test.go:125
        	Error:      	An error is expected but got nil.
        	Test:       	Test_validateConfig/valid_config
--- FAIL: Test_validateConfig/valid_config (0.00s)

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig
--- FAIL: Test_validateConfig (0.00s)

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig/valid_config
    config_test.go:125: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-6-05c294ab-6e52-481e-869a-26aa99ab5d20/src/github.com/elastic/beats/x-pack/filebeat/input/etw/config_test.go:125
        	Error:      	An error is expected but got nil.
        	Test:       	Test_validateConfig/valid_config
--- FAIL: Test_validateConfig/valid_config (0.00s)

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig
--- FAIL: Test_validateConfig (0.00s)

Steps errors

Expand to view the steps failures

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 7 min 35 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 3 min 31 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 3 min 32 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

Took 7 min 46 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

Took 2 min 35 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

Took 1 min 3 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

Took 6 min 54 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

Took 1 min 56 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

Took 1 min 56 sec . View more details here
Description: mage build unitTest

`Error signal`

Took 0 min 0 sec . View more details here
Description: Error 'hudson.AbortException: script returned exit code 1'

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest
Name: Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest
Name: Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest
Name: Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest
Name: Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw
Name: Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw
Name: Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw
Name: Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2023-11-29T09:25:46Z

💔 Tests Failed

Expand to view the summary

Build stats

Start Time: 2023-11-29T07:17:45.854+0000
Duration: 128 min 48 sec

Test stats 🧪

Test	Results
Failed	4
Passed	16556
Skipped	984
Total	17544

Test errors

Expand to view the tests failures

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestFilebeat
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701244169
    init.go:62: Resetting fleet manager...
    filebeat_v2_test.go:90: waiting for events...
    filebeat_v2_test.go:84: Running beats...
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.356Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\logs]","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.557Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: 4959b930-a2ac-4761-a9e8-88b089c82a69","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:29.578Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:29.578Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:29.579Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:29.580Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:29.581Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.581Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-a\",\"instance\":{\"id\":\"2417193015925495398\",\"name\":\"beats-ci-immutable-windows-2022-1701242996623781094\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.581Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.581Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"filebeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149","data":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\logs"},"type":"filebeat","uuid":"4959b930-a2ac-4761-a9e8-88b089c82a69"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.581Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"filebeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.581Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"filebeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.588Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"filebeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-29T07:31:23Z","name":"beats-ci-immutable-windows-2022-1701242996623781094","ip":["10.224.0.182","::1","127.0.0.1"],"kernel_version":"10.0.20348.2110 (WinBuild.160101.0800)","mac":["42:01:0a:e0:00:b6"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2022 Standard","version":"10.0","major":10,"minor":0,"patch":0,"build":"20348.2113"},"timezone":"GMT","timezone_offset_sec":0,"id":"e02dae5a-ad6a-49ad-9c6a-eea4e5f21a75"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.589Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"filebeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\fbtest.test.exe","name":"fbtest.test.exe","pid":4228,"ppid":1408,"start_time":"2023-11-29T07:49:29.169Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.589Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: filebeat; Version: 8.12.0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.594Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.600Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2022-1701242996623781094","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:29.600Z","log.logger":"modules","log.origin":{"file.name":"fileset/modules.go","file.line":152},"message":"Not loading modules. Module directory not found: C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\module","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.601Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"filebeat start running.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.600Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.602Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.605Z","log.origin":{"file.name":"memlog/store.go","file.line":134},"message":"Finished loading transaction log file for 'C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1149\\data\\registry\\filebeat'. Active transaction id=0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-29T07:49:29.606Z","log.origin":{"file.name":"beater/filebeat.go","file.line":331},"message":"Filebeat is unable to load the ingest pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the ingest pipelines or are using Logstash pipelines, you can ignore this warning.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.606Z","log.logger":"input","log.origin":{"file.name":"shipper/input.go","file.line":55},"message":"creating new InputManager","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.607Z","log.logger":"registrar","log.origin":{"file.name":"registrar/registrar.go","file.line":107},"message":"States Loaded from registrar: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.607Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":71},"message":"Loading Inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.607Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":106},"message":"Loading and starting Inputs completed. Enabled inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:29.607Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.611Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(7c719fc2-4568-4f55-a761-735f8c032cc8), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:29.611Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(3e048239-12fb-4837-a963-8241519262fb), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:30.612Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:30.613Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701244169\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-29T07:49:30.615Z","log.logger":"cfgwarn","log.origin":{"file.name":"log/input.go","file.line":90},"message":"DEPRECATED: Log input. Use Filestream input instead.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:30.616Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages]","service.name":"filebeat","input_id":"51482bb2-afe0-49ce-8539-4d6feecbe30d","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:30.616Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure*]","service.name":"filebeat","input_id":"bc109462-6f00-4238-829d-3f9c4fc2f8f5","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:30.617Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/messages]","service.name":"filebeat","input_id":"51482bb2-afe0-49ce-8539-4d6feecbe30d","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages","state_id":"native::196608-539414-3836337016","finished":false,"os_id":"196608-539414-3836337016","harvester_id":"d65c20f4-edd0-4efc-9f78-b0d256fab38f","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:30.617Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/secure*]","service.name":"filebeat","input_id":"bc109462-6f00-4238-829d-3f9c4fc2f8f5","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure","state_id":"native::196608-539415-3836337016","finished":false,"os_id":"196608-539415-3836337016","harvester_id":"f16725bf-ceb3-423b-96d2-5961c4b7cf7a","ecs.version":"1.6.0"}
    filebeat_v2_test.go:96: stopping filebeat after 91 events
{"log.level":"error","@timestamp":"2023-11-29T07:49:41.333Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:41.333Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
    filebeat_v2_test.go:103: Reading events...
    filebeat_v2_test.go:80: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:80
        	            				C:/Users/jenkins/workspace/PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:131
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701244169\beat-out-20231129.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestFilebeat
--- FAIL: TestFilebeat (12.04s)

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestFilebeat
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701244183
    init.go:62: Resetting fleet manager...
    filebeat_v2_test.go:90: waiting for events...
    filebeat_v2_test.go:84: Running beats...
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.329Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\logs]","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.332Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: cbd03c65-d234-4312-a673-8989bbdd3a69","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:43.349Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.351Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-b\",\"instance\":{\"id\":\"3603124672801756772\",\"name\":\"beats-ci-immutable-windows-2016-1701242996623811334\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.351Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.351Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"filebeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149","data":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\logs"},"type":"filebeat","uuid":"cbd03c65-d234-4312-a673-8989bbdd3a69"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.351Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"filebeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.352Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"filebeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.357Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"filebeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-29T07:33:34Z","name":"beats-ci-immutable-windows-2016-1701242996623811334","ip":["fe80::7016:c770:eab9:10ed","10.224.0.212","::1","127.0.0.1","fe80::5efe:ae0:d4","2001:0:34f1:8072:2814:6f7:f51f:ff2b","fe80::2814:6f7:f51f:ff2b"],"kernel_version":"10.0.14393.6451 (rs1_release.231103-1737)","mac":["42:01:0a:e0:00:d4","00:00:00:00:00:00:00:e0","00:00:00:00:00:00:00:e0"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2016 Datacenter","version":"10.0","major":10,"minor":0,"patch":0,"build":"14393.6452"},"timezone":"GMT","timezone_offset_sec":0,"id":"b92a1945-a05d-40c2-967b-7996f3eb5d67"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.358Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"filebeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\fbtest.test.exe","name":"fbtest.test.exe","pid":4972,"ppid":4344,"start_time":"2023-11-29T07:49:43.151Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.358Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: filebeat; Version: 8.12.0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.362Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.369Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2016-1701242996623811334","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:43.369Z","log.logger":"modules","log.origin":{"file.name":"fileset/modules.go","file.line":152},"message":"Not loading modules. Module directory not found: C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\module","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.369Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"filebeat start running.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.369Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.370Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.374Z","log.origin":{"file.name":"memlog/store.go","file.line":134},"message":"Finished loading transaction log file for 'C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1149\\data\\registry\\filebeat'. Active transaction id=0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-29T07:49:43.374Z","log.origin":{"file.name":"beater/filebeat.go","file.line":331},"message":"Filebeat is unable to load the ingest pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the ingest pipelines or are using Logstash pipelines, you can ignore this warning.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.375Z","log.logger":"input","log.origin":{"file.name":"shipper/input.go","file.line":55},"message":"creating new InputManager","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.375Z","log.logger":"registrar","log.origin":{"file.name":"registrar/registrar.go","file.line":107},"message":"States Loaded from registrar: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.375Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":71},"message":"Loading Inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.375Z","log.logger":"crawler","log.origin":{"file.name":"beater/crawler.go","file.line":106},"message":"Loading and starting Inputs completed. Enabled inputs: 0","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:43.376Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.379Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(fef5c3cd-ab67-452c-ac6c-d7f8f30a3178), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:43.379Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(7edb5795-103c-4d14-bc3b-f51f804af847), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:44.380Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:44.381Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701244183\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-11-29T07:49:44.382Z","log.logger":"cfgwarn","log.origin":{"file.name":"log/input.go","file.line":90},"message":"DEPRECATED: Log input. Use Filestream input instead.","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:44.382Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages]","service.name":"filebeat","input_id":"25f0c63d-c45c-4ee9-8ca2-a3c918ef5a19","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:44.382Z","log.logger":"input","log.origin":{"file.name":"log/input.go","file.line":174},"message":"Configured paths: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure*]","service.name":"filebeat","input_id":"aa62ccf9-7a9f-4a6d-bb59-751a5a8793d8","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:44.382Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/messages]","service.name":"filebeat","input_id":"25f0c63d-c45c-4ee9-8ca2-a3c918ef5a19","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\messages","state_id":"native::262144-423051-212358640","finished":false,"os_id":"262144-423051-212358640","harvester_id":"f80b3972-2f18-48f4-a81c-6d2fd4d598b3","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:44.383Z","log.logger":"input.harvester","log.origin":{"file.name":"log/harvester.go","file.line":311},"message":"Harvester started for paths: [./testdata/secure*]","service.name":"filebeat","input_id":"aa62ccf9-7a9f-4a6d-bb59-751a5a8793d8","source_file":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\fbtest\\testdata\\secure","state_id":"native::262144-423052-212358640","finished":false,"os_id":"262144-423052-212358640","harvester_id":"dbc9b608-346d-4f82-af07-8d14f0c572f0","ecs.version":"1.6.0"}
    filebeat_v2_test.go:96: stopping filebeat after 91 events
{"log.level":"error","@timestamp":"2023-11-29T07:49:55.310Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:55.310Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"filebeat","ecs.version":"1.6.0"}
    filebeat_v2_test.go:103: Reading events...
    filebeat_v2_test.go:80: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:80
        	            				C:/Users/jenkins/workspace/PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18/src/github.com/elastic/beats/x-pack/libbeat/management/tests/fbtest/filebeat_v2_test.go:131
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701244183\beat-out-20231129.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestFilebeat
--- FAIL: TestFilebeat (12.03s)

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestSingleMetricbeatMetricsetWithProcessors
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701244178
    init.go:62: Resetting fleet manager...
    metricbeat_v2_test.go:81: Running beats...
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.427Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721\\logs]","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.435Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: 5453c087-eb11-473c-8ea1-ad5385955773","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.457Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-a\",\"instance\":{\"id\":\"2417193015925495398\",\"name\":\"beats-ci-immutable-windows-2022-1701242996623781094\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.457Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.457Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"metricbeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721","data":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721\\logs"},"type":"metricbeat","uuid":"5453c087-eb11-473c-8ea1-ad5385955773"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.457Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"metricbeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.457Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"metricbeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.463Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"metricbeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-29T07:31:23Z","name":"beats-ci-immutable-windows-2022-1701242996623781094","ip":["10.224.0.182","::1","127.0.0.1"],"kernel_version":"10.0.20348.2110 (WinBuild.160101.0800)","mac":["42:01:0a:e0:00:b6"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2022 Standard","version":"10.0","major":10,"minor":0,"patch":0,"build":"20348.2113"},"timezone":"GMT","timezone_offset_sec":0,"id":"e02dae5a-ad6a-49ad-9c6a-eea4e5f21a75"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.463Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"metricbeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\mbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b\\go-build2940281484\\b1721\\mbtest.test.exe","name":"mbtest.test.exe","pid":5488,"ppid":1408,"start_time":"2023-11-29T07:49:37.294Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.463Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: metricbeat; Version: 8.12.0","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.469Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.475Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2022-1701242996623781094","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.476Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"metricbeat start running.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.476Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.476Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:38.477Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.483Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(9a00d9ce-e667-455f-9555-abc4c1d2bedb), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:38.484Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(cc662772-103b-41f2-8c02-066c5e8c8c38), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:39.485Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.487Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701244178\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.488Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.494Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":80},"message":"Metricbeat process and system info: {\"OSVersion\":{\"Major\":6,\"Minor\":2,\"Build\":9200},\"Arch\":\"amd64\",\"NumCPU\":8,\"User\":{\"SID\":\"S-1-5-21-3205092550-1898950018-3018611077-1192\",\"Account\":\"jenkins\",\"Domain\":\"BEATS-CI-IMMUTA\",\"Type\":1},\"ProcessPrivs\":{\"SeBackupPrivilege\":{\"enabled\":false},\"SeChangeNotifyPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreateGlobalPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreatePagefilePrivilege\":{\"enabled\":false},\"SeCreateSymbolicLinkPrivilege\":{\"enabled\":false},\"SeDebugPrivilege\":{\"enabled\":true},\"SeDelegateSessionUserImpersonatePrivilege\":{\"enabled\":false},\"SeImpersonatePrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeIncreaseBasePriorityPrivilege\":{\"enabled\":false},\"SeIncreaseQuotaPrivilege\":{\"enabled\":false},\"SeIncreaseWorkingSetPrivilege\":{\"enabled\":false},\"SeLoadDriverPrivilege\":{\"enabled\":false},\"SeManageVolumePrivilege\":{\"enabled\":false},\"SeProfileSingleProcessPrivilege\":{\"enabled\":false},\"SeRemoteShutdownPrivilege\":{\"enabled\":false},\"SeRestorePrivilege\":{\"enabled\":false},\"SeSecurityPrivilege\":{\"enabled\":false},\"SeShutdownPrivilege\":{\"enabled\":false},\"SeSystemEnvironmentPrivilege\":{\"enabled\":false},\"SeSystemProfilePrivilege\":{\"enabled\":false},\"SeSystemtimePrivilege\":{\"enabled\":false},\"SeTakeOwnershipPrivilege\":{\"enabled\":false},\"SeTimeZonePrivilege\":{\"enabled\":false},\"SeUndockPrivilege\":{\"enabled\":false}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.494Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":88},"message":"SeDebugPrivilege is enabled. SeDebugPrivilege=(Enabled)","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.494Z","log.logger":"system.cpu","log.origin":{"file.name":"cpu/cpu.go","file.line":106},"message":"got DiagnosticSetup request for system/cpu","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.494Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:39.495Z","log.logger":"system.memory","log.origin":{"file.name":"memory/memory.go","file.line":76},"message":"got DiagnosticSetup request for system/memory","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
{"log.level":"error","@timestamp":"2023-11-29T07:49:50.422Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:50.422Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:117: Reading events...
    metricbeat_v2_test.go:119: Got 20 events
    metricbeat_v2_test.go:77: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:77
        	            				C:/Users/jenkins/workspace/PR-36915-7-fc57017a-fc40-4930-8438-68e0d392091b/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:156
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701244178\beat-out-20231129.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestSingleMetricbeatMetricsetWithProcessors
--- FAIL: TestSingleMetricbeatMetricsetWithProcessors (12.03s)

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestSingleMetricbeatMetricsetWithProcessors
    init.go:31: Setting flags...
    init.go:56: writing output to file C:\Users\jenkins\AppData\Local\Temp\test-1701244191
    init.go:62: Resetting fleet manager...
    metricbeat_v2_test.go:81: Running beats...
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.566Z","log.origin":{"file.name":"instance/beat.go","file.line":811},"message":"Home path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721] Config path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721] Data path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721\\data] Logs path: [C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721\\logs]","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.570Z","log.origin":{"file.name":"instance/beat.go","file.line":819},"message":"Beat ID: b4c6c5cd-0e06-41b4-a477-b0f713742a3b","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:51.590Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:49:51.591Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/providers.go","file.line":173},"message":"add_cloud_metadata: received error failed with http status code 404","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.592Z","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/add_cloud_metadata.go","file.line":104},"message":"add_cloud_metadata: hosting provider type detected as gcp, metadata={\"cloud\":{\"account\":{\"id\":\"elastic-ci-prod\"},\"availability_zone\":\"us-central1-b\",\"instance\":{\"id\":\"3603124672801756772\",\"name\":\"beats-ci-immutable-windows-2016-1701242996623811334\"},\"machine\":{\"type\":\"n1-highmem-8\"},\"project\":{\"id\":\"elastic-ci-prod\"},\"provider\":\"gcp\",\"region\":\"us-central1\",\"service\":{\"name\":\"GCE\"}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.592Z","log.origin":{"file.name":"instance/beat.go","file.line":436},"message":"running under elastic-agent, per-beat lockfiles disabled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.592Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1337},"message":"Beat info","service.name":"metricbeat","system_info":{"beat":{"path":{"config":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721","data":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721\\data","home":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721","logs":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721\\logs"},"type":"metricbeat","uuid":"b4c6c5cd-0e06-41b4-a477-b0f713742a3b"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.592Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1346},"message":"Build info","service.name":"metricbeat","system_info":{"build":{"commit":"unknown","libbeat":"8.12.0","time":"0001-01-01T00:00:00.000Z","version":"8.12.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.592Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1349},"message":"Go runtime info","service.name":"metricbeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":8,"version":"go1.20.11"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.598Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1355},"message":"Host info","service.name":"metricbeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-11-29T07:33:34Z","name":"beats-ci-immutable-windows-2016-1701242996623811334","ip":["fe80::7016:c770:eab9:10ed","10.224.0.212","::1","127.0.0.1","fe80::5efe:ae0:d4","2001:0:34f1:8072:2814:6f7:f51f:ff2b","fe80::2814:6f7:f51f:ff2b"],"kernel_version":"10.0.14393.6451 (rs1_release.231103-1737)","mac":["42:01:0a:e0:00:d4","00:00:00:00:00:00:00:e0","00:00:00:00:00:00:00:e0"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows Server 2016 Datacenter","version":"10.0","major":10,"minor":0,"patch":0,"build":"14393.6452"},"timezone":"GMT","timezone_offset_sec":0,"id":"b92a1945-a05d-40c2-967b-7996f3eb5d67"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.599Z","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1384},"message":"Process info","service.name":"metricbeat","system_info":{"process":{"cwd":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\src\\github.com\\elastic\\beats\\x-pack\\libbeat\\management\\tests\\mbtest","exe":"C:\\Users\\jenkins\\workspace\\PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18\\go-build296582218\\b1721\\mbtest.test.exe","name":"mbtest.test.exe","pid":2540,"ppid":4344,"start_time":"2023-11-29T07:49:50.371Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.599Z","log.origin":{"file.name":"instance/beat.go","file.line":334},"message":"Setup Beat: metricbeat; Version: 8.12.0","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.603Z","log.origin":{"file.name":"instance/beat.go","file.line":366},"message":"Output is configured through Central Management","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.610Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":105},"message":"Beat name: beats-ci-immutable-windows-2016-1701242996623811334","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.611Z","log.origin":{"file.name":"instance/beat.go","file.line":520},"message":"metricbeat start running.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.611Z","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.612Z","log.origin":{"file.name":"service/service_windows.go","file.line":163},"message":"Attempted to register Windows service handlers, but this is not a service. No action necessary","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:51.612Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":465},"message":"Listening for agent unit changes","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.615Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(edafed35-4289-468b-a6e1-6406175b31a8), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:51.615Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":486},"message":"BeatV2Manager.unitListen UnitChanged.ID(18d990e5-3310-478b-a645-dc4413a2624f), UnitChanged.Type(added), UnitChanged.Trigger(0): added/nothing_triggered","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2023-11-29T07:49:52.615Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":719},"message":"Got output unit config ''","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.616Z","log.logger":"file","log.origin":{"file.name":"fileout/file.go","file.line":102},"message":"Initialized file output. path=C:\\Users\\jenkins\\AppData\\Local\\Temp\\test-1701244191\\beat-out max_size_bytes=10485760 max_backups=7 permissions=-rw-------","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.617Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.620Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":80},"message":"Metricbeat process and system info: {\"OSVersion\":{\"Major\":6,\"Minor\":2,\"Build\":9200},\"Arch\":\"amd64\",\"NumCPU\":8,\"User\":{\"SID\":\"S-1-5-21-2378767034-2386247227-3938748546-1148\",\"Account\":\"jenkins\",\"Domain\":\"BEATS-CI-IMMUTA\",\"Type\":1},\"ProcessPrivs\":{\"SeBackupPrivilege\":{\"enabled\":false},\"SeChangeNotifyPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreateGlobalPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreatePagefilePrivilege\":{\"enabled\":false},\"SeCreateSymbolicLinkPrivilege\":{\"enabled\":false},\"SeDebugPrivilege\":{\"enabled\":true},\"SeDelegateSessionUserImpersonatePrivilege\":{\"enabled\":false},\"SeImpersonatePrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeIncreaseBasePriorityPrivilege\":{\"enabled\":false},\"SeIncreaseQuotaPrivilege\":{\"enabled\":false},\"SeIncreaseWorkingSetPrivilege\":{\"enabled\":false},\"SeLoadDriverPrivilege\":{\"enabled\":false},\"SeManageVolumePrivilege\":{\"enabled\":false},\"SeProfileSingleProcessPrivilege\":{\"enabled\":false},\"SeRemoteShutdownPrivilege\":{\"enabled\":false},\"SeRestorePrivilege\":{\"enabled\":false},\"SeSecurityPrivilege\":{\"enabled\":false},\"SeShutdownPrivilege\":{\"enabled\":false},\"SeSystemEnvironmentPrivilege\":{\"enabled\":false},\"SeSystemProfilePrivilege\":{\"enabled\":false},\"SeSystemtimePrivilege\":{\"enabled\":false},\"SeTakeOwnershipPrivilege\":{\"enabled\":false},\"SeTimeZonePrivilege\":{\"enabled\":false},\"SeUndockPrivilege\":{\"enabled\":false}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.620Z","log.origin":{"file.name":"helper/privileges_windows.go","file.line":88},"message":"SeDebugPrivilege is enabled. SeDebugPrivilege=(Enabled)","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.621Z","log.logger":"system.cpu","log.origin":{"file.name":"cpu/cpu.go","file.line":106},"message":"got DiagnosticSetup request for system/cpu","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.621Z","log.origin":{"file.name":"sysinit/init.go","file.line":57},"message":"initializing HostFS values under agent: /","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-29T07:49:52.622Z","log.logger":"system.memory","log.origin":{"file.name":"memory/memory.go","file.line":76},"message":"got DiagnosticSetup request for system/memory","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
    metricbeat_v2_test.go:111: found memory and CPU events
{"log.level":"error","@timestamp":"2023-11-29T07:50:03.575Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-11-29T07:50:03.575Z","log.logger":"centralmgmt.V2-manager","log.origin":{"file.name":"management/managerV2.go","file.line":448},"message":"elastic-agent-client error: rpc error: code = Canceled desc = context canceled","service.name":"metricbeat","ecs.version":"1.6.0"}
    metricbeat_v2_test.go:117: Reading events...
    metricbeat_v2_test.go:119: Got 20 events
    metricbeat_v2_test.go:77: 
        	Error Trace:	C:/Users/jenkins/workspace/PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:77
        	            				C:/Users/jenkins/workspace/PR-36915-7-a1aa6ee4-4baf-4fce-a7c8-2a0464b86a18/src/github.com/elastic/beats/x-pack/libbeat/management/tests/mbtest/metricbeat_v2_test.go:156
        	Error:      	Received unexpected error:
        	            	remove C:\Users\jenkins\AppData\Local\Temp\test-1701244191\beat-out-20231129.ndjson: The process cannot access the file because it is being used by another process.
        	Test:       	TestSingleMetricbeatMetricsetWithProcessors
--- FAIL: TestSingleMetricbeatMetricsetWithProcessors (12.04s)

Steps errors

Expand to view the steps failures

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 7 min 50 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 2 min 25 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 2 min 28 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

Took 7 min 2 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

Took 1 min 7 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

Took 1 min 1 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

Took 7 min 40 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

Took 1 min 59 sec . View more details here
Description: mage build unitTest

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

Took 1 min 57 sec . View more details here
Description: mage build unitTest

`Error signal`

Took 0 min 0 sec . View more details here
Description: Error 'hudson.AbortException: script returned exit code 1'

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest
Name: Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest
Name: Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest
Name: Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2023-12-01T00:50:02Z

💔 Build Failed

Expand to view the summary

Build stats

Duration: 124 min 37 sec

Pipeline error

❕ Flaky test report

No test was executed to be analysed.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2023-12-01T18:43:48Z

💔 Tests Failed

Expand to view the summary

Build stats

Start Time: 2023-12-01T16:37:44.328+0000
Duration: 126 min 50 sec

Test stats 🧪

Test	Results
Failed	6
Passed	16388
Skipped	982
Total	17376

Test errors

Expand to view the tests failures

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / TestInput/retry_failure – github.com/elastic/beats/v7/x-pack/filebeat/input/cel`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestInput/retry_failure
    input_test.go:1463: unexpected result for event 0: got:- want:+
          mapstr.M{
        - 	"error": map[string]any{
        - 		"message": string("failed eval: failed to unmarshal JSON message: unexpected end of JSON input"),
        - 	},
        + 	"hello": string("world"),
          }
--- FAIL: TestInput/retry_failure (0.01s)

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / TestInput – github.com/elastic/beats/v7/x-pack/filebeat/input/cel`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestInput
--- FAIL: TestInput (29.63s)

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/minimal_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig/minimal_config
    config_test.go:133: Configuration validation failed. no error expected but got 'invalid Trace Level value '' accessing config'
--- FAIL: Test_validateConfig/minimal_config (0.00s)

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig
--- FAIL: Test_validateConfig (0.00s)

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/minimal_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig/minimal_config
    config_test.go:133: Configuration validation failed. no error expected but got 'invalid Trace Level value '' accessing config'
--- FAIL: Test_validateConfig/minimal_config (0.00s)

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   Test_validateConfig
--- FAIL: Test_validateConfig (0.00s)

Steps errors

Expand to view the steps failures

`x-pack/filebeat-windows-2022-windows-2022 - mage build unitTest`

Took 7 min 28 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2022-windows-2022 - mage build unitTest`

Took 3 min 43 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2022-windows-2022 - mage build unitTest`

Took 3 min 39 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 7 min 42 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 3 min 32 sec . View more details here
Description: mage build unitTest

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

Took 2 min 27 sec . View more details here
Description: mage build unitTest

`Error signal`

Took 0 min 0 sec . View more details here
Description: Error 'hudson.AbortException: script returned exit code 1'

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / x-pack/filebeat-windows-2016-windows-2016 / TestInput/retry_failure – github.com/elastic/beats/v7/x-pack/filebeat/input/cel
Name: Build&Test / x-pack/filebeat-windows-2016-windows-2016 / TestInput – github.com/elastic/beats/v7/x-pack/filebeat/input/cel
Name: Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/minimal_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw
Name: Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw
Name: Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/minimal_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw
Name: Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2023-12-04T10:56:48Z

❕ Build Aborted

Expand to view the summary

Build stats

Duration: 64 min 21 sec

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2023-12-04T13:13:26Z

💚 Build Succeeded

Expand to view the summary

Build stats

Start Time: 2023-12-04T10:50:08.140+0000
Duration: 143 min 7 sec

Test stats 🧪

Test	Results
Failed	0
Passed	13602
Skipped	960
Total	14562

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

x-pack/filebeat/input/etw/input.go

andrewkroh

I tested manually with this config and it was working. I notice some of the debug message were not clear so I have made some suggestion that can be addressed in a follow-up PR. I also think the input's Run func can be cleaned up a bit by using sync.OnceFunc and golang.org/x/sync/errgroup.

  - type: etw
    provider.name: Microsoft-Windows-DNS-Client

andrewkroh · 2024-02-12T16:37:38Z

x-pack/filebeat/input/etw/input.go

+			errChan <- fmt.Errorf("failed to start consumer: %w", err) // Send error to channel
+			return
+		}
+		e.log.Debug("stopped to read ETW events from session")


This message is confusing to me. I think it's just telling that the consumer stopped.

Suggested change

e.log.Debug("stopped to read ETW events from session")

e.log.Debug("ETW consumer stopped")

andrewkroh · 2024-02-12T16:38:06Z

x-pack/filebeat/input/etw/input.go

+			return 1
+		}
+
+		e.log.Debugf("received event %d with length %d", record.EventHeader.EventDescriptor.Id, record.UserDataLength)


Some context about the parameters is missing IMO.

Suggested change

e.log.Debugf("received event %d with length %d", record.EventHeader.EventDescriptor.Id, record.UserDataLength)

e.log.Debugf("received event with ID %d and user-data length %d", record.EventHeader.EventDescriptor.Id, record.UserDataLength)

andrewkroh · 2024-02-12T18:15:04Z

PR to skip the unrelated flaky test: #37988

mergify · 2024-02-12T23:45:08Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b dev-etw-filebeat-input upstream/dev-etw-filebeat-input
git merge upstream/main
git push upstream dev-etw-filebeat-input

elasticmachine · 2024-02-13T11:35:39Z

💚 Build Succeeded

Buildkite Build
Commit: 30b3f3a

History

💚 Build #1307 succeeded c04f88a
💚 Build #1275 succeeded 4940400
💚 Build #1269 succeeded e036719
💔 Build #1266 failed c8df9cb
💚 Build #1221 succeeded 2aa117e
💚 Build #1220 succeeded 1ed5695

cc @chemamartinez

elasticmachine · 2024-02-13T11:35:43Z

💚 Build Succeeded

Buildkite Build
Commit: 30b3f3a

History

💚 Build #1301 succeeded c04f88a
💚 Build #1269 succeeded 4940400
💚 Build #1263 succeeded e036719
💔 Build #1260 failed c8df9cb
💚 Build #1216 succeeded 2aa117e
💚 Build #1215 succeeded 1ed5695

cc @chemamartinez

elasticmachine · 2024-02-13T11:35:58Z

💚 Build Succeeded

Buildkite Build
Commit: 30b3f3a

History

💚 Build #472 succeeded c04f88a
💚 Build #434 succeeded e036719
💔 Build #431 failed c8df9cb
💚 Build #385 succeeded 2aa117e
💚 Build #384 succeeded 1ed5695
💚 Build #345 succeeded 198d928

cc @chemamartinez

elasticmachine · 2024-02-13T11:36:00Z

💚 Build Succeeded

Buildkite Build
Commit: 30b3f3a

History

💚 Build #2521 succeeded c04f88a
💚 Build #2489 succeeded 4940400
💚 Build #2483 succeeded e036719
💔 Build #2480 failed c8df9cb
💚 Build #2434 succeeded 2aa117e
💚 Build #2433 succeeded 1ed5695

cc @chemamartinez

elasticmachine · 2024-02-13T11:49:21Z

💔 Build Failed

Buildkite Build
Commit: 30b3f3a

Failed CI Steps

:windows:-family/core-windows-2016 Unit Tests

History

💔 Build #2971 failed c04f88a
💔 Build #2939 failed 4940400
💔 Build #2930 failed c8df9cb
💚 Build #2885 succeeded 2aa117e
💔 Build #2884 failed 1ed5695

cc @chemamartinez

elasticmachine · 2024-02-13T11:53:01Z

💚 Build Succeeded

Buildkite Build
Commit: 30b3f3a

History

💔 Build #1632 failed c04f88a
💚 Build #1600 succeeded 4940400
💚 Build #1594 succeeded e036719
💔 Build #1591 failed c8df9cb
💚 Build #1546 succeeded 2aa117e

cc @chemamartinez

andrewkroh · 2024-02-13T13:31:55Z

We are not blocked by Buildkite failures, but I did open #37998 for the failing filestream input test.

Use errgroup to wait on the ETW consumer routine. Use sync.OnceFunc to wrap the Close() func for the ETW session. Clarify a few log messages (follow-up to #36915) - #36915 (comment) - #36915 (comment)

kalramani · 2024-04-07T06:24:27Z

following - case no. 01567791

chemamartinez added enhancement Filebeat Filebeat x-pack Issues and pull requests for X-Pack features. Team:Security-External Integrations new input (filebeat) A new input for file beat labels Oct 19, 2023

chemamartinez self-assigned this Oct 19, 2023

botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Oct 19, 2023

chemamartinez force-pushed the dev-etw-filebeat-input branch 2 times, most recently from fafbbd9 to e854e35 Compare October 27, 2023 09:06

andrewkroh reviewed Nov 7, 2023

View reviewed changes

chemamartinez force-pushed the dev-etw-filebeat-input branch from e854e35 to bdf547b Compare November 20, 2023 10:36

chemamartinez mentioned this pull request Nov 23, 2023

x-pack/libbeat/reader/etw: New reader to collect ETW logs #36914

Merged

8 tasks

chemamartinez force-pushed the dev-etw-filebeat-input branch from bdf547b to 0e34d50 Compare November 28, 2023 11:58

chemamartinez force-pushed the dev-etw-filebeat-input branch from 0e34d50 to 83b3975 Compare November 29, 2023 07:17

chemamartinez added the 8.12 candidate label Nov 29, 2023

chemamartinez force-pushed the dev-etw-filebeat-input branch from 83b3975 to ec4235a Compare November 30, 2023 22:45

chemamartinez requested a review from andrewkroh December 1, 2023 15:26

chemamartinez force-pushed the dev-etw-filebeat-input branch from ec4235a to ff6e00a Compare December 1, 2023 16:37

chemamartinez removed the 8.12 candidate label Dec 12, 2023

andrewkroh reviewed Feb 12, 2024

View reviewed changes

x-pack/filebeat/input/etw/input.go Outdated Show resolved Hide resolved

andrewkroh reviewed Feb 12, 2024

View reviewed changes

x-pack/filebeat/input/etw/input.go Outdated Show resolved Hide resolved

andrewkroh reviewed Feb 12, 2024

View reviewed changes

x-pack/filebeat/input/etw/input.go Show resolved Hide resolved

andrewkroh reviewed Feb 12, 2024

View reviewed changes

x-pack/filebeat/input/etw/input.go Outdated Show resolved Hide resolved

andrewkroh reviewed Feb 12, 2024

View reviewed changes

x-pack/filebeat/input/etw/input.go Outdated Show resolved Hide resolved

andrewkroh reviewed Feb 12, 2024

View reviewed changes

x-pack/filebeat/input/etw/input.go Outdated Show resolved Hide resolved

andrewkroh added 3 commits February 12, 2024 10:04

Address review comments

c8df9cb

Merge remote-tracking branch 'elastic/main' into dev-etw-filebeat-input

e036719

filebeat/docs - rebuild with field changes

4940400

andrewkroh approved these changes Feb 12, 2024

View reviewed changes

narph removed the request for review from belimawr February 13, 2024 08:51

narph added 2 commits February 13, 2024 10:38

Merge branch 'main' into dev-etw-filebeat-input

c04f88a

fix tests

30b3f3a

narph merged commit c3cedcf into elastic:main Feb 13, 2024
77 of 78 checks passed

andrewkroh mentioned this pull request Feb 14, 2024

[Filebeat] ETW input - use errgroup #38009

Merged

6 tasks

taylor-swanson mentioned this pull request Apr 17, 2024

[netflow] Restore netflow input on Windows #39024

Merged

2 tasks

This was referenced Apr 18, 2024

[8.13](backport #39024) [netflow] Restore netflow input on Windows #39059

Merged

[8.14](backport #39024) [netflow] Restore netflow input on Windows #39119

Merged

junkiebev mentioned this pull request May 1, 2024

[feature request] - New release with updated components Graylog2/collector-sidecar#495

Open

	e.log.Debug("stopped to read ETW events from session")
	e.log.Debug("ETW consumer stopped")

	e.log.Debugf("received event %d with length %d", record.EventHeader.EventDescriptor.Id, record.UserDataLength)
	e.log.Debugf("received event with ID %d and user-data length %d", record.EventHeader.EventDescriptor.Id, record.UserDataLength)

x-pack/filebeat/input/etw: New input #36915

x-pack/filebeat/input/etw: New input #36915

Conversation

chemamartinez commented Oct 19, 2023 • edited by andrewkroh Loading

Description

Checklist

Author's Checklist

How to test this PR locally

Related issues

Logs

mergify bot commented Oct 19, 2023

elasticmachine commented Oct 19, 2023 • edited by jenkins-beats-ci bot Loading

💔 Build Failed

Build stats

Test stats 🧪

Steps errors

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/libbeat-unitTest - mage build unitTest

x-pack/libbeat-unitTest - mage build unitTest

x-pack/libbeat-unitTest - mage build unitTest

x-pack/libbeat-goIntegTest - mage goIntegTest

x-pack/libbeat-goIntegTest - mage goIntegTest

x-pack/libbeat-goIntegTest - mage goIntegTest

Error signal

💚 Flaky test report

🤖 GitHub comments

mergify bot commented Oct 27, 2023

elasticmachine commented Nov 20, 2023

💚 Build Succeeded

Build stats

Test stats 🧪

💚 Flaky test report

🤖 GitHub comments

elasticmachine commented Nov 28, 2023

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest

Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest

Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest

Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest

Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw

Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw

Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw

Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw

Steps errors

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest

x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest

x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest

x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest

x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest

x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest

Error signal

🐛 Flaky test report

Genuine test errors

🤖 GitHub comments

elasticmachine commented Nov 29, 2023

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest

Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest

Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest

Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest

Steps errors

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest

x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest

x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest

x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest

x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest

x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest

chemamartinez commented Oct 19, 2023 •

edited by andrewkroh

Loading

elasticmachine commented Oct 19, 2023 •

edited by jenkins-beats-ci bot

Loading

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-unitTest - mage build unitTest`

`x-pack/libbeat-unitTest - mage build unitTest`

`x-pack/libbeat-unitTest - mage build unitTest`

`x-pack/libbeat-goIntegTest - mage goIntegTest`

`x-pack/libbeat-goIntegTest - mage goIntegTest`

`x-pack/libbeat-goIntegTest - mage goIntegTest`

`Error signal`

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/valid_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

`Error signal`

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestFilebeat – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/fbtest`

`Build&Test / x-pack/libbeat-windows-2022-windows-2022 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

`Build&Test / x-pack/libbeat-windows-2016-windows-2016 / TestSingleMetricbeatMetricsetWithProcessors – github.com/elastic/beats/v7/x-pack/libbeat/management/tests/mbtest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/libbeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/libbeat-windows-2016-windows-2016 - mage build unitTest`

`Error signal`

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / TestInput/retry_failure – github.com/elastic/beats/v7/x-pack/filebeat/input/cel`

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / TestInput – github.com/elastic/beats/v7/x-pack/filebeat/input/cel`

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig/minimal_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`Build&Test / x-pack/filebeat-windows-2016-windows-2016 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig/minimal_config – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`Build&Test / x-pack/filebeat-windows-2022-windows-2022 / Test_validateConfig – github.com/elastic/beats/v7/x-pack/filebeat/input/etw`

`x-pack/filebeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/filebeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/filebeat-windows-2022-windows-2022 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`x-pack/filebeat-windows-2016-windows-2016 - mage build unitTest`

`Error signal`

elasticmachine commented Feb 13, 2024 •

edited

Loading