Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x-pack/metricbeat/module/panw: Add a new module #40686

Merged
merged 35 commits into from
Sep 17, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
c286f92
initial module creation
dparkerelastic Aug 29, 2024
741fc30
panos.system metricset running
dparkerelastic Aug 31, 2024
b4140e2
remove testing data
dparkerelastic Aug 31, 2024
f78742f
panos.disk metricset working
dparkerelastic Aug 31, 2024
daf2caf
rename metricset
dparkerelastic Sep 1, 2024
6004852
change metricset name
dparkerelastic Sep 1, 2024
6ff51e6
bgp_peers metricset working
dparkerelastic Sep 1, 2024
4c986a1
temperature metricset
dparkerelastic Sep 1, 2024
eff0e0b
more metricsets
dparkerelastic Sep 2, 2024
7a359ea
use MetricSetFields
dparkerelastic Sep 2, 2024
cdafd8b
license notices
dparkerelastic Sep 2, 2024
246d065
update fields.yml
dparkerelastic Sep 3, 2024
e26bd4f
added doc
dparkerelastic Sep 3, 2024
d8dac4d
refactor down to 4 metricsets
dparkerelastic Sep 7, 2024
c9f2bec
more cleanup
dparkerelastic Sep 7, 2024
0438c2f
cleanup field names
dparkerelastic Sep 7, 2024
2c37e9a
remove yml
dparkerelastic Sep 7, 2024
20e1103
panos.yml.disabled
dparkerelastic Sep 7, 2024
80a6c2b
PR comment fixes
dparkerelastic Sep 9, 2024
6a9c0f5
more PR comments addressed. Still to do: tests
dparkerelastic Sep 10, 2024
8e2d899
Changes to:
dparkerelastic Sep 12, 2024
1e73885
Fixes for PR comments
dparkerelastic Sep 16, 2024
213f417
add license header
dparkerelastic Sep 16, 2024
7bb44ac
add pango package
dparkerelastic Sep 16, 2024
615c2b5
mage check && mage update
shmsr Sep 17, 2024
181a0bb
remove mappings & make update
shmsr Sep 17, 2024
e37b59d
make linter happy
shmsr Sep 17, 2024
ae57920
Merge branch 'main' into dap_panos
shmsr Sep 17, 2024
e833453
add the untracked docs
shmsr Sep 17, 2024
1ff4197
Merge branch 'main' into dap_panos
shmsr Sep 17, 2024
1d55a22
update the fields.yml
shmsr Sep 17, 2024
77ba48e
update the fields.yml with example fields to make python integ tests …
shmsr Sep 17, 2024
d51944e
make docs check happy and update codeowners
shmsr Sep 17, 2024
162bec0
Merge branch 'main' into dap_panos
shmsr Sep 17, 2024
87e57f5
add result of 'mage update' in x-pack/metricbeat
tommyers-elastic Sep 17, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
Expand Up @@ -216,6 +216,7 @@ CHANGELOG*
/x-pack/metricbeat/module/istio/ @elastic/obs-cloudnative-monitoring
/x-pack/metricbeat/module/mssql @elastic/obs-infraobs-integrations
/x-pack/metricbeat/module/oracle @elastic/obs-infraobs-integrations
/x-pack/metricbeat/module/panw @elastic/obs-infraobs-integrations
/x-pack/metricbeat/module/prometheus/ @elastic/obs-cloudnative-monitoring
/x-pack/metricbeat/module/redisenterprise @elastic/obs-infraobs-integrations
/x-pack/metricbeat/module/sql @elastic/obs-infraobs-integrations
Expand Down
25 changes: 25 additions & 0 deletions NOTICE.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2720,6 +2720,31 @@ Redistribution and use in source and binary forms, with or without modification,

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

--------------------------------------------------------------------------------
Dependency : github.com/PaloAltoNetworks/pango
Version: v0.10.2
Licence type (autodetected): ISC
--------------------------------------------------------------------------------

Contents of probable licence file $GOMODCACHE/github.com/!palo!alto!networks/pango@v0.10.2/LICENSE:

Distributed under ISC license:

Copyright (c) 2014-2016, Palo Alto Networks Inc.

Permission to use, copy, modify, and/or distribute this software for any
purpose with or without fee is hereby granted, provided that the above
copyright notice and this permission notice appear in all copies.

THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES
WITH REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF
MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY
SPECIAL, DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION
OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF OR IN
CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.


--------------------------------------------------------------------------------
Dependency : github.com/elastic/sarama
Version: v1.19.1-0.20220310193331-ebc2b0d8eef3
Expand Down
1 change: 1 addition & 0 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -394,6 +394,7 @@ require (

require (
cloud.google.com/go/storage v1.43.0
github.com/PaloAltoNetworks/pango v0.10.2
github.com/dlclark/regexp2 v1.4.0 // indirect
github.com/google/gofuzz v1.2.0 // indirect
github.com/moby/term v0.5.0 // indirect
Expand Down
2 changes: 2 additions & 0 deletions go.sum
Original file line number Diff line number Diff line change
Expand Up @@ -215,6 +215,8 @@ github.com/PaesslerAG/gval v1.2.2/go.mod h1:XRFLwvmkTEdYziLdaCeCa5ImcGVrfQbeNUbV
github.com/PaesslerAG/jsonpath v0.1.0/go.mod h1:4BzmtoM/PI8fPO4aQGIusjGxGir2BzcV0grWtFzq1Y8=
github.com/PaesslerAG/jsonpath v0.1.1 h1:c1/AToHQMVsduPAa4Vh6xp2U0evy4t8SWp8imEsylIk=
github.com/PaesslerAG/jsonpath v0.1.1/go.mod h1:lVboNxFGal/VwW6d9JzIy56bUsYAP6tH/x80vjnCseY=
github.com/PaloAltoNetworks/pango v0.10.2 h1:Tjn6vIzzAq6Dd7N0mDuiP8w8pz8k5W9zz/TTSUQCsQY=
github.com/PaloAltoNetworks/pango v0.10.2/go.mod h1:GztcRnVLur7G+VFG7Z5ZKNFgScLtsycwPMp1qVebE5g=
github.com/PuerkitoBio/purell v1.0.0/go.mod h1:c11w/QuzBsJSee3cPx9rAFu61PvFxuPbtSwDGJws/X0=
github.com/PuerkitoBio/purell v1.1.0/go.mod h1:c11w/QuzBsJSee3cPx9rAFu61PvFxuPbtSwDGJws/X0=
github.com/PuerkitoBio/purell v1.1.1/go.mod h1:c11w/QuzBsJSee3cPx9rAFu61PvFxuPbtSwDGJws/X0=
Expand Down
45 changes: 45 additions & 0 deletions metricbeat/docs/fields.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,7 @@ grouped in the following categories:
* <<exported-fields-nginx>>
* <<exported-fields-openmetrics>>
* <<exported-fields-oracle>>
* <<exported-fields-panw>>
* <<exported-fields-php_fpm>>
* <<exported-fields-postgresql>>
* <<exported-fields-process>>
Expand Down Expand Up @@ -57152,6 +57153,50 @@ format: bytes

--

[[exported-fields-panw]]
== Panw fields

PAN-OS module


[float]
=== panw

PAN-OS module



*`panw.interfaces.example`*::
+
--
type: keyword

--


*`panw.routing.example`*::
+
--
type: keyword

--


*`panw.system.example`*::
+
--
type: keyword

--


*`panw.vpn.example`*::
+
--
type: keyword

--

[[exported-fields-php_fpm]]
== PHP_FPM fields

Expand Down
143 changes: 143 additions & 0 deletions metricbeat/docs/modules/panw.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,143 @@
////
This file is generated! See scripts/mage/docs_collector.go
////

:modulename: panw
:edit_url: https://github.com/elastic/beats/edit/main/x-pack/metricbeat/module/panw/_meta/docs.asciidoc


[[metricbeat-module-panw]]
[role="xpack"]
== Panw module

beta[]

:modulename: panw

include::{libbeat-dir}/shared/integration-link.asciidoc[]

:modulename!:

The panw Metricbeat module uses the Palo Alto [pango](https://pkg.go.dev/github.com/PaloAltoNetworks/pango#section-documentation) package to extract metrics
information from a firewall device via the XML API.

[float]
=== Dashboards


[float]
=== Module-specific configuration notes

The panw module configuration requires the ip address of the target firewall device and an API Key generated from that firewall. It is assumed
that network access to the firewall is available. All access by the panw module is read-only.

***Limitations***
The current version of the module is configured to run against **exactly 1** firewall. Multiple firewalls will require multiple agent configurations.
The module has also not been tested with Panorama, though it should work since it only relies on lower level Client.Op calls to send XML API commands
to the server.

Required credentials for the `panw` module:

`host_ip` :: IP address of the firewall - must be network accessible.

`apiKey`:: An API Key generated via an XML API call to the firewall or via the management dashboard. This


[float]
== Metricsets

[float]
=== `bgp_peers`
This metricset reports information on BGP Peers defined in the firewall.

[float]
=== `certificates`
This metricset will capture certificates defined on the firewall including expiration dates.

[float]
=== `fans`
This metricset will collect information from hardware fans (RPMS) and will report if an alarm is active for a given fan.

[float]
=== `filesystem`
This metricset reports disk usage for filesystems defined on the device, based on df output.

[float]
=== `globalprotect_sessions`
This metricset will collect metrics on current user sessions established on Global Protect gateways.

[float]
=== `globalprotect_stats`
This metricset reports the number of user per GlobalProtect gateway and totals across all gateways.

[float]
=== `ha_interfaces`
This metricset will collect metrics from the device on High Availabilty configuration for interfaces.

[float]
=== `licenses`
This metricset reports on licenses for sofware features with expiration dates.

[float]
=== `logical`
This metricset will collect metrics on logical interfaces in the device's network.

[float]
=== `power`
This metricset reports power usage and alarms.

[float]
=== `system`
This metricset captures system informate such as uptime, user count, CPU, memory and swap: essentiallyl the first 5 lines of 'top' output.

[float]
=== `temperature`
This metricset reports temperature for various slots on the device and reports on alarm status.

[float]
=== `tunnels`
This metricset enumerates ipsec tunnels and their status.



:edit_url:

[float]
=== Example configuration

The Panw module supports the standard configuration options that are described
in <<configuration-metricbeat>>. Here is an example configuration:

[source,yaml]
----
metricbeat.modules:
- module: panw
metricsets: ["licenses"]
enabled: false
period: 10s
hosts: ["localhost"]

----

[float]
=== Metricsets

The following metricsets are available:

* <<metricbeat-metricset-panw-interfaces,interfaces>>

* <<metricbeat-metricset-panw-routing,routing>>

* <<metricbeat-metricset-panw-system,system>>

* <<metricbeat-metricset-panw-vpn,vpn>>

include::panw/interfaces.asciidoc[]

include::panw/routing.asciidoc[]

include::panw/system.asciidoc[]

include::panw/vpn.asciidoc[]

:edit_url!:
29 changes: 29 additions & 0 deletions metricbeat/docs/modules/panw/interfaces.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
////
This file is generated! See scripts/mage/docs_collector.go
////
:edit_url: https://github.com/elastic/beats/edit/main/x-pack/metricbeat/module/panw/interfaces/_meta/docs.asciidoc


[[metricbeat-metricset-panw-interfaces]]
[role="xpack"]
=== Panw interfaces metricset

beta[]

include::../../../../x-pack/metricbeat/module/panw/interfaces/_meta/docs.asciidoc[]


:edit_url:

==== Fields

For a description of each field in the metricset, see the
<<exported-fields-panw,exported fields>> section.

Here is an example document generated by this metricset:

[source,json]
----
include::../../../../x-pack/metricbeat/module/panw/interfaces/_meta/data.json[]
----
:edit_url!:
29 changes: 29 additions & 0 deletions metricbeat/docs/modules/panw/routing.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
////
This file is generated! See scripts/mage/docs_collector.go
////
:edit_url: https://github.com/elastic/beats/edit/main/x-pack/metricbeat/module/panw/routing/_meta/docs.asciidoc


[[metricbeat-metricset-panw-routing]]
[role="xpack"]
=== Panw routing metricset

beta[]

include::../../../../x-pack/metricbeat/module/panw/routing/_meta/docs.asciidoc[]


:edit_url:

==== Fields

For a description of each field in the metricset, see the
<<exported-fields-panw,exported fields>> section.

Here is an example document generated by this metricset:

[source,json]
----
include::../../../../x-pack/metricbeat/module/panw/routing/_meta/data.json[]
----
:edit_url!:
29 changes: 29 additions & 0 deletions metricbeat/docs/modules/panw/system.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
////
This file is generated! See scripts/mage/docs_collector.go
////
:edit_url: https://github.com/elastic/beats/edit/main/x-pack/metricbeat/module/panw/system/_meta/docs.asciidoc


[[metricbeat-metricset-panw-system]]
[role="xpack"]
=== Panw system metricset

beta[]

include::../../../../x-pack/metricbeat/module/panw/system/_meta/docs.asciidoc[]


:edit_url:

==== Fields

For a description of each field in the metricset, see the
<<exported-fields-panw,exported fields>> section.

Here is an example document generated by this metricset:

[source,json]
----
include::../../../../x-pack/metricbeat/module/panw/system/_meta/data.json[]
----
:edit_url!:
29 changes: 29 additions & 0 deletions metricbeat/docs/modules/panw/vpn.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
////
This file is generated! See scripts/mage/docs_collector.go
////
:edit_url: https://github.com/elastic/beats/edit/main/x-pack/metricbeat/module/panw/vpn/_meta/docs.asciidoc


[[metricbeat-metricset-panw-vpn]]
[role="xpack"]
=== Panw vpn metricset

beta[]

include::../../../../x-pack/metricbeat/module/panw/vpn/_meta/docs.asciidoc[]


:edit_url:

==== Fields

For a description of each field in the metricset, see the
<<exported-fields-panw,exported fields>> section.

Here is an example document generated by this metricset:

[source,json]
----
include::../../../../x-pack/metricbeat/module/panw/vpn/_meta/data.json[]
----
:edit_url!:
Loading
Loading