Onboard Latency Threshold rule type with FAAD

[doakalexi]

Towards: #169867

This PR onboards Latency Threshold rule type with FAAD.

To verify

1. Run the following script to generate APM data:

node scripts/synthtrace simple_trace.ts --local --live

2. Create a latency threshold rule.
   Example:

POST kbn:/api/alerting/rule
{
  "params": {
    "aggregationType": "avg",
    "environment": "ENVIRONMENT_ALL",
    "threshold": 400,
    "windowSize": 5,
    "windowUnit": "m"
  },
  "consumer": "alerts",
  "schedule": {
    "interval": "1m"
  },
  "tags": [],
  "name": "testinggg",
  "rule_type_id": "apm.transaction_duration",
  "notify_when": "onActionGroupChange",
  "actions": []
}

3. Your rule should create an alert and should saved it in .internal.alerts-observability.apm.alerts-default-000001
   Example:

GET .internal.alerts-*/_search

4. Set threshold: 10000

5. The alert should be recovered and the AAD in the above index should be updated kibana.alert.status: recovered.

[doakalexi]

/ci

[doakalexi]

/ci

[elasticmachine]

Pinging @elastic/response-ops (Team:ResponseOps)

[cauemarcondes]

What does shouldWrite mean?

[doakalexi]

We added this flag to prevent rules that were registered with both the rule registry and the alerting framework from having both write alerting docs. It will be removed once we move all rules away from the rule registry

[ymao1]

We should set this to true here and remove the override in x-pack/plugins/observability_solution/apm/server/routes/alerts/rule_types/transaction_duration/register_transaction_duration_rule_type.ts

[doakalexi]

I think we need this until all the APM rules have been onboarded. On the last rule I will make sure to do this. Thanks!

[elasticmachine]

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

[pmuellr]

LGTM, alert documents appear correct, in the expected index, can be updated

[js-jankisalvi]

Verified locally, works as expected 👍 🎉

[cauemarcondes]

LGTM

[kibana-ci]

💚 Build Succeeded

• Buildkite Build
• Commit: e2f95ba

Metrics [docs]

✅ unchanged

History

• 💚 Build #199171 succeeded 1e4efdf
• 💚 Build #198621 succeeded 5a936a9
• 💔 Build #198593 failed 5ff303a

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @doakalexi