[RELEASE] Release version 2.2.0

[github-actions]

Release OpenSearch and OpenSearch Dashboards 2.2.0

I noticed that a manifest was automatically created in manifests/2.2.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. More details are included in the Maintainers Release owner section.

Release Steps

There are several steps to the release process, these steps are completed as the whole release and components that are behind present risk to the release. The release owner completes the tasks in this ticket, whereas component owners resolve tasks on their ticket in their repositories.

Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release.

Component List

To aid in understanding the state of the release there is a table with status indicating each component state. This is updated based on the status of the component issues.

Preparation

• Assign this issue to a release owner.
• Declare a pencils down date for new features to be merged.
• 2022/08/04 is pencils down date for feature freeze.
• Update the Campaigns section to include monitoring campaigns during this release.
• Update this issue so all __REPLACE_RELEASE-__ placeholders have actual dates.
• Document any new quality requirements or changes.
• Finalize scope and feature set and update the Public Roadmap.
• Create a release issue in every component repo that links back to this issue, update Components section with these links.
• Ensure the label is created in each component repo for this new version, and the next minor release. Create a version label
• Ensure that all release issues created above are assigned to an owner in the component team.

CI/CD (Feature Freeze) - 2022/07/26 - 2022/08/04

• Create Jenkins workflows that run daily snapshot builds for OpenSearch and OpenSearch Dashboards.
• Increment each component version to 2.2.0 and ensure working CI in component repositories.
• Make pull requests to add each component to manifests/2.2.0/opensearch-2.2.0.yml and manifests/2.2.0/opensearch-dashboards-2.2.0.yml with the corresponding checks.
• OpenSearch / OpenSearch-Dashboards core and components teams finalize their features
• OpenSearch / OpenSearch-Dashboards core cut branch 2.2 early.

Campaigns

• [Meta] Add automated license header check to all plugins opensearch-plugins#138
• [PROPOSAL] Add flaky test retry  opensearch-plugins#139
• [Meta] Deprecate non-inclusive naming  OpenSearch#2589
  • Deprecate the "Master" nomenclature OpenSearch-Dashboards#1318
  • Change the "Master" nomenclature OpenSearch#472
• [IntegTest] Onboard all plugins into automated integration tests for the distribution #58
• New plugins geospatial, dashboard-maps need to be added to 2.2 release #2346
• [Campaign] Ensure 1.x and 2.x branches (main should be 3.0) opensearch-plugins#142

Code Complete - 2022/07/26 - 2022/08/04

• Code Complete: Make sure that the code for this specific version of the release is ready and the branch corresponding to this release has been added to this release version manifest.
• Verify pull requests to add each component to manifests/2.2.0/opensearch-2.2.0.yml and manifests/2.2.0/opensearch-dashboards-2.2.0.yml have been merged.
• Gather, review and combine the release notes from components repositories.
  • Add 2.2.0 release notes draft for distribution #2445

Release testing - 2022/08/05 - 2022/08/09

• All components should have cut branch 2.2 for the release.
• Declare a release candidate build, and provide the instructions with the release candidates for teams on testing (2022/08/05).
• Stop builds for this version of OpenSearch and/or OpenSearch Dashboards in order to avoid accidental commits going in unknowingly. Restart only if necessary else manually run the build workflow and declare new release candidate.
• Sanity Testing (2022/08/08 - 2022/08/09): Sanity testing and fixing of critical issues found by teams. Teams test their components within the distribution, ensuring integration, backwards compatibility, and perf tests pass.
• Publish all test results in the comments of this issue.

Performance testing validation - 2022/08/08 - 2022/08/09

• Performance tests do not show a regression
• Longevity tests do not show any issues

Release - 2022/08/10 - 2022/08/11

• Verify all issues labeled v2.2.0 in all projects have been resolved.
• Complete documentation for this release.
  • Added 2.2 release documentation-website#876
• Author blog post for this release.
  • Pushing the 2.2.0 release live project-website#944
• 2022/08/10 - Publish this release on opensearch.org.
• 2022/08/11 - Publish a blog post - release is launched!

Post Release

• Create release tags for each component (Jenkins job name: release-tag-creation).
• Replace refs in manifests/2.2.0 with tags and remove checks.
  • All 2.2.0 reference change to tag name #2450
• If this is a major or minor version release, stop building previous patch version.
• Generate distribution release notes reviewed by PM team for opensearch-build repository.
  • Add 2.2.0 release notes draft for distribution #2445
• Increment version for Helm Charts (sample PR) for the 2.2.0 release.
  • Update AppVersion to 2.2.0 to consume latest changes helm-charts#308
• Increment version for Ansible Charts (sample PR) for the 2.2.0 release.
  • Update app version to user 2.2.0 artifacts ansible-playbook#88
• Prepare for next patch release by incrementing patch versions for each component.
  • [AUTO] Incremented version to 2.2.1. OpenSearch#4192
  • [AUTO] [2.x] Added bwc version 2.2.1. OpenSearch#4193
  • [AUTO] [main] Added bwc version 2.2.1. OpenSearch#4194
  • Bump 2.2 branch version to be 2.2.1 OpenSearch-Dashboards#2129
  • Bump 2.x branch version to be 2.3.0 OpenSearch-Dashboards#2130
  • increment from 2.2 to 2.3 OpenSearch-Dashboards#2096
• Lower the frequency of builds for this version of OpenSearch and/or OpenSearch Dashboards.
• Update this template with any new or missed steps.
• Create an issue for a retrospective, solicit feedback, and publish a summary.
  • [Retrospective] Release Version 2.2.0 #2451

Components

Component	On track	Notes
opensearch-project/OpenSearch#4017	🟢	In manifest
opensearch-project/OpenSearch-Dashboards#1957	🟢	In manifest
opensearch-project/alerting#498	🟢	In manifest
opensearch-project/anomaly-detection#618	🟢	In manifest
opensearch-project/asynchronous-search#160	🟢	In manifest
opensearch-project/reporting#401	🟢	In manifest
opensearch-project/dashboards-visualizations#98	🟢	In manifest
opensearch-project/index-management#431	🟢	In manifest
opensearch-project/job-scheduler#214	🟢	In manifest
opensearch-project/k-NN#467	🟢	In manifest
opensearch-project/performance-analyzer#242	🟢	In manifest
opensearch-project/security-dashboards-plugin#1042	🟢	In manifest
opensearch-project/security#1969	🟢	In manifest
opensearch-project/sql#711	🟢	In manifest
opensearch-project/observability#894	🟢	In manifest
opensearch-project/alerting-dashboards-plugin#293	🟢	In manifest
opensearch-project/notifications#490	🟢	In manifest
opensearch-project/index-management-dashboards-plugin#217	🟢	In manifest
opensearch-project/anomaly-detection-dashboards-plugin#291	🟢	In manifest
opensearch-project/cross-cluster-replication#462	🟢	In manifest
opensearch-project/common-utils#206	🟢	In manifest
opensearch-project/ml-commons#374	🟢	In manifest
opensearch-project/geospatial#99	🟢	In manifest
opensearch-project/dashboards-maps#17	🟢	In manifest

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

Issue tracking (Updated 2022/08/05 21:31 PST)

State	Total	Bug	Enhancement
Open	89	3	25
Closed	144	18	39

Issues:

• Boost 2.2.0 build freq and fix commits.yml postclean #2408
• Remove 2.2.0 auto cron trigger now #2432
• [BUG] Gradle task order cause publishzip plugin to change groupid too early notifications#501
  • Temporary solution to unblock notifications 2.2.0 to publishtomavenlocal / publishzips #2431
• Force pull from defined origin to avoid ambiguity performance-analyzer#245
• Add docker scan lib and workflow as part of the distribution builds #2440
• [Bug] Alerting failed on publishzip task on macOS alerting#516
  • Temporary comment out the macos build section snapshots #2442
• Update nodejs version to 14.20.0 for 2.2.0 #2443
• Add 2.2.0 release notes draft for distribution #2445

[prudhvigodithi]

[Triaged] Release 2.2.0 issue, more details will be added after 2.1.0.

[zelinh]

Two new plugins will be added to 2.2 release. #2346

[peternied]

@opensearch-project/engineering-effectiveness there is no owner on this issue and the roadmap says the release is scheduled for the 11th - is there a new mechanism for tracking release processes or is this issue out of date?

[bbarani]

This is a release template for major, minor and patch releases. Feature freeze / code complete is targeted for August 4, 2022 with release date set to August 11, 2022 for 2.2 release. @peterzhuamazon please update the template with these dates.

[peterzhuamazon]

This is a release template for major, minor and patch releases. Feature freeze / code complete is targeted for August 4, 2022 with release date set to August 11, 2022 for 2.2 release. @peterzhuamazon please update the template with these dates.

I have added the dates now @bbarani will add the individual issues soon.

[peterzhuamazon]

OSD 4048:

• Security confirm it is a known flaky test, @DarshitChanpura is fixing.
• AD Dashboards: Adjust ad-dashboard historical page test and fix flaky tests opensearch-dashboards-functional-test#275
• OBS Dashboards:

[kotwanikunal]

Performance results comparison between OpenSearch 2.1 vs 2.2 version

Product/ Version	Architecture	Description	Instance Type	Workload Details	Index Latency (ms) p50	Index Latency (ms) p90	Index Latency (ms) p99	Index Latency (ms) p100	Index Throughput (docs/s) p0	Index Throughput (docs/s) p50	Index Throughput (docs/s) p100	Index Throughput (docs/s) Ops Count	Index Operation Counts Op Error Count	Index Operation Counts Error Rate	Query Latency (ms) p50	Query Latency (ms) p90	Query Latency (ms) p99	Query Latency (ms) p100	Query Throughput (docs/s) p0	Query Throughput (docs/s) p50	Query Throughput (docs/s) p100	Query Operation Counts Ops Count	Query Operation Counts Op Error Count	Error Rate****Query** Operation Counts**	CPU (%) p50	CPU (%) p90	CPU (%) p99	CPU (%) p100	Memory (%) p50	Memory (%) p90	Memory (%) p99	Memory (%) p100	GC (ms) Old	GC (ms) Young
OpenSearch - 2.1.0	X64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,324.80	3,073.90	6,064.20	10,016.10	31,888.40	33,275.90	37,798.70	46,905	0	0	289.6	303.7	313.7	330.4	1.73	1.741	1.754	1,510	0	0	97	97	97	98	51.333	65	82.61	92	0	1,245,816
OpenSearch - 2.1.0	X64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,193.60	2,908.70	5,561.70	8,586	33,935.30	35,489.10	40,399.60	46,728	0	0	279.8	288.1	301.2	309.8	1.727	1.742	1.756	1,510	0	0	97	98	98	98	49	62	86.36	94	0	1,041,064
OpenSearch - 2.1.0	ARM64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,916	2,524.20	4,626.10	6,358.80	38,446.80	40,096.30	43,909.90	46,468	0	0	363.8	372.5	379.1	385.6	1.686	1.707	1.754	1,510	0	0	96	97	97	97	50.333	65	81	90	0	917,896
OpenSearch - 2.1.0	ARM64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,668.20	2,223.30	4,057.60	6,691.20	44,384.30	46,221.20	50,871	45,960	0	0	351.9	361.3	366.5	368.3	1.709	1.732	1.755	1,510	0	0	96	97	97	97	47	63	82.58	93	0	822,345
OpenSearch - 2.2.0	X64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,335.31	3,079.34	5,936.30	10,214.61	31,686.21	33,343.77	37,974.69	46,895	1	0	279.294	287.681	296.732	324.452	1.725	1.739	1.753	1,510	0	0	97	97	97	97	52.667	80.66	65.1	90	0	1,247,685
OpenSearch - 2.2.0	X64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,191.33	2,897.34	5,598.88	9,647.27	34,082.47	35,546.74	40,358.20	46,717	0	0	283.958	291.434	301.78	317.644	1.725	1.74	1.755	1,510	0	0	97	98	98	98	50	83.88	64	87	0	1,045,643
OpenSearch - 2.2.0	ARM64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,883.37	2,479.36	4,604.23	7,402.89	39,028.32	40,765.93	44,511.18	46,419	0	0	342.469	366.734	373.616	380.034	1.693	1.717	1.75	1,510	0	0	96	97	97	97	50	89	64	94	0	974,866
OpenSearch - 2.2.0	ARM64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,706.20	2,266.16	4,083.58	6,656.40	43,532.26	45,223.83	49,498.55	46,049	0	0	414.607	426.393	434.969	444.161	1.667	1.705	1.751	1,510	0	0	96	97	97	97	49	78.78	64	94	0	812,093

[saratvemulapalli]

Thanks @kotwanikunal. Looks like Indexing (P100) is >10% high, Querying on ARM without security >20% . Also memory seems inconsistent (P90 is higher than P99), is that an error in our computation or I am misunderstanding it?
But anyway as @dblock said, we are using up >20% memory (P90) compared to 2.1 which does not look right.

Were there any runs for opensearch-min (I assume all of these tests are for the bundle) ?

[peternied]

memory seems inconsistent P90 is higher than P99

Is it possible those columns are transposed in the table? Those values look like they would swap cleanly and mirror the previous versions memory usage

[kavilla]

AD test run after merged changes.

OSD 4048:

* Security confirm it is a known flaky test, @DarshitChanpura is fixing.

* AD Dashboards: [Adjust ad-dashboard historical page test and fix flaky tests opensearch-dashboards-functional-test#275](https://github.com/opensearch-project/opensearch-dashboards-functional-test/pull/275)

* OBS Dashboards:

     Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  core-opensearch-dashboards/opensear      00:27       34       34        -        -        - │
  │    ch-dashboards/dashboard_sanity_test                                                         │
  │    _spec.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:21        3        3        -        -        - │
  │    acknowledge_alerts_modal_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      02:21        5        5        -        -        - │
  │    alert_spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:23        2        2        -        -        - │
  │    alerts_dashboard_flyout_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:14        3        3        -        -        - │
  │    bucket_level_monitor_spec.js                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:17        6        6        -        -        - │
  │    cluster_metrics_monitor_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:35        7        7        -        -        - │
  │    query_level_monitor_spec.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:17        1        1        -        -        - │
  │    s-plugin/create_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:21        8        8        -        -        - │
  │    s-plugin/dashboard_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        5        5        -        -        - │
  │    s-plugin/detector_configuration_spe                                                         │
  │    c.js                                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:22       11       11        -        -        - │
  │    s-plugin/detector_list_spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      01:10        6        6        -        -        - │
  │    s-plugin/historical_analysis_spec.j                                                         │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:08        4        4        -        -        - │
  │    s-plugin/overview_spec.js                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        2        2        -        -        - │
  │    s-plugin/real_time_results_spec.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:15        3        3        -        -        - │
  │    s-plugin/sample_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/custom-import-map-dashboard      00:22        1        1        -        -        - │
  │    s/import_vector_map_tab.spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/gantt-chart-dashboards/gant      00:50        9        9        -        -        - │
  │    t_ui.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:27        3        3        -        -        - │
  │    -plugin/indices_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      01:15        5        5        -        -        - │
  │    -plugin/managed_indices_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:32        5        5        -        -        - │
  │    -plugin/policies_spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:44        4        4        -        -        - │
  │    -plugin/rollups_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:32        4        4        -        -        - │
  │    -plugin/transforms_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/1_      01:04       11       11        -        -        - │
  │    email_senders_and_groups.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/2_      01:27       13       13        -        -        - │
  │    channels.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/0_      00:08        1        1        -        -        - │
  │    before.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/1_      01:20        8        8        -        -        - │
  │    trace_analytics_dashboard.spec.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/2_      00:49        7        7        -        -        - │
  │    trace_analytics_services.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/3_      00:44        7        7        -        -        - │
  │    trace_analytics_traces.spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/4_      02:26       25       25        -        -        - │
  │    panels.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/5_      05:06       36       36        -        -        - │
  │    event_analytics.spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/6_      05:18       31       31        -        -        - │
  │    notebooks.spec.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  plugins/observability-dashboards/7_      10:01        8        7        1        -        - │
  │    app_analytics.spec.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/8_       75ms        1        1        -        -        - │
  │    after.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/query-workbench-dashboards/      01:23       20       20        -        -        - │
  │    ui.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/01-creat      04:26       14       14        -        -        - │
  │    e.spec.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/02-edit.      01:24        3        3        -        -        - │
  │    spec.js                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/03-detai      02:06        6        6        -        -        - │
  │    ls.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/04-downl      01:16        5        5        -        -        - │
  │    oad.spec.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/audit_log_spec.js       00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/auth_spec.js            00:05        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/get_started_spec.j      00:11        8        8        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/internalusers_spec      00:10        4        4        -        -        - │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/permissions_spec.j      00:16        5        5        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/roles_spec.js           00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/tenants_spec.js         00:08        2        2        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  1 of 45 failed (2%)                      57:40      356      355        1        -        -  

info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

[DarshitChanpura]

AD test run after merged changes.

All security dashboards tests are passing in this run.

[kotwanikunal]

Thanks @kotwanikunal. Looks like Indexing (P100) is >10% high, Querying on ARM without security >20% . Also memory seems inconsistent (P90 is higher than P99), is that an error in our computation or I am misunderstanding it? But anyway as @dblock said, we are using up >20% memory (P90) compared to 2.1 which does not look right.

Were there any runs for opensearch-min (I assume all of these tests are for the bundle) ?

memory seems inconsistent P90 is higher than P99

Is it possible those columns are transposed in the table? Those values look like they would swap cleanly and mirror the previous versions memory usage

@peternied @saratvemulapalli
Interestingly enough, comparing with 2.0 with 2.2 does not show any major deviations.

The differences in memory consumption seem to be introduced in the results here.

Product/ Version	Architecture	Description	Instance Type	Workload Details	Index Latency (ms) p50	Index Latency (ms) p90	Index Latency (ms) p99	Index Latency (ms) p100	Index Throughput (docs/s) p0	Index Throughput (docs/s) p50	Index Throughput (docs/s) p100	Index Throughput (docs/s) Ops Count	Index Operation Counts Op Error Count	Index Operation Counts Error Rate	Query Latency (ms) p50	Query Latency (ms) p90	Query Latency (ms) p99	Query Latency (ms) p100	Query Throughput (docs/s) p0	Query Throughput (docs/s) p50	Query Throughput (docs/s) p100	Query Operation Counts Ops Count	Query Operation Counts Op Error Count	Error Rate****Query** Operation Counts**	CPU (%) p50	CPU (%) p90	CPU (%) p99	CPU (%) p100	Memory (%) p50	Memory (%) p90	Memory (%) p99	Memory (%) p100	GC (ms) Old	GC (ms) Young
OpenSearch - 2.0.0	X64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,329.16	3,078.93	5,928.08	9,996.32	31,648.39	33,180.46	37,658.63	46,930	0	0	321.077	327.537	339.74	346.36	1.727	1.741	1.753	1,510	0	0	97	97	97.633	98	51	86.9	65	94	0	1,238,045
OpenSearch - 2.0.0	X64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,194.72	2,911.85	5,533.73	9,148.97	33,908.51	35,751.85	40,786.57	46,689	0	0	325.573	374.97	383.257	406.041	1.727	1.741	1.756	1,510	0	0	97	98	98	98	49	78.66	64	89	0	1,042,484
OpenSearch - 2.0.0	ARM64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,836.63	2,425.53	4,603.91	7,938.29	39,916.78	41,835.35	46,370.79	46,309	0	0	377.718	388.623	394.611	477.491	1.685	1.711	1.737	1,510	0	0	96	97	97	97	52	81.08	66	94	0	979,516
OpenSearch - 2.0.0	ARM64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,583.90	2,119.10	4,072.69	6,760.69	46,667.65	48,219.27	53,191.03	45,795	0	0	420.445	434.06	439.104	442.699	1.697	1.725	1.754	1,510	0	0	96	97	97	97	50	85.89	63	95	0	816,215
OpenSearch - 2.2.0	X64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,335.31	3,079.34	5,936.30	10,214.61	31,686.21	33,343.77	37,974.69	46,895	1	0	279.294	287.681	296.732	324.452	1.725	1.739	1.753	1,510	0	0	97	97	97	97	52.667	80.66	65.1	90	0	1,247,685
OpenSearch - 2.2.0	X64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,191.33	2,897.34	5,598.88	9,647.27	34,082.47	35,546.74	40,358.20	46,717	0	0	283.958	291.434	301.78	317.644	1.725	1.74	1.755	1,510	0	0	97	98	98	98	50	83.88	64	87	0	1,045,643
OpenSearch - 2.2.0	ARM64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,883.37	2,479.36	4,604.23	7,402.89	39,028.32	40,765.93	44,511.18	46,419	0	0	342.469	366.734	373.616	380.034	1.693	1.717	1.75	1,510	0	0	96	97	97	97	50	89	64	94	0	974,866
OpenSearch - 2.2.0	ARM64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,706.20	2,266.16	4,083.58	6,656.40	43,532.26	45,223.83	49,498.55	46,049	0	0	414.607	426.393	434.969	444.161	1.667	1.705	1.751	1,510	0	0	96	97	97	97	49	78.78	64	94	0	812,093

The tests have been re-run to circumvent any flakiness between runs.

[saratvemulapalli]

@kotwanikunal thats interesting. I am worried we either made improvements in 2.1 and probably loosing them in 2.2 or as @peternied suggested we are misreporting the columns.
I can't wrap my head around to have P90 higher and P99 being lower memory footprint. From what I see both 2.0 and 2.2 have the same format which seems suspicious.

[kavilla]

Integ Test Result

OSD 4049
with-security-4049.txt
osd-with-security-screenshots-4049.zip

Videos of test failures:
7_app_analytics.spec.js.mp4.zip
historical_analysis_spec.js.mp4.zip

Click to expand the test logs here

yarn run v1.22.19
$ yarn cypress:run-with-security --browser electron --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/*.js,cypress/integration/plugins/*/*'
$ env TZ=America/Los_Angeles NO_COLOR=1 cypress run --headless --env SECURITY_ENABLED=true,openSearchUrl=https://localhost:9200 --browser electron --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/*.js,cypress/integration/plugins/*/*'
The experimentalNetworkStubbing configuration option was removed in Cypress version 6.0.0.

It is no longer necessary for using cy.intercept(). You can safely remove this option from your config.

====================================================================================================

  (Run Starting)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Cypress:        9.5.4                                                                          │
  │ Browser:        Electron 94 (headless)                                                         │
  │ Node Version:   v14.20.0 (/home/ubuntu/.nvm/versions/node/v14.20.0/bin/node)                   │
  │ Specs:          45 found (core-opensearch-dashboards/opensearch-dashboards/dashboard_sanity_te │
  │                 st_spec.js, plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.j │
  │                 s, plugins/alerting-dashboards-plugin/alert_spec.js, plugins/alerting-dashboar │
  │                 ds-plugin/alerts_dashbo...)                                                    │
  │ Searched:       cypress/integration/core-opensearch-dashboards/opensearch-dashboards/*.js, cyp │
  │                 ress/integration/plugins/*/*                                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  core-opensearch-dashboards/opensearch-dashboards/dashboard_sanity_te           (1 of 45)
            st_spec.js                                                                              


  dashboard sample data validation
    checking home page
      ✓ checking opensearch_dashboards_overview display
      ✓ checking tutorial_directory display
      ✓ checking management display
      ✓ checking dev_tools display
      ✓ settings display
      ✓ checking feature_directory display
      ✓ checking navigation display
      ✓ checking Help menu display
    adding sample data
      ✓ checking ecommerce dashboards displayed (10914ms)
      ✓ checking flights dashboards displayed
      ✓ checking web logs dashboards displayed
      checking index patterns
        ✓ checking ecommerce index patterns are added
        ✓ checking flights index patterns are added
        ✓ checking web logs index patterns are added
      checking saved objects
        ✓ checking ecommerce object is saved
        ✓ checking flights object is saved
        ✓ checking web logs object is saved
      checking Visualize
        ✓ checking visualizations list display
        ✓ checking search bar display
        ✓ checking create visualization button display
      checking discover
        ✓ checking save query button display
        ✓ checking query input display
        ✓ checking refresh button display
        ✓ checking add filter button display
        ✓ checking index pattern switch button display
        ✓ checking field filter display
    checking Dev Tools
      ✓ checking welcome panel display
      ✓ checking dismiss button display
      ✓ checking console input area display
      ✓ checking console output area display
    checking stack management
      ✓ checking Stack Management display
      ✓ checking index patterns link display
      ✓ checking saved objects link display
      ✓ checking advance settings link display


  34 passing (29s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        34                                                                               │
  │ Passing:      34                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     28 seconds                                                                       │
  │ Spec Ran:     core-opensearch-dashboards/opensearch-dashboards/dashboard_sanity_test_spec.js   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (2 seconds)
                          press/videos/core-opensearch-dashboards/opensearch-dashboar               
                          ds/dashboard_sanity_test_spec.js.mp4                                      


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.js            (2 of 45)


  AcknowledgeAlertsModal
    ✓ Acknowledge button disabled when more than 1 trigger selected (67783ms)
    ✓ Bucket-level monitor modal test (7169ms)
    ✓ Query-level monitor modal test (6309ms)


  3 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 21 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/acknowledge               
                          _alerts_modal_spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/alert_spec.js                               (3 of 45)


  Alerts
    can be in 'Active' state
      ✓ after the monitor starts running (66894ms)
    can be in 'Acknowledged' state
      ✓ by clicking the button in Dashboard
    can be in 'Completed' state
      ✓ when the trigger condition is not met after met once (64648ms)
    can be in 'Error' state
      ✓ by using a wrong destination
    can be in 'Deleted' state
      ✓ by deleting the monitor


  5 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 21 seconds                                                            │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/alert_spec.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (8 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/alert_spec.               
                          js.mp4                                                                    


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/alerts_dashboard_flyout_spec.js             (4 of 45)


  Alerts by trigger flyout
    ✓ Bucket-level monitor flyout test (75124ms)
    ✓ Query-level monitor flyout test (7860ms)


  2 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 23 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/alerts_dashboard_flyout_spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/alerts_dash               
                          board_flyout_spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/bucket_level_monitor_spec.js                (5 of 45)


  Bucket-Level Monitors
    can be created
      ✓ by extraction query (31705ms)
      ✓ by visual editor (27164ms)
    can be updated
      when defined by visual editor
        ✓ by adding trigger (15023ms)


  3 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 14 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/bucket_level_monitor_spec.js                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/bucket_leve               
                          l_monitor_spec.js.mp4                                                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/cluster_metrics_monitor_spec.js             (6 of 45)


  ClusterMetricsMonitor
    can be created
      ✓ for the Cluster Health API (23754ms)
      ✓ for the Nodes Stats API (19904ms)
    displays Query parameters field appropriately
      ✓ for the CAT Snapshots API (7321ms)
    clearTriggersModal renders and behaves as expected
      ✓ when no triggers exist (5503ms)
      ✓ when triggers exist (9222ms)
    can update
      Cluster Health API monitor
        ✓ with a new trigger (11517ms)


  6 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 17 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/cluster_metrics_monitor_spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/cluster_met               
                          rics_monitor_spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/query_level_monitor_spec.js                 (7 of 45)


  Query-Level Monitors
    can be created
      ✓ by extraction query (12421ms)
    can be updated
      ✓ by changing the name (7160ms)
    can be deleted
      ✓ from "Actions" menu
    can be searched
      ✓ by name
    can have triggers
      ✓ with names that contain periods (54941ms)
    schedule component displays as intended
      ✓ for an interval schedule (7197ms)
      ✓ for a cron expression schedule (5583ms)


  7 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 36 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/query_level_monitor_spec.js                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (6 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/query_level               
                          _monitor_spec.js.mp4                                                      


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/create_detector_spec.js            (8 of 45)


  Create detector workflow
    ✓ Full creation - based on real index (16999ms)


  1 passing (17s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     17 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/create_detector_spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/cr               
                          eate_detector_spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/dashboard_spec.js                  (9 of 45)


  AD Dashboard page
    ✓ Empty - no detector index
    ✓ Empty - empty detector index
    ✓ Non-empty - single running detector
    ✓ Redirect to create detector page
    ✓ Filter by detector
    ✓ Filter by detector state
    ✓ Filter by index
    ✓ Enter and exit full screen


  8 passing (21s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     21 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/dashboard_spec.js                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/da               
                          shboard_spec.js.mp4                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/detector_configuration_s          (10 of 45)
            pec.js                                                                                  


  Detector configuration page
    ✓ Redirect to edit detector settings from button (7872ms)
    ✓ Redirect to edit model configuration from button
    ✓ Redirect to edit detector settings from dropdown
    ✓ Redirect to edit model configuration from dropdown
    ✓ Delete detector from dropdown, redirects to detector list page


  5 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/detector_configuration_spec.js       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/de               
                          tector_configuration_spec.js.mp4                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/detector_list_spec.js             (11 of 45)


  Detector list page
    ✓ Empty - no detector index
    ✓ Empty - empty detector index
    ✓ Non-empty - single stopped detector
    ✓ Non-empty - multiple detectors
    ✓ Redirect to create detector
    ✓ Start single detector
    ✓ Stop single detector
    ✓ Delete single detector
    ✓ Filter by detector search
    ✓ Filter by detector state
    ✓ Filter by index


  11 passing (23s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        11                                                                               │
  │ Passing:      11                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     22 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/detector_list_spec.js                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/de               
                          tector_list_spec.js.mp4                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/historical_analysis_spec          (12 of 45)
            .js                                                                                     


  Historical results page
    Sample detector
      ✓ Empty message with modal (7097ms)
      ✓ Start first historical analysis
      ✓ Produces anomaly results by default (15558ms)
      ✓ Filtering by date range (11849ms)
      1) Aggregations render anomalies
      ✓ Run subsequent historical analysis (16052ms)


  5 passing (2m)
  1 failing

  1) Historical results page
       Sample detector
         Aggregations render anomalies:
     CypressError: Timed out retrying after 60050ms: `cy.click()` failed because this element:

`<label class="euiButtonGroupButton euiButtonGroupButton--text euiButtonGroupButton--small" for="i92b7b861-1908-11ed-a7e5-b1792f060f66">...</label>`

is being covered by another element:

`<select class="euiSelect euiSelect--compressed" aria-label="Time unit" aria-describedby="ia36e48e1-1908-11ed-a7e5-b1792f060f66 ia36e48e2-1908-11ed-a7e5-b1792f060f66">...</select>`

Fix this problem, or use {force: true} to disable error checking.

https://on.cypress.io/element-cannot-be-interacted-with
      at $Cy.ensureDescendents (http://localhost:5601/__cypress/runner/cypress_runner.js:164076:78)
      at ensureDescendents (http://localhost:5601/__cypress/runner/cypress_runner.js:150263:8)
      at ensureDescendentsAndScroll (http://localhost:5601/__cypress/runner/cypress_runner.js:150270:14)
      at ensureElIsNotCovered (http://localhost:5601/__cypress/runner/cypress_runner.js:150402:5)
      at runAllChecks (http://localhost:5601/__cypress/runner/cypress_runner.js:150592:52)
      at retryActionability (http://localhost:5601/__cypress/runner/cypress_runner.js:150616:16)
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Function.Promise.attempt.Promise.try (http://localhost:5601/__cypress/runner/cypress_runner.js:10296:29)
      at whenStable (http://localhost:5601/__cypress/runner/cypress_runner.js:168808:63)
      at http://localhost:5601/__cypress/runner/cypress_runner.js:168305:14
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Promise._settlePromiseFromHandler (http://localhost:5601/__cypress/runner/cypress_runner.js:10957:31)
      at Promise._settlePromise (http://localhost:5601/__cypress/runner/cypress_runner.js:11014:18)
      at Promise._settlePromise0 (http://localhost:5601/__cypress/runner/cypress_runner.js:11059:10)
      at Promise._settlePromises (http://localhost:5601/__cypress/runner/cypress_runner.js:11139:18)
      at Promise._fulfill (http://localhost:5601/__cypress/runner/cypress_runner.js:11083:18)
  From Your Spec Code:
      at Context.eval (http://localhost:5601/__cypress/tests?p=cypress/integration/plugins/anomaly-detection-dashboards-plugin/historical_analysis_spec.js:230:32)




  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  1                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 55 seconds                                                             │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/historical_analysis_spec.js          │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Screenshots)

  -  /home/ubuntu/repos/opensearch-dashboards-functional-test/cypress/screenshots/plu     (1280x720)
     gins/anomaly-detection-dashboards-plugin/historical_analysis_spec.js/Historical                
     results page -- Sample detector -- Aggregations render anomalies (failed).png                  


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (7 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/hi               
                          storical_analysis_spec.js.mp4                                             


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/overview_spec.js                  (13 of 45)


  Overview page
    ✓ Side nav AD button redirects to overview page
    Flyouts open and close
      ✓ HTTP responses sample detector
      ✓ eCommerce sample detector
      ✓ Host health sample detector


  4 passing (9s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/overview_spec.js                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/ov               
                          erview_spec.js.mp4                                                        


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/real_time_results_spec.j          (14 of 45)
            s                                                                                       


  Real-time results page
    Sample detector
      ✓ Renders no anomalies (7384ms)
      ✓ Enter and exit full screen


  2 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/real_time_results_spec.js            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/re               
                          al_time_results_spec.js.mp4                                               


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/sample_detector_spec.js           (15 of 45)


  Sample detectors
    ✓ HTTP response sample detector - create and delete (7254ms)
    ✓ eCommerce sample detector - create and delete
    ✓ Host health sample detector - create and delete


  3 passing (16s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     15 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/sample_detector_spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/sa               
                          mple_detector_spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/custom-import-map-dashboards/import_vector_map_tab.spec.js            (16 of 45)


  Verify the presence of import custom map tab in region map plugin
    ✓ checks import custom map tab is present (20994ms)


  1 passing (23s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     23 seconds                                                                       │
  │ Spec Ran:     plugins/custom-import-map-dashboards/import_vector_map_tab.spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/custom-import-map-dashboards/import_ve               
                          ctor_map_tab.spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/gantt-chart-dashboards/gantt_ui.spec.js                               (17 of 45)


  Dump test data
    ✓ Indexes test data for gantt chart

  Save a gantt chart
    ✓ Creates and saves a gantt chart (11338ms)

  Render and configure a gantt chart
    ✓ Renders no data message (5068ms)
    ✓ Renders the chart (5227ms)

  Configure panel settings
    ✓ Changes y-axis label (5540ms)
    ✓ Changes x-axis label (5704ms)
    ✓ Changes time formats (9378ms)
    ✓ Hides legends (5273ms)

  Add gantt chart to dashboard
    ✓ Adds gantt chart to dashboard


  9 passing (52s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     51 seconds                                                                       │
  │ Spec Ran:     plugins/gantt-chart-dashboards/gantt_ui.spec.js                                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/gantt-chart-dashboards/gantt_ui.spec.j               
                          s.mp4                                                                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/indices_spec.js                    (18 of 45)


  Indices
    can be searched
      ✓ successfully (8072ms)
    can show data stream indices
      ✓ successfully (8617ms)
    can have policies applied
      ✓ successfully (9994ms)


  3 passing (27s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     26 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/indices_spec.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/index-management-dashboards-plugin/ind               
                          ices_spec.js.mp4                                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/managed_indices_spec.js            (19 of 45)


  Managed indices
    can have policies removed
      ✓ successfully (13834ms)
    can have policies retried
      ✓ successfully (31596ms)
    can edit rollover_alias
      ✓ successfully (5688ms)
    can change policies
      ✓ successfully (17134ms)
    can manage data stream indices
      ✓ successfully (8061ms)


  5 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 16 seconds                                                             │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/managed_indices_spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/man               
                          aged_indices_spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/policies_spec.js                   (20 of 45)


  Policies
    can be created
      ✓ successfully (10779ms)
    can be edited
      ✓ successfully (9187ms)
    can be deleted
      ✓ successfully (5137ms)
    can be searched
      ✓ successfully
    can be viewed
      ✓ successfully


  5 passing (33s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     33 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/policies_spec.js                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (2 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/pol               
                          icies_spec.js.mp4                                                         


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/rollups_spec.js                    (21 of 45)


  Rollups
    can be created
      ✓ successfully (18105ms)
    can be edited
      ✓ successfully (9682ms)
    can be deleted
      ✓ successfully (9116ms)
    can be enabled and disabled
      ✓ successfully (8836ms)


  4 passing (46s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     45 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/rollups_spec.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/rol               
                          lups_spec.js.mp4                                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/transforms_spec.js                 (22 of 45)


  Transforms
    can be created
      ✓ successfully (13519ms)
    can be edited
      ✓ successfully (5985ms)
    can be deleted
      ✓ successfully (5649ms)
    can be enabled and disabled
      ✓ successfully (6860ms)


  4 passing (32s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     32 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/transforms_spec.js                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (2 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/tra               
                          nsforms_spec.js.mp4                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/notifications-dashboards/1_email_senders_and_groups.spec.js           (23 of 45)


  Test create email senders
    ✓ creates ssl sender (5281ms)
    ✓ creates tls sender (8498ms)
    ✓ creates SES sender (5362ms)

  Test edit senders
    ✓ edits sender email address (5039ms)
    ✓ edits ses sender region

  Test delete senders
    ✓ deletes smtp senders
    ✓ deletes ses senders (6264ms)

  Test create, edit and delete recipient group
    ✓ creates recipient group (9738ms)
    ✓ edits recipient group description
    ✓ opens email addresses popup
    ✓ deletes recipient groups (6126ms)


  11 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        11                                                                               │
  │ Passing:      11                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 4 seconds                                                              │
  │ Spec Ran:     plugins/notifications-dashboards/1_email_senders_and_groups.spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/notifications-dashboards/1_email_sende               
                          rs_and_groups.spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/notifications-dashboards/2_channels.spec.js                           (24 of 45)


  Test create channels
    ✓ creates a slack channel and send test message (7008ms)
    ✓ creates a chime channel (7493ms)
    ✓ creates a email channel (9780ms)
    ✓ creates a email channel with ses sender (10994ms)
    ✓ creates a webhook channel (8148ms)
    ✓ creates a sns channel (7529ms)

  Test channels table
    ✓ displays channels
    ✓ mutes channels (7084ms)
    ✓ filters channels (6769ms)

  Test channel details
    ✓ displays channel details
    ✓ mutes and unmutes channels
    ✓ edits channels (5186ms)
    ✓ deletes channels (5028ms)


  13 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        13                                                                               │
  │ Passing:      13                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 26 seconds                                                             │
  │ Spec Ran:     plugins/notifications-dashboards/2_channels.spec.js                              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/notifications-dashboards/2_channels.sp               
                          ec.js.mp4                                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/0_before.spec.js                             (25 of 45)


  Before
    ✓ setup completed (8752ms)


  1 passing (9s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     8 seconds                                                                        │
  │ Spec Ran:     plugins/observability-dashboards/0_before.spec.js                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/observability-dashboards/0_before.spec               
                          .js.mp4                                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/1_trace_analytics_dashboard.spec.js          (26 of 45)


  Testing dashboard table empty state
    ✓ Renders empty state (5166ms)

  Testing dashboard table
    ✓ Renders the dashboard table (6897ms)
    ✓ Has working breadcrumbs (11280ms)
    ✓ Adds the percentile filters (14545ms)
    ✓ Opens latency trend popover (16391ms)
    ✓ Redirects to traces table with filter (11873ms)

  Testing plots
    ✓ Renders service map (7615ms)
    ✓ Renders plots (5697ms)


  8 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 19 seconds                                                             │
  │ Spec Ran:     plugins/observability-dashboards/1_trace_analytics_dashboard.spec.js             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/observability-dashboards/1_trace_analy               
                          tics_dashboard.spec.js.mp4                                                


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/2_trace_analytics_services.spec.js           (27 of 45)


  Testing services table empty state
    ✓ Renders empty state (5169ms)

  Testing services table
    ✓ Renders the services table (6647ms)
    ✓ Searches correctly (9292ms)

  Testing service view empty state
    ✓ Renders service view empty state

  Testing service view
    ✓ Renders service view (5743ms)
    ✓ Has working breadcrumbs (11488ms)
    ✓ Renders spans data grid, flyout, filters (9069ms)


  7 passing (50s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     49 seconds                                                                       │
  │ Spec Ran:     plugins/observability-dashboards/2_trace_analytics_services.spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/observability-dashboards/2_trace_analy               
                          tics_services.spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/3_trace_analytics_traces.spec.js             (28 of 45)


  Testing traces table empty state
    ✓ Renders empty state (5164ms)

  Testing traces table
    ✓ Renders the traces table (6994ms)
    ✓ Sorts the traces table (5123ms)
    ✓ Searches correctly (6252ms)

  Testing trace view
    ✓ Renders the trace view
    ✓ Has working breadcrumbs (8574ms)
    ✓ Renders data grid, flyout and filters (8092ms)


  7 passing (45s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     44 seconds                                                                       │
  │ Spec Ran:     plugins/observability-dashboards/3_trace_analytics_traces.spec.js                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/observability-dashboards/3_trace_analy               
                          tics_traces.spec.js.mp4                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/4_panels.spec.js                             (29 of 45)


  Creating visualizations
    ✓ Create first visualization in event analytics (12623ms)
    ✓ Create second visualization in event analytics (11817ms)

  Testing panels table
    ✓ Displays error toast for invalid panel name
    ✓ Creates a panel and redirects to the panel
    ✓ Duplicates and renames a panel
    ✓ Searches existing panel
    ✓ Deletes panels

  Testing a panel
    ✓ Move to test panel
    ✓ Opens visualization flyout from empty panel
    ✓ Redirects to correct page on breadcrumb click
    ✓ Duplicate the open panel
    ✓ Rename the open panel
    ✓ Change date filter of the panel
    ✓ Add existing visualization #1 (9035ms)
    ✓ Add existing visualization #2
    ✓ Add ppl filter to panel (36803ms)
    ✓ Drag and drop a visualization
    ✓ Resize a visualization
    ✓ Delete a visualization
    ✓ Duplicate a visualization
    ✓ Replace a visualization
    ✓ Create new visualization and add to panel (16095ms)
    ✓ Move to test panel and check visualization edit button (13219ms)

  Clean up all test data
    ✓ Delete visualizations from event analytics
    ✓ Deletes test panel


  25 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        25                                                                               │
  │ Passing:      25                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 26 seconds                                                            │
  │ Spec Ran:     plugins/observability-dashboards/4_panels.spec.js                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (9 seconds)
                          press/videos/plugins/observability-dashboards/4_panels.spec               
                          .js.mp4                                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/5_event_analytics.spec.js                    (30 of 45)


  Has working breadcrumbs
    ✓ Redirect to correct page on breadcrumb click (12506ms)

  Search a query on event home
    ✓ Search a query and redirect to explorer to display query output

  Open flyout for a data row to see details
    ✓ Should be able to open flyout and see data, json and traces (7827ms)
    ✓ Should be able to see srrounding docs (7224ms)

  Add/delete/switch explorer top level tabs
    ✓ Add a new tab
    ✓ Click to switch to anther tab
    ✓ Close a tab
    ✓ Close current selected tab
    ✓ Close another unselected tab

  Load a saved query from event home
    ✓ Click on a saved query and redirect to explorer (13380ms)

  Click actions
    ✓ Actions - click event explorer
    ✓ Actions - add sample data (7946ms)
    ✓ Actions - delete saved queries

  Saves a query on explorer page
    ✓ Saves a query on event tab of explorer page (14348ms)
    ✓ Saves a visualization on visualization tab of explorer page (15932ms)
    ✓ Saves a visualization to an existing panel (18154ms)

  Override timestamp for an index
    ✓ Click override button to override default timestamp

  Toggle sidebar fields
    ✓ Toggle fields between available and selected section (6949ms)

  Search fields in sidebar
    ✓ Search a field (6457ms)

  Delete saved objects
    ✓ Delete visualizations/querys from event analytics (13442ms)

  Click to view field insights
    ✓ Click a numerical field to view field insights (5249ms)
    ✓ Click a non-numerical field to view insights (5216ms)

  Switch on and off livetail
    ✓ Switch on and off in live tail (11033ms)

  Live tail stop automatically
    ✓ Moving to other tab should stop live tail automatically (7656ms)
    ✓ Add a new tab
    ✓ Click to switch to another tab
    ✓ Close current selected tab
    ✓ Live tail should be stopped

  Renders noresult chart
    ✓ It should render no result when there is no data

  Renders bar charts
    ✓ Renders vertical bar chart (22622ms)
    ✓ Renders horiztontal bar chart (24924ms)

  Renders line charts
    ✓ Renders line chart with threshold (15404ms)

  Renders pie charts
    ✓ Renders pie chart (8975ms)

  Renders heatmap chart
    ✓ Renders heatmap chart with different z-axes (20967ms)

  Renders markdown chart
    ✓ Renders markdown chart with test title (14854ms)

  Renders data view
    ✓ Switch views between data table and visualization workspace (7322ms)


  36 passing (5m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        36                                                                               │
  │ Passing:      36                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     5 minutes, 6 seconds                                                             │
  │ Spec Ran:     plugins/observability-dashboards/5_event_analytics.spec.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  54%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (18 seconds)
                          press/videos/plugins/observability-dashboards/5_event_analy               
                          tics.spec.js.mp4                                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/6_notebooks.spec.js                          (31 of 45)


  Adding sample visualization
    ✓ Add sample observability data (6035ms)

  Testing notebooks table
    ✓ Displays error toast for invalid notebook name (5295ms)
    ✓ Creates a notebook and redirects to the notebook
    ✓ Duplicates and renames a notebook (16137ms)
    ✓ Searches existing notebooks (7549ms)
    ✓ Deletes notebooks (11858ms)

  Test reporting integration if plugin installed
    ✓ Create in-context PDF report from notebook (8018ms)
    ✓ Create in-context PNG report from notebook (8134ms)
    ✓ Create on-demand report definition from context menu (11651ms)
    ✓ View reports homepage from context menu (9189ms)

  Testing paragraphs
    ✓ Goes into a notebook and creates paragraphs (13563ms)
    ✓ Has working breadcrumbs (7060ms)
    ✓ Renders markdown
    ✓ Shows output message (6572ms)
    ✓ Renders input only mode
    ✓ Renders output only mode
    ✓ Duplicates paragraphs (6460ms)
    ✓ Adds a dashboards visualization paragraph (14634ms)
    ✓ Adds a SQL query paragraph (15884ms)
    ✓ Adds an observability visualization paragraph (16867ms)
    ✓ Adds a PPL query paragraph (18005ms)
    ✓ Clears outputs (12289ms)
    ✓ Runs all paragraphs (9709ms)
    ✓ Adds paragraph to top and bottom (18086ms)
    ✓ Moves paragraphs (6902ms)
    ✓ Duplicates and renames the notebook (21795ms)
    ✓ Deletes paragraphs (11319ms)
    ✓ Deletes notebook (10281ms)
    ✓ Cleans up test notebooks (10282ms)

  clean up all test data
    ✓ Delete visualizations from event analytics (12415ms)
    ✓ Deletes test panel (10092ms)


  31 passing (5m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        31                                                                               │
  │ Passing:      31                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     5 minutes, 20 seconds                                                            │
  │ Spec Ran:     plugins/observability-dashboards/6_notebooks.spec.js                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  52%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (19 seconds)
                          press/videos/plugins/observability-dashboards/6_notebooks.s               
                          pec.js.mp4                                                                


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/7_app_analytics.spec.js                      (32 of 45)


  Creating application
    ✓ Creates an application and redirects to application (95278ms)

  Viewing application
    ✓ Saves visualization #1 to panel (134312ms)
    ✓ Adds availability level to visualization #1 (17459ms)
    ✓ Saves visualization #2 to panel with availability level (150235ms)
    ✓ Changes availability visualization (78170ms)

  Editing application
    ✓ Redirects to application after saving changes (64883ms)

  Application Analytics home page
    1) Renames application
    ✓ Deletes application (5712ms)


  7 passing (10m)
  1 failing

  1) Application Analytics home page
       Renames application:
     CypressError: Timed out retrying after 60050ms: `cy.click()` failed because this element is `disabled`:

`<button disabled="" class="euiContextMenuItem euiContextMenuItem-isDisabled" type="button" data-test-subj="renameApplicationContextMenuItem">...</button>`

Fix this problem, or use `{force: true}` to disable error checking.

https://on.cypress.io/element-cannot-be-interacted-with
      at $Cy.ensureNotDisabled (http://localhost:5601/__cypress/runner/cypress_runner.js:163868:76)
      at runAllChecks (http://localhost:5601/__cypress/runner/cypress_runner.js:150539:14)
      at retryActionability (http://localhost:5601/__cypress/runner/cypress_runner.js:150616:16)
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Function.Promise.attempt.Promise.try (http://localhost:5601/__cypress/runner/cypress_runner.js:10296:29)
      at whenStable (http://localhost:5601/__cypress/runner/cypress_runner.js:168808:63)
      at http://localhost:5601/__cypress/runner/cypress_runner.js:168305:14
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Promise._settlePromiseFromHandler (http://localhost:5601/__cypress/runner/cypress_runner.js:10957:31)
      at Promise._settlePromise (http://localhost:5601/__cypress/runner/cypress_runner.js:11014:18)
      at Promise._settlePromise0 (http://localhost:5601/__cypress/runner/cypress_runner.js:11059:10)
      at Promise._settlePromises (http://localhost:5601/__cypress/runner/cypress_runner.js:11139:18)
      at Promise._fulfill (http://localhost:5601/__cypress/runner/cypress_runner.js:11083:18)
      at http://localhost:5601/__cypress/runner/cypress_runner.js:12697:46
  From Your Spec Code:
      at Context.eval (http://localhost:5601/__cypress/tests?p=cypress/integration/plugins/observability-dashboards/7_app_analytics.spec.js:492:8)




  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  1                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     10 minutes, 11 seconds                                                           │
  │ Spec Ran:     plugins/observability-dashboards/7_app_analytics.spec.js                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Screenshots)

  -  /home/ubuntu/repos/opensearch-dashboards-functional-test/cypress/screenshots/plu     (1280x720)
     gins/observability-dashboards/7_app_analytics.spec.js/Application Analytics home               
      page -- Renames application (failed).png                                                      


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  27%
    Compression progress:  52%
    Compression progress:  79%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (38 seconds)
                          press/videos/plugins/observability-dashboards/7_app_analyti               
                          cs.spec.js.mp4                                                            


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/8_after.spec.js                              (33 of 45)


  After
    ✓ clean up complete


  1 passing (74ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     plugins/observability-dashboards/8_after.spec.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/observability-dashboards/8_after.spec.               
                          js.mp4                                                                    


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/query-workbench-dashboards/ui.spec.js                                 (34 of 45)


  Dump test data
    ✓ Indexes test data for SQL and PPL

  Test PPL UI
    ✓ Confirm results are empty
    ✓ Test Run button (5122ms)
    ✓ Test Clear button (6804ms)
    ✓ Test full screen view (5954ms)

  Test SQL UI
    ✓ Confirm results are empty
    ✓ Test Run button and field search (5538ms)
    ✓ Test Translate button (6318ms)
    ✓ Test Clear button
    ✓ Test full screen view

  Test and verify SQL downloads
    ✓ Download and verify JSON
    ✓ Download and verify JDBC
    ✓ Download and verify CSV
    ✓ Download and verify Text

  Test table display
    ✓ Test GROUP BY (6039ms)
    ✓ Test GROUP BY with aliases and scalar function (6175ms)
    ✓ Test GROUP BY and HAVING (6458ms)
    ✓ Test ORDER BY (6273ms)
    ✓ Test JOIN (7264ms)
    ✓ Test nested fields display (7121ms)


  20 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        20                                                                               │
  │ Passing:      20                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 23 seconds                                                             │
  │ Spec Ran:     plugins/query-workbench-dashboards/ui.spec.js                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/query-workbench-dashboards/ui.spec.js.               
                          mp4                                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/01-create.spec.js                                  (35 of 45)


  Cypress
    ✓ Visits Reporting homepage (50726ms)
    ✓ Visit Create page
    ✓ Create a new on-demand dashboard report definition (9414ms)
    ✓ Create a new on-demand visualization report definition (9037ms)
    ✓ Create a new on-demand saved search report definition (9108ms)
    ✓ Create a new dashboard daily recurring report definition (10190ms)
    ✓ Create a new visualization daily recurring report definition (9818ms)
    ✓ Create a new saved search daily recurring report definition (7836ms)
    ✓ Create a new dashboard interval recurring report definition (25228ms)
    ✓ Create a new visualization interval recurring report definition (27437ms)
    ✓ Create a new saved search interval recurring report definition (27660ms)
    ✓ Create a dashboard cron-based report definition (25368ms)
    ✓ Create a visualization cron-based report definition (24582ms)
    ✓ Create a saved search cron-based report definition (25169ms)


  14 passing (4m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        14                                                                               │
  │ Passing:      14                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     4 minutes, 26 seconds                                                            │
  │ Spec Ran:     plugins/reports-dashboards/01-create.spec.js                                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  64%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (17 seconds)
                          press/videos/plugins/reports-dashboards/01-create.spec.js.m               
                          p4                                                                        


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/02-edit.spec.js                                    (36 of 45)


  Cypress
    ✓ Visit edit page, update name and description (31247ms)
    ✓ Visit edit page, change report trigger (26735ms)
    ✓ Visit edit page, change report trigger back (26693ms)


  3 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 24 seconds                                                             │
  │ Spec Ran:     plugins/reports-dashboards/02-edit.spec.js                                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/reports-dashboards/02-edit.spec.js.mp4               


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/03-details.spec.js                                 (37 of 45)


  Cypress
    ✓ Visit report definition details page (33183ms)
    ✓ Go to edit report definition from report definition details (16716ms)
    ✓ Verify report source URL on report definition details (31264ms)
    ✓ Delete report definition from details page (7227ms)
    ✓ Visit report details page (6407ms)
    ✓ Verify report source URL on report details (31057ms)


  6 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 5 seconds                                                             │
  │ Spec Ran:     plugins/reports-dashboards/03-details.spec.js                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (7 seconds)
                          press/videos/plugins/reports-dashboards/03-details.spec.js.               
                          mp4                                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/04-download.spec.js                                (38 of 45)


  Cypress
    ✓ Download from reporting homepage (12957ms)
    ✓ Download pdf from in-context menu (5469ms)
    ✓ Download png from in-context menu (5610ms)
    ✓ Download csv from saved search in-context menu (10567ms)
    ✓ Download from Report definition details page (30467ms)


  5 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 16 seconds                                                             │
  │ Spec Ran:     plugins/reports-dashboards/04-download.spec.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/reports-dashboards/04-download.spec.js               
                          .mp4                                                                      


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/audit_log_spec.js                                            (39 of 45)


  Audit logs page
    ✓ should load Audit logs page properly
    ✓ should toggle enable-disable switch for audit logging
    ✓ should configure general settings successfully
    ✓ should configure compliance settings successfully


  4 passing (9s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/security/audit_log_spec.js                                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/audit_log_spec.js.mp4                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/auth_spec.js                                                 (40 of 45)


  Authc and Authz page
    ✓ authentication and authorization section should exist
    ✓ View Expression Modal should display and close correctly


  2 passing (6s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     5 seconds                                                                        │
  │ Spec Ran:     plugins/security/auth_spec.js                                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/auth_spec.js.mp4                            


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/get_started_spec.js                                          (41 of 45)


  Home(Get Started) page
    ✓ should load Home page properly
    ✓ should redirect to Auth page
    ✓ should redirect to view Roles page
    ✓ should redirect to create Roles page
    ✓ should redirect to view Users page
    ✓ should redirect to create Users page
    ✓ should redirect to Audit Logging page
    ✓ should purge Cache successfully


  8 passing (11s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     11 seconds                                                                       │
  │ Spec Ran:     plugins/security/get_started_spec.js                                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/get_started_spec.js.mp4                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/internalusers_spec.js                                        (42 of 45)


  Internal users page
    ✓ should load internal users page properly
    ✓ should view user edit page when a user is clicked
    ✓ should redirect to create new users page
    ✓ should create new user successfully


  4 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     10 seconds                                                                       │
  │ Spec Ran:     plugins/security/internalusers_spec.js                                           │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/internalusers_spec.js.mp4                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/permissions_spec.js                                          (43 of 45)


  Permissions page
    ✓ should load Permissions page properly
    ✓ should expand an action-group when it is clicked
    ✓ should open modal with options to create new action group page
    ✓ should create new action group successfully by selecting `Create from blank`
    ✓ should create new action group successfully by selecting `Create from selection` (5371ms)


  5 passing (16s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     15 seconds                                                                       │
  │ Spec Ran:     plugins/security/permissions_spec.js                                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/security/permissions_spec.js.mp4                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/roles_spec.js                                                (44 of 45)


  Roles page
    ✓ should load Roles page properly
    ✓ should open Cluster Permissions drop-down menu when clicked
    ✓ should redirect to create new role page
    ✓ should create new role successfully


  4 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/security/roles_spec.js                                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/roles_spec.js.mp4                           


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/tenants_spec.js                                              (45 of 45)


  Tenants page
    ✓ should load Tenants page properly
    ✓ should create new tenant successfully by selecting `Create tenant`


  2 passing (8s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     8 seconds                                                                        │
  │ Spec Ran:     plugins/security/tenants_spec.js                                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/tenants_spec.js.mp4                         


====================================================================================================

  (Run Finished)


       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  core-opensearch-dashboards/opensear      00:28       34       34        -        -        - │
  │    ch-dashboards/dashboard_sanity_test                                                         │
  │    _spec.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:21        3        3        -        -        - │
  │    acknowledge_alerts_modal_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      02:21        5        5        -        -        - │
  │    alert_spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:23        2        2        -        -        - │
  │    alerts_dashboard_flyout_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:14        3        3        -        -        - │
  │    bucket_level_monitor_spec.js                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:17        6        6        -        -        - │
  │    cluster_metrics_monitor_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:36        7        7        -        -        - │
  │    query_level_monitor_spec.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:17        1        1        -        -        - │
  │    s-plugin/create_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:21        8        8        -        -        - │
  │    s-plugin/dashboard_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        5        5        -        -        - │
  │    s-plugin/detector_configuration_spe                                                         │
  │    c.js                                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:22       11       11        -        -        - │
  │    s-plugin/detector_list_spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  plugins/anomaly-detection-dashboard      01:55        6        5        1        -        - │
  │    s-plugin/historical_analysis_spec.j                                                         │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        4        4        -        -        - │
  │    s-plugin/overview_spec.js                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        2        2        -        -        - │
  │    s-plugin/real_time_results_spec.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:15        3        3        -        -        - │
  │    s-plugin/sample_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/custom-import-map-dashboard      00:23        1        1        -        -        - │
  │    s/import_vector_map_tab.spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/gantt-chart-dashboards/gant      00:51        9        9        -        -        - │
  │    t_ui.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:26        3        3        -        -        - │
  │    -plugin/indices_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      01:16        5        5        -        -        - │
  │    -plugin/managed_indices_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:33        5        5        -        -        - │
  │    -plugin/policies_spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:45        4        4        -        -        - │
  │    -plugin/rollups_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:32        4        4        -        -        - │
  │    -plugin/transforms_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/1_      01:04       11       11        -        -        - │
  │    email_senders_and_groups.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/2_      01:26       13       13        -        -        - │
  │    channels.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/0_      00:08        1        1        -        -        - │
  │    before.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/1_      01:19        8        8        -        -        - │
  │    trace_analytics_dashboard.spec.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/2_      00:49        7        7        -        -        - │
  │    trace_analytics_services.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/3_      00:44        7        7        -        -        - │
  │    trace_analytics_traces.spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/4_      02:26       25       25        -        -        - │
  │    panels.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/5_      05:06       36       36        -        -        - │
  │    event_analytics.spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/6_      05:20       31       31        -        -        - │
  │    notebooks.spec.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  plugins/observability-dashboards/7_      10:11        8        7        1        -        - │
  │    app_analytics.spec.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/8_       76ms        1        1        -        -        - │
  │    after.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/query-workbench-dashboards/      01:23       20       20        -        -        - │
  │    ui.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/01-creat      04:26       14       14        -        -        - │
  │    e.spec.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/02-edit.      01:24        3        3        -        -        - │
  │    spec.js                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/03-detai      02:05        6        6        -        -        - │
  │    ls.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/04-downl      01:16        5        5        -        -        - │
  │    oad.spec.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/audit_log_spec.js       00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/auth_spec.js            00:05        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/get_started_spec.j      00:11        8        8        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/internalusers_spec      00:10        4        4        -        -        - │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/permissions_spec.j      00:15        5        5        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/roles_spec.js           00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/tenants_spec.js         00:08        2        2        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  2 of 45 failed (4%)                      58:39      356      354        2        -        -  

info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

[kotwanikunal]

Performance Test re-run results -

The previous arm64 without security seemed to be an outlier which was rectified by the re-run.

Product/ Version	Architecture	Description	Instance Type	Workload Details	Index Latency (ms) p50	Index Latency (ms) p90	Index Latency (ms) p99	Index Latency (ms) p100	Index Throughput (docs/s) p0	Index Throughput (docs/s) p50	Index Throughput (docs/s) p100	Index Throughput (docs/s) Ops Count	Index Operation Counts Op Error Count	Index Operation Counts Error Rate	Query Latency (ms) p50	Query Latency (ms) p90	Query Latency (ms) p99	Query Latency (ms) p100	Query Throughput (docs/s) p0	Query Throughput (docs/s) p50	Query Throughput (docs/s) p100	Query Operation Counts Ops Count	Query Operation Counts Op Error Count	Error Rate****Query** Operation Counts**	CPU (%) p50	CPU (%) p90	CPU (%) p99	CPU (%) p100	Memory (%) p50	Memory (%) p90	Memory (%) p99	Memory (%) p100	GC (ms) Old	GC (ms) Young
OpenSearch - 2.1.0	X64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,324.80	3,073.90	6,064.20	10,016.10	31,888.40	33,275.90	37,798.70	46,905	0	0	289.6	303.7	313.7	330.4	1.73	1.741	1.754	1,510	0	0	97	97	97	98	51.333	65	82.61	92	0	1,245,816
OpenSearch - 2.1.0	X64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,193.60	2,908.70	5,561.70	8,586	33,935.30	35,489.10	40,399.60	46,728	0	0	279.8	288.1	301.2	309.8	1.727	1.742	1.756	1,510	0	0	97	98	98	98	49	62	86.36	94	0	1,041,064
OpenSearch - 2.1.0	ARM64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,916	2,524.20	4,626.10	6,358.80	38,446.80	40,096.30	43,909.90	46,468	0	0	363.8	372.5	379.1	385.6	1.686	1.707	1.754	1,510	0	0	96	97	97	97	50.333	65	81	90	0	917,896
OpenSearch - 2.1.0	ARM64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,668.20	2,223.30	4,057.60	6,691.20	44,384.30	46,221.20	50,871	45,960	0	0	351.9	361.3	366.5	368.3	1.709	1.732	1.755	1,510	0	0	96	97	97	97	47	63	82.58	93	0	822,345
OpenSearch - 2.2.0	X64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,211.27	2,890.46	5,633.01	8,836.61	33,197.68	35,075.64	39,594.34	46,783	0	0	282.267	288.9	297.585	309.173	1.727	1.74	1.753	1,510	0	0	97	97	97.532	98	54	88	66	94	0	1,237,246
OpenSearch - 2.2.0	X64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	2,186.68	2,900.06	5,635.71	9,135.63	33,752.51	35,539.30	40,463.50	46,719	0	0	277.991	284.457	294.579	308.001	1.727	1.742	1.756	1,510	0	0	97	98	98	98	49	87.87	65	92	0	1,048,250
OpenSearch - 2.2.0	ARM64	With Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,906.08	2,518.58	4,694.59	6,648.64	38,407.62	39,954.75	43,516.45	46,487	0	0	381.273	393.433	396.973	475.763	1.693	1.716	1.747	1,510	0	0	96	97	97	97	52	81.82	66	90	0	977,237
OpenSearch - 2.2.0	ARM64	Without Security	m5.xlarge	nyc_taxis/ 2 warmupIterations/ 3 testIterations	1,623.33	2,178.12	4,071.57	5,921.38	44,770.95	46,766.53	51,702.92	45,894	0	0	362.253	372.819	380.157	384.054	1.686	1.71	1.754	1,510	0	0	96	97	97	97	50	85.79	64	91	0	830,052

[bbarani]

./opensearch-plugin install repository-s3
warning: ignoring JAVA_TOOL_OPTIONS=-Dlog4j2.formatMsgNoLookups=true
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%   
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

[peterzhuamazon]

RPM YUM verification:

opensearch.x86_64                                                                                                                                          2.0.0-1                                                                                                                                           opensearch-2.x
opensearch.x86_64                                                                                                                                          2.0.1-1                                                                                                                                           opensearch-2.x
opensearch.x86_64                                                                                                                                          2.1.0-1                                                                                                                                           opensearch-2.x
opensearch.x86_64                                                                                                                                          2.2.0-1                                                                                                                                           opensearch-2.x

opensearch-dashboards.x86_64                                                                                                                               2.0.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.x86_64                                                                                                                               2.0.1-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.x86_64                                                                                                                               2.1.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.x86_64                                                                                                                               2.2.0-1                                                                                                                                opensearch-dashboards-2.x

opensearch.aarch64                                                                                                                                          2.0.0-1                                                                                                                                           opensearch-2.x
opensearch.aarch64                                                                                                                                          2.0.1-1                                                                                                                                           opensearch-2.x
opensearch.aarch64                                                                                                                                          2.1.0-1                                                                                                                                           opensearch-2.x
opensearch.aarch64                                                                                                                                          2.2.0-1                                                                                                                                           opensearch-2.x

opensearch-dashboards.aarch64                                                                                                                               2.0.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.aarch64                                                                                                                               2.0.1-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.aarch64                                                                                                                               2.1.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.aarch64                                                                                                                               2.2.0-1                                                                                                                                opensearch-dashboards-2.x

[peterzhuamazon]

https://repo1.maven.org/maven2/org/opensearch/opensearch/2.2.0/

[vinylen]

Hi,

Thanks for the release. Seems that build-tools for 2.2.0 is missing though?
https://repo.gradle.org/ui/native/jcenter/org/opensearch/gradle/build-tools/

[grmblfrz]

Seems to me that all maven artifacts for 2.2.0 are missing, can't find them anywhere...

[lukas-vlcek]

The plugin artifacts are not available and thus the plugin install command fails as well.

% ./bin/opensearch-plugin install opensearch-sql  --verbose
-> Installing opensearch-sql
-> Failed installing opensearch-sql
-> Rolling back opensearch-sql
-> Rolled back opensearch-sql

BTW, it would be useful to improve the --verbose output in this case because it does not provide any further details about why the installation failed.

[bbarani]

@lukas-vlcek OpenSearch currently does not have support to install standalone plugins (outside of native plugins inherited from Elasticsearch) using plugin install command. You can view more details and the workaround in the below thread

https://forum.opensearch.org/t/download-urls-for-plugins-not-listed-anywhere/8297/6?u=bbarani

[gaiksaya]

We are looking into the maven artifacts. Filed an issue with sonatype to get some information.
Thanks!

[gaiksaya]

Hey everyone, the artifacts are available on maven now. https://repo1.maven.org/maven2/org/opensearch/opensearch/2.2.0/
please let us know if you see any issues.
Thanks!