Make number of segment metadata files in remote segment store configurable (#11329)

[sachinpkale]

Backport ec5a0f9 from #11329.

[github-actions]

Compatibility status:

Checks if related components are compatible with change 5e3dd85

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/performance-analyzer.git]

[github-actions]

❕ Gradle check result for 5e3dd85: UNSTABLE

• TEST FAILURES:

      1 org.opensearch.search.SearchWeightedRoutingIT.testShardRoutingWithNetworkDisruption_FailOpenEnabled

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Attention: 7 lines in your changes are missing coverage. Please review.

Comparison is base (ae8ded5) 71.11% compared to head (5e3dd85) 71.05%.

Files	Patch %	Lines
...ch/indices/recovery/PeerRecoveryTargetService.java	0.00%	4 Missing ⚠️
...earch/index/store/RemoteSegmentStoreDirectory.java	0.00%	2 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##                2.x   #11357      +/-   ##
============================================
- Coverage     71.11%   71.05%   -0.06%     
+ Complexity    59165    59089      -76     
============================================
  Files          4869     4869              
  Lines        278674   278691      +17     
  Branches      40836    40836              
============================================
- Hits         198175   198031     -144     
- Misses        63765    63901     +136     
- Partials      16734    16759      +25     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.