[Backport 2.x] Fix the HttpChannel trace termination in case of exceptions

[opensearch-trigger-bot]

Backport bddf0d3 from #10325.

[github-actions]

Compatibility status:

Checks if related components are compatible with change ce3f348

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git]

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/26783/
• CommitID: ce3f348
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/26791/
• CommitID: ce3f348
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/26795/
• CommitID: ce3f348
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/26802/
• CommitID: ce3f348
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/26813/
• CommitID: ce3f348
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.snapshots.CloneSnapshotIT.testClonePreventsSnapshotDelete
      1 org.opensearch.search.SearchWeightedRoutingIT.testMultiGetWithNetworkDisruption_FailOpenEnabled
      1 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testTaskResourceTrackingDuringTaskCancellation

• URL: https://build.ci.opensearch.org/job/gradle-check/26814/
• CommitID: ce3f348
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #10344 (ce3f348) into 2.x (3c1e5fb) will decrease coverage by 0.08%.
Report is 4 commits behind head on 2.x.
The diff coverage is 25.00%.

@@             Coverage Diff              @@
##                2.x   #10344      +/-   ##
============================================
- Coverage     70.96%   70.88%   -0.08%     
+ Complexity    58445    58406      -39     
============================================
  Files          4816     4817       +1     
  Lines        275763   275770       +7     
  Branches      40534    40535       +1     
============================================
- Hits         195683   195471     -212     
- Misses        63405    63618     +213     
- Partials      16675    16681       +6     

Files	Coverage Δ
...rg/opensearch/telemetry/tracing/DefaultTracer.java	100.00% <ø> (ø)
...g/opensearch/http/AbstractHttpServerTransport.java	75.13% <100.00%> (+0.13%)	⬆️
...src/main/java/org/opensearch/http/HttpChannel.java	100.00% <100.00%> (ø)
...ing/handler/TraceableTransportResponseHandler.java	80.00% <0.00%> (-3.34%)	⬇️
...opensearch/transport/TransportResponseHandler.java	0.00% <0.00%> (ø)
...lemetry/tracing/channels/TraceableHttpChannel.java	57.14% <0.00%> (-13.45%)	⬇️

... and 503 files with indirect coverage changes