Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SOLR-16992 Non-reproducible StreamingTest failures #1955

Merged
merged 9 commits into from
Sep 27, 2023

Conversation

stillalex
Copy link
Member

@stillalex stillalex commented Sep 24, 2023

-- suggests CloudSolrStream concurency race condition

https://issues.apache.org/jira/browse/SOLR-16992

Description

Introduced a new method to deal with the executor task list work. it will wait for everything to complete and fully shut down. it will also attempt to throw the exception if one occurs, attaching all other exceptions to it.
refactored all previous uses to move to this common method.
Also, SolrClientCache is more strict about being closed

Open Questions

  • where should the executor method live? it is now in a new class StreamExecutorHelper but it could easily move to ExecutorUtil, it is generic enough.

  • I did not tackle adding 'closed' flags to all tuple stream impls. this might not strictly be needed to plug this gap. it could be a followup task given the amount of refactoring needed. thoughts?

Solution

Please provide a short description of the approach taken to implement your solution.

Tests

Please describe the tests you've developed or run to confirm this patch implements the feature or solves the problem.

Checklist

Please review the following and check all that apply:

  • I have reviewed the guidelines for How to Contribute and my code conforms to the standards described there to the best of my ability.
  • I have created a Jira issue and added the issue ID to my pull request title.
  • I have given Solr maintainers access to contribute to my PR branch. (optional but recommended)
  • I have developed this patch against the main branch.
  • I have run ./gradlew check.
  • I have added tests for my changes.
  • I have added documentation for the Reference Guide

@stillalex stillalex requested a review from hossman September 24, 2023 13:52
@stillalex stillalex force-pushed the SOLR-16992-more-streams branch from 13a9aa6 to 4006939 Compare September 27, 2023 18:04
@stillalex stillalex merged commit f0fcd30 into apache:main Sep 27, 2023
3 checks passed
@stillalex stillalex deleted the SOLR-16992-more-streams branch September 27, 2023 20:44
stillalex added a commit that referenced this pull request Sep 27, 2023
-- suggests CloudSolrStream concurency race condition

(cherry picked from commit f0fcd30)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant