Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: exit on grpc plugin crash #3604

Merged

Conversation

johanneswuerbach
Copy link
Contributor

Which problem is this PR solving?

Fixes #3562

Short description of the changes

Exit when the grpc plugins fails so we an orchestration can recover from such failures. The exit inside the storage plugin feels odd, but I couldn't find a way to bubble up the failure to a different place.

Instead of crashing jaeger could also attempt to restart the plugin, but then restart loops would also need to be prevented, etc. so just crashing seemed easier and more obvious for an operator.

Related hashicorp/go-plugin#31 hashicorp/go-plugin#92

@johanneswuerbach johanneswuerbach requested a review from a team as a code owner March 29, 2022 09:15
Signed-off-by: Johannes Würbach <johannes.wuerbach@googlemail.com>
@johanneswuerbach johanneswuerbach force-pushed the grpc-plugin-health-check branch from 047d842 to e592f13 Compare March 29, 2022 09:16
@codecov
Copy link

codecov bot commented Mar 29, 2022

Codecov Report

Merging #3604 (2bd8111) into main (e08f5c0) will increase coverage by 0.04%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #3604      +/-   ##
==========================================
+ Coverage   96.50%   96.54%   +0.04%     
==========================================
  Files         264      264              
  Lines       15447    15447              
==========================================
+ Hits        14907    14914       +7     
+ Misses        455      449       -6     
+ Partials       85       84       -1     
Impacted Files Coverage Δ
...lugin/sampling/strategystore/adaptive/processor.go 100.00% <0.00%> (+0.61%) ⬆️
cmd/query/app/static_handler.go 97.60% <0.00%> (+1.79%) ⬆️
pkg/config/tlscfg/cert_watcher.go 94.73% <0.00%> (+2.10%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f02f79f...2bd8111. Read the comment docs.

@yurishkuro yurishkuro enabled auto-merge (squash) March 29, 2022 13:49
@yurishkuro yurishkuro merged commit 07ca602 into jaegertracing:main Mar 29, 2022
@johanneswuerbach johanneswuerbach deleted the grpc-plugin-health-check branch March 29, 2022 15:31
albertteoh pushed a commit to albertteoh/jaeger that referenced this pull request Jul 13, 2022
Signed-off-by: Johannes Würbach <johannes.wuerbach@googlemail.com>

Co-authored-by: Yuri Shkuro <yurishkuro@users.noreply.github.com>
Signed-off-by: Albert Teoh <see.kwang.teoh@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GRPC plugin crash is not terminating the process
2 participants