Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Document operating procedure for post-mortems on reindexing #3056

Closed
hannes-ucsc opened this issue May 13, 2021 · 4 comments
Closed

Document operating procedure for post-mortems on reindexing #3056

hannes-ucsc opened this issue May 13, 2021 · 4 comments
Assignees
@hannes-ucsc @dsotirho-ucsc
Labels
debt [type] A defect incurring continued engineering cost doc [subject] Internal and external documentation no demo [process] Not to be demonstrated at the end of the sprint no pr [process] Resolution (usually hotfix) commited directly to branch orange [process] Done by the Azul team

Comments

@hannes-ucsc
Copy link
Member

Check for fail messages, triage fail messages against expected failures, raise issues for unexpected failures, ping people on #dcp2 about those issues, clear the fail queues so they are empty for the next reindexing.
@hannes-ucsc hannes-ucsc added orange [process] Done by the Azul team debt [type] A defect incurring continued engineering cost doc [subject] Internal and external documentation labels May 13, 2021
@theathorn theathorn added the no pr [process] Resolution (usually hotfix) commited directly to branch label May 17, 2021
@dsotirho-ucsc
Copy link
Contributor

https://github.com/DataBiosphere/azul/wiki/Operator-Manual
Added section Failures during reindex.

@amarjandu
Copy link
Contributor

I think there is a step that was forgotten above which is to document the failures within the PR itself. IMO there should be a link to the example that Daniel created here #3050 (comment)

@amarjandu
Copy link
Contributor

Added the step to document the failures within the PR.

@amarjandu amarjandu removed their assignment May 18, 2021
@hannes-ucsc
Copy link
Member Author

Wiki changes LGTM.

@hannes-ucsc hannes-ucsc added the no demo [process] Not to be demonstrated at the end of the sprint label May 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hannes-ucsc hannes-ucsc

@dsotirho-ucsc dsotirho-ucsc

Labels
debt [type] A defect incurring continued engineering cost doc [subject] Internal and external documentation no demo [process] Not to be demonstrated at the end of the sprint no pr [process] Resolution (usually hotfix) commited directly to branch orange [process] Done by the Azul team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@amarjandu @hannes-ucsc @theathorn @dsotirho-ucsc