Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add check for bulk import loaded columns that have no corresponding live fate operation #5175

Open
keith-turner opened this issue Dec 12, 2024 · 2 comments
Labels
enhancement This issue describes a new feature, improvement, or optimization.
Milestone

Comments

@keith-turner
Copy link
Contributor

Is your feature request related to a problem? Please describe.

In Accumulo 4.0 when a bulk load operation fails it can leave behind loaded columns in tablets that reference fate operations that are not alive.

Describe the solution you'd like

Look for these with a new check in the accumulo admin check command. May want to consider adding options for cleaning them up also.

@keith-turner keith-turner added the enhancement This issue describes a new feature, improvement, or optimization. label Dec 12, 2024
@keith-turner keith-turner added this to the 4.0.0 milestone Dec 12, 2024
@keith-turner
Copy link
Contributor Author

In 3.1 and 2.1 these loaded markers could be left behid because of race conditions. Because of this there was a mechanism in 3.1 and 2.1 to clean them up. In 4.0 that race condition should be gone, so do not want to automatically clean up. Thinking the check command can be used to find these and then they can be investigated and cleaned up.

@keith-turner keith-turner changed the title Add check for bulk import loaded columns that have not corresponding live fate operation Add check for bulk import loaded columns that have no corresponding live fate operation Dec 12, 2024
@keith-turner
Copy link
Contributor Author

Could also look for selected columns for which there is no live fate operation. These columns are placed by the fate operation that drives user compactions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement This issue describes a new feature, improvement, or optimization.
Projects
None yet
Development

No branches or pull requests

1 participant