-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Datastore: expose retry parameters #6119
Comments
This is not a feature, but a bug that is triggering quite often on our fuzzing infrastructure. @tseaver can you prioritize this. Or just add InternalServerError to the retry_codes before next release please ? |
I feel I've just hit a wall regarding setting retry/timeout strategy/settings for the Python clients for GCP services. The more I dig up it feels this fundamental missing feature (and for some cases it could be argued it is more a bug than a requested feature) has no priority for the project maintainers. See #3109 and #2988. Both were closed on the argument that some work was in progress that would eventually fix the issues (they didn't). That was in April and August 2017! |
The list of "idempotent" errors is generated from the @pcostell Could you open a bug to update the upstream repo for googleapis to include 500 errors as idempotent? |
FWIW, I'd be happy to review / merge a PR which added |
Overall design of retries for manual clients is tracked in #9298. |
Would it be possible to expose retry parameters for datastore?
We are seeing frequent "InternalServerError: 500 GOAWAY received" errors during queries, and it looks like the default retry does not handle internal errors: https://github.com/GoogleCloudPlatform/google-cloud-python/blob/master/datastore/google/cloud/datastore_v1/gapic/datastore_client_config.py#L5
It's not possible for us to add our own retry here either to retry fetching a particular page, as _items_iter and _page_iter are generators and we can't retry on failures during iteration.
Would it be possible to expose these settings somehow, or add INTERNAL to the list of retryable errors? We'd like to avoid doing something like #3128 (comment)
The text was updated successfully, but these errors were encountered: