Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(backoff): add backoff to Google Group API calls #1081

Merged
merged 3 commits into from
Apr 28, 2023
Merged

Conversation

Avantol13
Copy link
Contributor

Jira Ticket: PXP-xxxx

  • Remove this line if you've changed the title to (PXP-xxxx): <title>

New Features

Breaking Changes

Bug Fixes

Improvements

  • add backoff to Google Group API calls

Dependency updates

Deployment changes

@coveralls
Copy link

coveralls commented Mar 22, 2023

Pull Request Test Coverage Report for Build 13464

  • 8 of 14 (57.14%) changed or added relevant lines in 1 file are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage decreased (-0.005%) to 74.363%

Changes Missing Coverage Covered Lines Changed/Added Lines %
fence/resources/google/access_utils.py 8 14 57.14%
Totals Coverage Status
Change from base Build 13455: -0.005%
Covered Lines: 7147
Relevant Lines: 9611

💛 - Coveralls

paulineribeyre
paulineribeyre previously approved these changes Mar 22, 2023
Comment on lines +86 to +87
def _add_member_to_google_group(gcm, add_member_to_group, group):
gcm.add_member_to_group(member_email, group)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we update the add_member_to_group calls to _add_member_to_google_group in bulk_update_google_groups()?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same for the other 2 functions

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whoops, yes. Just pushed a commit to fix

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not sure if you meant to add backoff to all the calls or just the bulk_update_google_groups process?

get_group_members is called in verify_bucket_access_group

add_member_to_group in add_user_service_account_to_google

remove_member_from_group in a bunch of functions

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just the bulk updates, the others should happen dynamically when a user requests access to data and/or during validation job where the number of calls is much less. This is just to alleviate the quota exceeded issues during usersync

paulineribeyre
paulineribeyre previously approved these changes Mar 22, 2023
@Avantol13 Avantol13 merged commit 4d26d1c into master Apr 28, 2023
@Avantol13 Avantol13 deleted the feat/backoff branch April 28, 2023 17:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants