-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use correct paths in GcsBucket.put/get_directory
#14432
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
hi @rooperuu ! thank you for the PR
this generally looks good to me, but 2 questions:
- why switch away from
self.write_path
here? - can you add a test for the new path creation logic?
Thanks for taking a look! I have updated the tests for Regarding the other point, the problem was that path resolution was done both in |
Thanks @rooperuu for adding those tests. @zzstoatzz does this LGTU? Would love to get this merged / released since this is blocking for this team. 🙇 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thank you @rooperuu !
closes #12487
Fixes target path resolution in
GcsBucket
methods. Currently, input_directory
, thebucket_folder
prefix is added twice, and inget_directory
, the prefix is not removed.Example
GCS target file for
put_directory
given local source filefrom_path/file.txt
:bucket_folder/bucket_folder/to_path/file.txt
bucket_folder/to_path/file.txt
Local target file for
get_directory
given GCS source filebucket_folder/from_path/file.txt
:to_path/from_path/file.txt
to_path/file.txt
Checklist
maintenance
,fix
,feature
,enhancement
,docs
.<link to issue>
"mint.json
.