Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add blocksize arg for ftp hook #24860

Merged
merged 1 commit into from
Jul 7, 2022
Merged

Conversation

kevgeo
Copy link
Contributor

@kevgeo kevgeo commented Jul 6, 2022

Closes: issue #23935 to add blocksize as an argument to transfer files from ftp server to local machine in user-defined chunks.

I have also added blocksize as an argument to store_file() which transfers from local machine to ftp server as it is useful too.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst, in newsfragments.

@kevgeo kevgeo changed the title Add blocksize arg for ftp hook #23935 Add blocksize arg for ftp hook Jul 6, 2022
@uranusjr
Copy link
Member

uranusjr commented Jul 6, 2022

Makes sense, but please fix the errors. (Documentation failure is unrelated and can be ignored for now.)

@potiuk potiuk force-pushed the add_blocksize_arg_ftphook branch from 19f8760 to c8421af Compare July 6, 2022 11:31
@kevgeo kevgeo force-pushed the add_blocksize_arg_ftphook branch from c8421af to 343bc74 Compare July 6, 2022 16:23
@potiuk potiuk merged commit 64412ee into apache:main Jul 7, 2022
@kevgeo
Copy link
Contributor Author

kevgeo commented Jul 7, 2022

Thanks @uranusjr for reviewing and @potiuk for the helpful discussion on slack 😁

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

No option to set blocksize when retrieving a file in ftphook
3 participants