Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Activate streaming from object storage #944

Merged
merged 1 commit into from
May 18, 2022
Merged

Conversation

mdellweg
Copy link
Member

@mdellweg mdellweg commented May 5, 2022

fixes #493

Comment on lines 315 to 318
with open(local_temp_file.name) as file_handle:
importer_result = process_collection(
file_handle, filename=filename, logger=user_facing_logger
)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a hell of a workaround to prevent galaxy-importer to try to be clever.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI @awcrosby

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

haha. we may have had a reason for this originally, but if we are able to get it working with pulp_ansible passing a file handle to galaxy-importer, then +1 to that

@mdellweg
Copy link
Member Author

mdellweg commented May 6, 2022

I intend to solve the issue on the galaxy-importer side.

ansible/galaxy-importer#168

@mdellweg mdellweg force-pushed the stream branch 4 times, most recently from c5741c1 to d768806 Compare May 16, 2022 12:24
@pep8speaks
Copy link

pep8speaks commented May 16, 2022

Hello @mdellweg! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

Line 398:9: W503 line break before binary operator

Comment last updated at 2022-05-18 12:26:27 UTC

@mdellweg mdellweg marked this pull request as ready for review May 18, 2022 07:52
@mdellweg mdellweg requested review from awcrosby and fao89 May 18, 2022 10:37
Copy link
Member

@fao89 fao89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shouldn't you ensure galaxy-importer version here?

Comment on lines +396 to +399
if (
settings.DEFAULT_FILE_STORAGE == "pulpcore.app.models.storage.FileSystem"
or not settings.REDIRECT_TO_OBJECT_STORAGE
):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍🏽

@@ -1,6 +1,6 @@
aiofiles>=0.8.0
async_lru~=1.0
galaxy_importer>=0.4.1
galaxy_importer>=0.4.5
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

galaxy-importer 0.4.5 is now on pypi

@mdellweg mdellweg merged commit 595f19b into pulp:main May 18, 2022
@mdellweg mdellweg deleted the stream branch May 18, 2022 19:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enable Streaming of content from cloud storage through content app
4 participants