Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Blobclient download stream readall() never finishes. #19783

Closed
fxdgear opened this issue Jul 13, 2021 · 1 comment
Closed

Blobclient download stream readall() never finishes. #19783

fxdgear opened this issue Jul 13, 2021 · 1 comment
Labels
customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that

Comments

@fxdgear
Copy link

fxdgear commented Jul 13, 2021

  • Package Name: azure-storage-blob==12.8.1
  • Package Version: 12.8.1
  • Operating System: Debian Buster (Docker image)
  • Python Version: 3.9.6

Describe the bug
download_stream.readall() hangs when running inside a container in GKE, but does not hang when executing the container locally.

with open(obj.name, "wb") as download_file:                                                                           
    download_stream = bc.download_blob()                                                                              
    download_file.write(download_stream.readall())

To Reproduce
Steps to reproduce the behavior:

  1. Try to download a blob using the python client in a GKE environment.

Expected behavior
To download the contents of the blob

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
I am trying to download the contents of a blob. My code hangs on the execution of the readall() method. When inspecting the container in the Pod, I can see that the contents of the file have been fully downloaded. yet the readall() method is still blocking.

When I run the container locally on my laptop, the execution of the method completes and the program continues along nicely.

It's only when I've created a K8s CronJob that's supposed to periodically download the blobs the readall() method gets stuck. I don't understand why this is happening. My assumption is it has something to do with a network connectivity between google and azure. But I would like a way to understand how to debug this a bit further.
@ghost ghost added needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. customer-reported Issues that are reported by GitHub users external to the Azure organization. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels Jul 13, 2021
@fxdgear
Copy link
Author

fxdgear commented Jul 13, 2021

closing, not a bug my fault :/ app hanging somewhere else, but my logging was not verbose enough to help me.

Sorry for the noise.

@fxdgear fxdgear closed this as completed Jul 13, 2021
azure-sdk pushed a commit to azure-sdk/azure-sdk-for-python that referenced this issue Jul 20, 2022
@serbrech @lht6 @haitch
CodeGen from PR 19653 in Azure/azure-rest-api-specs
4a0abc1 
Review request for Microsoft.ContainerService to add version 2022-06-02-preview (Azure#19653)

* Adds base for updating Microsoft.ContainerService from version preview/2022-05-02-preview to version 2022-06-02-preview

* Updates readme

* Updates API version in new specs and examples

* update readmes (Azure#19422)

* Containerservice 2022 06 02 preview fleet (Azure#19541)

* add fleets and fleet members resource types

* remove clusterLocation

* wording

* don't flatten  hubprofile

* extra comma

* fix patch example

* Fix violated rule R4041 for 2022-06-02-preview managedCluster swagger (Azure#19582)

* remove useless directive

* fix R4041

* fix

* add node restriction to swagger (Azure#19587)

* aks fleet list credentials api (Azure#19559)

* add fleet list credential api

* tweaks

* fix example filename

* fix casing

* add resourceId on hubProfile

* drop the new field, keep it as internal field

* fix duplicate shema error

* different name for fleet credential results

* use xms-identifier on the array items

* prettier fi

Co-authored-by: Stephane Erbrech <stephane.erbrech@gmail.com>

* sterbrec - address fleet comments - Microsoft.ContainerService - 2022-06-02-preview (Azure#19783)

* address fleet comments

* add example for nadditional status code

* Add missing `x-ms-long-running-operation-options` for delete operations in fleet-related API (Azure#19787)

* add final-state-via

* fix final state to location header

Co-authored-by: Stéphane Erbrech <stephane.erbrech@gmail.com>
Co-authored-by: lht6 <46062996+lht6@users.noreply.github.com>
Co-authored-by: Haitao Chen <haitch@users.noreply.github.com>
@github-actions github-actions bot locked and limited conversation to collaborators Apr 11, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@fxdgear