Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need Ability to Alter Header Attributes #12

Open
rhudock opened this issue Feb 14, 2023 · 1 comment
Open

Need Ability to Alter Header Attributes #12

rhudock opened this issue Feb 14, 2023 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@rhudock
Copy link

rhudock commented Feb 14, 2023

Costco seems to be blocking these types of requests, it appears you need to alter attributes related to the client:

[2023-02-14 10:18:27] - WARNING Encountered a network exception while scraping policy from https://www.costco.com/privacy-policy.html -- skipping.
HTTPSConnectionPool(host='www.costco.com', port=443): Read timed out. (read timeout=30)
[2023-02-14 10:18:27] - WARNING Encountered a network exception while scraping policy from https://www.costco.com/privacy-policy.html -- skipping.

@nsamarin nsamarin self-assigned this Feb 14, 2023
@nsamarin nsamarin added the bug Something isn't working label Feb 14, 2023
@nsamarin
Copy link
Member

@rhudock thanks for the feedback, we will take a look into it and reference the fix here once we implement it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants