Skip to content

Need Ability to Alter Header Attributes #12

@rhudock

Description

@rhudock

Costco seems to be blocking these types of requests, it appears you need to alter attributes related to the client:

[2023-02-14 10:18:27] - WARNING Encountered a network exception while scraping policy from https://www.costco.com/privacy-policy.html -- skipping.
HTTPSConnectionPool(host='www.costco.com', port=443): Read timed out. (read timeout=30)
[2023-02-14 10:18:27] - WARNING Encountered a network exception while scraping policy from https://www.costco.com/privacy-policy.html -- skipping.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions