New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Prevent suspicious flagging #1

Open

deven96 opened this issue Feb 3, 2019 · 1 comment

Member

deven96 commented Feb 3, 2019 •

edited

Loading

Apply techniques to prevent search engine scraper from being flagged as suspicious activity. Randomly cycle through browser headers for scraping

deven96 added the help wanted label

deven96 added enhancement major change labels

deven96 mentioned this issue

Switch from Request to PyCurl #31

Closed

deven96 added the in progress label

AvinashReddy3108 commented Oct 2, 2020

Maybe add ability to provide a user agent and proxy too!
I think it would be really cool.

MeNsaaH mentioned this issue

Prevent search engine failure #119

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment