New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

爬虫速度好慢 #460

Open

xubing8 opened this issue Oct 26, 2024 · 2 comments

xubing8 commented Oct 26, 2024

现在速度超级慢，不到1000条微博，需要两个小时

Owner

dataabc commented Oct 26, 2024

因为添加了sleep等待代码，注释了sleep代码会使速度变快，或者把sleep里的数字改小，不过这样会增加被限制的风险，不建议。

MiSanl commented Nov 2, 2024

我现在爬取，有时会打印同一个链接好多次，不知道是否会被ban，慢点没关系，只要别断掉就好

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment