A web crawler working on weibo.
The key idea is that, the mobile site of weibo is plain text, and we can use "htmlunit" package to get return from the html request, then extract information we want from the content. Results are stored into MySQL.
-
Notifications
You must be signed in to change notification settings - Fork 0
yefanTao/web_crawler_weibo
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published