Skip to content

A crawler with data analyzer for Medium bloghost users' behavior analysis

License

Notifications You must be signed in to change notification settings

lifei96/Medium-crawler-with-data-analyzer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

89 Commits
 
 
 
 
 
 

Repository files navigation

Medium crawler with data analyzer

This is a distributed web crawler to crawl data from Medium.com, a light blog social network.

The crawled data includes users' profiles, following/followers lists, users' posts and their Twitter/Facebook profiles(based on cross-site linking function).

In addition, different data analyzers are developed to do research on social networks.

A research paper based on this project is submitted to 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). GL && HF!

About

A crawler with data analyzer for Medium bloghost users' behavior analysis

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published