How to crawl a dynamic web page

[HoikanChan]

This crawler is cool.
But I always met some contents in the web page is loading.
And I can't get the loaded contents in the html.
Can this lib help me to get the contents after the page load completely?
-^-

[darrenqc]

Sorry dude, this lib is like calling an api. You get only whatever the api returns. You have to find out which api returns the data you want or you can have a look at some web driver based lib.

[mike442144]

Same with #103