Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The "President Weekly Address Scraper" is actually scraping the White House blog. #91

Open
onyxfish opened this issue Sep 27, 2009 · 0 comments

Comments

@onyxfish
Copy link
Owner

e.g.

{
   "_id": "2009-08-26T07:41:00Z -  President Weekly Address Scraper - One of the Most Accomplished Americans Ever to Serve our Democracy",
   "_rev": "1-20e3a33ad199100e653284e6a12f77fd",
   "datetime": "2009-08-26T07:41:00Z",
   "end_datetime": null,
   "title": ""One of the Most Accomplished Americans Ever to Serve our Democracy"",
   "description": "Author: Jesse Lee "One of the Most Accomplished Americans Ever to Serve our Democracy"",
   "branch": "Executive",
   "entity": "White House",
   "source_url": "http://www.whitehouse.gov/feed/blog/",
   "source_text": "no result",
   "access_datetime": "2009-09-02T21:33:30Z",
   "parser_name": "President Weekly Address Scraper",
   "parser_version": "1.0"
}

It doesn't look like we are getting the addresses at all. I dont think we should scrape the blog, as it is very high traffic and much of it doesn't constitute an "event" on the behalf of the government. Correct url for the weekly addresses is: http://www.whitehouse.gov/weekly_address/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant