Datasets

Million Song Dataset

• http://labrosa.ee.columbia.edu/millionsong/pages/getting-dataset

Special thanks to Echo Nest for converting the whole 200+ GB HDF5 format of the dataset to TSV for us

NASDAQ daily prices and dividends

• http://www.infochimps.com/datasets/daily-1970-2010-open-close-hi-low-and-volume-nasdaq-exchange

NYSE daily prices and dividends

• http://www.infochimps.com/datasets/daily-1970-2010-open-close-hi-low-and-volume-nyse-exchange

Wikipedia XML dump

• http://en.wikipedia.org/wiki/Wikipedia:Database_download#English-language_Wikipedia

Google Ngram

• Only the 1-gram and 2-gram datasets are available
• http://ngrams.googlelabs.com/datasets

Geonames

• http://download.geonames.org/export/dump/readme.txt

Reddit voting data

• http://www.reddit.com/r/redditdev/comments/dtg4j/want_to_help_reddit_build_a_recommender_a_public/

Bixi Montreal

• XML dump of all the bike station information queried every minute over a couple of months.
• Provided by Fabrice

DNS dataset

• Contains the root file with all the domain names and their associated nameservers for the "com" TLD.

LDEO Surface Ocean CO2 Climatology data

• http://www.pmel.noaa.gov/co2/story/LDEO+Surface+Ocean+CO2+Climatology

Twitter dataset

• Data of the social graph, user id to names, and selected celebrity profiles. This does not contain actual tweets because of Twitter policies.
• http://an.kaist.ac.kr/traces/WWW2010.html

Flight dataset

• Limited set of flight data containing origin, destination, departure time, return time, price and date. Only has flights originated from SEA.
• Provided by Hopper