Skip to content

Scrapes the NYT Mini Leaderboard and puts it in a postgres database

Notifications You must be signed in to change notification settings

kyledeanreinford/NYT_Mini_Leaderboard_Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 

Repository files navigation

NYT Mini Leaderboard Scraper

I play the NY Times Mini Crossword with several of my friends, and while we could see the daily leaderboard, there was no way to see who had yesterday's best time, or who had the most wins. This made trash talking difficult.

I created this app which uses Python and Beautiful Soup to log in to my NY Times account and scrape all of the times into a database. I set up a cron on my server to do this one minute before the current day's puzzle disappears (9pm central Monday-Friday, 5pm Saturday-Sunday). Initially I was using a Postgres DB and Streamlit, but decided I wanted a more robust setup, so I shifted to MongoDB and built a MERN app, with visualizations using Nivo.

Scraper portion of my Mini Scraper. See an example at Heroku.

Full MERN Stack code is here.

To run with your own friends: Change list of players to a list of your friends' usernames

to run: python scraper.py -u {username} -p {password}

About

Scrapes the NYT Mini Leaderboard and puts it in a postgres database

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages