Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Club Scraper #1

Open
Waidhoferj opened this issue Sep 26, 2021 · 2 comments
Open

Club Scraper #1

Waidhoferj opened this issue Sep 26, 2021 · 2 comments
Assignees
@Braden50
Labels
enhancement New feature or request web scraping

Comments

@Waidhoferj
Copy link
Member

Create a new scraper in the scrapers folder that gets info on Cal Poly Campus clubs. See the Club object in models.py to understand the schema. Review CollegeScraper as an example of a web scraper template.
@Waidhoferj Waidhoferj added the enhancement New feature or request label Sep 26, 2021
@Waidhoferj Waidhoferj changed the title Create a club scraper Club Scraper Sep 26, 2021
@Braden50 Braden50 self-assigned this Oct 10, 2021
@Braden50
Copy link
Member

Working in "club-scraper" branch. Cal poly now uses an API that we can utilize. In attempting to see if I need to be signed in to see officers, the cal poly portal login stopped working. Will have to check in later

@Braden50
Copy link
Member

Looks like to see officer or member information, you have to be signed in. This complicates things because it means our requests now need to be made in a consistent session or cookies need to be passed around.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Braden50 Braden50

Labels
enhancement New feature or request web scraping
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Waidhoferj @Braden50