Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write Unit tests for column names #5

Open
V-Neck opened this issue Mar 1, 2020 · 0 comments
Open

Write Unit tests for column names #5

V-Neck opened this issue Mar 1, 2020 · 0 comments
Assignees

Comments

@V-Neck
Copy link
Collaborator

V-Neck commented Mar 1, 2020

We obviously face the problem of these external data sources changing schema from under our feet. A great way to handle this would be to add unit tests what would

1.) Assess whether a change has occurred
2.) Indicate which columns are different to simplify the research that needs to be done in order to get the scraping script back up.

We don't have to do any more engineering at that point, but it would set us up to have nightly builds and alerts if any of these things fail.

@V-Neck V-Neck self-assigned this Mar 1, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant