You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As noted in #423 and based on findings in #453 , we suggest adding QC checks to the data relay server to alert the team of potential failures in the data pipeline. Some suggestions from the initial analysis include:
build an alert when a given district has any missing days in the S3 bucket
build an alert in Snowflake or dbt when the number of observations for a given station ID and/or district is lower than an expected threshold
build a model to check data relay data against clearinghouse data (this is a temporary fix meant to alert of us new data issue patterns that may arise, and act as a secondary validation check until we turn the clearinghouse data collection off)
The text was updated successfully, but these errors were encountered:
As noted in #423 and based on findings in #453 , we suggest adding QC checks to the data relay server to alert the team of potential failures in the data pipeline. Some suggestions from the initial analysis include:
The text was updated successfully, but these errors were encountered: