You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The daily pipeline script runs as the title would suggest... daily. One of the inputs to the script is the current date. When the script fails for a particular day due to data not being available it creates holes in the historical information.
In order to avoid the holes in the data, this ticket would create a script that evaluates a time window for holes in data, and then runs the daily-pipeline for the missing days.
The text was updated successfully, but these errors were encountered:
This has been resolved with the matrix build that does the calculation at run time of data available vs data previously processed, and then processes the missing data.
The daily pipeline script runs as the title would suggest... daily. One of the inputs to the script is the current date. When the script fails for a particular day due to data not being available it creates holes in the historical information.
In order to avoid the holes in the data, this ticket would create a script that evaluates a time window for holes in data, and then runs the daily-pipeline for the missing days.
The text was updated successfully, but these errors were encountered: