Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Export forecasted values for backtest windows #68

Open
apurvaGodg opened this issue Mar 2, 2020 · 1 comment
Open

Export forecasted values for backtest windows #68

apurvaGodg opened this issue Mar 2, 2020 · 1 comment

Comments

@apurvaGodg
Copy link

apurvaGodg commented Mar 2, 2020

As per the documentation here , Amazon Forecast provides backtesting to produce evaluation metrics. However, these metrics are at aggregated level. When forecasting for a large number of items,and backtesting(let's say for NumberOfBacktestWindows = 4), sometimes I am interested in looking at the forecasted values of individual items during the back tests.

In the following example, for all the items is it possible to export forecasted values for each 'Testing' window ? It will be nice to see what are some items for which the error metric remains fairly constant over 4 test windows ,which is not possible if it's just aggregated metric.

image

Thanks in advance!

@shimomut
Copy link
Contributor

shimomut commented Mar 4, 2020

Thank you for your improvement idea, @apurvagodghase. As you wrote this is not possible by the current backtest feature. We will include this idea in our consideration for feature development planning.
Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants