[Major] Speedup dataset get_item #2211
GitHub Actions / ModelReport
succeeded
Aug 24, 2024 in 0s
ModelReport
Model Benchmark
| Benchmark | Metric | main | current | diff | |
|---|---|---|---|---|---|
| YosemiteTemps | MAE_val | 0.59734 | 0.58159 | -2.64% | ✅ |
| YosemiteTemps | RMSE_val | 0.88884 | 0.86935 | -2.19% | ✅ |
| YosemiteTemps | Loss_val | 0.00046 | 0.00044 | -4.33% | ✅ |
| YosemiteTemps | train_loss | 0.00126 | 0.0012 | -4.44% | ✅ |
| YosemiteTemps | reg_loss | 0 | 0 | 0.0% | ✅ |
| YosemiteTemps | MAE | 0.97461 | 0.94811 | -2.72% | ✅ |
| YosemiteTemps | RMSE | 1.70806 | 1.66847 | -2.32% | ✅ |
| YosemiteTemps | Loss | 0.00126 | 0.0012 | -4.44% | ✅ |
| YosemiteTemps | time | 139.286 | 63.47 | -54.43% | 🎉 |
| EnergyPriceDaily | MAE_val | 5.64247 | 5.42935 | -3.78% | ✅ |
| EnergyPriceDaily | RMSE_val | 7.19972 | 6.8899 | -4.3% | ✅ |
| EnergyPriceDaily | Loss_val | 0.02893 | 0.02655 | -8.24% | 🎉 |
| EnergyPriceDaily | train_loss | 0.02957 | 0.02758 | -6.73% | 🎉 |
| EnergyPriceDaily | reg_loss | 0 | 0 | 0.0% | ✅ |
| EnergyPriceDaily | MAE | 6.39654 | 6.15242 | -3.82% | ✅ |
| EnergyPriceDaily | RMSE | 8.56207 | 8.26191 | -3.51% | ✅ |
| EnergyPriceDaily | Loss | 0.02936 | 0.02739 | -6.73% | 🎉 |
| EnergyPriceDaily | time | 40.8615 | 21.21 | -48.09% | 🎉 |
| AirPassengers | MAE_val | 30.8306 | 30.081 | -2.43% | ✅ |
| AirPassengers | RMSE_val | 31.8167 | 30.9826 | -2.62% | ✅ |
| AirPassengers | Loss_val | 0.01301 | 0.01234 | -5.17% | 🎉 |
| AirPassengers | train_loss | 0.00071 | 0.00071 | -0.86% | ✅ |
| AirPassengers | reg_loss | 0 | 0 | 0.0% | ✅ |
| AirPassengers | MAE | 6.88169 | 6.86204 | -0.29% | ✅ |
| AirPassengers | RMSE | 8.92083 | 8.81789 | -1.15% | ✅ |
| AirPassengers | Loss | 0.00076 | 0.00074 | -2.27% | ✅ |
| AirPassengers | time | 10.3648 | 9.29 | -10.37% | 🎉 |
| PeytonManning | MAE_val | 0.35533 | 0.35447 | -0.24% | ✅ |
| PeytonManning | RMSE_val | 0.50396 | 0.50324 | -0.14% | ✅ |
| PeytonManning | Loss_val | 0.01802 | 0.01796 | -0.32% | ✅ |
| PeytonManning | train_loss | 0.01466 | 0.01461 | -0.3% | ✅ |
| PeytonManning | reg_loss | 0 | 0 | 0.0% | ✅ |
| PeytonManning | MAE | 0.34756 | 0.34738 | -0.05% | ✅ |
| PeytonManning | RMSE | 0.4945 | 0.49347 | -0.21% | ✅ |
| PeytonManning | Loss | 0.01465 | 0.01461 | -0.3% | ✅ |
| PeytonManning | time | 26.1209 | 16.1 | -38.36% | 🎉 |
Model training plots
Model Training
PeytonManning
YosemiteTemps
AirPassengers
EnergyPriceDaily
Loading