Skip to main content
covid
Projects
covid_forecast
Reports
Examining Variations Across Test Set MSE

Examining Variations Across Test Set MSE

In this report we will examine variations across test set loss. It is important that a model performs robustly over time and not just on the most immediate test set. Therefore here we will analyze how the models perform over time.
Isaac
Created on June 25|Last edited on July 3

MSE Across Counties




02,0004,0006,0008,00010,00012,00014,00016,00018,00020,00022,00024,00026,00028,00030,000unscaled_test_loss0100,000200,000300,000400,000500,000600,000700,000800,000900,000test_accuracy.new_cases_MSE
Los Angeles County
1125
Maricopa County
1560
Queen County
763
Denver County
1383
Middlesex County
1606


Best Scoring Metrics (test_loss and mapping)




Cook
1
Maricopa
5


Created with ❤️ on Weights & Biases.

https://wandb.ai/covid/covid_forecast/reports/Examining-Variations-Across-Test-Set-MSE--VmlldzoxNTEwODk
Made with Weights & Biases. Sign up or log in to create reports like this one.