Skip to main content
mmd
Projects
MIMIC_FMs_Public
Reports
30d Readmission Prediction/Fine-tuning Hyperparameter Tuning
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
30d Readmission Prediction/Fine-tuning Hyperparameter Tuning
Matthew McDermott
Created on August 15
|
Last edited on October 23
Comment
Hyperparameter Tuning Results
tuning_loss
tuning_loss
Showing first 10 runs
0
10
20
30
epoch
0.62
0.63
0.64
0.65
0.66
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
Parameter importance with respect to
tuning_loss
Parameters
1-8
of 8
Config parameter
Importance
Correlation
optimization_config/init_lr
optimization_config/init_lr
config.resid_dropout
config.resid_dropout
optimization_config/end_lr_frac_of_init_lr
optimization_config/end_lr_frac_of_init_lr
config.attention_dropout
config.attention_dropout
optimization_config.weight_decay
optimization_config.weight_decay
optimization_config.batch_size
optimization_config.batch_size
optimization_config.lr_decay_power
optimization_config.lr_decay_power
config/input_dropout
config/input_dropout
Loading...
All Non-crashed Sweep Runs
40
Crashed Runs
0
Add a comment