Skip to main content
mmd
Projects
MIMIC_FMs_Public
Reports
In hospital mortality/From-scratch Training Hyperparameter Tuning
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
In hospital mortality/From-scratch Training Hyperparameter Tuning
Matthew McDermott
Created on August 23
|
Last edited on August 23
Comment
Hyperparameter Tuning Results
tuning_loss
tuning_loss
Showing first 10 runs
0
10
20
30
40
epoch
0.3
0.4
0.5
0.6
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
Parameter importance with respect to
tuning_loss
Parameters
1-10
of 34
Config parameter
Importance
Correlation
optimization_config.lr_decay_power
optimization_config.lr_decay_power
optimization_config/lr_decay_power
optimization_config/lr_decay_power
config.attention_dropout
config.attention_dropout
config.resid_dropout
config.resid_dropout
config.categorical_embedding_weight
config.categorical_embedding_weight
config/max_seq_len
config/max_seq_len
config/categorical_embedding_weight
config/categorical_embedding_weight
optimization_config.batch_size
optimization_config.batch_size
optimization_config/batch_size
optimization_config/batch_size
optimization_config.weight_decay
optimization_config.weight_decay
Loading...
All Non-crashed Sweep Runs
16
Crashed Runs
4
Add a comment