Skip to main content
mmd
Projects
MIMIC_FMs_Public
Reports
Hyperparameter Tuning Sweep
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Hyperparameter Tuning Sweep
Matthew McDermott
Created on June 13
|
Last edited on June 13
Comment
Hyperparameter Tuning Results
tuning_loss
tuning_loss
Showing first 10 runs
0
10
20
30
40
50
epoch
20
40
60
80
100
120
140
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
Parameter importance with respect to
tuning_loss
Parameters
1-10
of 40
Config parameter
Importance
Correlation
config.static_embedding_weight
config.static_embedding_weight
config.head_dim
config.head_dim
config.numerical_embedding_dim
config.numerical_embedding_dim
config.do_full_block_in_seq_attention
config.do_full_block_in_seq_attention
config.input_dropout
config.input_dropout
optimization_config.lr_frac_warmup_steps
optimization_config.lr_frac_warmup_steps
optimization_config.weight_decay
optimization_config.weight_decay
config.resid_dropout
config.resid_dropout
config.num_hidden_layers
config.num_hidden_layers
optimization_config.init_lr
optimization_config.init_lr
Loading...
Sweep Runs with Tuning Loss <= 30
15
All Non-crashed Sweep Runs
24
Crashed Runs
6
Add a comment