Skip to main content
mmd
Projects
MIMIC_FMs_Public
Reports
08/10 Hyperparameter Tuning Sweep
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
08/10 Hyperparameter Tuning Sweep
Matthew McDermott
Created on August 10
|
Last edited on August 10
Comment
Hyperparameter Tuning Results
tuning_loss
tuning_loss
Showing first 10 runs
0
20
40
60
80
100
epoch
200
400
600
800
1000
1200
1400
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
generative_event_stream_transformer
Parameter importance with respect to
tuning_loss
Parameters
1-10
of 40
Config parameter
Importance
Correlation
config.head_dim
config.head_dim
config.do_split_embeddings
config.do_split_embeddings
config.input_dropout
config.input_dropout
optimization_config.lr_frac_warmup_steps
optimization_config.lr_frac_warmup_steps
config.seq_window_size
config.seq_window_size
optimization_config.weight_decay
optimization_config.weight_decay
config.num_attention_heads
config.num_attention_heads
config.TTE_lognormal_generation_num_components
config.TTE_lognormal_generation_num_components
data_config.max_seq_len
data_config.max_seq_len
config.resid_dropout
config.resid_dropout
Loading...
Sweep Runs with Tuning Loss <= 30
11
All Non-crashed Sweep Runs
18
Crashed Runs
4
Add a comment