Urakiny's workspace
Runs
1
State
Notes
User
Tags
Created
Runtime
Sweep
batch_size
cls_token_id
cooldown_epochs
decay_rate
device
dist_url
epochs
evaluation
exp_name
k_test
learnable_temp
local_rank
loss
lr
measurement_activation
measurement_dropout
measurement_emb_size
measurement_mask_rate
measurement_max_seq_len
measurement_model
measurement_num_heads
measurement_num_layers
mimic_benchmark_root
mimic_root
min_lr
mlp
n
n_features
notes_dropout
notes_emb_size
notes_mask_rate
notes_max_seq_len
notes_num_heads
notes_num_layers
opt
pad_token_id
rank
report_freq
sched
sep_token_id
temp
text_model
use_cls_token
use_measurements
Finished
-
urakiny
5h 55m 13s
-
32
101
0
1
cuda
env://
200
false
multimodal-mimic-3-pretraining-epoch-200
256
false
0
CLIP+MSE
0.0001
GELU(approximate='none')
0.1
128
0.1
256
Transformer
8
8
/workspaces/multimodal-mimic/mimic3-benchmarks
/workspaces/multimodal-mimic/raw-mimic3
1.0000e-8
128
15562
76
0.1
128
0.1
256
8
8
adamW
0
0
10
cosine
102
0.2
BERT
true
true
1-1
of 1