Skip to main content
dual-attention
Projects
dual_attention--Language_Modeling-Fineweb
Log in
Sign up
Project
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Awni00's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
50
Name
50 visualized
DAT-sa12-ra12-nr64-ns1024-sh8-nkvh6-734M_2024_08_21_07_48_32_resumed_2024_08_23_16_14_12
DAT-sa12-ra12-nr64-ns1024-sh8-nkvh6-734M_2024_08_21_07_48_32_resumed_2024_08_23_16_14_12
T-sa24-757M_2024_08_22_19_01_41
T-sa24-757M_2024_08_22_19_01_41
T-sa24-757M_2024_08_20_13_22_34 (recovered logs)
T-sa24-757M_2024_08_20_13_22_34 (recovered logs)
DAT-sa16-ra16-nr128-ns512-sh16-nkvh8-1.27B_2024_07_29_18_13_44_resumed_2024_08_22_00_59_59
DAT-sa16-ra16-nr128-ns512-sh16-nkvh8-1.27B_2024_07_29_18_13_44_resumed_2024_08_22_00_59_59
DAT-sa12-ra12-nr64-ns1024-sh8-nkvh6-734M_2024_08_21_07_48_32
DAT-sa12-ra12-nr64-ns1024-sh8-nkvh6-734M_2024_08_21_07_48_32
T-sa24-757M_2024_08_20_13_22_34
T-sa24-757M_2024_08_20_13_22_34
DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B_2024_07_31_08_52_58_resumed_2024_08_19_15_26_57
DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B_2024_07_31_08_52_58_resumed_2024_08_19_15_26_57
DAT-sa8-ra8-nr32-ns1024-sh8-nkvh4-343M_2024_07_30_16_55_13_resumed_2024_08_14_19_34_16
DAT-sa8-ra8-nr32-ns1024-sh8-nkvh4-343M_2024_07_30_16_55_13_resumed_2024_08_14_19_34_16
DAT-sa8-ra8-nr64-ns1024-sh8-nkvh4-343M_2024_07_30_13_58_00_resumed_2024_08_14_19_34_08
DAT-sa8-ra8-nr64-ns1024-sh8-nkvh4-343M_2024_07_30_13_58_00_resumed_2024_08_14_19_34_08
DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B_2024_07_31_08_52_58
DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B_2024_07_31_08_52_58
DAT-sa8-ra8-nr32-ns1024-sh8-nkvh4-343M_2024_07_30_16_55_13
DAT-sa8-ra8-nr32-ns1024-sh8-nkvh4-343M_2024_07_30_16_55_13
DAT-sa8-ra8-nr32-sr1-ns1024-sh8-nkvh4-332M_2024_07_30_16_02_44
DAT-sa8-ra8-nr32-sr1-ns1024-sh8-nkvh4-332M_2024_07_30_16_02_44
DAT-sa8-ra8-nr64-ns1024-sh8-nkvh4-343M_2024_07_30_13_58_00
DAT-sa8-ra8-nr64-ns1024-sh8-nkvh4-343M_2024_07_30_13_58_00
DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B_2024_07_29_23_38_47
DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B_2024_07_29_23_38_47
DAT-sa16-ra16-nr128-ns512-sh16-nkvh8-1.27B_2024_07_29_18_13_44
DAT-sa16-ra16-nr128-ns512-sh16-nkvh8-1.27B_2024_07_29_18_13_44
DAT-sa16-ra16-nr128-ns2048-sh8-nkvh8-1.27B_2024_07_28_06_17_28
DAT-sa16-ra16-nr128-ns2048-sh8-nkvh8-1.27B_2024_07_28_06_17_28
DAT-sa16-ra16-nr64-ns2048-sh8-nkvh8-1.27B_2024_07_28_00_48_29
DAT-sa16-ra16-nr64-ns2048-sh8-nkvh8-1.27B_2024_07_28_00_48_29
DAT-sa8-ra8-ns1024-sh8-nkvh2-330M_2024_07_19_13_50_14_resumed_2024_07_26_21_12_37
DAT-sa8-ra8-ns1024-sh8-nkvh2-330M_2024_07_19_13_50_14_resumed_2024_07_26_21_12_37
DAT-sa8-ra8-ns1024-sh8-nkvh4-343M_2024_07_19_13_50_14_resumed_2024_07_26_18_49_04
DAT-sa8-ra8-ns1024-sh8-nkvh4-343M_2024_07_19_13_50_14_resumed_2024_07_26_18_49_04
T-sa32-1.3B_2024_07_11_19_05_56_resumed_2024_07_26_18_41_46
T-sa32-1.3B_2024_07_11_19_05_56_resumed_2024_07_26_18_41_46
1-20
of 50
norm
norm
5k
10k
15k
Step
5
10
15
20
25
30
T-sa24-757M_2024_08_20_13_22_34 (recovered logs)
DAT-ra10sa6-362M_2024_07_09_22_10_16
DAT-ra8sa8-368M_2024_07_09_22_03_04
T-350M_2024_07_09_17_25_58
Previous
Next