doppelganger Workspace – Weights & Biases

Skip to main content

Furiousteabag's workspace

Runs

9

Name

5 visualized

Full bs64 fix-fsdp

Full bs64 fix-fsdp

Full bs128 2x-data

Full bs128 2x-data

Full bs128 fixed-tokenizer2

Full bs128 fixed-tokenizer2

Full bs128 fixed-tokenizer

Full bs128 fixed-tokenizer

LoRA cosine0.03 2e-4 bs16 r32 a16

LoRA cosine0.03 2e-4 bs16 r32 a16

LoRA cosine0.3 2e-4 bs16 r16 a16

LoRA cosine0.3 2e-4 bs16 r16 a16

LoRA linear 2e-4 bs16 r16 a16

LoRA linear 2e-4 bs16 r16 a16

LoRA linear 3e-5 bs32 r16 a16

LoRA linear 3e-5 bs32 r16 a16

1-9

of 9

train

10

train/train_loss

train/train_loss

train/loss

train/loss

Full bs64 fix-fsdp

Full bs128 2x-data

Full bs128 fixed-tokenizer2

Full bs128 fixed-tokenizer

train/learning_rate

train/learning_rate

Full bs64 fix-fsdp

Full bs128 2x-data

Full bs128 fixed-tokenizer2

Full bs128 fixed-tokenizer

train/global_step

train/global_step

Full bs64 fix-fsdp

Full bs128 2x-data

Full bs128 fixed-tokenizer2

Full bs128 fixed-tokenizer

train/train_runtime

train/train_runtime

train/train_samples_per_second

train/train_samples_per_second

To pick up a draggable item, press the space bar. While dragging, use the arrow keys to move the item. Press space again to drop the item in its new position, or press escape to cancel.