Skip to main content
marin-community
Projects
marin
Reports
647: Wikipedia Training Runs with DOLMA source substitution

647: Wikipedia Training Runs with DOLMA source substitution

Herumb Shandilya
Created on January 13|Last edited on January 16
Paloma Evals

02k4k6k8kStep11.522.533.54
dolma-wiki-subbed-1.4b-resiliparse-with-pf-no-reference-no-links-981064
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-with--671aba
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-62515b
02k4k6k8kStep11.522.533.5
dolma-wiki-subbed-1.4b-resiliparse-with-pf-no-reference-no-links-981064
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-with--671aba
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-62515b
02k4k6k8kStep11.522.533.5
dolma-wiki-subbed-1.4b-resiliparse-with-pf-no-reference-no-links-981064
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-with--671aba
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-62515b
02k4k6k8kStep1.522.533.544.5
dolma-wiki-subbed-1.4b-resiliparse-with-pf-no-reference-no-links-981064
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-with--671aba
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-62515b
02k4k6k8kStep2345
dolma-wiki-subbed-1.4b-resiliparse-with-pf-no-reference-no-links-981064
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-with--671aba
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-62515b
02k4k6k8kStep1.522.533.54
dolma-wiki-subbed-1.4b-resiliparse-with-pf-no-reference-no-links-981064
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-with--671aba
dolma-wiki-subbed-1.4b-resiliparse-with-pf-with-references-62515b
Run set
3

Internal Evals:

Run set
3

LM Eval Harness

Run set
3


Created with ❤️ on Weights & Biases.

https://wandb.ai/marin-community/marin/reports/647-Wikipedia-Training-Runs-with-DOLMA-source-substitution--VmlldzoxMDkyNjIxNw
Made with Weights & Biases. Sign up or log in to create reports like this one.