Skip to main content
marin-community
Projects
marin
Reports
845/6 Wiki and Arxiv Quality Ablations

845/6 Wiki and Arxiv Quality Ablations

Herumb Shandilya
Created on March 20|Last edited on April 1

662k664k666k668k670kStep2.52.522.542.562.58
8b-quality-eval-tokenized-stackexchange-markdownified-f7cb9d
8b-quality-eval-tokenized-ar5iv-no-problem-markdownified-b4c053
8b-quality-eval-tokenized-wikipedia-markdownified-6d1982
llama-8b-anneal-eu-all-dolma-hq-w-flan15-b1dffb
llama-8b-anneal-eu-tokenized-dolma-arxiv-long-w-flan15-4418ad
llama-8b-anneal-eu-tokenized-dolma-megawika-long-w-flan15-85deae
llama-8b-anneal-eu-tokenized-dolma-flan-long-b39003
llama-8b-anneal-control-eu-long-72568e
662k664k666k668k670kStep0.770.7750.780.7850.790.795
8b-quality-eval-tokenized-stackexchange-markdownified-f7cb9d
8b-quality-eval-tokenized-ar5iv-no-problem-markdownified-b4c053
8b-quality-eval-tokenized-wikipedia-markdownified-6d1982
llama-8b-anneal-eu-all-dolma-hq-w-flan15-b1dffb
llama-8b-anneal-eu-tokenized-dolma-arxiv-long-w-flan15-4418ad
llama-8b-anneal-eu-tokenized-dolma-megawika-long-w-flan15-85deae
llama-8b-anneal-eu-tokenized-dolma-flan-long-b39003
llama-8b-anneal-control-eu-long-72568e
670k670.5k671k671.5kStep0.5650.570.5750.580.585
8b-quality-eval-tokenized-stackexchange-markdownified-f7cb9d
8b-quality-eval-tokenized-ar5iv-no-problem-markdownified-b4c053
8b-quality-eval-tokenized-wikipedia-markdownified-6d1982
llama-8b-anneal-eu-all-dolma-hq-w-flan15-b1dffb
llama-8b-anneal-eu-tokenized-dolma-arxiv-long-w-flan15-4418ad
llama-8b-anneal-eu-tokenized-dolma-megawika-long-w-flan15-85deae
llama-8b-anneal-eu-tokenized-dolma-flan-long-b39003
llama-8b-anneal-control-eu-long-72568e
670k670.5k671k671.5kStep0.5950.60.6050.61
8b-quality-eval-tokenized-stackexchange-markdownified-f7cb9d
8b-quality-eval-tokenized-ar5iv-no-problem-markdownified-b4c053
8b-quality-eval-tokenized-wikipedia-markdownified-6d1982
llama-8b-anneal-eu-all-dolma-hq-w-flan15-b1dffb
llama-8b-anneal-eu-tokenized-dolma-arxiv-long-w-flan15-4418ad
llama-8b-anneal-eu-tokenized-dolma-megawika-long-w-flan15-85deae
llama-8b-anneal-eu-tokenized-dolma-flan-long-b39003
llama-8b-anneal-control-eu-long-72568e
Run set
8


Created with ❤️ on Weights & Biases.

https://wandb.ai/marin-community/marin/reports/845-6-Wiki-and-Arxiv-Quality-Ablations--VmlldzoxMTg4MzY2OA
Made with Weights & Biases. Sign up or log in to create reports like this one.