Skip to main content
yokey
Projects
SparseDPOv2
Reports
LogP Chosen & Rejected

LogP Chosen & Rejected

Yokey
Created on October 1|Last edited on October 1

Llama-3 8B


1k2k3k4k5ktrain/global_step-120-100-80-60-40-20
l3-8b-tldr-sppo
l3-8b-tldr-dpo-pdpo
l3-8b-tldr-slichf
l3-8b-tldr-simpo
l3-8b-tldr-cpo-rrhf
l3-8b-tldr-dpo-rdpo
l3-8b-tldr-cpo-sigmoid
l3-8b-tldr-dpo-ipo
Run set
10



Run set
10


Mistral 7B


Run set
156



Run set
156


Created with ❤️ on Weights & Biases.

https://wandb.ai/yokey/SparseDPOv2/reports/LogP-Chosen-Rejected--Vmlldzo5NTYxNTQx
Made with Weights & Biases. Sign up or log in to create reports like this one.