Skip to main content
crystal427
Projects
RWKVWorldLoraFT
Reports
RWKVLora Training Report1

RWKVLora Training Report1

we used pretrain model “RWKV-World-7b-CHNTuned-ctx4096” to train this lora
Crystal427
Created on July 18|Last edited on July 18
loss/lr condition on Training set 1.3

01k2k3kStep1.522.5
01k2k3kStep0.0000560.0000580.000060.0000620.0000640.0000660.000068
01k2k3kStep00.0050.010.0150.02
Run set
6



Run set
6


Created with ❤️ on Weights & Biases.

https://wandb.ai/crystal427/RWKVWorldLoraFT/reports/RWKVLora-Training-Report1--Vmlldzo0OTA2MTA5
Made with Weights & Biases. Sign up or log in to create reports like this one.