Skip to main content
dongfu
Projects
MLlava
Reports
Mantis-8B-CLIP-LLaMA-3

Mantis-8B-CLIP-LLaMA-3

This is the training curves of model Mantis-8B-CLIP-LLaMA-3. It's reported to help reproduce mantis's training results. This training has 2 training failures, and models trainings are resumed from the previous checkpoint with the same hyper parameters
Dongfu Jiang
Created on August 5|Last edited on August 5
Hugging face Model Page: https://huggingface.co/TIGER-Lab/Mantis-8B-clip-llama3/


Section 1


1k2k3k4k5k6ktrain/global_step00.0000020.0000040.0000060.0000080.00001
llava_clip_llama3_8b_finetune_8192
llava_clip_llama3_8b_finetune_8192
llava_clip_llama3_8b_finetune_8192
1k2k3k4k5k6ktrain/global_step50100150200250
llava_clip_llama3_8b_finetune_8192
llava_clip_llama3_8b_finetune_8192
llava_clip_llama3_8b_finetune_8192
1k2k3k4k5k6ktrain/global_step1234
llava_clip_llama3_8b_finetune_8192
llava_clip_llama3_8b_finetune_8192
llava_clip_llama3_8b_finetune_8192
Run set
10



Run set
10


Created with ❤️ on Weights & Biases.

https://wandb.ai/dongfu/MLlava/reports/Mantis-8B-CLIP-LLaMA-3--Vmlldzo4OTM0MDk5
Made with Weights & Biases. Sign up or log in to create reports like this one.