How to submit Model Evaluation Result
Created on July 12|Last edited on July 12
Comment
This report details the method for submitting evaluation results to the Nejumi Leaderboard. Please note that not all results can be published.
Here is the process:
Step 1: Perform the evaluation in your environment
Please refer to the README in the following GitHub repository:
If you do not have a wandb account or are using a dedicated cloud or on-premise wandb, please create a free account at wandb.ai and perform the evaluation on the multi-tenant SaaS platform.
💡
Step 2: Make the project containing the run public
First, change the project settings to public:
Click on "Settings" in your team where the run was created.
Scroll down and toggle off "Make all future team projects private (public sharing not allowed)."
Click on "Overview" in the project that contains the evaluation run.
Click on "Edit project details" in the top right.
Change the Project visibility to Public.
Step 3: Share the run URL with wandb
Please share the URL of the run with wandb at the contact point you inquired.
Add a comment