How to host private leaderboard

Created on April 23|Last edited on April 23
Comment
﻿
SaaSClick the 'Make a copy' button in the settings at the top right of the leaderboard to copy the leaderboard's project and utilize it within your company's environment! You can choose the destination of the copy!
﻿
﻿
Afterward, by clicking the '+' button to the right of each model in the 'Run set' tab, a new tab 'Run set2' will be added, showing a list of experiments conducted in the wandb project. Please add the tasks you want to execute in your company here. Then, the results will be displayed on the leaderboard.
﻿
Dedicated cloud / Onpremise
Download runsrequirements.txt
polars
tqdm
wandb==0.15.6
script to download runs
import wandb
﻿
#from wandb.apis.importers import WandbParquetImporter
﻿
importer = WandbParquetImporter(
    src_base_url="https://api.wandb.ai",# SaaS Base_URL
    src_api_key="your-saas-api-key-here",# SaaS API Key
    dst_base_url="https://your-dedicated-cloud.wandb.io",# Base_URL of your env (destination)
    dst_api_key="your-dedicatedcloud-apy-key-here",# API Key in your env (destination)
)
﻿
src_entity = "wandb-korea"
src_project = "korean-llm-leaderboard"# project to import
dst_entity = "your-dedicatedcloud-entity"# destination entity
dst_project = 'your-project-name' # destination project name
tag = "leaderboard"# tag all runs with "leaderboard"
﻿
runs = importer.collect_runs(src_entity)
﻿
for run in runs:
    if tag in run.tags():
        importer.import_run(run, overrides={"entity": dst_entity, "project":dst_project})
﻿
Create reportsIf you use dedicated cloud and onpremise, you need to create a leaderboard template with your report.
But, you can refer the existing report!!
﻿
Add a comment