ait-toronto-evals-workshop Workspace – Weights & Biases

Skip to main content

Evaluations

Filter

inputs

output

DoomerBoomerScorer

is_right_based_on_human_annotation

metrics

match

Trace

Feedback

Status

model

self

accuracy

cohens_kappa

sample_size

true_count

true_fraction

Dumb Judge with Kappa

dumb_judge_api:v0

0.5926

0.0438

27

N/A

N/A

Smart Judge with Kappa

llm_judge_api:v0

0.9259

0.4

27

N/A

N/A

llm_judge_api:v0

noContextEvaluation:v0

N/A

N/A

N/A

N/A

N/A

llm_judge_api:v0

withContextEvaluation:v0

N/A

N/A

N/A

N/A

N/A

eval-2025-02-23-dazzling-plateau

return_input_row:v0

hitl_evaluation:v0

N/A

N/A

N/A

N/A

N/A

eval-2025-02-23-noble-star

with_structured_llm_call:v2

doomer_or_boomer_dataset-evaluation:v2

N/A

N/A

N/A

N/A

N/A

eval-2025-02-23-jubilant-river

with_structured_llm_call:v1

doomer_or_boomer_dataset-evaluation:v2

N/A

N/A

N/A

N/A

N/A

eval-2025-02-23-gentle-wolf

with_structured_llm_call:v0

doomer_or_boomer_dataset-evaluation:v2

N/A

N/A

N/A

N/A

N/A

eval-2025-02-23-proud-bird

function_to_evaluate:v1

doomer_or_boomer_dataset-evaluation:v1

N/A

N/A

N/A

15

0.5556

eval-2025-02-23-innocent-sun

function_to_evaluate:v1

doomer_or_boomer_dataset-evaluation:v1

N/A

N/A

N/A

15

0.5556

eval-2025-02-23-eager-wind

function_to_evaluate:v1

doomer_or_boomer_dataset-evaluation:v1

N/A

N/A

N/A

15

0.5556

eval-2025-02-23-bright-hill

function_to_evaluate:v0

doomer_or_boomer_dataset-evaluation:v0

N/A

N/A

N/A

0

0

1-12 of 12

Per page:

50