Friedmuchbout's workspace
Runs
4
State
Notes
User
Tags
Created
Runtime
Sweep
_Config__is_set.batch_size
_Config__is_set.custom_eval_path
_Config__is_set.from_window
_Config__is_set.netuid
_Config__is_set.tasks
_Config__is_set.to_window
_Config__is_set.version
batch_size
cache_dir
config
current_version
custom_eval_path
eval_interval
force_reval
from_window
netuid
no_follow
no_version_checking
project
strict
subtensor._mock
subtensor.chain_endpoint
subtensor.network
tasks
to_window
version
version_history
latest/evaluator/benchmark/arc_challenge/acc_norm,none
latest/evaluator/benchmark/arc_easy/acc_norm,none
latest/evaluator/benchmark/hellaswag/acc_norm,none
latest/evaluator/benchmark/mmlu/acc,none
latest/evaluator/benchmark/mmlu_abstract_algebra/acc,none
latest/evaluator/benchmark/mmlu_anatomy/acc,none
latest/evaluator/benchmark/mmlu_astronomy/acc,none
latest/evaluator/benchmark/mmlu_business_ethics/acc,none
latest/evaluator/benchmark/mmlu_clinical_knowledge/acc,none
latest/evaluator/benchmark/mmlu_college_biology/acc,none
latest/evaluator/benchmark/mmlu_college_chemistry/acc,none
latest/evaluator/benchmark/mmlu_college_computer_science/acc,none
latest/evaluator/benchmark/mmlu_college_mathematics/acc,none
latest/evaluator/benchmark/mmlu_college_medicine/acc,none
latest/evaluator/benchmark/mmlu_college_physics/acc,none
latest/evaluator/benchmark/mmlu_computer_security/acc,none
latest/evaluator/benchmark/mmlu_conceptual_physics/acc,none
Crashed
joellidin
v2.1.3
17d 20h 17m 25s
-
true
true
true
true
true
true
true
8
models/cache
false
2.1.3
eval/
600
false
51836
3
false
false
templar-eval
false
false
wss://entrypoint-finney.opentensor.ai:443
finney
mmlu
52505
2.1.3
["2.1.1","2.1.3"]
0.32935
0.60522
0.60825
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Running
joellidin
v2.1.8
1mo 2d 3h 23m 22s
-
-
true
-
-
true
-
-
4
models/cache
false
2.1.8
eval_dataset
600
false
-
3
false
false
templar-eval
false
false
wss://entrypoint-finney.opentensor.ai:443
finney
arc_challenge,arc_easy,openbookqa,winogrande,piqa,hellaswag,mmlu
-
-
["2.1.0","2.1.1","2.0.11","2.1.2","2.1.3","2.1.4","2.1.5","2.1.6","2.1.7","2.1.8"]
0.48464
0.73359
0.75144
0.43719
0.35
0.5037
0.5
0.43
0.46415
0.44444
0.31
0.36
0.24
0.41618
0.23529
0.6
0.41277
Crashed
joellidin
v2.1.0
6d 8m 13s
-
true
true
-
true
-
-
-
4
models/cache
false
2.1.0
eval_dataset
600
-
-
3
-
false
templar-eval
false
false
wss://entrypoint-finney.opentensor.ai:443
finney
arc_challenge,arc_easy,openbookqa,winogrande,piqa,hellaswag
-
-
["2.0.10","2.0.11","2.1.0"]
0.40017
0.68561
0.68522
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
joellidin
v2.0.9
1d 15h 30m 21s
-
true
true
-
true
-
-
-
8
models/cache
false
2.0.9
eval_dataset/
600
-
-
3
-
false
templar-eval
false
false
wss://entrypoint-finney.opentensor.ai:443
finney
arc_challenge,arc_easy,openbookqa,winogrande,piqa,hellaswag
-
-
["2.0.9"]
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1-4
of 4