知識・質問応答

アプリケーション開発能力と安全性評価を強化し、実用的なLLM選定を支援

Yuya Yamamoto, Kei Kamata, Kotaro Yamamoto, Taichi Ibi, Kazuki Kurosawa, Hyunwoo Oh, Koshiro Murakami, chengwei gu, Richard Song, Akira Shibata

Created on August 26|Last edited on August 26

Comment

﻿
一般的知識 (general knowledge)Jaster（jcommonsenseqa, jemhopqa, niilc, aio）, MT-bench（stem）
﻿
📋 カテゴリ別リーダーボード
runs.summary["subcategory_table_general_knowledge"]
 - 5 of 77
jcommonsenseqa_0shot
jcommonsenseqa_fewshot
jemhopqa_0shot
jemhopqa_fewshot
niilc_0shot
niilc_fewshot
aio_0shot
aio_fewshot
stem_mtbench
model_name
6
26
4
21
23
run.name
AVG
Run set77
﻿
﻿
専門的知識 (expert knowledge)Jaster（jmmlu, mmlu_prox_ja）, HLE
﻿
Run set77
﻿
﻿
﻿
﻿

Add a comment