基礎的言語性能

アプリケーション開発能力と安全性評価を強化し、実用的なLLM選定を支援

Yuya Yamamoto, Kei Kamata, Kotaro Yamamoto, Taichi Ibi, Kazuki Kurosawa, Hyunwoo Oh, Koshiro Murakami, chengwei gu, Richard Song, Akira Shibata

Created on August 26|Last edited on August 26

Comment

﻿
意味解析 (semantic analysis)Jaster（jnli, janli, jsem, jsick, jamp）
﻿
📋 カテゴリ別リーダーボード
runs.summary["subcategory_table_semantic_analysis"]
 - 5 of 59
jnli_0shot
jnli_fewshot
janli_0shot
janli_fewshot
jsem_0shot
jsem_fewshot
jsick_0shot
jsick_fewshot
jamp_0shot
jamp_fewshot
model_name
4
3
5
1
7
run.name
AVG
Run set59
﻿
﻿
構文解析 (syntactic analysis)Jaster（jcola-in-domain, jcola-out-of-domain, jblimp）
﻿
Run set59
﻿
﻿
﻿
﻿

Add a comment