KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged

LoRA merged model from beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B

  • Developed by: beomi
  • License: apache-2.0
  • Finetuned from model : beomi/Solar-Ko-Recovery-11B

Eval with LogicKor

Default

Category Single turn Multi turn
์ดํ•ด(Understanding) 8.43 5.86
์ˆ˜ํ•™(Math) 3.86 1.00
๊ธ€์“ฐ๊ธฐ(Writing) 9.71 7.71
์ถ”๋ก (Reasoning) 7.57 3.86
์ฝ”๋”ฉ(Coding) 7.57 7.00
๋ฌธ๋ฒ•(Grammar) 7.43 4.14
Category Score
Single turn 7.43
Multi turn 4.93
Overall 6.18

1-Shot

Category Single turn Multi turn
์ถ”๋ก (Reasoning) 7.57 4.43
์ฝ”๋”ฉ(Coding) 7.29 8.57
์ˆ˜ํ•™(Math) 2.86 1.71
๊ธ€์“ฐ๊ธฐ(Writing) 9.29 7.57
์ดํ•ด(Understanding) 7.43 5.86
๋ฌธ๋ฒ•(Grammar) 7.29 4.71
Category Score
Single turn 6.95
Multi turn 5.48
Overall 6.21

CoT-1-Shot

Category Single turn Multi turn
์ฝ”๋”ฉ(Coding) 7.14 8.14
์ถ”๋ก (Reasoning) 6.86 3.57
๊ธ€์“ฐ๊ธฐ(Writing) 9.71 7.71
์ˆ˜ํ•™(Math) 2.29 1.14
์ดํ•ด(Understanding) 7.43 7.00
๋ฌธ๋ฒ•(Grammar) 7.29 3.14
Category Score
Single turn 6.79
Multi turn 5.12
Overall 5.95

Downloads last month
11
Safetensors
Model size
11B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged

Finetuned
(5)
this model
Quantizations
2 models

Space using beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged 1