germanic-nlg.md

layout	title
leaderboard	Germanic NLG 🇪🇺

Last updated: 11/01/2025 17:23:14 CET

Include merged models

Model ID	Parameters	Vocabulary size	Context	Commercial	Speed	Rank	Danish Rank	Norwegian Rank	Swedish Rank	Icelandic Rank	Faroese Rank	German Rank	Dutch Rank	English Rank	DANSK	Angry Tweets	ScaLA-da	ScandiQA-da	Nordjylland-News	Danske Talemaader	Danish Citizen Tests	HellaSwag-da	NorNE-nb	NorNE-nn	NoReC	No Sammendrag	ScaLA-nb	ScaLA-nn	NorQuAD	MMLU-no	HellaSwag-no	SUC3	SweReC	ScaLA-sv	ScandiQA-sv	SweDN	MMLU-sv	HellaSwag-sv	MIM-GOLD-NER	Hotter-and-Colder-sentiment	ScaLA-is	NQiI	RRN	ARC-is	Winogrande-is	FoNE	FoSent	ScaLA-fo	FoQA	GermEval	SB10k	ScaLA-de	GermanQuAD	MLSum	MMLU-de	HellaSwag-de	CoNLL-nl	Dutch Social	ScaLA-nl	SQuAD-nl	Wiki-Lingua-NL	MMLU-nl	HellaSwag-nl	CoNLL-en	SST5	ScaLA-en	SQuAD	CNN-DailyMail	MMLU	HellaSwag	DANSK version	Angry Tweets version	ScaLA-da version	ScandiQA-da version	Nordjylland-News version	Danske Talemaader version	Danish Citizen Tests version	HellaSwag-da version	NorNE-nb version	NorNE-nn version	NoReC version	No Sammendrag version	ScaLA-nb version	ScaLA-nn version	NorQuAD version	MMLU-no version	HellaSwag-no version	SUC3 version	SweReC version	ScaLA-sv version	ScandiQA-sv version	SweDN version	MMLU-sv version	HellaSwag-sv version	MIM-GOLD-NER version	Hotter-and-Colder-sentiment version	ScaLA-is version	NQiI version	RRN version	ARC-is version	Winogrande-is version	FoNE version	FoSent version	ScaLA-fo version	FoQA version	GermEval version	SB10k version	ScaLA-de version	GermanQuAD version	MLSum version	MMLU-de version	HellaSwag-de version	CoNLL-nl version	Dutch Social version	ScaLA-nl version	SQuAD-nl version	Wiki-Lingua-NL version	MMLU-nl version	HellaSwag-nl version	CoNLL-en version	SST5 version	ScaLA-en version	SQuAD version	CNN-DailyMail version	MMLU version	HellaSwag version
gpt-4-1106-preview (few-shot, val)	unknown	100	128000	True	576 ± 221 / 81 ± 28	1.24	1.14	1.28	1.08	1.12	1.29	1.30	1.52	1.21	66.80 ± 3.01 / 45.69 ± 2.85	61.62 ± 2.17 / 73.99 ± 1.48	66.84 ± 3.27 / 82.79 ± 1.86	56.85 ± 2.62 / 68.83 ± 1.50	66.21 ± 0.44 / 18.02 ± 0.61	95.21 ± 0.55 / 96.41 ± 0.41	97.19 ± 1.15 / 98.12 ± 0.76	78.74 ± 3.12 / 83.91 ± 2.42	77.48 ± 2.32 / 55.87 ± 2.83	78.70 ± 2.78 / 57.58 ± 4.23	62.55 ± 2.82 / 72.41 ± 2.42	63.60 ± 0.15 / 13.15 ± 0.35	74.45 ± 4.27 / 86.22 ± 2.49	56.31 ± 5.81 / 74.04 ± 4.03	44.67 ± 3.23 / 73.39 ± 1.83	70.84 ± 1.92 / 78.12 ± 1.44	86.30 ± 2.04 / 89.53 ± 1.60	74.45 ± 3.09 / 49.97 ± 4.23	77.59 ± 1.38 / 78.78 ± 1.69	71.35 ± 3.10 / 83.98 ± 2.23	56.56 ± 1.39 / 66.76 ± 1.10	66.08 ± 0.14 / 17.19 ± 0.38	71.32 ± 1.56 / 78.48 ± 1.15	84.09 ± 2.99 / 88.01 ± 2.26	86.37 ± 1.19 / 82.25 ± 2.73	49.59 ± 2.76 / 62.50 ± 2.08	43.03 ± 5.07 / 71.18 ± 2.64	37.26 ± 2.60 / 66.04 ± 1.95	69.61 ± 0.61 / 23.98 ± 1.17	89.09 ± 1.59 / 91.76 ± 1.19	72.03 ± 3.91 / 86.09 ± 1.96	86.51 ± 2.01 / 85.01 ± 2.45	38.22 ± 8.49 / 52.33 ± 6.78	35.09 ± 5.70 / 65.72 ± 3.27	58.65 ± 3.25 / 81.93 ± 2.20	68.94 ± 2.50 / 44.89 ± 2.85	60.47 ± 2.94 / 72.79 ± 1.90	51.26 ± 4.94 / 74.76 ± 2.45	30.04 ± 1.30 / 58.77 ± 1.50	63.62 ± 0.65 / 13.08 ± 0.87	73.80 ± 2.03 / 80.31 ± 1.54	83.93 ± 2.38 / 87.85 ± 1.80	66.44 ± 2.18 / 56.97 ± 2.87	14.22 ± 3.26 / 33.41 ± 3.24	72.30 ± 2.26 / 85.96 ± 1.13	57.81 ± 1.23 / 74.51 ± 0.62	67.13 ± 0.50 / 17.61 ± 0.76	70.04 ± 1.91 / 77.58 ± 1.42	88.29 ± 2.26 / 91.17 ± 1.70	81.79 ± 1.39 / 65.51 ± 4.16	67.55 ± 2.34 / 74.04 ± 1.80	51.21 ± 4.96 / 75.11 ± 2.42	66.60 ± 1.45 / 84.48 ± 0.76	68.80 ± 0.43 / 21.84 ± 0.45	81.71 ± 1.12 / 86.29 ± 0.83	89.91 ± 1.81 / 92.38 ± 1.34	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2	12.5.1	13.2.0	12.10.2	12.5.1	12.5.1	12.10.8	12.10.2	12.5.1	13.3.0	12.5.1	13.0.0	12.6.1	12.10.2	12.10.2	12.6.1	12.6.1	12.10.2	12.10.2	12.3.2	12.10.2	12.10.2	12.3.2	12.3.2	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2
meta-llama/Llama-3.1-405B-Instruct-FP8 (few-shot)	405869	128	131072	True	799 ± 246 / 112 ± 38	1.39	1.13	1.47	1.08	1.69	1.65	1.26	1.63	1.19	71.94 ± 1.37 / 61.59 ± 1.44	61.26 ± 1.20 / 73.27 ± 0.95	64.94 ± 1.80 / 81.65 ± 1.13	56.00 ± 2.32 / 66.00 ± 1.23	67.44 ± 0.26 / 21.15 ± 0.71	89.91 ± 0.92 / 92.43 ± 0.69	96.37 ± 0.73 / 97.58 ± 0.49	81.66 ± 1.00 / 86.23 ± 0.75	82.44 ± 1.19 / 81.86 ± 1.20	82.17 ± 0.89 / 82.07 ± 1.38	40.55 ± 0.50 / 40.35 ± 0.39	66.76 ± 0.53 / 19.71 ± 1.09	63.91 ± 1.57 / 79.76 ± 1.13	45.93 ± 1.97 / 67.09 ± 1.85	45.33 ± 1.59 / 73.27 ± 1.24	73.55 ± 1.00 / 80.20 ± 0.75	81.37 ± 0.81 / 86.02 ± 0.61	76.27 ± 1.55 / 73.77 ± 1.72	80.70 ± 0.46 / 79.67 ± 0.67	68.85 ± 1.48 / 83.10 ± 0.95	56.41 ± 2.22 / 66.31 ± 1.05	67.18 ± 0.12 / 20.05 ± 0.26	75.85 ± 0.70 / 81.89 ± 0.53	81.49 ± 0.52 / 86.08 ± 0.40	66.40 ± 3.96 / 65.04 ± 4.36	53.84 ± 1.13 / 67.24 ± 1.23	26.22 ± 2.28 / 57.33 ± 2.21	26.49 ± 1.58 / 54.41 ± 1.48	69.88 ± 0.18 / 23.58 ± 0.58	77.37 ± 0.87 / 83.04 ± 0.66	59.56 ± 1.97 / 79.38 ± 1.05	81.95 ± 1.35 / 81.71 ± 1.81	53.25 ± 1.76 / 50.18 ± 1.09	14.29 ± 2.45 / 40.76 ± 1.85	60.41 ± 1.26 / 79.84 ± 0.96	72.87 ± 1.32 / 69.43 ± 1.71	60.79 ± 2.05 / 71.73 ± 2.13	50.25 ± 1.78 / 74.33 ± 0.79	28.34 ± 1.37 / 57.73 ± 1.57	66.17 ± 0.18 / 18.11 ± 0.49	74.98 ± 0.83 / 81.27 ± 0.62	83.48 ± 1.05 / 87.58 ± 0.78	69.12 ± 2.03 / 64.39 ± 2.33	11.23 ± 1.27 / 20.82 ± 0.81	68.74 ± 0.69 / 83.97 ± 0.59	55.25 ± 3.26 / 73.34 ± 1.13	70.51 ± 1.10 / 24.87 ± 1.85	74.89 ± 1.06 / 81.14 ± 0.79	80.93 ± 1.07 / 85.65 ± 0.81	82.86 ± 0.87 / 81.12 ± 1.04	70.60 ± 1.14 / 73.47 ± 1.06	53.80 ± 1.81 / 76.34 ± 1.02	62.69 ± 1.45 / 82.32 ± 0.61	69.33 ± 0.08 / 23.72 ± 0.38	80.39 ± 0.78 / 85.32 ± 0.59	88.02 ± 0.99 / 91.00 ± 0.75	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
gpt-4o-2024-05-13 (few-shot, val)	unknown	200	128000	True	916 ± 329 / 114 ± 38	1.44	1.20	1.25	1.09	1.20	2.46	1.37	1.64	1.31	71.15 ± 2.89 / 52.24 ± 3.76	49.42 ± 3.29 / 61.74 ± 2.59	64.59 ± 2.97 / 79.93 ± 1.88	57.35 ± 2.51 / 67.87 ± 1.75	66.03 ± 0.24 / 17.74 ± 0.71	96.41 ± 0.63 / 97.30 ± 0.48	97.68 ± 1.06 / 98.44 ± 0.72	85.96 ± 1.48 / 89.41 ± 1.15	79.07 ± 3.01 / 64.17 ± 3.51	81.56 ± 2.45 / 64.06 ± 4.11	66.66 ± 1.91 / 77.70 ± 1.29	63.25 ± 0.26 / 13.02 ± 0.33	64.53 ± 6.09 / 79.17 ± 4.89	54.70 ± 4.36 / 74.94 ± 3.26	43.51 ± 3.40 / 74.52 ± 1.79	73.81 ± 1.88 / 80.39 ± 1.45	89.91 ± 1.13 / 92.42 ± 0.83	76.66 ± 2.11 / 60.34 ± 4.71	77.16 ± 2.65 / 79.22 ± 2.36	68.99 ± 4.33 / 83.37 ± 2.61	57.96 ± 1.35 / 67.71 ± 0.96	66.00 ± 0.29 / 16.97 ± 0.45	70.70 ± 1.32 / 77.97 ± 0.99	86.30 ± 2.23 / 89.65 ± 1.68	81.19 ± 2.45 / 54.02 ± 5.60	49.86 ± 5.14 / 64.51 ± 3.68	51.10 ± 5.09 / 73.25 ± 3.42	29.64 ± 2.12 / 55.46 ± 1.12	68.25 ± 0.27 / 19.22 ± 0.51	91.27 ± 1.41 / 93.40 ± 1.09	70.85 ± 5.98 / 85.55 ± 3.05	81.86 ± 2.08 / 67.98 ± 3.64	27.30 ± 11.60 / 55.31 ± 9.21	-0.97 ± 2.82 / 33.64 ± 0.85	56.45 ± 2.88 / 78.76 ± 1.86	69.99 ± 1.63 / 45.58 ± 2.42	54.82 ± 2.19 / 68.42 ± 1.67	43.66 ± 5.67 / 64.64 ± 4.65	30.06 ± 1.04 / 60.77 ± 1.11	63.80 ± 0.60 / 13.87 ± 1.05	74.13 ± 1.60 / 80.59 ± 1.22	88.18 ± 1.79 / 91.13 ± 1.34	76.75 ± 3.44 / 61.13 ± 4.40	10.80 ± 2.24 / 32.52 ± 2.18	56.26 ± 4.51 / 73.83 ± 3.26	55.55 ± 2.54 / 76.28 ± 1.13	66.86 ± 0.46 / 16.93 ± 0.91	73.11 ± 1.87 / 79.69 ± 1.46	92.69 ± 1.46 / 94.53 ± 1.09	83.48 ± 1.52 / 75.51 ± 2.26	62.74 ± 2.04 / 71.28 ± 1.46	46.56 ± 3.35 / 71.13 ± 1.97	65.41 ± 1.96 / 84.78 ± 0.68	67.64 ± 0.97 / 20.90 ± 0.92	78.55 ± 1.82 / 83.91 ± 1.34	91.34 ± 1.66 / 93.48 ± 1.27	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2	12.10.0	13.2.0	12.10.2	12.10.0	12.10.0	12.10.8	12.10.2	12.10.0	13.3.0	12.10.0	13.0.0	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2	12.10.0	12.10.2	12.10.2	12.10.0	12.10.0	12.10.2	12.10.2
meta-llama/Llama-3.1-70B-Instruct (few-shot)	70554	128	131072	True	1,409 ± 457 / 186 ± 63	1.49	1.29	1.59	1.23	1.81	1.69	1.33	1.71	1.27	68.57 ± 0.95 / 50.90 ± 2.30	60.52 ± 1.22 / 72.91 ± 1.05	57.57 ± 0.79 / 78.54 ± 0.46	54.33 ± 1.19 / 63.94 ± 0.72	68.01 ± 0.18 / 22.86 ± 0.45	87.22 ± 1.10 / 90.39 ± 0.83	92.93 ± 1.26 / 95.29 ± 0.84	70.23 ± 1.06 / 77.20 ± 0.89	80.05 ± 0.87 / 67.79 ± 1.90	80.67 ± 0.92 / 69.11 ± 3.29	40.65 ± 0.45 / 40.56 ± 0.29	66.56 ± 0.47 / 19.70 ± 1.10	56.42 ± 1.70 / 76.10 ± 1.29	38.21 ± 3.25 / 64.61 ± 2.89	49.22 ± 2.20 / 74.92 ± 1.35	65.19 ± 0.76 / 73.71 ± 0.58	69.47 ± 1.66 / 76.67 ± 1.30	72.16 ± 1.93 / 50.59 ± 2.82	81.69 ± 0.62 / 81.33 ± 0.85	63.97 ± 1.73 / 81.83 ± 0.85	57.99 ± 1.26 / 66.35 ± 0.76	66.85 ± 0.08 / 19.44 ± 0.20	69.59 ± 0.71 / 77.05 ± 0.52	70.40 ± 1.27 / 77.35 ± 1.04	69.95 ± 2.18 / 42.88 ± 4.51	51.27 ± 1.19 / 63.66 ± 1.02	18.75 ± 1.65 / 55.50 ± 0.89	30.79 ± 1.22 / 56.29 ± 1.87	69.53 ± 0.17 / 23.61 ± 0.48	75.02 ± 0.81 / 81.25 ± 0.60	48.44 ± 2.47 / 74.68 ± 1.23	79.04 ± 1.57 / 69.20 ± 3.32	52.33 ± 2.11 / 49.69 ± 1.21	15.72 ± 2.73 / 53.70 ± 3.15	59.08 ± 1.71 / 79.21 ± 1.19	72.11 ± 1.42 / 54.20 ± 2.19	59.87 ± 1.63 / 72.22 ± 1.34	46.82 ± 1.39 / 72.14 ± 0.64	30.64 ± 1.27 / 57.19 ± 1.78	66.20 ± 0.16 / 18.95 ± 0.43	68.80 ± 0.65 / 76.52 ± 0.52	73.49 ± 1.15 / 79.81 ± 0.87	68.82 ± 1.86 / 53.75 ± 2.33	11.41 ± 1.33 / 21.26 ± 0.89	61.66 ± 1.04 / 80.70 ± 0.54	55.43 ± 1.71 / 74.07 ± 0.54	69.51 ± 0.76 / 23.39 ± 1.19	68.61 ± 1.24 / 76.39 ± 0.93	69.72 ± 1.33 / 76.77 ± 1.11	83.16 ± 0.92 / 78.18 ± 0.71	69.96 ± 0.89 / 72.99 ± 0.72	50.83 ± 1.22 / 74.22 ± 0.70	60.82 ± 1.25 / 81.99 ± 0.50	69.21 ± 0.07 / 23.55 ± 0.30	77.51 ± 0.75 / 83.07 ± 0.56	83.85 ± 0.63 / 87.76 ± 0.49	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3
meta-llama/Llama-3.3-70B-Instruct (few-shot)	70554	128	131072	True	1,353 ± 443 / 180 ± 61	1.58	1.34	1.65	1.25	1.92	1.81	1.50	1.82	1.35	67.07 ± 1.22 / 48.82 ± 2.09	59.89 ± 0.97 / 72.51 ± 0.84	56.56 ± 2.10 / 77.06 ± 1.62	49.02 ± 0.61 / 62.78 ± 0.39	67.00 ± 0.17 / 20.23 ± 0.45	87.31 ± 0.95 / 90.47 ± 0.71	94.13 ± 0.91 / 96.09 ± 0.61	76.43 ± 0.81 / 82.11 ± 0.65	79.84 ± 1.02 / 67.96 ± 2.10	79.93 ± 0.81 / 68.93 ± 2.65	41.11 ± 0.41 / 40.48 ± 0.38	65.38 ± 0.46 / 16.49 ± 1.02	57.84 ± 1.77 / 77.97 ± 1.19	43.52 ± 2.51 / 69.59 ± 2.20	40.92 ± 1.45 / 69.52 ± 1.07	66.69 ± 0.64 / 74.99 ± 0.47	75.66 ± 1.08 / 81.60 ± 0.80	71.98 ± 2.05 / 51.44 ± 3.30	81.15 ± 0.64 / 80.25 ± 0.97	64.46 ± 1.14 / 81.56 ± 0.73	51.22 ± 1.77 / 64.14 ± 1.00	66.63 ± 0.10 / 18.54 ± 0.22	70.79 ± 0.74 / 78.05 ± 0.55	75.48 ± 0.71 / 81.42 ± 0.56	69.04 ± 1.73 / 41.91 ± 4.10	50.79 ± 1.13 / 62.68 ± 1.21	20.36 ± 1.78 / 55.23 ± 2.44	24.56 ± 1.12 / 49.35 ± 1.46	69.13 ± 0.22 / 21.75 ± 0.61	77.24 ± 1.01 / 82.95 ± 0.76	46.46 ± 2.66 / 72.82 ± 1.44	78.46 ± 1.42 / 66.11 ± 4.28	51.60 ± 1.99 / 49.29 ± 1.20	17.25 ± 3.90 / 53.45 ± 4.72	50.98 ± 1.67 / 72.58 ± 1.07	70.47 ± 1.16 / 51.68 ± 2.18	60.55 ± 2.01 / 72.05 ± 1.69	50.13 ± 1.53 / 72.87 ± 0.69	20.42 ± 0.81 / 47.44 ± 1.06	65.20 ± 0.10 / 15.59 ± 0.30	69.32 ± 0.80 / 76.95 ± 0.62	78.33 ± 0.90 / 83.58 ± 0.69	70.37 ± 1.97 / 56.00 ± 2.79	10.87 ± 1.05 / 19.75 ± 0.82	62.87 ± 1.48 / 81.12 ± 0.82	44.30 ± 1.09 / 68.76 ± 0.55	69.36 ± 0.65 / 22.77 ± 1.04	68.82 ± 1.12 / 76.61 ± 0.84	74.72 ± 0.75 / 80.76 ± 0.61	82.35 ± 0.76 / 76.42 ± 0.70	71.07 ± 0.91 / 72.62 ± 0.74	51.27 ± 1.18 / 74.25 ± 0.77	50.23 ± 1.33 / 76.00 ± 0.67	68.77 ± 0.05 / 22.03 ± 0.24	76.73 ± 0.84 / 82.57 ± 0.63	86.49 ± 0.98 / 89.79 ± 0.76	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3
Qwen/Qwen2.5-72B-Instruct (few-shot)	72706	152	32768	True	1,219 ± 412 / 158 ± 53	1.59	1.41	1.71	1.33	2.07	1.65	1.37	1.83	1.32	63.81 ± 1.27 / 42.18 ± 2.59	54.50 ± 1.55 / 69.89 ± 1.02	57.19 ± 1.30 / 78.30 ± 0.79	55.77 ± 0.97 / 67.26 ± 0.69	64.62 ± 0.14 / 14.36 ± 0.29	82.81 ± 0.92 / 87.00 ± 0.70	87.32 ± 1.12 / 91.56 ± 0.75	77.57 ± 0.86 / 83.06 ± 0.66	72.21 ± 1.25 / 49.58 ± 2.05	70.24 ± 1.23 / 52.09 ± 2.38	39.85 ± 0.65 / 39.69 ± 0.52	62.86 ± 0.09 / 11.19 ± 0.11	63.14 ± 1.27 / 81.41 ± 0.62	43.24 ± 1.56 / 71.36 ± 0.86	43.41 ± 3.02 / 73.20 ± 2.14	70.20 ± 1.16 / 77.50 ± 0.86	76.79 ± 1.16 / 82.49 ± 0.90	62.12 ± 2.14 / 39.19 ± 2.64	79.89 ± 0.97 / 80.23 ± 0.85	61.71 ± 1.08 / 80.82 ± 0.54	54.99 ± 0.94 / 66.56 ± 0.46	65.38 ± 0.08 / 16.18 ± 0.12	70.61 ± 0.65 / 77.88 ± 0.48	76.53 ± 0.83 / 82.29 ± 0.62	68.54 ± 1.33 / 42.62 ± 3.69	47.72 ± 1.58 / 64.00 ± 1.39	22.98 ± 1.57 / 61.08 ± 0.91	26.72 ± 1.78 / 55.63 ± 0.93	66.93 ± 0.10 / 17.14 ± 0.19	67.74 ± 1.27 / 75.78 ± 0.96	36.29 ± 2.04 / 68.27 ± 1.01	76.56 ± 1.09 / 58.59 ± 3.63	46.61 ± 1.58 / 47.25 ± 1.29	23.45 ± 2.41 / 59.84 ± 1.99	55.28 ± 2.18 / 77.14 ± 1.37	68.94 ± 0.70 / 51.96 ± 2.24	58.78 ± 1.77 / 72.15 ± 1.29	52.66 ± 1.92 / 75.17 ± 0.93	27.62 ± 0.83 / 57.71 ± 0.89	63.32 ± 0.06 / 12.00 ± 0.10	70.49 ± 0.48 / 77.80 ± 0.36	81.41 ± 0.90 / 85.98 ± 0.68	67.16 ± 1.61 / 44.06 ± 2.06	9.84 ± 1.35 / 19.81 ± 0.75	66.06 ± 1.20 / 82.87 ± 0.67	50.91 ± 2.59 / 71.45 ± 0.89	64.83 ± 0.23 / 15.04 ± 0.29	73.09 ± 0.79 / 79.74 ± 0.60	79.00 ± 0.83 / 84.13 ± 0.64	75.84 ± 1.19 / 69.70 ± 0.91	68.66 ± 1.08 / 74.39 ± 0.68	56.46 ± 2.43 / 76.75 ± 1.60	58.39 ± 1.84 / 81.86 ± 0.68	68.32 ± 0.06 / 20.52 ± 0.14	78.29 ± 1.05 / 83.70 ± 0.78	86.39 ± 0.74 / 89.77 ± 0.56	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
gpt-4o-2024-05-13 (zero-shot, val)	unknown	200	8191	True	637 ± 306 / 92 ± 31	1.60	1.39	1.68	1.24	1.82	1.87	1.60	1.82	1.39	64.80 ± 1.56 / 45.57 ± 1.47	53.07 ± 1.45 / 68.64 ± 1.04	64.18 ± 3.36 / 81.90 ± 1.68	49.02 ± 1.18 / 63.09 ± 1.29	64.78 ± 0.17 / 13.85 ± 0.23	90.74 ± 1.55 / 93.05 ± 1.15	95.22 ± 1.04 / 96.80 ± 0.70	78.10 ± 2.23 / 83.59 ± 1.69	77.72 ± 1.59 / 57.89 ± 2.50	71.70 ± 2.52 / 50.78 ± 2.60	36.27 ± 1.67 / 35.73 ± 0.92	62.76 ± 0.16 / 10.95 ± 0.13	71.70 ± 2.39 / 85.59 ± 1.30	58.79 ± 1.33 / 76.83 ± 0.92	40.95 ± 1.31 / 72.82 ± 0.88	69.22 ± 1.77 / 76.95 ± 1.30	76.40 ± 1.27 / 82.27 ± 0.91	75.06 ± 2.26 / 44.92 ± 1.50	74.85 ± 2.89 / 74.58 ± 2.54	65.23 ± 2.16 / 80.52 ± 1.22	53.02 ± 1.40 / 63.85 ± 1.17	65.80 ± 0.15 / 15.36 ± 0.14	71.87 ± 1.77 / 78.87 ± 1.32	69.98 ± 2.38 / 77.42 ± 1.70	72.85 ± 2.10 / 33.36 ± 1.59	53.43 ± 2.20 / 66.07 ± 1.59	49.26 ± 4.89 / 73.99 ± 2.32	27.36 ± 0.94 / 48.73 ± 0.97	67.01 ± 0.08 / 15.62 ± 0.12	78.98 ± 1.73 / 83.91 ± 1.34	9.83 ± 4.86 / 60.62 ± 2.37	68.00 ± 1.08 / 37.75 ± 1.09	27.30 ± 4.69 / 30.12 ± 3.11	28.09 ± 3.31 / 54.91 ± 2.24	58.59 ± 1.88 / 77.38 ± 1.63	67.18 ± 1.47 / 35.10 ± 1.57	50.12 ± 2.00 / 65.79 ± 1.25	44.98 ± 4.97 / 71.63 ± 2.39	27.01 ± 1.67 / 55.19 ± 1.49	63.10 ± 0.20 / 11.09 ± 0.30	74.22 ± 1.79 / 80.74 ± 1.32	69.31 ± 1.88 / 76.76 ± 1.46	69.12 ± 2.60 / 41.51 ± 2.79	12.36 ± 2.16 / 19.95 ± 1.34	58.88 ± 2.34 / 79.01 ± 1.24	45.88 ± 1.32 / 70.93 ± 1.49	64.37 ± 0.09 / 13.15 ± 0.11	70.81 ± 1.85 / 78.12 ± 1.39	84.34 ± 2.59 / 88.20 ± 1.98	81.23 ± 1.31 / 72.72 ± 1.69	63.46 ± 1.00 / 69.35 ± 1.28	46.45 ± 4.58 / 72.89 ± 2.30	57.64 ± 1.26 / 81.53 ± 0.66	68.71 ± 0.14 / 20.56 ± 0.22	80.09 ± 2.42 / 85.12 ± 1.78	86.91 ± 1.20 / 90.04 ± 0.92	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3
Qwen/QwQ-32B-Preview (few-shot)	32764	152	32768	True	2,258 ± 1,221 / 198 ± 67	1.65	1.52	1.83	1.39	2.24	1.97	1.24	1.81	1.20	64.66 ± 1.67 / 48.66 ± 3.44	53.42 ± 1.21 / 66.49 ± 1.21	53.93 ± 1.76 / 76.52 ± 1.14	55.55 ± 0.70 / 65.32 ± 0.49	64.54 ± 0.23 / 14.49 ± 0.50	72.75 ± 1.86 / 79.36 ± 1.42	78.49 ± 1.23 / 85.70 ± 0.81	74.11 ± 2.07 / 80.07 ± 1.72	75.68 ± 1.44 / 63.54 ± 3.33	75.89 ± 0.88 / 63.84 ± 4.94	38.41 ± 0.87 / 38.78 ± 0.71	62.79 ± 0.40 / 11.74 ± 0.41	56.42 ± 1.37 / 77.77 ± 0.78	39.34 ± 2.27 / 69.48 ± 1.18	44.35 ± 3.74 / 71.44 ± 3.05	61.53 ± 0.80 / 70.75 ± 0.62	67.36 ± 1.40 / 74.69 ± 1.14	69.73 ± 1.67 / 54.58 ± 4.83	78.76 ± 0.99 / 74.72 ± 2.08	57.57 ± 1.55 / 77.98 ± 1.00	56.43 ± 0.59 / 66.23 ± 0.53	65.53 ± 0.08 / 16.64 ± 0.08	64.02 ± 0.99 / 72.70 ± 0.81	67.11 ± 2.52 / 74.35 ± 2.14	65.08 ± 2.06 / 46.62 ± 5.37	48.71 ± 1.27 / 63.98 ± 0.90	20.51 ± 2.32 / 57.54 ± 3.00	28.29 ± 1.69 / 58.94 ± 2.10	65.67 ± 0.28 / 16.58 ± 0.37	52.92 ± 1.20 / 64.22 ± 0.87	28.01 ± 3.54 / 64.15 ± 1.73	77.19 ± 1.09 / 72.79 ± 2.09	45.55 ± 2.05 / 46.59 ± 1.05	16.92 ± 1.77 / 55.66 ± 2.98	47.51 ± 2.79 / 69.45 ± 2.43	70.66 ± 1.22 / 61.82 ± 2.45	59.33 ± 2.00 / 69.45 ± 2.43	54.53 ± 2.50 / 76.97 ± 1.30	32.66 ± 1.90 / 62.45 ± 2.73	65.00 ± 0.76 / 16.07 ± 1.83	67.84 ± 0.70 / 75.71 ± 0.55	79.00 ± 1.09 / 83.96 ± 0.86	71.32 ± 1.36 / 57.50 ± 3.60	9.12 ± 1.28 / 21.29 ± 0.75	63.96 ± 1.27 / 81.82 ± 0.72	58.36 ± 1.16 / 73.62 ± 0.47	66.59 ± 0.44 / 16.89 ± 0.53	67.82 ± 0.94 / 75.79 ± 0.71	78.26 ± 1.44 / 83.32 ± 1.15	76.84 ± 1.07 / 71.81 ± 0.77	68.94 ± 0.65 / 68.76 ± 1.24	57.74 ± 2.22 / 78.11 ± 1.52	71.22 ± 1.19 / 86.06 ± 0.60	68.96 ± 0.08 / 21.49 ± 0.18	75.15 ± 0.76 / 81.28 ± 0.58	87.36 ± 0.67 / 90.41 ± 0.52	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
ThatsGroes/gemma-2-27b-it-FP8-Dynamic (few-shot)	28411	256	4096	True	3,633 ± 1,236 / 777 ± 220	1.71	1.41	1.76	1.50	2.17	1.82	1.56	2.03	1.44	66.50 ± 2.00 / 45.33 ± 2.92	58.93 ± 1.72 / 72.70 ± 1.38	57.27 ± 1.30 / 78.52 ± 0.62	55.02 ± 0.88 / 64.14 ± 0.46	66.59 ± 0.08 / 19.30 ± 0.16	81.37 ± 1.50 / 85.99 ± 1.12	83.16 ± 0.99 / 88.81 ± 0.65	67.83 ± 1.38 / 75.47 ± 1.13	76.25 ± 1.39 / 60.31 ± 3.22	77.91 ± 0.47 / 61.81 ± 3.84	40.54 ± 0.72 / 39.96 ± 0.60	64.53 ± 0.08 / 15.13 ± 0.19	59.75 ± 1.66 / 78.91 ± 1.21	47.82 ± 2.00 / 73.51 ± 1.21	40.99 ± 1.38 / 69.77 ± 1.17	56.11 ± 0.87 / 66.82 ± 0.63	67.72 ± 1.98 / 75.38 ± 1.55	62.91 ± 1.46 / 47.13 ± 3.48	79.51 ± 0.63 / 79.57 ± 0.65	60.28 ± 1.19 / 79.99 ± 0.66	55.44 ± 0.92 / 64.81 ± 0.62	65.24 ± 0.08 / 17.65 ± 0.12	56.40 ± 0.94 / 67.07 ± 0.71	65.89 ± 1.34 / 73.88 ± 1.11	67.23 ± 2.77 / 45.61 ± 4.86	50.38 ± 1.18 / 66.21 ± 1.00	20.01 ± 1.09 / 59.74 ± 0.60	21.18 ± 1.67 / 49.26 ± 0.93	67.61 ± 0.15 / 19.31 ± 0.26	66.74 ± 1.30 / 75.07 ± 0.99	33.03 ± 1.47 / 66.80 ± 0.84	81.30 ± 1.24 / 73.31 ± 3.51	60.99 ± 2.59 / 72.95 ± 1.68	12.49 ± 3.30 / 49.82 ± 2.65	48.47 ± 1.72 / 70.99 ± 1.42	73.31 ± 1.01 / 59.78 ± 2.14	58.02 ± 1.62 / 71.81 ± 1.10	45.12 ± 0.99 / 70.92 ± 0.38	24.67 ± 1.03 / 55.19 ± 1.27	64.40 ± 0.06 / 15.05 ± 0.16	58.70 ± 0.65 / 68.95 ± 0.50	68.90 ± 1.33 / 76.26 ± 1.04	68.17 ± 1.75 / 51.61 ± 2.73	10.56 ± 1.04 / 19.29 ± 0.63	56.89 ± 0.82 / 78.31 ± 0.43	53.05 ± 2.18 / 71.82 ± 0.84	64.01 ± 0.23 / 15.23 ± 0.30	58.74 ± 0.88 / 68.94 ± 0.65	65.18 ± 0.73 / 73.34 ± 0.53	81.06 ± 0.87 / 75.22 ± 1.31	68.92 ± 1.04 / 72.90 ± 0.74	49.06 ± 1.46 / 72.52 ± 0.82	61.27 ± 1.63 / 81.48 ± 0.86	68.00 ± 0.09 / 22.45 ± 0.14	67.84 ± 0.73 / 75.85 ± 0.56	78.26 ± 0.99 / 83.56 ± 0.79	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
gpt-4-1106-preview (zero-shot, val)	unknown	100	8191	True	436 ± 152 / 57 ± 21	1.81	1.69	1.99	1.51	1.89	2.22	1.53	1.95	1.67	35.79 ± 2.45 / 25.86 ± 1.74	53.69 ± 2.27 / 67.91 ± 1.55	62.98 ± 2.61 / 81.27 ± 1.31	51.96 ± 1.07 / 64.87 ± 0.92	64.56 ± 0.18 / 13.61 ± 0.30	87.34 ± 2.03 / 90.59 ± 1.49	98.11 ± 1.10 / 98.75 ± 0.73	67.56 ± 1.88 / 75.47 ± 1.48	60.16 ± 3.63 / 49.38 ± 2.48	48.74 ± 2.05 / 40.98 ± 1.83	39.62 ± 1.29 / 38.68 ± 0.94	62.75 ± 0.20 / 10.78 ± 0.13	71.38 ± 2.71 / 85.52 ± 1.38	42.94 ± 3.66 / 71.26 ± 1.76	36.04 ± 1.53 / 69.46 ± 0.84	68.89 ± 1.85 / 76.76 ± 1.38	59.02 ± 2.40 / 67.34 ± 1.69	51.31 ± 4.64 / 43.84 ± 3.44	73.54 ± 3.03 / 68.68 ± 2.31	66.39 ± 2.24 / 82.10 ± 1.23	52.22 ± 1.51 / 63.21 ± 1.40	65.32 ± 0.13 / 15.67 ± 0.18	69.31 ± 1.63 / 77.07 ± 1.24	63.92 ± 2.21 / 72.70 ± 1.63	30.39 ± 3.49 / 25.88 ± 1.98	47.47 ± 3.03 / 63.45 ± 2.13	43.30 ± 3.41 / 71.54 ± 1.71	29.82 ± 1.09 / 51.48 ± 0.89	63.89 ± 0.21 / 13.99 ± 0.19	86.79 ± 1.30 / 90.12 ± 0.97	54.76 ± 4.75 / 77.97 ± 2.44	57.52 ± 2.17 / 36.36 ± 1.53	13.18 ± 5.13 / 19.41 ± 3.41	28.03 ± 3.90 / 62.26 ± 2.03	59.06 ± 2.40 / 76.65 ± 1.98	57.47 ± 2.20 / 36.29 ± 1.91	58.67 ± 2.30 / 71.20 ± 1.34	54.55 ± 3.18 / 75.08 ± 1.71	27.02 ± 1.33 / 53.97 ± 1.74	62.91 ± 0.22 / 11.70 ± 0.28	69.23 ± 2.31 / 77.07 ± 1.72	71.17 ± 2.36 / 77.66 ± 1.84	55.72 ± 3.68 / 40.53 ± 2.95	11.13 ± 1.98 / 18.38 ± 1.21	67.28 ± 2.42 / 83.06 ± 1.36	54.20 ± 2.18 / 72.73 ± 1.79	64.09 ± 0.08 / 12.91 ± 0.15	67.45 ± 1.74 / 75.66 ± 1.30	72.71 ± 2.29 / 79.49 ± 1.72	42.40 ± 2.22 / 34.09 ± 2.02	65.24 ± 2.14 / 72.51 ± 1.77	44.59 ± 4.02 / 71.93 ± 2.06	62.94 ± 1.37 / 82.84 ± 0.53	68.33 ± 0.17 / 20.27 ± 0.29	78.80 ± 2.08 / 84.14 ± 1.57	82.60 ± 1.54 / 86.60 ± 1.25	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3
gpt-4o-mini-2024-07-18 (few-shot, val)	unknown	200	8191	True	784 ± 310 / 95 ± 28	1.81	1.71	1.80	1.87	1.83	2.19	1.71	1.84	1.53	59.96 ± 1.64 / 41.55 ± 2.90	56.91 ± 2.34 / 71.25 ± 1.60	67.13 ± 4.29 / 83.05 ± 2.24	17.52 ± 2.69 / 33.63 ± 2.10	65.32 ± 0.28 / 15.39 ± 0.62	91.70 ± 1.66 / 93.79 ± 1.23	88.38 ± 2.84 / 92.19 ± 1.94	71.08 ± 1.15 / 78.12 ± 0.91	72.74 ± 1.75 / 57.58 ± 4.14	69.17 ± 2.61 / 56.34 ± 3.95	67.45 ± 4.03 / 77.50 ± 2.90	63.00 ± 0.19 / 11.59 ± 0.22	74.27 ± 2.57 / 86.86 ± 1.43	54.83 ± 3.96 / 76.91 ± 1.98	3.67 ± 1.64 / 43.45 ± 1.90	59.93 ± 2.64 / 69.69 ± 1.97	76.01 ± 1.56 / 81.33 ± 1.30	62.45 ± 2.79 / 46.68 ± 4.08	77.69 ± 2.28 / 78.73 ± 2.17	68.93 ± 3.67 / 84.15 ± 2.01	12.11 ± 4.65 / 31.14 ± 3.37	66.04 ± 0.19 / 16.02 ± 0.27	55.80 ± 3.06 / 66.48 ± 2.33	63.61 ± 1.68 / 71.99 ± 1.38	64.69 ± 1.77 / 37.89 ± 3.23	56.18 ± 4.37 / 69.53 ± 2.97	45.52 ± 4.15 / 71.51 ± 2.48	15.80 ± 6.24 / 55.19 ± 4.14	67.06 ± 0.10 / 15.92 ± 0.24	82.10 ± 1.93 / 86.37 ± 1.50	42.82 ± 4.17 / 71.48 ± 2.40	73.80 ± 2.44 / 63.06 ± 3.84	39.45 ± 8.53 / 62.38 ± 6.69	34.78 ± 4.81 / 63.14 ± 2.83	0.87 ± 1.17 / 19.37 ± 1.52	65.51 ± 1.91 / 48.61 ± 3.73	55.16 ± 3.05 / 69.81 ± 1.96	44.60 ± 3.19 / 67.35 ± 2.53	21.87 ± 3.80 / 59.67 ± 2.67	63.50 ± 0.20 / 11.55 ± 0.36	60.83 ± 2.50 / 70.31 ± 1.91	67.98 ± 3.25 / 75.39 ± 2.59	68.71 ± 3.85 / 53.19 ± 4.36	20.33 ± 2.51 / 40.68 ± 1.79	49.52 ± 5.39 / 72.59 ± 3.64	34.06 ± 3.24 / 61.15 ± 2.69	66.13 ± 0.23 / 15.64 ± 0.32	62.12 ± 2.67 / 71.76 ± 1.95	65.74 ± 3.66 / 73.59 ± 2.89	77.38 ± 1.61 / 66.97 ± 2.42	66.75 ± 2.50 / 73.93 ± 1.51	52.43 ± 3.69 / 74.46 ± 2.17	41.03 ± 6.90 / 67.96 ± 4.99	68.73 ± 0.21 / 20.97 ± 0.36	66.63 ± 2.82 / 74.92 ± 2.08	79.95 ± 1.44 / 84.69 ± 1.09	14.0.0	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1	14.0.0	14.0.0	14.0.0	14.0.1	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1	14.0.0	14.0.0	14.0.0	14.0.0	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1
gpt-4o-mini-2024-07-18 (zero-shot, val)	unknown	200	8191	True	908 ± 303 / 96 ± 36	1.89	1.63	2.07	1.77	2.22	2.08	1.73	2.01	1.58	57.52 ± 2.21 / 35.79 ± 1.78	49.73 ± 3.09 / 65.95 ± 2.22	57.56 ± 2.67 / 77.16 ± 1.35	51.79 ± 1.50 / 64.34 ± 1.32	64.66 ± 0.20 / 13.62 ± 0.27	79.84 ± 1.66 / 84.92 ± 1.26	83.21 ± 2.59 / 88.67 ± 1.79	63.33 ± 1.94 / 72.15 ± 1.54	60.43 ± 2.46 / 37.82 ± 2.68	55.59 ± 2.84 / 32.20 ± 2.11	39.82 ± 1.20 / 37.70 ± 1.08	62.77 ± 0.17 / 10.94 ± 0.12	54.84 ± 2.09 / 74.79 ± 1.33	33.80 ± 3.42 / 62.11 ± 2.19	36.55 ± 1.71 / 70.12 ± 0.99	56.96 ± 1.87 / 67.11 ± 1.36	68.70 ± 1.59 / 75.86 ± 1.16	52.47 ± 2.22 / 29.74 ± 0.97	73.55 ± 2.73 / 71.66 ± 2.30	52.27 ± 2.34 / 71.55 ± 1.30	48.95 ± 1.41 / 61.75 ± 1.16	65.59 ± 0.17 / 15.30 ± 0.25	54.30 ± 3.14 / 65.47 ± 2.42	54.13 ± 2.66 / 64.77 ± 2.09	31.11 ± 2.16 / 14.28 ± 0.85	50.02 ± 2.61 / 65.44 ± 1.86	35.85 ± 1.55 / 66.14 ± 0.82	26.93 ± 1.10 / 49.25 ± 1.18	66.48 ± 0.12 / 14.96 ± 0.13	72.80 ± 2.91 / 79.45 ± 2.24	28.63 ± 7.69 / 59.45 ± 3.75	53.92 ± 1.55 / 28.59 ± 1.28	35.05 ± 3.84 / 34.41 ± 2.93	23.12 ± 4.18 / 60.20 ± 2.01	54.99 ± 2.45 / 76.60 ± 1.29	59.19 ± 1.52 / 30.16 ± 1.22	52.66 ± 3.86 / 68.10 ± 2.51	46.66 ± 4.45 / 72.82 ± 2.13	26.02 ± 1.78 / 51.63 ± 1.54	63.30 ± 0.18 / 11.78 ± 0.24	58.21 ± 2.60 / 68.09 ± 2.09	65.19 ± 2.42 / 73.28 ± 1.95	64.15 ± 2.49 / 38.77 ± 2.59	12.67 ± 2.02 / 18.63 ± 1.37	62.44 ± 3.24 / 80.58 ± 1.66	45.65 ± 1.56 / 70.43 ± 1.29	64.26 ± 0.11 / 13.64 ± 0.19	56.45 ± 2.36 / 67.46 ± 1.73	62.09 ± 2.86 / 71.09 ± 2.06	75.80 ± 0.83 / 52.95 ± 1.04	61.65 ± 2.17 / 71.46 ± 1.72	47.74 ± 4.29 / 73.28 ± 2.23	56.98 ± 1.46 / 79.90 ± 0.76	68.60 ± 0.16 / 20.57 ± 0.28	63.18 ± 2.47 / 72.23 ± 1.82	77.31 ± 1.71 / 82.54 ± 1.37	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.3	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.3	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.3
CohereForAI/c4ai-command-r-08-2024 (few-shot)	32296	256	131072	False	1,909 ± 646 / 248 ± 84	2.00	1.89	2.31	1.87	2.68	2.00	1.75	1.96	1.54	63.63 ± 2.58 / 40.18 ± 3.60	50.82 ± 1.22 / 64.57 ± 1.50	35.58 ± 1.76 / 66.59 ± 1.22	54.33 ± 0.77 / 64.51 ± 0.50	65.71 ± 0.23 / 17.20 ± 0.46	58.67 ± 1.76 / 68.17 ± 1.44	72.01 ± 1.26 / 81.37 ± 0.86	33.61 ± 2.24 / 48.15 ± 2.00	73.20 ± 1.45 / 46.13 ± 3.02	72.26 ± 1.32 / 50.60 ± 3.32	35.80 ± 0.54 / 38.56 ± 0.56	63.37 ± 0.27 / 12.90 ± 0.29	36.86 ± 1.57 / 68.01 ± 0.98	23.40 ± 1.98 / 60.51 ± 1.62	40.32 ± 1.30 / 70.57 ± 1.28	38.62 ± 1.30 / 53.47 ± 0.90	40.50 ± 1.40 / 54.65 ± 1.07	65.01 ± 1.61 / 38.41 ± 3.29	77.68 ± 1.01 / 74.34 ± 1.86	34.06 ± 2.14 / 65.64 ± 1.66	56.78 ± 0.52 / 65.93 ± 0.49	66.08 ± 0.07 / 18.08 ± 0.13	39.39 ± 3.39 / 53.89 ± 2.70	37.81 ± 2.49 / 51.65 ± 2.19	62.68 ± 1.93 / 42.03 ± 4.30	31.96 ± 2.37 / 51.22 ± 2.00	11.81 ± 0.99 / 49.24 ± 2.30	30.49 ± 1.20 / 56.00 ± 1.68	66.24 ± 0.15 / 17.31 ± 0.46	21.10 ± 0.78 / 40.19 ± 0.62	9.34 ± 2.50 / 56.92 ± 0.95	73.26 ± 1.78 / 63.41 ± 3.03	47.71 ± 2.52 / 64.44 ± 1.96	10.41 ± 2.22 / 54.04 ± 1.47	57.08 ± 1.61 / 73.87 ± 1.31	68.62 ± 1.15 / 49.68 ± 3.91	56.20 ± 2.11 / 69.68 ± 1.83	43.36 ± 1.37 / 67.19 ± 2.03	28.50 ± 1.00 / 57.50 ± 1.84	64.52 ± 0.06 / 13.88 ± 0.25	50.16 ± 1.00 / 62.25 ± 0.74	51.13 ± 2.01 / 62.67 ± 1.67	68.58 ± 1.76 / 44.49 ± 2.32	14.41 ± 1.69 / 35.58 ± 1.84	55.01 ± 1.21 / 77.17 ± 0.63	58.63 ± 0.55 / 72.85 ± 0.32	65.69 ± 0.95 / 16.39 ± 0.64	50.48 ± 0.92 / 62.55 ± 0.71	49.08 ± 1.51 / 60.63 ± 1.34	78.35 ± 1.42 / 68.56 ± 1.40	67.62 ± 0.95 / 70.27 ± 1.06	46.50 ± 1.03 / 71.67 ± 0.79	63.20 ± 1.15 / 80.12 ± 0.66	70.22 ± 0.23 / 26.49 ± 0.34	60.40 ± 0.83 / 70.22 ± 0.62	60.49 ± 2.10 / 69.11 ± 1.87	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF (few-shot)	70554	128	131072	True	1,208 ± 412 / 156 ± 53	2.07	2.01	2.21	1.69	2.67	1.99	2.01	2.25	1.72	58.34 ± 1.24 / 33.52 ± 1.47	59.14 ± 1.19 / 72.45 ± 0.97	56.46 ± 1.02 / 77.90 ± 0.61	39.77 ± 1.12 / 54.05 ± 0.72	47.41 ± 0.23 / 4.96 ± 0.10	85.69 ± 1.25 / 89.23 ± 0.95	91.37 ± 1.33 / 94.26 ± 0.90	74.30 ± 0.79 / 80.57 ± 0.62	69.21 ± 1.13 / 41.18 ± 1.79	70.45 ± 1.43 / 43.05 ± 2.42	39.87 ± 0.47 / 39.97 ± 0.29	47.52 ± 0.09 / 5.00 ± 0.11	57.80 ± 1.53 / 78.16 ± 0.92	40.31 ± 2.88 / 68.01 ± 2.32	40.97 ± 1.43 / 72.01 ± 0.69	63.81 ± 1.21 / 72.83 ± 0.89	73.01 ± 1.26 / 79.65 ± 0.95	58.65 ± 2.12 / 28.39 ± 1.64	81.81 ± 0.86 / 82.33 ± 0.74	63.69 ± 1.28 / 81.49 ± 0.64	42.29 ± 1.15 / 56.06 ± 0.57	50.67 ± 0.97 / 7.02 ± 0.72	68.28 ± 0.81 / 76.14 ± 0.61	72.36 ± 1.01 / 79.06 ± 0.80	54.15 ± 2.09 / 23.38 ± 1.16	51.96 ± 0.95 / 65.42 ± 0.94	19.63 ± 1.76 / 56.76 ± 1.54	21.22 ± 0.69 / 49.57 ± 0.98	43.26 ± 0.37 / 0.69 ± 0.28	73.61 ± 0.87 / 80.21 ± 0.66	45.29 ± 2.50 / 72.72 ± 1.35	64.88 ± 1.71 / 37.91 ± 1.50	52.56 ± 2.14 / 49.94 ± 1.21	14.28 ± 1.04 / 45.93 ± 2.64	50.11 ± 1.82 / 74.50 ± 0.82	61.98 ± 0.95 / 33.82 ± 1.10	57.07 ± 1.62 / 70.61 ± 1.27	45.61 ± 1.62 / 71.65 ± 0.69	24.89 ± 0.88 / 54.36 ± 1.28	43.28 ± 0.70 / 1.38 ± 0.31	66.68 ± 0.93 / 74.94 ± 0.72	75.48 ± 1.28 / 81.42 ± 1.00	55.08 ± 2.19 / 30.07 ± 1.17	10.80 ± 1.40 / 20.34 ± 0.88	61.31 ± 1.10 / 80.58 ± 0.56	49.80 ± 1.58 / 70.37 ± 0.65	52.72 ± 0.51 / 9.05 ± 0.31	68.15 ± 1.32 / 76.04 ± 1.01	72.50 ± 0.80 / 79.13 ± 0.64	73.66 ± 1.39 / 60.87 ± 1.81	68.56 ± 1.01 / 74.22 ± 0.73	51.33 ± 1.21 / 74.14 ± 0.75	56.87 ± 1.12 / 79.71 ± 0.44	54.04 ± 0.37 / 6.64 ± 0.20	75.50 ± 0.90 / 81.59 ± 0.67	84.61 ± 1.36 / 88.37 ± 1.07	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
claude-3-5-sonnet-20241022 (zero-shot, val)	unknown	unknown	200000	True	193 ± 87 / 55 ± 19	2.11	1.64	2.18	1.87	2.35	2.02	2.26	2.52	2.04	65.88 ± 2.11 / 55.11 ± 1.59	63.61 ± 1.57 / 76.00 ± 1.07	71.03 ± 2.52 / 85.46 ± 1.24	46.24 ± 1.37 / 59.56 ± 1.25	64.60 ± 0.17 / 13.66 ± 0.33	84.02 ± 1.91 / 88.01 ± 1.39	85.34 ± 1.48 / 89.61 ± 1.10	23.71 ± 2.05 / 41.45 ± 1.43	74.23 ± 1.86 / 70.66 ± 2.97	70.50 ± 2.19 / 65.71 ± 2.34	50.92 ± 2.29 / 63.00 ± 1.71	62.57 ± 0.14 / 10.84 ± 0.13	76.10 ± 3.28 / 88.02 ± 1.64	72.03 ± 2.05 / 85.28 ± 1.07	40.57 ± 1.42 / 67.69 ± 0.75	24.04 ± 2.65 / 37.19 ± 1.54	-0.80 ± 1.96 / 23.98 ± 1.59	70.22 ± 2.34 / 58.75 ± 1.43	77.70 ± 2.39 / 77.22 ± 2.00	74.34 ± 2.79 / 87.04 ± 1.39	49.32 ± 1.33 / 60.05 ± 0.93	65.36 ± 0.14 / 15.31 ± 0.16	28.34 ± 2.24 / 38.09 ± 2.17	13.68 ± 1.67 / 26.91 ± 1.11	61.70 ± 2.37 / 41.44 ± 1.76	51.24 ± 1.69 / 65.49 ± 1.06	52.43 ± 2.29 / 73.78 ± 1.09	22.92 ± 1.06 / 47.06 ± 1.02	66.02 ± 0.13 / 15.54 ± 0.10	15.97 ± 2.78 / 23.83 ± 1.74	5.31 ± 4.38 / 59.84 ± 2.96	72.52 ± 0.65 / 60.99 ± 0.78	8.17 ± 5.22 / 27.16 ± 4.39	32.38 ± 4.28 / 56.38 ± 2.60	45.34 ± 1.90 / 69.24 ± 1.30	61.83 ± 1.50 / 46.40 ± 1.54	61.59 ± 4.13 / 73.65 ± 2.62	46.40 ± 3.16 / 69.51 ± 1.58	23.77 ± 1.57 / 48.70 ± 1.26	62.69 ± 0.14 / 10.95 ± 0.17	17.15 ± 1.59 / 27.23 ± 2.17	9.70 ± 2.37 / 29.80 ± 1.51	62.41 ± 2.92 / 52.27 ± 2.69	12.64 ± 2.16 / 33.98 ± 1.59	74.06 ± 2.21 / 86.59 ± 1.26	35.77 ± 1.20 / 68.02 ± 1.47	64.25 ± 0.09 / 13.47 ± 0.15	27.77 ± 1.44 / 40.51 ± 0.91	14.21 ± 1.94 / 33.83 ± 1.57	82.11 ± 1.42 / 79.77 ± 1.03	67.01 ± 2.34 / 71.49 ± 1.89	51.09 ± 5.20 / 74.48 ± 2.70	52.41 ± 1.56 / 77.79 ± 1.01	67.73 ± 0.14 / 18.28 ± 0.26	26.14 ± 2.01 / 35.16 ± 1.54	13.56 ± 3.11 / 26.48 ± 1.71	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3
mgoin/Nemotron-4-340B-Instruct-hf-FP8 (few-shot)	341029	256	4096	True	1,904 ± 475 / 361 ± 121	2.17	2.04	2.11	1.92	2.09	2.54	2.08	2.64	1.95	48.24 ± 9.94 / 31.90 ± 6.18	39.52 ± 7.04 / 57.63 ± 7.05	62.92 ± 7.59 / 79.60 ± 5.59	36.92 ± 4.33 / 50.43 ± 5.70	56.79 ± 3.55 / 9.68 ± 1.99	67.68 ± 13.44 / 73.37 ± 11.27	84.85 ± 5.06 / 89.61 ± 3.57	68.82 ± 9.57 / 75.07 ± 8.79	56.41 ± 4.08 / 40.15 ± 2.52	55.60 ± 10.22 / 41.46 ± 7.34	25.18 ± 6.55 / 26.60 ± 5.64	59.28 ± 1.86 / 9.96 ± 0.98	62.56 ± 12.80 / 78.17 ± 9.21	53.09 ± 12.43 / 72.49 ± 10.07	42.57 ± 3.25 / 68.49 ± 4.62	45.67 ± 7.99 / 57.20 ± 7.81	73.86 ± 10.33 / 78.94 ± 9.45	48.92 ± 3.54 / 30.97 ± 2.58	62.08 ± 12.16 / 66.00 ± 9.89	68.93 ± 11.34 / 82.77 ± 8.76	36.40 ± 6.01 / 45.68 ± 7.55	61.39 ± 1.89 / 14.44 ± 1.38	48.18 ± 6.47 / 59.40 ± 6.01	56.87 ± 7.48 / 66.26 ± 6.37	37.98 ± 7.26 / 24.63 ± 3.82	47.34 ± 5.45 / 63.42 ± 4.34	50.14 ± 6.12 / 73.44 ± 4.16	16.27 ± 1.26 / 41.01 ± 2.32	63.40 ± 1.31 / 14.12 ± 0.78	79.94 ± 1.28 / 84.95 ± 0.97	44.61 ± 7.95 / 72.53 ± 3.86	55.31 ± 9.55 / 44.19 ± 6.59	51.62 ± 10.21 / 62.71 ± 10.54	15.07 ± 1.77 / 54.46 ± 2.11	18.22 ± 3.26 / 36.19 ± 4.86	50.17 ± 7.37 / 32.80 ± 4.21	43.41 ± 7.58 / 60.96 ± 6.31	40.59 ± 9.15 / 63.58 ± 7.55	19.75 ± 2.91 / 43.00 ± 6.51	60.34 ± 1.55 / 10.97 ± 0.78	52.07 ± 8.24 / 62.36 ± 7.80	74.99 ± 6.86 / 80.52 ± 5.91	47.60 ± 2.59 / 29.38 ± 1.71	10.62 ± 2.33 / 34.10 ± 2.72	61.64 ± 9.03 / 78.16 ± 6.70	24.02 ± 6.42 / 38.65 ± 10.84	54.51 ± 2.27 / 8.49 ± 1.49	50.32 ± 11.27 / 61.39 ± 9.56	64.62 ± 6.94 / 71.43 ± 6.37	51.92 ± 11.90 / 40.30 ± 8.36	67.01 ± 2.29 / 72.21 ± 1.61	45.98 ± 7.10 / 68.89 ± 6.52	30.12 ± 6.60 / 48.37 ± 9.50	65.82 ± 1.56 / 18.90 ± 1.25	60.71 ± 5.40 / 69.77 ± 4.90	77.14 ± 11.59 / 81.19 ± 10.68	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
meta-llama/Meta-Llama-3-8B-Instruct (few-shot)	8030	128	8192	True	1,483 ± 377 / 287 ± 97	2.22	2.14	2.43	2.08	2.73	2.26	1.94	2.34	1.82	57.74 ± 2.06 / 40.66 ± 2.58	48.43 ± 3.31 / 62.09 ± 3.62	27.12 ± 2.83 / 60.40 ± 2.70	46.76 ± 1.20 / 59.77 ± 0.51	66.36 ± 0.47 / 19.75 ± 0.84	57.87 ± 1.67 / 67.43 ± 1.34	50.42 ± 3.32 / 65.43 ± 2.41	29.17 ± 2.24 / 44.59 ± 2.00	66.56 ± 1.70 / 58.47 ± 2.40	68.29 ± 1.47 / 61.22 ± 2.25	34.47 ± 0.44 / 37.96 ± 0.40	63.80 ± 0.09 / 13.37 ± 0.15	28.22 ± 1.37 / 59.51 ± 1.44	18.21 ± 2.21 / 52.84 ± 2.30	47.34 ± 1.99 / 73.23 ± 1.29	30.78 ± 0.81 / 47.33 ± 0.75	31.49 ± 1.29 / 48.15 ± 0.99	69.67 ± 1.30 / 52.94 ± 4.01	59.93 ± 4.70 / 67.54 ± 3.04	27.63 ± 3.19 / 60.85 ± 3.29	49.84 ± 1.61 / 60.85 ± 0.93	66.60 ± 0.07 / 19.13 ± 0.31	33.54 ± 1.40 / 49.20 ± 1.13	30.32 ± 2.27 / 45.96 ± 1.87	60.20 ± 2.76 / 40.38 ± 4.22	38.09 ± 2.38 / 54.51 ± 2.16	9.14 ± 0.98 / 49.56 ± 2.11	28.66 ± 1.28 / 58.93 ± 1.41	67.50 ± 0.21 / 18.61 ± 0.39	17.93 ± 1.69 / 38.38 ± 1.30	5.59 ± 1.88 / 54.19 ± 1.33	70.61 ± 1.12 / 68.27 ± 1.76	45.78 ± 2.05 / 47.72 ± 1.15	4.58 ± 2.43 / 36.78 ± 1.86	50.67 ± 1.56 / 72.73 ± 1.11	68.18 ± 0.95 / 57.72 ± 1.15	58.33 ± 2.83 / 69.31 ± 3.16	29.12 ± 3.17 / 63.60 ± 1.63	28.68 ± 1.99 / 56.42 ± 3.34	65.23 ± 0.49 / 16.56 ± 0.94	38.44 ± 0.81 / 53.38 ± 0.60	37.69 ± 1.00 / 51.24 ± 0.73	68.72 ± 1.81 / 54.89 ± 2.10	14.67 ± 2.51 / 41.36 ± 2.04	32.91 ± 2.56 / 64.93 ± 1.97	45.36 ± 1.31 / 67.50 ± 0.69	67.62 ± 0.82 / 18.19 ± 1.14	36.18 ± 1.31 / 51.68 ± 1.05	33.91 ± 1.71 / 48.01 ± 1.47	75.02 ± 1.31 / 69.47 ± 1.18	67.64 ± 1.12 / 71.04 ± 1.17	32.29 ± 3.05 / 64.85 ± 2.07	54.84 ± 2.22 / 79.10 ± 1.10	69.28 ± 0.17 / 25.48 ± 0.61	53.77 ± 1.03 / 64.91 ± 0.80	57.64 ± 1.55 / 67.29 ± 1.30	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.2	14.0.2	14.0.2	14.0.4	14.0.4	14.0.4	14.0.4	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1
mistralai/Mixtral-8x7B-v0.1 (few-shot)	46703	32	32768	True	2,363 ± 794 / 311 ± 105	2.22	1.99	2.45	2.05	2.78	2.41	1.95	2.28	1.82	52.62 ± 1.84 / 38.57 ± 2.99	50.07 ± 1.62 / 63.30 ± 1.97	37.37 ± 2.49 / 67.81 ± 1.44	54.87 ± 3.63 / 60.32 ± 3.48	66.46 ± 0.25 / 21.44 ± 0.33	69.00 ± 0.96 / 76.69 ± 0.73	79.86 ± 1.46 / 86.58 ± 1.01	24.68 ± 4.80 / 42.06 ± 3.69	63.92 ± 1.45 / 51.71 ± 3.49	62.15 ± 1.56 / 49.74 ± 3.23	46.68 ± 3.59 / 59.99 ± 4.44	63.04 ± 0.86 / 15.52 ± 1.02	33.38 ± 2.21 / 64.72 ± 1.46	19.99 ± 2.53 / 58.41 ± 1.97	31.87 ± 4.76 / 53.96 ± 5.86	38.91 ± 1.15 / 53.89 ± 0.87	20.29 ± 3.40 / 38.96 ± 2.34	60.92 ± 1.45 / 47.51 ± 4.83	79.78 ± 0.72 / 77.07 ± 1.23	34.88 ± 2.27 / 64.32 ± 3.30	50.35 ± 4.89 / 56.29 ± 5.07	62.82 ± 0.39 / 17.12 ± 0.65	43.74 ± 0.88 / 57.66 ± 0.66	19.86 ± 1.92 / 37.84 ± 1.96	55.09 ± 2.15 / 38.38 ± 3.92	39.60 ± 2.22 / 53.52 ± 3.54	8.23 ± 1.55 / 49.15 ± 2.76	30.78 ± 2.39 / 58.02 ± 1.37	63.01 ± 1.21 / 16.91 ± 1.01	18.12 ± 1.51 / 38.37 ± 1.07	8.15 ± 2.10 / 56.08 ± 1.16	67.97 ± 1.73 / 65.91 ± 2.05	45.19 ± 3.93 / 59.61 ± 3.28	5.21 ± 3.44 / 47.34 ± 4.27	43.26 ± 1.74 / 60.83 ± 1.76	59.10 ± 1.24 / 46.00 ± 3.08	55.30 ± 4.28 / 67.32 ± 5.07	37.84 ± 4.60 / 67.45 ± 2.49	31.71 ± 1.34 / 59.85 ± 2.39	64.23 ± 1.65 / 18.85 ± 2.99	47.89 ± 0.67 / 60.86 ± 0.50	28.53 ± 3.75 / 44.58 ± 2.73	64.81 ± 2.75 / 50.00 ± 2.43	12.99 ± 2.90 / 35.40 ± 3.35	39.38 ± 1.67 / 69.22 ± 0.96	49.08 ± 2.09 / 59.88 ± 2.00	66.41 ± 0.70 / 20.80 ± 0.95	45.60 ± 1.16 / 59.03 ± 0.83	24.71 ± 2.75 / 41.41 ± 2.20	65.31 ± 3.21 / 60.19 ± 2.58	68.87 ± 0.60 / 66.34 ± 0.90	43.07 ± 1.73 / 70.80 ± 1.06	63.97 ± 3.33 / 75.92 ± 3.61	68.68 ± 1.07 / 22.56 ± 1.09	56.64 ± 0.82 / 67.35 ± 0.65	33.42 ± 5.53 / 47.54 ± 4.76	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
meta-llama/Llama-3.1-8B-Instruct (few-shot)	8030	128	131072	True	1,473 ± 377 / 283 ± 96	2.25	1.98	2.39	2.04	2.79	2.42	1.99	2.65	1.73	54.70 ± 1.69 / 38.11 ± 2.31	54.81 ± 1.51 / 67.88 ± 1.39	32.11 ± 1.93 / 63.11 ± 1.61	48.87 ± 1.18 / 59.47 ± 0.67	66.79 ± 0.20 / 19.88 ± 0.44	56.14 ± 2.09 / 67.01 ± 1.58	63.54 ± 2.14 / 75.61 ± 1.50	39.48 ± 2.00 / 54.53 ± 1.52	64.55 ± 1.69 / 56.81 ± 2.50	66.44 ± 1.38 / 60.02 ± 3.36	35.17 ± 0.32 / 38.11 ± 0.29	64.48 ± 0.14 / 15.14 ± 0.38	27.41 ± 1.97 / 54.94 ± 2.06	15.60 ± 2.05 / 46.51 ± 2.41	43.11 ± 2.22 / 69.74 ± 1.60	35.02 ± 1.24 / 51.13 ± 0.94	37.61 ± 0.88 / 53.12 ± 0.65	55.80 ± 2.68 / 34.65 ± 1.98	79.23 ± 0.48 / 76.86 ± 0.80	32.67 ± 2.18 / 63.89 ± 1.49	46.88 ± 1.47 / 58.66 ± 0.84	66.43 ± 0.07 / 18.43 ± 0.14	36.35 ± 1.43 / 51.97 ± 1.14	37.89 ± 1.45 / 53.38 ± 1.09	46.48 ± 1.98 / 24.57 ± 1.73	39.91 ± 2.35 / 57.39 ± 1.64	11.72 ± 1.81 / 51.67 ± 1.45	25.91 ± 0.99 / 53.39 ± 1.83	67.67 ± 0.21 / 18.97 ± 0.43	25.83 ± 1.36 / 44.48 ± 1.05	6.40 ± 3.07 / 50.66 ± 1.69	67.67 ± 1.31 / 59.86 ± 2.12	48.54 ± 2.43 / 49.17 ± 1.48	3.89 ± 2.71 / 36.33 ± 1.50	47.07 ± 2.63 / 69.50 ± 1.68	62.03 ± 1.17 / 45.31 ± 1.89	58.15 ± 2.40 / 70.81 ± 1.86	30.18 ± 1.92 / 63.41 ± 1.19	26.48 ± 0.98 / 52.41 ± 1.48	64.68 ± 0.10 / 15.03 ± 0.29	39.36 ± 0.79 / 54.48 ± 0.57	47.21 ± 1.02 / 60.39 ± 0.77	61.68 ± 1.94 / 42.64 ± 1.85	8.97 ± 1.44 / 20.07 ± 0.82	36.57 ± 1.77 / 65.25 ± 1.94	33.88 ± 1.83 / 62.17 ± 0.91	64.80 ± 0.38 / 16.87 ± 0.29	37.45 ± 0.61 / 53.03 ± 0.48	42.45 ± 1.72 / 56.78 ± 1.31	76.95 ± 0.95 / 72.47 ± 0.82	68.12 ± 0.92 / 72.48 ± 0.53	34.34 ± 3.37 / 65.84 ± 1.59	47.88 ± 3.37 / 76.21 ± 1.69	69.57 ± 0.25 / 26.30 ± 0.35	56.62 ± 0.49 / 67.29 ± 0.39	69.03 ± 1.19 / 76.69 ± 0.89	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.2	14.0.2	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
mistralai/Mixtral-8x7B-Instruct-v0.1 (few-shot)	46703	32	32768	True	5,535 ± 1,837 / 760 ± 256	2.29	2.06	2.51	2.04	3.14	2.58	1.92	2.32	1.72	51.20 ± 3.31 / 30.53 ± 2.46	50.95 ± 1.15 / 66.13 ± 0.87	33.44 ± 1.67 / 64.34 ± 1.32	46.85 ± 1.67 / 61.54 ± 1.02	64.66 ± 0.25 / 14.48 ± 0.73	67.12 ± 1.23 / 75.29 ± 0.88	76.78 ± 1.29 / 84.47 ± 0.92	39.93 ± 1.65 / 54.24 ± 1.32	55.02 ± 2.74 / 36.31 ± 1.97	57.37 ± 2.34 / 38.25 ± 2.37	36.76 ± 0.69 / 38.81 ± 0.52	61.59 ± 0.17 / 7.66 ± 0.45	30.73 ± 1.86 / 63.33 ± 2.10	18.96 ± 2.45 / 52.64 ± 4.21	41.01 ± 2.00 / 70.24 ± 1.75	39.07 ± 1.18 / 53.90 ± 0.87	40.48 ± 1.57 / 54.73 ± 1.23	46.15 ± 1.63 / 25.08 ± 1.69	80.33 ± 0.51 / 79.04 ± 0.76	32.89 ± 2.06 / 64.41 ± 1.78	46.51 ± 1.69 / 61.35 ± 1.02	66.04 ± 0.10 / 17.27 ± 0.37	42.98 ± 0.91 / 56.81 ± 0.67	35.33 ± 1.71 / 49.88 ± 1.41	35.00 ± 3.16 / 20.45 ± 2.42	23.93 ± 4.28 / 46.14 ± 3.72	9.69 ± 1.44 / 52.07 ± 1.78	21.38 ± 2.08 / 53.35 ± 1.40	64.69 ± 0.39 / 14.44 ± 0.78	17.73 ± 1.70 / 38.30 ± 1.29	9.06 ± 2.52 / 54.02 ± 1.58	63.43 ± 0.93 / 41.57 ± 2.20	43.99 ± 2.94 / 59.58 ± 2.00	9.38 ± 2.05 / 51.75 ± 1.36	25.35 ± 3.98 / 49.54 ± 4.57	58.07 ± 0.94 / 40.30 ± 1.75	52.18 ± 1.33 / 65.98 ± 1.66	41.45 ± 1.66 / 68.13 ± 0.98	26.87 ± 1.60 / 59.41 ± 2.41	64.10 ± 0.11 / 13.39 ± 0.19	47.93 ± 0.83 / 60.80 ± 0.60	51.72 ± 1.42 / 63.09 ± 1.17	58.80 ± 3.37 / 37.95 ± 1.80	12.50 ± 1.74 / 33.57 ± 1.09	45.22 ± 1.65 / 71.80 ± 1.10	47.03 ± 2.34 / 67.41 ± 1.00	65.95 ± 0.32 / 15.67 ± 0.51	43.41 ± 1.10 / 57.51 ± 0.81	43.33 ± 1.37 / 57.03 ± 1.09	70.02 ± 1.35 / 60.95 ± 1.57	69.48 ± 0.68 / 71.36 ± 1.02	44.59 ± 0.99 / 70.37 ± 0.77	55.70 ± 2.73 / 77.76 ± 1.18	68.79 ± 0.10 / 21.92 ± 0.16	55.61 ± 0.89 / 66.57 ± 0.68	57.52 ± 1.56 / 67.66 ± 1.21	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
mistralai/Ministral-8B-Instruct-2410 (few-shot)	8020	131	32768	True	1,302 ± 323 / 253 ± 86	2.31	2.18	2.47	2.13	3.00	2.71	1.96	2.38	1.63	55.49 ± 2.05 / 34.11 ± 1.79	49.18 ± 1.89 / 65.27 ± 1.69	7.40 ± 1.81 / 35.19 ± 0.73	57.72 ± 0.54 / 64.99 ± 0.45	65.10 ± 0.22 / 15.51 ± 0.44	45.83 ± 2.26 / 56.80 ± 1.75	59.45 ± 2.23 / 72.70 ± 1.59	35.46 ± 5.42 / 49.09 ± 4.65	67.24 ± 1.06 / 45.38 ± 2.20	66.08 ± 1.05 / 47.58 ± 3.27	31.41 ± 0.86 / 33.56 ± 0.97	62.89 ± 0.12 / 11.72 ± 0.18	28.72 ± 2.42 / 58.62 ± 3.68	20.55 ± 3.71 / 54.24 ± 4.15	40.60 ± 2.39 / 68.91 ± 2.08	30.39 ± 1.20 / 46.55 ± 1.05	38.46 ± 2.98 / 52.16 ± 2.44	54.76 ± 1.82 / 31.21 ± 2.67	73.32 ± 1.59 / 75.58 ± 1.15	16.17 ± 2.98 / 42.93 ± 2.72	57.94 ± 0.58 / 65.27 ± 0.58	65.95 ± 0.08 / 17.10 ± 0.06	30.08 ± 1.00 / 46.33 ± 0.78	39.51 ± 1.84 / 53.10 ± 1.65	47.10 ± 1.90 / 22.63 ± 2.03	24.43 ± 2.98 / 39.27 ± 3.37	7.19 ± 2.76 / 44.62 ± 3.61	28.73 ± 1.45 / 54.38 ± 2.28	66.62 ± 0.16 / 17.04 ± 0.23	21.98 ± 1.25 / 40.56 ± 1.07	0.10 ± 2.39 / 55.15 ± 1.19	65.55 ± 1.39 / 51.57 ± 3.35	29.49 ± 2.40 / 47.06 ± 2.82	2.05 ± 1.58 / 35.92 ± 2.05	47.72 ± 2.10 / 65.78 ± 1.43	60.50 ± 1.22 / 40.72 ± 1.61	50.39 ± 2.45 / 66.39 ± 1.62	30.86 ± 1.37 / 53.78 ± 1.61	30.53 ± 1.21 / 58.26 ± 1.93	64.03 ± 0.05 / 12.90 ± 0.19	39.61 ± 0.90 / 54.41 ± 0.67	60.04 ± 1.94 / 69.43 ± 1.54	63.30 ± 2.36 / 39.20 ± 2.16	11.82 ± 1.07 / 34.18 ± 1.11	32.20 ± 0.77 / 65.67 ± 0.69	59.45 ± 0.89 / 71.13 ± 0.60	65.60 ± 0.14 / 15.53 ± 0.18	33.02 ± 0.79 / 49.45 ± 0.61	44.88 ± 2.56 / 57.56 ± 2.18	72.40 ± 0.80 / 65.83 ± 1.64	63.46 ± 2.10 / 69.49 ± 1.15	35.86 ± 7.94 / 65.20 ± 6.98	68.42 ± 1.21 / 83.97 ± 0.74	69.38 ± 0.48 / 24.96 ± 0.47	53.42 ± 0.91 / 64.98 ± 0.74	78.36 ± 2.31 / 83.62 ± 1.78	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.0	14.0.0	14.0.0	14.0.0	14.0.1	14.0.1	14.0.1	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
nvidia/mistral-nemo-minitron-8b-base (few-shot)	8414	131	8192	True	2,470 ± 836 / 326 ± 111	2.31	2.19	2.48	2.16	2.78	2.50	2.10	2.50	1.76	49.85 ± 2.30 / 33.79 ± 3.10	49.52 ± 1.96 / 66.14 ± 1.58	32.35 ± 2.54 / 64.15 ± 2.71	52.54 ± 3.16 / 58.28 ± 3.02	65.13 ± 0.61 / 19.61 ± 0.53	52.71 ± 1.70 / 63.89 ± 1.30	63.47 ± 1.81 / 75.66 ± 1.22	16.30 ± 4.29 / 34.08 ± 3.38	64.15 ± 1.20 / 47.04 ± 3.09	62.16 ± 1.91 / 46.60 ± 2.86	55.29 ± 1.82 / 69.90 ± 1.64	60.17 ± 0.83 / 13.31 ± 0.63	32.30 ± 3.70 / 60.88 ± 3.83	22.82 ± 1.34 / 57.53 ± 2.19	32.62 ± 5.27 / 54.92 ± 6.28	35.37 ± 1.16 / 50.76 ± 0.97	15.39 ± 2.01 / 32.25 ± 1.49	58.75 ± 1.62 / 39.78 ± 2.75	79.59 ± 0.77 / 77.48 ± 1.05	33.09 ± 2.18 / 66.25 ± 1.20	47.28 ± 6.79 / 53.05 ± 6.94	62.78 ± 0.48 / 16.54 ± 0.78	36.58 ± 1.09 / 51.81 ± 0.85	18.78 ± 2.26 / 35.54 ± 2.19	53.28 ± 3.54 / 39.35 ± 3.78	41.80 ± 1.57 / 59.81 ± 1.60	11.07 ± 2.40 / 51.96 ± 2.62	29.74 ± 1.76 / 56.76 ± 2.14	64.08 ± 0.66 / 16.06 ± 0.54	20.14 ± 1.34 / 39.67 ± 1.08	3.62 ± 2.53 / 53.63 ± 1.06	66.18 ± 1.87 / 62.76 ± 2.46	39.48 ± 3.86 / 56.83 ± 3.61	5.78 ± 1.69 / 47.83 ± 3.37	44.81 ± 2.15 / 63.16 ± 2.38	59.82 ± 2.10 / 47.76 ± 2.63	50.22 ± 5.25 / 58.77 ± 6.76	30.43 ± 3.65 / 61.43 ± 3.32	30.22 ± 1.60 / 58.72 ± 2.48	62.56 ± 1.20 / 14.72 ± 2.03	43.09 ± 0.66 / 56.95 ± 0.53	33.40 ± 3.57 / 46.78 ± 3.16	66.29 ± 2.06 / 47.69 ± 2.04	12.71 ± 2.10 / 37.65 ± 1.83	31.39 ± 1.27 / 63.48 ± 1.67	48.33 ± 1.71 / 58.63 ± 1.53	64.10 ± 0.62 / 17.65 ± 0.69	37.55 ± 1.03 / 52.98 ± 0.83	29.69 ± 2.55 / 44.05 ± 2.51	67.52 ± 3.88 / 61.41 ± 2.66	69.03 ± 0.69 / 65.72 ± 2.41	40.51 ± 1.93 / 69.82 ± 0.89	58.12 ± 2.97 / 72.32 ± 2.85	67.86 ± 0.55 / 19.31 ± 0.44	55.93 ± 0.71 / 66.85 ± 0.53	64.11 ± 1.73 / 72.26 ± 1.43	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1
CohereForAI/aya-expanse-8b (few-shot)	8028	256	8192	False	2,686 ± 685 / 491 ± 164	2.33	2.17	2.39	2.08	3.32	2.74	2.00	2.21	1.72	51.32 ± 3.82 / 25.54 ± 2.10	52.00 ± 1.67 / 66.25 ± 1.77	18.48 ± 2.44 / 52.18 ± 4.28	52.43 ± 1.19 / 62.08 ± 0.60	66.18 ± 0.84 / 21.10 ± 0.69	41.32 ± 1.11 / 55.43 ± 0.86	52.24 ± 1.55 / 68.01 ± 1.05	37.67 ± 0.80 / 53.26 ± 0.60	66.55 ± 2.12 / 39.28 ± 3.45	63.63 ± 1.62 / 37.25 ± 3.49	38.61 ± 2.28 / 51.46 ± 2.62	64.48 ± 0.61 / 17.46 ± 0.76	15.80 ± 2.22 / 51.42 ± 3.79	12.30 ± 2.38 / 51.96 ± 3.31	43.26 ± 2.53 / 71.49 ± 2.01	36.48 ± 0.85 / 52.32 ± 0.62	35.85 ± 1.48 / 51.83 ± 1.11	57.38 ± 1.93 / 29.69 ± 4.23	78.43 ± 0.93 / 74.54 ± 2.40	14.52 ± 2.43 / 45.18 ± 4.21	53.14 ± 1.81 / 63.00 ± 0.50	65.69 ± 0.22 / 19.95 ± 0.16	37.32 ± 0.70 / 52.95 ± 0.50	38.28 ± 1.31 / 53.70 ± 0.97	28.98 ± 2.63 / 21.75 ± 1.89	19.83 ± 4.76 / 41.64 ± 3.64	4.93 ± 1.06 / 49.69 ± 2.65	24.72 ± 2.22 / 54.41 ± 1.43	63.45 ± 1.92 / 16.81 ± 2.23	10.97 ± 1.13 / 33.51 ± 0.81	4.23 ± 1.80 / 49.31 ± 0.84	64.72 ± 1.73 / 47.25 ± 4.90	28.57 ± 4.08 / 50.22 ± 2.92	5.12 ± 1.16 / 51.09 ± 0.89	38.83 ± 3.81 / 56.89 ± 3.51	59.95 ± 1.43 / 39.14 ± 2.24	55.39 ± 1.97 / 69.86 ± 1.34	30.59 ± 1.76 / 64.21 ± 1.65	26.94 ± 1.06 / 57.13 ± 1.35	66.11 ± 0.37 / 18.21 ± 0.62	38.63 ± 1.03 / 54.04 ± 0.73	48.53 ± 1.17 / 61.25 ± 0.85	53.02 ± 1.86 / 30.09 ± 1.16	13.68 ± 1.32 / 34.87 ± 0.67	29.97 ± 2.13 / 64.01 ± 1.12	53.40 ± 1.34 / 69.31 ± 0.65	73.93 ± 0.30 / 30.81 ± 0.43	38.81 ± 1.13 / 53.87 ± 0.90	40.95 ± 1.72 / 55.25 ± 1.38	67.33 ± 1.57 / 53.00 ± 0.88	68.67 ± 0.74 / 66.23 ± 0.49	31.18 ± 1.63 / 65.23 ± 0.69	68.33 ± 2.04 / 84.26 ± 1.04	72.23 ± 0.14 / 30.67 ± 0.16	49.41 ± 1.09 / 62.03 ± 0.82	58.93 ± 1.50 / 68.81 ± 1.21	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
NorwAI/NorwAI-Mixtral-8x7B-instruct (few-shot)	46998	68	32768	True	9,015 ± 2,966 / 1,121 ± 510	2.37	2.26	2.27	1.95	3.12	2.68	2.24	2.60	1.80	49.18 ± 2.27 / 32.04 ± 1.45	49.76 ± 1.76 / 64.54 ± 1.57	41.28 ± 3.88 / 66.46 ± 4.23	12.83 ± 5.44 / 40.81 ± 3.18	67.44 ± 0.39 / 22.88 ± 0.66	77.55 ± 1.15 / 83.10 ± 0.89	74.67 ± 1.83 / 82.79 ± 1.28	36.42 ± 2.29 / 51.22 ± 1.72	58.05 ± 2.37 / 42.27 ± 2.34	59.65 ± 1.56 / 42.70 ± 2.35	57.94 ± 2.51 / 71.75 ± 2.43	65.07 ± 0.24 / 18.51 ± 0.39	51.36 ± 5.61 / 73.74 ± 5.30	42.84 ± 3.95 / 70.80 ± 2.32	14.72 ± 3.35 / 53.03 ± 2.43	43.18 ± 0.88 / 57.12 ± 0.65	37.58 ± 3.38 / 50.89 ± 2.88	57.66 ± 1.75 / 36.87 ± 4.27	80.04 ± 0.73 / 80.11 ± 0.89	45.21 ± 3.06 / 70.61 ± 2.93	52.73 ± 2.46 / 63.63 ± 1.65	59.91 ± 1.12 / 18.25 ± 1.04	42.25 ± 0.97 / 56.59 ± 0.80	28.88 ± 2.42 / 45.53 ± 2.20	41.84 ± 3.14 / 24.97 ± 2.44	38.12 ± 1.81 / 54.60 ± 1.56	7.47 ± 1.59 / 45.34 ± 4.68	20.87 ± 2.65 / 52.61 ± 1.29	65.24 ± 0.58 / 19.34 ± 0.51	13.41 ± 2.29 / 35.09 ± 1.66	3.94 ± 2.09 / 50.90 ± 1.51	58.62 ± 3.34 / 53.80 ± 3.15	40.74 ± 5.37 / 57.33 ± 4.26	5.58 ± 2.68 / 45.68 ± 4.79	28.04 ± 7.49 / 52.48 ± 5.80	56.14 ± 1.69 / 44.49 ± 3.25	53.33 ± 4.66 / 64.05 ± 6.18	29.49 ± 6.46 / 59.01 ± 6.80	18.49 ± 4.03 / 55.32 ± 2.95	64.84 ± 1.06 / 21.23 ± 1.72	44.31 ± 0.88 / 57.84 ± 0.67	30.72 ± 4.07 / 46.97 ± 3.37	62.81 ± 3.06 / 43.07 ± 2.90	11.28 ± 2.13 / 32.44 ± 3.18	28.57 ± 2.14 / 60.59 ± 2.37	38.75 ± 5.65 / 58.21 ± 3.41	65.35 ± 0.98 / 18.66 ± 0.83	39.53 ± 0.99 / 54.24 ± 0.73	26.71 ± 3.11 / 44.58 ± 2.46	63.77 ± 2.22 / 57.86 ± 1.49	69.23 ± 0.98 / 66.61 ± 1.42	38.49 ± 4.39 / 65.15 ± 4.44	57.03 ± 4.40 / 76.18 ± 2.59	70.47 ± 0.55 / 26.63 ± 0.50	54.58 ± 0.94 / 65.69 ± 0.71	47.93 ± 3.99 / 59.68 ± 3.43	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
meta-llama/Llama-3.1-8B (few-shot)	8030	128	131072	True	2,986 ± 823 / 276 ± 94	2.37	2.20	2.62	2.17	2.81	2.80	2.22	2.31	1.85	50.92 ± 1.88 / 34.24 ± 2.85	47.86 ± 1.66 / 62.47 ± 1.97	29.19 ± 2.02 / 59.61 ± 3.20	48.38 ± 5.07 / 55.27 ± 4.71	64.89 ± 0.69 / 18.31 ± 1.03	51.88 ± 2.75 / 63.27 ± 2.28	62.31 ± 1.65 / 74.08 ± 1.29	27.37 ± 2.18 / 44.83 ± 1.77	65.17 ± 2.02 / 52.91 ± 2.25	60.22 ± 2.29 / 50.51 ± 3.15	34.02 ± 0.93 / 37.19 ± 0.86	62.16 ± 0.46 / 14.17 ± 0.62	32.48 ± 3.31 / 63.48 ± 2.97	18.38 ± 4.77 / 49.87 ± 5.55	33.06 ± 4.39 / 58.56 ± 4.32	32.40 ± 1.19 / 48.21 ± 0.92	24.89 ± 2.57 / 43.29 ± 1.79	62.19 ± 2.34 / 43.29 ± 4.62	80.31 ± 0.45 / 76.50 ± 1.19	30.29 ± 3.08 / 56.52 ± 4.71	42.78 ± 7.55 / 49.56 ± 7.91	64.14 ± 0.58 / 18.03 ± 0.51	35.10 ± 1.17 / 50.10 ± 0.98	23.18 ± 2.01 / 41.44 ± 1.95	52.97 ± 1.54 / 38.17 ± 4.65	41.29 ± 2.30 / 59.30 ± 1.75	5.95 ± 2.81 / 40.86 ± 3.68	31.99 ± 2.60 / 60.26 ± 1.51	65.19 ± 0.73 / 17.47 ± 0.61	21.56 ± 1.35 / 40.99 ± 1.01	4.44 ± 1.77 / 54.52 ± 1.51	65.65 ± 3.31 / 63.81 ± 2.72	24.30 ± 7.03 / 35.85 ± 7.35	0.61 ± 1.75 / 35.51 ± 2.23	45.01 ± 1.79 / 65.74 ± 1.54	59.45 ± 1.64 / 46.60 ± 2.02	53.39 ± 5.35 / 65.74 ± 5.74	23.87 ± 5.74 / 57.17 ± 6.01	27.14 ± 2.19 / 54.63 ± 2.74	64.01 ± 1.18 / 17.85 ± 1.99	36.56 ± 0.73 / 52.11 ± 0.56	30.05 ± 2.57 / 46.82 ± 2.11	64.79 ± 1.96 / 45.48 ± 2.24	11.95 ± 2.83 / 37.12 ± 2.19	32.97 ± 2.68 / 58.52 ± 2.92	63.89 ± 1.06 / 74.73 ± 1.02	66.29 ± 1.29 / 20.14 ± 1.64	38.44 ± 1.33 / 53.68 ± 1.01	30.88 ± 2.27 / 47.18 ± 1.81	69.86 ± 2.10 / 62.68 ± 2.21	66.76 ± 0.72 / 68.58 ± 0.72	30.96 ± 2.46 / 61.29 ± 3.61	71.39 ± 2.20 / 84.24 ± 1.55	67.93 ± 0.44 / 22.00 ± 0.51	52.47 ± 0.85 / 64.25 ± 0.66	43.95 ± 3.26 / 57.04 ± 2.74	14.0.3	14.1.2	14.1.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.0	14.1.2	14.1.2	14.0.0	14.0.0	14.0.0	14.0.0	14.0.4	14.1.2	14.1.2	14.0.4	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	12.11.0	12.11.0	12.11.0	13.0.0	13.0.0	13.0.0	13.0.0	12.11.0	12.11.0	12.11.0	13.0.0	13.0.0	13.0.0	13.0.0
Nexusflow/Starling-LM-7B-beta (few-shot)	7242	32	4096	False	4,136 ± 1,282 / 668 ± 326	2.39	2.27	2.09	2.13	3.33	3.07	2.19	2.44	1.63	51.94 ± 2.00 / 27.59 ± 1.79	51.97 ± 1.36 / 68.62 ± 0.93	29.99 ± 0.73 / 60.05 ± 1.33	38.99 ± 2.82 / 52.38 ± 2.25	64.49 ± 0.10 / 14.18 ± 0.17	35.95 ± 2.22 / 51.40 ± 1.57	59.76 ± 1.99 / 73.24 ± 1.37	34.63 ± 2.52 / 50.01 ± 2.00	66.22 ± 2.15 / 48.98 ± 4.65	64.14 ± 1.26 / 49.59 ± 4.31	55.48 ± 1.77 / 69.68 ± 1.45	65.32 ± 0.41 / 18.53 ± 0.65	26.13 ± 1.28 / 56.08 ± 2.05	17.32 ± 0.77 / 54.57 ± 1.49	49.75 ± 1.22 / 77.08 ± 0.60	29.72 ± 1.33 / 46.95 ± 0.96	46.78 ± 2.83 / 59.65 ± 2.28	56.28 ± 1.55 / 28.71 ± 3.39	77.51 ± 0.55 / 76.88 ± 0.58	23.25 ± 2.19 / 50.00 ± 2.40	47.09 ± 2.61 / 59.76 ± 2.06	65.58 ± 0.17 / 17.40 ± 0.09	31.52 ± 1.23 / 48.14 ± 0.93	39.95 ± 2.32 / 54.35 ± 1.92	42.23 ± 4.22 / 25.96 ± 4.27	27.93 ± 2.80 / 48.93 ± 1.43	6.38 ± 0.99 / 49.63 ± 1.47	19.39 ± 3.38 / 53.87 ± 1.59	61.92 ± 1.25 / 15.31 ± 1.05	4.22 ± 0.83 / 28.35 ± 0.70	0.31 ± 2.64 / 54.29 ± 1.30	62.20 ± 1.42 / 45.92 ± 2.03	26.68 ± 6.93 / 47.94 ± 8.20	7.07 ± 2.30 / 44.94 ± 2.71	11.97 ± 3.61 / 31.80 ± 3.65	61.37 ± 1.04 / 36.06 ± 2.27	51.38 ± 2.17 / 67.66 ± 1.45	35.58 ± 1.85 / 66.99 ± 0.83	19.92 ± 3.88 / 57.70 ± 2.99	63.64 ± 0.06 / 12.60 ± 0.12	33.87 ± 0.63 / 49.89 ± 0.56	48.46 ± 1.55 / 60.82 ± 1.32	63.01 ± 2.00 / 33.76 ± 1.86	15.13 ± 1.83 / 40.18 ± 1.61	39.20 ± 1.25 / 68.05 ± 1.27	36.46 ± 2.79 / 59.21 ± 2.19	64.42 ± 0.66 / 14.56 ± 0.60	32.99 ± 1.03 / 49.58 ± 0.77	42.56 ± 1.31 / 56.00 ± 0.93	72.77 ± 1.02 / 57.29 ± 1.58	70.12 ± 0.78 / 74.54 ± 0.50	44.68 ± 0.97 / 71.05 ± 0.52	57.17 ± 2.60 / 80.36 ± 1.40	69.32 ± 0.08 / 23.63 ± 0.24	47.17 ± 1.25 / 60.21 ± 0.92	77.25 ± 0.73 / 82.76 ± 0.56	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	12.5.2	12.5.2	12.5.2	12.5.2	12.5.2	12.5.2	12.5.2	12.5.2	12.5.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
meta-llama/Meta-Llama-3-8B (few-shot)	8030	128	8192	True	1,477 ± 376 / 285 ± 97	2.39	2.22	2.67	2.17	2.87	2.84	2.00	2.46	1.90	49.46 ± 1.88 / 32.11 ± 2.41	51.16 ± 2.15 / 67.00 ± 1.51	23.01 ± 3.93 / 49.99 ± 4.63	49.75 ± 5.10 / 56.13 ± 4.89	65.26 ± 0.48 / 18.81 ± 0.72	51.64 ± 2.09 / 63.34 ± 1.71	59.28 ± 1.85 / 72.62 ± 1.29	24.30 ± 3.14 / 42.50 ± 2.67	62.89 ± 2.01 / 50.34 ± 1.92	56.18 ± 3.26 / 47.30 ± 2.62	33.07 ± 0.73 / 37.60 ± 0.49	61.95 ± 0.69 / 14.09 ± 0.61	30.73 ± 3.19 / 64.06 ± 2.41	20.57 ± 3.62 / 54.22 ± 5.15	30.77 ± 4.33 / 54.66 ± 4.41	30.95 ± 1.33 / 47.50 ± 0.99	21.98 ± 2.12 / 41.07 ± 1.52	59.92 ± 2.46 / 40.98 ± 4.90	80.91 ± 0.41 / 78.09 ± 1.22	26.39 ± 3.47 / 52.38 ± 4.49	47.69 ± 6.29 / 54.30 ± 6.65	63.94 ± 0.48 / 17.92 ± 0.37	33.39 ± 0.95 / 49.21 ± 0.77	20.21 ± 1.46 / 39.29 ± 1.54	50.45 ± 1.95 / 37.62 ± 3.95	34.68 ± 3.74 / 53.39 ± 3.75	8.69 ± 2.70 / 44.84 ± 4.03	31.94 ± 2.16 / 59.26 ± 1.50	65.22 ± 0.77 / 17.53 ± 0.72	19.93 ± 1.86 / 39.95 ± 1.39	4.52 ± 2.03 / 53.43 ± 2.36	61.11 ± 4.21 / 58.55 ± 4.19	19.40 ± 8.13 / 32.14 ± 7.75	2.02 ± 1.68 / 39.88 ± 3.56	50.34 ± 1.74 / 71.74 ± 1.27	56.00 ± 1.94 / 43.49 ± 2.05	56.40 ± 3.89 / 70.17 ± 2.91	22.01 ± 5.17 / 56.97 ± 3.54	35.39 ± 2.49 / 64.61 ± 2.42	68.92 ± 0.99 / 26.93 ± 2.01	38.12 ± 0.75 / 53.52 ± 0.56	31.37 ± 1.37 / 47.65 ± 1.09	62.26 ± 2.20 / 42.41 ± 2.02	10.45 ± 2.69 / 33.45 ± 1.99	30.30 ± 3.94 / 62.28 ± 2.89	62.99 ± 1.00 / 73.73 ± 0.98	65.17 ± 1.24 / 18.63 ± 1.85	36.38 ± 0.86 / 52.08 ± 0.66	28.33 ± 2.31 / 45.29 ± 1.78	66.31 ± 2.09 / 58.68 ± 1.95	64.30 ± 0.65 / 69.26 ± 0.50	28.18 ± 3.96 / 58.97 ± 4.03	70.38 ± 3.51 / 82.95 ± 2.38	67.90 ± 0.49 / 21.54 ± 0.57	52.54 ± 0.88 / 64.26 ± 0.66	41.19 ± 4.40 / 54.78 ± 3.62	14.0.3	14.1.2	14.1.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.1	14.1.2	14.1.2	14.0.1	14.0.1	14.0.2	14.0.2	12.6.1	14.1.2	12.6.1	13.0.0	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1
senseable/WestLake-7B-v2 (few-shot)	7242	32	32768	False	5,993 ± 1,028 / 1,742 ± 561	2.41	2.13	2.34	2.18	3.23	3.31	2.01	2.25	1.86	52.61 ± 1.77 / 33.64 ± 2.67	49.81 ± 1.43 / 66.32 ± 1.25	19.64 ± 1.63 / 54.22 ± 2.32	48.03 ± 1.24 / 57.94 ± 1.02	66.67 ± 0.87 / 21.08 ± 0.83	57.65 ± 1.99 / 68.08 ± 1.51	51.99 ± 3.67 / 66.43 ± 2.85	44.44 ± 1.52 / 58.16 ± 1.21	64.37 ± 2.17 / 52.81 ± 2.48	62.77 ± 0.83 / 51.80 ± 2.77	50.60 ± 4.90 / 66.76 ± 3.04	65.09 ± 0.31 / 17.27 ± 0.66	18.09 ± 2.04 / 52.56 ± 2.60	12.25 ± 2.18 / 50.79 ± 2.42	38.34 ± 2.39 / 69.54 ± 1.96	27.33 ± 0.72 / 45.16 ± 0.55	41.59 ± 2.61 / 56.02 ± 2.08	58.90 ± 1.34 / 42.48 ± 3.97	67.74 ± 2.79 / 71.89 ± 1.89	16.52 ± 2.55 / 46.30 ± 2.62	49.41 ± 1.21 / 59.91 ± 0.48	66.09 ± 0.17 / 19.64 ± 0.27	31.76 ± 0.89 / 48.64 ± 0.69	45.84 ± 1.47 / 59.27 ± 1.16	56.71 ± 1.98 / 46.71 ± 5.28	7.92 ± 3.63 / 32.79 ± 2.05	3.44 ± 2.02 / 50.18 ± 1.14	21.55 ± 2.79 / 54.79 ± 2.02	65.39 ± 0.80 / 18.24 ± 1.00	9.11 ± 0.92 / 32.06 ± 0.70	3.30 ± 2.81 / 44.40 ± 1.61	67.42 ± 2.21 / 60.87 ± 3.22	20.01 ± 4.67 / 38.23 ± 3.04	7.02 ± 1.56 / 49.32 ± 2.91	0.65 ± 0.17 / 7.03 ± 0.26	64.38 ± 1.60 / 50.26 ± 2.53	54.44 ± 1.45 / 69.32 ± 1.02	26.03 ± 2.23 / 61.88 ± 1.38	25.68 ± 2.81 / 62.48 ± 2.93	68.16 ± 0.95 / 24.52 ± 2.45	33.84 ± 1.54 / 50.24 ± 1.19	50.99 ± 0.99 / 63.11 ± 0.75	64.25 ± 2.23 / 46.52 ± 1.72	13.66 ± 1.99 / 39.45 ± 1.52	28.59 ± 1.48 / 61.24 ± 1.46	49.64 ± 0.86 / 68.04 ± 0.55	68.66 ± 0.57 / 19.51 ± 0.67	35.37 ± 1.30 / 51.43 ± 0.96	47.50 ± 1.75 / 60.41 ± 1.32	70.62 ± 0.90 / 58.92 ± 2.15	67.78 ± 1.03 / 72.29 ± 0.47	30.99 ± 2.94 / 62.20 ± 2.56	49.56 ± 2.85 / 76.72 ± 1.15	70.76 ± 0.56 / 24.95 ± 1.03	44.11 ± 4.39 / 57.76 ± 3.36	69.20 ± 2.71 / 76.75 ± 2.06	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	13.3.0	12.6.1	12.6.1	12.6.1	12.10.8	12.6.1	12.6.1	13.3.0	12.6.1	13.0.0	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1	12.6.1
utter-project/EuroLLM-9B-Instruct (few-shot)	9152	128	4096	False	1,483 ± 321 / 379 ± 158	2.41	1.98	2.42	2.08	3.44	2.88	2.04	2.35	2.09	34.00 ± 2.69 / 25.49 ± 2.06	53.97 ± 1.21 / 68.40 ± 1.28	32.21 ± 4.81 / 56.97 ± 5.83	57.10 ± 0.99 / 63.73 ± 0.85	67.55 ± 1.08 / 23.77 ± 0.94	80.75 ± 1.25 / 85.31 ± 0.98	74.77 ± 1.93 / 83.14 ± 1.29	36.86 ± 1.37 / 51.61 ± 1.09	40.91 ± 2.56 / 33.22 ± 1.88	42.91 ± 2.34 / 35.61 ± 2.22	52.62 ± 2.01 / 68.10 ± 2.25	65.77 ± 0.38 / 19.35 ± 0.75	9.70 ± 4.22 / 36.58 ± 1.69	11.98 ± 2.76 / 39.37 ± 2.76	47.36 ± 4.28 / 72.71 ± 4.10	36.97 ± 1.21 / 52.08 ± 0.96	37.64 ± 1.86 / 51.95 ± 1.52	40.59 ± 1.98 / 28.19 ± 1.47	76.02 ± 2.40 / 77.86 ± 1.70	33.98 ± 5.90 / 57.44 ± 6.59	56.98 ± 0.58 / 63.97 ± 0.66	66.33 ± 0.19 / 20.77 ± 0.27	40.09 ± 0.90 / 54.78 ± 0.70	36.27 ± 1.57 / 50.67 ± 1.45	24.92 ± 3.54 / 23.09 ± 3.30	9.76 ± 7.16 / 26.68 ± 6.80	0.15 ± 0.29 / 33.01 ± 0.31	28.18 ± 1.51 / 54.08 ± 0.71	64.67 ± 1.48 / 18.74 ± 1.31	11.10 ± 0.78 / 33.53 ± 0.69	0.89 ± 1.86 / 51.27 ± 1.18	54.79 ± 2.33 / 46.30 ± 4.57	35.84 ± 8.64 / 48.22 ± 7.58	0.00 ± 0.00 / 33.26 ± 0.54	41.94 ± 2.59 / 62.06 ± 2.17	40.85 ± 2.21 / 34.64 ± 2.00	56.53 ± 2.49 / 69.48 ± 1.70	24.74 ± 4.45 / 56.60 ± 5.56	38.20 ± 1.47 / 67.94 ± 2.19	69.44 ± 1.03 / 28.76 ± 2.71	39.43 ± 1.06 / 54.28 ± 0.77	37.67 ± 1.13 / 51.67 ± 1.11	43.06 ± 1.89 / 30.50 ± 1.45	11.95 ± 2.25 / 33.40 ± 1.41	40.85 ± 3.31 / 68.94 ± 2.23	63.42 ± 0.63 / 74.62 ± 0.52	69.33 ± 0.60 / 23.01 ± 1.18	41.90 ± 1.02 / 56.09 ± 0.76	36.69 ± 1.64 / 50.85 ± 1.65	44.81 ± 2.07 / 39.51 ± 1.62	62.54 ± 2.18 / 68.78 ± 1.18	28.10 ± 4.55 / 62.46 ± 4.36	71.71 ± 2.21 / 84.31 ± 1.69	69.27 ± 0.77 / 25.38 ± 1.10	45.95 ± 0.80 / 59.04 ± 0.60	43.97 ± 1.97 / 56.43 ± 1.61	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.0.4	14.0.4	14.0.4	14.0.4	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
CohereForAI/c4ai-command-r-v01 (few-shot)	34981	256	8192	False	1,919 ± 645 / 248 ± 83	2.44	2.23	2.66	2.29	3.17	2.64	2.14	2.49	1.86	53.44 ± 1.53 / 33.98 ± 1.94	49.17 ± 1.04 / 61.82 ± 1.64	20.55 ± 1.56 / 51.55 ± 2.37	51.70 ± 1.48 / 62.01 ± 1.21	65.47 ± 0.14 / 17.13 ± 0.39	37.41 ± 1.84 / 52.54 ± 1.27	62.46 ± 2.29 / 74.92 ± 1.54	26.25 ± 1.68 / 43.96 ± 1.25	61.54 ± 2.53 / 42.44 ± 2.12	60.94 ± 1.48 / 43.92 ± 2.09	35.73 ± 0.66 / 38.06 ± 0.54	63.77 ± 0.17 / 13.21 ± 0.37	21.33 ± 2.08 / 52.01 ± 3.05	13.20 ± 1.51 / 52.20 ± 2.53	32.36 ± 1.99 / 61.64 ± 1.20	27.87 ± 1.17 / 45.13 ± 1.00	30.99 ± 1.23 / 47.54 ± 0.95	47.15 ± 2.31 / 29.98 ± 2.07	80.24 ± 0.75 / 78.86 ± 1.28	11.35 ± 1.20 / 41.82 ± 1.41	49.93 ± 1.69 / 61.00 ± 1.14	65.30 ± 0.09 / 17.12 ± 0.25	29.64 ± 1.87 / 46.27 ± 1.65	31.96 ± 1.53 / 48.43 ± 1.09	42.29 ± 2.87 / 27.16 ± 2.06	38.87 ± 2.06 / 54.76 ± 1.96	0.28 ± 1.28 / 44.15 ± 2.34	18.74 ± 3.19 / 49.89 ± 1.52	66.07 ± 0.16 / 17.33 ± 0.39	10.93 ± 1.17 / 33.27 ± 0.89	4.44 ± 3.37 / 53.49 ± 1.46	64.53 ± 1.51 / 50.53 ± 3.29	44.01 ± 1.86 / 55.97 ± 2.61	2.39 ± 1.56 / 38.90 ± 2.09	34.84 ± 3.88 / 58.25 ± 3.25	62.43 ± 0.91 / 43.18 ± 2.22	53.90 ± 1.12 / 65.63 ± 1.62	29.68 ± 3.64 / 62.39 ± 2.81	19.35 ± 3.19 / 50.25 ± 1.61	64.80 ± 0.12 / 14.58 ± 0.34	41.22 ± 0.72 / 55.63 ± 0.54	46.05 ± 1.33 / 59.27 ± 1.10	61.21 ± 2.15 / 41.76 ± 1.84	9.03 ± 1.38 / 29.15 ± 1.45	38.15 ± 2.37 / 65.60 ± 2.16	44.91 ± 3.07 / 63.57 ± 1.72	67.58 ± 0.17 / 18.69 ± 0.23	41.03 ± 0.96 / 55.56 ± 0.74	44.57 ± 1.60 / 58.17 ± 1.22	71.96 ± 0.83 / 63.08 ± 1.18	67.26 ± 0.99 / 68.90 ± 1.29	40.81 ± 1.97 / 70.25 ± 1.02	49.79 ± 2.48 / 73.04 ± 1.31	68.97 ± 0.15 / 22.78 ± 0.28	50.59 ± 1.17 / 62.68 ± 0.84	58.04 ± 1.68 / 68.27 ± 1.28	14.0.4	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.1.1	14.1.1	14.0.4	14.0.4	14.0.4	14.1.1	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.0.4	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.1.1	14.0.4	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.1.1	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.1.1	14.0.4	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.1.1	14.0.4	14.0.4	14.0.4	14.0.4	14.1.1	14.1.1	14.1.1
ibm-granite/granite-3.0-8b-instruct (few-shot)	8171	49	4096	True	1,118 ± 302 / 184 ± 63	2.49	2.39	2.54	2.30	3.44	2.85	2.11	2.52	1.75	44.92 ± 3.05 / 32.65 ± 2.50	49.31 ± 1.35 / 66.02 ± 1.10	10.14 ± 2.87 / 44.99 ± 4.82	57.34 ± 0.99 / 63.24 ± 0.44	66.02 ± 0.75 / 20.91 ± 0.70	33.71 ± 1.69 / 49.70 ± 1.24	43.55 ± 3.67 / 62.50 ± 2.36	21.34 ± 1.27 / 39.77 ± 1.09	53.79 ± 1.52 / 46.58 ± 1.73	56.13 ± 0.91 / 47.13 ± 2.04	51.36 ± 2.53 / 66.19 ± 2.08	62.40 ± 1.11 / 13.68 ± 1.61	6.83 ± 2.54 / 38.36 ± 3.81	8.09 ± 2.03 / 41.05 ± 4.14	48.01 ± 2.52 / 73.03 ± 1.99	24.55 ± 0.94 / 42.12 ± 0.85	26.71 ± 1.68 / 44.15 ± 1.46	44.94 ± 2.91 / 35.67 ± 3.53	76.78 ± 1.63 / 78.27 ± 1.22	16.96 ± 2.77 / 55.03 ± 3.49	56.83 ± 1.02 / 63.13 ± 0.89	65.09 ± 0.37 / 19.37 ± 0.37	26.57 ± 1.18 / 44.19 ± 0.95	24.62 ± 2.11 / 42.11 ± 1.50	42.67 ± 3.13 / 35.40 ± 3.93	9.95 ± 3.78 / 30.20 ± 5.91	1.11 ± 1.45 / 34.61 ± 0.82	22.25 ± 2.78 / 49.58 ± 2.19	63.81 ± 1.05 / 16.07 ± 1.19	5.12 ± 1.20 / 27.91 ± 0.90	0.89 ± 2.37 / 53.27 ± 1.64	59.96 ± 2.42 / 58.61 ± 2.57	28.33 ± 7.70 / 49.72 ± 6.84	2.24 ± 1.78 / 41.32 ± 3.70	39.52 ± 1.83 / 57.16 ± 2.10	54.68 ± 1.38 / 46.36 ± 2.67	55.48 ± 2.67 / 69.91 ± 1.90	26.89 ± 0.86 / 62.51 ± 0.48	31.27 ± 1.89 / 62.30 ± 2.09	66.33 ± 0.75 / 20.58 ± 1.77	33.98 ± 0.82 / 50.12 ± 0.65	34.59 ± 1.42 / 49.13 ± 1.25	53.62 ± 2.29 / 40.51 ± 1.41	13.37 ± 1.25 / 36.94 ± 1.81	23.47 ± 1.79 / 60.17 ± 1.23	61.20 ± 1.02 / 72.98 ± 0.62	62.34 ± 3.24 / 18.49 ± 1.19	34.69 ± 0.59 / 50.59 ± 0.56	31.36 ± 1.90 / 46.78 ± 1.51	66.17 ± 1.74 / 57.76 ± 1.30	68.03 ± 0.81 / 69.65 ± 1.18	39.76 ± 2.51 / 69.54 ± 1.18	71.21 ± 1.53 / 84.07 ± 0.91	69.30 ± 0.10 / 23.68 ± 0.29	49.99 ± 0.60 / 62.20 ± 0.47	52.45 ± 1.74 / 61.79 ± 1.58	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
mistralai/Mistral-7B-v0.1 (few-shot)	7242	32	32768	True	1,446 ± 354 / 295 ± 100	2.49	2.35	2.62	2.24	3.27	2.78	2.10	2.67	1.90	45.42 ± 2.88 / 32.66 ± 2.49	43.16 ± 1.69 / 54.53 ± 2.83	8.79 ± 3.23 / 38.38 ± 4.22	59.43 ± 1.04 / 64.55 ± 0.68	66.47 ± 1.00 / 22.11 ± 1.08	53.26 ± 1.94 / 64.50 ± 1.68	58.26 ± 2.62 / 71.56 ± 1.79	18.53 ± 2.03 / 37.79 ± 1.68	52.00 ± 1.91 / 43.55 ± 2.21	55.12 ± 3.14 / 45.34 ± 4.15	47.25 ± 4.11 / 64.53 ± 3.71	63.49 ± 1.49 / 16.48 ± 1.62	8.66 ± 4.12 / 38.87 ± 3.40	6.80 ± 1.59 / 39.72 ± 2.50	46.86 ± 3.27 / 70.86 ± 2.79	27.78 ± 1.08 / 45.76 ± 0.79	10.88 ± 3.63 / 32.43 ± 2.67	53.34 ± 2.55 / 40.48 ± 3.66	80.00 ± 0.70 / 79.80 ± 0.66	4.61 ± 2.18 / 34.51 ± 0.86	58.99 ± 1.05 / 64.65 ± 0.83	64.87 ± 0.31 / 19.30 ± 0.43	35.52 ± 1.01 / 51.52 ± 0.73	19.67 ± 2.31 / 38.98 ± 1.98	50.69 ± 3.67 / 41.90 ± 4.06	24.38 ± 5.21 / 44.65 ± 5.83	1.46 ± 1.66 / 38.73 ± 2.27	27.11 ± 3.11 / 51.14 ± 2.22	56.76 ± 2.97 / 13.19 ± 1.46	8.71 ± 0.95 / 31.51 ± 0.81	3.21 ± 2.55 / 56.74 ± 1.01	62.63 ± 3.44 / 57.85 ± 3.72	25.57 ± 6.07 / 44.34 ± 6.18	2.84 ± 1.84 / 42.62 ± 4.53	44.06 ± 1.93 / 60.40 ± 2.37	55.37 ± 1.32 / 44.65 ± 2.48	54.27 ± 1.71 / 68.13 ± 1.16	23.12 ± 4.07 / 57.81 ± 3.70	31.89 ± 3.29 / 59.77 ± 4.31	68.24 ± 0.70 / 25.71 ± 1.33	35.63 ± 1.12 / 51.69 ± 0.85	26.40 ± 1.86 / 43.98 ± 1.58	58.15 ± 1.14 / 40.78 ± 1.91	7.94 ± 1.25 / 31.02 ± 3.45	25.41 ± 3.46 / 61.11 ± 2.36	62.56 ± 1.10 / 73.16 ± 0.93	64.24 ± 0.91 / 17.54 ± 1.10	35.49 ± 0.57 / 51.51 ± 0.42	19.88 ± 1.80 / 39.13 ± 1.56	63.40 ± 2.72 / 56.92 ± 2.17	68.17 ± 1.33 / 70.74 ± 0.93	30.92 ± 4.81 / 63.79 ± 4.42	73.45 ± 1.83 / 84.54 ± 1.42	69.11 ± 0.31 / 23.70 ± 0.53	47.74 ± 1.26 / 60.63 ± 0.97	34.96 ± 4.19 / 49.62 ± 3.28	0.0.0	0.0.0	0.0.0	12.5.1	12.6.1	10.0.1	10.0.1	9.1.2	0.0.0	0.0.0	0.0.0	11.0.0	0.0.0	0.0.0	12.5.1	9.1.2	9.1.2	0.0.0	0.0.0	0.0.0	12.5.1	11.0.0	9.1.2	9.1.2	14.0.3	14.1.2	14.1.2	14.0.3	14.0.3	14.0.3	14.0.3	9.1.2	14.1.2	9.1.2	13.0.0	9.1.2	9.1.2	9.1.2	12.5.1	11.0.0	9.1.2	9.2.0	9.1.2	9.1.2	9.1.2	12.5.1	11.0.0	9.2.0	9.2.0	9.1.2	9.1.2	9.1.2	12.5.1	11.0.0	9.2.0	9.2.0
mistralai/Mistral-7B-v0.3 (few-shot)	7248	33	32768	True	1,364 ± 343 / 266 ± 90	2.52	2.27	2.67	2.25	3.33	2.81	2.13	2.78	1.93	43.60 ± 2.94 / 32.17 ± 2.26	45.92 ± 1.50 / 61.91 ± 1.50	15.43 ± 3.79 / 46.20 ± 5.54	59.13 ± 0.86 / 64.43 ± 0.58	66.33 ± 0.98 / 22.03 ± 0.96	53.81 ± 1.88 / 64.81 ± 1.53	61.06 ± 2.83 / 73.89 ± 2.00	20.64 ± 1.95 / 39.21 ± 1.79	50.56 ± 2.04 / 44.38 ± 1.85	52.65 ± 2.27 / 46.48 ± 3.65	44.61 ± 2.28 / 62.22 ± 2.10	63.13 ± 1.63 / 16.19 ± 1.73	12.10 ± 4.22 / 43.27 ± 5.24	9.30 ± 0.99 / 46.11 ± 3.47	45.15 ± 3.72 / 68.61 ± 3.30	28.31 ± 1.01 / 45.93 ± 0.80	13.59 ± 2.44 / 33.95 ± 1.83	49.18 ± 2.71 / 39.25 ± 3.60	79.08 ± 0.77 / 78.81 ± 0.94	11.06 ± 3.55 / 38.96 ± 3.77	58.98 ± 1.04 / 64.79 ± 0.79	64.79 ± 0.32 / 19.30 ± 0.42	34.51 ± 1.13 / 50.46 ± 0.88	20.84 ± 2.19 / 39.88 ± 1.85	46.73 ± 3.51 / 38.01 ± 4.18	26.28 ± 4.82 / 46.42 ± 4.24	1.50 ± 1.18 / 36.24 ± 1.65	25.17 ± 3.82 / 50.14 ± 2.43	55.71 ± 3.49 / 12.57 ± 1.70	7.21 ± 1.17 / 30.37 ± 0.97	2.09 ± 2.31 / 55.37 ± 1.42	61.32 ± 4.26 / 59.28 ± 4.43	26.73 ± 4.70 / 45.03 ± 5.25	1.30 ± 1.64 / 45.10 ± 3.27	44.98 ± 1.62 / 62.38 ± 1.68	55.41 ± 1.45 / 48.39 ± 1.46	52.58 ± 2.42 / 67.52 ± 1.82	24.10 ± 2.12 / 59.47 ± 2.92	31.52 ± 2.95 / 60.03 ± 3.81	68.96 ± 1.13 / 28.26 ± 2.32	35.06 ± 0.54 / 51.20 ± 0.43	28.85 ± 1.70 / 45.83 ± 1.39	56.52 ± 1.42 / 41.84 ± 1.84	7.02 ± 1.21 / 26.40 ± 2.96	23.41 ± 2.91 / 59.14 ± 3.11	61.90 ± 1.07 / 72.49 ± 1.05	64.37 ± 0.74 / 17.69 ± 0.90	34.93 ± 1.11 / 51.02 ± 0.87	23.73 ± 1.97 / 41.93 ± 1.68	61.02 ± 2.74 / 55.65 ± 2.55	67.29 ± 0.80 / 70.81 ± 0.84	30.10 ± 5.12 / 62.99 ± 4.71	73.59 ± 1.75 / 84.31 ± 1.35	69.04 ± 0.56 / 23.86 ± 0.77	47.63 ± 1.17 / 60.45 ± 0.88	35.63 ± 4.21 / 49.72 ± 3.73	12.10.4	12.10.4	12.10.4	12.10.4	12.10.5	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.5	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.5	12.10.4	12.10.4	14.0.3	14.1.2	14.1.2	14.0.3	14.0.3	14.0.3	14.0.3	12.10.4	14.1.2	12.10.4	13.0.0	12.10.4	12.10.4	12.10.4	12.10.5	12.10.5	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.5	12.10.5	12.10.4	12.10.4	12.10.4	12.10.4	12.10.4	12.10.5	12.10.5	12.10.4	12.10.4
NorwAI/NorwAI-Mixtral-8x7B (few-shot)	46998	68	32768	True	2,368 ± 793 / 317 ± 108	2.53	2.05	2.39	2.22	3.29	2.79	2.36	2.73	2.41	51.95 ± 1.51 / 31.96 ± 1.74	52.11 ± 1.49 / 67.70 ± 1.08	44.47 ± 2.01 / 69.57 ± 2.71	43.32 ± 8.90 / 50.67 ± 8.15	64.64 ± 0.79 / 21.13 ± 0.55	77.33 ± 0.74 / 82.90 ± 0.58	79.05 ± 1.54 / 86.04 ± 1.07	23.81 ± 4.55 / 40.25 ± 3.94	58.53 ± 2.06 / 39.86 ± 1.77	60.26 ± 1.71 / 41.24 ± 1.50	59.48 ± 2.27 / 73.61 ± 2.04	54.54 ± 7.15 / 13.03 ± 2.14	51.85 ± 2.78 / 73.40 ± 2.33	41.89 ± 3.17 / 69.00 ± 2.68	25.62 ± 3.95 / 43.70 ± 5.67	43.35 ± 0.76 / 56.97 ± 0.60	26.91 ± 5.35 / 42.50 ± 4.87	57.01 ± 1.32 / 33.14 ± 2.45	80.12 ± 0.88 / 81.23 ± 0.76	43.04 ± 1.96 / 67.69 ± 2.83	30.44 ± 7.83 / 39.20 ± 7.83	63.55 ± 0.52 / 17.61 ± 0.71	41.92 ± 0.69 / 56.24 ± 0.52	19.13 ± 2.25 / 37.62 ± 1.27	36.73 ± 4.50 / 27.29 ± 1.83	34.34 ± 3.99 / 53.29 ± 3.80	6.57 ± 2.18 / 46.35 ± 4.24	22.59 ± 4.98 / 48.68 ± 4.19	58.69 ± 2.45 / 14.60 ± 1.15	12.07 ± 1.85 / 33.86 ± 1.36	2.87 ± 1.72 / 52.79 ± 1.13	62.60 ± 3.09 / 54.91 ± 2.40	31.36 ± 5.40 / 50.13 ± 5.67	5.21 ± 3.15 / 46.32 ± 4.42	34.26 ± 2.20 / 51.27 ± 2.30	57.26 ± 1.41 / 42.54 ± 2.77	54.57 ± 4.98 / 68.40 ± 4.08	26.52 ± 4.63 / 59.83 ± 5.12	19.96 ± 1.50 / 43.10 ± 2.18	61.10 ± 0.91 / 14.12 ± 1.59	43.30 ± 1.06 / 57.22 ± 0.87	23.82 ± 3.21 / 41.16 ± 2.65	62.76 ± 3.54 / 40.29 ± 1.82	13.83 ± 1.32 / 37.70 ± 1.94	24.44 ± 2.86 / 58.02 ± 2.28	26.17 ± 2.88 / 37.61 ± 2.20	63.34 ± 0.59 / 18.36 ± 0.69	38.50 ± 0.76 / 52.93 ± 0.49	20.26 ± 3.39 / 38.63 ± 3.03	63.12 ± 2.34 / 56.38 ± 1.23	66.47 ± 1.61 / 69.35 ± 1.31	38.82 ± 3.65 / 67.96 ± 2.36	29.16 ± 3.45 / 46.82 ± 4.35	57.65 ± 5.62 / 18.79 ± 1.79	54.57 ± 1.21 / 65.11 ± 0.83	30.13 ± 5.52 / 42.55 ± 4.99	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
ibm-granite/granite-3.0-8b-base (few-shot)	8171	49	4097	True	2,515 ± 625 / 476 ± 159	2.54	2.29	2.52	2.26	3.55	2.85	2.24	2.64	1.97	44.58 ± 2.62 / 33.50 ± 2.75	47.16 ± 1.36 / 64.63 ± 1.18	19.20 ± 2.44 / 53.44 ± 4.36	58.41 ± 1.36 / 63.32 ± 0.89	65.64 ± 0.99 / 21.12 ± 0.86	32.05 ± 2.18 / 47.54 ± 1.78	47.42 ± 1.74 / 65.02 ± 1.13	28.73 ± 1.32 / 46.04 ± 1.04	49.94 ± 2.13 / 46.49 ± 2.00	52.17 ± 1.02 / 46.44 ± 2.72	53.27 ± 1.54 / 66.73 ± 1.31	63.01 ± 1.50 / 15.82 ± 1.50	17.22 ± 3.50 / 50.42 ± 5.01	12.01 ± 2.47 / 47.98 ± 4.37	45.04 ± 3.42 / 69.52 ± 2.79	24.31 ± 1.12 / 42.68 ± 0.87	30.34 ± 1.41 / 47.38 ± 1.10	44.80 ± 2.36 / 34.91 ± 2.67	75.92 ± 2.44 / 75.77 ± 2.08	24.84 ± 2.78 / 59.88 ± 4.08	56.71 ± 1.65 / 62.01 ± 1.64	63.65 ± 0.52 / 18.25 ± 0.41	26.71 ± 1.53 / 44.61 ± 1.21	30.43 ± 0.92 / 47.06 ± 0.83	37.82 ± 3.63 / 32.97 ± 3.97	-0.29 ± 1.16 / 15.66 ± 0.37	-0.12 ± 1.31 / 33.78 ± 0.32	21.59 ± 2.22 / 47.09 ± 1.09	62.35 ± 3.34 / 16.15 ± 1.66	6.54 ± 1.30 / 28.63 ± 1.24	1.83 ± 3.53 / 49.23 ± 2.07	61.47 ± 1.57 / 58.60 ± 2.31	24.35 ± 6.38 / 30.32 ± 5.04	1.44 ± 1.85 / 34.71 ± 1.84	41.54 ± 1.49 / 58.90 ± 1.24	50.43 ± 1.80 / 41.26 ± 3.08	57.84 ± 3.59 / 71.20 ± 2.77	22.58 ± 5.59 / 53.17 ± 6.23	27.96 ± 1.39 / 54.99 ± 1.75	65.08 ± 1.62 / 20.35 ± 3.02	35.21 ± 1.13 / 51.21 ± 0.96	26.48 ± 1.04 / 43.71 ± 0.74	52.32 ± 1.98 / 41.98 ± 1.88	8.46 ± 1.09 / 21.30 ± 0.67	42.42 ± 3.42 / 68.81 ± 2.66	53.12 ± 1.81 / 63.79 ± 1.63	66.00 ± 0.61 / 18.47 ± 0.79	34.34 ± 0.87 / 50.51 ± 0.72	26.46 ± 3.88 / 43.33 ± 3.00	55.76 ± 2.15 / 52.69 ± 1.24	66.89 ± 1.11 / 69.52 ± 0.94	36.60 ± 2.37 / 67.85 ± 1.19	67.55 ± 1.46 / 80.25 ± 1.22	66.51 ± 0.93 / 21.81 ± 1.31	46.22 ± 1.20 / 59.52 ± 0.94	52.23 ± 2.04 / 61.87 ± 1.91	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
CohereForAI/aya-23-8B (few-shot)	8028	256	8192	False	2,707 ± 688 / 497 ± 166	2.58	2.34	2.70	2.28	3.60	3.05	2.47	2.27	1.94	47.08 ± 3.39 / 32.34 ± 2.97	47.16 ± 1.21 / 63.47 ± 1.57	8.41 ± 2.40 / 37.31 ± 1.66	58.83 ± 0.73 / 63.96 ± 0.56	65.03 ± 0.98 / 20.21 ± 0.77	36.64 ± 1.30 / 49.92 ± 1.19	39.24 ± 1.63 / 59.45 ± 1.09	27.29 ± 1.22 / 45.01 ± 0.99	60.94 ± 2.30 / 53.33 ± 3.53	59.61 ± 1.37 / 50.84 ± 3.99	35.73 ± 1.26 / 50.42 ± 1.67	62.45 ± 1.72 / 15.67 ± 1.26	6.18 ± 1.69 / 35.40 ± 1.06	4.00 ± 1.01 / 36.17 ± 0.94	46.52 ± 2.15 / 71.95 ± 1.63	20.14 ± 1.32 / 38.69 ± 0.99	27.50 ± 1.61 / 44.60 ± 1.39	60.04 ± 1.22 / 43.93 ± 3.63	76.21 ± 0.85 / 67.87 ± 1.71	7.54 ± 2.52 / 35.42 ± 1.33	58.60 ± 0.59 / 63.65 ± 0.30	63.00 ± 0.55 / 18.11 ± 0.35	20.97 ± 0.82 / 39.72 ± 0.64	28.96 ± 2.18 / 46.32 ± 1.64	47.16 ± 2.83 / 38.60 ± 4.04	0.33 ± 0.93 / 15.64 ± 1.01	3.84 ± 1.27 / 40.06 ± 3.79	21.75 ± 2.21 / 48.25 ± 2.02	59.16 ± 2.91 / 14.91 ± 1.85	3.70 ± 1.01 / 27.71 ± 0.66	-3.24 ± 3.16 / 49.96 ± 2.38	62.22 ± 2.10 / 58.79 ± 2.20	17.34 ± 5.56 / 37.16 ± 5.28	0.01 ± 2.43 / 37.74 ± 4.20	38.70 ± 1.22 / 54.70 ± 0.93	51.20 ± 4.11 / 41.29 ± 2.80	47.79 ± 3.34 / 64.03 ± 2.90	18.04 ± 1.40 / 54.89 ± 2.23	29.46 ± 1.12 / 55.85 ± 1.72	62.58 ± 0.45 / 15.06 ± 0.66	24.21 ± 0.88 / 42.71 ± 0.85	30.55 ± 3.52 / 45.97 ± 3.24	60.81 ± 1.94 / 46.59 ± 3.32	7.90 ± 1.63 / 24.82 ± 0.95	31.12 ± 2.35 / 64.29 ± 1.88	63.00 ± 1.23 / 74.60 ± 0.67	72.90 ± 0.24 / 30.63 ± 0.42	32.37 ± 1.09 / 48.63 ± 0.82	53.32 ± 1.89 / 64.30 ± 1.72	56.16 ± 3.59 / 51.12 ± 2.58	68.27 ± 0.53 / 60.37 ± 0.57	23.82 ± 2.16 / 60.83 ± 1.63	74.23 ± 1.31 / 85.11 ± 0.73	72.14 ± 0.13 / 29.83 ± 0.23	33.04 ± 1.30 / 49.51 ± 0.98	55.10 ± 1.39 / 64.78 ± 1.34	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
mistralai/Mistral-7B-Instruct-v0.2 (few-shot)	7242	32	32768	False	2,370 ± 416 / 711 ± 242	2.63	2.33	2.74	2.39	3.60	2.84	2.35	2.67	2.13	44.89 ± 2.46 / 29.13 ± 1.92	48.09 ± 1.00 / 65.40 ± 0.75	19.06 ± 2.34 / 58.77 ± 1.37	51.56 ± 1.16 / 60.81 ± 0.74	66.84 ± 0.77 / 21.21 ± 1.08	51.60 ± 1.33 / 63.50 ± 1.03	35.85 ± 2.68 / 52.62 ± 2.08	22.21 ± 1.60 / 40.78 ± 1.32	53.42 ± 2.48 / 42.63 ± 1.66	54.34 ± 1.93 / 41.06 ± 2.40	38.79 ± 2.56 / 53.72 ± 3.01	64.43 ± 0.45 / 16.11 ± 0.97	17.06 ± 1.53 / 56.51 ± 2.06	11.00 ± 1.00 / 53.26 ± 2.32	35.74 ± 2.44 / 64.27 ± 2.42	20.37 ± 1.34 / 39.32 ± 1.03	21.16 ± 2.07 / 39.85 ± 1.73	47.92 ± 2.66 / 33.00 ± 3.24	62.90 ± 2.44 / 70.61 ± 1.19	19.95 ± 2.24 / 56.49 ± 2.10	52.51 ± 0.36 / 61.42 ± 0.52	66.11 ± 0.18 / 19.64 ± 0.28	25.60 ± 1.10 / 43.53 ± 0.90	21.75 ± 1.61 / 40.57 ± 1.45	34.80 ± 1.37 / 24.03 ± 2.32	17.64 ± 3.40 / 40.55 ± 3.17	5.46 ± 1.31 / 51.42 ± 1.10	12.66 ± 2.33 / 45.06 ± 2.27	61.79 ± 0.68 / 8.78 ± 1.49	2.88 ± 0.65 / 26.40 ± 0.51	-1.11 ± 3.79 / 53.57 ± 2.07	61.28 ± 2.98 / 54.02 ± 3.55	32.07 ± 3.55 / 51.69 ± 3.46	1.68 ± 1.41 / 50.06 ± 1.22	39.00 ± 1.21 / 59.78 ± 1.14	55.10 ± 1.35 / 41.89 ± 1.61	47.69 ± 2.35 / 64.93 ± 1.71	24.14 ± 2.09 / 60.83 ± 1.63	23.93 ± 2.11 / 57.64 ± 1.89	67.51 ± 0.71 / 22.63 ± 1.73	26.06 ± 1.65 / 44.13 ± 1.29	31.09 ± 1.35 / 47.48 ± 0.98	55.56 ± 2.66 / 39.56 ± 2.13	12.37 ± 1.64 / 37.37 ± 1.35	21.50 ± 1.70 / 59.10 ± 1.32	50.77 ± 0.95 / 66.54 ± 0.79	67.99 ± 0.49 / 19.54 ± 0.55	22.86 ± 1.89 / 41.71 ± 1.45	24.80 ± 1.77 / 42.93 ± 1.38	62.11 ± 1.61 / 52.36 ± 2.00	59.91 ± 2.10 / 68.92 ± 1.21	30.66 ± 3.60 / 64.32 ± 2.03	58.27 ± 2.09 / 77.85 ± 0.70	69.75 ± 0.63 / 24.71 ± 0.72	34.93 ± 1.35 / 50.71 ± 1.00	44.91 ± 2.44 / 58.07 ± 1.93	9.2.0	9.2.0	9.3.1	12.4.0	12.6.1	10.0.1	10.0.1	9.3.2	9.2.0	9.2.0	9.2.0	12.4.0	9.3.1	9.3.1	12.4.0	9.3.2	9.3.2	9.2.0	9.2.0	9.3.1	12.4.0	12.4.0	9.3.2	9.3.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	9.2.0	13.3.0	9.3.1	13.0.0	12.9.0	12.9.0	12.9.0	12.9.0	12.9.0	12.9.0	12.9.0	9.3.1	9.2.0	9.3.1	12.4.0	12.4.0	9.3.2	9.3.2	9.3.1	9.2.0	9.3.1	12.4.0	12.4.0	9.3.2	9.3.2
occiglot/occiglot-7b-eu5-instruct (few-shot)	7242	32	32768	False	2,088 ± 352 / 706 ± 214	2.67	2.50	2.77	2.40	3.38	3.11	2.21	2.80	2.18	40.19 ± 2.55 / 29.73 ± 1.44	42.31 ± 1.55 / 59.29 ± 2.00	1.14 ± 1.22 / 33.83 ± 0.72	57.89 ± 1.16 / 63.95 ± 0.82	66.68 ± 0.81 / 22.38 ± 0.71	44.30 ± 2.46 / 57.00 ± 2.30	48.76 ± 2.39 / 65.51 ± 1.72	15.44 ± 1.66 / 35.82 ± 1.14	45.50 ± 2.71 / 40.02 ± 3.16	45.96 ± 2.67 / 41.28 ± 2.25	44.46 ± 3.40 / 62.00 ± 2.71	63.95 ± 0.42 / 16.91 ± 0.61	0.00 ± 0.00 / 33.41 ± 0.30	0.00 ± 0.00 / 33.86 ± 0.33	52.19 ± 2.88 / 74.97 ± 2.11	20.61 ± 1.27 / 39.79 ± 1.10	16.18 ± 1.88 / 36.19 ± 1.66	47.67 ± 2.81 / 36.91 ± 3.50	71.73 ± 2.40 / 74.97 ± 1.84	7.90 ± 3.20 / 41.24 ± 4.78	57.78 ± 0.79 / 64.48 ± 0.73	65.07 ± 0.34 / 19.59 ± 0.38	25.52 ± 1.30 / 43.68 ± 1.03	14.06 ± 1.68 / 35.12 ± 1.47	40.71 ± 2.93 / 34.57 ± 4.02	14.70 ± 7.78 / 36.09 ± 6.06	0.71 ± 2.00 / 36.90 ± 2.10	20.66 ± 3.67 / 45.91 ± 3.45	65.25 ± 0.97 / 19.09 ± 1.05	5.35 ± 1.32 / 28.11 ± 1.13	0.35 ± 2.49 / 51.16 ± 2.74	60.37 ± 3.60 / 59.38 ± 3.85	8.21 ± 5.06 / 27.79 ± 5.76	0.00 ± 0.00 / 33.26 ± 0.34	43.69 ± 2.03 / 60.55 ± 1.76	52.63 ± 1.89 / 42.99 ± 2.40	43.16 ± 4.45 / 57.79 ± 4.61	27.09 ± 1.92 / 60.29 ± 1.99	34.01 ± 4.01 / 63.29 ± 3.97	69.43 ± 0.97 / 29.48 ± 2.59	32.56 ± 1.16 / 49.02 ± 0.79	23.61 ± 2.42 / 41.55 ± 2.14	53.78 ± 1.86 / 41.29 ± 2.07	7.78 ± 1.43 / 24.33 ± 1.57	16.23 ± 2.49 / 55.09 ± 3.18	63.09 ± 1.18 / 73.88 ± 0.72	66.46 ± 0.67 / 19.49 ± 0.92	28.37 ± 0.99 / 45.81 ± 0.88	15.25 ± 1.71 / 35.83 ± 1.42	56.90 ± 3.08 / 51.16 ± 2.56	62.10 ± 1.65 / 68.81 ± 0.76	20.17 ± 3.68 / 54.76 ± 4.24	75.29 ± 1.37 / 86.48 ± 0.72	69.63 ± 0.46 / 25.61 ± 0.45	38.48 ± 1.10 / 53.32 ± 0.83	27.67 ± 2.08 / 43.61 ± 2.08	12.5.2	12.2.0	12.3.1	12.4.0	12.6.1	12.3.1	12.3.1	12.3.1	12.5.2	12.5.2	12.2.0	12.4.0	12.3.1	12.3.1	12.4.0	12.3.1	12.3.1	12.5.2	12.2.0	12.3.1	12.4.0	12.4.0	12.3.1	12.3.1	12.5.2	13.3.0	12.3.1	12.4.0	12.4.0	12.10.8	12.3.1	12.5.2	13.3.0	12.3.1	13.0.0	12.5.2	12.2.0	12.3.1	12.4.0	12.4.0	12.3.1	12.3.1	12.5.2	12.2.0	12.3.1	12.4.0	12.4.0	12.3.1	12.3.1	12.5.2	12.2.0	12.3.1	12.4.0	12.4.0	12.3.1	12.3.1
timpal0l/Mistral-7B-v0.1-flashback-v2 (few-shot)	7242	32	32768	True	5,054 ± 1,200 / 1,056 ± 339	2.67	2.33	2.66	2.15	3.47	3.22	2.37	3.11	2.06	42.43 ± 3.36 / 29.30 ± 2.53	47.82 ± 2.00 / 63.19 ± 2.09	16.51 ± 2.59 / 52.73 ± 3.91	56.95 ± 1.21 / 62.20 ± 0.83	65.43 ± 1.12 / 20.36 ± 0.95	50.76 ± 1.75 / 62.66 ± 1.43	50.82 ± 1.17 / 66.66 ± 0.76	14.47 ± 2.35 / 34.86 ± 1.97	48.97 ± 2.42 / 39.15 ± 2.78	51.52 ± 2.96 / 40.17 ± 3.62	49.05 ± 2.73 / 63.94 ± 2.42	63.32 ± 1.58 / 16.33 ± 1.63	14.37 ± 2.18 / 47.80 ± 4.36	9.96 ± 1.34 / 48.97 ± 3.77	44.07 ± 3.40 / 68.49 ± 2.97	25.07 ± 1.48 / 43.13 ± 1.15	15.56 ± 3.55 / 35.85 ± 2.56	44.14 ± 2.40 / 29.77 ± 4.06	80.14 ± 1.11 / 80.19 ± 0.78	34.23 ± 2.23 / 65.29 ± 2.17	57.07 ± 1.56 / 62.52 ± 1.11	65.15 ± 0.31 / 18.72 ± 0.57	33.24 ± 0.85 / 49.69 ± 0.67	25.50 ± 2.25 / 43.44 ± 2.03	36.47 ± 4.24 / 30.33 ± 3.70	1.84 ± 3.02 / 23.26 ± 3.53	2.54 ± 1.29 / 50.66 ± 0.62	18.66 ± 4.26 / 38.73 ± 3.66	63.68 ± 1.75 / 16.38 ± 1.24	5.12 ± 1.30 / 28.85 ± 0.99	8.30 ± 1.28 / 57.35 ± 0.75	58.96 ± 2.05 / 52.20 ± 2.50	8.97 ± 6.97 / 27.85 ± 5.18	0.00 ± 0.00 / 33.26 ± 0.34	39.20 ± 1.10 / 54.89 ± 1.25	50.66 ± 1.53 / 39.89 ± 2.43	54.79 ± 3.53 / 68.79 ± 3.00	20.17 ± 1.69 / 58.67 ± 1.13	27.86 ± 4.70 / 54.38 ± 5.91	65.53 ± 1.07 / 19.46 ± 1.48	27.04 ± 1.04 / 44.99 ± 0.77	17.47 ± 3.26 / 36.70 ± 2.93	54.56 ± 2.96 / 37.86 ± 2.49	8.43 ± 1.27 / 24.23 ± 0.94	10.99 ± 2.55 / 50.46 ± 4.17	55.91 ± 1.08 / 66.78 ± 1.13	57.88 ± 1.41 / 12.36 ± 1.30	25.12 ± 1.17 / 43.50 ± 0.92	10.65 ± 1.55 / 31.51 ± 1.52	59.10 ± 1.87 / 51.31 ± 1.87	68.41 ± 1.17 / 70.85 ± 0.74	25.43 ± 4.22 / 60.79 ± 3.45	71.89 ± 2.20 / 82.99 ± 1.78	67.99 ± 0.41 / 22.12 ± 0.52	44.09 ± 1.21 / 56.37 ± 0.96	32.29 ± 4.57 / 45.16 ± 4.28	12.5.3	12.5.3	12.5.3	12.5.3	12.6.1	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	14.1.2	12.5.3	12.5.3	12.5.3	12.10.8	12.5.3	12.5.3	14.1.2	12.5.3	13.0.0	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3	12.5.3
meta-llama/Llama-3.2-3B-Instruct (few-shot)	3213	128	131073	False	10,424 ± 2,641 / 2,081 ± 666	2.68	2.46	2.94	2.41	3.53	2.80	2.49	2.80	2.03	41.12 ± 3.39 / 32.50 ± 2.74	42.77 ± 2.76 / 54.70 ± 4.19	11.52 ± 3.01 / 49.37 ± 4.12	51.14 ± 1.03 / 60.18 ± 0.55	65.19 ± 0.78 / 18.34 ± 1.22	49.78 ± 1.52 / 62.29 ± 1.14	45.88 ± 2.43 / 63.96 ± 1.59	21.89 ± 1.77 / 41.16 ± 1.43	49.66 ± 1.79 / 39.31 ± 2.55	51.98 ± 1.55 / 42.48 ± 3.10	44.13 ± 2.80 / 60.09 ± 3.10	60.50 ± 0.73 / 10.91 ± 0.62	0.67 ± 1.18 / 33.81 ± 0.33	1.11 ± 0.93 / 33.03 ± 0.39	28.62 ± 4.16 / 56.91 ± 4.14	26.82 ± 1.08 / 45.32 ± 0.84	20.98 ± 1.40 / 40.34 ± 1.17	43.74 ± 2.58 / 34.37 ± 2.59	76.98 ± 1.31 / 71.38 ± 3.20	16.01 ± 2.24 / 51.83 ± 3.50	48.38 ± 1.78 / 57.83 ± 0.99	64.98 ± 0.47 / 17.53 ± 0.50	29.44 ± 0.61 / 47.21 ± 0.47	22.42 ± 1.89 / 41.45 ± 1.49	27.57 ± 1.71 / 22.52 ± 1.18	10.07 ± 5.45 / 28.32 ± 4.30	-1.39 ± 1.30 / 34.40 ± 1.96	22.98 ± 2.48 / 50.74 ± 1.59	62.00 ± 1.89 / 14.40 ± 1.93	13.33 ± 1.23 / 35.42 ± 0.93	0.74 ± 1.09 / 50.92 ± 0.73	58.24 ± 3.73 / 47.44 ± 4.83	32.79 ± 2.01 / 41.82 ± 1.09	1.77 ± 2.13 / 45.44 ± 4.00	45.13 ± 1.12 / 64.71 ± 0.74	55.52 ± 2.07 / 46.18 ± 2.32	50.52 ± 2.29 / 62.39 ± 2.63	9.87 ± 2.95 / 42.20 ± 3.60	20.20 ± 3.28 / 47.02 ± 5.20	66.40 ± 0.98 / 21.21 ± 2.33	33.58 ± 0.41 / 50.27 ± 0.28	28.97 ± 1.01 / 46.45 ± 0.80	43.66 ± 2.01 / 40.23 ± 1.75	12.87 ± 1.32 / 37.23 ± 1.55	17.94 ± 3.48 / 55.88 ± 3.97	47.77 ± 1.82 / 64.44 ± 1.35	66.74 ± 1.00 / 18.33 ± 1.28	33.80 ± 0.84 / 50.30 ± 0.61	21.02 ± 1.29 / 40.27 ± 1.09	68.44 ± 1.14 / 56.80 ± 2.31	66.00 ± 1.41 / 70.47 ± 1.02	32.04 ± 3.44 / 65.62 ± 1.88	49.54 ± 3.13 / 75.26 ± 1.64	69.23 ± 0.19 / 24.84 ± 0.39	45.50 ± 0.74 / 58.96 ± 0.57	46.50 ± 1.78 / 59.43 ± 1.44	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
nvidia/mistral-nemo-minitron-8b-instruct (few-shot)	8414	131	8192	True	3,161 ± 676 / 1,247 ± 481	2.74	2.67	2.84	2.56	3.45	2.98	2.38	2.94	2.12	49.01 ± 1.94 / 29.13 ± 2.09	47.95 ± 1.37 / 64.82 ± 0.89	32.89 ± 1.40 / 66.18 ± 0.64	0.00 ± 0.00 / 17.81 ± 0.42	62.70 ± 0.09 / 10.45 ± 0.15	51.21 ± 1.33 / 63.45 ± 0.98	62.30 ± 2.00 / 74.94 ± 1.32	33.79 ± 2.86 / 49.01 ± 2.17	63.70 ± 0.98 / 39.82 ± 2.02	62.53 ± 1.64 / 40.20 ± 2.22	34.35 ± 0.92 / 37.57 ± 0.55	61.42 ± 0.09 / 8.33 ± 0.10	31.53 ± 1.91 / 64.14 ± 1.52	22.71 ± 2.23 / 57.77 ± 2.48	0.06 ± 0.04 / 26.09 ± 1.72	35.46 ± 0.97 / 51.44 ± 0.76	36.47 ± 1.79 / 51.20 ± 1.47	48.51 ± 1.91 / 24.61 ± 1.44	78.68 ± 0.89 / 78.07 ± 0.97	29.18 ± 2.29 / 63.69 ± 1.55	0.00 ± 0.00 / 16.78 ± 0.35	65.35 ± 0.08 / 15.76 ± 0.11	40.16 ± 1.01 / 55.00 ± 0.75	39.81 ± 2.46 / 53.79 ± 2.03	43.65 ± 4.03 / 26.17 ± 3.16	10.70 ± 1.95 / 32.23 ± 2.92	10.77 ± 1.76 / 53.53 ± 1.49	0.29 ± 0.07 / 29.69 ± 2.78	65.26 ± 0.16 / 14.88 ± 0.16	23.45 ± 1.23 / 42.71 ± 0.91	8.35 ± 2.49 / 54.73 ± 1.16	67.72 ± 1.04 / 51.81 ± 3.32	42.98 ± 3.22 / 60.44 ± 2.81	6.40 ± 1.61 / 51.02 ± 1.86	0.07 ± 0.10 / 29.23 ± 1.59	60.69 ± 1.19 / 45.82 ± 1.42	53.77 ± 2.21 / 66.24 ± 2.25	38.53 ± 2.04 / 65.65 ± 2.18	0.00 ± 0.00 / 32.27 ± 3.90	62.73 ± 0.12 / 9.78 ± 0.11	45.91 ± 0.75 / 59.44 ± 0.55	47.37 ± 2.99 / 59.38 ± 2.38	60.11 ± 1.96 / 37.17 ± 1.69	11.12 ± 1.15 / 29.33 ± 1.27	32.68 ± 1.80 / 64.15 ± 1.14	0.00 ± 0.00 / 17.43 ± 0.98	64.01 ± 0.11 / 11.65 ± 0.13	41.00 ± 1.29 / 55.62 ± 0.95	39.20 ± 2.23 / 53.01 ± 1.79	72.63 ± 1.76 / 63.75 ± 1.29	65.74 ± 1.14 / 69.65 ± 0.96	43.43 ± 1.62 / 69.19 ± 1.28	0.00 ± 0.00 / 20.81 ± 0.82	66.76 ± 0.07 / 17.17 ± 0.16	60.00 ± 0.90 / 69.95 ± 0.66	69.36 ± 1.38 / 76.63 ± 1.08	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1	14.1.1
occiglot/occiglot-7b-eu5 (few-shot)	7242	32	32768	True	2,219 ± 427 / 717 ± 224	2.74	2.54	2.85	2.42	3.45	3.19	2.26	2.98	2.26	37.93 ± 3.09 / 29.50 ± 2.18	44.62 ± 1.98 / 62.62 ± 1.54	0.28 ± 0.54 / 33.48 ± 0.24	58.05 ± 1.02 / 62.89 ± 0.89	66.05 ± 1.13 / 21.82 ± 0.96	38.54 ± 1.47 / 53.57 ± 1.26	45.89 ± 3.00 / 63.14 ± 1.98	12.38 ± 1.99 / 33.54 ± 1.61	45.28 ± 3.06 / 41.73 ± 2.14	46.00 ± 4.26 / 42.96 ± 3.38	44.95 ± 3.19 / 61.88 ± 2.88	63.26 ± 1.07 / 16.04 ± 1.34	0.00 ± 0.00 / 33.41 ± 0.30	0.00 ± 0.00 / 33.86 ± 0.33	43.88 ± 4.07 / 66.65 ± 4.20	20.87 ± 1.54 / 39.98 ± 1.27	13.10 ± 2.04 / 34.20 ± 1.55	49.02 ± 3.23 / 41.69 ± 3.74	76.56 ± 1.52 / 78.16 ± 1.12	2.18 ± 2.34 / 36.26 ± 3.89	58.98 ± 0.95 / 63.65 ± 0.89	64.42 ± 0.45 / 18.79 ± 0.47	23.68 ± 1.41 / 42.15 ± 1.14	14.05 ± 1.60 / 34.81 ± 1.58	40.08 ± 2.82 / 37.15 ± 4.07	16.23 ± 4.59 / 35.37 ± 4.49	1.59 ± 1.86 / 39.93 ± 4.19	15.98 ± 3.74 / 39.67 ± 3.36	62.55 ± 3.03 / 15.26 ± 2.31	5.98 ± 1.66 / 28.18 ± 1.30	-0.51 ± 1.95 / 47.23 ± 2.39	58.67 ± 3.95 / 58.47 ± 3.96	10.39 ± 7.55 / 30.73 ± 6.92	0.00 ± 0.00 / 33.26 ± 0.34	40.95 ± 1.80 / 55.82 ± 1.95	51.39 ± 1.35 / 44.47 ± 2.77	47.30 ± 4.44 / 62.28 ± 4.24	21.83 ± 1.98 / 57.05 ± 2.18	31.55 ± 3.67 / 60.39 ± 4.29	69.31 ± 0.68 / 28.27 ± 1.70	32.49 ± 0.91 / 48.82 ± 0.70	22.25 ± 2.13 / 40.28 ± 1.67	51.31 ± 2.32 / 42.95 ± 2.58	7.41 ± 1.24 / 26.93 ± 1.56	13.04 ± 1.93 / 53.54 ± 2.70	59.28 ± 1.15 / 69.67 ± 0.95	64.66 ± 0.74 / 18.22 ± 0.85	27.12 ± 0.86 / 44.36 ± 0.75	13.99 ± 2.04 / 34.45 ± 1.89	55.37 ± 2.94 / 51.08 ± 2.87	63.32 ± 1.29 / 68.50 ± 0.53	18.92 ± 2.39 / 57.96 ± 1.89	72.38 ± 2.57 / 83.46 ± 1.49	68.61 ± 0.55 / 23.48 ± 0.74	37.04 ± 1.33 / 52.33 ± 1.02	23.54 ± 2.08 / 40.78 ± 1.59	12.5.2	12.1.0	12.1.0	12.1.0	12.6.1	12.1.0	12.1.0	12.2.0	12.5.2	12.5.2	12.1.0	12.1.0	12.1.0	12.1.0	12.1.0	12.1.0	12.2.0	12.5.2	12.1.0	12.1.0	12.1.0	12.1.0	12.1.0	12.2.0	12.5.2	14.1.2	12.1.0	12.1.0	12.1.0	12.10.8	12.2.0	12.5.2	14.1.2	12.1.0	13.0.0	12.5.2	12.1.0	12.1.0	12.1.0	12.1.0	12.1.0	12.2.0	12.5.2	12.1.0	12.1.0	12.1.0	12.1.0	12.2.0	12.2.0	12.5.2	12.1.0	12.1.0	12.1.0	12.1.0	12.2.0	12.2.0
mistralai/Mistral-7B-Instruct-v0.1 (few-shot)	7242	32	32768	False	634 ± 179 / 110 ± 35	2.75	2.51	2.81	2.52	3.50	3.14	2.48	2.94	2.07	37.93 ± 2.71 / 23.54 ± 1.99	44.49 ± 2.56 / 60.64 ± 3.00	14.09 ± 2.94 / 42.43 ± 3.30	51.38 ± 2.31 / 58.78 ± 1.27	65.80 ± 0.93 / 19.91 ± 1.41	45.07 ± 1.34 / 58.18 ± 1.03	35.36 ± 2.19 / 55.82 ± 1.48	14.85 ± 1.19 / 35.26 ± 1.24	50.08 ± 1.54 / 34.52 ± 1.17	51.27 ± 1.52 / 33.37 ± 2.37	43.65 ± 1.98 / 60.88 ± 1.36	62.39 ± 0.76 / 14.24 ± 0.81	14.09 ± 2.85 / 44.91 ± 3.95	8.28 ± 1.82 / 47.22 ± 3.72	37.23 ± 3.15 / 63.67 ± 2.98	20.44 ± 1.03 / 39.51 ± 0.72	15.87 ± 1.29 / 35.89 ± 1.06	45.01 ± 2.11 / 27.59 ± 3.35	73.33 ± 1.98 / 76.19 ± 1.59	11.59 ± 3.45 / 40.89 ± 4.15	52.12 ± 1.42 / 59.29 ± 1.17	63.10 ± 0.60 / 18.05 ± 0.36	24.03 ± 1.09 / 42.32 ± 0.70	15.37 ± 0.71 / 35.78 ± 0.69	36.04 ± 2.59 / 24.74 ± 2.79	12.93 ± 5.42 / 30.40 ± 3.15	-0.36 ± 1.36 / 33.94 ± 0.32	18.06 ± 3.16 / 42.57 ± 2.89	62.80 ± 1.69 / 15.23 ± 1.01	5.44 ± 1.14 / 28.13 ± 1.06	6.35 ± 2.71 / 50.49 ± 1.57	55.42 ± 2.12 / 46.41 ± 2.50	15.85 ± 6.84 / 36.28 ± 7.13	1.11 ± 2.41 / 36.79 ± 4.00	33.54 ± 1.29 / 50.80 ± 1.31	47.19 ± 3.74 / 33.02 ± 2.09	47.26 ± 3.14 / 63.48 ± 2.94	22.32 ± 1.78 / 56.73 ± 4.00	24.36 ± 3.78 / 54.61 ± 4.44	67.75 ± 1.10 / 25.91 ± 2.95	26.79 ± 1.01 / 44.58 ± 0.85	20.33 ± 1.63 / 39.63 ± 1.09	52.72 ± 2.58 / 33.51 ± 1.22	7.91 ± 2.16 / 27.82 ± 1.97	18.14 ± 2.10 / 55.42 ± 3.05	52.75 ± 0.88 / 67.15 ± 1.08	64.77 ± 0.97 / 16.55 ± 0.81	26.06 ± 0.77 / 44.08 ± 0.51	14.26 ± 1.48 / 35.14 ± 1.18	57.58 ± 2.30 / 47.94 ± 2.89	61.44 ± 2.02 / 69.47 ± 0.98	34.92 ± 2.40 / 66.67 ± 1.41	65.38 ± 1.76 / 81.90 ± 0.57	69.62 ± 0.31 / 24.65 ± 0.44	38.40 ± 0.98 / 53.43 ± 0.76	35.72 ± 1.56 / 49.69 ± 1.42	9.3.1	9.3.1	9.3.1	12.4.0	12.6.1	10.0.1	10.0.1	9.3.1	9.3.1	9.3.1	9.3.1	12.4.0	9.3.1	9.3.1	12.4.0	9.3.1	9.3.1	9.3.1	9.3.1	9.3.1	12.4.0	12.4.0	9.3.1	9.3.1	9.3.1	13.3.0	9.3.1	12.4.0	12.4.0	12.10.8	12.1.0	9.3.1	13.3.0	9.3.1	13.0.0	12.9.0	12.9.0	12.9.0	12.9.0	12.9.0	12.9.0	12.9.0	9.3.1	9.3.1	9.3.1	12.4.0	12.4.0	9.3.1	9.3.1	9.3.1	9.3.1	9.3.1	12.4.0	12.4.0	9.3.1	9.3.1
ibm-granite/granite-8b-code-base-4k (few-shot)	8055	49	4096	True	2,313 ± 423 / 682 ± 210	2.76	2.67	2.85	2.55	3.51	3.02	2.45	2.81	2.21	48.44 ± 1.69 / 36.99 ± 1.77	39.07 ± 1.03 / 56.85 ± 1.91	9.72 ± 1.58 / 46.85 ± 3.66	51.18 ± 0.92 / 56.54 ± 0.69	63.93 ± 0.79 / 17.49 ± 0.73	33.11 ± 2.59 / 49.31 ± 2.03	18.96 ± 2.16 / 46.29 ± 1.39	9.03 ± 1.28 / 31.42 ± 1.04	68.40 ± 1.16 / 62.53 ± 1.69	65.15 ± 0.79 / 60.39 ± 2.11	42.00 ± 1.78 / 59.90 ± 1.22	61.27 ± 0.80 / 13.34 ± 0.66	5.20 ± 2.23 / 36.33 ± 1.30	3.32 ± 2.02 / 37.81 ± 3.26	37.51 ± 2.58 / 60.94 ± 3.06	12.42 ± 1.42 / 34.82 ± 0.98	8.32 ± 0.78 / 30.87 ± 0.75	59.77 ± 3.55 / 45.71 ± 4.91	74.45 ± 1.19 / 72.26 ± 0.89	3.97 ± 1.50 / 34.79 ± 0.80	50.18 ± 1.05 / 56.07 ± 0.89	62.61 ± 0.55 / 17.92 ± 0.33	14.34 ± 0.73 / 35.93 ± 0.55	7.40 ± 1.39 / 30.20 ± 1.23	50.89 ± 2.90 / 35.75 ± 4.67	9.52 ± 4.25 / 29.57 ± 4.96	0.50 ± 0.94 / 33.77 ± 0.30	17.43 ± 3.38 / 41.32 ± 3.18	59.94 ± 2.87 / 12.62 ± 1.91	5.52 ± 1.26 / 28.97 ± 0.97	1.73 ± 2.31 / 50.89 ± 3.35	66.82 ± 2.36 / 65.84 ± 2.35	21.19 ± 5.19 / 32.96 ± 5.05	-0.36 ± 1.67 / 37.57 ± 3.35	36.47 ± 0.96 / 51.89 ± 1.05	59.07 ± 0.78 / 51.00 ± 2.06	49.75 ± 2.44 / 65.93 ± 1.66	14.71 ± 2.21 / 53.75 ± 3.07	29.45 ± 2.13 / 56.14 ± 2.53	67.78 ± 1.54 / 26.66 ± 3.40	16.39 ± 1.29 / 37.35 ± 0.95	10.68 ± 1.41 / 32.52 ± 1.35	63.29 ± 2.51 / 52.18 ± 4.31	13.81 ± 1.66 / 36.99 ± 2.58	8.16 ± 1.97 / 44.29 ± 4.25	56.64 ± 0.68 / 66.29 ± 0.71	63.08 ± 0.90 / 15.69 ± 0.65	16.86 ± 1.16 / 37.54 ± 0.93	6.24 ± 0.78 / 29.25 ± 0.61	72.76 ± 0.57 / 67.49 ± 0.90	62.35 ± 1.68 / 67.34 ± 0.77	21.57 ± 2.22 / 59.22 ± 1.69	69.80 ± 3.60 / 81.37 ± 2.26	67.73 ± 0.60 / 23.48 ± 0.91	25.63 ± 0.81 / 44.26 ± 0.63	16.44 ± 1.84 / 36.73 ± 1.54	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
NbAiLab/nb-llama-3.1-70B (few-shot)	70554	128	131072	True	1,220 ± 411 / 158 ± 53	2.78	2.68	2.73	2.53	3.20	3.07	2.63	2.88	2.51	50.83 ± 1.31 / 41.56 ± 1.86	53.23 ± 2.63 / 64.70 ± 3.82	23.02 ± 6.31 / 53.19 ± 7.11	0.00 ± 0.00 / 11.36 ± 0.99	57.74 ± 0.48 / 9.03 ± 0.19	77.42 ± 1.22 / 82.92 ± 0.92	82.47 ± 2.08 / 88.34 ± 1.37	30.39 ± 4.04 / 46.68 ± 3.11	65.75 ± 2.00 / 59.69 ± 2.98	70.12 ± 2.22 / 63.49 ± 3.83	41.90 ± 3.43 / 49.94 ± 4.59	53.29 ± 1.55 / 7.06 ± 0.65	47.88 ± 8.48 / 69.91 ± 7.73	35.66 ± 6.93 / 62.56 ± 6.50	0.03 ± 0.04 / 19.59 ± 1.89	46.91 ± 2.14 / 60.01 ± 1.60	33.14 ± 1.88 / 48.61 ± 1.53	69.54 ± 1.72 / 57.56 ± 4.03	79.55 ± 1.16 / 76.00 ± 2.17	28.27 ± 6.55 / 54.36 ± 6.56	0.02 ± 0.02 / 11.05 ± 1.02	55.51 ± 0.84 / 12.37 ± 0.38	48.02 ± 2.43 / 60.79 ± 1.86	24.46 ± 3.54 / 41.61 ± 2.91	62.28 ± 1.43 / 53.70 ± 3.40	38.08 ± 3.91 / 47.69 ± 4.81	2.85 ± 1.20 / 39.44 ± 3.92	0.86 ± 0.23 / 40.54 ± 1.57	57.60 ± 0.77 / 12.58 ± 0.52	48.56 ± 3.66 / 61.33 ± 2.75	16.74 ± 2.86 / 56.38 ± 1.94	65.06 ± 2.04 / 64.49 ± 1.85	48.44 ± 4.16 / 54.28 ± 3.55	3.30 ± 1.95 / 34.38 ± 1.34	0.00 ± 0.00 / 20.32 ± 0.61	67.63 ± 1.29 / 58.41 ± 2.59	55.79 ± 4.32 / 64.18 ± 5.71	24.45 ± 4.07 / 59.54 ± 4.12	1.17 ± 0.37 / 26.56 ± 2.63	55.51 ± 1.24 / 8.89 ± 0.79	44.20 ± 1.65 / 57.95 ± 1.26	31.71 ± 2.07 / 47.88 ± 1.81	69.37 ± 2.25 / 59.14 ± 2.55	14.35 ± 1.64 / 31.18 ± 2.02	29.13 ± 3.95 / 58.71 ± 5.17	0.34 ± 0.14 / 15.25 ± 0.86	52.69 ± 0.52 / 10.85 ± 0.37	50.90 ± 1.94 / 63.00 ± 1.48	34.78 ± 2.85 / 49.76 ± 2.31	76.84 ± 1.89 / 72.90 ± 1.50	67.91 ± 1.19 / 68.81 ± 1.37	30.61 ± 4.10 / 62.57 ± 4.17	0.10 ± 0.04 / 16.48 ± 1.10	58.37 ± 1.69 / 13.47 ± 1.23	48.18 ± 2.66 / 61.07 ± 2.06	34.99 ± 1.90 / 47.61 ± 1.78	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
meta-llama/Llama-2-7b-chat-hf (few-shot)	6738	32	4096	False	2,643 ± 455 / 800 ± 247	2.83	2.58	2.94	2.61	3.52	3.25	2.57	2.91	2.22	35.44 ± 3.00 / 24.63 ± 1.65	44.88 ± 1.45 / 62.35 ± 1.33	9.74 ± 1.96 / 47.42 ± 4.19	55.04 ± 0.79 / 61.34 ± 0.81	66.15 ± 0.67 / 19.69 ± 0.94	32.17 ± 2.28 / 46.67 ± 1.92	35.74 ± 2.46 / 55.18 ± 1.81	11.32 ± 0.41 / 32.24 ± 0.79	44.99 ± 2.49 / 38.59 ± 2.84	49.09 ± 1.90 / 39.09 ± 4.02	41.56 ± 3.37 / 57.09 ± 3.80	63.59 ± 0.40 / 14.15 ± 0.70	3.04 ± 2.84 / 36.81 ± 2.42	4.03 ± 2.49 / 40.55 ± 4.14	33.77 ± 2.11 / 61.99 ± 2.34	14.81 ± 0.79 / 34.79 ± 0.63	12.69 ± 0.77 / 31.84 ± 1.05	39.72 ± 2.82 / 29.85 ± 2.99	66.18 ± 3.25 / 72.00 ± 1.75	6.74 ± 1.66 / 45.55 ± 4.31	54.05 ± 0.84 / 60.90 ± 0.82	65.92 ± 0.05 / 18.51 ± 0.18	17.73 ± 0.98 / 37.55 ± 0.69	12.85 ± 0.93 / 33.37 ± 0.90	41.10 ± 3.35 / 40.54 ± 3.19	13.59 ± 6.27 / 36.87 ± 4.51	-1.07 ± 2.09 / 44.83 ± 2.20	16.13 ± 2.52 / 39.51 ± 1.98	62.30 ± 0.90 / 13.28 ± 1.36	3.16 ± 0.79 / 27.40 ± 0.79	1.84 ± 2.19 / 43.79 ± 0.73	59.77 ± 3.38 / 56.97 ± 4.30	13.24 ± 5.37 / 38.49 ± 4.97	-0.54 ± 1.61 / 36.94 ± 2.79	31.87 ± 2.20 / 46.21 ± 1.15	50.09 ± 1.33 / 38.59 ± 1.66	46.52 ± 2.85 / 63.64 ± 2.10	15.23 ± 1.71 / 55.08 ± 1.88	25.54 ± 3.58 / 56.07 ± 3.76	67.62 ± 0.89 / 23.52 ± 2.43	20.12 ± 1.13 / 39.48 ± 1.02	13.98 ± 1.56 / 34.07 ± 1.30	50.23 ± 2.34 / 37.12 ± 3.30	10.07 ± 1.84 / 35.66 ± 2.24	14.73 ± 1.62 / 54.59 ± 2.24	53.42 ± 0.80 / 66.24 ± 0.84	67.59 ± 0.56 / 18.45 ± 0.65	20.19 ± 1.26 / 39.24 ± 1.03	11.42 ± 1.29 / 32.50 ± 1.10	62.53 ± 1.35 / 53.42 ± 2.04	62.23 ± 1.29 / 68.09 ± 1.34	22.71 ± 1.81 / 60.79 ± 1.08	64.45 ± 1.39 / 80.79 ± 0.79	69.95 ± 0.32 / 25.22 ± 0.33	30.47 ± 0.70 / 46.82 ± 0.55	30.18 ± 1.87 / 45.85 ± 1.98	9.3.1	9.3.1	9.3.1	12.4.0	12.6.1	10.0.1	10.0.1	9.3.1	9.3.1	9.3.1	9.3.1	12.4.0	9.3.1	9.3.1	12.4.0	9.3.1	9.3.1	9.3.1	9.3.1	9.3.1	12.4.0	12.4.0	9.3.1	9.3.1	9.3.1	13.3.0	9.3.1	12.4.0	12.4.0	12.10.8	12.1.0	9.3.1	13.3.0	9.3.1	13.0.0	12.9.0	12.9.0	12.10.0	12.10.0	12.10.0	12.10.0	12.10.0	9.3.1	9.3.1	9.3.1	12.4.0	12.4.0	9.3.1	9.3.1	9.3.1	9.3.1	9.3.1	12.4.0	12.4.0	9.3.1	9.3.1
claude-3-5-haiku-20241022 (zero-shot, val)	unknown	unknown	200000	True	277 ± 77 / 70 ± 25	2.85	2.28	3.12	2.71	3.36	3.26	2.73	2.83	2.48	59.48 ± 1.97 / 42.21 ± 2.53	56.46 ± 2.39 / 71.07 ± 1.48	20.57 ± 3.78 / 49.85 ± 2.21	38.23 ± 1.71 / 57.70 ± 1.22	64.38 ± 0.17 / 13.19 ± 0.29	53.54 ± 2.56 / 64.30 ± 2.11	69.09 ± 2.95 / 77.89 ± 1.92	21.03 ± 1.49 / 36.45 ± 2.08	69.39 ± 2.58 / 47.10 ± 3.14	62.76 ± 2.10 / 42.75 ± 2.27	3.97 ± 1.70 / 32.77 ± 0.95	62.53 ± 0.18 / 10.78 ± 0.12	31.65 ± 2.14 / 54.96 ± 1.11	5.86 ± 3.28 / 38.81 ± 1.69	36.65 ± 1.08 / 66.51 ± 0.83	16.62 ± 2.53 / 27.77 ± 1.24	2.63 ± 1.71 / 22.23 ± 1.08	57.06 ± 2.15 / 38.72 ± 1.61	59.89 ± 3.67 / 62.05 ± 2.71	9.30 ± 1.88 / 35.59 ± 0.94	39.97 ± 1.52 / 58.05 ± 1.05	65.29 ± 0.11 / 14.61 ± 0.15	16.34 ± 1.98 / 28.83 ± 1.68	0.00 ± 0.00 / 23.16 ± 1.18	34.99 ± 2.03 / 17.39 ± 1.24	31.19 ± 1.29 / 43.32 ± 1.05	-10.68 ± 2.75 / 33.95 ± 1.08	23.65 ± 1.16 / 46.35 ± 1.25	66.12 ± 0.10 / 15.71 ± 0.20	9.00 ± 1.46 / 20.47 ± 1.01	0.00 ± 0.00 / 59.30 ± 3.13	51.06 ± 1.45 / 30.27 ± 1.00	-3.58 ± 4.03 / 14.94 ± 2.38	4.10 ± 4.03 / 37.28 ± 1.78	45.29 ± 1.54 / 72.97 ± 1.19	55.59 ± 1.42 / 31.16 ± 1.29	43.73 ± 2.53 / 61.91 ± 1.47	23.74 ± 3.03 / 45.75 ± 2.40	21.36 ± 1.42 / 50.29 ± 1.55	62.97 ± 0.16 / 11.18 ± 0.21	16.53 ± 2.79 / 28.83 ± 2.66	-1.78 ± 3.04 / 25.27 ± 2.64	61.15 ± 3.04 / 43.60 ± 2.00	12.71 ± 2.21 / 30.22 ± 1.53	35.26 ± 2.46 / 59.55 ± 1.69	41.27 ± 1.25 / 68.96 ± 1.30	64.93 ± 0.11 / 13.88 ± 0.23	8.55 ± 2.28 / 28.32 ± 1.08	10.69 ± 1.69 / 31.29 ± 1.47	74.35 ± 1.24 / 63.12 ± 1.09	31.19 ± 2.30 / 44.96 ± 1.92	21.76 ± 3.56 / 59.95 ± 1.92	45.70 ± 1.03 / 74.84 ± 0.76	67.96 ± 0.14 / 18.65 ± 0.23	28.80 ± 2.50 / 39.84 ± 1.87	42.52 ± 3.28 / 53.63 ± 2.58	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.1	14.0.3	14.0.3	14.0.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.2	14.0.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.2	14.0.3	14.0.3	14.0.3	14.0.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3	14.0.2	14.0.3	14.0.3	14.0.3	14.0.3	14.0.3
ibm-granite/granite-8b-code-instruct-4k (few-shot)	8055	49	4096	True	5,617 ± 995 / 1,623 ± 540	2.89	2.75	2.94	2.62	3.82	3.14	2.63	2.95	2.29	45.90 ± 2.53 / 33.00 ± 1.93	37.11 ± 1.88 / 56.47 ± 1.59	11.70 ± 2.16 / 50.31 ± 3.91	50.11 ± 0.83 / 55.71 ± 0.49	63.86 ± 0.96 / 18.38 ± 0.71	32.44 ± 2.29 / 46.63 ± 2.29	7.46 ± 1.83 / 39.41 ± 1.17	5.62 ± 1.16 / 28.71 ± 0.79	66.91 ± 1.50 / 54.98 ± 2.20	62.82 ± 1.23 / 53.14 ± 3.17	40.71 ± 1.63 / 59.35 ± 1.58	60.59 ± 0.99 / 12.74 ± 0.82	9.50 ± 1.68 / 46.31 ± 3.06	6.74 ± 1.70 / 42.10 ± 4.67	32.83 ± 1.83 / 55.30 ± 2.35	11.35 ± 1.23 / 32.01 ± 0.91	6.21 ± 0.99 / 29.05 ± 0.80	52.85 ± 2.76 / 35.11 ± 3.66	73.93 ± 1.58 / 73.97 ± 1.19	8.27 ± 2.90 / 43.29 ± 4.82	48.49 ± 0.77 / 54.50 ± 0.73	60.98 ± 0.80 / 16.18 ± 0.48	13.69 ± 0.86 / 33.34 ± 0.46	5.68 ± 1.13 / 27.99 ± 1.11	43.20 ± 3.61 / 32.10 ± 3.76	2.54 ± 2.60 / 17.05 ± 2.70	0.00 ± 0.00 / 33.69 ± 0.28	14.28 ± 2.94 / 38.21 ± 2.38	49.66 ± 3.28 / 7.97 ± 1.43	3.07 ± 1.66 / 25.74 ± 1.09	2.79 ± 3.13 / 47.97 ± 1.43	60.46 ± 2.53 / 58.29 ± 2.53	21.59 ± 6.94 / 40.68 ± 5.50	0.51 ± 0.78 / 36.20 ± 2.37	33.54 ± 1.00 / 49.02 ± 0.91	54.45 ± 1.17 / 42.36 ± 2.59	43.62 ± 3.18 / 59.82 ± 2.70	15.24 ± 1.87 / 55.49 ± 2.89	26.00 ± 2.28 / 51.82 ± 2.70	66.68 ± 1.30 / 24.80 ± 3.14	15.81 ± 1.07 / 36.18 ± 0.94	9.60 ± 1.12 / 31.31 ± 1.02	60.72 ± 2.14 / 45.52 ± 2.46	12.38 ± 1.62 / 29.91 ± 1.91	10.96 ± 1.47 / 47.97 ± 3.45	51.20 ± 0.91 / 61.75 ± 0.63	63.23 ± 0.96 / 16.22 ± 0.74	15.26 ± 0.67 / 35.76 ± 0.34	4.03 ± 0.90 / 27.17 ± 0.73	72.59 ± 0.91 / 65.83 ± 1.30	61.61 ± 1.45 / 67.09 ± 1.38	18.37 ± 2.07 / 56.26 ± 2.62	66.68 ± 3.56 / 78.95 ± 2.38	68.41 ± 0.33 / 24.66 ± 0.47	24.14 ± 0.58 / 42.17 ± 0.33	14.42 ± 2.00 / 34.50 ± 1.81	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
ibm-granite/granite-3.0-3b-a800m-instruct (few-shot)	3374	49	4096	True	10,246 ± 3,021 / 1,629 ± 550	3.01	2.96	3.22	2.76	3.84	3.54	2.60	2.92	2.23	37.37 ± 2.46 / 26.81 ± 2.24	31.44 ± 1.82 / 48.96 ± 2.35	5.27 ± 2.40 / 40.63 ± 4.68	48.41 ± 1.10 / 55.05 ± 0.97	63.82 ± 0.97 / 18.09 ± 0.88	18.25 ± 1.54 / 38.38 ± 1.12	19.54 ± 2.59 / 46.35 ± 1.91	2.64 ± 1.03 / 26.88 ± 0.77	44.89 ± 2.26 / 34.93 ± 2.45	48.08 ± 1.68 / 34.39 ± 2.61	32.29 ± 1.15 / 51.91 ± 2.66	59.77 ± 0.91 / 11.96 ± 0.65	7.49 ± 1.65 / 47.79 ± 3.81	4.65 ± 1.91 / 45.75 ± 5.13	26.37 ± 1.51 / 47.59 ± 2.41	11.54 ± 1.37 / 32.89 ± 1.10	3.42 ± 1.93 / 26.93 ± 1.47	40.68 ± 2.32 / 24.33 ± 2.43	68.96 ± 2.04 / 72.76 ± 1.25	4.77 ± 1.97 / 43.64 ± 5.60	49.73 ± 0.76 / 56.63 ± 0.69	60.93 ± 0.49 / 14.76 ± 0.77	13.55 ± 1.27 / 34.97 ± 0.99	5.27 ± 1.49 / 27.92 ± 1.10	23.14 ± 2.08 / 23.09 ± 2.24	5.07 ± 2.69 / 27.01 ± 2.31	0.18 ± 1.67 / 33.93 ± 0.34	14.15 ± 2.49 / 36.10 ± 1.65	60.80 ± 0.81 / 10.79 ± 1.85	2.86 ± 1.31 / 26.61 ± 1.04	-1.31 ± 2.24 / 50.29 ± 1.93	45.56 ± 1.92 / 42.78 ± 1.78	7.44 ± 3.71 / 28.90 ± 5.97	0.92 ± 2.19 / 40.29 ± 3.87	20.82 ± 1.22 / 31.49 ± 1.49	47.31 ± 1.67 / 31.36 ± 2.00	48.28 ± 4.28 / 64.07 ± 3.81	14.08 ± 1.29 / 52.67 ± 2.70	28.37 ± 4.07 / 55.92 ± 4.76	61.97 ± 1.94 / 19.06 ± 1.18	22.99 ± 0.83 / 41.98 ± 0.66	20.06 ± 1.95 / 38.69 ± 1.78	49.25 ± 2.57 / 36.48 ± 2.14	9.45 ± 1.76 / 39.66 ± 1.14	11.87 ± 2.68 / 47.32 ± 3.85	54.20 ± 1.44 / 67.04 ± 0.75	64.77 ± 0.96 / 16.74 ± 0.86	21.52 ± 1.18 / 40.76 ± 0.95	22.32 ± 2.02 / 39.89 ± 1.82	52.79 ± 4.09 / 43.45 ± 2.82	65.92 ± 1.02 / 70.47 ± 0.75	16.74 ± 2.67 / 55.45 ± 3.35	64.92 ± 2.84 / 80.88 ± 1.27	65.50 ± 0.97 / 21.90 ± 0.40	33.84 ± 0.87 / 50.07 ± 0.67	49.84 ± 1.22 / 61.87 ± 1.03	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
ibm-granite/granite-3.0-3b-a800m-base (few-shot)	3374	49	4096	True	10,504 ± 3,028 / 1,678 ± 559	3.17	3.22	3.32	2.91	4.01	3.81	2.80	3.02	2.30	31.80 ± 2.87 / 23.06 ± 2.09	6.85 ± 2.25 / 19.42 ± 0.91	0.97 ± 1.10 / 36.48 ± 3.91	49.83 ± 1.73 / 55.19 ± 1.84	63.43 ± 0.90 / 16.85 ± 1.02	15.97 ± 1.54 / 36.37 ± 1.08	17.19 ± 2.72 / 45.23 ± 1.84	3.07 ± 0.91 / 27.05 ± 0.83	40.08 ± 2.60 / 33.17 ± 1.81	43.96 ± 1.65 / 32.96 ± 2.24	31.90 ± 1.50 / 53.03 ± 1.81	59.98 ± 1.54 / 11.97 ± 1.13	-0.07 ± 0.97 / 35.01 ± 1.42	1.27 ± 2.35 / 38.10 ± 4.51	23.32 ± 2.39 / 43.13 ± 3.33	11.78 ± 1.09 / 33.75 ± 0.93	5.48 ± 1.23 / 28.09 ± 1.29	36.01 ± 3.07 / 24.61 ± 4.22	57.18 ± 5.33 / 62.72 ± 5.30	1.52 ± 2.14 / 38.30 ± 3.62	51.04 ± 0.95 / 56.97 ± 0.96	58.57 ± 0.73 / 15.09 ± 0.29	13.42 ± 0.96 / 34.81 ± 0.72	7.33 ± 1.70 / 29.31 ± 1.45	18.07 ± 3.62 / 18.73 ± 2.54	0.65 ± 3.12 / 18.97 ± 1.86	-0.72 ± 1.22 / 33.96 ± 0.50	12.27 ± 2.81 / 30.66 ± 1.47	56.49 ± 3.33 / 8.77 ± 1.24	0.32 ± 1.35 / 24.82 ± 1.04	1.00 ± 2.57 / 51.21 ± 2.91	41.27 ± 4.31 / 40.85 ± 4.31	5.40 ± 3.00 / 17.90 ± 2.95	-0.20 ± 2.17 / 43.01 ± 3.39	19.69 ± 2.66 / 29.77 ± 2.80	40.61 ± 2.18 / 28.49 ± 2.11	31.86 ± 3.60 / 42.96 ± 3.98	5.36 ± 3.96 / 37.83 ± 4.03	25.99 ± 3.85 / 47.72 ± 4.74	66.77 ± 0.94 / 23.71 ± 1.90	22.17 ± 1.05 / 41.55 ± 0.85	22.61 ± 1.75 / 41.16 ± 1.46	42.52 ± 3.31 / 33.08 ± 2.70	9.91 ± 1.71 / 35.24 ± 2.62	0.69 ± 2.82 / 36.10 ± 2.58	56.95 ± 1.18 / 66.87 ± 1.37	63.71 ± 0.60 / 17.04 ± 0.70	20.93 ± 1.42 / 40.35 ± 1.23	24.42 ± 1.73 / 42.26 ± 1.49	49.44 ± 3.68 / 39.69 ± 2.34	66.65 ± 1.04 / 65.72 ± 1.32	12.56 ± 2.15 / 54.20 ± 3.42	63.29 ± 4.61 / 75.62 ± 3.79	66.38 ± 0.28 / 21.17 ± 0.41	32.06 ± 0.87 / 49.12 ± 0.61	58.21 ± 0.98 / 68.63 ± 0.74	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
MaLA-LM/emma-500-llama2-7b (few-shot)	6738	32	4096	True	6,275 ± 1,193 / 1,755 ± 578	3.18	3.19	3.39	2.76	3.55	3.32	3.19	3.44	2.57	28.18 ± 3.39 / 24.25 ± 3.30	29.32 ± 7.19 / 41.08 ± 8.29	2.90 ± 2.18 / 37.93 ± 4.98	56.48 ± 1.11 / 62.92 ± 0.96	53.81 ± 1.18 / 9.42 ± 0.33	27.86 ± 1.78 / 43.42 ± 1.51	34.62 ± 2.93 / 55.21 ± 2.08	4.73 ± 0.61 / 27.77 ± 0.53	36.96 ± 3.10 / 34.68 ± 3.19	39.38 ± 3.30 / 37.06 ± 3.49	32.67 ± 2.52 / 44.37 ± 3.06	51.44 ± 1.23 / 8.37 ± 0.51	2.18 ± 2.36 / 38.05 ± 3.18	5.33 ± 2.97 / 44.30 ± 4.99	45.23 ± 5.03 / 67.75 ± 4.41	9.35 ± 1.27 / 30.22 ± 0.88	4.85 ± 0.63 / 27.55 ± 0.65	41.49 ± 2.82 / 38.09 ± 2.86	75.64 ± 1.51 / 76.06 ± 1.42	0.66 ± 1.97 / 33.73 ± 0.54	57.48 ± 0.54 / 63.85 ± 0.46	55.94 ± 1.10 / 13.29 ± 0.34	10.56 ± 1.14 / 31.45 ± 0.92	5.03 ± 1.36 / 28.41 ± 0.76	31.81 ± 1.93 / 29.47 ± 2.02	18.33 ± 5.09 / 30.21 ± 5.80	3.63 ± 1.69 / 44.49 ± 3.89	16.72 ± 7.29 / 46.83 ± 5.93	58.72 ± 3.28 / 13.71 ± 1.35	12.62 ± 1.36 / 34.51 ± 1.27	3.43 ± 2.18 / 44.56 ± 1.09	40.18 ± 3.60 / 39.95 ± 3.38	14.19 ± 8.12 / 28.15 ± 8.15	0.31 ± 1.71 / 41.35 ± 4.05	41.60 ± 2.49 / 60.78 ± 2.12	32.33 ± 2.48 / 30.20 ± 1.92	26.39 ± 5.23 / 36.06 ± 6.62	1.44 ± 1.38 / 33.60 ± 0.42	28.15 ± 5.57 / 54.13 ± 6.75	58.62 ± 3.80 / 13.54 ± 2.20	14.94 ± 1.09 / 35.44 ± 0.89	8.70 ± 0.96 / 31.09 ± 0.58	36.61 ± 3.37 / 31.91 ± 2.20	8.77 ± 1.80 / 25.31 ± 1.42	3.52 ± 2.07 / 35.34 ± 1.61	59.51 ± 0.97 / 70.33 ± 0.64	54.50 ± 5.78 / 15.01 ± 1.59	14.90 ± 1.44 / 35.20 ± 1.09	7.26 ± 1.56 / 29.91 ± 1.18	47.20 ± 3.39 / 44.00 ± 3.43	64.82 ± 1.13 / 67.11 ± 1.41	7.57 ± 2.31 / 45.83 ± 3.97	73.88 ± 1.02 / 83.56 ± 0.75	67.34 ± 0.38 / 21.61 ± 0.61	16.59 ± 1.01 / 35.35 ± 0.70	11.97 ± 1.35 / 32.72 ± 0.94	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
openGPT-X/Teuken-7B-instruct-research-v0.4 (few-shot)	7453	251	4096	False	1,254 ± 328 / 243 ± 83	3.22	2.92	3.35	2.84	3.79	3.51	3.01	3.36	3.00	34.66 ± 1.19 / 21.37 ± 1.52	21.93 ± 3.72 / 31.67 ± 4.68	1.50 ± 1.04 / 33.84 ± 0.24	52.36 ± 0.70 / 60.53 ± 0.63	64.84 ± 0.14 / 14.90 ± 0.35	24.39 ± 2.23 / 40.04 ± 1.96	33.37 ± 3.58 / 54.00 ± 2.48	13.98 ± 1.55 / 33.88 ± 1.46	37.36 ± 1.61 / 24.19 ± 1.65	42.83 ± 1.41 / 28.06 ± 1.69	16.02 ± 6.40 / 30.81 ± 5.11	61.93 ± 0.08 / 9.94 ± 0.21	-0.08 ± 0.82 / 33.74 ± 0.41	2.29 ± 1.78 / 35.36 ± 1.11	31.60 ± 1.36 / 56.15 ± 1.66	8.67 ± 0.86 / 29.37 ± 0.97	9.80 ± 1.50 / 30.12 ± 1.06	35.02 ± 2.08 / 17.87 ± 0.89	51.80 ± 4.28 / 57.15 ± 4.66	6.15 ± 0.86 / 36.62 ± 0.84	50.85 ± 0.74 / 60.00 ± 0.48	65.68 ± 0.10 / 16.49 ± 0.10	10.11 ± 1.07 / 28.11 ± 0.93	8.76 ± 1.73 / 27.81 ± 1.22	28.74 ± 2.37 / 19.43 ± 1.48	4.30 ± 1.28 / 19.35 ± 2.86	0.06 ± 1.39 / 34.20 ± 1.30	17.41 ± 2.45 / 45.55 ± 1.65	60.79 ± 0.72 / 13.13 ± 0.60	0.18 ± 1.16 / 23.06 ± 0.66	-1.64 ± 2.16 / 53.50 ± 2.67	46.64 ± 1.91 / 35.58 ± 2.47	16.72 ± 4.87 / 41.68 ± 4.39	-1.54 ± 2.60 / 36.21 ± 2.51	18.69 ± 5.12 / 38.94 ± 4.72	39.39 ± 2.50 / 23.55 ± 1.34	23.60 ± 3.12 / 34.73 ± 3.27	7.68 ± 1.29 / 36.93 ± 0.75	25.30 ± 0.79 / 52.63 ± 1.81	63.84 ± 0.15 / 12.84 ± 0.30	14.99 ± 1.10 / 33.86 ± 1.26	14.99 ± 1.43 / 33.86 ± 1.03	39.24 ± 2.43 / 24.25 ± 1.34	4.25 ± 1.28 / 18.15 ± 3.08	11.48 ± 1.02 / 52.86 ± 2.43	54.18 ± 0.98 / 65.58 ± 0.62	65.55 ± 0.28 / 15.78 ± 0.39	13.37 ± 0.76 / 32.35 ± 0.82	9.13 ± 1.17 / 27.27 ± 0.70	50.73 ± 2.64 / 38.64 ± 1.60	27.52 ± 3.38 / 31.81 ± 3.98	2.96 ± 2.64 / 35.23 ± 1.82	63.42 ± 1.34 / 76.38 ± 1.18	68.74 ± 0.08 / 21.51 ± 0.20	16.65 ± 0.64 / 35.86 ± 0.47	10.69 ± 1.12 / 29.62 ± 0.77	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
ibm-granite/granite-3b-code-instruct-2k (few-shot)	3483	49	2048	True	9,059 ± 1,947 / 2,201 ± 728	3.26	3.09	3.32	3.05	4.04	3.63	3.06	3.33	2.59	37.21 ± 2.75 / 27.74 ± 2.59	31.54 ± 2.39 / 50.61 ± 2.88	6.30 ± 1.61 / 49.09 ± 2.54	44.86 ± 0.80 / 51.51 ± 0.91	61.56 ± 0.49 / 13.64 ± 0.97	17.92 ± 1.52 / 37.22 ± 1.29	10.79 ± 2.32 / 40.86 ± 1.85	1.70 ± 1.10 / 26.14 ± 0.76	53.78 ± 2.43 / 49.41 ± 2.56	55.14 ± 1.27 / 51.07 ± 1.78	26.21 ± 1.63 / 43.33 ± 1.46	57.11 ± 1.08 / 10.81 ± 0.52	3.90 ± 1.45 / 43.86 ± 4.21	2.42 ± 1.39 / 41.58 ± 3.89	24.86 ± 1.34 / 45.77 ± 1.85	10.36 ± 1.15 / 29.64 ± 1.06	5.85 ± 1.57 / 27.84 ± 1.21	50.10 ± 4.30 / 42.80 ± 5.47	65.67 ± 3.92 / 64.00 ± 3.84	4.55 ± 2.18 / 45.11 ± 4.32	42.83 ± 1.02 / 49.35 ± 1.09	45.16 ± 0.70 / 11.84 ± 0.27	7.58 ± 0.88 / 28.54 ± 0.85	3.79 ± 0.85 / 27.39 ± 0.57	33.57 ± 2.48 / 33.47 ± 2.48	0.60 ± 2.01 / 16.42 ± 1.16	0.00 ± 0.00 / 33.69 ± 0.28	11.27 ± 2.38 / 33.54 ± 1.64	49.32 ± 3.71 / 8.01 ± 2.04	1.37 ± 1.11 / 25.57 ± 1.36	-4.04 ± 3.58 / 50.55 ± 3.65	56.88 ± 2.51 / 57.68 ± 2.14	3.80 ± 5.87 / 28.41 ± 4.70	-0.21 ± 2.20 / 34.20 ± 1.19	13.72 ± 2.56 / 24.11 ± 2.40	49.16 ± 2.12 / 40.34 ± 2.81	35.17 ± 4.48 / 51.15 ± 4.55	9.79 ± 2.06 / 50.77 ± 3.64	22.48 ± 2.59 / 45.90 ± 3.03	60.81 ± 0.38 / 15.92 ± 0.54	6.89 ± 0.76 / 28.82 ± 0.69	4.79 ± 0.91 / 28.40 ± 0.78	48.53 ± 3.89 / 38.20 ± 2.92	10.15 ± 1.55 / 22.01 ± 1.44	4.88 ± 2.27 / 38.78 ± 3.56	45.38 ± 0.93 / 56.09 ± 1.05	59.56 ± 1.09 / 15.20 ± 0.56	7.38 ± 1.06 / 29.60 ± 0.71	2.69 ± 0.56 / 25.85 ± 0.33	58.30 ± 2.16 / 53.45 ± 1.98	59.01 ± 2.14 / 62.37 ± 1.73	10.33 ± 3.06 / 53.28 ± 2.21	65.04 ± 2.20 / 75.93 ± 1.50	67.46 ± 0.31 / 23.04 ± 0.42	14.10 ± 0.93 / 34.24 ± 0.84	10.67 ± 0.81 / 32.66 ± 0.64	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.3.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
ibm-granite/granite-3b-code-base-2k (few-shot)	3483	49	2048	True	2,732 ± 868 / 662 ± 238	3.31	2.93	3.70	3.00	3.83	3.62	3.38	3.33	2.72	38.62 ± 3.40 / 27.71 ± 3.01	35.47 ± 1.35 / 52.70 ± 2.05	5.07 ± 1.76 / 43.91 ± 4.86	45.21 ± 0.84 / 50.96 ± 0.94	62.50 ± 0.59 / 15.45 ± 0.50	13.46 ± 2.03 / 33.24 ± 1.59	15.31 ± 3.62 / 43.65 ± 2.19	6.00 ± 1.15 / 29.24 ± 0.76	53.93 ± 3.93 / 48.95 ± 4.17	54.04 ± 1.83 / 49.74 ± 2.48	23.83 ± 3.47 / 45.39 ± 3.46	50.59 ± 3.68 / 7.28 ± 1.97	3.91 ± 1.46 / 42.54 ± 4.53	1.55 ± 2.39 / 40.63 ± 4.26	2.37 ± 0.20 / 12.14 ± 1.07	8.68 ± 1.17 / 31.15 ± 0.84	6.19 ± 0.85 / 29.29 ± 0.77	51.76 ± 4.53 / 41.73 ± 6.65	70.61 ± 1.12 / 60.47 ± 1.13	6.24 ± 3.11 / 46.34 ± 5.43	44.67 ± 1.34 / 50.56 ± 1.33	41.31 ± 2.13 / 7.20 ± 1.44	7.41 ± 0.75 / 30.14 ± 0.39	5.42 ± 0.79 / 29.15 ± 0.59	38.52 ± 3.25 / 28.84 ± 5.49	4.29 ± 3.60 / 23.24 ± 4.11	0.00 ± 0.00 / 33.69 ± 0.28	12.94 ± 2.60 / 36.06 ± 2.17	58.58 ± 4.00 / 12.91 ± 2.09	2.11 ± 1.02 / 27.80 ± 1.02	-4.75 ± 2.84 / 50.40 ± 4.21	60.88 ± 2.03 / 60.02 ± 1.84	0.16 ± 0.32 / 14.73 ± 2.24	-0.35 ± 1.18 / 34.50 ± 1.25	18.54 ± 1.93 / 29.79 ± 1.35	49.38 ± 2.20 / 42.66 ± 3.24	41.72 ± 4.07 / 60.45 ± 3.07	7.67 ± 1.52 / 46.66 ± 3.23	13.70 ± 2.43 / 30.21 ± 3.80	45.88 ± 3.36 / 8.30 ± 1.98	8.73 ± 1.03 / 31.46 ± 0.70	6.18 ± 1.33 / 29.78 ± 1.02	50.88 ± 3.41 / 39.51 ± 3.29	12.39 ± 1.50 / 30.05 ± 1.80	3.31 ± 1.19 / 37.97 ± 4.40	48.44 ± 1.06 / 58.85 ± 0.75	52.50 ± 2.95 / 10.11 ± 2.12	9.22 ± 0.79 / 31.06 ± 0.75	4.45 ± 1.38 / 28.26 ± 1.08	60.64 ± 2.11 / 55.14 ± 2.01	61.20 ± 1.16 / 61.92 ± 1.68	7.63 ± 2.79 / 46.39 ± 3.79	69.83 ± 2.12 / 80.15 ± 1.27	56.62 ± 3.70 / 13.80 ± 2.77	16.29 ± 0.76 / 36.25 ± 0.61	10.37 ± 1.17 / 32.60 ± 0.89	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0
openGPT-X/Teuken-7B-instruct-commercial-v0.4 (few-shot)	7453	251	4096	True	1,438 ± 410 / 233 ± 79	3.33	2.95	3.38	3.08	3.79	3.58	3.24	3.52	3.07	29.49 ± 2.73 / 21.57 ± 2.07	13.77 ± 3.72 / 23.78 ± 3.10	0.00 ± 0.00 / 33.49 ± 0.27	51.53 ± 1.01 / 59.23 ± 0.88	66.31 ± 0.80 / 20.62 ± 0.37	24.59 ± 2.75 / 41.65 ± 2.33	39.09 ± 2.12 / 55.43 ± 2.08	15.60 ± 1.46 / 35.88 ± 1.25	34.78 ± 2.34 / 27.42 ± 1.71	39.00 ± 3.24 / 31.27 ± 2.29	10.69 ± 5.81 / 26.94 ± 3.14	62.73 ± 0.26 / 13.33 ± 0.22	6.17 ± 1.50 / 50.50 ± 1.78	5.90 ± 1.38 / 49.15 ± 2.88	31.25 ± 2.01 / 55.30 ± 2.29	7.97 ± 1.20 / 31.21 ± 0.84	10.39 ± 2.05 / 32.03 ± 1.42	37.17 ± 2.59 / 25.25 ± 1.61	20.20 ± 4.93 / 21.73 ± 5.47	6.13 ± 1.52 / 39.55 ± 1.91	46.66 ± 1.19 / 56.90 ± 1.10	65.28 ± 0.14 / 18.08 ± 0.12	10.89 ± 1.11 / 32.66 ± 0.94	9.20 ± 1.47 / 30.95 ± 1.18	26.58 ± 1.47 / 22.13 ± 2.38	-0.79 ± 2.98 / 26.06 ± 1.66	0.63 ± 1.36 / 43.80 ± 3.59	15.14 ± 2.49 / 44.23 ± 2.12	60.84 ± 0.65 / 13.75 ± 0.70	1.17 ± 1.56 / 23.34 ± 1.03	-0.12 ± 2.10 / 54.54 ± 1.79	39.78 ± 1.79 / 31.09 ± 2.58	16.03 ± 6.81 / 39.68 ± 7.16	-0.48 ± 1.85 / 33.39 ± 0.49	20.04 ± 4.63 / 38.93 ± 4.09	38.81 ± 2.72 / 27.14 ± 1.94	10.59 ± 3.02 / 21.22 ± 2.19	0.91 ± 1.67 / 33.45 ± 0.28	22.54 ± 1.17 / 48.13 ± 1.67	64.28 ± 0.13 / 14.60 ± 0.27	15.69 ± 0.87 / 35.90 ± 0.62	14.18 ± 2.07 / 33.42 ± 2.12	42.35 ± 2.49 / 29.29 ± 1.66	0.78 ± 0.93 / 8.63 ± 0.29	-0.02 ± 1.29 / 38.46 ± 1.55	47.61 ± 1.96 / 59.25 ± 1.42	65.32 ± 0.26 / 16.11 ± 0.29	14.59 ± 0.65 / 34.74 ± 0.52	11.78 ± 1.60 / 32.91 ± 0.98	44.48 ± 3.17 / 36.31 ± 2.23	23.69 ± 3.36 / 25.98 ± 3.59	8.52 ± 2.60 / 51.57 ± 2.62	56.97 ± 1.53 / 71.38 ± 1.28	68.81 ± 0.06 / 22.48 ± 0.20	15.31 ± 1.45 / 35.07 ± 1.13	9.35 ± 1.36 / 29.47 ± 1.09	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4
HuggingFaceTB/SmolLM2-1.7B-Instruct (few-shot)	1711	49	8192	True	15,971 ± 3,654 / 3,609 ± 1,197	3.40	3.21	3.77	3.01	3.76	3.94	3.31	3.79	2.42	29.44 ± 1.81 / 20.31 ± 1.68	18.49 ± 2.47 / 35.29 ± 2.83	1.73 ± 1.63 / 38.18 ± 4.15	44.39 ± 0.80 / 50.40 ± 1.02	61.76 ± 1.10 / 15.33 ± 1.17	22.03 ± 1.83 / 37.29 ± 1.77	12.61 ± 2.43 / 41.82 ± 1.61	2.06 ± 0.89 / 26.03 ± 0.67	37.60 ± 2.17 / 29.30 ± 2.43	38.38 ± 2.48 / 30.13 ± 2.95	24.05 ± 3.58 / 40.36 ± 4.22	48.55 ± 6.18 / 8.21 ± 1.30	3.56 ± 1.93 / 38.60 ± 3.52	2.61 ± 2.57 / 38.57 ± 3.89	13.58 ± 3.16 / 25.34 ± 5.83	9.52 ± 1.13 / 30.72 ± 1.12	3.62 ± 1.22 / 27.07 ± 1.15	37.37 ± 1.87 / 26.31 ± 3.34	64.46 ± 3.06 / 69.83 ± 2.00	4.49 ± 1.96 / 46.63 ± 4.39	43.92 ± 1.06 / 49.57 ± 1.17	54.50 ± 1.26 / 12.92 ± 0.48	8.61 ± 1.25 / 29.95 ± 1.28	4.51 ± 0.96 / 27.64 ± 0.87	26.23 ± 3.53 / 23.26 ± 2.30	6.86 ± 5.25 / 23.96 ± 4.13	2.69 ± 1.42 / 45.61 ± 2.69	10.84 ± 2.59 / 28.57 ± 2.09	60.43 ± 2.70 / 15.28 ± 1.36	1.93 ± 1.38 / 25.06 ± 1.16	3.27 ± 2.97 / 54.02 ± 1.79	40.28 ± 3.29 / 42.15 ± 2.85	3.94 ± 3.10 / 30.51 ± 3.43	-0.26 ± 1.92 / 38.29 ± 4.03	10.68 ± 1.75 / 17.52 ± 1.85	32.54 ± 1.57 / 26.92 ± 1.87	27.03 ± 2.54 / 42.80 ± 3.28	8.95 ± 1.62 / 51.86 ± 2.23	18.38 ± 1.26 / 39.18 ± 2.13	59.91 ± 0.84 / 16.05 ± 0.61	12.30 ± 1.16 / 32.60 ± 1.27	6.28 ± 1.36 / 27.82 ± 1.17	31.84 ± 3.39 / 28.66 ± 1.77	1.56 ± 3.25 / 28.78 ± 2.60	5.05 ± 1.34 / 43.99 ± 4.14	40.55 ± 0.77 / 48.56 ± 0.95	60.35 ± 1.16 / 13.63 ± 0.63	13.39 ± 0.96 / 34.55 ± 0.65	4.57 ± 0.96 / 27.42 ± 0.73	47.58 ± 2.41 / 39.52 ± 1.41	66.78 ± 0.76 / 61.52 ± 0.99	20.53 ± 3.83 / 58.47 ± 2.90	58.07 ± 2.23 / 69.96 ± 1.63	62.45 ± 5.62 / 19.60 ± 1.85	32.90 ± 0.96 / 49.16 ± 0.95	25.32 ± 2.12 / 42.50 ± 2.39	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
utter-project/EuroLLM-1.7B-Instruct (few-shot)	1657	128	4096	True	15,009 ± 4,072 / 2,702 ± 878	3.40	3.09	3.40	2.97	4.02	4.07	3.15	3.58	2.93	19.61 ± 2.68 / 17.44 ± 2.64	37.92 ± 1.74 / 46.23 ± 1.91	2.81 ± 1.13 / 38.15 ± 2.81	50.05 ± 1.02 / 56.82 ± 0.77	63.91 ± 1.29 / 18.26 ± 1.57	2.54 ± 1.89 / 25.25 ± 1.06	17.85 ± 2.63 / 40.98 ± 1.12	0.52 ± 0.97 / 25.60 ± 0.68	31.43 ± 1.78 / 30.82 ± 2.35	36.92 ± 1.75 / 37.80 ± 1.67	30.63 ± 1.48 / 37.24 ± 1.90	59.45 ± 1.98 / 10.85 ± 1.59	0.98 ± 1.59 / 42.00 ± 2.28	1.67 ± 1.96 / 34.92 ± 1.93	33.24 ± 2.51 / 55.11 ± 2.82	1.85 ± 1.02 / 24.15 ± 0.66	-1.18 ± 1.33 / 24.23 ± 0.94	27.41 ± 2.70 / 24.45 ± 3.82	72.24 ± 0.82 / 68.89 ± 2.63	0.13 ± 1.85 / 36.22 ± 3.14	49.77 ± 0.63 / 56.59 ± 0.54	63.23 ± 0.51 / 17.40 ± 0.45	3.39 ± 0.48 / 25.11 ± 0.71	0.54 ± 0.72 / 25.45 ± 0.45	13.29 ± 2.33 / 14.72 ± 2.11	6.83 ± 5.62 / 31.41 ± 4.70	0.92 ± 1.51 / 42.09 ± 3.39	7.49 ± 1.26 / 24.16 ± 1.95	56.76 ± 2.66 / 9.80 ± 1.05	0.59 ± 0.49 / 23.09 ± 0.56	1.87 ± 3.67 / 49.58 ± 3.20	33.53 ± 3.87 / 35.41 ± 3.77	4.25 ± 5.04 / 26.21 ± 4.24	-2.32 ± 2.11 / 45.19 ± 2.78	15.41 ± 2.05 / 25.07 ± 1.98	28.49 ± 2.30 / 24.73 ± 1.76	43.18 ± 2.89 / 58.22 ± 3.50	2.92 ± 1.40 / 44.65 ± 3.51	23.26 ± 3.37 / 48.47 ± 3.57	64.64 ± 0.93 / 17.38 ± 1.77	2.60 ± 0.88 / 26.76 ± 0.79	1.46 ± 1.09 / 26.00 ± 0.95	32.45 ± 2.17 / 30.83 ± 2.31	7.03 ± 2.08 / 34.16 ± 1.83	5.58 ± 1.32 / 44.79 ± 3.28	51.18 ± 1.19 / 61.82 ± 1.19	61.96 ± 0.80 / 14.66 ± 0.48	2.53 ± 1.10 / 25.95 ± 1.10	1.04 ± 0.74 / 25.13 ± 0.68	37.47 ± 1.64 / 32.39 ± 2.53	58.61 ± 2.46 / 62.78 ± 1.22	5.30 ± 1.43 / 46.95 ± 3.51	63.26 ± 0.73 / 74.41 ± 0.65	67.24 ± 0.36 / 21.22 ± 0.36	3.93 ± 0.84 / 28.88 ± 0.73	1.26 ± 1.14 / 25.56 ± 0.82	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
HuggingFaceTB/SmolLM2-1.7B (few-shot)	1711	49	8192	True	16,249 ± 3,690 / 3,689 ± 1,226	3.48	3.40	3.70	2.97	3.91	4.08	3.31	3.83	2.66	24.47 ± 3.42 / 18.70 ± 2.18	9.93 ± 2.70 / 23.57 ± 3.00	1.22 ± 1.81 / 35.31 ± 1.93	42.09 ± 2.63 / 47.54 ± 2.94	61.62 ± 0.72 / 14.36 ± 0.73	19.65 ± 1.47 / 36.46 ± 1.24	19.01 ± 2.56 / 46.27 ± 1.71	1.34 ± 1.16 / 25.88 ± 0.65	26.70 ± 4.42 / 24.56 ± 2.10	28.23 ± 3.78 / 28.27 ± 2.80	23.25 ± 4.16 / 36.07 ± 4.20	56.31 ± 2.34 / 9.78 ± 0.93	-0.47 ± 1.05 / 33.93 ± 0.92	0.26 ± 0.74 / 33.32 ± 0.79	13.40 ± 2.83 / 26.51 ± 4.94	11.12 ± 0.88 / 33.35 ± 0.75	2.53 ± 0.82 / 26.29 ± 0.74	35.96 ± 3.50 / 26.41 ± 4.11	68.31 ± 1.43 / 72.51 ± 1.03	3.61 ± 1.79 / 49.47 ± 1.68	43.26 ± 1.85 / 49.32 ± 1.97	57.04 ± 0.95 / 13.24 ± 1.09	10.86 ± 1.20 / 31.65 ± 1.09	2.53 ± 0.98 / 26.17 ± 0.78	20.50 ± 4.51 / 18.93 ± 3.84	10.09 ± 3.91 / 29.11 ± 2.96	0.83 ± 1.65 / 45.84 ± 2.02	10.84 ± 2.45 / 28.36 ± 1.48	57.52 ± 4.61 / 13.43 ± 2.11	3.16 ± 0.85 / 26.13 ± 0.67	-1.83 ± 3.11 / 49.80 ± 1.96	27.91 ± 4.97 / 30.98 ± 4.28	0.77 ± 4.14 / 23.56 ± 3.58	-0.48 ± 0.89 / 33.97 ± 1.00	16.56 ± 1.66 / 26.11 ± 1.42	28.67 ± 3.31 / 25.27 ± 2.68	19.69 ± 2.50 / 29.00 ± 2.22	5.07 ± 0.89 / 47.60 ± 2.39	18.43 ± 2.31 / 38.33 ± 2.91	64.25 ± 1.99 / 18.90 ± 2.50	15.15 ± 0.67 / 35.75 ± 0.46	6.23 ± 0.96 / 28.39 ± 0.87	22.84 ± 5.42 / 25.11 ± 3.52	4.60 ± 2.12 / 29.94 ± 1.50	2.55 ± 1.41 / 40.88 ± 3.15	40.33 ± 1.19 / 48.35 ± 1.31	58.31 ± 1.50 / 13.08 ± 0.51	14.32 ± 0.71 / 35.65 ± 0.50	3.87 ± 1.02 / 27.14 ± 0.66	41.57 ± 4.29 / 37.51 ± 3.05	62.32 ± 1.12 / 67.09 ± 0.96	8.04 ± 3.17 / 48.16 ± 5.38	56.01 ± 3.10 / 67.43 ± 2.41	65.06 ± 0.87 / 20.12 ± 0.51	34.02 ± 0.87 / 50.12 ± 0.76	22.81 ± 1.86 / 41.37 ± 1.41	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.1.2	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.1.2	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
tiiuae/Falcon3-1B-Instruct (few-shot)	1669	131	8192	True	9,270 ± 2,690 / 1,434 ± 437	3.73	3.71	3.97	3.58	4.14	4.26	3.40	4.05	2.73	20.03 ± 1.60 / 17.52 ± 1.50	15.96 ± 2.77 / 38.74 ± 2.88	0.86 ± 1.76 / 42.48 ± 3.82	28.98 ± 1.93 / 35.38 ± 2.10	56.75 ± 0.67 / 10.37 ± 0.34	2.15 ± 1.69 / 25.19 ± 0.96	2.51 ± 2.17 / 35.61 ± 1.10	0.88 ± 0.95 / 25.68 ± 0.52	29.25 ± 2.15 / 28.34 ± 2.25	25.45 ± 1.96 / 24.62 ± 1.86	11.28 ± 0.71 / 22.46 ± 2.54	55.58 ± 1.17 / 8.04 ± 0.65	1.52 ± 1.26 / 40.82 ± 4.08	0.52 ± 1.60 / 41.23 ± 4.21	8.47 ± 0.94 / 20.43 ± 2.10	2.62 ± 1.32 / 26.23 ± 0.92	-0.06 ± 0.97 / 24.96 ± 0.73	26.41 ± 2.74 / 25.18 ± 2.46	25.99 ± 3.51 / 35.36 ± 4.53	1.64 ± 1.90 / 37.52 ± 2.69	21.39 ± 1.66 / 26.70 ± 1.83	58.09 ± 0.53 / 13.29 ± 0.62	3.51 ± 1.35 / 27.14 ± 1.02	1.05 ± 1.05 / 25.62 ± 0.84	9.39 ± 3.31 / 9.28 ± 3.38	6.44 ± 2.00 / 22.24 ± 3.62	-0.72 ± 1.67 / 43.21 ± 3.74	3.34 ± 0.98 / 21.41 ± 2.93	59.37 ± 0.99 / 11.96 ± 0.51	-1.22 ± 0.96 / 23.83 ± 1.00	4.20 ± 2.70 / 53.16 ± 2.28	14.18 ± 3.48 / 13.89 ± 3.46	2.36 ± 2.76 / 17.70 ± 4.11	2.29 ± 2.66 / 48.34 ± 3.37	6.35 ± 1.25 / 12.91 ± 1.66	32.54 ± 1.23 / 30.63 ± 1.12	22.27 ± 4.97 / 36.09 ± 3.66	7.18 ± 1.13 / 51.77 ± 1.56	16.72 ± 0.88 / 38.07 ± 0.76	58.08 ± 0.37 / 10.60 ± 0.37	6.57 ± 1.03 / 29.10 ± 0.93	5.16 ± 1.64 / 28.12 ± 1.34	28.25 ± 3.03 / 25.24 ± 2.38	3.73 ± 1.83 / 15.20 ± 2.26	0.76 ± 1.10 / 33.57 ± 0.34	19.08 ± 2.27 / 28.16 ± 2.64	57.20 ± 1.38 / 10.23 ± 0.61	5.45 ± 0.96 / 28.87 ± 0.86	2.34 ± 1.16 / 26.19 ± 0.80	43.00 ± 1.94 / 39.96 ± 1.87	54.47 ± 1.37 / 64.39 ± 0.56	17.44 ± 1.67 / 50.79 ± 2.44	53.15 ± 1.38 / 70.06 ± 0.79	67.33 ± 0.15 / 22.37 ± 0.27	20.49 ± 1.00 / 38.88 ± 0.87	17.50 ± 0.84 / 36.85 ± 0.65	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2	14.1.2
PleIAs/Pleias-1.2b-Preview (few-shot)	1195	66	2048	True	10,756 ± 3,589 / 1,157 ± 670	3.82	3.45	3.93	3.60	4.03	4.04	3.84	4.00	3.69	28.30 ± 2.45 / 22.93 ± 1.82	28.95 ± 4.05 / 48.32 ± 5.01	0.20 ± 0.52 / 34.12 ± 1.62	36.39 ± 0.84 / 43.32 ± 0.77	56.60 ± 2.67 / 10.20 ± 1.29	-0.19 ± 1.94 / 24.99 ± 1.24	11.52 ± 2.67 / 40.10 ± 1.81	0.06 ± 1.12 / 25.22 ± 0.57	38.96 ± 2.67 / 36.82 ± 3.28	40.42 ± 2.43 / 38.81 ± 2.83	19.42 ± 3.09 / 26.64 ± 4.19	49.86 ± 2.91 / 6.53 ± 1.00	-0.13 ± 0.55 / 33.43 ± 0.23	0.77 ± 1.22 / 33.80 ± 0.25	4.70 ± 1.89 / 8.66 ± 3.16	-0.21 ± 1.45 / 24.34 ± 0.86	-0.56 ± 1.00 / 24.97 ± 0.77	36.29 ± 4.00 / 31.64 ± 3.95	39.68 ± 11.06 / 47.78 ± 9.30	0.96 ± 1.25 / 36.56 ± 2.57	32.64 ± 1.84 / 38.42 ± 1.95	28.38 ± 11.08 / 6.24 ± 2.51	1.35 ± 1.17 / 24.67 ± 1.17	-0.19 ± 1.18 / 24.79 ± 0.78	22.56 ± 3.90 / 22.69 ± 3.50	0.53 ± 2.22 / 20.28 ± 1.55	-0.26 ± 0.43 / 33.59 ± 1.01	11.77 ± 1.87 / 31.39 ± 2.24	53.36 ± 3.05 / 8.87 ± 1.05	0.36 ± 1.59 / 23.64 ± 0.76	0.24 ± 3.00 / 55.12 ± 1.24	38.91 ± 4.57 / 39.53 ± 3.74	-1.72 ± 2.43 / 16.58 ± 3.29	0.66 ± 0.95 / 33.60 ± 0.66	4.82 ± 3.70 / 7.41 ± 5.58	34.68 ± 3.56 / 30.00 ± 2.82	21.76 ± 5.01 / 39.73 ± 5.21	0.85 ± 1.86 / 38.42 ± 3.98	14.30 ± 0.97 / 30.11 ± 2.25	43.98 ± 8.28 / 9.06 ± 1.56	0.36 ± 1.05 / 25.80 ± 0.69	1.32 ± 0.86 / 25.98 ± 0.61	38.22 ± 3.45 / 35.62 ± 3.90	4.99 ± 3.86 / 29.17 ± 2.70	1.85 ± 1.45 / 40.34 ± 3.41	27.77 ± 1.34 / 36.19 ± 1.60	49.31 ± 4.05 / 8.77 ± 1.00	-1.45 ± 0.89 / 24.35 ± 0.73	0.83 ± 0.92 / 26.03 ± 0.51	40.45 ± 3.27 / 37.90 ± 2.99	47.89 ± 3.76 / 56.99 ± 2.11	0.28 ± 1.01 / 44.40 ± 3.07	26.77 ± 5.45 / 35.60 ± 6.25	50.31 ± 7.81 / 13.58 ± 2.12	1.03 ± 0.82 / 26.95 ± 0.56	-0.30 ± 1.30 / 24.99 ± 1.10	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
PleIAs/Pleias-3b-Preview (few-shot)	3212	66	4096	True	6,513 ± 1,241 / 1,282 ± 644	3.84	3.63	3.91	3.39	4.06	4.28	3.75	3.85	3.84	15.93 ± 3.91 / 14.68 ± 2.81	13.01 ± 2.33 / 28.28 ± 4.63	0.05 ± 1.37 / 40.73 ± 3.78	36.85 ± 1.28 / 41.96 ± 1.64	58.60 ± 2.15 / 10.74 ± 1.12	-0.09 ± 1.15 / 23.40 ± 0.41	2.94 ± 2.51 / 35.74 ± 1.24	-0.35 ± 0.97 / 25.37 ± 0.72	28.82 ± 3.76 / 28.03 ± 3.72	27.81 ± 4.34 / 26.00 ± 4.14	18.74 ± 2.86 / 27.39 ± 3.91	53.53 ± 1.41 / 7.98 ± 0.87	-0.46 ± 1.39 / 36.22 ± 3.32	-0.84 ± 1.32 / 37.42 ± 3.48	12.66 ± 1.66 / 21.98 ± 3.16	-1.29 ± 1.40 / 22.92 ± 0.76	1.29 ± 0.77 / 25.52 ± 0.59	21.42 ± 6.21 / 20.27 ± 5.32	45.75 ± 7.94 / 50.33 ± 6.88	-0.25 ± 1.25 / 44.95 ± 2.93	32.71 ± 2.02 / 37.44 ± 2.20	57.21 ± 1.63 / 13.08 ± 1.06	1.57 ± 1.29 / 22.82 ± 1.04	0.36 ± 0.63 / 25.15 ± 0.48	18.86 ± 5.30 / 18.63 ± 4.20	-0.67 ± 2.61 / 21.03 ± 3.38	-0.76 ± 0.76 / 33.16 ± 0.37	8.09 ± 1.59 / 26.19 ± 2.53	60.61 ± 1.18 / 12.59 ± 0.80	-0.78 ± 1.21 / 22.85 ± 1.06	-0.84 ± 2.04 / 56.38 ± 1.01	22.75 ± 5.63 / 23.52 ± 4.86	-0.03 ± 6.54 / 23.66 ± 3.61	-0.78 ± 1.59 / 33.93 ± 0.87	7.75 ± 1.53 / 12.38 ± 1.36	23.08 ± 4.90 / 21.68 ± 4.10	7.41 ± 5.97 / 23.37 ± 5.40	0.89 ± 1.81 / 40.64 ± 3.86	17.32 ± 1.06 / 33.36 ± 2.38	56.57 ± 2.63 / 11.57 ± 1.39	-0.63 ± 0.62 / 23.00 ± 0.52	-0.17 ± 1.38 / 24.60 ± 0.84	31.13 ± 3.71 / 29.34 ± 2.26	7.24 ± 2.08 / 29.45 ± 4.63	1.23 ± 1.73 / 44.71 ± 3.28	32.13 ± 0.85 / 39.28 ± 0.76	56.85 ± 0.66 / 11.52 ± 0.17	1.79 ± 1.11 / 26.12 ± 0.72	-0.63 ± 1.13 / 23.93 ± 0.71	27.37 ± 4.57 / 26.50 ± 4.52	36.35 ± 7.92 / 45.58 ± 8.18	-0.37 ± 1.89 / 44.67 ± 2.86	7.42 ± 2.13 / 16.44 ± 2.71	60.89 ± 0.87 / 17.36 ± 0.62	2.21 ± 1.17 / 26.40 ± 1.12	-0.90 ± 0.79 / 24.52 ± 0.70	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
HuggingFaceTB/SmolLM2-360M (few-shot)	362	49	8192	True	22,023 ± 6,203 / 3,675 ± 1,231	3.97	3.86	4.25	3.88	4.19	4.27	3.84	4.13	3.34	12.68 ± 1.39 / 12.32 ± 1.19	3.61 ± 2.69 / 19.01 ± 3.95	1.79 ± 0.97 / 36.23 ± 3.19	28.12 ± 3.14 / 32.48 ± 3.57	56.85 ± 1.37 / 10.17 ± 1.17	-0.03 ± 0.59 / 23.99 ± 0.76	6.03 ± 3.05 / 37.58 ± 1.59	0.20 ± 0.86 / 25.12 ± 0.70	26.60 ± 1.99 / 23.60 ± 2.05	23.70 ± 1.58 / 23.04 ± 2.17	6.21 ± 2.55 / 23.74 ± 3.28	48.59 ± 1.59 / 6.80 ± 0.45	-0.39 ± 0.76 / 33.40 ± 0.31	0.21 ± 0.41 / 35.33 ± 3.02	4.65 ± 1.00 / 10.23 ± 1.68	-1.13 ± 0.96 / 21.80 ± 0.52	-0.51 ± 0.40 / 24.82 ± 0.86	18.22 ± 1.75 / 17.97 ± 2.10	11.52 ± 7.20 / 29.30 ± 5.30	1.72 ± 1.21 / 34.96 ± 1.12	27.27 ± 3.03 / 31.25 ± 3.24	45.57 ± 0.97 / 9.20 ± 0.68	0.69 ± 0.65 / 22.10 ± 0.54	0.68 ± 0.79 / 25.25 ± 0.76	13.43 ± 1.36 / 13.81 ± 1.45	3.82 ± 2.09 / 24.09 ± 2.81	1.14 ± 1.52 / 36.93 ± 3.69	3.71 ± 1.14 / 16.21 ± 2.86	51.93 ± 3.96 / 8.48 ± 0.87	0.95 ± 1.48 / 22.52 ± 1.05	2.90 ± 2.91 / 56.72 ± 0.69	28.14 ± 2.42 / 28.12 ± 2.55	-0.56 ± 5.13 / 23.83 ± 3.35	-0.06 ± 0.67 / 33.85 ± 0.68	2.43 ± 0.73 / 6.05 ± 0.59	19.94 ± 0.96 / 18.01 ± 0.59	19.64 ± 5.59 / 36.97 ± 5.41	0.00 ± 0.00 / 33.32 ± 0.30	8.78 ± 1.33 / 20.50 ± 1.50	57.06 ± 3.46 / 11.78 ± 1.69	0.32 ± 0.94 / 22.52 ± 0.61	-0.65 ± 0.72 / 24.04 ± 0.46	20.95 ± 2.02 / 25.63 ± 1.96	6.84 ± 1.76 / 27.74 ± 5.49	-1.50 ± 1.30 / 34.07 ± 0.45	22.67 ± 1.77 / 30.14 ± 1.68	53.89 ± 2.61 / 10.53 ± 0.37	-0.45 ± 1.59 / 24.24 ± 0.79	-0.31 ± 1.39 / 23.58 ± 0.40	31.14 ± 1.79 / 28.54 ± 0.86	43.97 ± 5.28 / 55.08 ± 4.26	3.49 ± 2.49 / 46.52 ± 4.13	47.91 ± 4.97 / 60.41 ± 3.91	62.20 ± 1.04 / 17.61 ± 0.50	0.12 ± 1.55 / 23.00 ± 0.82	0.13 ± 1.34 / 24.53 ± 0.49	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.1.2	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.1.2	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
PleIAs/Pleias-Nano (few-shot)	1195	66	2048	True	2,519 ± 841 / 323 ± 104	3.97	3.52	4.06	3.85	4.12	4.34	4.10	3.97	3.80	16.17 ± 3.44 / 14.33 ± 1.92	29.12 ± 4.09 / 49.93 ± 4.45	-0.47 ± 0.62 / 33.18 ± 0.28	34.80 ± 1.08 / 41.23 ± 1.18	59.04 ± 1.20 / 11.45 ± 0.63	-0.22 ± 1.00 / 25.05 ± 0.76	6.94 ± 2.90 / 38.44 ± 2.00	0.52 ± 0.76 / 25.53 ± 0.44	27.47 ± 4.87 / 27.10 ± 3.15	23.82 ± 4.37 / 27.33 ± 3.71	22.22 ± 1.30 / 32.60 ± 1.49	49.84 ± 3.33 / 6.70 ± 0.85	-2.06 ± 1.97 / 35.29 ± 1.70	-0.77 ± 1.41 / 35.74 ± 1.76	2.48 ± 1.20 / 5.33 ± 1.94	0.39 ± 1.55 / 24.22 ± 1.11	-1.07 ± 0.92 / 24.48 ± 0.46	14.09 ± 5.11 / 15.95 ± 3.72	23.71 ± 6.92 / 32.87 ± 7.00	1.74 ± 1.73 / 38.94 ± 3.25	32.00 ± 1.48 / 37.80 ± 1.63	28.30 ± 11.29 / 5.98 ± 2.41	0.94 ± 1.13 / 23.75 ± 1.20	-0.48 ± 1.44 / 24.60 ± 0.90	9.90 ± 5.26 / 15.24 ± 2.90	2.13 ± 2.07 / 21.55 ± 2.63	0.02 ± 1.43 / 34.31 ± 2.24	10.64 ± 2.56 / 31.31 ± 1.47	54.83 ± 2.32 / 11.29 ± 0.66	-0.56 ± 1.92 / 23.31 ± 1.19	1.21 ± 2.27 / 53.67 ± 2.22	20.76 ± 6.32 / 22.79 ± 5.85	-1.78 ± 2.38 / 16.36 ± 2.94	0.87 ± 1.94 / 34.86 ± 1.71	3.58 ± 2.75 / 6.25 ± 4.69	24.32 ± 2.91 / 22.08 ± 1.97	15.58 ± 3.73 / 29.45 ± 4.32	1.25 ± 1.70 / 37.57 ± 3.82	6.82 ± 2.39 / 20.51 ± 3.06	44.90 ± 8.88 / 8.06 ± 1.63	-0.19 ± 1.08 / 24.99 ± 1.08	1.18 ± 0.93 / 26.03 ± 0.59	23.58 ± 4.08 / 26.01 ± 4.43	7.90 ± 3.56 / 33.04 ± 3.49	1.79 ± 1.38 / 40.53 ± 3.24	26.11 ± 2.05 / 35.07 ± 1.64	53.77 ± 3.32 / 10.12 ± 0.52	-0.41 ± 0.68 / 24.81 ± 0.50	-0.45 ± 0.84 / 25.39 ± 0.66	21.60 ± 4.23 / 23.22 ± 3.33	45.04 ± 5.19 / 50.60 ± 4.14	-0.46 ± 1.47 / 44.56 ± 3.38	33.46 ± 2.84 / 44.25 ± 3.38	49.12 ± 7.39 / 12.74 ± 2.01	2.37 ± 0.75 / 27.67 ± 0.77	-0.33 ± 1.21 / 25.00 ± 1.15	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
HuggingFaceTB/SmolLM2-360M-Instruct (few-shot)	362	49	8192	True	21,777 ± 6,115 / 3,617 ± 1,211	4.05	3.99	4.26	3.97	4.29	4.20	4.07	4.25	3.34	8.97 ± 3.18 / 8.62 ± 2.72	2.66 ± 2.70 / 16.29 ± 2.34	1.65 ± 1.38 / 44.50 ± 3.21	24.92 ± 1.68 / 28.73 ± 1.90	55.39 ± 0.68 / 10.01 ± 0.63	0.28 ± 0.93 / 23.92 ± 0.72	3.55 ± 3.45 / 35.45 ± 1.54	-0.41 ± 1.41 / 25.02 ± 0.71	20.37 ± 5.55 / 21.57 ± 3.57	21.27 ± 5.10 / 22.34 ± 4.41	7.60 ± 2.24 / 26.47 ± 2.89	49.27 ± 1.15 / 7.39 ± 0.36	1.31 ± 1.92 / 45.75 ± 3.36	0.51 ± 1.81 / 38.71 ± 2.95	4.80 ± 1.18 / 10.53 ± 2.12	-0.90 ± 0.97 / 21.85 ± 0.55	-1.00 ± 0.70 / 24.21 ± 0.55	13.64 ± 5.84 / 16.38 ± 4.06	9.34 ± 6.26 / 26.00 ± 3.56	2.20 ± 1.59 / 41.62 ± 3.37	26.06 ± 2.35 / 30.05 ± 2.29	37.49 ± 0.77 / 9.36 ± 0.25	-0.00 ± 0.96 / 22.03 ± 0.45	0.78 ± 1.51 / 25.50 ± 0.87	13.60 ± 1.50 / 13.99 ± 1.39	3.12 ± 4.92 / 27.55 ± 4.21	0.28 ± 1.41 / 37.58 ± 4.34	4.09 ± 1.03 / 16.34 ± 2.86	50.00 ± 3.22 / 7.84 ± 0.71	-0.11 ± 0.95 / 22.28 ± 0.83	2.51 ± 3.01 / 51.41 ± 3.27	26.85 ± 3.99 / 27.35 ± 3.60	3.07 ± 2.88 / 28.68 ± 2.63	-0.12 ± 1.62 / 45.84 ± 3.59	1.39 ± 0.54 / 4.02 ± 0.64	18.77 ± 3.96 / 18.65 ± 3.26	12.59 ± 3.85 / 22.64 ± 2.25	1.64 ± 1.30 / 34.84 ± 2.12	9.27 ± 1.07 / 21.58 ± 1.37	46.31 ± 1.46 / 8.68 ± 0.61	0.84 ± 0.81 / 22.50 ± 0.61	0.01 ± 1.07 / 24.43 ± 0.50	15.68 ± 5.54 / 22.21 ± 5.42	6.73 ± 2.20 / 27.67 ± 4.00	0.63 ± 1.05 / 43.48 ± 2.98	19.73 ± 1.42 / 27.47 ± 1.35	50.53 ± 2.03 / 9.14 ± 0.47	1.30 ± 0.75 / 24.43 ± 0.78	-0.36 ± 0.85 / 24.09 ± 0.49	30.73 ± 4.30 / 29.47 ± 4.10	59.51 ± 3.73 / 54.82 ± 2.43	1.55 ± 1.90 / 43.18 ± 5.08	49.03 ± 1.47 / 60.00 ± 1.53	57.73 ± 4.93 / 15.68 ± 1.21	0.11 ± 1.23 / 23.20 ± 0.56	-0.06 ± 0.39 / 24.60 ± 0.44	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
HuggingFaceTB/SmolLM2-135M (few-shot)	135	49	8192	True	26,346 ± 7,812 / 4,082 ± 1,372	4.19	4.20	4.09	3.93	4.23	4.31	4.22	4.52	4.03	13.72 ± 1.83 / 13.41 ± 1.52	3.79 ± 3.11 / 21.06 ± 4.74	-0.45 ± 0.70 / 39.69 ± 4.95	14.69 ± 2.86 / 17.28 ± 3.01	47.44 ± 1.55 / 6.04 ± 0.58	-0.58 ± 2.44 / 25.72 ± 1.40	10.99 ± 5.42 / 38.26 ± 1.92	-0.51 ± 1.30 / 24.79 ± 0.70	24.37 ± 2.17 / 26.91 ± 2.28	24.69 ± 1.85 / 27.60 ± 2.48	8.84 ± 4.19 / 29.74 ± 3.45	53.61 ± 2.33 / 6.64 ± 0.79	-1.20 ± 1.10 / 36.09 ± 3.06	-0.50 ± 1.21 / 36.68 ± 3.16	0.16 ± 0.13 / 2.31 ± 0.44	-0.81 ± 0.69 / 24.67 ± 1.24	-0.71 ± 1.01 / 24.42 ± 0.63	19.15 ± 1.75 / 20.52 ± 1.77	-3.03 ± 7.40 / 24.39 ± 3.87	0.06 ± 1.12 / 36.05 ± 2.59	14.18 ± 3.82 / 16.55 ± 4.25	51.51 ± 1.96 / 11.46 ± 0.73	0.02 ± 1.30 / 25.25 ± 0.94	0.04 ± 0.79 / 24.92 ± 0.73	14.74 ± 2.42 / 16.01 ± 2.04	3.13 ± 3.12 / 22.51 ± 2.62	-0.25 ± 0.60 / 34.69 ± 3.02	1.35 ± 0.73 / 10.92 ± 2.52	52.66 ± 3.89 / 8.73 ± 0.71	1.21 ± 0.80 / 26.20 ± 1.03	1.69 ± 2.26 / 49.46 ± 3.56	25.51 ± 2.40 / 26.43 ± 1.77	-0.24 ± 2.92 / 26.18 ± 4.52	0.46 ± 1.43 / 36.19 ± 3.30	0.15 ± 0.20 / 3.01 ± 0.44	16.89 ± 1.62 / 16.63 ± 1.80	2.74 ± 3.46 / 23.30 ± 3.11	-0.34 ± 1.06 / 39.21 ± 4.13	0.28 ± 0.27 / 2.91 ± 0.92	54.79 ± 2.10 / 8.47 ± 1.10	-0.32 ± 0.88 / 25.45 ± 0.97	0.18 ± 0.99 / 25.72 ± 0.91	17.49 ± 2.94 / 18.59 ± 2.66	2.01 ± 1.88 / 15.88 ± 1.32	-0.02 ± 0.15 / 34.86 ± 2.12	0.53 ± 0.36 / 3.23 ± 0.51	52.46 ± 1.93 / 9.47 ± 0.33	0.33 ± 0.71 / 25.12 ± 0.63	-0.10 ± 0.85 / 24.87 ± 0.65	31.26 ± 3.84 / 30.44 ± 3.28	26.69 ± 10.82 / 34.46 ± 8.00	1.78 ± 1.67 / 43.50 ± 3.99	13.88 ± 1.36 / 22.49 ± 2.14	52.05 ± 1.59 / 12.74 ± 1.04	1.51 ± 0.81 / 25.05 ± 0.75	-0.76 ± 0.97 / 24.52 ± 0.59	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.1.2	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	14.1.2	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
PleIAs/Pleias-350m-Preview (few-shot)	353	66	2048	True	10,242 ± 3,432 / 1,335 ± 484	4.22	4.13	4.30	4.12	4.23	4.24	4.15	4.53	4.08	13.84 ± 1.95 / 13.12 ± 1.60	9.47 ± 3.30 / 25.66 ± 3.36	-0.36 ± 1.60 / 39.52 ± 3.19	22.10 ± 2.03 / 26.85 ± 2.16	45.28 ± 4.20 / 6.64 ± 0.74	-0.27 ± 1.66 / 25.68 ± 1.51	2.54 ± 3.58 / 36.82 ± 2.34	-0.66 ± 0.98 / 24.57 ± 0.57	26.59 ± 2.14 / 26.61 ± 2.49	26.78 ± 1.46 / 26.94 ± 1.92	7.91 ± 2.20 / 17.44 ± 3.42	45.83 ± 1.92 / 5.61 ± 0.51	0.28 ± 1.08 / 36.00 ± 3.05	0.04 ± 1.65 / 41.17 ± 5.30	0.65 ± 0.40 / 2.88 ± 1.01	0.57 ± 1.71 / 24.14 ± 1.57	-0.66 ± 0.78 / 24.58 ± 0.58	22.09 ± 2.91 / 21.86 ± 2.85	14.15 ± 7.21 / 25.90 ± 4.05	-0.04 ± 1.25 / 36.18 ± 3.31	21.60 ± 1.52 / 26.25 ± 1.48	27.08 ± 10.78 / 5.28 ± 2.27	-0.65 ± 0.97 / 22.89 ± 0.69	0.48 ± 0.88 / 25.21 ± 0.51	17.73 ± 1.58 / 18.22 ± 1.53	2.38 ± 2.00 / 21.79 ± 2.03	-0.18 ± 1.21 / 37.94 ± 4.17	1.59 ± 0.83 / 12.57 ± 3.10	52.81 ± 2.78 / 8.12 ± 0.57	0.89 ± 1.75 / 25.64 ± 1.59	-1.11 ± 3.80 / 55.19 ± 1.68	31.99 ± 3.53 / 32.31 ± 3.75	0.00 ± 0.00 / 13.57 ± 0.43	0.48 ± 1.60 / 37.69 ± 4.37	0.29 ± 0.29 / 0.89 ± 0.74	25.30 ± 2.32 / 24.21 ± 2.13	13.90 ± 5.43 / 30.42 ± 6.17	-0.25 ± 1.90 / 39.25 ± 4.50	6.12 ± 0.63 / 15.65 ± 1.66	41.90 ± 7.85 / 7.52 ± 1.26	-1.81 ± 1.16 / 22.39 ± 0.62	0.00 ± 0.84 / 24.71 ± 0.61	24.47 ± 2.03 / 26.64 ± 2.70	3.57 ± 2.03 / 16.42 ± 3.18	-2.03 ± 1.35 / 39.46 ± 4.09	10.18 ± 1.78 / 17.17 ± 2.17	44.43 ± 2.69 / 7.67 ± 0.47	-0.11 ± 1.20 / 24.70 ± 0.92	-0.01 ± 1.24 / 24.56 ± 0.75	31.79 ± 3.88 / 31.32 ± 2.81	19.13 ± 9.92 / 33.51 ± 6.97	-0.03 ± 1.07 / 36.37 ± 2.34	12.35 ± 1.80 / 21.93 ± 1.63	46.13 ± 6.88 / 11.20 ± 1.59	-1.20 ± 0.68 / 23.43 ± 0.94	0.47 ± 1.47 / 25.42 ± 1.15	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
HuggingFaceTB/SmolLM2-135M-Instruct (few-shot)	135	49	8192	True	25,602 ± 7,583 / 3,953 ± 1,325	4.23	4.02	4.21	4.12	4.32	4.31	4.31	4.55	3.97	12.11 ± 1.07 / 11.48 ± 1.07	2.61 ± 3.22 / 18.95 ± 3.93	0.25 ± 1.87 / 39.65 ± 4.00	14.02 ± 2.56 / 16.74 ± 2.74	56.53 ± 0.95 / 8.45 ± 0.77	1.05 ± 1.51 / 26.37 ± 0.83	10.81 ± 4.60 / 38.73 ± 1.77	-0.50 ± 0.85 / 24.15 ± 0.67	20.89 ± 2.55 / 22.28 ± 2.32	19.62 ± 1.91 / 21.82 ± 2.35	2.78 ± 4.25 / 26.17 ± 3.37	53.93 ± 2.39 / 6.60 ± 0.99	-0.98 ± 1.80 / 40.63 ± 4.03	0.93 ± 2.26 / 40.91 ± 4.95	0.15 ± 0.13 / 2.19 ± 0.57	-0.48 ± 1.78 / 25.53 ± 1.87	-0.53 ± 0.95 / 24.68 ± 0.62	17.09 ± 2.33 / 18.78 ± 2.11	7.41 ± 9.32 / 28.42 ± 3.18	0.47 ± 1.48 / 38.19 ± 3.61	11.73 ± 3.22 / 13.94 ± 3.48	38.30 ± 1.88 / 8.09 ± 0.47	0.30 ± 0.87 / 25.76 ± 0.77	0.06 ± 1.19 / 24.33 ± 0.53	13.70 ± 2.05 / 15.01 ± 2.07	3.01 ± 2.55 / 22.58 ± 2.22	-0.83 ± 0.71 / 32.99 ± 0.27	0.94 ± 0.54 / 10.22 ± 2.52	50.30 ± 4.32 / 7.82 ± 0.77	1.10 ± 1.16 / 25.43 ± 1.07	-0.07 ± 3.01 / 46.28 ± 3.42	23.22 ± 3.22 / 24.30 ± 2.81	3.78 ± 2.95 / 27.36 ± 2.62	0.41 ± 2.39 / 39.64 ± 3.47	0.54 ± 0.33 / 3.34 ± 0.61	15.54 ± 1.74 / 15.29 ± 1.88	2.51 ± 1.90 / 21.27 ± 3.22	0.36 ± 1.07 / 39.04 ± 3.21	1.77 ± 0.67 / 5.69 ± 0.96	49.41 ± 1.73 / 7.27 ± 0.41	-1.46 ± 0.84 / 24.84 ± 0.68	-0.18 ± 1.25 / 24.79 ± 1.02	15.82 ± 3.13 / 16.46 ± 2.61	-0.62 ± 1.55 / 16.18 ± 1.88	1.16 ± 1.38 / 34.30 ± 1.27	3.25 ± 1.17 / 5.89 ± 0.97	54.82 ± 3.44 / 9.74 ± 0.58	1.36 ± 1.10 / 25.96 ± 0.81	0.34 ± 1.33 / 25.40 ± 0.83	29.96 ± 3.19 / 28.98 ± 3.29	18.64 ± 8.52 / 28.83 ± 5.86	1.85 ± 1.20 / 44.03 ± 3.98	26.90 ± 1.56 / 36.91 ± 1.53	52.96 ± 1.38 / 14.23 ± 0.78	1.34 ± 0.74 / 25.67 ± 1.03	0.10 ± 1.29 / 24.71 ± 0.69	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.3.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0	13.1.0
PleIAs/Pleias-Pico (few-shot)	353	66	2048	True	2,331 ± 787 / 301 ± 97	4.26	3.99	4.42	4.19	4.47	4.38	4.16	4.31	4.20	10.59 ± 2.24 / 10.29 ± 1.37	13.31 ± 3.23 / 34.38 ± 3.13	0.52 ± 0.78 / 33.76 ± 0.37	16.61 ± 2.60 / 20.46 ± 2.96	53.52 ± 1.40 / 7.67 ± 0.60	0.89 ± 2.10 / 26.06 ± 1.57	4.30 ± 2.48 / 37.38 ± 1.67	-0.01 ± 1.18 / 25.21 ± 0.79	25.02 ± 2.09 / 25.54 ± 2.29	21.59 ± 3.84 / 21.51 ± 4.17	8.05 ± 2.35 / 22.59 ± 2.42	43.81 ± 1.95 / 4.91 ± 0.42	-0.15 ± 1.40 / 36.65 ± 4.39	-0.97 ± 1.78 / 39.00 ± 3.45	0.37 ± 0.29 / 2.47 ± 0.84	-0.31 ± 1.64 / 23.54 ± 1.29	-0.61 ± 0.97 / 25.08 ± 0.47	16.28 ± 4.73 / 16.34 ± 4.84	17.38 ± 10.26 / 34.60 ± 5.85	-0.45 ± 0.67 / 36.19 ± 2.92	17.78 ± 2.45 / 22.13 ± 2.29	27.12 ± 10.70 / 5.04 ± 2.19	-1.38 ± 1.03 / 22.26 ± 0.54	0.94 ± 1.07 / 25.20 ± 0.63	13.80 ± 3.19 / 14.46 ± 3.19	2.17 ± 2.73 / 22.31 ± 3.55	-0.63 ± 0.78 / 36.66 ± 3.41	1.29 ± 0.69 / 10.96 ± 2.80	43.40 ± 4.76 / 4.83 ± 1.49	1.16 ± 0.83 / 25.72 ± 0.93	1.21 ± 4.89 / 55.31 ± 1.38	22.55 ± 5.84 / 22.62 ± 6.04	0.67 ± 1.52 / 13.76 ± 0.51	0.87 ± 1.83 / 38.38 ± 4.75	0.27 ± 0.26 / 0.91 ± 0.72	21.03 ± 2.96 / 21.02 ± 2.73	10.99 ± 6.72 / 27.88 ± 6.96	0.13 ± 1.96 / 36.48 ± 3.10	3.61 ± 0.37 / 11.45 ± 1.56	43.73 ± 8.31 / 7.34 ± 1.49	-0.77 ± 0.77 / 22.86 ± 0.58	0.11 ± 0.91 / 24.98 ± 0.79	21.32 ± 2.14 / 22.20 ± 2.65	4.37 ± 2.16 / 18.06 ± 2.83	-0.19 ± 1.24 / 41.66 ± 3.35	9.38 ± 1.20 / 15.78 ± 1.26	50.94 ± 2.76 / 7.92 ± 0.87	0.33 ± 1.58 / 24.74 ± 1.23	-0.81 ± 0.69 / 24.22 ± 0.67	27.45 ± 4.13 / 27.11 ± 3.47	27.39 ± 8.29 / 39.38 ± 6.65	0.31 ± 1.47 / 39.37 ± 3.75	15.62 ± 2.29 / 26.76 ± 1.43	43.83 ± 6.89 / 8.96 ± 1.14	0.65 ± 0.70 / 24.30 ± 0.79	-0.44 ± 1.22 / 24.71 ± 0.98	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4	14.0.4	14.1.2	14.1.2	14.0.4	14.0.4	14.0.4	14.0.4
ssmits/Falcon2-5.5B-multilingual (few-shot)	5465	65	8192	True	7,692 ± 1,423 / 1,960 ± 644	4.72	4.67	4.67	4.42	4.80	4.70	4.70	4.96	4.81	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 18.12 ± 0.19	0.00 ± 0.00 / 33.25 ± 0.23	0.02 ± 0.02 / 0.03 ± 0.03	42.82 ± 0.93 / 0.20 ± 0.02	4.55 ± 2.15 / 25.74 ± 1.15	-1.17 ± 3.12 / 34.84 ± 1.63	-1.26 ± 1.34 / 24.88 ± 0.69	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 9.59 ± 0.29	41.98 ± 0.64 / 0.21 ± 0.04	0.00 ± 0.00 / 33.25 ± 0.30	0.00 ± 0.00 / 32.79 ± 0.34	0.00 ± 0.00 / 0.09 ± 0.03	1.14 ± 1.04 / 24.51 ± 0.78	0.64 ± 1.18 / 24.68 ± 0.55	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 19.16 ± 0.14	0.00 ± 0.00 / 33.30 ± 0.27	0.00 ± 0.00 / 0.00 ± 0.00	40.82 ± 1.17 / 0.34 ± 0.05	1.19 ± 1.32 / 24.74 ± 1.06	1.55 ± 0.84 / 25.30 ± 0.69	0.00 ± 0.00 / 0.00 ± 0.00	-1.30 ± 1.45 / 18.79 ± 0.29	0.00 ± 0.00 / 33.69 ± 0.28	0.00 ± 0.00 / 0.02 ± 0.01	36.58 ± 2.96 / 0.16 ± 0.02	-0.00 ± 1.73 / 24.71 ± 1.42	0.00 ± 0.00 / 43.48 ± 0.89	0.00 ± 0.00 / 0.00 ± 0.00	0.74 ± 1.78 / 13.97 ± 0.80	0.00 ± 0.00 / 33.40 ± 0.34	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 17.05 ± 0.35	0.00 ± 0.00 / 33.34 ± 0.31	0.00 ± 0.00 / 0.02 ± 0.01	37.66 ± 0.76 / 0.15 ± 0.02	0.87 ± 0.51 / 24.67 ± 0.61	1.95 ± 1.33 / 25.62 ± 0.89	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 8.62 ± 0.30	0.00 ± 0.00 / 33.34 ± 0.31	0.00 ± 0.00 / 0.01 ± 0.00	43.74 ± 0.57 / 0.22 ± 0.04	0.32 ± 0.67 / 24.79 ± 0.61	1.73 ± 1.07 / 26.61 ± 0.61	0.00 ± 0.00 / 0.00 ± 0.00	0.00 ± 0.00 / 19.61 ± 0.22	2.48 ± 1.94 / 34.52 ± 0.85	0.01 ± 0.02 / 0.03 ± 0.02	44.80 ± 0.36 / 0.32 ± 0.04	-0.69 ± 0.77 / 22.76 ± 0.40	0.37 ± 0.95 / 24.71 ± 0.44	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	14.1.2	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0	13.0.0

Download as CSV   •