DFM-Mimir-v1.5 / comparison_macro_averages.csv
peter-sk's picture
Add completed Ouro 1.4B and 2.6B benchmark comparisons
521b40b verified
Raw History Blame Contribute Delete
1.29 kB
model,English,Math/Code,Danish
Mimir-2850K,77.80660975659963,71.11563182258054,62.97261975652402
Mimir-1650K,68.9650039377685,64.14130685355374,57.035111127408825
Qwen3.5-0.8B,50.64696385659728,38.59197741575596,30.887131406593525
Qwen3.5-2B,58.66609059044379,58.97105555452825,32.73121462552333
Qwen3.5-4B,69.26109759303107,65.02305318762058,49.823394609268526
Qwen3.5-9B,77.05400488468159,85.83726412593921,53.053378634996164
Gemma-4-E2B,52.78615319483545,75.4416586845171,44.432706066784405
Gemma-4-E4B,54.89259286806845,82.85323545183898,53.58009604944023
Gemma-4-E4B-thinking,72.25952457735038,82.17406448590641,54.52621177814698
Gemma-3-1B,37.44421641519764,43.187253092697716,34.00180249659065
OLMo-2-1B,42.81713873193756,31.35227081368615,25.722888329168775
SmolLM3-3B,63.07699902723909,67.93006761712803,28.816229975105003
EuroLLM-9B,60.61038405367872,17.297073170731707,45.73833917773132
Apertus-8B,61.631183451723984,44.10703748220197,46.520369456632864
Ministral-3-8B,71.34070074726007,76.23670161553775,42.23503478769814
Munin-Apertus-8B,,,44.35326568631533
Munin-Mistral-8B,,,42.13241394734135
Munin-Qwen-9B,,,44.79791433886715
Ouro-1.4B,60.678463981148056,56.63173776635417,24.798753642496514
Ouro-2.6B,70.2257023084669,60.8018983339189,25.392804181009986