ZAZUMODELSBLOG

Model library · Mistral NeMo 12B · 2026-11-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
410failuser_stop60$0.006Transcript →
420failuser_stop61$0.006Transcript →
430failtoo_many_errors68$0.006Transcript →
440passuser_stop20$0.001Transcript →
450failtoo_many_errors75$0.008Transcript →
460passuser_stop40$0.004Transcript →
470passuser_stop32$0.002Transcript →
480passuser_stop50$0.004Transcript →
490passuser_stop50$0.004Transcript →
50failuser_stop57$0.006Transcript →
500passuser_stop30$0.002Transcript →
510failuser_stop52$0.004Transcript →
520failtoo_many_errors64$0.006Transcript →
530failuser_stop42$0.003Transcript →
540failtoo_many_errors76$0.007Transcript →
550failuser_stop34$0.003Transcript →
560failuser_stop57$0.005Transcript →
570failtoo_many_errors43$0.003Transcript →
580failtoo_many_errors50$0.003Transcript →
590failuser_stop24$0.002Transcript →
60failtoo_many_errors47$0.003Transcript →
600failuser_stop78$0.008Transcript →
610failuser_stop71$0.008Transcript →
620failtoo_many_errors42$0.003Transcript →
630failuser_stop60$0.006Transcript →
640failuser_stop46$0.003Transcript →
650failtoo_many_errors101$0.014Transcript →
660failuser_stop84$0.011Transcript →
670passuser_stop36$0.003Transcript →
680passuser_stop34$0.003Transcript →
690failuser_stop24$0.002Transcript →
70failtoo_many_errors60$0.005Transcript →
700failuser_stop43$0.003Transcript →
710failuser_stop92$0.011Transcript →
720failtoo_many_errors28$0.002Transcript →
730failtoo_many_errors51$0.004Transcript →
740failtoo_many_errors30$0.002Transcript →
750passuser_stop33$0.003Transcript →
760failuser_stop28$0.002Transcript →
770passuser_stop30$0.002Transcript →
780passuser_stop54$0.005Transcript →
790failtoo_many_errors46$0.004Transcript →
80failtoo_many_errors39$0.002Transcript →
800passuser_stop20$0.002Transcript →
810failuser_stop48$0.004Transcript →
820failuser_stop30$0.002Transcript →
830passuser_stop33$0.002Transcript →
840failtoo_many_errors72$0.007Transcript →
850failtoo_many_errors39$0.002Transcript →
860failtoo_many_errors62$0.004Transcript →