ZAZUMODELSBLOG

Model library · Mistral NeMo 12B · 2026-11-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop59$0.007Transcript →
10passuser_stop17$0.001Transcript →
100failtoo_many_errors39$0.002Transcript →
1000failtoo_many_errors75$0.005Transcript →
1010failtoo_many_errors70$0.005Transcript →
1020failtoo_many_errors74$0.006Transcript →
1030failtoo_many_errors78$0.007Transcript →
1040failuser_stop34$0.002Transcript →
1050failuser_stop41$0.004Transcript →
1060failuser_stop43$0.003Transcript →
1070failuser_stop42$0.003Transcript →
1080failtoo_many_errors56$0.003Transcript →
1090failuser_stop101$0.013Transcript →
110failtoo_many_errors40$0.002Transcript →
1100failuser_stop35$0.003Transcript →
1110passuser_stop38$0.003Transcript →
1120failtoo_many_errors68$0.005Transcript →
1130failuser_stop28$0.001Transcript →
120failuser_stop34$0.002Transcript →
130failuser_stop46$0.003Transcript →
140failtoo_many_errors32$0.002Transcript →
150failuser_stop39$0.003Transcript →
160failuser_stop40$0.003Transcript →
170passuser_stop24$0.002Transcript →
180failuser_stop32$0.002Transcript →
190failtoo_many_errors46$0.003Transcript →
20failuser_stop36$0.003Transcript →
200failuser_stop151$0.019Transcript →
210failtoo_many_errors74$0.007Transcript →
220failuser_stop44$0.003Transcript →
230failtoo_many_errors81$0.006Transcript →
240passuser_stop53$0.004Transcript →
250passuser_stop38$0.002Transcript →
260passuser_stop57$0.005Transcript →
270failtoo_many_errors58$0.003Transcript →
280failuser_stop53$0.004Transcript →
290failtoo_many_errors69$0.007Transcript →
30failuser_stop35$0.002Transcript →
300failuser_stop6$0.000Transcript →
310failuser_stop91$0.010Transcript →
320failtoo_many_errors110$0.013Transcript →
330failuser_stop30$0.002Transcript →
340failuser_stop84$0.010Transcript →
350failuser_stop51$0.005Transcript →
360failuser_stop60$0.005Transcript →
370failtoo_many_errors70$0.006Transcript →
380failtoo_many_errors52$0.003Transcript →
390failtoo_many_errors53$0.005Transcript →
40failuser_stop38$0.003Transcript →
400passuser_stop37$0.002Transcript →
Page 1 of 3Next →