ZAZUMODELSBLOG

Model library · GPT-4.1 mini · 2026-10-28

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop24$0.026Transcript →
10passuser_stop27$0.029Transcript →
100passuser_stop24$0.019Transcript →
1000failuser_stop42$0.050Transcript →
1010failuser_stop44$0.052Transcript →
1020failuser_stop33$0.033Transcript →
1030passuser_stop60$0.079Transcript →
1040passuser_stop62$0.088Transcript →
1050failuser_stop56$0.083Transcript →
1060passuser_stop38$0.038Transcript →
1070passuser_stop29$0.031Transcript →
1080passuser_stop26$0.024Transcript →
1090failuser_stop36$0.040Transcript →
110passuser_stop27$0.022Transcript →
1100failuser_stop30$0.028Transcript →
1110failuser_stop34$0.041Transcript →
1120failuser_stop32$0.032Transcript →
1130passuser_stop24$0.019Transcript →
120passuser_stop25$0.023Transcript →
130passuser_stop27$0.023Transcript →
140passuser_stop25$0.020Transcript →
150passuser_stop28$0.027Transcript →
160passuser_stop24$0.020Transcript →
170passuser_stop16$0.012Transcript →
180failuser_stop33$0.032Transcript →
190passuser_stop36$0.046Transcript →
20failuser_stop30$0.028Transcript →
200failuser_stop35$0.039Transcript →
210passuser_stop32$0.030Transcript →
220failuser_stop27$0.022Transcript →
230passuser_stop37$0.039Transcript →
240passuser_stop27$0.023Transcript →
250passuser_stop23$0.019Transcript →
260passuser_stop19$0.014Transcript →
270failuser_stop35$0.040Transcript →
280failuser_stop47$0.057Transcript →
290failuser_stop36$0.045Transcript →
30failuser_stop32$0.036Transcript →
300passuser_stop50$0.058Transcript →
310failuser_stop83$0.117Transcript →
320failuser_stop31$0.026Transcript →
330passuser_stop28$0.026Transcript →
340failuser_stop34$0.034Transcript →
350passuser_stop39$0.043Transcript →
360passuser_stop42$0.052Transcript →
370failuser_stop37$0.038Transcript →
380failuser_stop52$0.086Transcript →
390failuser_stop28$0.027Transcript →
40failuser_stop29$0.027Transcript →
400passuser_stop20$0.016Transcript →
Page 1 of 3Next →