ZAZUMODELSBLOG

Model library · GPT-4.1 mini · 2026-10-28

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
410failuser_stop33$0.033Transcript →
420failuser_stop35$0.037Transcript →
430passuser_stop23$0.020Transcript →
440passuser_stop18$0.015Transcript →
450passuser_stop32$0.033Transcript →
460passuser_stop28$0.024Transcript →
470passuser_stop38$0.036Transcript →
480passuser_stop26$0.024Transcript →
490passuser_stop24$0.020Transcript →
50passuser_stop32$0.033Transcript →
500passuser_stop20$0.016Transcript →
510passuser_stop26$0.023Transcript →
520passuser_stop29$0.027Transcript →
530failuser_stop57$0.072Transcript →
540failuser_stop49$0.058Transcript →
550passuser_stop37$0.037Transcript →
560failuser_stop26$0.024Transcript →
570failuser_stop20$0.016Transcript →
580passuser_stop34$0.039Transcript →
590failuser_stop39$0.042Transcript →
60passuser_stop34$0.036Transcript →
600passuser_stop20$0.019Transcript →
610failuser_stop24$0.023Transcript →
620passuser_stop28$0.026Transcript →
630failuser_stop42$0.046Transcript →
640failuser_stop28$0.025Transcript →
650passuser_stop18$0.014Transcript →
660passuser_stop25$0.021Transcript →
670failuser_stop20$0.015Transcript →
680passuser_stop18$0.013Transcript →
690passuser_stop28$0.024Transcript →
70passuser_stop32$0.030Transcript →
700passuser_stop27$0.025Transcript →
710failuser_stop29$0.029Transcript →
720passuser_stop37$0.037Transcript →
730passuser_stop21$0.017Transcript →
740failuser_stop34$0.035Transcript →
750passuser_stop20$0.018Transcript →
760passuser_stop34$0.035Transcript →
770passuser_stop24$0.021Transcript →
780passuser_stop28$0.028Transcript →
790failuser_stop34$0.036Transcript →
80passuser_stop36$0.036Transcript →
800passuser_stop17$0.013Transcript →
810passuser_stop33$0.030Transcript →
820passuser_stop33$0.031Transcript →
830passuser_stop29$0.025Transcript →
840passuser_stop33$0.031Transcript →
850passuser_stop36$0.034Transcript →
860passuser_stop35$0.033Transcript →