ZAZUMODELSBLOG

Model library · Grok 4.20 · 2026-10-27

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop23$0.093Transcript →
10passuser_stop23$0.093Transcript →
100failuser_stop37$0.139Transcript →
1000passuser_stop54$0.260Transcript →
1010passuser_stop52$0.236Transcript →
1020passuser_stop48$0.217Transcript →
1030passuser_stop57$0.287Transcript →
1040passuser_stop66$0.359Transcript →
1050failuser_stop39$0.181Transcript →
1060passuser_stop36$0.138Transcript →
1070passuser_stop45$0.219Transcript →
1080passuser_stop32$0.123Transcript →
1090passuser_stop38$0.156Transcript →
110passuser_stop45$0.181Transcript →
1100passuser_stop41$0.172Transcript →
1110passuser_stop45$0.228Transcript →
1120passuser_stop45$0.190Transcript →
1130passuser_stop40$0.156Transcript →
120passuser_stop26$0.088Transcript →
130passuser_stop32$0.118Transcript →
140passuser_stop29$0.101Transcript →
150passuser_stop32$0.125Transcript →
160passuser_stop32$0.124Transcript →
170passuser_stop18$0.053Transcript →
180passuser_stop33$0.125Transcript →
190failuser_stop45$0.212Transcript →
20passuser_stop37$0.162Transcript →
200passuser_stop90$0.784Transcript →
210passuser_stop47$0.212Transcript →
220failuser_stop38$0.150Transcript →
230passuser_stop50$0.262Transcript →
240passuser_stop39$0.162Transcript →
250passuser_stop26$0.091Transcript →
260passuser_stop30$0.106Transcript →
270passuser_stop38$0.162Transcript →
280passuser_stop42$0.187Transcript →
290passuser_stop35$0.144Transcript →
30passuser_stop48$0.227Transcript →
300passuser_stop49$0.195Transcript →
310passuser_stop52$0.216Transcript →
320failuser_stop70$0.363Transcript →
330passuser_stop24$0.075Transcript →
340passuser_stop24$0.082Transcript →
350passuser_stop37$0.154Transcript →
360passuser_stop37$0.147Transcript →
370passuser_stop39$0.158Transcript →
380passuser_stop43$0.176Transcript →
390failuser_stop32$0.140Transcript →
40passuser_stop35$0.141Transcript →
400passuser_stop22$0.069Transcript →
Page 1 of 3Next →