ZAZUMODELSBLOG

Model library · Grok 4.20 · 2026-10-27

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
100 simulations
TaskTrialResultEndedMessagesCost
470passuser_stop32$0.109Transcript →
480passuser_stop28$0.094Transcript →
490passuser_stop31$0.107Transcript →
50passuser_stop37$0.148Transcript →
500passuser_stop37$0.135Transcript →
510passuser_stop26$0.087Transcript →
520passuser_stop26$0.091Transcript →
530passuser_stop25$0.076Transcript →
540passuser_stop49$0.224Transcript →
550passuser_stop47$0.211Transcript →
560passuser_stop40$0.165Transcript →
580passuser_stop29$0.109Transcript →
60passuser_stop34$0.142Transcript →
600passuser_stop22$0.081Transcript →
610passuser_stop16$0.056Transcript →
620passuser_stop30$0.103Transcript →
630passuser_stop38$0.149Transcript →
650passuser_stop35$0.137Transcript →
660passuser_stop31$0.113Transcript →
670passuser_stop28$0.085Transcript →
680passuser_stop18$0.051Transcript →
690passuser_stop26$0.083Transcript →
70passuser_stop30$0.110Transcript →
700passuser_stop34$0.134Transcript →
710passuser_stop37$0.150Transcript →
720passuser_stop41$0.185Transcript →
730passuser_stop24$0.079Transcript →
740passuser_stop44$0.197Transcript →
750passuser_stop22$0.074Transcript →
770passuser_stop28$0.098Transcript →
780passuser_stop24$0.094Transcript →
790passuser_stop28$0.097Transcript →
810passuser_stop29$0.097Transcript →
820passuser_stop36$0.144Transcript →
830passuser_stop40$0.162Transcript →
840passuser_stop32$0.118Transcript →
850passuser_stop44$0.186Transcript →
860passuser_stop48$0.199Transcript →
870passuser_stop48$0.204Transcript →
880passuser_stop29$0.099Transcript →
890passuser_stop27$0.107Transcript →
90passuser_stop35$0.130Transcript →
900passuser_stop32$0.122Transcript →
920passuser_stop28$0.096Transcript →
930passuser_stop36$0.159Transcript →
940passuser_stop32$0.130Transcript →
950passuser_stop40$0.191Transcript →
960passuser_stop36$0.147Transcript →
970passuser_stop34$0.135Transcript →
990passuser_stop33$0.132Transcript →
← PreviousPage 2 of 2