ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-10-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
67 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop20$0.000Transcript →
10passuser_stop22$0.000Transcript →
100passuser_stop28$0.000Transcript →
1010passuser_stop46$0.000Transcript →
1020passuser_stop54$0.000Transcript →
110passuser_stop34$0.000Transcript →
1120passuser_stop46$0.000Transcript →
120passuser_stop23$0.000Transcript →
130passuser_stop41$0.000Transcript →
140passuser_stop23$0.000Transcript →
150passuser_stop26$0.000Transcript →
170passuser_stop16$0.000Transcript →
210passuser_stop27$0.000Transcript →
220passuser_stop26$0.000Transcript →
230passuser_stop53$0.000Transcript →
250passuser_stop25$0.000Transcript →
260passuser_stop26$0.000Transcript →
280passuser_stop56$0.000Transcript →
330passuser_stop26$0.000Transcript →
340passuser_stop22$0.000Transcript →
350passuser_stop35$0.000Transcript →
390passuser_stop26$0.000Transcript →
410passuser_stop24$0.000Transcript →
420passuser_stop31$0.000Transcript →
480passuser_stop24$0.000Transcript →
500passuser_stop14$0.000Transcript →
510passuser_stop22$0.000Transcript →
520passuser_stop32$0.000Transcript →
530passuser_stop27$0.000Transcript →
540passuser_stop39$0.000Transcript →
550passuser_stop42$0.000Transcript →
560passuser_stop26$0.000Transcript →
570passuser_stop16$0.000Transcript →
580passuser_stop23$0.000Transcript →
60passuser_stop27$0.000Transcript →
610passuser_stop16$0.000Transcript →
640passuser_stop28$0.000Transcript →
650passuser_stop29$0.000Transcript →
660passuser_stop29$0.000Transcript →
670passuser_stop20$0.000Transcript →
680passuser_stop18$0.000Transcript →
690passuser_stop27$0.000Transcript →
70passuser_stop35$0.000Transcript →
710passuser_stop36$0.000Transcript →
720passuser_stop34$0.000Transcript →
730passuser_stop18$0.000Transcript →
740passuser_stop37$0.000Transcript →
750passuser_stop20$0.000Transcript →
770passuser_stop18$0.000Transcript →
780passuser_stop39$0.000Transcript →
Page 1 of 2Next →