ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-10-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
157 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop20$0.000Transcript →
10passuser_stop22$0.000Transcript →
100passuser_stop28$0.000Transcript →
1000failuser_stop44$0.000Transcript →
1010passuser_stop46$0.000Transcript →
1020passuser_stop54$0.000Transcript →
1030errorinfrastructure_error0$0.000Transcript →
1030errorinfrastructure_error0$0.000Transcript →
1040failuser_stop50$0.000Transcript →
1050errorinfrastructure_error0$0.000Transcript →
1050errorinfrastructure_error0$0.000Transcript →
1060errorinfrastructure_error0$0.000Transcript →
1060failuser_stop20$0.000Transcript →
1070errorinfrastructure_error0$0.000Transcript →
1070errorinfrastructure_error0$0.000Transcript →
1080errorinfrastructure_error0$0.000Transcript →
1080errorinfrastructure_error0$0.000Transcript →
1090errorinfrastructure_error0$0.000Transcript →
1090errorinfrastructure_error0$0.000Transcript →
110passuser_stop34$0.000Transcript →
1100errorinfrastructure_error0$0.000Transcript →
1100errorinfrastructure_error0$0.000Transcript →
1110failuser_stop34$0.000Transcript →
1120passuser_stop46$0.000Transcript →
1130errorinfrastructure_error0$0.000Transcript →
1130errorinfrastructure_error0$0.000Transcript →
120passuser_stop23$0.000Transcript →
120errorinfrastructure_error0$0.000Transcript →
130errorinfrastructure_error0$0.000Transcript →
130passuser_stop41$0.000Transcript →
140passuser_stop23$0.000Transcript →
150passuser_stop26$0.000Transcript →
160errorinfrastructure_error0$0.000Transcript →
160errorinfrastructure_error0$0.000Transcript →
170passuser_stop16$0.000Transcript →
180failuser_stop30$0.000Transcript →
190errorinfrastructure_error0$0.000Transcript →
190errorinfrastructure_error0$0.000Transcript →
20failuser_stop30$0.000Transcript →
20errorinfrastructure_error0$0.000Transcript →
200failuser_stop31$0.000Transcript →
210errorinfrastructure_error0$0.000Transcript →
210passuser_stop27$0.000Transcript →
220passuser_stop26$0.000Transcript →
230passuser_stop53$0.000Transcript →
240errorinfrastructure_error0$0.000Transcript →
240errorinfrastructure_error0$0.000Transcript →
250passuser_stop25$0.000Transcript →
260passuser_stop26$0.000Transcript →
270failuser_stop28$0.000Transcript →
Page 1 of 4Next →