ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-11-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
00errorinfrastructure_error0$0.000Transcript →
10errorinfrastructure_error0$0.000Transcript →
100passuser_stop28$0.006Transcript →
1000failuser_stop38$0.010Transcript →
1010passuser_stop58$0.024Transcript →
1020errorinfrastructure_error0$0.000Transcript →
1030failuser_stop60$0.025Transcript →
1040failuser_stop60$0.027Transcript →
1050failuser_stop36$0.007Transcript →
1060errorinfrastructure_error0$0.000Transcript →
1070errorinfrastructure_error0$0.000Transcript →
1080passuser_stop26$0.005Transcript →
1090failuser_stop32$0.009Transcript →
110passuser_stop28$0.005Transcript →
1100failuser_stop38$0.012Transcript →
1110errorinfrastructure_error0$0.000Transcript →
1120failuser_stop68$0.024Transcript →
1130passuser_stop32$0.006Transcript →
120passuser_stop32$0.009Transcript →
130passuser_stop30$0.009Transcript →
140failuser_stop30$0.009Transcript →
150passuser_stop28$0.007Transcript →
160passuser_stop40$0.013Transcript →
170passuser_stop20$0.004Transcript →
180failuser_stop40$0.011Transcript →
190failuser_stop40$0.013Transcript →
20errorinfrastructure_error0$0.000Transcript →
200passuser_stop48$0.018Transcript →
210passuser_stop50$0.017Transcript →
220failuser_stop32$0.007Transcript →
230passuser_stop56$0.024Transcript →
240failuser_stop26$0.006Transcript →
250passuser_stop38$0.011Transcript →
260passuser_stop32$0.008Transcript →
270failuser_stop30$0.008Transcript →
280failuser_stop50$0.018Transcript →
290passuser_stop54$0.024Transcript →
30failuser_stop42$0.015Transcript →
300passuser_stop54$0.018Transcript →
310failuser_stop74$0.035Transcript →
320failuser_stop76$0.034Transcript →
330passuser_stop32$0.009Transcript →
340passuser_stop36$0.010Transcript →
350passuser_stop46$0.017Transcript →
360passuser_stop60$0.027Transcript →
370failuser_stop36$0.009Transcript →
380passuser_stop48$0.016Transcript →
390passuser_stop34$0.011Transcript →
40passuser_stop56$0.025Transcript →
400passuser_stop22$0.004Transcript →
Page 1 of 3Next →