ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-11-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
63 simulations
TaskTrialResultEndedMessagesCost
100passuser_stop28$0.006Transcript →
1010passuser_stop58$0.024Transcript →
1080passuser_stop26$0.005Transcript →
110passuser_stop28$0.005Transcript →
1130passuser_stop32$0.006Transcript →
120passuser_stop32$0.009Transcript →
130passuser_stop30$0.009Transcript →
150passuser_stop28$0.007Transcript →
160passuser_stop40$0.013Transcript →
170passuser_stop20$0.004Transcript →
200passuser_stop48$0.018Transcript →
210passuser_stop50$0.017Transcript →
230passuser_stop56$0.024Transcript →
250passuser_stop38$0.011Transcript →
260passuser_stop32$0.008Transcript →
290passuser_stop54$0.024Transcript →
300passuser_stop54$0.018Transcript →
330passuser_stop32$0.009Transcript →
340passuser_stop36$0.010Transcript →
350passuser_stop46$0.017Transcript →
360passuser_stop60$0.027Transcript →
380passuser_stop48$0.016Transcript →
390passuser_stop34$0.011Transcript →
40passuser_stop56$0.025Transcript →
400passuser_stop22$0.004Transcript →
410passuser_stop44$0.015Transcript →
440passuser_stop24$0.008Transcript →
480passuser_stop34$0.009Transcript →
490passuser_stop42$0.014Transcript →
500passuser_stop10$0.001Transcript →
510passuser_stop26$0.007Transcript →
520passuser_stop30$0.008Transcript →
530passuser_stop28$0.008Transcript →
560passuser_stop34$0.010Transcript →
580passuser_stop28$0.008Transcript →
610passuser_stop28$0.007Transcript →
620passuser_stop38$0.010Transcript →
650passuser_stop44$0.018Transcript →
660passuser_stop36$0.008Transcript →
680passuser_stop22$0.004Transcript →
70passuser_stop34$0.012Transcript →
700passuser_stop42$0.013Transcript →
710passuser_stop60$0.027Transcript →
720passuser_stop44$0.015Transcript →
730passuser_stop20$0.005Transcript →
750passuser_stop24$0.006Transcript →
760passuser_stop62$0.028Transcript →
770passuser_stop28$0.005Transcript →
80passuser_stop38$0.013Transcript →
800passuser_stop22$0.005Transcript →
Page 1 of 2Next →