ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-11-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
410passuser_stop44$0.015Transcript →
420errorinfrastructure_error0$0.000Transcript →
430failuser_stop28$0.006Transcript →
440passuser_stop24$0.008Transcript →
450failuser_stop12$0.002Transcript →
460failuser_stop36$0.011Transcript →
470errorinfrastructure_error0$0.000Transcript →
480passuser_stop34$0.009Transcript →
490passuser_stop42$0.014Transcript →
50failuser_stop56$0.024Transcript →
500passuser_stop10$0.001Transcript →
510passuser_stop26$0.007Transcript →
520passuser_stop30$0.008Transcript →
530passuser_stop28$0.008Transcript →
540errorinfrastructure_error0$0.000Transcript →
550failuser_stop50$0.021Transcript →
560passuser_stop34$0.010Transcript →
570failuser_stop24$0.005Transcript →
580passuser_stop28$0.008Transcript →
590failuser_stop20$0.006Transcript →
60failuser_stop36$0.011Transcript →
600failuser_stop20$0.004Transcript →
610passuser_stop28$0.007Transcript →
620passuser_stop38$0.010Transcript →
630errorinfrastructure_error0$0.000Transcript →
640failuser_stop46$0.015Transcript →
650passuser_stop44$0.018Transcript →
660passuser_stop36$0.008Transcript →
670errorinfrastructure_error0$0.000Transcript →
680passuser_stop22$0.004Transcript →
690errorinfrastructure_error0$0.000Transcript →
70passuser_stop34$0.012Transcript →
700passuser_stop42$0.013Transcript →
710passuser_stop60$0.027Transcript →
720passuser_stop44$0.015Transcript →
730passuser_stop20$0.005Transcript →
740failuser_stop44$0.015Transcript →
750passuser_stop24$0.006Transcript →
760passuser_stop62$0.028Transcript →
770passuser_stop28$0.005Transcript →
780errorinfrastructure_error0$0.000Transcript →
790failuser_stop28$0.008Transcript →
80passuser_stop38$0.013Transcript →
800passuser_stop22$0.005Transcript →
810errorinfrastructure_error0$0.000Transcript →
820passuser_stop26$0.007Transcript →
830errorinfrastructure_error0$0.000Transcript →
840errorinfrastructure_error0$0.000Transcript →
850passuser_stop32$0.007Transcript →
860passuser_stop44$0.015Transcript →