ZAZUMODELSBLOG

Model library · Gemma 4 31B · 2026-11-09

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
410failuser_stop26$0.015Transcript →
420failuser_stop43$0.031Transcript →
430passuser_stop30$0.017Transcript →
440passuser_stop22$0.012Transcript →
450passuser_stop28$0.017Transcript →
460failuser_stop32$0.019Transcript →
470passuser_stop32$0.019Transcript →
480passuser_stop26$0.014Transcript →
490failuser_stop26$0.014Transcript →
50failuser_stop42$0.030Transcript →
500passuser_stop8$0.003Transcript →
510passuser_stop25$0.012Transcript →
520passuser_stop28$0.016Transcript →
530passuser_stop29$0.016Transcript →
540passuser_stop38$0.027Transcript →
550passuser_stop30$0.015Transcript →
560passuser_stop28$0.017Transcript →
570passuser_stop18$0.009Transcript →
580passuser_stop29$0.020Transcript →
590failuser_stop22$0.012Transcript →
60passuser_stop29$0.018Transcript →
600passuser_stop20$0.012Transcript →
610passuser_stop22$0.013Transcript →
620passuser_stop37$0.024Transcript →
630passuser_stop36$0.025Transcript →
640passuser_stop26$0.014Transcript →
650passuser_stop16$0.007Transcript →
660passuser_stop29$0.015Transcript →
670passuser_stop24$0.012Transcript →
680passuser_stop18$0.008Transcript →
690passuser_stop26$0.014Transcript →
70passuser_stop34$0.020Transcript →
700passuser_stop33$0.021Transcript →
710passuser_stop35$0.023Transcript →
720passuser_stop36$0.024Transcript →
730passuser_stop18$0.009Transcript →
740passuser_stop30$0.020Transcript →
750passuser_stop22$0.012Transcript →
760passuser_stop28$0.016Transcript →
770passuser_stop26$0.015Transcript →
780passuser_stop24$0.014Transcript →
790passuser_stop24$0.013Transcript →
80passuser_stop31$0.020Transcript →
800passuser_stop28$0.018Transcript →
810passuser_stop30$0.018Transcript →
820passuser_stop29$0.017Transcript →
830passuser_stop27$0.015Transcript →
840passuser_stop36$0.023Transcript →
850passuser_stop28$0.015Transcript →
860passuser_stop27$0.013Transcript →