ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-10-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
157 simulations
TaskTrialResultEndedMessagesCost
590errorinfrastructure_error0$0.000Transcript →
590errorinfrastructure_error0$0.000Transcript →
60passuser_stop27$0.000Transcript →
60errorinfrastructure_error0$0.000Transcript →
600errorinfrastructure_error0$0.000Transcript →
600errorinfrastructure_error0$0.000Transcript →
610passuser_stop16$0.000Transcript →
620errorinfrastructure_error0$0.000Transcript →
620errorinfrastructure_error0$0.000Transcript →
630errorinfrastructure_error0$0.000Transcript →
630errorinfrastructure_error0$0.000Transcript →
640passuser_stop28$0.000Transcript →
650passuser_stop29$0.000Transcript →
650errorinfrastructure_error0$0.000Transcript →
660passuser_stop29$0.000Transcript →
670passuser_stop20$0.000Transcript →
680passuser_stop18$0.000Transcript →
690errorinfrastructure_error0$0.000Transcript →
690passuser_stop27$0.000Transcript →
70passuser_stop35$0.000Transcript →
700errorinfrastructure_error0$0.000Transcript →
700errorinfrastructure_error0$0.000Transcript →
710passuser_stop36$0.000Transcript →
720passuser_stop34$0.000Transcript →
730passuser_stop18$0.000Transcript →
740passuser_stop37$0.000Transcript →
750passuser_stop20$0.000Transcript →
760failuser_stop36$0.000Transcript →
770passuser_stop18$0.000Transcript →
780passuser_stop39$0.000Transcript →
790failuser_stop22$0.000Transcript →
790errorinfrastructure_error0$0.000Transcript →
80errorinfrastructure_error0$0.000Transcript →
80passuser_stop36$0.000Transcript →
800passuser_stop22$0.000Transcript →
810passuser_stop28$0.000Transcript →
820passuser_stop28$0.000Transcript →
830passuser_stop32$0.000Transcript →
840passuser_stop30$0.000Transcript →
850passuser_stop30$0.000Transcript →
860passuser_stop40$0.000Transcript →
870passuser_stop25$0.000Transcript →
880passuser_stop26$0.000Transcript →
890errorinfrastructure_error0$0.000Transcript →
890errorinfrastructure_error0$0.000Transcript →
90passuser_stop29$0.000Transcript →
900passuser_stop28$0.000Transcript →
910failuser_stop36$0.000Transcript →
920passuser_stop28$0.000Transcript →
930failuser_stop22$0.000Transcript →