ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-10-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
157 simulations
TaskTrialResultEndedMessagesCost
280passuser_stop56$0.000Transcript →
290failuser_stop33$0.000Transcript →
290errorinfrastructure_error0$0.000Transcript →
30failuser_stop32$0.000Transcript →
300errorinfrastructure_error0$0.000Transcript →
300failuser_stop38$0.000Transcript →
310failuser_stop30$0.000Transcript →
320failuser_stop53$0.000Transcript →
330passuser_stop26$0.000Transcript →
340passuser_stop22$0.000Transcript →
340errorinfrastructure_error0$0.000Transcript →
350passuser_stop35$0.000Transcript →
360errorinfrastructure_error0$0.000Transcript →
360errorinfrastructure_error0$0.000Transcript →
370errorinfrastructure_error0$0.000Transcript →
370errorinfrastructure_error0$0.000Transcript →
380errorinfrastructure_error0$0.000Transcript →
380failuser_stop30$0.000Transcript →
390errorinfrastructure_error0$0.000Transcript →
390passuser_stop26$0.000Transcript →
40failuser_stop32$0.000Transcript →
400errorinfrastructure_error0$0.000Transcript →
400errorinfrastructure_error0$0.000Transcript →
410passuser_stop24$0.000Transcript →
420passuser_stop31$0.000Transcript →
430errorinfrastructure_error0$0.000Transcript →
430errorinfrastructure_error0$0.000Transcript →
440errorinfrastructure_error0$0.000Transcript →
440errorinfrastructure_error0$0.000Transcript →
450errorinfrastructure_error0$0.000Transcript →
450errorinfrastructure_error0$0.000Transcript →
460failuser_stop26$0.000Transcript →
460errorinfrastructure_error0$0.000Transcript →
470errorinfrastructure_error0$0.000Transcript →
470errorinfrastructure_error0$0.000Transcript →
480passuser_stop24$0.000Transcript →
490errorinfrastructure_error0$0.000Transcript →
490failuser_stop40$0.000Transcript →
50errorinfrastructure_error0$0.000Transcript →
50failuser_stop53$0.000Transcript →
500passuser_stop14$0.000Transcript →
510passuser_stop22$0.000Transcript →
520passuser_stop32$0.000Transcript →
530passuser_stop27$0.000Transcript →
530errorinfrastructure_error0$0.000Transcript →
540passuser_stop39$0.000Transcript →
550passuser_stop42$0.000Transcript →
560passuser_stop26$0.000Transcript →
570passuser_stop16$0.000Transcript →
580passuser_stop23$0.000Transcript →