ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-10-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
23 simulations
TaskTrialResultEndedMessagesCost
1000failuser_stop44$0.000Transcript →
1040failuser_stop50$0.000Transcript →
1060failuser_stop20$0.000Transcript →
1110failuser_stop34$0.000Transcript →
180failuser_stop30$0.000Transcript →
20failuser_stop30$0.000Transcript →
200failuser_stop31$0.000Transcript →
270failuser_stop28$0.000Transcript →
290failuser_stop33$0.000Transcript →
30failuser_stop32$0.000Transcript →
300failuser_stop38$0.000Transcript →
310failuser_stop30$0.000Transcript →
320failuser_stop53$0.000Transcript →
380failuser_stop30$0.000Transcript →
40failuser_stop32$0.000Transcript →
460failuser_stop26$0.000Transcript →
490failuser_stop40$0.000Transcript →
50failuser_stop53$0.000Transcript →
760failuser_stop36$0.000Transcript →
790failuser_stop22$0.000Transcript →
910failuser_stop36$0.000Transcript →
930failuser_stop22$0.000Transcript →
980failuser_stop36$0.000Transcript →