ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-11-07

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
32 simulations
TaskTrialResultEndedMessagesCost
1000failuser_stop38$0.010Transcript →
1030failuser_stop60$0.025Transcript →
1040failuser_stop60$0.027Transcript →
1050failuser_stop36$0.007Transcript →
1090failuser_stop32$0.009Transcript →
1100failuser_stop38$0.012Transcript →
1120failuser_stop68$0.024Transcript →
140failuser_stop30$0.009Transcript →
180failuser_stop40$0.011Transcript →
190failuser_stop40$0.013Transcript →
220failuser_stop32$0.007Transcript →
240failuser_stop26$0.006Transcript →
270failuser_stop30$0.008Transcript →
280failuser_stop50$0.018Transcript →
30failuser_stop42$0.015Transcript →
310failuser_stop74$0.035Transcript →
320failuser_stop76$0.034Transcript →
370failuser_stop36$0.009Transcript →
430failuser_stop28$0.006Transcript →
450failuser_stop12$0.002Transcript →
460failuser_stop36$0.011Transcript →
50failuser_stop56$0.024Transcript →
550failuser_stop50$0.021Transcript →
570failuser_stop24$0.005Transcript →
590failuser_stop20$0.006Transcript →
60failuser_stop36$0.011Transcript →
600failuser_stop20$0.004Transcript →
640failuser_stop46$0.015Transcript →
740failuser_stop44$0.015Transcript →
790failuser_stop28$0.008Transcript →
930failuser_stop28$0.007Transcript →
980failuser_stop72$0.039Transcript →