ZAZUMODELSBLOG

Model library · Gemma 4 31B · 2026-11-09

Retail simulations

Tests tool calling on order changes.

Allpassfailerror
90 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop21$0.013Transcript →
10passuser_stop31$0.022Transcript →
100passuser_stop12$0.005Transcript →
1010passuser_stop44$0.031Transcript →
1020passuser_stop50$0.037Transcript →
1030passuser_stop60$0.052Transcript →
1040passuser_stop49$0.042Transcript →
1060passuser_stop32$0.019Transcript →
1080passuser_stop34$0.020Transcript →
1090passuser_stop33$0.021Transcript →
110passuser_stop24$0.012Transcript →
1110passuser_stop35$0.023Transcript →
1120passuser_stop47$0.034Transcript →
1130passuser_stop24$0.012Transcript →
120passuser_stop23$0.012Transcript →
130passuser_stop25$0.014Transcript →
140passuser_stop22$0.011Transcript →
150passuser_stop22$0.013Transcript →
170passuser_stop16$0.008Transcript →
20passuser_stop30$0.018Transcript →
200passuser_stop33$0.023Transcript →
220passuser_stop34$0.020Transcript →
240passuser_stop27$0.015Transcript →
250passuser_stop21$0.010Transcript →
260passuser_stop25$0.013Transcript →
280passuser_stop29$0.016Transcript →
300passuser_stop41$0.028Transcript →
310passuser_stop38$0.025Transcript →
330passuser_stop30$0.019Transcript →
340passuser_stop28$0.017Transcript →
350passuser_stop28$0.018Transcript →
360passuser_stop34$0.022Transcript →
370passuser_stop40$0.030Transcript →
380passuser_stop36$0.023Transcript →
390passuser_stop26$0.016Transcript →
400passuser_stop18$0.009Transcript →
430passuser_stop30$0.017Transcript →
440passuser_stop22$0.012Transcript →
450passuser_stop28$0.017Transcript →
470passuser_stop32$0.019Transcript →
480passuser_stop26$0.014Transcript →
500passuser_stop8$0.003Transcript →
510passuser_stop25$0.012Transcript →
520passuser_stop28$0.016Transcript →
530passuser_stop29$0.016Transcript →
540passuser_stop38$0.027Transcript →
550passuser_stop30$0.015Transcript →
560passuser_stop28$0.017Transcript →
570passuser_stop18$0.009Transcript →
580passuser_stop29$0.020Transcript →
Page 1 of 2Next →