ZAZUMODELSBLOG

Model library · Gemma 4 31B · 2026-11-09

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
20 simulations
TaskTrialResultEndedMessagesCost
10failuser_stop24$0.011Transcript →
110failuser_stop14$0.005Transcript →
140failuser_stop35$0.025Transcript →
160failuser_stop27$0.016Transcript →
180failuser_stop31$0.015Transcript →
210failuser_stop38$0.025Transcript →
230failuser_stop42$0.027Transcript →
290failuser_stop25$0.015Transcript →
30failuser_stop18$0.008Transcript →
330failuser_stop40$0.027Transcript →
340failuser_stop23$0.012Transcript →
350failuser_stop35$0.026Transcript →
360failuser_stop32$0.019Transcript →
410failuser_stop22$0.009Transcript →
420failuser_stop28$0.013Transcript →
430failuser_stop29$0.014Transcript →
440failuser_stop30$0.009Transcript →
60failuser_stop57$0.038Transcript →
70failuser_stop28$0.014Transcript →
90failuser_stop24$0.012Transcript →