ZAZUMODELSBLOG

Model library · Gemini 3.1 Flash-Lite · 2026-10-27

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
26 simulations
TaskTrialResultEndedMessagesCost
10failuser_stop28$0.016Transcript →
100failuser_stop48$0.040Transcript →
110failuser_stop20$0.010Transcript →
120failuser_stop30$0.018Transcript →
140failuser_stop30$0.021Transcript →
150failuser_stop30$0.021Transcript →
160failuser_stop22$0.013Transcript →
170failuser_stop40$0.026Transcript →
200failuser_stop44$0.035Transcript →
210failuser_stop14$0.006Transcript →
220failuser_stop20$0.010Transcript →
230failuser_stop36$0.028Transcript →
250failuser_stop18$0.008Transcript →
290failuser_stop38$0.027Transcript →
320failuser_stop24$0.013Transcript →
330failuser_stop24$0.017Transcript →
350failtoo_many_errors140$0.135Transcript →
370failuser_stop26$0.014Transcript →
400failuser_stop18$0.011Transcript →
420failuser_stop38$0.026Transcript →
430failuser_stop28$0.016Transcript →
440failuser_stop74$0.052Transcript →
480failuser_stop18$0.010Transcript →
60failuser_stop58$0.047Transcript →
70failuser_stop34$0.022Transcript →
90failuser_stop24$0.014Transcript →