ZAZUMODELSBLOG

Model library · Grok 4.20 · 2026-10-27

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
45 simulations
TaskTrialResultEndedMessagesCost
101passuser_stop62$0.306Transcript →
110passuser_stop23$0.074Transcript →
111passuser_stop16$0.048Transcript →
120passuser_stop36$0.128Transcript →
130passuser_stop12$0.033Transcript →
131passuser_stop20$0.071Transcript →
150passuser_stop32$0.128Transcript →
151passuser_stop26$0.096Transcript →
160passuser_stop29$0.118Transcript →
161passuser_stop27$0.101Transcript →
170passuser_stop31$0.113Transcript →
171passuser_stop35$0.139Transcript →
180passuser_stop54$0.286Transcript →
190passuser_stop27$0.088Transcript →
191passuser_stop27$0.091Transcript →
200passuser_stop29$0.113Transcript →
201passuser_stop22$0.082Transcript →
220passuser_stop29$0.105Transcript →
221passuser_stop31$0.108Transcript →
250passuser_stop24$0.080Transcript →
251passuser_stop26$0.092Transcript →
270passuser_stop20$0.062Transcript →
271passuser_stop22$0.073Transcript →
31passuser_stop16$0.044Transcript →
310passuser_stop22$0.068Transcript →
311passuser_stop20$0.056Transcript →
331passuser_stop39$0.162Transcript →
340passuser_stop28$0.103Transcript →
341passuser_stop22$0.079Transcript →
360passuser_stop21$0.061Transcript →
361passuser_stop24$0.067Transcript →
40passuser_stop36$0.114Transcript →
41passuser_stop24$0.067Transcript →
400passuser_stop14$0.038Transcript →
401passuser_stop16$0.045Transcript →
460passuser_stop14$0.039Transcript →
461passuser_stop12$0.032Transcript →
470passuser_stop20$0.063Transcript →
471passuser_stop22$0.073Transcript →
480passuser_stop16$0.047Transcript →
50passuser_stop35$0.135Transcript →
51passuser_stop21$0.058Transcript →
81passuser_stop33$0.122Transcript →
90passuser_stop29$0.109Transcript →
91passuser_stop32$0.117Transcript →