ZAZUMODELSBLOG

Model library · Grok 4.20 · 2026-10-27

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
100 simulations
TaskTrialResultEndedMessagesCost
310passuser_stop22$0.068Transcript →
311passuser_stop20$0.056Transcript →
320failuser_stop51$0.235Transcript →
321failuser_stop35$0.129Transcript →
330failuser_stop40$0.183Transcript →
331passuser_stop39$0.162Transcript →
340passuser_stop28$0.103Transcript →
341passuser_stop22$0.079Transcript →
350failuser_stop42$0.183Transcript →
351failuser_stop28$0.120Transcript →
360passuser_stop21$0.061Transcript →
361passuser_stop24$0.067Transcript →
370failuser_stop26$0.079Transcript →
371failuser_stop31$0.114Transcript →
380failuser_stop31$0.111Transcript →
381failuser_stop33$0.121Transcript →
390failuser_stop66$0.334Transcript →
391failuser_stop70$0.366Transcript →
40passuser_stop36$0.114Transcript →
41passuser_stop24$0.067Transcript →
400passuser_stop14$0.038Transcript →
401passuser_stop16$0.045Transcript →
410failuser_stop30$0.105Transcript →
411failuser_stop40$0.163Transcript →
420failuser_stop106$0.552Transcript →
421failuser_stop38$0.159Transcript →
430failuser_stop27$0.087Transcript →
431failuser_stop34$0.132Transcript →
440failuser_stop67$0.291Transcript →
441errorinfrastructure_error0$0.000Transcript →
450failuser_stop14$0.039Transcript →
451failuser_stop14$0.039Transcript →
460passuser_stop14$0.039Transcript →
461passuser_stop12$0.032Transcript →
470passuser_stop20$0.063Transcript →
471passuser_stop22$0.073Transcript →
480passuser_stop16$0.047Transcript →
481failuser_stop12$0.032Transcript →
490failuser_stop28$0.098Transcript →
491failuser_stop20$0.064Transcript →
50passuser_stop35$0.135Transcript →
51passuser_stop21$0.058Transcript →
60failuser_stop36$0.142Transcript →
61failuser_stop32$0.118Transcript →
70failuser_stop38$0.169Transcript →
71failuser_stop28$0.099Transcript →
80failuser_stop40$0.168Transcript →
81passuser_stop33$0.122Transcript →
90passuser_stop29$0.109Transcript →
91passuser_stop32$0.117Transcript →
← PreviousPage 2 of 2