ZAZUMODELSBLOG

Model library · Grok 4.20 · 2026-10-27

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
54 simulations
TaskTrialResultEndedMessagesCost
00failuser_stop46$0.245Transcript →
01failuser_stop12$0.032Transcript →
10failuser_stop27$0.085Transcript →
11failuser_stop25$0.077Transcript →
100failuser_stop104$0.876Transcript →
121failuser_stop32$0.115Transcript →
140failuser_stop39$0.193Transcript →
141failuser_stop33$0.148Transcript →
181failuser_stop44$0.205Transcript →
20failuser_stop31$0.109Transcript →
21failuser_stop37$0.178Transcript →
210failuser_stop39$0.174Transcript →
211failuser_stop46$0.212Transcript →
230failuser_stop62$0.401Transcript →
231failuser_stop33$0.142Transcript →
240failuser_stop36$0.147Transcript →
241failuser_stop35$0.147Transcript →
260failuser_stop21$0.064Transcript →
261failuser_stop24$0.072Transcript →
280failuser_stop22$0.071Transcript →
281failuser_stop20$0.064Transcript →
290failuser_stop27$0.102Transcript →
291failuser_stop26$0.102Transcript →
30failuser_stop18$0.054Transcript →
300failuser_stop24$0.085Transcript →
301failuser_stop28$0.109Transcript →
320failuser_stop51$0.235Transcript →
321failuser_stop35$0.129Transcript →
330failuser_stop40$0.183Transcript →
350failuser_stop42$0.183Transcript →
351failuser_stop28$0.120Transcript →
370failuser_stop26$0.079Transcript →
371failuser_stop31$0.114Transcript →
380failuser_stop31$0.111Transcript →
381failuser_stop33$0.121Transcript →
390failuser_stop66$0.334Transcript →
391failuser_stop70$0.366Transcript →
410failuser_stop30$0.105Transcript →
411failuser_stop40$0.163Transcript →
420failuser_stop106$0.552Transcript →
421failuser_stop38$0.159Transcript →
430failuser_stop27$0.087Transcript →
431failuser_stop34$0.132Transcript →
440failuser_stop67$0.291Transcript →
450failuser_stop14$0.039Transcript →
451failuser_stop14$0.039Transcript →
481failuser_stop12$0.032Transcript →
490failuser_stop28$0.098Transcript →
491failuser_stop20$0.064Transcript →
60failuser_stop36$0.142Transcript →
Page 1 of 2Next →