ZAZUMODELSBLOG

Model library · GPT-4.1 mini · 2026-10-28

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
22 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop12$0.008Transcript →
100passuser_stop46$0.056Transcript →
110passuser_stop22$0.018Transcript →
130passuser_stop40$0.043Transcript →
150passuser_stop29$0.030Transcript →
160passuser_stop29$0.030Transcript →
20passuser_stop94$0.054Transcript →
200passuser_stop34$0.035Transcript →
240passuser_stop39$0.035Transcript →
250passuser_stop28$0.025Transcript →
280passuser_stop16$0.011Transcript →
30passuser_stop16$0.012Transcript →
300passuser_stop18$0.015Transcript →
310passuser_stop20$0.015Transcript →
320passuser_stop43$0.046Transcript →
340passuser_stop16$0.012Transcript →
40passuser_stop38$0.024Transcript →
400passuser_stop14$0.010Transcript →
460passuser_stop10$0.006Transcript →
480passuser_stop16$0.011Transcript →
490passuser_stop14$0.010Transcript →
60passuser_stop42$0.041Transcript →