ZAZUMODELSBLOG

Model library · gpt-oss-120B · 2026-10-27

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
50 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop12$0.001Transcript →
10passuser_stop20$0.002Transcript →
100failuser_stop24$0.003Transcript →
110passuser_stop28$0.004Transcript →
120passuser_stop20$0.003Transcript →
130passuser_stop8$0.001Transcript →
140failuser_stop26$0.006Transcript →
150passuser_stop26$0.005Transcript →
160passuser_stop18$0.002Transcript →
170failuser_stop16$0.001Transcript →
180failuser_stop24$0.003Transcript →
190failuser_stop12$0.001Transcript →
20passuser_stop46$0.006Transcript →
200passuser_stop26$0.005Transcript →
210failuser_stop30$0.005Transcript →
220failuser_stop28$0.003Transcript →
230failuser_stop32$0.008Transcript →
240failuser_stop10$0.002Transcript →
250failuser_stop42$0.008Transcript →
260passuser_stop12$0.001Transcript →
270passuser_stop38$0.005Transcript →
280passuser_stop10$0.001Transcript →
290failuser_stop6$0.001Transcript →
30passuser_stop14$0.001Transcript →
300failuser_stop22$0.003Transcript →
310passuser_stop14$0.001Transcript →
320failuser_stop12$0.001Transcript →
330failuser_stop32$0.006Transcript →
340passuser_stop18$0.003Transcript →
350passuser_stop36$0.006Transcript →
360passuser_stop12$0.001Transcript →
370failuser_stop28$0.004Transcript →
380passuser_stop24$0.003Transcript →
390failuser_stop22$0.002Transcript →
40passuser_stop34$0.004Transcript →
400passuser_stop12$0.001Transcript →
410passuser_stop20$0.002Transcript →
420passuser_stop36$0.008Transcript →
430passuser_stop16$0.001Transcript →
440failuser_stop60$0.009Transcript →
450passuser_stop26$0.003Transcript →
460passuser_stop8$0.001Transcript →
470passuser_stop20$0.003Transcript →
480passuser_stop10$0.001Transcript →
490passuser_stop10$0.001Transcript →
50passuser_stop10$0.001Transcript →
60passuser_stop28$0.003Transcript →
70failuser_stop18$0.003Transcript →
80failuser_stop34$0.005Transcript →
90failuser_stop28$0.004Transcript →