ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-28

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
50 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop16$0.004Transcript →
10failuser_stop28$0.007Transcript →
100failuser_stop72$0.146Transcript →
110passuser_stop24$0.008Transcript →
120failuser_stop40$0.018Transcript →
130passuser_stop26$0.008Transcript →
140passuser_stop30$0.013Transcript →
150passuser_stop28$0.015Transcript →
160passuser_stop24$0.010Transcript →
170passuser_stop28$0.010Transcript →
180passuser_stop38$0.015Transcript →
190passuser_stop28$0.008Transcript →
20passuser_stop62$0.027Transcript →
200passuser_stop22$0.007Transcript →
210passuser_stop48$0.029Transcript →
220passuser_stop28$0.009Transcript →
230failuser_stop38$0.024Transcript →
240passuser_stop56$0.021Transcript →
250passuser_stop22$0.007Transcript →
260failuser_stop24$0.007Transcript →
270passuser_stop32$0.010Transcript →
280passuser_stop22$0.007Transcript →
290failuser_stop44$0.020Transcript →
30passuser_stop16$0.004Transcript →
300failuser_stop26$0.010Transcript →
310failuser_stop34$0.016Transcript →
320passuser_stop36$0.016Transcript →
330failuser_stop36$0.021Transcript →
340passuser_stop22$0.010Transcript →
350passuser_stop34$0.013Transcript →
360passuser_stop12$0.003Transcript →
370passuser_stop30$0.012Transcript →
380passuser_stop32$0.011Transcript →
390passuser_stop36$0.065Transcript →
40passuser_stop32$0.013Transcript →
400passuser_stop16$0.004Transcript →
410passuser_stop40$0.013Transcript →
420failuser_stop52$0.020Transcript →
430passuser_stop32$0.012Transcript →
440failuser_stop24$0.007Transcript →
450passuser_stop20$0.005Transcript →
460passuser_stop16$0.004Transcript →
470passuser_stop18$0.005Transcript →
480passuser_stop20$0.006Transcript →
490passuser_stop36$0.013Transcript →
50passuser_stop22$0.006Transcript →
60failuser_stop32$0.011Transcript →
70failuser_stop44$0.022Transcript →
80passuser_stop32$0.010Transcript →
90passuser_stop28$0.027Transcript →