ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
48 simulations
TaskTrialResultEndedMessagesCost
101failuser_stop28$0.038Transcript →
102failuser_stop42$0.089Transcript →
103failuser_stop38$0.033Transcript →
120failuser_stop26$0.031Transcript →
122failuser_stop38$0.023Transcript →
123failuser_stop26$0.021Transcript →
140failuser_stop28$0.032Transcript →
142failuser_stop36$0.040Transcript →
151failuser_stop44$0.069Transcript →
172failuser_stop24$0.009Transcript →
173failuser_stop32$0.023Transcript →
182failuser_stop34$0.013Transcript →
183failuser_stop38$0.015Transcript →
192failuser_stop16$0.009Transcript →
221failuser_stop24$0.008Transcript →
230failuser_stop26$0.037Transcript →
231failuser_stop28$0.025Transcript →
233failuser_stop34$0.038Transcript →
290failuser_stop28$0.025Transcript →
291failuser_stop22$0.022Transcript →
292failuser_stop32$0.022Transcript →
293failuser_stop24$0.026Transcript →
330failuser_stop24$0.024Transcript →
331failuser_stop24$0.033Transcript →
332failuser_stop24$0.023Transcript →
333failuser_stop32$0.025Transcript →
340failuser_stop24$0.024Transcript →
341failuser_stop20$0.015Transcript →
342failuser_stop22$0.027Transcript →
350failuser_stop24$0.026Transcript →
420failuser_stop32$0.022Transcript →
421failuser_stop30$0.028Transcript →
422failuser_stop32$0.032Transcript →
440failuser_stop46$0.033Transcript →
441failuser_stop50$0.028Transcript →
442failuser_stop52$0.038Transcript →
443failuser_stop54$0.029Transcript →
470failuser_stop16$0.011Transcript →
472failuser_stop16$0.011Transcript →
60failuser_stop36$0.050Transcript →
61failuser_stop40$0.045Transcript →
62failuser_stop44$0.052Transcript →
63failuser_stop38$0.063Transcript →
70failuser_stop40$0.016Transcript →
71failuser_stop36$0.019Transcript →
72failuser_stop30$0.025Transcript →
73failuser_stop34$0.014Transcript →
90failuser_stop26$0.020Transcript →