ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
200 simulations
TaskTrialResultEndedMessagesCost
22passuser_stop52$0.029Transcript →
23passuser_stop54$0.020Transcript →
200passuser_stop20$0.019Transcript →
201passuser_stop34$0.035Transcript →
202passuser_stop40$0.041Transcript →
203passuser_stop28$0.029Transcript →
210passuser_stop42$0.033Transcript →
211passuser_stop38$0.021Transcript →
212passuser_stop44$0.030Transcript →
213passuser_stop42$0.035Transcript →
220passuser_stop26$0.010Transcript →
221failuser_stop24$0.008Transcript →
222passuser_stop24$0.008Transcript →
223passuser_stop26$0.009Transcript →
230failuser_stop26$0.037Transcript →
231failuser_stop28$0.025Transcript →
232passuser_stop30$0.034Transcript →
233failuser_stop34$0.038Transcript →
240passuser_stop46$0.026Transcript →
241passuser_stop52$0.024Transcript →
242passuser_stop42$0.016Transcript →
243passuser_stop38$0.015Transcript →
250passuser_stop16$0.014Transcript →
251passuser_stop16$0.018Transcript →
252passuser_stop18$0.015Transcript →
253passuser_stop16$0.015Transcript →
260passuser_stop14$0.008Transcript →
261passuser_stop22$0.010Transcript →
262passuser_stop18$0.012Transcript →
263passuser_stop12$0.007Transcript →
270passuser_stop34$0.016Transcript →
271passuser_stop32$0.013Transcript →
272passuser_stop32$0.005Transcript →
273passuser_stop32$0.011Transcript →
280passuser_stop14$0.015Transcript →
281passuser_stop14$0.011Transcript →
282passuser_stop14$0.014Transcript →
283passuser_stop16$0.008Transcript →
290failuser_stop28$0.025Transcript →
291failuser_stop22$0.022Transcript →
292failuser_stop32$0.022Transcript →
293failuser_stop24$0.026Transcript →
30passuser_stop14$0.009Transcript →
31passuser_stop16$0.013Transcript →
32passuser_stop14$0.012Transcript →
33passuser_stop18$0.018Transcript →
300passuser_stop20$0.012Transcript →
301passuser_stop22$0.015Transcript →
302passuser_stop22$0.013Transcript →
303passuser_stop20$0.011Transcript →