ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
200 simulations
TaskTrialResultEndedMessagesCost
310passuser_stop18$0.010Transcript →
311passuser_stop26$0.051Transcript →
312passuser_stop24$0.016Transcript →
313passuser_stop26$0.023Transcript →
320passuser_stop28$0.024Transcript →
321passuser_stop28$0.028Transcript →
322passuser_stop28$0.018Transcript →
323passuser_stop26$0.017Transcript →
330failuser_stop24$0.024Transcript →
331failuser_stop24$0.033Transcript →
332failuser_stop24$0.023Transcript →
333failuser_stop32$0.025Transcript →
340failuser_stop24$0.024Transcript →
341failuser_stop20$0.015Transcript →
342failuser_stop22$0.027Transcript →
343passuser_stop20$0.028Transcript →
350failuser_stop24$0.026Transcript →
351passuser_stop24$0.029Transcript →
352passuser_stop34$0.035Transcript →
353passuser_stop28$0.036Transcript →
360passuser_stop10$0.007Transcript →
361passuser_stop8$0.005Transcript →
362passuser_stop10$0.003Transcript →
363passuser_stop8$0.003Transcript →
370passuser_stop18$0.011Transcript →
371passuser_stop28$0.012Transcript →
372passuser_stop16$0.004Transcript →
373passuser_stop20$0.011Transcript →
380passuser_stop18$0.014Transcript →
381passuser_stop38$0.023Transcript →
382passuser_stop28$0.022Transcript →
383passuser_stop20$0.015Transcript →
390passuser_stop32$0.012Transcript →
391passuser_stop34$0.016Transcript →
392passuser_stop32$0.014Transcript →
393passuser_stop34$0.019Transcript →
40passuser_stop20$0.014Transcript →
41passuser_stop30$0.021Transcript →
42passuser_stop28$0.017Transcript →
43passuser_stop20$0.012Transcript →
400passuser_stop18$0.009Transcript →
401passuser_stop16$0.007Transcript →
402passuser_stop18$0.009Transcript →
403passuser_stop18$0.009Transcript →
410passuser_stop24$0.004Transcript →
411passuser_stop30$0.012Transcript →
412passuser_stop28$0.015Transcript →
413passuser_stop28$0.011Transcript →
420failuser_stop32$0.022Transcript →
421failuser_stop30$0.028Transcript →