ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
152 simulations
TaskTrialResultEndedMessagesCost
240passuser_stop46$0.026Transcript →
241passuser_stop52$0.024Transcript →
242passuser_stop42$0.016Transcript →
243passuser_stop38$0.015Transcript →
250passuser_stop16$0.014Transcript →
251passuser_stop16$0.018Transcript →
252passuser_stop18$0.015Transcript →
253passuser_stop16$0.015Transcript →
260passuser_stop14$0.008Transcript →
261passuser_stop22$0.010Transcript →
262passuser_stop18$0.012Transcript →
263passuser_stop12$0.007Transcript →
270passuser_stop34$0.016Transcript →
271passuser_stop32$0.013Transcript →
272passuser_stop32$0.005Transcript →
273passuser_stop32$0.011Transcript →
280passuser_stop14$0.015Transcript →
281passuser_stop14$0.011Transcript →
282passuser_stop14$0.014Transcript →
283passuser_stop16$0.008Transcript →
30passuser_stop14$0.009Transcript →
31passuser_stop16$0.013Transcript →
32passuser_stop14$0.012Transcript →
33passuser_stop18$0.018Transcript →
300passuser_stop20$0.012Transcript →
301passuser_stop22$0.015Transcript →
302passuser_stop22$0.013Transcript →
303passuser_stop20$0.011Transcript →
310passuser_stop18$0.010Transcript →
311passuser_stop26$0.051Transcript →
312passuser_stop24$0.016Transcript →
313passuser_stop26$0.023Transcript →
320passuser_stop28$0.024Transcript →
321passuser_stop28$0.028Transcript →
322passuser_stop28$0.018Transcript →
323passuser_stop26$0.017Transcript →
343passuser_stop20$0.028Transcript →
351passuser_stop24$0.029Transcript →
352passuser_stop34$0.035Transcript →
353passuser_stop28$0.036Transcript →
360passuser_stop10$0.007Transcript →
361passuser_stop8$0.005Transcript →
362passuser_stop10$0.003Transcript →
363passuser_stop8$0.003Transcript →
370passuser_stop18$0.011Transcript →
371passuser_stop28$0.012Transcript →
372passuser_stop16$0.004Transcript →
373passuser_stop20$0.011Transcript →
380passuser_stop18$0.014Transcript →
381passuser_stop38$0.023Transcript →