ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
152 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop10$0.010Transcript →
01passuser_stop18$0.009Transcript →
02passuser_stop18$0.011Transcript →
03passuser_stop16$0.011Transcript →
10passuser_stop24$0.013Transcript →
11passuser_stop20$0.010Transcript →
12passuser_stop26$0.014Transcript →
13passuser_stop24$0.011Transcript →
100passuser_stop34$0.058Transcript →
110passuser_stop24$0.020Transcript →
111passuser_stop24$0.013Transcript →
112passuser_stop18$0.007Transcript →
113passuser_stop20$0.009Transcript →
121passuser_stop12$0.015Transcript →
130passuser_stop14$0.007Transcript →
131passuser_stop38$0.018Transcript →
132passuser_stop12$0.012Transcript →
133passuser_stop14$0.008Transcript →
141passuser_stop30$0.050Transcript →
143passuser_stop34$0.034Transcript →
150passuser_stop28$0.023Transcript →
152passuser_stop22$0.017Transcript →
153passuser_stop20$0.018Transcript →
160passuser_stop20$0.010Transcript →
161passuser_stop22$0.015Transcript →
162passuser_stop20$0.016Transcript →
163passuser_stop24$0.017Transcript →
170passuser_stop24$0.012Transcript →
171passuser_stop24$0.012Transcript →
180passuser_stop36$0.014Transcript →
181passuser_stop32$0.012Transcript →
190passuser_stop16$0.012Transcript →
191passuser_stop22$0.014Transcript →
193passuser_stop16$0.012Transcript →
20passuser_stop120$0.029Transcript →
21passuser_stop78$0.033Transcript →
22passuser_stop52$0.029Transcript →
23passuser_stop54$0.020Transcript →
200passuser_stop20$0.019Transcript →
201passuser_stop34$0.035Transcript →
202passuser_stop40$0.041Transcript →
203passuser_stop28$0.029Transcript →
210passuser_stop42$0.033Transcript →
211passuser_stop38$0.021Transcript →
212passuser_stop44$0.030Transcript →
213passuser_stop42$0.035Transcript →
220passuser_stop26$0.010Transcript →
222passuser_stop24$0.008Transcript →
223passuser_stop26$0.009Transcript →
232passuser_stop30$0.034Transcript →
Page 1 of 4Next →