ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
200 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop10$0.010Transcript →
01passuser_stop18$0.009Transcript →
02passuser_stop18$0.011Transcript →
03passuser_stop16$0.011Transcript →
10passuser_stop24$0.013Transcript →
11passuser_stop20$0.010Transcript →
12passuser_stop26$0.014Transcript →
13passuser_stop24$0.011Transcript →
100passuser_stop34$0.058Transcript →
101failuser_stop28$0.038Transcript →
102failuser_stop42$0.089Transcript →
103failuser_stop38$0.033Transcript →
110passuser_stop24$0.020Transcript →
111passuser_stop24$0.013Transcript →
112passuser_stop18$0.007Transcript →
113passuser_stop20$0.009Transcript →
120failuser_stop26$0.031Transcript →
121passuser_stop12$0.015Transcript →
122failuser_stop38$0.023Transcript →
123failuser_stop26$0.021Transcript →
130passuser_stop14$0.007Transcript →
131passuser_stop38$0.018Transcript →
132passuser_stop12$0.012Transcript →
133passuser_stop14$0.008Transcript →
140failuser_stop28$0.032Transcript →
141passuser_stop30$0.050Transcript →
142failuser_stop36$0.040Transcript →
143passuser_stop34$0.034Transcript →
150passuser_stop28$0.023Transcript →
151failuser_stop44$0.069Transcript →
152passuser_stop22$0.017Transcript →
153passuser_stop20$0.018Transcript →
160passuser_stop20$0.010Transcript →
161passuser_stop22$0.015Transcript →
162passuser_stop20$0.016Transcript →
163passuser_stop24$0.017Transcript →
170passuser_stop24$0.012Transcript →
171passuser_stop24$0.012Transcript →
172failuser_stop24$0.009Transcript →
173failuser_stop32$0.023Transcript →
180passuser_stop36$0.014Transcript →
181passuser_stop32$0.012Transcript →
182failuser_stop34$0.013Transcript →
183failuser_stop38$0.015Transcript →
190passuser_stop16$0.012Transcript →
191passuser_stop22$0.014Transcript →
192failuser_stop16$0.009Transcript →
193passuser_stop16$0.012Transcript →
20passuser_stop120$0.029Transcript →
21passuser_stop78$0.033Transcript →
Page 1 of 4Next →