ZAZUMODELSBLOG

Model library · LFM3-1.7B · 2026-10-28

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
50 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop18$0.005Transcript →
10failuser_stop26$0.008Transcript →
100failuser_stop26$0.010Transcript →
110passuser_stop24$0.008Transcript →
120passuser_stop27$0.010Transcript →
130passuser_stop44$0.019Transcript →
140failuser_stop42$0.026Transcript →
150passuser_stop30$0.011Transcript →
160failuser_stop24$0.008Transcript →
170failuser_stop26$0.008Transcript →
180passuser_stop42$0.016Transcript →
190passuser_stop18$0.005Transcript →
20passuser_stop42$0.018Transcript →
200passuser_stop22$0.008Transcript →
210failuser_stop44$0.030Transcript →
220passuser_stop38$0.013Transcript →
230failuser_stop36$0.023Transcript →
240failuser_stop32$0.014Transcript →
250passuser_stop22$0.007Transcript →
260failuser_stop40$0.017Transcript →
270passuser_stop42$0.015Transcript →
280passuser_stop24$0.006Transcript →
290failuser_stop24$0.009Transcript →
30passuser_stop12$0.003Transcript →
300passuser_stop20$0.008Transcript →
310failuser_stop38$0.019Transcript →
320passuser_stop42$0.019Transcript →
330failuser_stop36$0.016Transcript →
340passuser_stop22$0.011Transcript →
350passuser_stop42$0.021Transcript →
360passuser_stop12$0.004Transcript →
370failuser_stop24$0.008Transcript →
380passuser_stop28$0.012Transcript →
390failuser_stop34$0.012Transcript →
40passuser_stop34$0.011Transcript →
400passuser_stop14$0.003Transcript →
410passuser_stop32$0.013Transcript →
420passuser_stop42$0.024Transcript →
430passuser_stop28$0.010Transcript →
440passuser_stop64$0.037Transcript →
450failuser_stop28$0.011Transcript →
460passuser_stop14$0.003Transcript →
470failuser_stop16$0.005Transcript →
480failuser_stop18$0.005Transcript →
490passuser_stop18$0.005Transcript →
50failuser_stop38$0.016Transcript →
60failuser_stop38$0.015Transcript →
70failuser_stop38$0.013Transcript →
80passuser_stop36$0.012Transcript →
90passuser_stop30$0.011Transcript →