ZAZUMODELSBLOG

Model library · LFM3-1.7B · 2026-10-28

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
20 simulations
TaskTrialResultEndedMessagesCost
10failuser_stop26$0.008Transcript →
100failuser_stop26$0.010Transcript →
140failuser_stop42$0.026Transcript →
160failuser_stop24$0.008Transcript →
170failuser_stop26$0.008Transcript →
210failuser_stop44$0.030Transcript →
230failuser_stop36$0.023Transcript →
240failuser_stop32$0.014Transcript →
260failuser_stop40$0.017Transcript →
290failuser_stop24$0.009Transcript →
310failuser_stop38$0.019Transcript →
330failuser_stop36$0.016Transcript →
370failuser_stop24$0.008Transcript →
390failuser_stop34$0.012Transcript →
450failuser_stop28$0.011Transcript →
470failuser_stop16$0.005Transcript →
480failuser_stop18$0.005Transcript →
50failuser_stop38$0.016Transcript →
60failuser_stop38$0.015Transcript →
70failuser_stop38$0.013Transcript →