ZAZUMODELSBLOG

Model library · Gemma 4 12B · 2026-11-07

Airline simulations

Tests instruction following over a long booking policy.

Allpassfailerror
19 simulations
TaskTrialResultEndedMessagesCost
00passuser_stop16$0.002Transcript →
130passuser_stop14$0.002Transcript →
220passuser_stop56$0.024Transcript →
250passuser_stop42$0.015Transcript →
260passuser_stop18$0.004Transcript →
270passuser_stop16$0.004Transcript →
280passuser_stop24$0.005Transcript →
300passuser_stop30$0.006Transcript →
310passuser_stop16$0.002Transcript →
360passuser_stop12$0.002Transcript →
400passuser_stop12$0.002Transcript →
410passuser_stop34$0.008Transcript →
430passuser_stop24$0.007Transcript →
450passuser_stop32$0.010Transcript →
460passuser_stop12$0.002Transcript →
470passuser_stop22$0.005Transcript →
480passuser_stop12$0.002Transcript →
490passuser_stop14$0.002Transcript →
60passuser_stop18$0.003Transcript →