Model library · Gemma 4 12B · 2026-11-07
Airline simulations
Tests instruction following over a long booking policy.
| Task | Trial | Result | Ended | Messages | Cost | |
|---|---|---|---|---|---|---|
| 1 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 15 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 17 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 19 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 20 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 21 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 32 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 39 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 4 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 5 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |
| 7 | 0 | error | infrastructure_error | 0 | $0.000 | Transcript → |