123456
01020304050607080910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364
01020304050607080910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364
ZAZU / INFERENCE SYSTEMSHEET 01 · REV A
Model library · OpenAI · 120B
gpt-oss-120B
From the transcripts Quiet, policy-correct tool use, but long table-heavy replies, and it hands off to a human too readily (62% of airline chats).
1MiniMax-strict customer
Customer simulator: minimax/minimax-m3.1-flash (strict customer patch).
2026-10-27
openrouter
| Domain | pass^1 | Higher k | Sims | Infra errors | Agent cost / task | Transcripts |
|---|
| AirlineInstruction following | 60.0% | — | 50 | 0 | $0.0023 | View → |
| RetailTool calling | 72.8% | — | 114 | 0 | $0.0029 | View → |
| TelecomReasoning | 79.8% | — | 114 | 0 | $0.0046 | View → |