123456
01020304050607080910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364
01020304050607080910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364
ZAZU / INFERENCE SYSTEMSHEET 01 · REV A
Model library · xAI
Grok 4.20
From the transcripts Thorough and careful, but tells customers about policy and tool names ("before I call the tool…") in long markdown replies.
1MiniMax-strict customer
Customer simulator: minimax/minimax-m3.1-flash (strict customer patch).
2026-10-27
openrouterreasoning off
| Domain | pass^1 | Higher k | Sims | Infra errors | Agent cost / task | Transcripts |
|---|
| AirlineInstruction following | 45.0% | ^2 38.0% | 100 | 1 | $0.1273 | View → |
| RetailTool calling | 87.7% | — | 114 | 0 | $0.1540 | View → |
| TelecomReasoning | 78.1% | ^1_scored_only 78.1% | 114 | 0 | $0.1823 | View → |