123456
01020304050607080910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364
01020304050607080910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364
ZAZU / INFERENCE SYSTEMSHEET 01 · REV A
Model library · Liquid AI · 1.7B
LFM3-1.7B
From the transcripts Handles simple returns, but leaks stray </think> tags into replies, invents tool arguments and loops tool calls in telecom (one call 94 times).
1MiniMax-strict customer
Customer simulator: minimax/minimax-m3.1-flash (strict customer patch).
2026-10-28
self-hostedbf16reasoning off
| Domain | pass^1 | Higher k | Sims | Infra errors | Agent cost / task | Transcripts |
|---|
| AirlineInstruction following | 60.0% | — | 50 | 0 | $0.0098 | View → |
| RetailTool calling | 78.1% | — | 114 | 0 | $0.0096 | View → |
| TelecomReasoning | 73.7% | — | 114 | 0 | $0.0174 | View → |