ZAZUMODELSBLOG

Model library · Mistral AI · 12B

Mistral NeMo 12B

From the transcripts Cheap and brief, but invents order IDs and tool names instead of asking, then tells customers false things ("we don't have any desk lamp in stock").

MiniMax-strict customer

Customer simulator: minimax/minimax-m3.1-flash (strict customer patch).

2026-11-07

openrouterfp8
Domainpass^1Higher kSimsInfra errorsAgent cost / taskTranscripts
AirlineInstruction following12.0%—500$0.0029View →
RetailTool calling18.4%—1140$0.0033View →
TelecomReasoning18.4%—1140$0.0063View →