ZAZUMODELSBLOG

Model library · Google · 31B

Gemma 4 31B

From the transcripts Brief and never thinks out loud, unlike the 12B, but gives up on telecom: it hands customers to a human in 54 of 114 chats, and all 34 of its telecom failures end that way.

MiniMax-strict customer

Customer simulator: minimax/minimax-m3.1-flash (strict customer patch).

2026-11-09

openrouterreasoning off
Domainpass^1Higher kSimsInfra errorsAgent cost / taskTranscripts
AirlineInstruction following60.0%—500$0.0146View →
RetailTool calling79.0%—1140$0.0173View →
TelecomReasoning70.2%—1140$0.0229View →