Model library · Grok 4.20 · 2026-10-27
Retail simulations
Tests tool calling on order changes.
| Task | Trial | Result | Ended | Messages | Cost | |
|---|---|---|---|---|---|---|
| 10 | 0 | fail | user_stop | 37 | $0.139 | Transcript → |
| 105 | 0 | fail | user_stop | 39 | $0.181 | Transcript → |
| 19 | 0 | fail | user_stop | 45 | $0.212 | Transcript → |
| 22 | 0 | fail | user_stop | 38 | $0.150 | Transcript → |
| 32 | 0 | fail | user_stop | 70 | $0.363 | Transcript → |
| 39 | 0 | fail | user_stop | 32 | $0.140 | Transcript → |
| 57 | 0 | fail | user_stop | 28 | $0.105 | Transcript → |
| 59 | 0 | fail | user_stop | 21 | $0.074 | Transcript → |
| 64 | 0 | fail | user_stop | 36 | $0.139 | Transcript → |
| 76 | 0 | fail | user_stop | 52 | $0.237 | Transcript → |
| 8 | 0 | fail | user_stop | 36 | $0.146 | Transcript → |
| 80 | 0 | fail | user_stop | 44 | $0.201 | Transcript → |
| 91 | 0 | fail | user_stop | 36 | $0.142 | Transcript → |
| 98 | 0 | fail | user_stop | 60 | $0.349 | Transcript → |