| Model | Quality | p99 | Cost / 1M traces | vs today | Result |
|---|---|---|---|---|---|
| Gemini 3.8 Flash Today | 100.0% | 13,939 ms | ₹1,07,253 | — | Today |
| Dvar GLM 5.3 Flash | 100.0% | 4,631 ms | ₹10,117 | −91% | Passes |
| Claude Sonnet 5.5 | 100.0% | 3,508 ms | ₹2,95,328 | +175% | Passes |
Dvar GLM 5.3 Flash passes every check: the same quality as today's model at 91% less cost. Indicative only: not every judge check is trusted.
Judge: 0 of 4 checks trusted.
Quality vs cost · up and left is better
| Topic | Gold rows | Today · Gemini 3.8 Flash | Candidate · Dvar GLM 5.3 Flash | Candidate · Claude Sonnet 5.5 | Status | ||
|---|---|---|---|---|---|---|---|
| Detention claims | 7 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | — |
| Where is the vehicle | 6 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | — |
| Breakdowns and stoppages | 3 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | — |
| Demands for more money | 2 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | — |
| Payment before POD | 2 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | — |
| All topics, weighted by traffic | 20 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 |