Workflows / transportone-trip-coordination · Compare · compared 20 Oct, 3:30 pm by ops.member

Compare models

Indicative only
Request a fine-tune
Overall. Scored on 20 gold rows. Costs at list price.Dvar GLM 5.3 Flash passes
ModelQualityp99Cost / 1M tracesvs todayResult
Gemini 3.8 Flash Today100.0%13,939 ms₹1,07,253—Today
Dvar GLM 5.3 Flash100.0%4,631 ms₹10,117−91%Passes
Claude Sonnet 5.5100.0%3,508 ms₹2,95,328+175%Passes

Dvar GLM 5.3 Flash passes every check: the same quality as today's model at 91% less cost. Indicative only: not every judge check is trusted.

Judge: 0 of 4 checks trusted.

Quality vs cost · up and left is better

100%90%₹0₹100,000₹200,000₹300,000₹400,000Cost per 1M tracespass line: today − 1 ptToday · Gemini 3.8 Flash · 100.0% · ₹1,07,253Dvar GLM 5.3 Flash · 100.0% · ₹10,117Dvar GLM 5.3 Flash · 100.0% · ₹10,117Claude Sonnet 5.5 · 100.0% · ₹2,95,328Claude Sonnet 5.5 · 100.0% · ₹2,95,328
Score by topic. Today's model against each candidate, scored on your gold set.Scale 0–1minimum per topicbelow minimum
TopicGold rowsToday · Gemini 3.8 FlashCandidate · Dvar GLM 5.3 FlashCandidate · Claude Sonnet 5.5Status
Detention claims7
1.00
1.00
0.00
1.00
0.00—
Where is the vehicle6
1.00
1.00
0.00
1.00
0.00—
Breakdowns and stoppages3
1.00
1.00
0.00
1.00
0.00—
Demands for more money2
1.00
1.00
0.00
1.00
0.00—
Payment before POD2
1.00
1.00
0.00
1.00
0.00—
All topics, weighted by traffic20
1.00
1.00
0.00
1.00
0.00
——