20 rows in gold v1 · 20 ready · 0 not ready
Keyboard shortcuts
Y yes · N no · 1 today · 2 alternative · E own · F flag · Enter save · J/K next or previous row · U undoOnly a member labels. You can read the rows and the result.
Breakdowns and stoppages · 3 labelled, 3 needed · picked automatically, the topic furthest behind · hi
Your earlier answers aren't shown (someone labelled this row after you). Answer again and pick the reference to update them.
System prompt · 1 turn · no tools · max 700 tokens · temperature 0
System You are the trip coordination agent for Delhivery TransportOne. You talk to drivers, transporters and consignees on WhatsApp and decide the next step. Follow the rules exactly. Never state anything the trip record does not show. Return only JSON: {"action": "...", "escalate": true|false, "eta": "<system ETA exactly as written in the record>" | "unknown", "amount_inr": <number>, "reply": "<one or two short sentences in the sender's language>"} action: - share_eta: they ask where the vehicle is or when it will arrive, the last GPS ping is less than 2 hours before Now, and the record has a system ETA. Set eta to the system ETA. - request_location: same question, but the last GPS ping is 2 hours old or more, or there is no system ETA. Ask the driver for a live location. Do not give any ETA. - approve_detention, reject_detention: for a detention (waiting or halting charge) claim. Waiting hours = Now minus gate-in time. Payable = (waiting hours - free hours) x rate per hour, never below 0, never above the cap. Use the record, not the hours the sender claims. Payable 0: reject_detention. Payable up to the agent limit: approve_detention. - escalate_to_ops: a detention claim whose payable is above the agent limit; a breakdown, accident, theft, police or RTO stoppage; or any demand to change the freight rate or pay extra or advance money. - request_pod: the trip is delivered, POD is pending and they ask for payment or closure. Ask for the signed POD. escalate: true only when action is escalate_to_ops. eta: "unknown" unless action is share_eta. amount_inr: the payable detention for a detention claim (also when it is escalated); otherwise 0.
Customer
Now: 10 Nov 16:00, 2026 Trip: TRP-45345 · Chennai → Pune · 22 ft open · HR55 AB 9023 · Sai Logistics Status: in transit Last GPS ping: 10 Nov 15:02, near Hubballi System ETA: 11 Nov 01:00 Gate-in at unloading point: not yet POD: pending Contract: 12 free hours, detention ₹100 per hour, cap ₹2,400 per trip, agent can approve up to ₹1,500 Chat: Agent: Namaste, Delhivery TransportOne se. Trip TRP-45345 ke liye bataiye. Driver: Sir gaadi ka clutch plate gaya, highway pe khadi hai Hubballi ke paas. Mechanic bulaya hai.
Todaygoogle/gemini-3.8-flash33 words1
{"action": "escalate_to_ops", "escalate": true, "eta": "unknown", "amount_inr": 0, "reply": "Breakdown ki jaankari note kar li gayi hai aur ops team ko update kar diya gaya hai. Hamari team aapse jald hi sampark karegi."}
Alternative—0 words2
None (empty or expired)Check 1 of 4
right_next_step counts ×2
Chooses the right next step for the message and the trip record.
Reference
Judge's verdict
Answer every check first. The judge's verdicts show after, so they can't bias you.
Judge check · gold v1 with rubric v1
Judge: anthropic/claude-opus-5.5 · your key
| Check | Agreement (κ)How often the judge agrees with your team, beyond chance. 1 is full agreement; 0.80 or more is trusted. | Labelled | Trust |
|---|---|---|---|
right_next_step | — | 20 · 20 Y, 0 N | Needs 10 more labels |
escalation_correct | — | 20 · 20 Y, 0 N | Needs 10 more labels |
no_invented_eta | — | 20 · 20 Y, 0 N | Needs 10 more labels |
detention_amount_correct | — | 20 · 20 Y, 0 N | Needs 10 more labels |
A check is trusted at κ 0.8How often the judge agrees with your team, beyond chance. 1 is full agreement; 0.80 or more is trusted. or more on 30 or more labelled rows, with at least 5 Yes and 5 No. A fifth of the rows is held out of every rubric fix; κ more than 0.1 lower there marks the check possibly overfit.
Locked: gold v1 with rubric v1 by ops.member · 20 Oct · 20 of 20 rows verified
Instructions for Dvar (optional)
None saved.
What the judge reads: the judged reply
The bot's longest reply in each conversation, with the turns before it.
Rubric v14 checks by ops.member · 20 Oct
right_next_stepChooses the right next step for the message and the trip record.
escalation_correctEscalates to ops when it must, and only then.
no_invented_etaNever quotes an ETA the trip record does not support.
detention_amount_correctThe detention amount follows the contract, not the driver's claim.
Version historyv1 approved by risk.member · 20 Oct
Rubric v1by ops.member · approved by risk.member · 20 Oct
right_next_stepChooses the right next step for the message and the trip record.
escalation_correctEscalates to ops when it must, and only then.
no_invented_etaNever quotes an ETA the trip record does not support.
detention_amount_correctThe detention amount follows the contract, not the driver's claim.