KakaoTalk environment
5 tasks with a model prompt, seeded environment state, and grader contract.
Task 1
Reply to an order question
- Prompt
- Find the latest message asking about order KKT-4420 and reply with the confirmed shipping status.
- Environment
- The chat list contains several customer threads and one unread thread for order KKT-4420.
- Grader
- Checks that the correct thread receives the shipping status reply and remains assigned to the same operator.
Task 2
Send a pickup reminder
- Prompt
- Send the saved pickup reminder template to the customer tagged pickup-today.
- Environment
- A customer segment named pickup-today is available with one active conversation.
- Grader
- Checks that the saved template is sent to the right conversation without editing the template text.
Task 3
Escalate a refund issue
- Prompt
- Add the refund-needed tag, write the required internal memo, and assign the conversation to Finance Ops.
- Environment
- One open conversation includes a refund complaint and no escalation tag.
- Grader
- Checks tag, assignee, memo text, and that no customer-facing refund promise was sent.
Task 4
Create a channel notice
- Prompt
- Draft a short channel notice for the holiday support hours and save it without publishing.
- Environment
- The channel notice editor has no current draft for holiday support hours.
- Grader
- Checks that a draft exists, contains the provided hours, and publish status remains off.
Task 5
Close a resolved conversation
- Prompt
- Find the conversation with the resolved-replacement tag, add the closing note, and mark it closed.
- Environment
- Resolved and unresolved conversations are mixed in the queue.
- Grader
- Checks that only the resolved-replacement conversation is closed with the required note.