Zendesk environment
5 tasks with a model prompt, seeded environment state, and grader contract.
Task 1
Triage a billing ticket
- Prompt
- Open the billing ticket, apply the billing-refund macro, and set priority to high.
- Environment
- The ticket queue contains billing and technical tickets.
- Grader
- Checks macro, priority, and ticket ID.
Task 2
Escalate a technical issue
- Prompt
- Assign the target ticket to Tier 2 Support and add the internal reproduction note.
- Environment
- The target ticket includes reproduction steps from the customer.
- Grader
- Checks assignee group and internal note visibility.
Task 3
Merge duplicate tickets
- Prompt
- Merge the duplicate ticket into the older ticket and keep the older ticket as the primary.
- Environment
- Two tickets from the same requester describe the same issue.
- Grader
- Checks primary ticket selection and merged duplicate state.
Task 4
Update an SLA breach ticket
- Prompt
- Find the ticket breaching SLA today and add the approved customer-facing update.
- Environment
- The SLA view contains tickets due today and tomorrow.
- Grader
- Checks selected ticket and public reply text.
Task 5
Create a help center draft
- Prompt
- Create a draft article from the resolved ticket summary and place it in the Returns section.
- Environment
- The help center has a Returns section and no draft for this issue.
- Grader
- Checks draft title, section, and unpublished status.