Xcelerate
Menu
Get in touch
All articles

Applied AI

Choosing a first AI pilot for a council team

Use a public service question to define the source material, the human review and the test that will decide whether to go further.

Colleagues compare an AI draft response with its recycling guidance source.
AI-generated editorial image.

A council service desk gets the same question each month. A resident wants to know what can go into their recycling bin. An AI pilot could test whether a staff member can find the council’s current answer more quickly. That is a small enough question to investigate, and the team can tell when an answer is wrong.

Write the job in one sentence

Try this brief. “Given a resident’s question and our published collection guide, prepare a draft reply for a service adviser and show the passage it comes from.” A staff member checks the reply before sending it. The pilot ends at that check. Changing a collection booking or deciding a complaint would need a different brief.

Put the same questions to the existing search box. Record how long it takes an adviser to find and confirm the answer. That gives the team a comparison and may reveal a simpler fix, such as renaming a hard-to-find guide.

Choose the material together

Give one service owner responsibility for the approved source list. Record the URL, publication date and owner of each guide. Include an example where the old guide and the new one disagree. The expected response should point to the current version or ask the adviser to resolve the conflict.

Use invented enquiries during the first test. A genuine email can include names, addresses and circumstances that the pilot does not need. The Office of the Privacy Commissioner recommends assessing privacy impacts before adopting generative AI and involving affected communities, including Māori. Ask whose information or language the service handles, who should help set the test, and how they can change its scope. Read the Commissioner’s guidance.

Give the reviewer an answer key

Choose varied questions before trying a model. Include a straightforward item, a misspelling, an item the guide omits and a question about another district. For each, write down the acceptable answer or the point at which the adviser should ask for help. A fluent reply about the wrong district counts as an error.

Have reviewers mark the source, factual accuracy, time to check and any correction they had to make. Keep the difficult cases alongside the successes. A short draft that takes longer to verify than an ordinary search is important evidence.

Decide what earns another trial

Agree the stop conditions with the service owner. For this example, an invented collection rule would pause the trial while the team investigates. Keep a record of that decision and the affected questions. If the pilot proceeds, name the person who will retest it when the council changes a rule.

The same brief can support a supplier conversation. Share the sample questions, approved sources, reviewer’s role and evidence you expect at handover. Prepare a council software brief.