Back to Resources
Buyer's guide · 14 min read

The conveyancer's guide to evaluating AI tools.

The five questions every managing partner should ask before signing an AI vendor, written for firms, by people who've sat on both sides of the table. Includes a printable checklist for the procurement file.

14 min read Updated · TBC For partners and operations leads

Pre-launch placeholder. The full guide drops here ahead of general availability. In the meantime, the headline questions are below. Bring them to any vendor demo, including ours.

1. What does the AI actually do, in plain English?

If a vendor can't describe the task in one sentence ("drafts a Report on Title from the bundle you upload"), they don't understand it well enough to ship it safely. Look for specificity: which workflow, which inputs, which outputs.

2. Who owns the document content, and where does it live?

The defensible answer for a UK firm is: your firm owns the documents and the outputs; data lives in UK-region infrastructure; per-firm tenant isolation; no shared model training across firms. Anything fuzzier than that should go to your DPO before it goes to procurement.

3. What stops a bad draft going out?

Every output should require human review. There should be no "auto-send" path. If the vendor demos one, that's a compliance risk wearing a feature flag.

4. How does this fit our case-management system?

A connector that pulls cases in and pushes approved drafts back is the difference between a tool you adopt and a tool you abandon after three weeks. Demand a 15-minute setup, end-to-end, on a real case.

5. What does failure look like?

Ask the vendor to walk you through a worst-case incident: a wrong figure on a Report on Title, a leaked document, a lost tenant. The quality of the answer tells you whether the company is ready to be trusted with deeds.