Judging AI governance

Where does your data go when people use AI?

Short answerIt should go to a named destination, for a named retention period, with a clear statement on training use and a contract term behind all three. If nobody can say where it goes, nobody drew the boundary, and there is nothing to enforce later.

The question works because it turns a security question into a location question, and location is a fact. "Secure" is a judgment a vendor makes about itself. "Held in this region, retained this long, never used for training, under this contract term" can be checked by someone who was never in the room.

Four things a complete answer names

  • Destination. Where prompts and attached documents are processed and held.
  • Retention. How long they are kept.
  • Training use. Whether they are used to train or improve a model.
  • Contract term. The clause that commits the supplier to the first three, and who is able to change it.

Most prompts do leave the building

In most enterprise deployments the prompt leaves the organization. That can be perfectly acceptable. The trouble starts when nobody can say where it goes. Then nobody has drawn the boundary, and a rule about data has no edge to be enforced at.

Two panels. Today, on a consumer tool: the organization's control ends at the employee, who types a request; no policy is applied and nothing checks it before it leaves for a vendor's model, whose retention is set by the vendor's terms, with no record the organization can reach. On a governed deployment: the same employee's request passes the organization's policy, written by its team and checked at runtime, then goes to a model the organization chose, hosted where it decides, with a record it can produce.
The same employee and the same request. What moves is the boundary: on a consumer tool it ends at the keyboard, and on a governed deployment it encloses the policy, the model, and the record.

How to ask it

A good answer
A specific destination, a named retention period, and a clear statement on training use, with a contract term behind it.
An evasion
"Your data is secure." "Enterprise-grade privacy." Both answer a question about security. The question was about destination.
The follow-up
Show me where that is written down, and tell me who can change it.

What to check

  • Take the AI tool your people use most and put the four questions to its supplier in writing.
  • Find the contract clause behind each answer. A sales deck or an FAQ describes; the clause commits.
  • Ask who on either side can change those terms, and how you would hear about it.

Sources

  1. National Institute of Standards and Technology, AI Risk Management Framework 1.0. Trustworthiness characteristics, including privacy and accountability.

Reviewed