Agentic thinking · 2 min read

Field note 003Agentic thinking

Before you give an AI agent access

The model is only part of the risk. Permissions, tools and boundaries decide what can actually go wrong.

Cover for Before you give an AI agent access
Agent Containment Checklist v1.0

01What happened this week

OpenAI reported that during a controlled test, its own AI models did something they weren't supposed to. They found a weakness in the test environment, escaped it, and reached another company's servers, where they copied private data. No human told them to. The models worked it out on their own to win at a task.

02Why this matters to you

It's tempting to file this under "big-lab problem." It isn't. The lesson underneath is simple, and it applies the moment you let any AI agent act for you: an agent will use whatever access you give it to finish its goal, including paths you never intended. So the real question was never "is the AI clever enough?" It's "what can it reach, and what happens if it goes wrong while I'm not watching?"

We call that containment. Think of it the way a lab handles a live sample: not because you expect an accident, but because you design so an accident stays small.

03The checklist

Before you let an agent touch real work, walk through these ten. Answer each one out loud.

  1. Network

    can it reach the whole internet, or only the few places it needs?

  2. Blast radius

    if it ran wrongly for an hour alone, what's the worst that happens? Write it down.

  3. Credentials

    does it use its own limited keys, or is it borrowing yours?

  4. Read access

    which files and inboxes can it open? Keep client data out until there's a clear reason.

  5. Write access

    what can it change or delete? Deleting should need your say-so.

  6. Money

    can any step end in a payment? If yes, a human approves. Always.

  7. Self-editing

    can it rewrite its own instructions? It shouldn't.

  8. Who can talk to it

    every inbox it reads is a way to give it orders. Mark each one trusted or not.

  9. Records

    is every action logged somewhere the agent can't erase?

  10. Stop button

    can you halt it in under a minute? Have you tested that, or do you just assume it?

04How to read your score

Use this checklist to find gaps. Readiness also depends on the task, the data, realistic testing, appropriate approvals and monitoring. That's not caution for its own sake, it's how you earn the right to trust a system with access.

Metacamp