Discussion about this post

User's avatar
Om Prakash Pant's avatar

A lot of the risk comes from permission sprawl happening gradually.

One integration gets added for convenience, then another, and over time nobody really has a clear mental model of what the agent can actually access or trigger across systems.

Mike Schlottman's avatar

Excellent piece!

The highest-risk capabilities to cut first are autonomous, state-changing actions: any agent that processes untrustworthy inputs, touches sensitive data, transfers money, sends external communications, or deletes files without a human approval step.

Reversibility is the dividing line because a bad summary can be rewritten, but a wire transfer or sent email lives on regardless of whether the AI was being helpful or hijacked. Cut the irreversible powers first, then layer convenience back in only where the blast radius is small. Unless you envy PocketOS or Replit permanently wiping data.

2 more comments...

No posts

Ready for more?