Discussion about this post

User's avatar
Tristan Doberhaus's avatar

AI harness -> let the chaos in ;)

The Arriving Future's avatar

A spreadsheet error on a smuggled-in PC sat in front of a human who caught it before it became an action. What got reined in, on that analogy, was visibility and procurement, not correctness. Agents inside an "Agent Habitat" are different: the chaos being contained includes agents executing changes to data, money and customer state, not just accumulating unauthorised hardware.

That changes what "reining in just the right amount" means. Permissions and audit logs are necessary but don't touch the harder constraint: how cheaply you can verify an agent's output was correct before it acts. The companies that go self-driving look more likely to cluster where that verification is cheap, not where the habitat is best designed.

13 more comments...

No posts

Ready for more?