Updated Thoughts on AI
Summary
Six months after his first wave of AI essays, Rocklin updates his thinking with one central revision: AI's surprising value isn't super-human depth but super-human breadth. AI rarely beats the best human specialist in a narrow field, but it can be a B+ engineer, lawyer, and accountant simultaneously—and most real, valuable work lives in the cracks between disciplines where humans collaborate poorly. His second major theme is building feedback systems so agents can converge on good answers autonomously: give them broad context, fast and thorough feedback, and stay human enough to notice when work feels wrong. He illustrates with examples from running Coiled (connecting agents to QuickBooks, contracts, logs, and legal docs), rebuilding Dask in Rust to expose telemetry for agents, and a Python profiler (Wiretapp) that lets agents query execution. He concludes that the job has shifted from understanding systems in detail to building systems that understand and improve themselves—while humans must get better at stepping back and thinking.
Key Insight
AI's transformative power lies in its breadth across disciplines and its ability to self-improve when given broad context and strong feedback systems, shifting the human's job from mastering systems to building systems that improve themselves.
Spicy Quotes (click to share)
- 8
The surprising value of AI today isn't super-human depth. It's super-human breadth.
- 8
AI can be a B+ engineer and a B+ lawyer and a B+ accountant at the same time. That turns out to be extremely useful.
- 7
AI can hold more breadth of expertise in its head, removing the need to communicate.
- 8
I would take a dumb model with good feedback over a smart model without feedback any day.
- 4
My job stopped being to understand the system in detail, but rather to build systems so that it can understand and improve itself.
- 3
Again, this is the point: agents get better when the environment talks back.
- 5
It turns out that retirement for me looks a lot like work, just more interesting and fun.
- 6
Productivity is seductive. I haven't figured out yet if my goal is to remain productive while still feeling unburdened, or if my goal is to train myself out of wanting to feel productive.
Tone
reflective
