Field Note

The bottleneck moves when AI writes the code

A mountain ridgeline at sunset
A mountain ridgeline at sunset.

I have watched AI write in minutes what would have taken me days. I have also watched it burn a context window rebuilding the wrong thing at impressive speed.

The implementation step gets cheaper. The bottleneck does not disappear. It moves into context, review, integration, testing, and ownership because the team can now produce change faster than it can safely understand it.

That is a useful trade. It just needs to be managed like one.

Faster output changes the queue

Traditional delivery often has an obvious implementation queue. There are more requested changes than the team can code. AI can cut into that queue quickly.

Then something predictable happens: review backs up. Test environments become the constraint. Product decisions that were hidden behind “engineering capacity” have to be made. Integration questions arrive earlier. Somebody has to decide whether the generated result fits the system instead of merely working in isolation.

The work did not disappear. More of it moved toward judgment.

This is why measuring AI by developer throughput is incomplete. A team can merge twice as much code and still release at the same rate. It can also release twice as often while increasing recovery time and support load. Both look productive if the dashboard stops at the pull request.

Context becomes production infrastructure

An experienced developer carries a lot of invisible system context: naming conventions, brittle integrations, deployment rules, past incidents, security boundaries, and the parts of the platform nobody touches on Friday afternoon.

An agent does not magically inherit that context. It needs access to accurate instructions, current architecture, testable contracts, and the actual repository. If the context is wrong, the model can produce a clean implementation of the wrong thing at impressive speed.

So the quality of the context layer matters. Repository guidance, architecture decisions, interface contracts, examples, and automated checks stop being documentation somebody may read later. They become inputs to the implementation system.

Bad documentation was always expensive. AI makes the bill arrive faster.

Review has to move up a level

Line-by-line review still matters, but it is not enough. The harder questions are usually outside the generated function:

  • Is this the right boundary?
  • Does another service already own this state?
  • What happens when the dependency is slow or unavailable?
  • Did the change create a second source of truth?
  • Can the team support this six months from now?

AI is good at producing locally plausible code. Enterprise systems fail globally. The review process has to connect those two facts.

That may mean smaller changes, stronger contract tests, architecture checks, better observability, or a named person responsible for the whole path. Probably all of the above in different amounts.

Measure the intervention rate

The metric I care about is not how much code the agent generated. It is how much human intervention was required to make the result safe and repeatable.

Track where people had to step in: misunderstood requirements, platform-specific corrections, failed tests, integration mismatches, security changes, deployment repairs, and production recovery. Those interventions show where the system needs better context, better tools, or actual expertise.

Over time, the useful question is whether the intervention rate falls without quality falling with it.

If it does, the delivery model is improving. If it does not, the team may simply be producing more things to review.

The operating model is the product

The durable advantage will not come from having access to the same coding model everyone else can buy. It will come from how a team packages context, makes decisions, tests outcomes, and learns from failure.

That is an operating model, not a prompt library.

AI can make implementation dramatically faster. Great.

Now the organization has to get good at everything around implementation.

That was always the real work. AI just removed the place we used to hide it.

Field Notes

More Field Notes.