with-agents

How AI Is Changing Software Development with Simon Willison

How AI is changing software development with Simon Willison

Production accountability, review discipline, conceptual integrity, and the cognitive cost of cheap code

Claire Giordano interviews Simon Willison about delegating implementation to coding agents while keeping understanding and accountability for production software. Willison uses explicit success criteria, red-green TDD, small reviewable changes, and aggressive nitpicking, and he discards off-concept generated features to protect conceptual integrity. His speed, cost, security, and labor observations are practitioner reports and forecasts, not controlled measurements.

Talking Postgres

Talking Postgres host Claire Giordano interviews independent open-source developer Simon Willison about an agent-assisted workflow in which implementation can become dramatically faster while production responsibility stays with the engineer. Willison's shipping threshold is whether he understands a change well enough to explain it to someone else 22:51–23:22(opens in a new tab). His speed, token-cost, model-capability, security, and labor observations remain practitioner reports and forecasts rather than controlled findings 04:00–12:09(opens in a new tab), 34:50–38:42(opens in a new tab), 1:02:05–1:04:07(opens in a new tab), 1:13:32–1:14:30(opens in a new tab).

Key Points Covered

  • Domain experience shapes effective delegation: Willison's two-paragraph research-spike prompt names the existing project, target API, databases, repository setup, test framework, and development loop. He attributes the result to accumulated knowledge of both the domain and agent behavior, not to a general promise that short prompts reliably produce production software 07:15–10:59(opens in a new tab).
  • Tests provide feedback, not automatic assurance: Red-green TDD makes an agent exercise the code it writes and a shared pytest fixture runs behavior across three database engines. Willison also says he had hardly reviewed the generated tests, so the reported hundred-test suite was evidence for a research spike rather than a production-quality conclusion 08:57–10:59(opens in a new tab).
  • Bounded parallel work can recover neglected maintenance: He delegates diagnosis of small irritants and triage of open issues, then reviews small changes or uses the resulting momentum for larger work. The agent can hold task context across interruptions, but consequential work becomes a closer collaboration rather than an unattended side quest 15:56–22:51(opens in a new tab).
  • Explanation is the production gate: Willison accepts code only when he can account for how it works. For large generated changes, he uses an intentionally aggressive nitpicking review to force active engagement with nearly every line instead of trusting a passive read-through 22:51–23:22(opens in a new tab), 30:49–33:28(opens in a new tab).
  • A working branch is not a maintained product: A claimed 39% Datasette optimization remains unmerged because passing tests and a promising benchmark do not remove the time needed to understand, test, document, and maintain the change. The episode supplies no benchmark design or independent measurement for that figure 34:02–37:50(opens in a new tab).
  • Cheap features increase the need for product discipline: When implementation no longer filters ideas by cost, software can accumulate unrelated additions like the Winchester Mystery House. Willison recommends preserving conceptual integrity, treating generated code as disposable, and keeping experiments in an isolated release valve rather than merging every successful prototype 45:03–51:57(opens in a new tab).
  • Management and QA skills transfer directly: Breaking work into clear goals, communicating needed context, and defining testable completion criteria resemble engineering management and product work. Willison argues that specialist QA skills become more valuable when generation is cheap but humans remain responsible for finding edge cases 1:00:56–1:06:07(opens in a new tab).
  • Writing and credibility still require human ownership: He treats writing as thinking, rejects forwarding generated prose that the sender cannot defend, and says the human in the loop must protect readers and coworkers from model mistakes. Personal credibility depends on checking claims before sharing them 23:42–28:25(opens in a new tab), 1:07:53–1:10:07(opens in a new tab), 1:21:49–1:22:48(opens in a new tab).
  • Open-source review systems face a volume problem: Cheaper issue reports and pull requests can make each contribution individually useful while overwhelming maintainers in aggregate. The episode describes policy experiments and security-report pressure, but does not establish a generally successful governance pattern or quantify comparative defect outcomes 1:09:27–1:14:30(opens in a new tab).
  • Prefer the simplest workflow that works: Because many elaborate agent processes can still produce functioning software, success alone is weak evidence that the process caused the result. Willison recommends starting simply and adding technique only in response to an observed failure 1:23:57–1:25:33(opens in a new tab).

Full episode and show notes: https://talkingpostgres.com/episodes/how-ai-is-changing-software-development-with-simon-willison(opens in a new tab)

Official publisher transcript: https://talkingpostgres.com/episodes/how-ai-is-changing-software-development-with-simon-willison/transcript(opens in a new tab)

Search

Search field guides and resources across the site.

    Keyboard shortcuts

    Press ? to open this guide (usually Shift + /). Close it before using other site shortcuts.

    Show keyboard shortcuts
    ?
    Search site
    Ctrl + K
    Close the current dialog or menu
    Esc

    Site shortcuts are ignored while typing. Browser and extension shortcuts may take priority.