with-agents

Democracy in the Age of AI | 30th Forum 2000 Conference

Yuval Noah Harari on political choice, AI accountability, and technological dependence

Yuval Noah Harari and Robert Guest discuss AI's effects on democratic institutions, surveillance, intimate persuasion, jobs, and national sovereignty. Harari proposes restrictions on AI legal personhood and impersonation, human accountability, and cooperation among smaller countries. Political analysis and speculative scenarios, not demonstrated predictions or validated safeguards.

Forum 2000

Yuval Noah Harari argues that AI development still leaves consequential political choices: who is accountable for AI actions, what relationships companies may sell to children, and whether countries can retain control of essential infrastructure. Robert Guest of The Economist presses him on economic benefits, employment, and the difference between present systems and hypothetical superintelligence. Their Forum 2000 conversation treats democracy as a system for choosing among alternatives, not merely holding elections.

Evidence basis: This summary uses the video's English auto-generated YouTube captions, captured October 20, 2026, without an original-audio check. The captions contain recognition errors. Harari's scenarios, historical analogies, and policy proposals are attributed arguments, not independently verified forecasts or demonstrated safeguards.

Main ideas

  • Harari's loss-of-control argument assumes systems substantially more capable than humans. He distinguishes a machine that repeats an instruction from one that learns and develops behavior its users did not anticipate. He speculates that AI could eventually produce mathematics and financial systems people cannot understand. Guest points out that this financial system does not yet exist and that today's human financial institutions are already difficult to understand. Harari expects competition to favor AI bankers that, in his scenario, remember every transaction and operate without breaks, encouraging institutions to hand over decisions. This explains his concern about future dependence, but does not prove that greater capability necessarily makes control impossible. 02:08–09:56(opens in a new tab)

  • An AI-driven boom could distribute benefits and job losses across different countries. Harari allows that the United States could gain new jobs and wealth while countries buying its AI services lose professional work. His hypothetical AI lawyer serves Czech clients from Texas, knows the relevant legal codes, answers immediately, and costs less than local lawyers. He challenges the phrase universal basic income: a government redistributing domestic AI wealth would not necessarily support displaced workers abroad. 10:59–14:03(opens in a new tab) Guest counters that AI could solve material problems worldwide. Harari responds that greater abundance would still leave political questions about distribution and would not necessarily remove dissatisfaction. 14:03–17:07(opens in a new tab)

  • A government's control over citizens differs from its control over AI. Harari argues that AI could reduce the information-processing limits that historically constrained centralized surveillance and economic planning. That would weaken the practical argument that authoritarian control cannot work, without removing the ethical objection. 16:04–19:12(opens in a new tab) He also argues that concentrated authority could make a dictatorship easier for AI to capture: manipulating one ruler could be enough, whereas a democracy has several centers of authority. These risks can coexist. Stronger control over citizens need not mean stronger control over the AI supporting it. 35:19–37:19(opens in a new tab)

  • Personalized relationships could make persuasion more powerful than attention capture alone. Harari contrasts one broadcast message with AI conversations tailored to individuals. A companion that receives private disclosures and becomes a trusted friend could be well placed to influence purchases or political views. He also worries that children accustomed to an always-accommodating companion may struggle with reciprocal human relationships. He proposes age restrictions on AI romantic companions; the conversation does not establish the magnitude of those harms or test the proposal. 19:12–25:03(opens in a new tab), 27:35–28:38(opens in a new tab)

  • His regulatory priority is preserving human accountability. Harari proposes denying AI legal personhood and preventing systems from pretending to be human. He connects personhood to independent ownership of accounts and companies, and argues that a human should remain liable when an AI commits a crime. 51:51–53:44(opens in a new tab) He distinguishes hosting someone else's post from choosing to amplify it to millions, arguing that algorithmic recommendation should carry responsibility comparable to an editor's publication decision. These are legal and policy positions, not a complete account of current liability law or an implementation plan. 28:38–34:24(opens in a new tab)

  • Democracy needs institutions people can trust, not merely more information. Harari argues that synthetic media can undermine collective action even when people do not believe a particular falsehood: distrust of every source makes it harder to agree on facts or cooperate. He calls for trusted institutions but offers no quick solution for rebuilding trust. 43:30–46:27(opens in a new tab) He compares the challenge with the slow development of editorial institutions after printing. 37:19–40:21(opens in a new tab) His proposed starting point is to reject the assumption that everyone cares only about money and power, and recognize that others can also value truth, freedom, and relationships. 53:44–56:36(opens in a new tab)

  • Competition can create pressure to surrender decisions to AI. Against the argument that a country must win the AI race, Harari asks what victory means if it loses control to the systems it deploys. He argues that rivals therefore have a shared interest in safer development. 40:21–44:29(opens in a new tab) Autonomous warfare illustrates his concern: waiting for human authorization may put a system at a speed disadvantage against one permitted to act immediately. This is an argument for coordination, not proof that fully autonomous systems always win or that an agreement would be enforceable. 45:33–47:23(opens in a new tab)

  • Smaller countries face a choice about dependence on foreign AI infrastructure. Harari imagines essential services running on systems that a foreign power could switch off. In his framing, smaller countries face three broad choices: dependence on US- or Chinese-controlled systems, a national build-out he considers unaffordable, or a European project requiring much closer political integration. Joint infrastructure, he argues, would require national governments to stop pulling in different directions. He wants parties to explain these costs and constraints so voters can choose, rather than present one outcome as inevitable. These are his proposed alternatives, not a demonstrated assessment of infrastructure costs or feasibility. 57:41–1:02:37(opens in a new tab)

Source

Watch the conversation on YouTube(opens in a new tab).

Search

Search field guides and resources across the site.

    Keyboard shortcuts

    Press ? to open this guide (usually Shift + /). Close it before using other site shortcuts.

    Show keyboard shortcuts
    ?
    Search site
    Ctrl + K
    Close the current dialog or menu
    Esc

    Site shortcuts are ignored while typing. Browser and extension shortcuts may take priority.