with-agents

Concepts & capabilities

Model behavior, learning, reasoning, representations, and how capabilities are evaluated.

Topics

Showing 10 resources

Labels reflect relevance within this catalog, not source reliability or freshness. Unlabeled resources are ungraded.

What do the labels mean?
Essential
—
A starting point or working reference.
Useful
—
Adds distinct examples or perspectives.
Context
—
Background or supplementary coverage.

Source caveats apply at every level.

Resources

Gemini 4 Argon: What’s new and what’s next

Podcast

Useful — Explains writing feedback and model-assisted research workflows, and distinguishes long reasoning from many tool turns; internal results remain vendor reports.

Google's Release Notes on writing quality, model-building agents, long reasoning, and review

Logan Kilpatrick and Google's product and research team discuss Argon's writing feedback, agents assisting model development, engineering use cases, long-decode reasoning, and balancing persistence with clarification. They recommend scrutinizing and iterating on outputs. A first-party launch conversation with internal anecdotes, not independent evidence of reliability or autonomous self-improvement.

Google for DevelopersOct 14, 2026
Models & evaluationContext & memoryReview & verificationTools & harnesses

Gemini 4 Argon and Muse Wonder

Video

Context — Offers an early practitioner perspective on document quality versus coding performance; benchmark criticism is unverified and token-limit claims need the linked documentation caveat.

Salvatore Sanfilippo on language quality, coding performance, and benchmark skepticism

Salvatore Sanfilippo contrasts his positive early impressions of Gemini 4 Argon's document understanding and concise writing with skepticism about Muse Wonder's benchmark claims. Italian-language opinion commentary, not a controlled model comparison. The summary separates his assessments from Google's documented shared token budget and introductory pricing.

Salvatore SanfilippoOct 14, 2026
Models & evaluationContext & memoryInformation & trust

WWC26-NA - 2026 in LLMs (so far)

Video

Useful — Provides a dated survey of agents, local models, costs, and security concerns while distinguishing personal observations from attributed incident reports.

Simon Willison on coding-agent progress, verification, costs, and human judgment

Simon Willison surveys 2026 through coding agents, personal agents, local models, software factories, and reported training-time security incidents. He argues that stronger agents shift engineering effort toward goals, constraints, verification, and product judgment. His demonstrations and capability assessments are personal observations; incident accounts are attributed reports, not independently verified here.

WeAreDevelopersSep 21, 2026
Models & evaluationTools & harnessesReview & verificationSafety & permissionsBusiness & adoption

ZiP — Salvatore Sanfilippo & Enkk

Playlist

Useful — Separates task reliability and useful-work evaluation from AGI labels, alongside speculative persistent-state discussion.

AI capabilities, evaluation, local models, and social implications

A combined episode guide to Salvatore Sanfilippo and Enkk's Italian-language conversations across both channels: coding-model workflows, local inference, AI safety, interpretability, text watermarking, AGI labels, and evaluation through useful work. The guide records summary coverage because the hosts' separate YouTube playlists are incomplete. Opinions, proposals, and project anecdotes are not controlled evaluation results.

Salvatore Sanfilippo & EnkkLatest summary: Sep 8, 2026
Models & evaluationReview & verificationContext & memorySafety & permissionsOpen source ecosystem

Sento puzza di AGI: Chollet, GPT Astra e Fable 5 1

Video

Context — Combines useful-work evaluation with model anecdotes and speculation, overlapping the fuller ZiP 5 discussion.

Salvatore Sanfilippo on reasoning, harnesses, and evaluating models through useful software optimizations

In Italian, Salvatore Sanfilippo interprets reported ARC-AGI reasoning results and argues that model evaluations should measure useful software improvements rather than rely on aggregate leaderboards. He proposes repeated Redis optimization tasks with a token budget and passing tests, and reports a Fable 5.1 inference-speed improvement in his Dwarf Star project. This is practitioner commentary: the speedup is anecdotal, the AGI conclusion is his interpretation, and the looping-transformer discussion is explicitly speculative.

Salvatore SanfilippoSep 4, 2026
Models & evaluationTools & harnessesReview & verification

Why AI Models Stop Learning — Rich Sutton and Khurram Javed

Video

Essential — Explains continual-learning mechanisms and limitations as a research proposal, not a demonstrated frontier-model replacement.

Continual learning, the Big World Hypothesis, and a research path beyond frozen model weights

Rich Sutton and Khurram Javed argue that deployed LLMs stay static because their weights do not update from experience. They propose continual learning from the real world, per-weight step-size optimization, Continual Backprop, and self-discovered abstractions as a path toward agents that keep adapting. Their claims about synthetic data, forgetting, and replacing the current LLM paradigm describe Oak Lab’s research agenda, not a system demonstrated at frontier scale.

Sequoia CapitalAug 18, 2026
Context & memoryModels & evaluation

AI concepts — Salvatore Sanfilippo

Playlist

Essential — Offers a broad conceptual route through representations and evaluation, framed as a research notebook with speculative material.

An Italian-language research notebook on model representations, reasoning, interpretability, architecture claims, open weights, local inference, efficiency, and speculative questions about AI and cosmology. The guided summary frames the playlist as conceptual grounding for evaluating coding agents rather than as a settled theory of AI.

Salvatore SanfilippoAug 9, 2026
Models & evaluationTools & harnessesOpen source ecosystem

Ending AI Slop — Thais Castello Branco, Taste Labs

Video

Essential — Explains how to separate verifiable attributes from human preferences and preserve meaningful disagreement in evaluation.

Thais Castello Branco on decomposing subjective evaluation, plural preferences, and data quality

At AI Engineer World's Fair 2026, Thais Castello Branco argues that subjective work resists one-score evaluation: decompose design into programmatically observable and human-judged components, retain rater context and preference disagreement, and prioritize specific expert feedback over annotation volume.

AI EngineerJul 31, 2026
Models & evaluationReview & verification

AI and eCommerce with Shopify CEO Tobias Lütke

Podcast

Useful — Distinguishes operating a browser from predictive validity and commercial outcomes in shopper-agent evaluation; product benefits remain participant accounts.

Shopper-agent simulation, outcome signals, and human–AI evaluation

Tobi Lütke, Richard Sutton, Sendhil Mullainathan, and fellow panelists examine Shopify's SimGym shopper agents, which navigate stores through a vision-model browser loop. They distinguish interface operation, predictive validity, real commercial outcomes, and benchmarks for people working with AI. Product accuracy and benefits are participant accounts, not independent evaluations.

Intrepid Growth PartnersDec 18, 2025
Models & evaluationTools & harnessesBusiness & adoptionCollaboration & teams

Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity

Podcast

Useful — Connects scaling, model steering, safety policy, and interpretability while remaining a first-party and historically dated account.

Scaling, model steering, computer use, prompting, and mechanistic interpretability

Lex Fridman interviews Anthropic's Dario Amodei on scaling, computer use, and safety; Amanda Askell on prompting and constitutional AI; and Chris Olah on how neural networks compute. The episode combines technical explanations with Anthropic leaders' first-party accounts and dated forecasts; it is not an independent evaluation of Claude's capabilities or safety.

Lex FridmanNov 11, 2024
Models & evaluationSafety & permissionsTools & harnessesBusiness & adoption

Search

Search field guides and resources across the site.

    Keyboard shortcuts

    Press ? to open this guide (usually Shift + /). Close it before using other site shortcuts.

    Show keyboard shortcuts
    ?
    Search site
    Ctrl + K
    Close the current dialog or menu
    Esc

    Site shortcuts are ignored while typing. Browser and extension shortcuts may take priority.