AI 行业热点

🎙️ 播客精选

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Training Data · 2026-08-18

Speaker 1 | 00:00 - 00:14
People think I have a radical point of view sometimes. They start questions saying how what I’m thinking is so different from everyone else. But I don’t see it that way at all. I see it as like I’m thinking the ordinary way. Just everyone else is thinking a bit weird.

Speaker 1 | 00:17 - 00:35
And I mean that like, you know, it’s just the recent times people are thinking weird. Before there was all this AI craziness, you talk about you wouldn’t have to say continual learning because it wouldn’t make any sense to talk about learning that wasn’t continual. All learning…

🎧 收听完整节目


🐦 X/Twitter 热点

Thibault Sottiaux (@thsottiaux)

  • If you still haven’t tried Codex but have considered it in the past, what’s the one thing holding you back? [2344 ❤️ 42 🔄]

Peter Yang (@petergyang)

  • Btw @drhoeflinger I just watched your videos and wow they’re so good. Keep going and thanks for sharing your knowledge
  • Trust is going to be the biggest barrier (and driver) of personal agent adoption. [28 ❤️]
  • Great advice [1333 ❤️ 49 🔄]

Nan Yu (@thenanyu)

  • Concerning
  • 🤞🏻 [167 ❤️ 1 🔄]
  • Some personal news—I’m joining OpenAI to work on Codex and ChatGPT.

I’m grateful to the Linear team for an incredible 4 years and proud of what we’ve built together. I look forward to bringing everything I’ve learned there about the craft of software into this next chapter. [3062 ❤️ 37 🔄]

Madhu Guru (@realmadhuguru)

  • If you’re a PM, there is immense alpha in understanding the model frontier for your specific product and use cases.

You should be able to answer the following better than most frontier lab researchers and PMs for your use cases:

1/ What can models in each size category do well today?

2/ Where does each model fail?

3/ What workarounds can you use to overcome these failures ?

4/ Given the trajectory, what will these models likely be able to do 2–3 months from now? How should your roadmap look given this?

This is a core part of the PM job now. [140 ❤️ 10 🔄]

Amjad Masad (@amasad)

  • Good iOS interaction tips! [30 ❤️ 2 🔄]

Guillermo Rauch (@rauchg)

  • Your next design system is… Markdown.

We wrote about how 𝙳𝙴𝚂𝙸𝙶𝙽.𝚖𝚍 is helping solve the hardest problem in AI today: slop.

And how you can truly, finally scale design taste within a large organization. [2443 ❤️ 103 🔄]

  • Coding tokens are basically infrastructure. Yet, the way companies have approached them amounts to:

“Hey all, here’s an AWS key. It can spin up anything from a 𝚝𝟹.𝚗𝚊𝚗𝚘 ($𝟹.𝟾𝟶/𝚖𝚘) to an 𝚙𝟻.𝟺𝟾𝚡𝚕𝚊𝚛𝚐𝚎 ($𝟺𝟶𝚔/𝚖𝚘). Go wild”

And obviously the reason companies don’t do this for their core infra is that you need to govern, optimize, and observe usage and costs.

The intern might decide to host a static website in that 192 vCPU machine, and you won’t be very happy about the bill.

AI Gateway fixes this for all your tokens, with per-key, and now per-user budgets. [250 ❤️ 7 🔄]

Aaron Levie (@levie)

  • Now that the base open weights AI models are getting far better, and post training infra is becoming more mature and commercialized, there are going to be all new plays for companies that have large amounts of data to have their own models.

Licensing data for external model training was previously the only play if you had a large corpus of information, but you can now reasonably go and train your own models as well without incurring the cost and complexity of competing with the labs on research.

The general purpose frontier models will still have a leg up in broad areas due to the ability to handle the widest set of tasks, but you can absolutely see a future where we have far more models than today across every vertical and domain. [119 ❤️ 13 🔄]

  • As AI security events pick up, it’s going to be critical that we have the most sophisticated AI agents for being able to detect and prevent security issues. Frontier models are clearly still ahead in cyber, but open models are catching up quickly. Wild times. [77 ❤️ 13 🔄]

Garry Tan (@garrytan)

  • Circleback is so much better than Granola, it’s not even close

Granola still doesn’t even support multiple person disambiguation [603 ❤️ 12 🔄]

  • I just made some new GBrain evals that help prove that my retrieval-for-AI-agent open source layer is SOTA for reading memory back without LLM-in-loop

And I’ve also added evals for memory-save from agent transcript, which is the best way to enrich your brain

Receipts at [403 ❤️ 33 🔄]

Nikunj Kothari (@nikunj)

  • [176 ❤️ 4 🔄]

Dan Shipper (@danshipper)

  • had me in the first half [27 ❤️]
  • Anthropomorphization of AI is good when it serves to help us use (understand, predict, etc) AI better.

It’s bad when it serves to sow panic, fear, and unrealistic / unwarranted comparisons to human beings.

Most opponents of anthropomorphism are rightly reacting to its misuse to sow panic or alter the moral status of agents by claiming consciousness etc.

It’s possible to use anthropomorphism without doing that though [87 ❤️ 10 🔄]

  • Pragmatists stay winning in the age of AI [22 ❤️ 2 🔄]

Follow Builders 自动生成 · 2026-09-01