AI 行业热点

🎙️ 播客精选

Memory and Continual Learning: Engram’s Dan Biderman and Jessy Lin

Training Data · 2026-06-24

Speaker 1 | 00:00 - 00:24
What about pre training or even post training makes it possible for the models to generalize in these magical emergent ways and controlling that process so that a company has a set of private data? How do we make the models learn that just as well as the models know, like, the capital of France or, you know, like, how to write Python? So I think it’s a really fun problem to think about.

Speaker 2 | 00:41 - 00:57
Welcome to training data. We are delighted to have Don Biederman and Jesse Lynn, cofounders of Ngram today. Ngram is a NeoLab focused on memory and continual…

🎧 收听完整节目


🐦 X/Twitter 热点

Swyx (@swyx)

  • Memberships for companies and creative individuals.

Apply here please! [9 ❤️]

  • impromptu ai engineer preshow floor tour and AMA [33 ❤️ 1 🔄]
  • An interesting way to take Noam at his word in regards to always keeping a constant inference budget for any eval reporting -

is that open models have a lot more dollar per token mileage than closed model APIs. So anyone launching an open model today or situationally incentivized toward open models should obviously report thinking levels measured by dollar inference on popular inference providers, instead of by number of tokens on the x axis [100 ❤️ 4 🔄]

Thibault Sottiaux (@thsottiaux)

  • Sol when operating Codex. Circa 2026 [607 ❤️ 13 🔄]

  • Talking to your plants isn’t weird anymore. You can just codex things. [315 ❤️ 16 🔄]

  • Tons of improvements landed in Codex.

  • Handles super long threads smoothly.

  • Hoverable navigation rail for previewing and jumping between turns that feels just right.

  • Settings search covers more controls, with clearer appearance and host-filtering options and easier-to-find custom-provider settings.

  • Zoom-level changes no longer misalign tooltips, dialogs, menus, selection bubbles, drag previews, or autocomplete.

  • Copying into Slack preserves Markdown formatting such as bullets, bold text, code, and links; and large text pastes no longer freeze the UI.

  • And most importantly: a dedicated Pets panel. [1383 ❤️ 71 🔄]

Peter Yang (@petergyang)

  • Messi is so goated damn [62 ❤️ 3 🔄]
  • There’s just one small problem with this framework:

If you wait till level 5 or whatever to tell other people that there’s a problem when there’s been a burning fire for days and your “solution” actually didn’t fix the problem at all, you’re 100% in a worse situation than someone who is level 1 and just told other people about the problem right away and found a solution together.

There’s no black and white to this stuff, everything has nuance. [35 ❤️]

  • Every Saturday, Hermes sends me a health check email with top takeaways and stats to help me work toward my health goals by pulling data from:

→ My smart scale via the Withings API
→ My Fitbit and Google Health
→ An MCP server and mobile fitness app I vibe coded to track my workouts

I find this super useful, even if my body fat is going the wrong way 😅

I talk about how to do this in my Hermes tutorial here:

Should I make another video on building my fitness app? [51 ❤️ 1 🔄]

Nan Yu (@thenanyu)

  • [9 ❤️]
  • Oh [7 ❤️]
  • If 90% of problems you bump into aren’t worth solving, then level 1 and level 6 are 90% the same [15 ❤️ 1 🔄]

Guillermo Rauch (@rauchg)

  • I now own Excited to give my children clean email handles. Domains are awesome. The internet is awesome. [1502 ❤️ 10 🔄]
  • Mythos / Sol cybersecurity capabilities are equally useful in an offensive as well a defensive capacity.

If adversaries get ahold of an equivalent offensive capability, it poses a serious threat to US companies that remain unaware of latent vulnerabilities.

In the meantime, I strongly recommend running deepsec[1] or similar harnesses with the available frontier models.

[1] [1225 ❤️ 57 🔄]

  • Me and my agents [957 ❤️ 72 🔄]

Aaron Levie (@levie)

  • Some good best practices here on AI token cost optimization. None of these happens though without a deep understanding of the underlying work being done in a non-abstract way.

The ultimate implication is that a layer between the work itself and the underlying intelligence needs to deeply understand your workflows, context, and business process. Now, each individual company doing this on their own is unlikely to be effective at scale, so as a consequence, this is effectively the playbook for any applied AI company right now.

By evaling the models for the applied use cases, deeply understanding the domain, having tuned UX and features for the use case, and having the ability to support adoption and change (via FDEs), allow this layer to add a ton of value. And as a result, enterprises get higher ROI because you actually can get more intelligence per dollar by having optimal architecture and workflows.

There will be many horizontal and vertical versions of this approach. Huge opportunity right now. [385 ❤️ 28 🔄]

Matt Turck (@mattturck)

  • The World Cup The World Cup
    until now starting tomorrow [19 ❤️ 3 🔄]
  • Smart glasses and goggles, a history:

Silicon Valley, 2013 (Google): “you really want this”
Everyone: “no we don’t”

Silicon Valley, 2016 (Microsoft): “ok but what if it’s for the enterprise”
Enterprise: “maybe, but also, no”

Silicon Valley, 2023 (Meta): “ok but what if they look normal and have AI”
Everyone: “wait… maybe? … Actually, no”

Silicon Valley, 2024 (Apple): “ok but what if it’s $3,499 and covers your whole face”
Everyone: “absolutely not”

Silicon Valley, 2026 (Snap): “ok but this time for real”
Everyone: “we admire the persistence but still no” [289 ❤️ 32 🔄]

Zara Zhang (@zarazhangrui)

  • Btw I’m not an engineer; these are all side projects I built for fun. I just love connecting technology with user problems/using it to solve my own pain points, and then telling stories about the products [12 ❤️ 1 🔄]
  • My projects: [40 ❤️ 1 🔄]
  • Last year I barely knew how GitHub worked. Now I have 10k followers on GitHub (and still can’t write code by hand). What a year. [2149 ❤️ 77 🔄]

Nikunj Kothari (@nikunj)

  • As someone who eats ice cream ~daily, this was SO fun to read..

Also, the visuals are absolutely stunning!! [19 ❤️ 2 🔄]

Peter Steinberger (@steipete)

  • “History teaches us that access blockage rarely stops determined users.” [670 ❤️ 64 🔄]
  • Got excited about the 52’ Dell, but it requires BetterDisplay hacking to get a usable resolution, but then I get weird flickers and also startup wake issues. [on M4 Max MBP]

So, Apple wins this round, 2xXDR it is. [341 ❤️ 5 🔄]

  • We getting Apple Car after all [530 ❤️ 11 🔄]

📝 博客文章


Follow Builders 自动生成 · 2026-06-28