Super Data Science: ML & AI Podcast with Jon Krohn · Jon Krohn
977: Attention, World Models and the Future of AI, with Prof. Kyunghyun Cho
·1 hr 18 min·5 clips
Intern Dima Badanao described the attention idea one morning, and Cho immediately knew it would change everything.
As heard by us
A technical discussion of active data collection, sample efficiency, rare aha moments, and world models.
The episode argues that AI progress may hinge less on passive data hoarding than on active collection, sample efficiency, and world models. Its sharpest point is simple: if a system can choose what data to gather, the right correlations show up sooner than they would through…
Why you'd press play
Why the next AI leap may come from actively choosing better data, not just collecting more of it.
Listen to the show on