Video-based AI gives robots a visual imagination

Posted under: AI technologies
Date: 2026-03-27
Video-Based AI Powers Robots' Visual Imagination | Justo Global

Researchers led by Yilun Du at Harvard's Kempner Institute have introduced a novel AI system enabling robots to visualize actions before executing them, using vast amounts of internet video data. This "visual imagination" allows robots to simulate future scenarios, significantly enhancing their adaptability in unfamiliar environments. Du emphasizes that traditional language-based models fail to adequately teach physical intelligence, positioning this video-driven approach as a groundbreaking leap in robotic capabilities. Such advancements could redefine robot learning in real-world applications.

Read more at: techxplore.com