World Models That Ignore Human Beliefs Predict Wrong Actions

Summary

New research reveals that current world models like Sora or Genie only simulate physics, ignoring what people think, want, or feel. The new "Mental World Modeling" framework adds mental variables such as beliefs and intentions. Even weaker language models using this approach outperform stronger models without mental modeling. The biggest bottleneck remains predicting how physical and mental states change together.