Read through the method behind an open-weights interactive world model whose weights just went public. The backbone is a causal DiT generating frames live, conditioned on user input. To stop it from over-relying on its own recent frames, the usual source of drift, they use a MoBA attention mask that
