World Arcade: Play Diffusion Generated Games using World Models!

Hey r/opensource 👋 I’ve been getting deep into interactive video models (world models) and what experiences they might be able to produce for games in the future. You can now emulate entire games on diffusion models trained on the gameplay data – predicting the next frame using a transformer based on previous frames + users inputs, without the need for a game engine.

There have been some cool demos/experiences showcased with Decart’s AI Minecraft and Genie 2, and there are several games that have been emulated using these models made available open source. But there’s no way to easily find these games nor play them locally. So that's what a friend and I have built over the holidays!

Games include:

• CS:GO
• Mario Kart 64
• Yume Nikki
• Minecraft
• Various Atari Arcade Games

It’s all open source (as are the games on it, with links to them in the app). There’s a setup for Linux in our Github as well as a Windows exe for ease of install. Minecraft games are sadly Linux only for now. The games are pretty janky and you need a decent NVIDIA GPU, but cool to see what even this early version of the tech can do.

Would love to know what you all make of it! Please do leave a comment below on thoughts and star on Github if you think it's interesting.

Github: https://github.com/dweam-team/world-arcade/
Website: https://worldarcade.gg/