- Modern Chaos
- Posts
- MC.52: An AI that can run DOOM at 20+ FPS π€―
MC.52: An AI that can run DOOM at 20+ FPS π€―
Researchers at Google recreated DOOM as an AI model, and it's wild. Check out how humans are playing in this AI-generated world and why it's got everyone talking
Hey everyone,
A team of researchers at Google created GameNGen, a neural network that can run the classic game DOOM at over 20 frames per second.
Watch the video below. A recording shows a human playing in this simulated world, demonstrating sheer madness:
How Good Is It?
Pretty darn good. When they showed short clips to people, they could barely tell the difference between the AI version and the real game. The AI achieves a PSNR (a measure of image quality) of 29.4, which is similar to lossy JPEG compression.
How Does It Work?
It's a two-step process:
1. An AI agent learns to play DOOM through reinforcement learning. They record all its gameplay.
2. They train a diffusion model to predict the next frame of the game, based on past frames and actions.
The cool part is they figured out how to make it stable over long periods of gameplay. They use a trick called "noise augmentation" that helps the AI correct mistakes and not go off the rails.
Of course, there are limitations. The AI only remembers about 3 seconds of gameplay history, which can cause some weird behavior. And it's not perfect at mimicking all the complex rules of DOOM.
Why This Matters
Companies in VR and game development are excited about this research. It shows neural networks can create complex, interactive environments instantly. The metaverse might come back as making endless worlds gets cheaper.
This model isn't a text-to-game AI, but imagine one where you describe a game and get a playable version right away. Many startups are working on this by generating code and assets, but GameNGen is on another level.
By the way, remember the idea that we might live in a computer simulation? Right now, it looks basic like DOOM, but as we get better at making realistic simulations, this idea seems more possible.
We live inside a simulation and are ourselves creating progressively more realistic and interesting simulations. Existence is a recursive simulation generator.
β Lex Fridman (@lexfridman)
7:46 PM β’ Sep 25, 2022
Have a good sim,
Sam
π¦Ύ Master AI & ChatGPT for FREE in just 3 hours π€―
1 Million+ people have attended, and are RAVING about this AI Workshop.
Donβt believe us? Attend it for free and see it for yourself.
Highly Recommended: π
Join this 3-hour Power-Packed Masterclass worth $399 for absolutely free and learn 20+ AI tools to become 10x better & faster at what you do
ποΈ Tomorrow | β±οΈ 10 AM EST
In this Masterclass, youβll learn how to:
π Do quick excel analysis & make AI-powered PPTs
π Build your own personal AI assistant to save 10+ hours
π Become an expert at prompting & learn 20+ AI tools
π Research faster & make your life a lot simpler & moreβ¦
What do you think of this email?You can add more feedback after choosing an option, this helps a lot π |
Enjoyed this newsletter? Forward it to a friend and have them sign up here.
Until next Thursday π
Reply