I have to admit that, while watching footage of the enhanced 2020 version of the 2018 game Forza Horizon 4, when they are driving fast, I have to sometimes remind myself that I am watching a video game and not a video recording of reality. It's the closest I've ever seen to photo realism, but as soon as the car stops, or they go too slowly, or they do something slightly not expected, the illusion quickly falls apart.
It's just a bunch of smoke and mirrors and dead polygon objects after all. Not an actual photo-realistic 3D version of England where I can "drive anywhere and do anything". But for small moments, it can fool me. Example gameplay footage: https://youtu.be/PqwQDRersIM?t=42
What exactly is the "missing piece" at this point? It's impossible for me to not be impressed by the game, but I still don't want to play it. I can tell that I would very quickly get bored of the illusion, and just grow ever more frustrated by the limitations of the reality as presented in the game.
For me, it's largely knowing that it's all dead 3D objects. There are no detailed rooms inside all of those buildings which I could enter and go through. There are no people either, or, if there are, they don't look or behave anything like real humans would. There are many visual details which just look "off", and the more photo-realistic it looks overall, the more demanding my brain becomes and the more eager I am to point out any flaw.
If you then take a look at this random actual video, even that game looks like garbage in comparison: https://youtu.be/FMOb5-e3J7Y?t=49 (yes, I know that the settings/locations are quite different, but that doesn't really matter).
Something about reality is so much "richer" and "real" than what they can do with a 3D world, but I don't quite understand what exactly. I feel as if I should be more impressed than I actually am by that car game. It looks objectively amazing, yet at the same time, I have very little interest in actually playing it. And keep in mind that I'm a person who has been hunting for photo-realistic 3D simulations my entire life and who is endlessly fascinated by the concept.
One thing I can say for sure: it has almost nothing to do with the resolution of the game/camera. Even if you take a very old and cheap camera and go filming reality, it will look a million times better than the 8K game.
Can you explain to me why we don't have a simulation that looks and behaves just like the actual video I just linked to?