Did any of you guys see those Skyrim AI NPC mods that were floating around YouTube around a year ago? I think they kept getting taken down for some reason.

But honestly it convinced me that that’s a good way to go. They were able to detect what the player was doing. For instance, if you dropped a sword on the ground, they would be like “hey don’t forget that iron greatsword on your way out”. You could also ask it for advice on how to complete your quest or what they knew about someone.

If the AI is somehow locked to only knowing information about the video game they’re in, it could really boost the immersion I think. But I think they should have to use a real voice actor to train the AI to mimic their voice or something like that.

I think the top use will actually be diffusion. A small model could add a lot of variability to palettes to start. Then move on to something like a slider puzzle where an AI is altering the initial terrain configuration in dynamic ways. It would likely create an environment where a player’s natural pacing can be compensated for in real time.

I could also picture a function calling setup that attempts to optimise player experience.

I’ve been looking at ways to generate tiles for CDDA using a small model. There is a ton of potential especially in open source. I won’t run any model unless it is open weights running on my hardware.

Yes it can. But we are still ways to go before it become a reality. The current AI is still missing the ‘intelligence’ and is no better than a a well designed predetermined script.

For every game that try to make good use of AI to improve on the player experience and immersion there will be hundreds, thousands more that do the exact opposite. Because that is capitalism for you. Just look at Upscaling/Frame generation.