Future of Elder Scrolls & RPG - Skyrim NPCs & Inworld AI (like GPT-4 for gaming)

Channel:Bloc · Length:26:15 · Published:2023-04-28 · Views:734761

Watch on YouTube

Summary

A demo of a Skyrim mod that uses Inworld AI to let players hold free-form conversations with NPCs. It previews LLM-driven characters in role-playing games.

Why HN recommends it

Pointed to as an early example of LLM-powered NPC dialog in games.

LLMs & generative AI · Game design · Speedrunning, glitches & game hacking

Subtitles (excerpt)

foreign [Music] for the Imperials both one or the other is bound to win the world yes my Thane I have been waiting for you how may I assist you on your next Quest no my Thane I camped close to the Khajiit Camp I suspect they may have stolen my Mead but I have no proof is there anything else you need from me [Music] thank you for your concern my Thane I can handle the situation myself I will be more careful around the Khajiit in the future is there anything else you need from me my Thane [Music] thank you my Thane I will wait here for your return please be careful on your journey to Whiterun and do not hesitate to call upon me if you need my assistance [Music] well it's a pleasure to make your acquaintance names John battleborn I'm a mercenary Bard an all-around decent chap s how can I help [Music] uh you've heard of us then the battleborns are a wealthy and influential family in Whiterun and yes I'm one of them but I've chosen to make my own way in the world as a mercenary and bard keeps things interesting you know well truth be told I'm waiting for someone special but don't tell anyone it's a secret just a friend that's all a very good friend actually her name is alfina greymane but like I said it's a secret

On Hacker News

Now I'm just imagining a video game with characters each having their own fine tune applied on top for their dialog. I'm guessing you could use some relatively small models. In each case you would be feeding all the context to the model (player name, current relevant quests, summary of previous interactions, etc). Though maybe fine tuning/training isn't even needed and a good enough prompt will w… — joshstrange, 2025-06
I saw a demo of a Skyrim mod on Youtube [1], where they wired the dialog screen with NPCs in the town of Windhelm up with the OpenAI API. Each character had all their Bethesda-written dialog fed to the LLM as a starting prompt, so each one communicated with the player within the bounds of their authored identity, and knew what that character was written to know. The human player used freeform in-… — kridsdale3, 2023-08
Real-time convincing-sounding TTS is extremely close - I’d be surprised if we don’t get an elevenlabs equivalent to gpt-turbo before the end of summer. I spent an hour or three over the weekend messing around in Skyrim VR with a mod that does player speech recognition, pipes it out to GPT with identifier tags to give scene context, sends GPT output to elevenlabs (optional), and then the mod integ… — trafficante, 2023-05

Related videos