Future of Elder Scrolls & RPG - Skyrim NPCs & Inworld AI (like GPT-4 for gaming)
Channel:Bloc · Length:26:15 · Published:2023-04-28 · Views:734761
Summary
A demo of a Skyrim mod that uses Inworld AI to let players hold free-form conversations with NPCs. It previews LLM-driven characters in role-playing games.
Why HN recommends it
Pointed to as an early example of LLM-powered NPC dialog in games.
LLMs & generative AI · Game design · Speedrunning, glitches & game hacking
Subtitles (excerpt)
foreign [Music] for the Imperials both one or the other is bound to win the world yes my Thane I have been waiting for you how may I assist you on your next Quest no my Thane I camped close to the Khajiit Camp I suspect they may have stolen my Mead but I have no proof is there anything else you need from me [Music] thank you for your concern my Thane I can handle the situation myself I will be more careful around the Khajiit in the future is there anything else you need from me my Thane [Music] thank you my Thane I will wait here for your return please be careful on your journey to Whiterun and do not hesitate to call upon me if you need my assistance [Music] well it's a pleasure to make your acquaintance names John battleborn I'm a mercenary Bard an all-around decent chap s how can I help [Music] uh you've heard of us then the battleborns are a wealthy and influential family in Whiterun and yes I'm one of them but I've chosen to make my own way in the world as a mercenary and bard keeps things interesting you know well truth be told I'm waiting for someone special but don't tell anyone it's a secret just a friend that's all a very good friend actually her name is alfina greymane but like I said it's a secret
On Hacker News
Now I'm just imagining a video game with characters each having their own fine tune applied on top for their dialog. I'm guessing you could use some relatively small models. In each case you would be feeding all the context to the model (player name, current relevant quests, summary of previous interactions, etc). Though maybe fine tuning/training isn't even needed and a good enough prompt will w… — joshstrange, 2025-06
I saw a demo of a Skyrim mod on Youtube [1], where they wired the dialog screen with NPCs in the town of Windhelm up with the OpenAI API. Each character had all their Bethesda-written dialog fed to the LLM as a starting prompt, so each one communicated with the player within the bounds of their authored identity, and knew what that character was written to know. The human player used freeform in-… — kridsdale3, 2023-08
Real-time convincing-sounding TTS is extremely close - I’d be surprised if we don’t get an elevenlabs equivalent to gpt-turbo before the end of summer. I spent an hour or three over the weekend messing around in Skyrim VR with a mod that does player speech recognition, pipes it out to GPT with identifier tags to give scene context, sends GPT output to elevenlabs (optional), and then the mod integ… — trafficante, 2023-05
Related videos
- SM64 - Watch for Rolling Rocks - 0.5x A Presses (Commentated) [OUTDATED] · pannenkoek2012 · 24:38
- Reverse emulating the NES to give it SUPER POWERS! · suckerpinch · 22:21
- Juice it or lose it - a talk by Martin Jonasson & Petri Purho · grapefrukt · 15:38
- Jan Willem Nijman - Vlambeer - "The art of screenshake" at INDIGO Classes 2013 · Dutch Game Garden · 44:09
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Preventing the Collapse of Civilization / Jonathan Blow (Thekla, Inc) · DevGAMM · 1:02:41
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- SNES Code Injection -- Flappy Bird in SMW · SethBling · 6:31
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- Failing to Fail: The Spiderweb Software Way · GDC Festival of Gaming · 59:47
- Exploring the Tech and Design of Noita · GDC Festival of Gaming · 31:00
- 'Diablo': A Classic Game Postmortem · GDC Festival of Gaming · 1:17:43
- FIXING the ENTIRE SM64 Source Code (INSANE N64 performance) · Kaze Emanuar · 18:20
- Jonathan Blow: Game design: the medium is the message · CreativeMornings HQ · 48:26