Solving Wordle using information theory
Channel:3Blue1Brown · Length:30:38 · Published:2022-02-06 · Views:11855179
Summary
3Blue1Brown uses Wordle as an excuse to teach information theory and entropy, building a solver that picks guesses by expected information and incorporating word frequencies.
Why HN recommends it
HN recommends it as the go-to explanation of optimal Wordle openers like CRANE and a friendly introduction to information theory, also relevant to Mastermind.
still worth a watch. — HN, 2023
Algorithms & data structures · Recreational & visual math · Information theory & signal processing
Subtitles (excerpt)
The game Wordle has gone pretty viral in the last month or two, and never one to overlook an opportunity for a math lesson, it occurs to me that this game makes for a very good central example in a lesson about information theory, and in particular a topic known as entropy. You see, like a lot of people, I got kind of sucked into the puzzle, and like a lot of programmers, I also got sucked into trying to write an algorithm that would play the game as optimally as it could. And what I thought I'd do here is just talk through with you some of my process in that, and explain some of the math that went into it, since the whole algorithm centers on this idea of entropy. First things first, in case you haven't heard of it, what is Wordle? And to kill two birds with one stone here, while we go through the rules of the game, let me also preview where we're going with this, which is to develop a little algorithm that will basically play the game for us. So, I haven't done today's Wordle, this is February 4th, and we'll see how the bot does. The goal of Wordle is to guess a mystery five-letter word, and you're given six different chances to guess. For example, my Wordle bot suggests that I start with the guess crane.
On Hacker News
Reminds me of the 3Blue1Brown video about Wordle, and then it's followup video. I guess that's kind of a spoiler, but still worth a watch. [VIDEO] [LINK] — bnycum, 2023-08
If you wonder why in the demo author uses `crane` as first guess - check out recent video from 3Blue1Brown [VIDEO] — dowakin, 2022-02
ICYMI, 3blue1brown (Grant Sanderson) has a video applying information theory to solving Wordle, which is conceptually similar to mastermind -- [VIDEO] — bschne, 2024-01
Interesting that SLATE is the apparent optimum opener. I found a youtube that "showed" that CRANE is mathematically optimal: [VIDEO] The second guess (if a low hit count) fleshes out the remaining vowels. My average is 4, followed by 3. — pstuart, 2023-12
Warning: Bit of a 'Hitch hikers guide to the galaxy"/conway game of life yak shave for a reply. Nice start to providing a simple way to visually interact/experiment/manipulate different multiple Neural network concepts by loading/transforming any traditional code (working or not) & reshuffling/tesselating the structual representation of the code to generate a turing tape path via color execution … — sargstuff, 2022-04
Related videos
- Vectors | Chapter 1, Essence of linear algebra · 3Blue1Brown · 9:51
- But what is the Fourier Transform? A visual introduction. · 3Blue1Brown · 19:41
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- The Beauty of Bézier Curves · Freya Holmér · 24:25
- D/A and A/D | Digital Show and Tell (Monty Montgomery @ xiph.org) · FL Studio · 23:52
- The Continuity of Splines · Freya Holmér · 1:13:50
- Jim Simons (full length interview) - Numberphile · Numberphile2 · 1:00:43
- But how does bitcoin actually work? · 3Blue1Brown · 25:15
- Conway's Game Of Life in APL · Dyalog · 7:47
- CppCon 2017: Matt Kulukundis “Designing a Fast, Efficient, Cache-friendly Hash Table, Step by Step” · CppCon · 59:33
- The essence of calculus · 3Blue1Brown · 17:04
- The Fast Fourier Transform (FFT): Most Ingenious Algorithm Ever? · Reducible · 28:23
- Modern Dictionaries by Raymond Hettinger · SF Python · 1:07:41
- The man with 1,000 Klein Bottles UNDER his house - Numberphile · Numberphile · 6:49
- Essence of linear algebra preview · 3Blue1Brown · 5:09
- A Swift Introduction to Geometric Algebra · sudgylacmoe · 44:23