State of GPT | BRK216HFS
Channel:Microsoft Developer · Length:42:40 · Published:2023-05-25 · Views:787450
Summary
Andrej Karpathy walks through how GPT assistants are trained, from tokenization and pretraining to supervised finetuning and RLHF, and gives practical prompting strategies and a view of the tooling ecosystem.
Why HN recommends it
Recommended as the clearest overview of how LLM assistants are built and how to use them well.
It changed the way I use GPT-4. — HN, 2023
Machine learning & deep learning · LLMs & generative AI
Subtitles (excerpt)
[MUSIC] ANNOUNCER: Please welcome AI researcher and founding member of OpenAI, Andrej Karpathy. ANDREJ KARPATHY: Hi, everyone. I'm happy to be here to tell you about the state of GPT and more generally about the rapidly growing ecosystem of large language models. I would like to partition the talk into two parts. In the first part, I would like to tell you about how we train GPT Assistance, and then in the second part, we're going to take a look at how we can use these assistants effectively for your applications. First, let's take a look at the emerging recipe for how to train these assistants and keep in mind that this is all very new and still rapidly evolving, but so far, the recipe looks something like this. Now, this is a complicated slide, I'm going to go through it piece by piece, but roughly speaking, we have four major stages, pretraining, supervised finetuning, reward modeling, reinforcement learning, and they follow each other serially. Now, in each stage, we have a dataset that powers that stage. We have an algorithm that for our purposes will be a objective and over for training the neural network, and then we have a resulting model, and then there are some notes on the bottom.
On Hacker News
I would highly recommend watching - State of GPT video by Karpathy at Microsoft Build to get an idea of how LLM’s work. There are some really good prompting ideas. It changed the way I use GPT-4. Video: [VIDEO] — sagarpatil, 2023-06
Thanks. Here is presentation by Karpathy explaining different stages of LLM training. Explains many details in a form suitable for beginners. [VIDEO] — tintor, 2025-02
It sounds like you want more broad stuff, not necessarily learning how to train models. More like learning to use them and how they work. [LINK] and Hacker's Guide to LLMs by Jeremy from Fast.ai - [LINK] State of GPT by Karpathy - [VIDEO] LLMs by 3b1b - [LINK] Visualizing transformers by 3b1b - [LINK] How ChatGPT trained - [LINK] AI in a nutshell - [LINK] How Carlini uses LLMs - [LINK] For stayin… — tikkun, 2024-11
I share many of your concerns and frustrations, although I suspect what you're asking for their consider a moat along the lines of a trade secret, rivaled only by the collection of performance improvement techniques they've amassed in 1000s-10,000s of training runs, 100s of engineers, and (hundreds of?) millions spent on compute. People are hired and praised in the community for their skill in cl… — mcint, 2023-06
I recognize there's plenty of catnip here when it comes to calling this "engineering" or not, however, whatever you want to call it (prompt fiddling?), the techniques are crucial if you want to achieve reasonably consistent output from current-state LLMs. As models improve concerns about context window limitations will be reduced and it will be easier to discern user intent. These are good straig… — valgaze, 2023-06
Related videos
- - Startups - David H. Hansson, Partner at 37signals -TWiST #E337 · This Week in Startups · 1:38:37
- Enhancing Photorealism Enhancement · ISL and Collaborators · 8:33
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- The Hidden Rules of Conversation · Tom Scott · 5:32
- [1hr Talk] Intro to Large Language Models · Andrej Karpathy · 59:48
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20