Why Greatness Cannot Be Planned — Kenneth Stanley
Channel:Machine Learning Street Talk · Length:2:46:27 · Published:2021-01-20 · Views:154688
Summary
A long Machine Learning Street Talk interview with Kenneth Stanley, creator of NEAT and novelty search, about his book on why greatness cannot be planned. They discuss open-endedness, the tyranny of objectives, serendipity and the evolution of ideas.
Why HN recommends it
Recommended to people who find it inspiring or perspective-changing on pursuing goals, open-ended search and AI beyond optimization.
It really changed my perspective on achieving my long term goals — HN, 2021
Machine learning & deep learning · AI & data (other) · Scientific method & science communication
Subtitles (excerpt)
hello street talkers and welcome back to the show this is a special edition i've been dreaming about this show for what seems like nearly a year now i first read kenneth's book about a year ago but anyway i hope you enjoy the episode i'm just sat here sipping a vita coco coconut water okay let's go to achieve your highest goals you have to be willing to abandon [Music] them we have a nose for the interesting that's how we got this far that's how civilization came out that's why the history of innovation is so amazing everything washes out when we start ruling by committee like we have to allow people to follow their passions to their extremes and yet we run society as if this actually makes any sense at all i think the gradient of interestingness is probably the best expression of like the ideal divergent search you get to this problem that like i don't know how to formalize interestingness what you get to then are proxies for interestingness that not everything that's novel is interesting but just about everything that's interesting is novel it is in my personality in nature to want to overthrow this i guess we could say tyranny of objectives okay a little bit of housekeeping before we kick off i just want to make it super clear what the
On Hacker News
> The signal might be good but is it the signal you should be focusing on? There is an amazing amount of interesting stuff being discovered all the time. But is it helping you achieve concrete goals? My point is that putting everything through the filter of "does this directly help me achieve my goals?" isn't the best way to pursue your goals, assuming we're talking about big goals where the path… — ZephyrBlu, 2021-05
I think it's mainly a competitive & cooperative self replicator. The brain exists because previous generations did well. Do we need to infuse "antenna magic" into our brains, aren't they marvelous enough? I found this video about open endedness (contrasting evolution vs optimization) in the brain and AI very inspiring: [VIDEO] — visarga, 2021-02
Lehman & Stanley concerning how explicit objectives encourage effort on exploit rather than explore. AI is progressing using objective functions that can be expressed in a concise form (energy minimization, gradient descent, etc.). A similar mechanism has been at work in industry since Ford and Winslow, from time-and-motion to jit-supply-chain, all under the short-term profit incentive. These are… — mikhailfranco, 2024-03
You're right, the search space is deceptive and going directly towards the goal might lead to a dead end. Only in hindsight we can tell which stepping stones were essential. Immediate results are the best, but in the meantime we need to focus on novelty and interestingness. A great video about open-endedness (warning - very long) with Kenneth Stanley, author of the book "Why Greatness Cannot be P… — visarga, 2022-09
This video is relevant. They talk about "openendedness", serendipity, the tyranny of objectives, the evolution of ideas (and biology), inventing new problems not just solving problems. There are important implications in AI. Kenneth Stanley - Why Greatness Cannot Be Planned on Machine Learning Street Talk. [VIDEO] — visarga, 2021-05
Related videos
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- High-Speed Robot Hand · Hizook · 3:00
- Neural Network Learns The Physics of Fluids and Smoke | Two Minute Papers #118 · Two Minute Papers · 5:26
- Attention Is All You Need · Yannic Kilcher · 27:06
- RAAIS 2017 - Simon Knowles, Co-Founder and CTO of Graphcore · The Research and Applied AI Summit - RAAIS · 35:44
- Bret Weinstein on "The Portal" (w/ host Eric Weinstein), Ep. #019 - The Prediction and the DISC. · Eric Weinstein · 2:13:50
- Vitalik Buterin: Ethereum, Cryptocurrency, and the Future of Money | Lex Fridman Podcast #80 · Lex Fridman · 1:35:04
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- The Quantum Conspiracy: What Popularizers of QM Don't Want You to Know · Google TechTalks · 1:03:43
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- James Burke Connections, Ep. 1 "The Trigger Effect" · DRS_Education · 49:22
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- Hamming, "You and Your Research" (June 6, 1995) · securitylectures · 44:02