Building the Software 2 0 Stack (Andrej Karpathy)

Channel:Databricks · Length:17:54 · Published:2018-08-29 · Views:72933

Watch on YouTube

Summary

Andrej Karpathy's Databricks talk on Software 2.0, the shift from human-written code to code produced by neural network training. It covers how developer work moves toward curating datasets, the advantages and challenges, and opportunities for new tooling.

Why HN recommends it

HN uses it as the primary source for the 'Software 2.0' idea and recommends it as a quick talk on the next software stack.

here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack. — HN, 2020

Machine learning & deep learning · Tech pioneers & interviews

Subtitles (excerpt)

great okay so I'm excited to be here I'd like to tell you a little bit about what I see as a transformation in how we write software so as referring to software 2.0 actually to tell the story correctly I actually have to go back quite a bit of time about 1 million years back this is us throwing rocks at each other 1 million years ago but we're actually pretty clever species we discovered how to control fire and developed our agriculture and then we started building machines we use those machines for computation and we transitioned the computation from mechanical to electrical and then here we are 2018 and we're writing software and we've built a pretty complex software tools and the way we've come about all of this progress is that we actually apply a single kind of approach to - to advancing all of these applications so first we identified some kind of a problem and then we break it down to subproblems and then we create we create algorithms for every one of those subproblems and then we stack them together up into a system and then those systems can actually get pretty elaborate and pretty complex and so this has this really kind of approach by decomposition has worked for us very well and we've been able to

On Hacker News

Btw, for anyone interested, here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack. [VIDEO] — __sy__, 2020-07
Was there a dedicated HN submission for this topic? This is extremely fascinating to me. In what Andrej Karpathy calls "software 2.0"[1], leaking your model is equivalent to leaking the main IP of your company. Unlike source code where it loses value quickly out of context (e.g. twitch leaked their code yet that didn't spawn a bunch of twitch clones), models can be fine-tuned and transfer-learnin… — gfd, 2022-10
Andrej Karpathy (who was one of the presenters today) actually made similar statements last year, about how the part of the software stack that is not neural networks is gradually shrinking: [VIDEO] — wcoenen, 2019-04

Related videos