I don't like notebooks.- Joel Grus (Allen Institute for Artificial Intelligence)
Channel:O'Reilly · Length:56:12 · Published:2018-10-10 · Views:120324
Summary
Joel Grus's JupyterCon talk explaining why he dislikes Jupyter notebooks. He covers hidden state, trouble with reproducibility and testing, and how notebooks frustrate teaching. He shows his preferred workflow and what Jupyter could change.
Why HN recommends it
It is the go-to funny, irreverent critique of notebooks, linked whenever HN debates notebooks versus testable code.
The parent article links this great talk that goes into more detail than the parent post and is much easier to understand — HN, 2024
Python, Ruby & scripting languages · Testing, debugging & developer tools · Data science & statistics
Subtitles (excerpt)
hi everyone thanks for coming my name is Joel and I don't like notebooks so it's possible the only person like this at the conference but out in the room no all right good because out in the real world there are dozens of us a few here and so how did we end up here well I was anger about notebooks I tweeted that I wanted he would talk about how I was angry about notebooks and someone was listening and it got accepted and so you know data science luminaries thought that it sounded like an unhelpful way to spend time and I got lots of other positive feedback about it as well but here we are so what kind of person not only doesn't like notebooks but goes to a conference about notebooks to talk about how he doesn't like notebooks so I'm a research engineer at Allen's super artificial intelligence my job is Python library design and reproducible science so I've lots of thoughts on these topics I won't call myself a Python expert you should never call yourself an expert but I've been in Python for a long time and I have a lot of opinions about it I was the chief data scientist at Woollett metrics I've managed data scientists I mentor data scientists I wrote a popular book in data science so I have some thoughts about how
On Hacker News
Jupyter notebooks are really abysmal when it comes to best engineering practices. There's an amazing talk called "I don't like notebooks" by Joel Grus at last years JupyterCon [0]. I highly recommend it. [0] [VIDEO] — kevsim, 2019-04
Here they are - they're definitely irreverent, but I find myself strongly agreeing with everything he says. [LINK] [VIDEO] — tcpekin, 2018-10
REPL stands for Read–eval–print loop [LINK] A REPL, by its name, is a very narrow version of the broader paradigm of interactive computer programming environments. But Notebooks are not REPLs, unless you use REPL to mean "interactive programming environment" and not REPL. Notebooks are much broader than a REPL! In a notebook, you can go back and edit and run individual lines of the notebook witho… — lelandbatey, 2024-06
First, yes, this is a common question. IPython does not try to deal with that, it's just the executing engine. Notebooks, do not have to be stored in ipynb form, I would suggest to look at [LINK] , and notebook UI is inherently not design for multi-file and application developpement. So training humans will always be necessary. Technically Jupyter Notebook does not even care that notebooks are fi… — carreau, 2022-01
Get extensive code out of notebooks into testable libraries. Confirm it works before running a big computation. We try to keep our notebooks slim and factor anything complex into a Python library. We can experiment with this libraries implementation, write unit tests on smaller data sets to confirm it works, before doing a bigger experiment. We can also deploy the library to prod and ensure users… — softwaredoug, 2021-06
Related videos
- The US Has More Tribes Than the World Has Countries · CGP Grey · 6:46
- Rails Conf 2012 Keynote: Simplicity Matters by Rich Hickey · Confreaks · 36:53
- Joe Rogan Experience #1342 - John Carmack · PowerfulJRE · 2:36:47
- "Programming Should Eat Itself" by Nada Amin · Strange Loop Conference · 47:41
- Clojure for Lisp Programmers Part 1 - Rich Hickey · ClojureTV · 1:28:58
- "The Mess We're In" by Joe Armstrong · Strange Loop Conference · 45:50
- I Like Notebooks · Jeremy Howard · 52:09
- What Alcohol Does to Your Body, Brain & Health · Andrew Huberman · 2:01:02
- Ruby Conf 12 - Y Not- Adventures in Functional Programming by Jim Weirich · Confreaks · 53:21
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- How Python was Shaped by leaky Internals, Armin Ronacher, Flask framework · Видео с мероприятий {speach! · 49:55
- RailsConf 2014 - All the Little Things by Sandi Metz · Confreaks · 38:47
- What the heck is the event loop anyway? | Philip Roberts | JSConf EU · JSConf · 26:52
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- 🚀 TDD, Where Did It All Go Wrong (Ian Cooper) · DevTernity Conference · 1:03:55