Emacs + org-mode + python in reproducible research; SciPy 2013 Presentation
Channel:Enthought · Length:21:16 · Published:2013-07-02 · Views:49782
Summary
John Kitchin shows how Emacs org-mode with Python lets researchers combine narrative, math, figures and executable code in one document. It exports to LaTeX, HTML and PDF, and he used it for papers and e-books.
Why HN recommends it
Repeatedly recommended as the canonical demo of org-mode for literate programming and reproducible research.
on Emacs + org-mode + python in reproducible research is worth a watch — HN, 2015
Python, Ruby & scripting languages · Testing, debugging & developer tools · Data science & statistics
Subtitles (excerpt)
I'm an assistant professor now in chemical engineering at Carnegie Mellon University and this is my first time at Syfy I'm really impressed with the way things things are going and interaction so I want to talk about some work I've been doing in this and I want to motivate it by a couple of problems I've been trying to solve for for quite a while so one is I have say computational research workflow where I set up a lot of calculations a lot maybe hundreds or thousands and that's typically done in a loop maybe in a script called periscope I then I'll write a script that runs those calculations and inevitably one of those hundreds will have some problem and I write a second script to fix that problem and so I get some sodium tungstate three script and maybe some more and then I have analysis scripts to do various things make various plots you can see them all kind of highlighted there and then what I might want to do later is try to teach one of my students how to do this but then I open this directory and it's you know all of these files that I have to try to figure out or I try to repeat this myself so so that's been one kind of problem is how do I document all of these things that I've done and even that my students have done
On Hacker News
A lot of people are starting to use org-mode for that kind of thing. Fully reproducible research in a single file. To check the work, just export the file to pdf/html/etc., or "C-c C-c" the code blocks as you read through in org-mode. It's fantastic. For python specifically, this video is a must watch: [VIDEO] — cube_yellow, 2014-05
I Agree with all those points. I've used org mode for a few things, but not for python notebooks. I remember seeing a great video a few years back on using python in org mode to make a research notebook. It really made me want to try org mode for literate / notebook style programming. I think it was this one: [VIDEO] It sounds like org mode does not store images inline, since you don't like the b… — dahart, 2018-04
This SciPy presentation (Kitchin, John Carnegie Mellon University) on Emacs + org-mode + python in reproducible research is worth a watch: [VIDEO] — rndn, 2015-06
Do check out org-mode, then. It is surprising how far that tool has been extended. Many of these features are actually under the label "reproducible research" nowdays. There was a really good talk given on this at a pypy convention a couple of years ago.[1] [1] [VIDEO] — taeric, 2014-08
Seriously, try emacs. You want to see what color you have put in a css field?[1] Want to see the image you are referencing in a repl?[2] More amazingly, want to combine TeX, lisp, a markdown like language, and python/whatever in a single document? Try org-mode.[3][4] [1] [LINK] [2] [LINK] [3] [LINK] [4] [VIDEO] — taeric, 2014-08
Related videos
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- How Big is Graham's Number? (feat Ron Graham) · Numberphile · 8:23
- The Drive Home - ShaderToy · The Art of Code · 2:01
- 50TH ANNIVERSARY OF THE COMPUTER SCIENCE DEPARTMENT AT THE UNIVERSITY OF UTAH · University of Utah · 6:55:03
- JavaScript: The Good Parts · Google TechTalks · 1:03:47
- Lecture 1 | Introduction to Convolutional Neural Networks for Visual Recognition · Stanford University School of Engineering · 57:56
- The world's worst video card? · Ben Eater · 32:47
- Why Women Are Stripey · Veritasium · 5:17
- Ruby Conf 12 - Y Not- Adventures in Functional Programming by Jim Weirich · Confreaks · 53:21
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- How Python was Shaped by leaky Internals, Armin Ronacher, Flask framework · Видео с мероприятий {speach! · 49:55
- RailsConf 2014 - All the Little Things by Sandi Metz · Confreaks · 38:47
- What the heck is the event loop anyway? | Philip Roberts | JSConf EU · JSConf · 26:52
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- 🚀 TDD, Where Did It All Go Wrong (Ian Cooper) · DevTernity Conference · 1:03:55