Emacs + org-mode + python in reproducible research; SciPy 2013 Presentation

Channel:Enthought · Length:21:16 · Published:2013-07-02 · Views:49782

Watch on YouTube

Summary

John Kitchin shows how Emacs org-mode with Python lets researchers combine narrative, math, figures and executable code in one document. It exports to LaTeX, HTML and PDF, and he used it for papers and e-books.

Why HN recommends it

Repeatedly recommended as the canonical demo of org-mode for literate programming and reproducible research.

on Emacs + org-mode + python in reproducible research is worth a watch — HN, 2015

Python, Ruby & scripting languages · Testing, debugging & developer tools · Data science & statistics

Subtitles (excerpt)

I'm an assistant professor now in chemical engineering at Carnegie Mellon University and this is my first time at Syfy I'm really impressed with the way things things are going and interaction so I want to talk about some work I've been doing in this and I want to motivate it by a couple of problems I've been trying to solve for for quite a while so one is I have say computational research workflow where I set up a lot of calculations a lot maybe hundreds or thousands and that's typically done in a loop maybe in a script called periscope I then I'll write a script that runs those calculations and inevitably one of those hundreds will have some problem and I write a second script to fix that problem and so I get some sodium tungstate three script and maybe some more and then I have analysis scripts to do various things make various plots you can see them all kind of highlighted there and then what I might want to do later is try to teach one of my students how to do this but then I open this directory and it's you know all of these files that I have to try to figure out or I try to repeat this myself so so that's been one kind of problem is how do I document all of these things that I've done and even that my students have done

On Hacker News

A lot of people are starting to use org-mode for that kind of thing. Fully reproducible research in a single file. To check the work, just export the file to pdf/html/etc., or "C-c C-c" the code blocks as you read through in org-mode. It's fantastic. For python specifically, this video is a must watch: [VIDEO] — cube_yellow, 2014-05
I Agree with all those points. I've used org mode for a few things, but not for python notebooks. I remember seeing a great video a few years back on using python in org mode to make a research notebook. It really made me want to try org mode for literate / notebook style programming. I think it was this one: [VIDEO] It sounds like org mode does not store images inline, since you don't like the b… — dahart, 2018-04
This SciPy presentation (Kitchin, John Carnegie Mellon University) on Emacs + org-mode + python in reproducible research is worth a watch: [VIDEO] — rndn, 2015-06
Do check out org-mode, then. It is surprising how far that tool has been extended. Many of these features are actually under the label "reproducible research" nowdays. There was a really good talk given on this at a pypy convention a couple of years ago.[1] [1] [VIDEO] — taeric, 2014-08
Seriously, try emacs. You want to see what color you have put in a css field?[1] Want to see the image you are referencing in a repl?[2] More amazingly, want to combine TeX, lisp, a markdown like language, and python/whatever in a single document? Try org-mode.[3][4] [1] [LINK] [2] [LINK] [3] [LINK] [4] [VIDEO] — taeric, 2014-08

Related videos