"Performance Matters" by Emery Berger
Channel:Strange Loop Conference · Length:42:15 · Published:2019-09-15 · Views:502235
Summary
Emery Berger explains why performance is hard to measure and deliver on modern hardware, showing how code layout and alignment can swamp optimization effects. He presents Stabilizer for statistically sound evaluation and Coz, a causal profiler.
Why HN recommends it
It is the standard recommendation for anyone puzzled by unexplained benchmark changes from tiny code edits, and for learning about causal profiling.
this is the most amazing optimisation information I have seen — HN, 2020
Software performance & optimization · Testing, debugging & developer tools
Subtitles (excerpt)
Hi everybody. Uh so I'm Emery Berger. I'm going to be talking today about performance matters. Uh this is joint work with my former PhD student Charlie Krsinger. So I'm going to tell you a story that happened a short time ago in a valley far far away. Not not actually this one, but in fact this one. Um so the story is about a character who we're going to call Luke. Luke is our hero. Of course he's a hero in Silicon Valley because Luke has an idea for an app. All right. So here's Luke's genius idea for an app. Um basically you use your smartphone and you take pictures of things and then it goes and finds matches like and returns them to you. And he's got a great name for it as well. He's going to call it Oggle. Um and he's pretty sure Oggle is going to totally disrupt image search. Nobody has told him about Google Image Search yet, but anyway. So he sets about building it. So he makes the prototype Oggle, right? So the prototype Oggle works like this. You take a picture, it gets sent off to the Oggle data center. If it is new, it gets added to the database and then at the same time it goes and finds similar pictures and sends them back to the user. All right? So this is pretty straightforward.
On Hacker News
Nobody should do benchmarking like this anymore. Memory layout of your code has such a big impact on performance on modern computers that measuring performance without removing that variable leads to wild goose chases, where you think you improved something, but in reality you incidentally got the compiler to move the code around a bit. Emery Berger has an excelent talk on this [1], and a causal … — j-pb, 2023-06
I would highly recommend Emery Berger's talks [1] for anyone interested in benchmarking software. The alignment and code layout in memory that huayra mentions has shockingly large performance implications. [1] [VIDEO] — acidbaseextract, 2020-12
Aside: this is the most amazing optimisation information I have seen: [VIDEO] Unfortunate that it is a video... Summary: Modern CPUs have so many hidden causes of performance variation, that you require special tools to actually measure small performance gains. He finds an amazing but unobvious speed up in SQLite using the causal analysis tool they developed. And a surprising difference between -… — robocat, 2020-05
I haven't had a chance to mess around with it much, but the coz-profiler [1] uses basically the same idea, but the other way around (i.e., slow down everything else to get a "virtual speedup") which helps quantify what the effect of optimizing some code would be. I learnt about this tool from Emery Berger's talk [2] on this (at strangeloop), which I highly recommend. Lots of really nice insight, … — jaybosamiya, 2020-01
"Performance matters" by Emery Berger on StrangeLoop'19 is a great talk - [VIDEO] Also, rest of his talks are also fascinating: - [LINK] - [LINK] — divan, 2019-12
Related videos
- The UK Is a Country Made of Countries · CGP Grey · 5:14
- The Virtual Production of The Mandalorian Season One · Industrial Light & Magic · 4:42
- RSA ANIMATE: Language as a Window into Human Nature · Royal Society of Arts · 10:53
- Why Are You So Angry? Part 1: A Short History of Anita Sarkeesian · Innuendo Studios · 9:35
- The Marvel Symphonic Universe · Every Frame a Painting · 13:35
- Confessions of a Converted Lecturer: Eric Mazur · UMBCtube · 1:20:08
- Interactive notebooks ~ Pluto.jl | Fons van der Plas | JuliaCon 2020 · The Julia Programming Language · 23:37
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- Geoffrey West on COMPLEXITY · FQxI · 40:50
- 4 2 1 Christopher Domas The future of RE Dynamic Binary Visualization · Adrian Crenshaw · 48:39
- Stanford Seminar: Beyond Floating Point: Next Generation Computer Arithmetic · Stanford Online · 1:31:28
- "Performance (Really) Matters" with Emery Berger · Association for Computing Machinery (ACM) · 1:04:47
- The Ingenious Design of the Aluminum Beverage Can · engineerguy · 11:39
- Brandt Bucher – A JIT Compiler for CPython · encukou · 47:50
- Pure Functional Programming in Excel • Felienne Hermans • GOTO 2016 · GOTO Conferences · 43:16
- Plover: Thought to Text at 240 WPM · Next Day Video · 34:21
- How Quantum Computers Break Encryption | Shor's Algorithm Explained · minutephysics · 17:30
- Why You Should Put YOUR MASK On First (My Brain Without Oxygen) - Smarter Every Day 157 · SmarterEveryDay · 10:17
- Bret Victor The Future of Programming · Joey Reid · 32:55