"Performance Matters" by Emery Berger

Channel:Strange Loop Conference · Length:42:15 · Published:2019-09-15 · Views:502235

Watch on YouTube

Summary

Emery Berger explains why performance is hard to measure and deliver on modern hardware, showing how code layout and alignment can swamp optimization effects. He presents Stabilizer for statistically sound evaluation and Coz, a causal profiler.

Why HN recommends it

It is the standard recommendation for anyone puzzled by unexplained benchmark changes from tiny code edits, and for learning about causal profiling.

this is the most amazing optimisation information I have seen — HN, 2020

Software performance & optimization · Testing, debugging & developer tools

Subtitles (excerpt)

Hi everybody. Uh so I'm Emery Berger. I'm going to be talking today about performance matters. Uh this is joint work with my former PhD student Charlie Krsinger. So I'm going to tell you a story that happened a short time ago in a valley far far away. Not not actually this one, but in fact this one. Um so the story is about a character who we're going to call Luke. Luke is our hero. Of course he's a hero in Silicon Valley because Luke has an idea for an app. All right. So here's Luke's genius idea for an app. Um basically you use your smartphone and you take pictures of things and then it goes and finds matches like and returns them to you. And he's got a great name for it as well. He's going to call it Oggle. Um and he's pretty sure Oggle is going to totally disrupt image search. Nobody has told him about Google Image Search yet, but anyway. So he sets about building it. So he makes the prototype Oggle, right? So the prototype Oggle works like this. You take a picture, it gets sent off to the Oggle data center. If it is new, it gets added to the database and then at the same time it goes and finds similar pictures and sends them back to the user. All right? So this is pretty straightforward.

On Hacker News

Nobody should do benchmarking like this anymore. Memory layout of your code has such a big impact on performance on modern computers that measuring performance without removing that variable leads to wild goose chases, where you think you improved something, but in reality you incidentally got the compiler to move the code around a bit. Emery Berger has an excelent talk on this [1], and a causal … — j-pb, 2023-06
I would highly recommend Emery Berger's talks [1] for anyone interested in benchmarking software. The alignment and code layout in memory that huayra mentions has shockingly large performance implications. [1] [VIDEO] — acidbaseextract, 2020-12
Aside: this is the most amazing optimisation information I have seen: [VIDEO] Unfortunate that it is a video... Summary: Modern CPUs have so many hidden causes of performance variation, that you require special tools to actually measure small performance gains. He finds an amazing but unobvious speed up in SQLite using the causal analysis tool they developed. And a surprising difference between -… — robocat, 2020-05
I haven't had a chance to mess around with it much, but the coz-profiler [1] uses basically the same idea, but the other way around (i.e., slow down everything else to get a "virtual speedup") which helps quantify what the effect of optimizing some code would be. I learnt about this tool from Emery Berger's talk [2] on this (at strangeloop), which I highly recommend. Lots of really nice insight, … — jaybosamiya, 2020-01
"Performance matters" by Emery Berger on StrangeLoop'19 is a great talk - [VIDEO] Also, rest of his talks are also fascinating: - [LINK] - [LINK] — divan, 2019-12

Related videos