Erlang Factory 2014 - That's 'Billion' with a 'B': Scaling to the Next Level at WhatsApp
Channel:Erlang Solutions · Length:49:15 · Published:2014-03-08 · Views:49777
Summary
Rick Reed of WhatsApp explains at Erlang Factory 2014 how the service scaled to billions of messages with a very small engineering team. He covers the FreeBSD and Erlang stack, Mnesia usage, server counts and bottleneck work.
Why HN recommends it
The go-to talk showing how Erlang let a tiny team run a massive messaging system.
watch this talk and imagine trying to recreate that system with only a handful of server engineers — HN, 2017
Functional programming · Software performance & optimization · Distributed systems
Subtitles (excerpt)
thank you uh as you said I'm Rick Reed I'm from a small startup you've probably never heard of um and uh I want to start by apologizing for the title when I submitted the talk in December I did not anticipate that it would mean something different in March uh so I I've been with WhatsApp since 2011 uh I learned llang at whatsapp and my focus is mly on scalability and the multimedia system um I'm honored to work with the fantastic team but we're small there's only about 10 of us plus or minus that work with llang and we handle all the development in the Ops um now before I get into why all the things that you need to tweak and change and patch and whatnot to get uh something of the scale of what'sapp working on earling I want to start out by saying that it's been a superb choice for for WhatsApp um primarily because of scalability in a number of directions uh dimensions uh just in terms of programming uh productivity I I don't think that it would be you'd be hardpressed to find a better language to be able to support so many users with so few Engineers than erlang uh secondly just in terms of the the scale of systems that you can build using it and and the the programming model that comes naturally and all the
On Hacker News
One of my favorite talks is by Rick Reed about scaling Erlang at WhatsApp. What an absolute savage. He flies through an articulate and in-depth curriculum on system performance and bottleneck mitigation. The talk is called "That's 'Billion' with a 'B'" and makes for a great lunchtime watch: [VIDEO] — kornish, 2020-09
Not sure why this comment saw a couple downvotes earlier. mbesto is correct: for most startups, most of the time, competitive advantage doesn't come from the underlying tech stack. To make a general statement, most things could be done similarly on any of several platforms. However, when product requirements match exceptionally well with a specialized technology, you can see things that would sim… — kornish, 2017-07
My other favorite "scalability" study is from WhatsApp: [VIDEO] That's 'Billion' with a 'B': Scaling to the Next Level at WhatsApp (that walk title was create before the acquisition and was mean to imply message count, after the acquisition it got a secondary meaning). The one thing that is fascinating about it, is how small their team was compared to the volume and complexity of the operation. — rdtsc, 2014-07
WhatsApp. Rick Reed’s “That’s Billion with a B” presentation is a good glimpse into their own view of it [VIDEO] — dpeck, 2022-08
Here is the description of their stack and how Erlang helped them by Rick Reed at Erlang Factory: [VIDEO] Here is Jamshid Mahdavi talking about their stack as well but focusing on development, testing and shipping code. Some of the stuff they do will surprise you if you've been at a shop with a large QA team and deployment pipelines with many stages. [LINK] — rdtsc, 2017-09
Related videos
- You are being misled about renewable energy technology. · Technology Connections · 1:32:00
- What Really Happened During the Texas Power Grid Outage? · Practical Engineering · 16:47
- Predatory Lending: Last Week Tonight with John Oliver (HBO) · LastWeekTonight · 16:32
- Matt Might - Winning the War on Error Solving the Halting Problem and Curing Cancer · Curry On! · 48:36
- "The Mess We're In" by Joe Armstrong · Strange Loop Conference · 45:50
- Joe Armstrong & Alan Kay - Joe Armstrong interviews Alan Kay · Erlang Solutions · 1:16:55
- Eric Cline | 1177 BC: The Year Civilization Collapsed · The Institute for the Study of Ancient Cultures · 52:19
- Computer Science - A Guide for the Perplexed • Joe Armstrong • GOTO 2018 · GOTO Conferences · 1:02:28
- Princes of the Yen | The Hidden Power of Central Banks · Independent POV · 1:32:39
- Inside a Huge PCB Factory · Strange Parts · 26:48
- Rick Reed - WhatsApp: Half a billion unsuspecting FreeBSD users · iX · 54:14
- Pandora's Box, E1: The Engineers' Plot · nagualdesign · 44:06
- The Patent Scam Intro · Austin Meyer · 21:36
- Slavoj Žižek on "They Live" (The Pervert's Guide to Ideology) · Christian G · 6:00
- Nest Protect is a terrible buggy product · Brad Fitzpatrick · 5:57
- Slavoj Žižek + Paul Holdengräber "Surveillance and whistleblowers" - International Authors' Stage · Det Kgl. Bibliotek · 1:20:59
- Erlang Factory SF 2016 Keynote Phoenix and Elm – Making the Web Functional · Erlang Solutions · 55:28