Rick Reed - WhatsApp: Half a billion unsuspecting FreeBSD users
Channel:iX · Length:54:14 · Published:2014-11-21 · Views:30584
Summary
Rick Reed of WhatsApp speaks at MeetBSD about running a messaging service on FreeBSD and Erlang at huge scale. He covers the stack, tuning and the challenges of millions of connections per host.
Why HN recommends it
Pointed to as a rare look at how a tiny engineering team ran WhatsApp's massive scale on FreeBSD and Erlang.
Their technology stack (FreeBSD/Erlang) is pretty interesting, more info here: 2014 talks by Rick Reed — HN, 2016
Distributed systems · Linux & open-source ecosystems · Cloud, DevOps & reliability
Subtitles (excerpt)
We uh and I always struggle to fit enough uh to have enough time to talk about all the different things that we have to do to Erling to uh to actually scale and uh allow us to do what we do. Um and the bottom line with FreeBSD is that um we don't have to do much. uh you know going around the room uh hearing you know everybody's comments about uh why they love FBSD those are those all resonate with us and uh and what I said was was really true um you know with the size of the team we have so there's a dozen of us on the server team uh I don't think there's any other platform that we could have at that level at at the OS level that would enable us to to scale to the way we have with the with the staff that we have because we just don't we don't really have to worry about uh what's going on with the OS and we can focus all our time at at higher levels. Uh and so you'd think I'd learned my lesson about titling these. Every time I title something uh that has a number in it or or something like that, it means something different by the time I actually give the talk. Um if you if you happen to look at this year's uh uh Erlang factory talk, you'll see what I mean about that one. But anyway, so we're we're past 600 million users now.
On Hacker News
I can personally guarantee to you from direct current experience that there is nothing particularly solved about running services for even 50 million users. Go watch this: [VIDEO] — felixgallo, 2015-09
It's required because your phone is where your messages are stored. Whatsapp don't retain messages/media after they've been delivered to your phone, which is a compelling privacy feature for many. It's also what allows them to serve such an enormous user base with limited hardware. Their technology stack (FreeBSD/Erlang) is pretty interesting, more info here: 2014 talks by Rick Reed: [LINK] [VIDE… — ddeck, 2016-05
> no big player took to developing cool things on top. Just one data-point, but WhatsApp engineering was adamant that FreeBSD was a key precursor that allowed them to scale 2m+ connections per host on their (rather beefy) boxes: [VIDEO] > It just shows you that having a technically good solution is irrelevant. True. I've seen many promising projects die/stagnate at the hands of unpopularity, *BSD… — ignoramous, 2019-03
There was a talk + slides about WhatsApp FreeBSD usage [1, 2]. At around 23:50 in the video, Rick Reed talks about slide #17, they say they are running 9.1 - 9.3, and looking at 10.1 (not in a hurry as 9 works for them). [1] [VIDEO] [2] [LINK] — WestCoastJustin, 2015-02
Related videos
- Princes of the Yen | The Hidden Power of Central Banks · Independent POV · 1:32:39
- Erlang Factory 2014 - That's 'Billion' with a 'B': Scaling to the Next Level at WhatsApp · Erlang Solutions · 49:15
- Inside a Huge PCB Factory · Strange Parts · 26:48
- The Soul of Erlang and Elixir • Sasa Juric • GOTO 2019 · GOTO Conferences · 42:02
- The Tragedy of systemd · linux.conf.au · 47:18
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- Velocity NY 2013: Richard Cook, "Resilience In Complex Adaptive Systems" · O'Reilly · 19:09
- Debugging Under Fire: Keep your Head when Systems have Lost their Mind • Bryan Cantrill • GOTO 2017 · GOTO Conferences · 52:34
- AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401) · Amazon Web Services · 59:56
- The Real Story Behind Wayland and X - Daniel Stone (linux.conf.au 2013) · Mladen Mijatov · 45:35
- LISA11 - Fork Yeah! The Rise and Development of illumos · USENIX · 1:04:03
- Tech Talk: Linus Torvalds on git · Google · 1:10:15
- "Turning the database inside out with Apache Samza" by Martin Kleppmann · Strange Loop Conference · 47:42
- The Language of the System - Rich Hickey · ClojureTV · 1:02:49
- Google I/O 2012 - Go Concurrency Patterns · Google for Developers · 51:27
- Literate Devops with Emacs · Howard Abrams · 28:36