Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin
Channel:EuroBSDCon · Length:47:41 · Published:2021-09-27 · Views:9503
Summary
Netflix engineer Drew Gallatin explains how Netflix serves TLS-encrypted video at 400Gb/s from a single FreeBSD server. He covers NUMA, kernel TLS, hardware TLS offload and the memory bandwidth and PCIe bottlenecks they hit.
Why HN recommends it
HN cites it as a prime example of FreeBSD tuned for extreme network performance at massive scale.
being actively used to run the largest streaming service on the planet makes you pretty relevant. — HN, 2022
Software performance & optimization · Operating systems & kernels · Networking & internet infrastructure
Subtitles (excerpt)
so my name is drew gallatin and i'm from netflix and i focus on uh basically cpu efficiency and trying to serve uh as many customers as we can from as little hardware as we can both to save the environment and to save ourselves some costs so for the last little bit i've been trying to push the envelope with serving as much as we can from a single box and i'm here to talk to you about getting as close as we can to serving 400 gigs from a single server on freebsd so i'm going to talk about you know why we want to do this and i'm going to describe a little bit about our production platform and talk about uh the workload that we have and then talk a little bit about whether or not we need pneuma or not to achieve these goals uh talk a little bit about hardware inline tls which is in freebsd we called nick tls and then if i have time at the end i'll loop around and look at some alternate platforms in addition to the production platform that i'll be talking about for most the talk all right since 2020 we've been rolling out uh some servers that uh have been able to serve 200 gigs of uh tls encrypted video so that's really cool um the thing is these servers actually have four 100 gig network ports and we've always thought well
On Hacker News
Your comment suggests that FreeBSD is a thing of a past and no longer capable of "quality networking", due to poor WiFi support. I can only agree with the poor WiFi support part. But WiFi is by no means something you can judge networking stack dedicated for servers. FreeBSD was never designed for consumer hardware networking. There were a few "desktop distros" but all have more or less died, and … — voytec, 2024-09
Discussion of the same presentation 11 months ago, when the title was 400GB/s. [LINK] This was the video which was posted back then alongside the slides: [VIDEO] — qwertox, 2022-08
I'd say being actively used to run the largest streaming service on the planet makes you pretty relevant. [VIDEO] — breakfastduck, 2022-02
This is my EuroBSDcon talk from 2 years ago. The more recent one (about getting to 400G) is up now at [VIDEO] — drewg123, 2021-10
Related videos
- How Python was Shaped by leaky Internals, Armin Ronacher, Flask framework · Видео с мероприятий {speach! · 49:55
- The Tragedy of systemd · linux.conf.au · 47:18
- CppCon 2015: Andrei Alexandrescu “std::allocator...” · CppCon · 1:12:27
- Preventing the Collapse of Civilization / Jonathan Blow (Thekla, Inc) · DevGAMM · 1:02:41
- "Performance Matters" by Emery Berger · Strange Loop Conference · 42:15
- The Thirty Million Line Problem · Molly Rocket · 1:48:55
- CppCon 2017: Matt Kulukundis “Designing a Fast, Efficient, Cache-friendly Hash Table, Step by Step” · CppCon · 59:33
- VCF East: Ken Thompson interviewed by Brian Kernighan · Vintage Computer Federation · 1:03:51
- Harder Drive: Hard drives we didn't want or need · suckerpinch · 36:46
- Erlang Factory 2014 - That's 'Billion' with a 'B': Scaling to the Next Level at WhatsApp · Erlang Solutions · 49:15
- How Crash Bandicoot Hacked The Original Playstation | War Stories | Ars Technica · Ars Technica · 31:37
- LISA11 - Fork Yeah! The Rise and Development of illumos · USENIX · 1:04:03
- "How NOT to Measure Latency" by Gil Tene · Strange Loop Conference · 42:59
- USENIX ATC '21/OSDI '21 Joint Keynote Address-It's Time for Operating Systems to Rediscover Hardware · USENIX · 1:06:19
- Refterm Lecture Part 1 - Philosophies of Optimization · Molly Rocket · 18:41
- CppCon 2014: Mike Acton "Data-Oriented Design and C++" · CppCon · 1:27:46