Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin

Channel:EuroBSDCon · Length:47:41 · Published:2021-09-27 · Views:9503

Watch on YouTube

Summary

Netflix engineer Drew Gallatin explains how Netflix serves TLS-encrypted video at 400Gb/s from a single FreeBSD server. He covers NUMA, kernel TLS, hardware TLS offload and the memory bandwidth and PCIe bottlenecks they hit.

Why HN recommends it

HN cites it as a prime example of FreeBSD tuned for extreme network performance at massive scale.

being actively used to run the largest streaming service on the planet makes you pretty relevant. — HN, 2022

Software performance & optimization · Operating systems & kernels · Networking & internet infrastructure

Subtitles (excerpt)

so my name is drew gallatin and i'm from netflix and i focus on uh basically cpu efficiency and trying to serve uh as many customers as we can from as little hardware as we can both to save the environment and to save ourselves some costs so for the last little bit i've been trying to push the envelope with serving as much as we can from a single box and i'm here to talk to you about getting as close as we can to serving 400 gigs from a single server on freebsd so i'm going to talk about you know why we want to do this and i'm going to describe a little bit about our production platform and talk about uh the workload that we have and then talk a little bit about whether or not we need pneuma or not to achieve these goals uh talk a little bit about hardware inline tls which is in freebsd we called nick tls and then if i have time at the end i'll loop around and look at some alternate platforms in addition to the production platform that i'll be talking about for most the talk all right since 2020 we've been rolling out uh some servers that uh have been able to serve 200 gigs of uh tls encrypted video so that's really cool um the thing is these servers actually have four 100 gig network ports and we've always thought well

On Hacker News

Your comment suggests that FreeBSD is a thing of a past and no longer capable of "quality networking", due to poor WiFi support. I can only agree with the poor WiFi support part. But WiFi is by no means something you can judge networking stack dedicated for servers. FreeBSD was never designed for consumer hardware networking. There were a few "desktop distros" but all have more or less died, and … — voytec, 2024-09
Discussion of the same presentation 11 months ago, when the title was 400GB/s. [LINK] This was the video which was posted back then alongside the slides: [VIDEO] — qwertox, 2022-08
I'd say being actively used to run the largest streaming service on the planet makes you pretty relevant. [VIDEO] — breakfastduck, 2022-02
This is my EuroBSDcon talk from 2 years ago. The more recent one (about getting to 400G) is up now at [VIDEO] — drewg123, 2021-10

Related videos