NYCBSDCon 2014: Serving one-third of the Internet via FreeBSD
Channel:BSDTV · Length:1:01:39 · Published:2014-04-06 · Views:13621
Summary
Scott Long of Netflix presents the architecture of the OpenConnect content delivery network at NYCBSDCon 2014. He explains why Netflix runs FreeBSD 10 on its appliances and what the future holds.
Why HN recommends it
Cited as the primary source for why Netflix uses FreeBSD and UFS rather than ZFS on its CDN boxes, and for its GPL reasoning.
Actually it turns out they don't really have a need for most of the features of ZFS. — HN, 2014
Distributed systems · Linux & open-source ecosystems · Networking & internet infrastructure
On Hacker News
Pretty sure it's still UFS+J. They've mentioned in the past that the benefits of ZFS don't really apply to the CDN boxes: if a drive dies, it's simply removed from the local cache, and files are re-downloaded/redistributed as necessary across the remaining cache drives the next time the appliance refreshes from its upstream origin. Additionally, ZFS prefetching was actually less performant in som… — m11r, 2019-02
Netflix delivers all video streaming content via FreeBSD which makes up 37% of all internet traffic. [LINK] They also contribute to FreeBSD core. It is not just an "appliance" as some people seem to want to point to. [LINK] [LINK] [VIDEO] In addition, a guy I met, who worked at Yahoo, told me about 25% of Yahoo still runs FreeBSD as of two years ago. — toomanythings2, 2016-04
Scott Long has summarized it a few times, eg, from [LINK] : • Availability of expertise, outstanding community • Works well, good vendor support • No GPL • Features used: – SUJ – gmirror – boot drive only – AIO – Dtrace, HWPMC – TCP Stack, modular CC It's missing "Integrates tightly with nginx: Async I/O and sendfile()" which Scott included in [VIDEO] . In the video he elaborates a bit more about… — brendangregg, 2014-11
Actually it turns out they don't really have a need for most of the features of ZFS. So they don't use it. [VIDEO] — howeyc, 2014-08
> I'm assuming whatever file system is on the disks... Netflix uses UFS+J on FreeBSD 10. Here are some notes from their talk at NYCBSDCon 2014: - 400,000 stream files per appliance. - 5,000 - 25,000 client streams per appliance. - 300 - 500 streams coming off each disk all the time. - Attempt to buffer 1MB ahead, but caching is futile. - Result is completely random disk workload. - System becomes… — runlevel1, 2014-07
Related videos
- The Soul of Erlang and Elixir • Sasa Juric • GOTO 2019 · GOTO Conferences · 42:02
- The Tragedy of systemd · linux.conf.au · 47:18
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- Harder Drive: Hard drives we didn't want or need · suckerpinch · 36:46
- The Real Story Behind Wayland and X - Daniel Stone (linux.conf.au 2013) · Mladen Mijatov · 45:35
- Erlang Factory 2014 - That's 'Billion' with a 'B': Scaling to the Next Level at WhatsApp · Erlang Solutions · 49:15
- LISA11 - Fork Yeah! The Rise and Development of illumos · USENIX · 1:04:03
- Tech Talk: Linus Torvalds on git · Google · 1:10:15
- "Turning the database inside out with Apache Samza" by Martin Kleppmann · Strange Loop Conference · 47:42
- The Language of the System - Rich Hickey · ClojureTV · 1:02:49
- This Video Is Sponsored By ███ VPN · Tom Scott · 7:25
- Google I/O 2012 - Go Concurrency Patterns · Google for Developers · 51:27
- Conflict Resolution for Eventual Consistency • Martin Kleppmann • GOTO 2016 · GOTO Conferences · 51:35
- DebConf 14: QA with Linus Torvalds · Adnan Hodzic · 1:11:43
- "Unison: a new distributed programming language" by Paul Chiusano · Strange Loop Conference · 41:05
- A New Way to look at Networking · Google · 1:21:15