AWS re:Invent 2018: Powering Next-Gen EC2 Instances: Deep Dive into the Nitro System (CMP303-R1)
Channel:Amazon Web Services · Length:1:05:06 · Published:2018-11-29 · Views:56873
Summary
An AWS re:Invent 2018 session diving into the Nitro system, a set of hardware offload and security building blocks behind next-generation EC2 instances. It covers the design and architecture and how Nitro enables new instance types.
Why HN recommends it
Cited as the primary source on how Nitro offloads I/O to dedicated hardware and keeps management tasks off guest CPUs.
With the Nitro hypervisor, there are no management tasks that share CPUs with guest workloads. — HN, 2019
Operating systems & kernels · Cloud, DevOps & reliability
Subtitles (excerpt)
we don't get started alright let's go ahead and get started my name is Anthony Liguori I'm a senior principal engineer with an EC 2 and I've led the development of the nitro system over the last year I've also led the engineering effort behind firecracker which we just announced earlier this week and most recently AWS outposts which we just launched today so really exciting week I'm super excited to share all of the exciting things that we're doing with all of you and I really appreciate you coming to a 7:00 p.m. meeting toward the end of this event I know I'm standing between everybody and beer and foods so I appreciate you taking the time to come and listen to what I have to say we're gonna start out with an overview of what nitro is why it matters and how it works last year I did another presentation on nitro and we kind of scratched the surface this year I want to go really deep in a specific component and that is the nitro security chip and so we'll talk a lot about why that exists what it does and what we use it for then I wanted to walk through some of our recent recent launches and talk about how nitro enabled those launches and you know how it's providing benefits to you very concretely with some of our recent instance
On Hacker News
Hi! I'm from the EC2 engineering team. This is a super challenging problem for general purpose virtualization stacks. EC2 has been working to avoid any guest VM interruptions. With the Nitro hypervisor, there are no management tasks that share CPUs with guest workloads. See more here, including data from a real customer with real-time requirements running on EC2 under the Nitro hypervisor: [VIDEO] — _msw_, 2019-01
A longer history would start with IBM mainframes. More recently, IBM Ultravisor shipped in OpenPower firmware, mediating KVM VMs, [LINK] & [LINK] 2018 video by Ian Pratt covers Xen, uXen and AX (2005-2015), [LINK] . Citrix acquired XenSource. Pratt left to work at Bromium, acquired by HP (which previously acquired BIOS company from Bromium co-founder). The former CTO of XenSource co-founded Qumra… — transpute, 2025-06
DPUs/SmartNICs are a partial industry response to AWS Nitro (based on Annapurna acquisition) which performs I/O (network/storage) virtualization. Nvidia DPU is based on Mellanox acquisition AMD DPU is based on Pensado acquisition Intel has an in-house DPU There was a 2018 talk on AWS Nitro, [VIDEO] Cadence summary: [LINK] James Hamilton summary: [LINK] The founder of Annapurna-Nitro is now at [LI… — walterbell, 2022-05
Hi Jeff! Eeeeeek! I'd love to know so much more about the Nitro acceleration. All these accelerated fabrics are so interesting. * What does the Nitro accelerator look like to the host? . Does the Nitro accelerator present as NVMe devices to the OS host, or is there a more custom thing it presents as? Does the Nitro accelerator use SR-IOV to or something else to present as many different PCIe adap… — rektide, 2021-11
Full post from eclypsium [LINK] . Also I assume aws baremetal servers are not vulnerable due to the nitro security card ( [VIDEO] ). — richardowright, 2019-02
Related videos
- The Tragedy of systemd · linux.conf.au · 47:18
- Velocity NY 2013: Richard Cook, "Resilience In Complex Adaptive Systems" · O'Reilly · 19:09
- Debugging Under Fire: Keep your Head when Systems have Lost their Mind • Bryan Cantrill • GOTO 2017 · GOTO Conferences · 52:34
- The Thirty Million Line Problem · Molly Rocket · 1:48:55
- VCF East: Ken Thompson interviewed by Brian Kernighan · Vintage Computer Federation · 1:03:51
- AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401) · Amazon Web Services · 59:56
- LISA11 - Fork Yeah! The Rise and Development of illumos · USENIX · 1:04:03
- USENIX ATC '21/OSDI '21 Joint Keynote Address-It's Time for Operating Systems to Rediscover Hardware · USENIX · 1:06:19
- Literate Devops with Emacs · Howard Abrams · 28:36
- AT&T Archives: The UNIX Operating System · AT&T Tech Channel · 27:27
- Unix and Google · FOAM · 7:15
- Bryan Cantrill on Jails and Solaris Zones · PapersWeLove · 1:45:46
- Containers From Scratch • Liz Rice • GOTO 2018 · GOTO Conferences · 42:53
- User-level threads....... with threads. - Paul Turner - Google · Linux Plumbers Conference · 33:59
- Over 200,000 Servers in One Place! Visiting Hetzner in Falkenstein (Germany) · der8auer EN · 20:29
- Bryan Cantrill from Joyent on Manta: internet-facing object storage facility that features compute · AI Council · 1:31:05