AWS re:Invent 2016: Move Exabyte-Scale Data Sets with AWS Snowmobile
Channel:Amazon Web Services · Length:3:39 · Published:2016-12-01 · Views:237877
Summary
AWS's short promo for Snowmobile, a 45-foot shipping container pulled by a semi truck that moves up to 100PB of data to AWS.
Why HN recommends it
HN cites it as the example of physically trucking data when network transfer is impractical.
You can transfer up to 100PB per Snowmobile, a 45-foot long rugged sized shipping container, pulled by a semi-trailer truck. — HN, 2019
Databases & storage · Cloud, DevOps & reliability
Subtitles (excerpt)
a number of our customers said well this is great if I have hundreds of pedabytes or dozens of pedabytes what about if I have exobytes of data we have a lot of customers who have exobytes of data when we started AWS the notion of an exabyte of data just seemed completely out there like an exabyte of data it's so big today an exited data is a lot more commonplace you'd be surprised how many companies large Enterprises and successful startups given the way they collect data have expit of data they said well I love snowball edges but if I have an exabyte of data I'm going to need like 10,000 of those snowball edges and that's probably too many for us to want to manage so is there something you can do that allow us to move exabytes of data so we can Leverage The Cloud as well so we thought about that that was a tricky one and the first thing that came to mind was we're going to need a bigger box [Applause] [Music] [Applause] [Music] [Applause] [Music] [Applause] [Music] [Music] yeah [Music] [Applause] introducing AWS snowmobile so snowmobile is a 100 pyte container it comes it comes fixed to a 45 ft long container and truck the way it works we'll drive the truck up to your data center we'll take the snowmobile a fix to
On Hacker News
AWS has a whole line of these, their "Snow" product line.[1] There's the "Snowcone", the "Snowball", and, for those really big transfers, the "Snowmobile".[2] [1] [LINK] [2] [VIDEO] — Animats, 2024-04
The scale of these megacorps is crazy! I wonder how you even plan to move that much data. I know that Amazon has a service called Snowmobile for stuff like this. They probably did something similar here. "You can transfer up to 100PB per Snowmobile, a 45-foot long rugged sized shipping container, pulled by a semi-trailer truck." [VIDEO] — pizza, 2019-01
[VIDEO] "Never underestimate the bandwidth of a station wagon full of tapes barreling down the highway at 70mph." — sillysaurus3, 2017-09
Related videos
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- The Value of Values with Rich Hickey · InfoQ · 31:43
- Velocity NY 2013: Richard Cook, "Resilience In Complex Adaptive Systems" · O'Reilly · 19:09
- Debugging Under Fire: Keep your Head when Systems have Lost their Mind • Bryan Cantrill • GOTO 2017 · GOTO Conferences · 52:34
- AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401) · Amazon Web Services · 59:56
- "Turning the database inside out with Apache Samza" by Martin Kleppmann · Strange Loop Conference · 47:42
- Literate Devops with Emacs · Howard Abrams · 28:36
- Conflict Resolution for Eventual Consistency • Martin Kleppmann • GOTO 2016 · GOTO Conferences · 51:35
- 01 - Course Introduction & Relational Model (CMU Databases Systems / Fall 2019) · CMU Database Group · 1:06:44
- Introduction to NoSQL • Martin Fowler • GOTO 2012 · GOTO Conferences · 54:51
- Containers From Scratch • Liz Rice • GOTO 2018 · GOTO Conferences · 42:53
- Rich Hickey rants about HttpServletRequest in 1080p: Death By Specificity from Clojure Made Simple · Fred Overflow · 4:56
- TigerStyle! (Or How To Design Safer Systems in Less Time) by Joran Dirk Greef · TigerBeetle · 1:01:59
- Over 200,000 Servers in One Place! Visiting Hetzner in Falkenstein (Germany) · der8auer EN · 20:29
- Bryan Cantrill from Joyent on Manta: internet-facing object storage facility that features compute · AI Council · 1:31:05
- Michael Stonebraker | Big Data is (at least) Four Different Problems · Michigan Engineering · 55:53