Shouting in the Datacenter

Channel:Bryan Cantrill · Length:2:00 · Published:2008-12-31 · Views:5670291

Watch on YouTube

Summary

A two-minute 2008 clip from Sun's Fishworks team in which Brendan Gregg uses DTrace to show disk latency spiking while he shouts at a rack of drives. Bryan Cantrill narrates the demonstration.

Why HN recommends it

It is the go-to viral demo whenever HN discusses vibration, acoustic attacks, or sound affecting hard drives.

this entertaining YouTube video from 2009, in which someone demonstrates the effect by literally shouting at a rack of servers — HN, 2017

Software performance & optimization · Testing, debugging & developer tools · Hardware (other)

Subtitles (excerpt)

Hi, I'm Brendan. We're here in the Fishworks Lab. Sorry for screaming. It's very loud in here with the air conditioners and service all around me. We just made an interesting discovery and we thought we'd show you straight away. So over here, here I'm measuring dis IO operations broken down by latency. Um I've also drilled down to disk IO operations taking at least 520 milliseconds broken down by disk. This is using Drace so I can do performance analysis of discs. I'm applying a right workload to two Jbods which are over here. The lights are blinking on these Jbs because they're doing work. What I'm going to do is not recommended. This is not supported. Do not try this at home. [Applause] This is not special effects. This is real. What we're looking at here is the effect of disc vibration. Vibration is a serious issue and we can see the effect here that it's caused. So here the uh latency for the discs that are under the workload has gone up. Here I can see which discs have had now had IO operations longer than 500 milliseconds and I can find out that they belong to the Jbods I was just shouting at. So amazing stuff. This has been made possible by analytics from Fishworks which lets us look at things we've never been never seen before.

On Hacker News

I had the "vibration" problem a few times in me IT career, train, construction work and once elevators. It is the kind of issue that are really hard to diagnose the first time but after the first time it's part of the standard "diagnose suite". I love to show this video about the effect of noise on HDD (be sure to put the volume down) [VIDEO] — kuon, 2022-08
One of the little gems I found while I was putting together the video for this post was "Shouting in the datacenter", an older clip (from the pre-HD era) demonstrating the consequence of doing exactly what the title says: [VIDEO] Warning: loud! — geerlingguy, 2021-04
The paper links to this entertaining YouTube video from 2009, in which someone demonstrates the effect by literally shouting at a rack of servers: [VIDEO] (EDIT: replaced the link I found via YouTube's search with the original, thanks robotmlg!) — teraflop, 2017-12
Also interesting: a Sun engineer uses dtrace to show HDD latency spiking after he yells at his disks [VIDEO] — dorianj, 2011-08
i just deleted a many-paragraph response that was getting long-winded(incoherent) and started over -- yes, i concur. like many, i dislike the "i want to help save the world" generic posts, but i think most here are being quick to dismiss TFA. to others (not the parent): just want to help place a human face onto this guy, who has (not known to me until now) not only published a bunch of works (who… — boneitis, 2026-02

Related videos