Google I/O 2013 - High Performance Audio

Channel:Google for Developers · Length:40:03 · Published:2013-05-19 · Views:61658

Watch on YouTube

Summary

A Google I/O 2013 talk by Android audio engineers on why reliable, low-latency audio is hard on the platform. It covers problem areas across the stack, platform work underway and techniques apps can use.

Why HN recommends it

Treated as the definitive explanation of Android's audio latency problem, showing it spans the entire stack.

is a must-watch — HN, 2015

Software performance & optimization · Audio & video engineering

Subtitles (excerpt)

IAN NI-LEWIS: Welcome, audio diehards. We're so happy to have you here. It's great to see that more than 10 or 15 people would like to hear about high performance audio on Android. We were running bets. So I'm Ian Ni-Lewis. I'm the developer relations contact for audio. If you send audio questions to our developers support email, probably I will answer them. But today, it's my great pleasure to introduce a couple friends of mine from the engineering team, Glenn Kasten and Raph Levien, who have actually done a huge amount of work in the last couple of years to set the standard for Android audio and make it better. And you're going to be hearing today some happy stories and some sad stories just to prep you on that. But believe me, these guys have advanced to state of the art for Android audio more than anyone else and also Raph did some, too. I know you were going to call me on that. Anyway, I start stop talking. Let's go ahead and welcome Glenn Kasten to begin High Performance Audio on Android. [APPLAUSE] GLENN KASTEN: Hi, everyone. I'm Glenn Kasten. I'm on the Android audio team, and my job is to provide great Android audio performance. I work with our OEMs and silicon chip vendors to help

On Hacker News

If you want an in-depth explanation (AP mostly skims the surface) : [VIDEO] is a must-watch. Obviously, it does not cover the work accomplished these past two years, but it gives a good idea of the challenges of audio latency on Android — on_and_off, 2015-12
You can watch this I/O session from a few years back: [VIDEO] It probably provides the best insight to the problem Google engineers were and probably is still facing in regards to high performance audio on Android. Even when the latency is brought down, there's still other audio related issues/glitches (like buffer underruns). Even now that Android is measurably better than it was previously, thi… — Polyphonie, 2015-12
This is a great description of the lowest level problem. But for those wondering why iOS doesn't have the problem or why only 10ms is such a difference, the answer is that this is only the beginning of the problem of Android audio latency. There are still additional problems that add latency that span the entire Android stack from the actual hardware and drivers, to the kernel and scheduler, to t… — dottrap, 2015-04
They gave a good talk at I/O on just audio latency: [VIDEO] The touch latency alone is generally in the >80ms ballpark as well though, and varies a lot between devices. — fidotron, 2014-02
Sure. Originally Android only had the Java media APIs, with a quite complex state. [LINK] Android 2.3 introduced OpenSL ES into the NDK and Android 4.0 got OpenMAX. All of them weren't up to the game of realtime audio due to the Android architecture. [LINK] [LINK] [LINK] There are plenty of other articles online when you search for audio issues on Android. There was even a Google IO 2013 talk abo… — pjmlp, 2018-04

Related videos