"Stop Rate Limiting! Capacity Management Done Right" by Jon Moore

Channel:Strange Loop Conference · Length:42:20 · Published:2017-10-01 · Views:41162

Watch on YouTube

Summary

Jon Moore's Strange Loop 2017 talk argues that rate limiting is the wrong tool for protecting services from noisy clients. He proposes concurrency-based capacity management and quotas instead.

Why HN recommends it

HN engineers recommend it for its core insight that limiting concurrency naturally yields request-rate limits, and for its link to queueing theory.

The basic premise is not do do req/s limiting but rather concurrency limiting which results in req/s limiting by itself. — HN, 2017

Software architecture & design · Distributed systems · Cloud, DevOps & reliability

Subtitles (excerpt)

all right hi everybody we've got 40 minutes I've got too much content I've drunk too much caffeine so there's gonna be like a punk rock concert are you ready for 40 blistering minutes of queueing theory I said are you ready for 40 blistering minutes of queueing theory all right so am I so let's say that you're going to adopt a services oriented architecture some of them might even be micro but it all starts with one application or service right you pull out some functionality you get it ready for production you get it set up ready to take some traffic and sure enough you know you start to gather some traffic to your service and then you start building more services and they start attracting more traffic themselves and before you know it you have hundreds of services and thousands of clients and you have to make sense of this somehow and this is usually where you bring in something called an API management gateway now there are really two things in API management gateway tends to do one of them is authentication and authorization right we want to make sure that the people calling the services are actually allowed to do that that's not what I'm going to be talking about today because the other thing that they do is

On Hacker News

You will like the Strange Loop 2017 talk about this subject: "Stop Rate Limiting! Capacity Management Done Right" by Jon Moore [VIDEO] Concurrent capacity might not be the best metric. — Lanzaa, 2024-11
Relevant to queueing theory: "Stop Rate Limiting! Capacity Management Done Right" by Jon Moore [VIDEO] — oftenwrong, 2019-06
* To Serve The People: Public Interest Technologists. Matt Mitchell is a hacker, security researcher, operational security trainer, and data journalist who founded & leads CryptoHarlem, impromptu workshops teaching basic cryptography tools to the predominately African American community in upper Manhattan. [LINK] * Stop Rate Limiting! Capacity Management Done Right. Jon Moore is the Chief Softwar… — cpeterso, 2018-01
For a different view on the topic watch "Stop Rate Limiting! Capacity Management Done Right" [VIDEO] The basic premise is not do do req/s limiting but rather concurrency limiting which results in req/s limiting by itself. Concurrency limiting is rather simple and doesn't require a lot of code complexity. — luckystarr, 2017-12

Related videos