Thesis: Partial State in Dataflow-Based Materialized Views

Channel:Jon Gjengset · Length:45:50 · Published:2020-10-23 · Views:17024

Watch on YouTube

Summary

Jon Gjengset's 2020 PhD dissertation presentation at MIT on partial state in dataflow-based materialized views, the idea behind the Noria database. The Q&A is cut out.

Why HN recommends it

HN points to it, including Gjengset himself, as a more digestible way into partially-stateful dataflow than the thesis text, mostly in caching and database threads.

a shorter talk from a few years earlier at — HN, 2022

Databases & storage · University lectures & courses

Subtitles (excerpt)

Hey everyone! Hello. Welcome to Jon Gjengset's thesis defense. And thank you for attending. I want to say just a couple of words before handing over to Jon. In his research life, Jon's been pursuing a really neat vision for how busy web sites ought to manage their data. It's been exciting to watch him develop this vision and impressive to see his skill in realizing it. But in parallel with research, Jon's been a hugely energetic contributor to all the communities he touches. From his infinite patience as a TA, to organizing graduate student events, to live-streaming systems programming tutorials. Jon's sure to be valuable and valued whatever he sets his hand to. And assuming his committee lets him go, many people at MIT are going to miss him. I certainly will. So with that, I'll hand over to Jon. Thank you Robert, I appreciate that! So, thank you everyone for coming, and welcome to my doctoral dissertation presentation where I'll be presenting my thesis on Partial State in Dataflow-Dased Materialized Views. Now, my goal with this presentation is to try to summarize the past six years of work or so in about 45 minutes. And hopefully I will succeed. And at least, hopefully, by the end, you will understand what

On Hacker News

:wave: Author of the paper this work is based on here. I'm so excited to see dynamic, partially-stateful data-flow for incremental materialized view maintenance becoming more wide-spread! I continue to think it's a _great_ idea, and the speed-ups (and complexity reduction) it can yield are pretty immense, so seeing more folks building on the idea makes me very happy. The PlanetScale blog post ref… — Jonhoo, 2022-11
Pretty sure that this is the database that Jon Gjengset[0] was working on as part of his thesis project. There have been several videos shared by him during talks about the system. It's a really interesting concept. edit: Here's[1] a video where he talks about the concept [0]: [LINK] [1]: [VIDEO] — dpcx, 2024-02
this is also one of the main ideas behind Noria[1] (built by @jonhoo, who also gave his PhD dissertation[2] on this recently) [1] [LINK] [2] [VIDEO] — kondu, 2020-10

Related videos