June 2021 FreeBSD Developer Summit: Raid-Z Expansion
Channel:FreeBSD · Length:35:30 · Published:2021-06-28 · Views:3905
Summary
Matt Ahrens presents the FreeBSD Foundation sponsored RAID-Z Expansion project for ZFS at the June 2021 FreeBSD Developer Summit. It explains how a RAID-Z vdev can be grown by adding disks on the fly.
Why HN recommends it
HN points to it as the video explanation of how RAID-Z expansion works without block pointer rewrite.
For those that like videos more than text, there is a youtube video from last year [1] that explain the feature — HN, 2022
Databases & storage · Operating systems & kernels · Linux & open-source ecosystems
Subtitles (excerpt)
hi all welcome back for our next session of our third day of the previous developer summit um one thing i'd encourage you during breaks and so forth if you're not stretching your legs or doing something like that you can feel free to go hang out in the hallway track we were talking a little bit um just various thoughts and chit chat so it's a great place to just go do a little bit of the social part of being at our conference uh but our next talk is going to be from matt erins talking about raise the expansion so i'm going to turn it over to matt awesome thanks um let me get my screen sharing let's do that screen sharing is coming all right hopefully you're seeing my slides now cool so uh i'm at erins i'm here to talk to you about uh zfs raid z expansion um i work for delfix and this work is sponsored by the freebies foundation i've actually seen your whole desktop oh all right then let me um make sure that we're getting the right thing here there we go better okay awesome so have you ever used zfs and been staring down a problem like this you're using uh raid z2 or some sort of raid z and uh you're at basically full capacity 95 percent you have no free space and uh you're sitting with a drive that you'd like to add to it you have additional storage
On Hacker News
That is not how this will work. The reason the parity ratio stays the same, is that all of the references to the data are by DVA (Data Virtual Address, effectively the LBA within the RAID-Z vdev). So the data will occupy the same amount of space and parity as it did before. All stripes in RAID-Z are dynamic, so if your stripe is 5 wide and your array is 6 wide, the 2nd stripe will start on the la… — allanjude, 2023-08
For those that like videos more than text, there is a youtube video from last year [1] that explain the feature (unless it's changed since ,but it seems not to be the case). One downside that I see of this approach, if I understand it correctly, is that the data already present on disk will not take advantage of the extra disk per slice. For example, if I have a raidz of 4 disks (so 25% of space … — mrighele, 2022-02
> AFAIK ZFS pools can't easily be resized > you generally have to recreate them Not anymore. There is RAIDZ Expansion available. Happens on the fly. - [VIDEO] - [LINK] — vermaden, 2021-11
Related videos
- The Tragedy of systemd · linux.conf.au · 47:18
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- The Value of Values with Rich Hickey · InfoQ · 31:43
- The Thirty Million Line Problem · Molly Rocket · 1:48:55
- VCF East: Ken Thompson interviewed by Brian Kernighan · Vintage Computer Federation · 1:03:51
- AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401) · Amazon Web Services · 59:56
- The Real Story Behind Wayland and X - Daniel Stone (linux.conf.au 2013) · Mladen Mijatov · 45:35
- LISA11 - Fork Yeah! The Rise and Development of illumos · USENIX · 1:04:03
- Tech Talk: Linus Torvalds on git · Google · 1:10:15
- "Turning the database inside out with Apache Samza" by Martin Kleppmann · Strange Loop Conference · 47:42
- USENIX ATC '21/OSDI '21 Joint Keynote Address-It's Time for Operating Systems to Rediscover Hardware · USENIX · 1:06:19
- AT&T Archives: The UNIX Operating System · AT&T Tech Channel · 27:27
- Conflict Resolution for Eventual Consistency • Martin Kleppmann • GOTO 2016 · GOTO Conferences · 51:35
- DebConf 14: QA with Linus Torvalds · Adnan Hodzic · 1:11:43
- 01 - Course Introduction & Relational Model (CMU Databases Systems / Fall 2019) · CMU Database Group · 1:06:44
- Unix and Google · FOAM · 7:15