VisiData Lightning Demo at PyCascades 2018
Channel:Saul Pwanson · Length:4:50 · Published:2018-01-25 · Views:41011
Summary
A five-minute lightning demo of VisiData, a terminal tool for exploring and manipulating data. It uses two months of NYC 311 complaint data to drill down, plot points on a virtual map and save selected rows.
Why HN recommends it
HN recommends it as the fastest way to understand what VisiData can do, since seeing it work is clearer than reading about it.
visdata is pretty mind-blowing...at least, that's how i felt when i saw the demo the first time — HN, 2021
Python, Ruby & scripting languages · Testing, debugging & developer tools · Data science & statistics
Subtitles (excerpt)
you're good to go hello so has anyone ever had to use any kind of tabular data by a show of hands okay a couple people is anyone prefer to use the terminal okay and has anyone ever used grep cut aux sort unique with a CSV file okay right exactly well I did that way too much and I got kind of fed up with it so Ivan made a tool called visit data which had been working on for the past year my sabbatical it's written in Python 3 it's open source it's in pi PI now working on and getting in through an apt it supports a whole lot of formats excel files and CSV files and JSON it's extensible via Python 3 and this it's kind of like a Swiss Army chainsaw for data and this is a lightning demo so I have a data set of all or of two months of three one one service complaints from New York and so it's loading it now you can see it's loading it asynchronously down there in the corner you can do all kinds of fun stuff for instance you can hide columns with a minus key and if you wanted to for instance we have a created date let me split this based on this got a date and time I just wanted a date so I just split that and I've got another column here for just the date I wanted to do a frequency analysis on that date for instance I just press
On Hacker News
Highly recommend this as well, it has been a godsend for me for digging into multi-GB Cloudfront log files and extracting stats and patterns. There is a good (albeit a bit old now, as the interface has been overhauled since) quick demo video from VD's creator : [VIDEO] — nowahe, 2022-12
visdata is pretty mind-blowing...at least, that's how i felt when i saw the demo the first time: [VIDEO] — mxuribe, 2021-08
If you aren't familiar with Visidata, this video gives a pretty good idea of what it can do: [VIDEO] It seems like making a living on shell tools can be difficult to impossible. The author Saul is using Patreon to help fund his work on this tool. I love this tool, and hope others can help support him too. Maybe this "duo-repo" approach will allow him to do this full time. — leonim, 2021-07
Not sure about saving but, more importantly for me, it can read sqlite DBs, which has been a godsend whenever I need to take a quick glance at some random DB just to see what kind of tables it holds and what does the data look like. I know my SELECTs but I can't, for the life of me, remember what are the commands to check schemas and DB metadata on sqlite ("Was it .describe? Maybe .schema? Or per… — asamarin, 2020-12
The "video demo" is pretty buried in the site, here it is for your enjoyment. Like most viz, seeing it in action makes it much clearer than reading about it. [VIDEO] — mwexler, 2020-10
Related videos
- Fear the Boom and Bust: Keynes vs. Hayek - The Original Economics Rap Battle! · Radical Discourse · 6:18
- Fight of the Century: Keynes vs. Hayek - Economics Rap Battle Round Two · Radical Discourse · 8:42
- Ruby Conf 12 - Y Not- Adventures in Functional Programming by Jim Weirich · Confreaks · 53:21
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- How Python was Shaped by leaky Internals, Armin Ronacher, Flask framework · Видео с мероприятий {speach! · 49:55
- RailsConf 2014 - All the Little Things by Sandi Metz · Confreaks · 38:47
- What the heck is the event loop anyway? | Philip Roberts | JSConf EU · JSConf · 26:52
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson · Strange Loop Conference · 40:20
- 🚀 TDD, Where Did It All Go Wrong (Ian Cooper) · DevTernity Conference · 1:03:55
- Bret Victor - Inventing on Principle · Rui Oliveira · 54:20
- How To Design A Good API and Why it Matters · Google TechTalks · 1:00:19
- The Problem with Time & Timezones - Computerphile · Computerphile · 10:12
- Solving Problems the Clojure Way - Rafal Dittwald · Clojure/north · 1:02:26
- Debugging Under Fire: Keep your Head when Systems have Lost their Mind • Bryan Cantrill • GOTO 2017 · GOTO Conferences · 52:34
- "Performance Matters" by Emery Berger · Strange Loop Conference · 42:15