VisiData Lightning Demo at PyCascades 2018

Channel:Saul Pwanson · Length:4:50 · Published:2018-01-25 · Views:41011

Watch on YouTube

Summary

A five-minute lightning demo of VisiData, a terminal tool for exploring and manipulating data. It uses two months of NYC 311 complaint data to drill down, plot points on a virtual map and save selected rows.

Why HN recommends it

HN recommends it as the fastest way to understand what VisiData can do, since seeing it work is clearer than reading about it.

visdata is pretty mind-blowing...at least, that's how i felt when i saw the demo the first time — HN, 2021

Python, Ruby & scripting languages · Testing, debugging & developer tools · Data science & statistics

Subtitles (excerpt)

you're good to go hello so has anyone ever had to use any kind of tabular data by a show of hands okay a couple people is anyone prefer to use the terminal okay and has anyone ever used grep cut aux sort unique with a CSV file okay right exactly well I did that way too much and I got kind of fed up with it so Ivan made a tool called visit data which had been working on for the past year my sabbatical it's written in Python 3 it's open source it's in pi PI now working on and getting in through an apt it supports a whole lot of formats excel files and CSV files and JSON it's extensible via Python 3 and this it's kind of like a Swiss Army chainsaw for data and this is a lightning demo so I have a data set of all or of two months of three one one service complaints from New York and so it's loading it now you can see it's loading it asynchronously down there in the corner you can do all kinds of fun stuff for instance you can hide columns with a minus key and if you wanted to for instance we have a created date let me split this based on this got a date and time I just wanted a date so I just split that and I've got another column here for just the date I wanted to do a frequency analysis on that date for instance I just press

On Hacker News

Highly recommend this as well, it has been a godsend for me for digging into multi-GB Cloudfront log files and extracting stats and patterns. There is a good (albeit a bit old now, as the interface has been overhauled since) quick demo video from VD's creator : [VIDEO] — nowahe, 2022-12
visdata is pretty mind-blowing...at least, that's how i felt when i saw the demo the first time: [VIDEO] — mxuribe, 2021-08
If you aren't familiar with Visidata, this video gives a pretty good idea of what it can do: [VIDEO] It seems like making a living on shell tools can be difficult to impossible. The author Saul is using Patreon to help fund his work on this tool. I love this tool, and hope others can help support him too. Maybe this "duo-repo" approach will allow him to do this full time. — leonim, 2021-07
Not sure about saving but, more importantly for me, it can read sqlite DBs, which has been a godsend whenever I need to take a quick glance at some random DB just to see what kind of tables it holds and what does the data look like. I know my SELECTs but I can't, for the life of me, remember what are the commands to check schemas and DB metadata on sqlite ("Was it .describe? Maybe .schema? Or per… — asamarin, 2020-12
The "video demo" is pretty buried in the site, here it is for your enjoyment. Like most viz, seeing it in action makes it much clearer than reading about it. [VIDEO] — mwexler, 2020-10

Related videos