The Eleventh HOPE (2016): Coding by Voice with Open Source Speech Recognition

Channel:Channel2600 · Length:46:19 · Published:2016-12-23 · Views:13235

Watch on YouTube

Summary

A HOPE XI talk on programming by voice with open source speech recognition. The speaker writes Linux systems code by voice and describes building custom voice grammars as an alternative to the keyboard for programmers with repetitive strain injuries.

Why HN recommends it

HN cites it as proof that voice coding works and lists it among resources for programmers who can't type.

Coding by Voice with Open Source Speech Recognition, from HOPE XI (2016) — HN, 2019

Software practice, open source & careers · Computer vision, speech & NLP · UX & UI design

Subtitles (excerpt)

Thanks everyone. Um This is a picture of my desk as it looks well as of yesterday or so. Uh so you can see a bunch of crazy stuff there. I've got some microphones. I've got a um a like an ergonomic goldtouch keyboard and a trackball and so on. And this is not really what a normal programmer's setup looks like I suppose. But I was forced into it unfortunately. Um I I had an illness uh starting around a little more a little under 2 years ago. Um some kind of virus. My body overreacted. Doctors not really sure what happened but the end result is um I couldn't type for a long time. I couldn't as it says I couldn't lift a pencil. I couldn't you I couldn't open a a door with keys. I mean it was uh very little uh hand strength. And then later on uh it started spreading to my legs and I couldn't um couldn't walk for long periods. Sometimes I couldn't even stand. And uh couldn't sit for sure unless the chair was very well padded. So that was uh somewhat of a disaster for me. As you saw from the first slide I'm a PhD student at uh Columbia University. I PhD in computer science. Um uh job description involves you know typing 10 or 12 hours a day normally. So fortunately my advisor didn't kick me out right away.

On Hacker News

I have been lucky to not be impacted by hand or wrist pain. I did experience chronic back pain for years due to a pinched sciatic nerve, it can be debilitating and depressing. Chronic pain is a large precursor to suicide, if you have it, you need to get it fixed. My interest in this is from a FutureOfProgramming perspective, how can we interact with computers in different, higher order ways. What… — sitkack, 2019-08
It's nice and all, but this is a nightmare for accessibility. Not everyone can read paper or even move around. With this design, coding around those limitations is not easy. In the current model, everything could be done 100% accessibly. Why it isn't is a completely different problem. When everything is inherently physical, though, accessibility is not just about the code, it involves much more p… — miki123211, 2018-10
While you were yucking it up, someone already did it. I'd say it takes about a minute: [VIDEO] Of course, there's plenty of room for improvement. Why not have the assistant understand keywords and perform high-level tasks? "import" "create function named main" "return" "Add two int arguments" — melling, 2018-01

Related videos