The Eleventh HOPE (2016): Coding by Voice with Open Source Speech Recognition
Channel:Channel2600 · Length:46:19 · Published:2016-12-23 · Views:13235
Summary
A HOPE XI talk on programming by voice with open source speech recognition. The speaker writes Linux systems code by voice and describes building custom voice grammars as an alternative to the keyboard for programmers with repetitive strain injuries.
Why HN recommends it
HN cites it as proof that voice coding works and lists it among resources for programmers who can't type.
Coding by Voice with Open Source Speech Recognition, from HOPE XI (2016) — HN, 2019
Software practice, open source & careers · Computer vision, speech & NLP · UX & UI design
Subtitles (excerpt)
Thanks everyone. Um This is a picture of my desk as it looks well as of yesterday or so. Uh so you can see a bunch of crazy stuff there. I've got some microphones. I've got a um a like an ergonomic goldtouch keyboard and a trackball and so on. And this is not really what a normal programmer's setup looks like I suppose. But I was forced into it unfortunately. Um I I had an illness uh starting around a little more a little under 2 years ago. Um some kind of virus. My body overreacted. Doctors not really sure what happened but the end result is um I couldn't type for a long time. I couldn't as it says I couldn't lift a pencil. I couldn't you I couldn't open a a door with keys. I mean it was uh very little uh hand strength. And then later on uh it started spreading to my legs and I couldn't um couldn't walk for long periods. Sometimes I couldn't even stand. And uh couldn't sit for sure unless the chair was very well padded. So that was uh somewhat of a disaster for me. As you saw from the first slide I'm a PhD student at uh Columbia University. I PhD in computer science. Um uh job description involves you know typing 10 or 12 hours a day normally. So fortunately my advisor didn't kick me out right away.
On Hacker News
I have been lucky to not be impacted by hand or wrist pain. I did experience chronic back pain for years due to a pinched sciatic nerve, it can be debilitating and depressing. Chronic pain is a large precursor to suicide, if you have it, you need to get it fixed. My interest in this is from a FutureOfProgramming perspective, how can we interact with computers in different, higher order ways. What… — sitkack, 2019-08
It's nice and all, but this is a nightmare for accessibility. Not everyone can read paper or even move around. With this design, coding around those limitations is not easy. In the current model, everything could be done 100% accessibly. Why it isn't is a completely different problem. When everything is inherently physical, though, accessibility is not just about the code, it involves much more p… — miki123211, 2018-10
While you were yucking it up, someone already did it. I'd say it takes about a minute: [VIDEO] Of course, there's plenty of room for improvement. Why not have the assistant understand keywords and perform high-level tasks? "import" "create function named main" "return" "Add two int arguments" — melling, 2018-01
Related videos
- 🚀 TDD, Where Did It All Go Wrong (Ian Cooper) · DevTernity Conference · 1:03:55
- Bret Victor - Inventing on Principle · Rui Oliveira · 54:20
- Bret Victor The Future of Programming · Joey Reid · 32:55
- "Uncle" Bob Martin - "The Future of Programming" · Paul Stringer's Mobile Tech · 1:18:21
- Tim Ewald - Clojure: Programming with Hand Tools · ClojureTV · 58:39
- Using Python to Code by Voice · Next Day Video · 28:17
- Transforming Code into Beautiful, Idiomatic Python · Next Day Video · 48:51
- Mike Monteiro: F*ck You, Pay Me · CreativeMornings HQ · 37:53
- Agile is Dead • Pragmatic Dave Thomas • GOTO 2015 · GOTO Conferences · 40:39
- Music Software & Bad Interface Design: Avid’s Sibelius · Tantacrul · 21:35
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10
- Plover: Thought to Text at 240 WPM · Next Day Video · 34:21
- "The Economics of Programming Languages" by Evan Czaplicki (Strange Loop 2023) · Strange Loop Conference · 43:57
- "The Mess We're In" by Joe Armstrong · Strange Loop Conference · 45:50
- Principles of Technology Leadership | Bryan Cantrill | Monktoberfest 2017 · RedMonk Tech Events · 51:22
- A Talk Near the Future of Python (a.k.a., Dave live-codes a WebAssembly Interpreter) · David Beazley · 1:01:45