Speech recognition demo

Here's a brief demo of a program I'm working on. It uses the built in speech recognition in windows (which is actually quite good in Vista) to control the chat functions of WoW. I don't know about anyone else, but I find having to pause key broadcasting to be very annoying every time I want to send a chat message, so I thought I would try to come up with a solution to that.

It's not quite ready for release yet as there as a few issues I need to resolve before I feel it's ready for a beta version (like it's not yet compatible with keyclone for some reason, which defeats the original purpose :( ). I thought I would share the demo anyway to gauge interest.

Vimeo (higher quality): http://www.vimeo.com/889982
Youtube: http://www.youtube.com/watch?v=Y3briuHKduI
WarcraftMovies: http://www.warcraftmovies.com/movieview.php?id=71007


Here's a list of all the channels it can talk in:

• say
• whisper / reply
• guild
• officer
• raid
• party
• battleground
• yell

You can also use it to set an AFK message.

In the future, I would like to include the ability to correct mistakes made by the recognition engine. Currently all you can do is clear the whole message and start over, which is tedious when it consistently fails to get a word correct (for instance mine never seems to get 'dictionary' correct). I've also thought about adding the ability to script more commands to control various other abilities such as rarely used spells. I'm aware of another program that can use voice to issue specific commands, but I don't think it is capable of the chat functionality.

I've only got Vista to test this on, so I'm not sure if it will end up working on XP. If it does, it probably won't work as well since it is my understanding Vista's speech recognition is much better than XP's. I've also read about issues with speech recognition on 64 bit versions of windows, so I'm not sure if it will work properly on those either.

This is a third party program that is not directly integrated into Warcraft. All it does is send the appropriate slash command and the text you dictate as key presses. There is no automation going on at all. The overlay you see where the dictated text first appears is the program itself, not any addon for Warcraft. I do plan to make releases open source.

that's pretty cool. I'd be glad to test it for you on windows XP.

Well after working on it all morning I finally got it to work properly with keyclone. :) Had to make sure to run as administrator and had to change the way I sent the text to warcraft, but it works like I want now. I think I'll play with it some more today and maybe package up a beta version tonight if I think it's ready.

From watching the video, it look slike once you have your kinks sorted out and have given Vista enough time to bed in to your speech then I think it will be a very good system.

Heh I don't normally talk like that. It feels kind of weird to talk to a computer in a normal voice, so I guess I compensate. :D Plus I was trying to make sure it got all the words correct.

Nice work, looks like your last say ended up in officer chat ;)
My suggestion (as I have tried out various voice recognition stuff in the past) for clearing individual mistakes would be to add a 'clear last' command that would hit ctrl+backspace. I think that should work ingame since it does here.

Yeah I was having some trouble with it being unable to keep up with too many keys being sent too quickly. Some would just end up getting lost in the void. I think I've got it throttled properly now. I'd like to make it be able to correct a single word anywhere in the text, just like you can with the normal speech recognition. It appears that is fairly involved, so it may have to wait a while. Your suggestion should be easy to implement in the mean time. :)

But all this will wait a bit, I just hit 50 so I have to go try out my new 4x Totem of Wrath :D