[REL] Voice Recognition for SH5

[skwasjer]

Speech Recognition for SH5 – v1.4 - by skwas

Developed in 2010 by skwas, a game enthusiast and ubergeek )
http://sh4.skwas.net
_______________________________________________

DESCRIPTION

This mod enables speech recognition to SH5 allowing you to use a microphone to dictate your crew what to do… Happy sailing!

English vocabulary only! Suggestions, bugs, please post. Also note, English is not my native language so any corrections on spoken phrases/orders are welcome.


CREDITS

• KarlKoch (working on German translation, coming soon)
• minsc_tdp, for SH4Speech.
• And the folks at forum.kickinbak.com and www.subsim.com.

VERSION HISTORY




v1.4 – 29-03-2010

• Renamed Page Voice Recognition.ini to Speech Recognition.ini
• Renamed Page Voice Recognition.py to Speech Recognition.py
• Moved XML-files to game data folder Data\Sound\Speech
• Added XSLT-stylesheet so you can view all supported commands by opening SHSpeech_Commands.xml in a browser.
• Lowered default confidence level to 0.87
• Added Microphone-icon to test application
• Added support for floating point values (max. one decimal), f.ex. 3.6 meters
• Fixed: when ordering ‘set pistol to magnetic’ you’d get a confirmation, but the pistol setting did not actually change.
• Added numerous commands. See ‘Supported Voice Commands’-shortcut for a complete overview.
• Included source code

v1.1 – 1.3

• Updated test application only.

v1.0

• Initial release

SYSTEM REQUIREMENTS

• Windows Vista
• Windows 7
• English language pack must be installed!!!

See Windows Update to install a language pack. Alternatively, check these links:

http://windows7center.com/news/windo...indows-update/
http://keznews.com/6149_Download_Win...Download_Links
http://support.microsoft.com/kb/934377

And if you can't install a language, check out this important post by Ernesto78 (it worked for several guys!):

http://www.subsim.com/radioroom/show...1&postcount=47

IMPORTANT: Any older platform may likely NOT work and cause CTD’s.


INSTALLATION INSTRUCTIONS

Install as any other mod using JSGME, and simply run the game.

NOTE: Likely NOT compatible with UI mods...!


SUPPORTED COMMANDS

Open the file Data\Sound\Speech\SHSpeech_Commands.xml in a browser, or view online:

http://sh4.skwas.net/redist/shspeech_commands.xml


HOW DOES IT WORK?

My mod is using a custom written DLL and some Python script-files. The entire speech recognition configuration can be controlled using two XML files, which contain the grammar for the accepted spoken words, and a commands file which controls the translation to a game command. Optionally you can capture any command and alter it’s behavior form the .py files I included.

See the readme for more details.


PERMISSIONS

Do not redistribute or reuse this mod without my permission.


SOURCE CODE

Source code is included in the Documentation\Source code folder. You will need Visual Studio 2008 (C#).


DOWNLOAD

http://sh4.skwas.net/download.aspx?i...d-47cce8e36be8

Miton's improved editions:
English: http://www.subsim.com/radioroom/down...o=file&id=3085

German: http://www.subsim.com/radioroom/down...o=file&id=3057


Have fun, and let me know!


Assistence needed to further improve the commands, and in the future for localization (once the mod has proven to be stable and functional enough)!

[rsvette12]

Looks great, so this would not work on xp ? thank you.

Rich

[Will-Rommel]

The Olympian strikes back.

Sad that i still run on XP.

[skwasjer]

I have no idea, but I don't think so, not out of the box anyway. You will need SAPI 5.1 or 5.3 and .NET Framework 3.5 installed. Vista and Windows 7 have this out of the box. On top of that the SRGS specification (used for grammar dictionary) may not be supported on XP. Only one way to find out

[krupp_88mm]

damn you ubisoft i want to say "bow planes down 15, aft planes up 10" why why WHY capt simulation!???

[gutted]

boooo to no XP support.

[gutted]

I checked, my XP version has .NET 3.5 and the speech SDK 5.1 ( i use speech rec for Falcon).

what else do i need?

and how to make this work? you give hardly any instructions.

I installed it as a mod, went in game and said a few things and nothing happened.

[gutted]

Oh and when i run the SHSpeechEngineTest.exe it just crashes. Guess XP is out of the question then?

XP > W7 for gaming on my machine.

[Westbroek]

@gutted
Dunno if you were a fan of sh3/4speech, but I loved using it and always was fascinated with how easily customized it was. Maybe we XP users should band together and tweak the old .csv files to accomodate SH5. I'm sure the hotkeys could be done... The mouse controls would be trickier, I never fiddled with those.
it's a thought anyway. Anyone interested?

[panosrxo]

It actually works... Well some of the commands. Do we need to train our voice recognition first (through windows 7 control panel)?
I have windows 7.

[Coldcall]

WOW! I've not tried it yet but this is exciting! Downloading now.

I really prefer the idea of voice commands as its more realistic than having an all in one push button UI. Just my opinion of course.

Thanks for this mod, will give you feedback once i've tried it out.

[BBWilly]

works perfect, even with german commands

[skwasjer]

Originally Posted by Gutted

Oh and when i run the SHSpeechEngineTest.exe it just crashes. Guess XP is out of the question then?

XP > W7 for gaming on my machine.

Originally Posted by Westbroek

@gutted
Dunno if you were a fan of sh3/4speech, but I loved using it and always was fascinated with how easily customized it was. Maybe we XP users should band together and tweak the old .csv files to accomodate SH5. I'm sure the hotkeys could be done... The mouse controls would be trickier, I never fiddled with those.
it's a thought anyway. Anyone interested?

My approach is alot better than those releases, due to the fact that I don't emulate mouse or keyboard. This approach actually let's you call game commands, and thus is UI independent (hint: UI mods may change position of dials/buttons etc). Emulators are dodgy and unreliable.

Guys, sigh, this is just the first release I quickly whipped up. Give me some days/weeks to finetune it and provide more info. I may make it compatible for XP too, but I don't have it so how could I know? That's what you guys are for... Just try it out instead of complaining about XP > W7, lol... seriously. Perhaps you can make it work, then great!



A few basic commands you can try:
- Ahead flank
- All stop

And if the test app crashes, then well, yea it won't work in game either...

[panosrxo]

Most of them work fine. I only have a problem with all stop. Also compute soluion to target doesnt work, but the command works well. It is a game thing.

hint: In order to see the phrases open the commands.xml

[skwasjer]

There's some issues with some commands yea (ie. torpedo speed setting doesn't work, and some others)... I'll improve it in the next few days.

All stop works for me though, I'll see if I can tweak the confidence level (how confident the engine is of a match) of the speech engine a bit, perhaps make it customizable.

Training should not be necessary, because the engine is in the so-called 'Command' mode. This is a bit less reliable as Dictation mode, but doesn't require training as it looks for sound patterns in a different way.