This is the front end to our smart house project (or smart office as is the case here). It uses Microsoft speech recognition and Guile 3D agent software (featuring Nicole). The speech synthesis is AT & T voices.
The program is written in a .Net language and an earlier version can be downloaded for free (minus the Agent Nicole of course).
http://www.massey.ac.nz/~tjmoir/speech.html

Of course speech recognition in a relatively noise-free environment is no longer such a challenge and the real work is applying adaptive signal processing to this to improve the hit rate in a noisy environment. This is the main thrust of our research. The recognition part is our interface with the house or office. The present system of course has great potential for disabled people. The devices on this video are powered by the parallel port or via USB to a local Triac switching box we made. I have since added X10 devices which are more convenient and “off the shelf”. The X10 devices can be placed anywhere in a house without extra wiring. I will post another video soon.
On Windows XP only SAPI4 speech sythesis is supported by Micropsoft for Agents. However, SAPI 5 voices can also be used concurrently which is like a voice-over.

School of engineering and Advanced Technology,Massey University Albany Auckland New Zealand.

Duration : 0:4:36


[youtube QYYN3fymgFA]