Speech_Recognition_using_Microsoft_SAPI

Up:Tutorial?

Speech recognition using Microsoft SAPI

Speech recognition using Microsoft SAPI †

This section explains how to perform speech recognition in client using Microsoft SAPI and send result to an Agent in SIGVerse.

※ This sample is tested with Visual studio 2010 and window 7

↑

Install Microsoft speech SDK †

Download and install Microsoft speech SDK from here

↑

Create Grammar: †

...
GrammarBuilder CMD = new GrammarBuilder();
CMD.Append(new Choices("Please take a cup of",
                       "I need some",
                       "take a cup of"));

//Providence T. F. Green Internatinoal Airport
GrammarBuilder OBJ = new GrammarBuilder();
Choices OBJchoices = new Choices("coffee",
                                 "tea",
                                 "milk",
                                 "hot water");
OBJ.Append(OBJchoices);
OBJ.Append(new SemanticResultValue("Object"));

CMD.Append(OBJ);

//Boston Logan Internatinoal Airport
GrammarBuilder CTRL = new GrammarBuilder();
Choices CTRLchoices = new Choices("go back",
                                  "go ahead",
                                  "turn left",
                                  "turn right",
                                  "stop");
CTRL.Append(CTRLchoices);
CTRL.Append(new SemanticResultValue("CTRL"));

// Final choices
Choices finalChoices = new Choices("Hi",
                                   "Hello",
                                   "What is your name",
                                   "How are you",
                                   "How are you today",
                                   "How'r you",
                                   "Are you ready");
finalChoices.Add(CMD);
finalChoices.Add(CTRL);

//Final Grammar
GrammarBuilder dialogGrammar = new GrammarBuilder();
dialogGrammar.Culture = culture;
dialogGrammar.Append(new SemanticResultKey("Dialog",finalChoices));

// Load grammar
_speechRecognitionEngine.LoadGrammar(dialogGrammar);
...

↑

Set input source for Recognizer: †

↑

Start recognize: †

↑

Send result text to an Agent in SIGverse †

↑

Import sigverse.dll †

Follow this tutorial import DLL

↑

Send result text to SIGverse †

sbyte[] String2Sbytes(string text)
        {
            sbyte[] osb = new sbyte[text.Length];
            byte[] b = Encoding.ASCII.GetBytes(text);
            for (int i = 0; i < b.Length; i++)
            {
                osb[i] = (sbyte)b[i];
            }
            return osb;
        }

void SendMessage2Agent(string hostname, string port, string agentname, string message)
        {
            MessageSender messageSender;
            sbyte[] rs = String2Sbytes(message + "\0");
            unsafe
            {
                sbyte[] _msgname = String2Sbytes("Microsoft Speech API");
                fixed (sbyte* _mn = _msgname)
                {
                    messageSender = new MessageSender(_mn);
                    fixed (sbyte* _hn = String2Sbytes(hostname))
                    {
                        if (messageSender.connect(_hn, Convert.ToInt32(port)))
                        {
                            LogLine("Connected to [" + hostname + ":" + port + "]");
                            sbyte* a = stackalloc sbyte[rs.Length];
                            for (int i = 0; i < rs.Length; i++)
                            {
                                a[i] = rs[i];
                            }
                            sbyte** _rs = &a;
                            sbyte[] agent = String2Sbytes(agentname);
                            fixed (sbyte* _agent = agent)
                            {
                                if (messageSender.sendto(_agent, 1, _rs))
                                {
                                    LogLine("message [" + message + "] has been sent to [" + hostname + ":" + port + "]");
                                }
                                else
                                {
                                    LogLine("error to send message to [" + hostname + ":" + port + "]");
                                }
                            }
                        }
                        else
                        {
                            LogLine("Can not connect to [" + hostname + ":" + port + "]. Please check ssh connection from SIGviewer");
                        }
                    }
                }
            }
        }
        // handle recognized event
        void SpeechEngine_SpeechRecognized(object sender, SpeechRecognizedEventArgs e)
        {
            ...

// Send message to SIGverse's Agent here
            SendMessage2Agent(_hostNameSIGverse.Text, _portSIGverse.Text, _agentSIGverse.Text, e.Result.Text.ToLower());

...
        }

Up:Tutorial?　　　　Previous：Samples/Communication between agents?　　　　　Next：

Counter: 4226, today: 1, yesterday: 1

Speech_Recognition_using_Microsoft_SAPI

recent(20)