Focus tracking in dialogs

CROSS-REFERENCE TO RELATED APPLICATIONS

0001The present application relates to U.S. patent application entitled APPLICATION ABSTRACTION WITH DIALOG PURPOSE having Ser. No. 10/087,608, filed Oct. 21, 2001, and published as U.S. 2003/0130854 and U.S. patent application entitled APPLICATION ABSTRACTION WITH DIALOG PURPOSE having Ser. No. 10/426,053, filed Apr. 28, 2003, the contents of which are hereby incorporated be reference in their entirety.

BACKGROUND OF THE INVENTION

0002The present invention relates to access of information over a wide area network such as the Internet. More particularly, the present invention relates to web enabled recognition allowing information and control on a client side device to be entered using a variety of methods.

0003Small computing devices such as personal information managers (PIM), devices and portable phones are used with ever increasing frequency by people in their day-to-day activities. With the increase in processing power now available for microprocessors used to run these devices, the functionality of these devices are increasing, and in some cases, merging. For instance, many portable phones now can be used to access and browse the Internet as well as can be used to store personal information such as addresses, phone numbers and the like.

0004In view that these computing devices are being used for browsing the Internet, or are used in other server/client architectures, it is therefore necessary to enter information into the computing device. Unfortunately, due to the desire to keep these devices as small as possible in order that they are easily carried, conventional keyboards having all the letters of the alphabet as isolated buttons are usually not possible due to the limited surface area available on the housings of the computing devices.

0005To address this problem, there has been increased interest and adoption of using voice or speech to provide and access such information, particularly over a wide area network such as the Internet. Published U.S. patent application, U.S. 2003/0130854, entitled APPLICATION ABSTRACTION WITH DIALOG PURPOSE and U.S. patent application entitled APPLICATION ABSTRACTION WITH DIALOG PURPOSE having Ser. No. 10/426,053 and filed Apr. 28, 2003 describe a method and system defining controls for a web server to generate client side markups that include recognition and/or audible prompting.

0006Each of the controls perform a role in the dialog. For instance, controls can include prompt object used to generate corresponding markup for the client device to present information to the user, or generate markups for the client device to ask a question. An answer control or object generates markup for the client device so that a grammar used for recognition is associated with an input field related to a question that has been asked. If it is unclear whether or not a recognized result is correct, a confirmation mechanism can be activated and generate markup to confirm a recognized result. A command control generates markup that allows the user to provide commands, which are other than the expected answers to a specific question, and thus, allows the user to navigate through the web server application, for example. A module, when executed such as on a client, creates a dialog to solicit and provide information as a function of the controls.

0007The module can use a control mechanism that identifies an order for the dialog, for example, an order for asking questions. The controls include activation logic that may activate other controls based on the answer given by the user. In many cases, the controls specify and allow the user to provide extra answers, which are commonly answers to questions yet to be asked, and thereby, cause the system to skip such questions since such answers have already been provided. This type of dialog is referred to as “mixed-initiative” since the system and the user have some control of dialog flow.

0008However, when users are allowed to provide many pieces of information in one sentence, it becomes difficult to ensure that the system will respond appropriately. For example, suppose a system asks a user for a phone number. In this example, the phone number includes an area code, a local number and an extension. In a mixed-initiative dialog, the user could provide the full number or just a portion of it. The system may need to confirm portions of the number that have been given and would need to ask for the remaining portions of the number. If the user denies or corrects a portion that the system misunderstood, the system would need to ask it again. Ideally, the system would make sure to always confirm or ask a question about the portions of the number that the user just provided. In contrast, if the system were to confirm or ask a question about another portion of the number, the dialog would seem confusing and hard to follow. Given the large number of possible dialog flows, which can be based on the number of permutations due to the number of extra answers that can be provided, a logical dialog flow is difficult to achieve. In some cases, the system may follow a hard-coded path through the dialog and appears from the user's point-of-view, to ignore the information it was given. However, it is usually processed later, which can further add to the confusion.

0009There is thus an ongoing need to improve upon the methods used to provide speech recognition in an application such as server/client architecture such as the Internet. In particular, a method, system or authoring tool that addresses one, several or all of the foregoing disadvantages and thus provides generation of speech-enabled recognition and/or speech-enabled prompting in an application is needed.

SUMMARY OF THE INVENTION

0010Controls are provided for a web server to generate client side markups that include recognition and/or audible prompting. The controls comprise elements of a dialog such as a question, answer, confirmation, command or statement. A module forms a dialog by making use of the information carried in the controls.

0011Each of the controls perform a role in the dialog. For instance, controls can include prompt object used to generate corresponding markup for the client device to present information to the user, or generate markups for the client device to ask a question. An answer control or object generates markup for the client device so that a grammar used for recognition is associated with an input field related to a question that has been asked. If it is unclear whether or not a recognized result is correct, a confirmation mechanism can be activated and generate markup to confirm a recognized result. A module, when executed such as on a client, creates a dialog to solicit and provide information as a function of the controls.

0012An aspect of the present invention is to allow the system to automatically adapt the dialogue flow so that it stays focused on the user's most recent inputs_[RL1]. Generally, whenever recognition results are received, this information is retained in a manner so as to provide an order indicating the relative order it was received. In this manner, the most recently recognition results can be identified. In one embodiment, memory is used in the form of a “stack”. The stack comprises identifiers related to recognition results received. When the dialog is created, it looks for controls related to the recognition results identified at the top of the stack, for example, whether this recognition result needs to be confirmed. Although the controls typically include means such as an attribute to indicate a selected order for execution, this means that controls later in the selected order than others can be “promoted” and run before them, provided that they are related to the top-most of the stack whereas the others are not.

BRIEF DESCRIPTION OF THE DRAWINGS

0013<figref idref="DRAWINGS">FIG. 1</figref> is a plan view of a first embodiment of a computing device operating environment.

0014<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram of the computing device of <figref idref="DRAWINGS">FIG. 1</figref>.

0015<figref idref="DRAWINGS">FIG. 3</figref> is a block diagram of a general purpose computer.

0016<figref idref="DRAWINGS">FIG. 4</figref> is a block diagram of an architecture for a client/server system.

0017<figref idref="DRAWINGS">FIG. 5</figref> is a display for obtaining credit card information.

0018<figref idref="DRAWINGS">FIG. 6</figref> is a block diagram illustrating a first approach for providing recognition and audible prompting in client side markups.

0019<figref idref="DRAWINGS">FIG. 7</figref> is a block diagram illustrating a second approach for providing recognition and audible prompting in client side markups.

0020<figref idref="DRAWINGS">FIG. 8</figref> is a block diagram illustrating a third approach for providing recognition and audible prompting in client side markups.

0021<figref idref="DRAWINGS">FIG. 9</figref> is a block diagram illustrating companion controls.

0022<figref idref="DRAWINGS">FIG. 10</figref> is a detailed block diagram illustrating companion controls of a first embodiment.

0023<figref idref="DRAWINGS">FIG. 11</figref> is a block diagram illustrating companion controls of a second embodiment.

0024<figref idref="DRAWINGS">FIG. 12</figref> is a block diagram illustrating speech controls inheritance for the second embodiment.

0025<figref idref="DRAWINGS">FIG. 13</figref> is a pictorial representation of a stack used for focussing dialogue.

0026<figref idref="DRAWINGS">FIG. 14</figref> is a method for comparing a SemanticItem on the focus stack with answers or confirms related to a QA._[RL2]

0027<figref idref="DRAWINGS">FIG. 15</figref> is a pictorial representation of information to be gathered organized as “topics”.

0028<figref idref="DRAWINGS">FIG. 16</figref> illustrates an exemplary display rendering for a travel page.

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS

0029Before describing architecture of web based recognition and methods for implementing the same, it may be useful to describe generally computing devices that can function in the architecture. Referring now to <figref idref="DRAWINGS">FIG. 1</figref>, an exemplary form of a data management device (PIM, PDA or the like) is illustrated at <b>30</b>. However, it is contemplated that the present invention can also be practiced using other computing devices discussed below, and in particular, those computing devices having limited surface areas for input buttons or the like. For example, phones and/or data management devices will also benefit from the present invention. Such devices will have an enhanced utility compared to existing portable personal information management devices and other portable electronic devices, and the functions and compact size of such devices will more likely encourage the user to carry the device at all times. Accordingly, it is not intended that the scope of the architecture herein described be limited by the disclosure of an exemplary data management or PIM device, phone or computer herein illustrated.

0030An exemplary form of a data management mobile device <b>30</b> is illustrated in <figref idref="DRAWINGS">FIG. 1</figref>. The mobile device <b>30</b> includes a housing <b>32</b> and has an user interface including a display <b>34</b>, which uses a contact sensitive display screen in conjunction with a stylus <b>33</b>. The stylus <b>33</b> is used to press or contact the display <b>34</b> at designated coordinates to select a field, to selectively move a starting position of a cursor, or to otherwise provide command information such as through gestures or handwriting. Alternatively, or in addition, one or more buttons <b>35</b> can be included on the device <b>30</b> for navigation. In addition, other input mechanisms such as rotatable wheels, rollers or the like can also be provided. However, it should be noted that the invention is not intended to be limited by these forms of input mechanisms. For instance, another form of input can include a visual input such as through computer vision.

0031Referring now to <figref idref="DRAWINGS">FIG. 2</figref>, a block diagram illustrates the functional components comprising the mobile device <b>30</b>. A central processing unit (CPU) <b>50</b> implements the software control functions. CPU <b>50</b> is coupled to display <b>34</b> so that text and graphic icons generated in accordance with the controlling software appear on the display <b>34</b>. A speaker <b>43</b> can be coupled to CPU <b>50</b> typically with a digital-to-analog converter <b>59</b> to provide an audible output. Data that is downloaded or entered by the user into the mobile device <b>30</b> is stored in a non-volatile read/write random access memory store <b>54</b> bi-directionally coupled to the CPU <b>50</b>. Random access memory (RAM) <b>54</b> provides volatile storage for instructions that are executed by CPU <b>50</b>, and storage for temporary data, such as register values. Default values for configuration options and other variables are stored in a read only memory (ROM) <b>58</b>. ROM <b>58</b> can also be used to store the operating system software for the device that controls the basic functionality of the mobile <b>30</b> and other operating system kernel functions (e.g., the loading of software components into RAM <b>54</b>).

0032RAM <b>54</b> also serves as a storage for the code in the manner analogous to the function of a hard drive on a PC that is used to store application programs. It should be noted that although non-volatile memory is used for storing the code, it alternatively can be stored in volatile memory that is not used for execution of the code.

0033Wireless signals can be transmitted/received by the mobile device through a wireless transceiver <b>52</b>, which is coupled to CPU <b>50</b>. An optional communication interface <b>60</b> can also be provided for downloading data directly from a computer (e.g., desktop computer), or from a wired network, if desired. Accordingly, interface <b>60</b> can comprise various forms of communication devices, for example, an infrared link, modem, a network card, or the like.

0034Mobile device <b>30</b> includes a microphone <b>29</b>, and analog-to-digital (A/D) converter <b>37</b>, and an optional recognition program (speech, DTMF, handwriting, gesture or computer vision) stored in store <b>54</b>. By way of example, in response to audible information, instructions or commands from a user of device <b>30</b>, microphone <b>29</b> provides speech signals, which are digitized by A/D converter <b>37</b>. The speech recognition program can perform normalization and/or feature extraction functions on the digitized speech signals to obtain intermediate speech recognition results. Using wireless transceiver <b>52</b> or communication interface <b>60</b>, speech data is transmitted to a remote recognition server <b>204</b> discussed below and illustrated in the architecture of <figref idref="DRAWINGS">FIG. 4</figref>. Recognition results are then returned to mobile device <b>30</b> for rendering (e.g. visual and/or audible) thereon, and eventual transmission to a web server <b>202</b> (<figref idref="DRAWINGS">FIG. 5</figref>), wherein the web server <b>202</b> and mobile device <b>30</b> operate in a client/server relationship. Similar processing can be used for other forms of input. For example, handwriting input can be digitized with or without pre-processing on device <b>30</b>. Like the speech data, this form of input can be transmitted to the recognition server <b>204</b> for recognition wherein the recognition results are returned to at least one of the device <b>30</b> and/or web server <b>202</b>. Likewise, DTMF data, gesture data and visual data can be processed similarly. Depending on the form of input, device <b>30</b> (and the other forms of clients discussed below) would include necessary hardware such as a camera for visual input.

0035In addition to the portable or mobile computing devices described above, it should also be understood that the present invention can be used with numerous other computing devices such as a general desktop computer. For instance, the present invention will allow a user with limited physical abilities to input or enter text into a computer or other computing device when other conventional input devices, such as a full alpha-numeric keyboard, are too difficult to operate.

0036The invention is also operational with numerous other general purpose or special purpose computing systems, environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, wireless or cellular telephones, regular telephones (without any screen), personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.

0037The following is a brief description of a general purpose computer <b>120</b> illustrated in <figref idref="DRAWINGS">FIG. 3</figref>. However, the computer <b>120</b> is again only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computer <b>120</b> be interpreted as having any dependency or requirement relating to any one or combination of components illustrated therein.

0038The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices. Tasks performed by the programs and modules are described below and with the aid of figures. Those skilled in the art can implement the description and figures as processor executable instructions, which can be written on any form of a computer readable medium.

0039With reference to <figref idref="DRAWINGS">FIG. 3</figref>, components of computer <b>120</b> may include, but are not limited to, a processing unit <b>140</b>, a system memory <b>150</b>, and a system bus <b>141</b> that couples various system components including the system memory to the processing unit <b>140</b>. The system bus <b>141</b> may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Universal Serial Bus (USB), Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus. Computer <b>120</b> typically includes a variety of computer readable mediums. Computer readable mediums can be any available media that can be accessed by computer <b>120</b> and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer readable mediums may comprise computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer <b>120</b>.

0040Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, FR, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media.

0041The system memory <b>150</b> includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) <b>151</b> and random access memory (RAM) <b>152</b>. A basic input/output system <b>153</b> (BIOS), containing the basic routines that help to transfer information between elements within computer <b>120</b>, such as during start-up, is typically stored in ROM <b>151</b>. RAM <b>152</b> typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit <b>140</b>. By way of example, and not limitation, <figref idref="DRAWINGS">FIG. 3</figref> illustrates operating system <b>54</b>, application programs <b>155</b>, other program modules <b>156</b>, and program data <b>157</b>.

0042The computer <b>120</b> may also include other removable/non-removable volatile/nonvolatile computer storage media. By way of example only, <figref idref="DRAWINGS">FIG. 3</figref> illustrates a hard disk drive <b>161</b> that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive <b>171</b> that reads from or writes to a removable, nonvolatile magnetic disk <b>172</b>, and an optical disk drive <b>175</b> that reads from or writes to a removable, nonvolatile optical disk <b>176</b> such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive <b>161</b> is typically connected to the system bus <b>141</b> through a non-removable memory interface such as interface <b>160</b>, and magnetic disk drive <b>171</b> and optical disk drive <b>175</b> are typically connected to the system bus <b>141</b> by a removable memory interface, such as interface <b>170</b>.

0043The drives and their associated computer storage media discussed above and illustrated in FIG. <b>3</b>, provide storage of computer readable instructions, data structures, program modules and other data for the computer <b>120</b>. In <figref idref="DRAWINGS">FIG. 3</figref>, for example, hard disk drive <b>161</b> is illustrated as storing operating system <b>164</b>, application programs <b>165</b>, other program modules <b>166</b>, and program data <b>167</b>. Note that these components can either be the same as or different from operating system <b>154</b>, application programs <b>155</b>, other program modules <b>156</b>, and program data <b>157</b>. Operating system <b>164</b>, application programs <b>165</b>, other program modules <b>166</b>, and program data <b>167</b> are given different numbers here to illustrate that, at a minimum, they are different copies.

0044A user may enter commands and information into the computer <b>120</b> through input devices such as a keyboard <b>182</b>, a microphone <b>183</b>, and a pointing device <b>181</b>, such as a mouse, trackball or touch pad. Other input devices (not shown) may include a joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit <b>140</b> through a user input interface <b>180</b> that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor <b>184</b> or other type of display device is also connected to the system bus <b>141</b> via an interface, such as a video interface <b>185</b>. In addition to the monitor, computers may also include other peripheral output devices such as speakers <b>187</b> and printer <b>186</b>, which may be connected through an output peripheral interface <b>188</b>.

0045The computer <b>120</b> may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer <b>194</b>. The remote computer <b>194</b> may be a personal computer, a hand-held device, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer <b>120</b>. The logical connections depicted in <figref idref="DRAWINGS">FIG. 3</figref> include a local area network (LAN) <b>191</b> and a wide area network (WAN) <b>193</b>, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.

0046When used in a LAN networking environment, the computer <b>120</b> is connected to the LAN <b>191</b> through a network interface or adapter <b>190</b>. When used in a WAN networking environment, the computer <b>120</b> typically includes a modem <b>192</b> or other means for establishing communications over the WAN <b>193</b>, such as the Internet. The modem <b>192</b>, which may be internal or external, may be connected to the system bus <b>141</b> via the user input interface <b>180</b>, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer <b>120</b>, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, <figref idref="DRAWINGS">FIG. 3</figref> illustrates remote application programs <b>195</b> as residing on remote computer <b>194</b>. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

Exemplary Architecture

0047<figref idref="DRAWINGS">FIG. 4</figref> illustrates architecture <b>200</b> for web based recognition as can be used with the present invention. Generally, information stored in a web server <b>202</b> can be accessed through mobile device <b>30</b> (which herein also represents other forms of computing devices having a display screen, a microphone, a camera, a touch sensitive panel, etc., as required based on the form of input), or through phone <b>80</b> wherein information is requested audibly or through tones generated by phone <b>80</b> in response to keys depressed and wherein information from web server <b>202</b> is provided only audibly back to the user.

0048In this exemplary embodiment, architecture <b>200</b> is unified in that whether information is obtained through device <b>30</b> or phone <b>80</b> using speech recognition, a single recognition server <b>204</b> can support either mode of operation. In addition, architecture <b>200</b> operates using an extension of well-known markup languages (e.g. HTML, XHTML, cHTML, XML, WML, and the like). Thus, information stored on web server <b>202</b> can also be accessed using well-known GUI methods found in these markup languages. By using an extension of well-known markup languages, authoring on the web server <b>202</b> is easier, and legacy applications currently existing can be also easily modified to include voice or other forms of recognition.

0049Generally, device <b>30</b> executes HTML+ scripts, or the like, provided by web server <b>202</b>. When voice recognition is required, by way of example, speech data, which can be digitized audio signals or speech features wherein the audio signals have been preprocessed by device <b>30</b> as discussed above, are provided to recognition server <b>204</b> with an indication of a grammar or language model to use during speech recognition. The implementation of the recognition server <b>204</b> can take many forms, one of which is illustrated, but generally includes a recognizer <b>211</b>. The results of recognition are provided back to device <b>30</b> for local rendering if desired or appropriate. Upon compilation of information through recognition and any graphical user interface if used, device <b>30</b> sends the information to web server <b>202</b> for further processing and receipt of further HTML scripts, if necessary.

0050As illustrated in <figref idref="DRAWINGS">FIG. 4</figref>, device <b>30</b>, web server <b>202</b> and recognition server <b>204</b> are commonly connected, and separately addressable, through a network <b>205</b>, herein a wide area network such as the Internet. It therefore is not necessary that any of these devices be physically located adjacent to each other. In particular, it is not necessary that web server <b>202</b> includes recognition server <b>204</b>. In this manner, authoring at web server <b>202</b> can be focused on the application to which it is intended without the authors needing to know the intricacies of recognition server <b>204</b>. Rather, recognition server <b>204</b> can be independently designed and connected to the network <b>205</b>, and thereby, be updated and improved without further changes required at web server <b>202</b>. As discussed below, web server <b>202</b> can also include an authoring mechanism that can dynamically generate client-side markups and scripts. In a further embodiment, the web server <b>202</b>, recognition server <b>204</b> and client <b>30</b> may be combined depending on the capabilities of the implementing machines. For instance, if the client comprises a general purpose computer, e.g. a personal computer, the client may include the recognition server <b>204</b>. Likewise, if desired, the web server <b>202</b> and recognition server <b>204</b> can be incorporated into a single machine.

0051Access to web server <b>202</b> through phone <b>80</b> includes connection of phone <b>80</b> to a wired or wireless telephone network <b>208</b>, that in turn, connects phone <b>80</b> to a third party gateway <b>210</b>. Gateway <b>210</b> connects phone <b>80</b> to a telephony voice browser <b>212</b>. Telephone voice browser <b>212</b> includes a media server <b>214</b> that provides a telephony interface and a voice browser <b>216</b>. Like device <b>30</b>, telephony voice browser <b>212</b> receives HTML scripts or the like from web server <b>202</b>. In one embodiment, the HTML scripts are of the form similar to HTML scripts provided to device <b>30</b>. In this manner, web server <b>202</b> need not support device <b>30</b> and phone <b>80</b> separately, or even support standard GUI clients separately. Rather, a common markup language can be used. In addition, like device <b>30</b>, voice recognition from audible signals transmitted by phone <b>80</b> are provided from voice browser <b>216</b> to recognition server <b>204</b>, either through the network <b>205</b>, or through a dedicated line <b>207</b>, for example, using TCP/IP. Web server <b>202</b>, recognition server <b>204</b> and telephone voice browser <b>212</b> can be embodied in any suitable computing environment such as the general purpose desktop computer illustrated in <figref idref="DRAWINGS">FIG. 3</figref>.

0052However, it should be noted that if DTMF recognition is employed, this form of recognition would generally be performed at the media server <b>214</b>, rather than at the recognition server <b>204</b>. In other words, the DTMF grammar would be used by the media server <b>214</b>.

0053Referring back to <figref idref="DRAWINGS">FIG. 4</figref>, web server <b>202</b> can include a server side plug-in authoring tool or module <b>209</b> (e.g. ASP, ASP+, ASP.Net by Microsoft Corporation, JSP, Javabeans, or the like). Server side plug-in module <b>209</b> can dynamically generate client-side markups and even a specific form of markup for the type of client accessing the web server <b>202</b>. The client information can be provided to the web server <b>202</b> upon initial establishment of the client/server relationship, or the web server <b>202</b> can include modules or routines to detect the capabilities of the client device. In this manner, server side plug-in module <b>209</b> can generate a client side markup for each of the voice recognition scenarios, i.e. voice only through phone <b>80</b> or multimodal for device <b>30</b>. By using a consistent client side model, application authoring for many different clients is significantly easier.

0054In addition to dynamically generating client side markups, high-level dialog modules, discussed below, can be implemented as a server-side control stored in store <b>211</b> for use by developers in application authoring. In general, the high-level dialog modules <b>211</b> would generate dynamically client-side markup and script in both voice-only and multimodal scenarios based on parameters specified by developers. The high-level dialog modules <b>211</b> can include parameters to generate client-side markups to fit the developers' needs.

Exemplary Client Side Extensions

0055Before describing further aspect of the present invention, it may be helpful to first discuss an exemplary form of extensions to the markup language for use in web based recognition.

0056As indicated above, the markup languages such as HTML, XHTML cHTML, XML, WML or any other SGML-derived markup, which are used for interaction between the web server <b>202</b> and the client device <b>30</b> and phone <b>80</b>, are extended to include controls and/or objects that provide recognition in a client/server architecture. Generally, controls and/or objects can include one or more of the following functions: recognizer controls and/or objects for recognizer configuration, recognizer execution and/or post-processing; synthesizer controls and/or objects for synthesizer configuration and prompt playing; grammar controls and/or objects for specifying input grammar resources; and/or binding controls and/or objects for processing recognition results. The extensions are designed to be a lightweight markup layer, which adds the power of an audible, visual, handwriting, etc. interface to existing markup languages. As such, the extensions can remain independent of: the high-level page in which they are contained, e.g. HTML; the low-level formats which the extensions used to refer to linguistic resources, e.g. the text-to-speech and grammar formats; and the individual properties of the recognition and speech synthesis platforms used in the recognition server <b>204</b>.

0057It should be noted, a markup language extension such as speech application language tags (SALT) can be used. SALT is a developing standard for enabling access to information, applications and web services from personal computers, telephones, tablet PCs and wireless mobile devices, for example. SALT extends existing markup languages such as HTML, XHTML and XML. An example of the SALT specification can be found in Published U.S. patent application, U.S. 2003/0130854, entitled APPLICATION ABSTRACTION WITH DIALOG PURPOSE, which is herein incorporated by reference in its entirety. The SALT specification may be found online at http://www.SALTforum.org. Further details regarding the extensions are not necessary for understanding the present invention.

0058Although speech recognition will be discussed below, it should be understood that the techniques, tags and server side controls described hereinafter can be similarly applied in handwriting recognition, gesture recognition and image recognition.

0059At this point though, a particular mode of entry should be discussed. In particular, use of speech recognition in conjunction with at least a display and, in a further embodiment, a pointing device as well which enables the coordination of multiple modes of input, e.g. to indicate the fields for data entry, is particularly useful. Specifically, in this mode of data entry, the user is generally able to coordinate the actions of the pointing device with the speech input, so for example the user is under control of when to select a field and provide corresponding information relevant to the field. For instance, a credit card submission graphical user interface (GUI) is illustrated in <figref idref="DRAWINGS">FIG. 5</figref>, a user could first decide to enter the credit card number in field <b>252</b> and then enter the type of credit card in field <b>250</b> followed by the expiration date in field <b>254</b>. Likewise, the user could return back to field <b>252</b> and correct an errant entry, if desired. When combined with speech recognition, an easy and natural form of navigation is provided. As used herein, this form of entry using both a screen display allowing free form actions of the pointing device on the screen, e.g. the selection of fields and recognition is called “multimodal”. When rendered using the phone <b>80</b> in a voice-only application, the user would be prompted to provide the information illustrated in <figref idref="DRAWINGS">FIG. 5</figref>.

Generation of Client Side Markups

0060As indicated above, server side plug-in module <b>209</b> outputs client side markups when a request has been made from the client device <b>30</b> or telephony voice browser <b>212</b>. Although possibly described below with respect to the client device, it should be understood that the telephony voice browser <b>212</b> is inferred as an example device for voice-only applications. In short, the server side plug-in module <b>209</b> allows the website, and thus, the application and services provided by the application to be defined or constructed. The instructions in the server side plug-in module <b>209</b> are made of a complied code. The code is run when a web request reaches the web server <b>202</b>. The server side plug-in module <b>209</b> then outputs a new client side markup page that is sent to the client device <b>30</b> or telephony voice browser <b>212</b>. As is well known, this process is commonly referred to as rendering. The server side plug-in module <b>209</b> operates on “controls” that abstract and encapsulate the markup language, and thus, the code of the client side markup page. Such controls that abstract and encapsulate the markup language and operate on the webserver <b>202</b> include or are equivalent to “Servlets” or “Server-side plug ins” to name a few.

0061As is known, server side plug-in modules of the prior art can generate client side markup for visual rendering and interaction with the client device <b>30</b>. Three different approaches are provided herein for extending the server side plug-in module <b>209</b> to include recognition and audible prompting extensions such as the exemplary client side extensions discussed above. In a first approach illustrated schematically in <figref idref="DRAWINGS">FIG. 6</figref>, the current, visual, server side controls (which include parameters for visual display such as location for rendering, font, foreground color, background color, etc.) are extended to include parameters or attributes for recognition and audibly prompting for related recognition. Using speech recognition and associated audible prompting by way of example, the attributes generally pertain to audible prompting parameters such as whether the prompt comprises inline text for text-to-speech conversion, playing of a prerecorded audio file (e.g. a wave file), the location of the data (text for text-to-speech conversion or a prerecorded audio file) for audible rendering, etc. For recognition, the parameters or attributes can include the location of the grammar to be used during recognition, confidence level thresholds, etc. Since the server side plug-in module <b>209</b> generates client side markup, the parameters and attributes for the controls for the server side plug-in module <b>209</b> relate to the extensions provided in the client side markup for recognition and/or audible prompting.

0062The controls indicated at <b>300</b>A in <figref idref="DRAWINGS">FIG. 6</figref> are controls, which are well-known in website application development or authoring tools such as ASP, ASP+, ASP.Net, JSP, Javabeans, or the like. Such controls are commonly formed in a library and used by controls <b>302</b> to perform a particular visual task. Library <b>300</b>A includes methods for generating the desired client markup, event handlers, etc. Examples of visual controls <b>302</b> include a “Label” control that provides a selected text label on a visual display such as the label “Credit Card Submission” <b>304</b> in <figref idref="DRAWINGS">FIG. 5</figref>. Another example of a higher level visual control <b>302</b> is a “Textbox”, which allows data to be entered in a data field such as is indicated at <b>250</b> in <figref idref="DRAWINGS">FIG. 5</figref>. The existing visual controls <b>302</b> are also well-known. In the first approach for extending server side plug-in module controls to include recognition and/or audible prompting, each of the visual controls <b>302</b> would include further parameters or attributes related to recognition or audible prompting. In the case of the “label” control, which otherwise provides selected text on a visual display, further attributes may include whether an audio data file will be rendered or text-to-speech conversion will be employed as well as the location of this data file. A library <b>300</b>B, similar to library <b>300</b>A, includes further markup information for performing recognition and/or audible prompting. Each of the visual controls <b>302</b> is coded so as to provide this information to the controls <b>300</b>B as appropriate to perform the particular task related to recognition or audible prompting.

0063As another example, the “Textbox” control, which generates an input field on a visual display and allows the user of the client device <b>30</b> to enter information, would also include appropriate recognition or audible prompting parameters or attributes such as the grammar to be used for recognition. It should be noted that the recognition or audible prompting parameters are optional and need not be used if recognition or audible prompting is not otherwise desired.

0064In general, if a control at level <b>302</b> includes parameters that pertain to visual aspects, the control will access and use the library <b>300</b>A. Likewise, if the control includes parameters pertaining to recognition and/or audible prompting the control will access or use the library <b>300</b>B. It should be noted that libraries <b>300</b>A and <b>300</b>B have been illustrated separately in order to emphasize the additional information present in library <b>300</b>B and that a single library having the information of libraries <b>300</b>A and <b>300</b>B can be implemented.

0065In this approach, each of the current or prior art visual controls <b>302</b> are extended to include appropriate recognition/audible prompting attributes. The controls <b>302</b> can be formed in a library. The server side plug-in module <b>209</b> accesses the library for markup information. Execution of the controls generates a client side markup page, or a portion thereof, with the provided parameters.

0066In a second approach illustrated in <figref idref="DRAWINGS">FIG. 7</figref>, new visual, recognition/audible prompting controls <b>304</b> are provided such that the controls <b>304</b> are a subclass relative to visual controls <b>302</b>, wherein recognition/audible prompting functionality or markup information is provided at controls <b>304</b>. In other words, a new set of controls <b>304</b> are provided for recognition/audible prompting and include appropriate parameters or attributes to perform the desired recognition or an audible prompting related to a recognition task on the client device <b>30</b>. The controls <b>304</b> use the existing visual controls <b>302</b> to the extent that visual information is rendered or obtained through a display. For instance, a control “SpeechLabel” at level <b>304</b> uses the “Label” control at level <b>302</b> to provide an audible rendering and/or visual text rendering. Likewise, a “SpeechTextbox” control would associate a grammar and related recognition resources and processing with an input field. Like the first approach, the attributes for controls <b>304</b> include where the grammar is located for recognition, the inline text for text-to-speech conversion, or the location of a prerecorded audio data file that will be rendered directly or a text file through text-to-speech conversion. The second approach is advantageous in that interactions of the recognition controls <b>304</b> with the visual controls <b>302</b> are through parameters or attributes, and thus, changes in the visual controls <b>302</b> may not require any changes in the recognition controls <b>304</b> provided the parameters or attributes interfacing between the controls <b>304</b> and <b>302</b> are still appropriate. However, with the creation of further visual controls <b>302</b>, a corresponding recognition/audible prompting control at level <b>304</b> may also have to be written.

0067A third approach is illustrated in <figref idref="DRAWINGS">FIG. 8</figref>. Generally, controls <b>306</b> of the third approach are separate from the visual controls <b>302</b>, but are associated selectively therewith as discussed below. In this manner, the controls <b>306</b> do not directly build upon the visual controls <b>302</b>, but rather provide recognition/audible prompting enablement without having to rewrite the visual controls <b>302</b>. The controls <b>306</b>, like the controls <b>302</b>, use a library <b>300</b>. In this embodiment, library <b>300</b> includes both visual and recognition/audible prompting markup information and as such is a combination of libraries <b>300</b>A and <b>300</b>B of <figref idref="DRAWINGS">FIG. 6</figref>.

0068There are significant advantages to this third approach. Firstly, the visual controls <b>302</b> do not need to be changed in content. Secondly, the controls <b>306</b> can form a single module which is consistent and does not need to change according to the nature of the speech-enabled control <b>302</b>. Thirdly, the process of speech enablement, that is, the explicit association of the controls <b>306</b> with the visual controls <b>302</b> is fully under the developer's control at design time, since it is an explicit and selective process. This also makes it possible for the markup language of the visual controls to receive input values from multiple sources such as through recognition provided by the markup language generated by controls <b>306</b>, or through a conventional input device such as a keyboard. In short, the controls <b>306</b> can be added to an existing application authoring page of a visual authoring page of the server side plug-in module <b>209</b>. The controls <b>306</b> provide a new modality of interaction (i.e. recognition and/or audible prompting) for the user of the client device <b>30</b>, while reusing the visual controls' application logic and visual input/output capabilities. In view that the controls <b>306</b> can be associated with the visual controls <b>302</b> whereat the application logic can be coded, controls <b>306</b> may be hereinafter referred to as “companion controls <b>306</b>” and the visual controls <b>302</b> be referred to as “primary controls <b>302</b>”. It should be noted that these references are provided for purposes of distinguishing controls <b>302</b> and <b>306</b> and are not intended to be limiting. For instance, the companion controls <b>306</b> could be used to develop or author a website that does not include visual renderings such as a voice-only website. In such a case, certain application logic could be embodied in the companion control logic.

0069A first exemplary set of companion controls <b>306</b> are further illustrated in <figref idref="DRAWINGS">FIG. 9</figref>. The set of companion controls <b>306</b> can be grouped as output controls <b>308</b> and input controls <b>310</b>. Output controls <b>308</b> provide “prompting” client side markups, which typically involves the playing of a prerecorded audio file, or text for text-to-speech conversion, the data included in the markup directly or referenced via a URL. Although a single output control can be defined with parameters to handle all audible prompting, in the exemplary embodiment, the forms or types of audible prompting in a human dialog are formed as separate controls. In particular, the output controls <b>308</b> can include a “Question” control <b>308</b>A, a “Confirmation” control <b>308</b>B and a “Statement” control <b>308</b>C, which will be discussed in detail below. Likewise, the input controls <b>310</b> can also form or follow human dialog and include a “Answer” control <b>310</b>A and a “Command” control <b>310</b>B. The input controls <b>310</b> are discussed below, but generally the input controls <b>310</b> associate a grammar with expected or possible input from the user of the client device <b>30</b>.

0070Although the question control <b>308</b>A, confirmation control <b>308</b>B, statement control <b>308</b>C, answer control <b>310</b>A, command control <b>310</b>B, other controls as well as the general structure of these controls, the parameters and event handlers, are specifically discussed with respect to use as companion controls <b>306</b>, it should be understood that these controls, the general structure, parameters and event handlers can be adapted to provide recognition and/or audible prompting in the other two approaches discussed above with respect to <figref idref="DRAWINGS">FIGS. 6 and 7</figref>. For instance, the parameter “ClientToSpeechEnable”, which comprises one exemplary mechanism to form the association between a companion control and a visual control, would not be needed when embodied in the approaches of <figref idref="DRAWINGS">FIGS. 6 and 7</figref>.

0071In a multimodal application, at least one of the output controls <b>308</b> or one of the input controls <b>310</b> is associated with a primary or visual control <b>302</b>. In the embodiment illustrated, the output controls <b>308</b> and input controls <b>310</b> are arranged or organized under a “Question/Answer” (hereinafter also “QA”) control <b>320</b>. QA control <b>320</b> is executed on the web server <b>202</b>, which means it is defined on the application development web page held on the web server using the server-side markup formalism (ASP, JSP or the like), but is output as a different form of markup to the client device <b>30</b> or telephony voice browser <b>212</b>. Although illustrated in <figref idref="DRAWINGS">FIG. 9</figref> where the QA control appears to be formed of all of the output controls <b>308</b> and the input controls <b>310</b>, it should be understood that these are merely options wherein one or more may be included for a QA control.

0072At this point it may be helpful to explain use of the controls <b>308</b> and <b>310</b> in terms of application scenarios. Referring to <figref idref="DRAWINGS">FIG. 10</figref> and in a voice-only application QA control <b>320</b> could comprise a single question control <b>308</b>A and an answer control <b>310</b>A. The question control <b>308</b>A contains one or more prompt objects or controls <b>322</b>, while the answer control <b>310</b>A can define a grammar through grammar object or control <b>324</b> for recognition of the input data and related processing on that input. Line <b>326</b> represents the association of the QA control <b>320</b> with the corresponding primary control <b>302</b>, if used. In a multimodal scenario, where the user of the client device <b>30</b> may touch on the visual textbox, for example with a “TapEvent”, an audible prompt may not be necessary. For example, for a primary control comprising a textbox having visual text forming an indication of what the user of client device should enter in the corresponding field, a corresponding QA control <b>320</b> may or may not have a corresponding prompt such as an audio playback or a text-to-speech conversion, but would have a grammar corresponding to the expected value for recognition, and event handlers <b>328</b> to process the input, or process other recognizer events such as no speech detected, speech not recognized, or events fired on timeouts (as illustrated in “Eventing” below).

0073In general, the QA control through the output controls <b>308</b> and input controls <b>310</b> and additional logic can perform one or more of the following: provide output audible prompting, collect input data, perform confidence validation of the input result, allow additional types of input such as “help” commands, or commands that allow the user of the client device to navigate to other selected areas of the website, allow confirmation of input data and control of dialog flow at the website, to name a few. In short, the QA control <b>320</b> contains all the controls related to a specific topic. In this manner, a dialog is created through use of the controls with respect to the topic in order to inform to obtain information, to confirm validity, or to repair a dialog or change the topic of conversation.

0074In one method of development, the application developer can define the visual layout of the application using the visual controls <b>302</b>. The application developer can then define the spoken interface of the application using companion controls <b>306</b> (embodied as QA control <b>320</b>, or output controls <b>308</b> and input control <b>310</b>). As illustrated in <figref idref="DRAWINGS">FIGS. 9 and 10</figref>, each of the companion controls <b>306</b> are then linked or otherwise associated with the corresponding primary or visual control <b>302</b> to provide recognition and audible prompting. Of course if desired, the application developer can define or encode the application by switching between visual controls <b>302</b> and companion controls <b>306</b>, forming the links therebetween, until the application is completely defined or encoded.

0075At this point, it may be helpful to provide a short description of each of the output controls <b>308</b> and input controls <b>310</b>. Detailed descriptions are provided below for this embodiment in Appendix A.

0000Questions, Answers and Commands

0076Generally, as indicated above, the question controls <b>308</b>A and answer controls <b>310</b>A in a QA control <b>320</b> hold the prompt and grammar resources relevant to the primary control <b>302</b>, and related binding (associating recognition results with input fields of the client-side markup page) and processing logic. The presence, or not, of question controls <b>308</b>A and answer controls <b>310</b>A determines whether speech output or recognition input is enabled on activation. Command controls <b>310</b>B and user initiative answers are activated by specification of the Scope property on the answer controls <b>310</b>A and command controls <b>310</b>B.

0077In simple voice-only applications, a QA control <b>320</b> will typically hold one question control or object <b>308</b>A and one answer control or object <b>310</b>A. Although not shown in the example below, command controls <b>310</b>B may also be specified, e.g. Help, Repeat, Cancel, etc., to enable user input which does not directly relate to the answering of a particular question.

0078A typical ‘regular’ QA control for voice-only dialog is as follows: <tables id="TABLE-US-00001" num="1"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_WhichOne”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“textBox1”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Question ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt> Which one do you want?</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=“whichOne.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0079(The examples provided herein are written in the ASP.Net framework by example only and should not be considered as limiting the present invention.) In this example, the QA control can be identified by its “id”, while the association of the QA control with the desired primary or visual control is obtained through the parameter “ControlsToSpeechEnable”, which identifies one or more primary controls by their respective identifiers. If desired, other well-known techniques can be used to form the association. For instance, direct, implicit associations are available through the first and second approaches described above, or separate tables can be created used to maintain the associations. The parameter “runat” instructs the web server that this code should be executed at the webserver <b>202</b> to generate the correct markup.

0080A QA control might also hold only a statement control <b>308</b>C, in which case it is a prompt-only control without active grammars (e.g. for a welcome prompt). Similarly a QA control might hold only an answer control <b>310</b>A, in which case it may be a multimodal control, whose answer control <b>310</b>A activates its grammars directly as the result of an event from the GUI, or a scoped mechanism (discussed below) for user initiative.

0081It should also be noted that a QA control <b>320</b> may also hold multiple output controls <b>308</b> and input controls <b>310</b> such as multiple question controls <b>308</b>A and multiple answers controls <b>310</b>A. This allows an author to describe interactional flow about the same entity within the same QA control. This is particularly useful for more complex voice-only dialogs. So a mini-dialog which may involve different kinds of question and answer (e.g. asking, confirming, giving help, etc.), can be specified within the wrapper of the QA control associated with the visual control which represents the dialog entity. A complex QA control is illustrated in <figref idref="DRAWINGS">FIG. 10</figref>.

0082The foregoing represent the main features of the QA control. Each feature is described from a functional perspective below.

0000Answer Control

0083The answer control <b>310</b>A abstracts the notion of grammars, binding and other recognition processing into a single object or control. Answer controls <b>310</b>A can be used to specify a set of possible grammars relevant to a question, along with binding declarations and relevant scripts. Answer controls for multimodal applications such as “Tap-and-Talk” are activated and deactivated by GUI browser events. The following example illustrates an answer control <b>310</b>A used in a multimodal application to select a departure city on the “mouseDown” event of the textbox “txtDepCity”, and write its value into the primary textbox control: <tables id="TABLE-US-00002" num="2"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>controlsToSpeechEnable=“txtDepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer</entry><entry>id=“AnsDepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>StartEvent=“onMouseDown”</entry></row><row><entry /><entry>StopEvent=“onMouseUp”</entry></row><row><entry /><entry>/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=“/grammars/depCities.gram”/></entry></row><row><entry /><entry><bind value=“//sml/DepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>targetElement=“txtCity” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0084Typical answer controls <b>310</b>A in voice-only applications are activated directly by question controls <b>308</b>A as described below.

0085The answer control further includes a mechanism to associate a received result with the primary controls. Herein, binding places the values in the primary controls; however, in another embodiment the association mechanism may allow the primary control to look at or otherwise access the recognized results.

0000Question Control

0086Question controls <b>308</b>A abstracts the notion of the prompt tags into an object which contains a selection of possible prompts and the answer controls <b>310</b>A which are considered responses to the question. Each question control <b>308</b>A is able to specify which answer control <b>310</b>A it activates on its execution. This permits appropriate response grammars to be bundled into answer controls <b>310</b>A, which reflect relevant question controls <b>308</b>A.

0087The following question control <b>308</b>A might be used in a voice-only application to ask for a Departure City: <tables id="TABLE-US-00003" num="3"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA id=”QADepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>controlsToSpeechEnable=”txtDepCity”</entry></row><row><entry /><entry>runat=″server″ ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Question id=”Q1” Answers=”AnsDepCity” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>Please give me the departure</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>city.</entry></row><row><entry /><entry></prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer id=”AnsDepCity” ... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0088In the example below, different prompts can be called depending on an internal condition of the question control <b>308</b>A. The ability to specify conditional tests on the prompts inside a question control <b>308</b>A means that changes in wording can be accommodated within the same functional unit of the question control <b>308</b>A. <tables id="TABLE-US-00004" num="4"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="56PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry><entry>id=”QADepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>controlsToSpeechEnable=”txtDepCity”</entry></row><row><entry /><entry>runat=″server″ ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Question id=”Q1” Answers=”AnsDepCity” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt count=”1”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>Now I need to get the departure city.</entry></row><row><entry /><entry>Where would you like to fly from?</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></prompt></entry></row><row><entry /><entry><prompt count =”2”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>Which departure city?</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer id=”AnsDepCity” ... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Conditional QA Control

0089The following example illustrates how to determine whether or not to activate a QA control based upon information known to the application. The example is a portion of a survey application. The survey is gathering information from employees regarding the mode of transportation they use to get to work.

0090The portion of the survey first asks whether or not the user rides the bus to work. If the answer is: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0091"> Yes, the next question asks how many days last week the users rode the bus. </li></ul></li></ul>

0092No, the “number of days rode the bus” question is bypassed. <tables id="TABLE-US-00005" num="5"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><asp:Label id=″lblDisplay1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>text=″Do you ride the bus to work?″</entry></row><row><entry /><entry>runat=″server″/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:DropDownList id=″lstRodeBusYN″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:ListItem</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>selected=″true″>No</asp:ListItem></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:ListItem>Yes</asp:ListItem></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></asp:DropDownList></entry></row><row><entry /><entry><Speech:QA id=″QA_RideBus</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>ControlsToSpeechEnable=″lstRodeBusYN″</entry></row><row><entry /><entry>runat=″server″ ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><SDN:Question id=″Q_RideBus″ ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt bargeIn=″False″></entry></row><row><entry /><entry>Do you ride the bus to work?</entry></row><row><entry /><entry></prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></SDN:Question></entry></row><row><entry /><entry><SDN:Answer id=″A_RideBus″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>autobind=″False″</entry></row><row><entry /><entry>StartEvent=″onMouseDown″</entry></row><row><entry /><entry>StopEvent=″onMouseUp″</entry></row><row><entry /><entry>runat=″server″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>onClientReco=″ProcessRideBusAnswer″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=″ . . . ″ /> <--! ″yes/no″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>grammar --></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></SDN:Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry><asp:Label id=″lblDisplay2″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>enabled=”False”</entry></row><row><entry /><entry>text=″How many days last week did you ride</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>the bus to work?″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:DropDownList id=″lstDaysRodeBus″ enabled=”False”</entry></row><row><entry /><entry>runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:ListItem selected=″true″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>>0</asp:ListItem></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:ListItem>1</asp:ListItem></entry></row><row><entry /><entry><asp:ListItem>2</asp:ListItem></entry></row><row><entry /><entry><asp:ListItem>3</asp:ListItem></entry></row><row><entry /><entry><asp:ListItem>4</asp:ListItem></entry></row><row><entry /><entry><asp:ListItem>5</asp:ListItem></entry></row><row><entry /><entry><asp:ListItem>6</asp:ListItem></entry></row><row><entry /><entry><asp:ListItem>7</asp:ListItem></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></asp:DropDownList></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry><Speech:QA id=″QA_DaysRodeBus″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>ControlsToSpeechEnable=″lstDaysRodeBus″</entry></row><row><entry /><entry>ClientTest=″RideBusCheck″</entry></row><row><entry /><entry>runat=″server″ ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry><Question id=″Q_DaysRodeBus″ ></entry></row><row><entry /><entry><prompt bargeIn=″False″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>How many days last week did you ride the</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>bus to work?</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></SDN:Question></entry></row><row><entry /><entry><SDN:Answer id=″A_DaysRodeBus″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>autobind=″False″</entry></row><row><entry /><entry>StartEvent=″onMouseDown″</entry></row><row><entry /><entry>StopEvent=″onMouseUp″</entry></row><row><entry /><entry>runat=″server″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>onClientReco=″ProcessDaysRodeBusAnswer″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=″ . . . ″ /> <--! ″numbers″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>grammar --></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></SDN:Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry><script language=″jscript″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>function ProcessRideBusAnswer( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><--! using SML attribute of the Event object,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>determine yes or no answer --></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><--! then select the appropriate item in the</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="98PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><tbody valign="top"><row><entry /><entry>dropdown listbox</entry><entry>--></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><--! and enable the next label and dropdown</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="91PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>listbox if answer is “yes”</entry><entry>--></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>if <--! Answer is “yes” --> {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>lstRodeBusYN.selectedIndex=2</entry></row><row><entry /><entry>lblDisplay2.enabled=”true”</entry></row><row><entry /><entry>lstDaysRodeBus.enabled=”true” }</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry>function RideBusCheck( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>if lstRodeBusYN.selectedIndex=″1″ <--!</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>this is no --></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>then return ″False″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>endif</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry>function ProcessDaysRodeBusAnswer( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><--! case statement to select proper</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>dropdown item --></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0093In the example provided above, the QA control “QA_DaysRodeBus” is executed based on a boolean parameter “ClientTest”, which in this example, is set based on the function RideBusCheck( ). If the function returns a false condition, the QA control is not activated, whereas if a true condition is returned the QA control is activated. The use of an activation mechanism allows increased flexibility and improved dialog flow in the client side markup page produced. As indicated in Appendix A many of the controls and objects include an activation mechanism.

0000Command Control

0094Command controls <b>310</b>B are user utterances common in voice-only dialogs which typically have little semantic import in terms of the question asked, but rather seek assistance or effect navigation, e.g. help, cancel, repeat, etc. The Command control <b>310</b>B within a QA control <b>306</b> can be used to specify not only the grammar and associated processing on recognition (rather like an answer control <b>310</b>A without binding of the result to an input field), but also a ‘scope’ of context and a type. This allows for the authoring of both global and context-sensitive behavior on the client side markup.

0095As appreciated by those skilled in the art from the foregoing description, controls <b>306</b> can be organized in a tree structure similar to that used in visual controls <b>302</b>. Since each of the controls <b>306</b> are also associated with selected visual controls <b>302</b>, the organization of the controls <b>306</b> can be related to the structure of the controls <b>302</b>.

0096The QA controls <b>302</b> may be used to speech-enable both atomic controls (textbox, label, etc.) and container controls (form, panel, etc.) This provides a way of scoping behaviour and of obtaining modularity of subdialog controls. For example, the scope will allow the user of the client device to navigate to other portions of the client side markup page without completing a dialog.

0097In one embodiment, “Scope” is determined as a node of the primary controls tree. The following is an example “help” command, scoped at the level of the “Pnl1” container control, which contains two textboxes. <tables id="TABLE-US-00006" num="6"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><asp:panel id=“Pnl1” ...></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><asp:textbox id=“tb1” ... /></entry></row><row><entry /><entry><asp:textbox id=“tb2” ... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></asp:panel></entry></row><row><entry /><entry><Speech:QA ... ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><Command</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“HelpCmd1”</entry></row><row><entry /><entry>scope=“Pnl1”</entry></row><row><entry /><entry>type=“help”</entry></row><row><entry /><entry>onClientReco=“GlobalGiveHelp( )” ></entry></row><row><entry /><entry><Grammar src=“grammars/help.gram”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Command></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><script></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>function GlobalGiveHelp( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0098As specified, the “help” grammar will be active in every QA control relating to “Pnl1” and its contents. The GlobalGiveHelp subroutine will execute every time “help” is recognized. To override this and achieve context-sensitive behavior, the same typed command can be scoped to the required level of context: <tables id="TABLE-US-00007" num="7"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA ... ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><Command</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“HelpCmd2”</entry></row><row><entry /><entry>scope=“Tb2”</entry></row><row><entry /><entry>type=“help”</entry></row><row><entry /><entry>onClientReco=“SpecialGiveHelp( )” ></entry></row><row><entry /><entry><Grammar src=“grammars/help.gram”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></Command></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry><script></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>function SpecialGiveHelp( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Confirmation Control

0099The QA control <b>320</b> can also include a method for simplifying the authoring of common confirmation subdialogs. The following QA control exemplifies a typical subdialog which asks and then confirms a value: <tables id="TABLE-US-00008" num="8"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>id=”qaDepCity”</entry></row><row><entry /><entry>controlsToSpeechEnable=”txtDepCity”</entry></row><row><entry /><entry>runat=”server” ></entry></row><row><entry /><entry><!-- asking for a value --></entry></row><row><entry /><entry><Question id=”AskDepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>type=″ask″</entry></row><row><entry /><entry>Answers=”AnsDepCity” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt> Which city? </prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer id=”AnsDepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>confirmThreshold=”60” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=”grammars/depCity.gram”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>/></entry></row><row><entry /><entry></Answer></entry></row><row><entry /><entry><!-- confirming the value --></entry></row><row><entry /><entry><Confirm id=”ConfirmDepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>Answers=”AnsConfDepCity” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>Did you say <value</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>targetElement=″txtDepCity/Text″>?</entry></row><row><entry /><entry></prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Confirm></entry></row><row><entry /><entry><Answer id=”AnsConfDepCity” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>src=”grammars/YesNoDepCity.gram” /></entry></row><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0100In this example, a user response to ‘which city?’ which matches the AnsDepCity grammar but whose confidence level does not exceed the confirmThreshold value will trigger the confirm control <b>308</b>. More flexible methods of confirmation available to the author include mechanisms using multiple question controls and multiple answer controls.

0101In a further embodiment, additional input controls related to the confirmation control include an accept control, a deny control and a correct control. Each of these controls could be activated (in a manner similar to the other controls) by the corresponding confirmation control and include grammars to accept, deny or correct results, respectively. For instance, users are likely to deny be saying “no”, to accept by saying “yes” or “yes+current value” (e.g., “Do you want to go to Seattle?” “Yes, to Seattle”), to correct by saying “no”+new value (e.g., “Do you want to go to Seattle” “No, Pittsburgh”).

0000Statement Control

0102The statement control allows the application developer to provide an output upon execution of the client side markup when a response is not required from the user of the client device <b>30</b>. An example could be a “Welcome” prompt played at the beginning of execution of a client side markup page.

0103An attribute can be provided in the statement control to distinguish different types of information to be provided to the user of the client device. For instance, attributes can be provided to denote a warning message or a help message. These types could have different built-in properties such as different voices. If desired, different forms of statement controls can be provided, i.e. a help control, warning control, etc. Whether provided as separate controls or attributes of the statement control, the different types of statements have different roles in the dialog created, but share the fundamental role of providing information to the user of the client device without expecting an answer back.

0000Eventing

0104Event handlers as indicated in <figref idref="DRAWINGS">FIG. 10</figref> are provided in the QA control <b>320</b>, the output controls <b>308</b> and the input controls <b>310</b> for actions/inactions of the user of the client device <b>30</b> and for operation of the recognition server <b>204</b> to name a few, other events are specified in Appendix A. For instance, mumbling, where the speech recognizer detects that the user has spoken but is unable to recognize the words and silence, where speech is not detected at all, are specified in the QA control <b>320</b>. These events reference client-side script functions defined by the author. In a multimodal application specified earlier, a simple mumble handler that puts an error message in the textbox could be written as follows: <tables id="TABLE-US-00009" num="9"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>controlsToSpeechEnable=”txtDepCit</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>y” onClientNoReco=”OnMumble( )”</entry></row><row><entry /><entry>runat=”server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer id=”AnsDepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>StartEvent=”onMouseDown”</entry></row><row><entry /><entry>StopEvent=”onMouseUp”</entry></row><row><entry /><entry>></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=”/grammars/depCities.gram”/></entry></row><row><entry /><entry><bind value=”//sml/DepCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>targetElement=”txtCity” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry><script></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>function OnMumble( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>txtDepCity.value=″ . . .recognition</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>error. . . ″;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Control Execution Algorithm

0105In one embodiment, a client-side script or module (herein referred to as “RunSpeech”) is provided to the client device. The purpose of this script is to execute dialog flow via logic, which is specified in the script when executed on the client device <b>30</b>, i.e. when the markup pertaining to the controls is activated for execution on the client due to values contained therein. The script allows multiple dialog turns between page requests, and therefore, is particularly helpful for control of voice-only dialogs such as through telephony browser <b>216</b>. The client-side script RunSpeech is executed in a loop manner on the client device <b>30</b> until a completed form in submitted, or a new page is otherwise requested from the client device <b>30</b>.

0106It should be noted that in one embodiment, the controls can activate each other (e.g. question control activating a selected answer control) due to values when executed on the client. However, in a further embodiment, the controls can “activate” each other in order to generate appropriate markup, in which case server-side processing may be implemented.

0107Generally, in one embodiment, the algorithm generates a dialog turn by outputting speech and recognizing user input. The overall logic of the algorithm is as follows for a voice-only scenario: <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0000"><ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0108"> 1. Find next active output companion control; </li><li id="ul0004-0002" num="0109"> 2. If it is a statement, play the statement and go back to 1; If it is a question or a confirm go to 3; </li><li id="ul0004-0003" num="0110"> 3. Collect expected answers; </li><li id="ul0004-0004" num="0111"> 4. Collect commands; </li><li id="ul0004-0005" num="0112"> 5. Play output control and listen in for input; </li><li id="ul0004-0006" num="0113"> 6. Activate recognized Answer or Command object or, issue an event if none is recognized; </li><li id="ul0004-0007" num="0114"> 7. Go back to 1. <br /> In the multimodal case, the logic is simplified to the following algorithm: </li><li id="ul0004-0008" num="0115"> 1. Wait for triggering event—i.e., user tapping on a control; </li><li id="ul0004-0009" num="0116"> 2. Collect expected answers; </li><li id="ul0004-0010" num="0117"> 3. Listen in for input; </li><li id="ul0004-0011" num="0118"> 4. Activate recognized Answer object or, if none, throw event; </li><li id="ul0004-0012" num="0119"> 5. Go back to 1. </li></ul></li></ul>

0120The algorithm is relatively simple because, as noted above, controls contain built-in information about when they can be activated. The algorithm also makes use of the role of the controls in the dialogue. For example statements are played immediately, while questions and confirmations are only played once the expected answers have been collected.

0121In a further embodiment, implicit confirmation can be provided whereby the system confirms a piece of information and asks a question at the same time. For example the system could confirm the arrival city of a flight and ask for the travel date in one utterance: “When do you want to go to Seattle?” (i.e. asking ‘when’ and implicitly confirming ‘destination: Seattle’). If the user gives a date then the city is considered implicitly accepted since, if the city was wrong, users would have immediately challenged it. In this scenario, it becomes clear that the knowledge of what a user is trying to achieve is vitally important: are they answering the question, or are they correcting the value, or are they asking for help? By using the role of the user input in the dialogue the system can know when to implicitly accept a value.

0122In summary, a dialog is created due to the role of the control in the dialog and the relationship with other controls, wherein the algorithm executes the controls and thus manages the dialog. Each control contains information based on its type which is used by the execution algorithm to select (i.e. make active for execution) a given control according to whether or not it serves a useful purpose at that point in the dialog on the client. For example, confirmation controls are only active when there is a value to confirm and the system does not have sufficient confidence in that value to proceed. In a further implementation, most of these built-in pieces of information can be overridden or otherwise adapted by application developers.

0123The following table summarizes the controls, their corresponding role in the dialog and the relationship with other controls. <tables id="TABLE-US-00010" num="10"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="70PT" align="left" /><colspec colname="3" colwidth="84PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="3" align="center" rowsep="1" /></row><row><entry /><entry /><entry /><entry>Relationship with other</entry></row><row><entry /><entry>Control</entry><entry>Role in dialogue</entry><entry>controls</entry></row><row><entry /><entry namest="OFFSET" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>Statement</entry><entry>output: present</entry><entry>(none)</entry></row><row><entry /><entry /><entry>information to</entry></row><row><entry /><entry /><entry>users</entry></row><row><entry /><entry>Question</entry><entry>output: ask</entry><entry>selects expected Answers</entry></row><row><entry /><entry /><entry>question</entry><entry>as a response</entry></row><row><entry /><entry>Confirmation</entry><entry>output: confirm a</entry><entry>selects potential input</entry></row><row><entry /><entry /><entry>value obtained from</entry><entry>controls as a response,</entry></row><row><entry /><entry /><entry>the user</entry><entry>typically Accept, Deny,</entry></row><row><entry /><entry /><entry /><entry>Correct</entry></row><row><entry /><entry>Answer</entry><entry>input: provide an</entry><entry>selected by</entry></row><row><entry /><entry /><entry>answer to a</entry><entry>Question/Confirmation</entry></row><row><entry /><entry /><entry>question</entry></row><row><entry /><entry>Command</entry><entry>input: seek to</entry><entry>scoped to other controls</entry></row><row><entry /><entry /><entry>repair a dialog, or</entry></row><row><entry /><entry /><entry>change the topic of</entry></row><row><entry /><entry /><entry>conversation</entry></row><row><entry /><entry>Accept</entry><entry>input: confirm a</entry><entry>selected by a</entry></row><row><entry /><entry /><entry>value in response</entry><entry>confirmation</entry></row><row><entry /><entry /><entry>to a confirmation</entry></row><row><entry /><entry>Deny</entry><entry>input: deny a value</entry><entry>selected by a</entry></row><row><entry /><entry /><entry>in response to a</entry><entry>confirmation</entry></row><row><entry /><entry /><entry>confirmation</entry></row><row><entry /><entry>Correct</entry><entry>input: correct a</entry><entry>selected by a</entry></row><row><entry /><entry /><entry>value in response</entry><entry>confirmation</entry></row><row><entry /><entry /><entry>to a confirmation</entry></row><row><entry /><entry>QA</entry><entry /><entry>(wrapper: contains all</entry></row><row><entry /><entry /><entry /><entry>the controls related to</entry></row><row><entry /><entry /><entry /><entry>a specific topic)</entry></row><row><entry /><entry namest="OFFSET" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> The use of these controls may be explained with an illustration of a simple human/computer dialog. In the dialog below, each dialog turn on the part of the System or the User is characterized according to the control (indicated in parentheses) which reflects its purpose in the dialog. <ul id="ul0005" list-style="none"><li id="ul0005-0001" num="0124"> 1. System (Statement): “Welcome to the travel booking service”. </li><li id="ul0005-0002" num="0125"> 2. System (Question): “Where would you like to go?”</li><li id="ul0005-0003" num="0126"> 3. User (Answer): “San Francisco.”</li><li id="ul0005-0004" num="0127"> 4. System (Confirmation): “Did you say Seattle?”</li><li id="ul0005-0005" num="0128"> 5. User (Deny): “No.”</li><li id="ul0005-0006" num="0129"> 6. System (Question): “Where would you like to go?”</li><li id="ul0005-0007" num="0130"> 7. User (Answer): “San Francisco.”</li><li id="ul0005-0008" num="0131"> 8. System (Confirmation): “Did you say Seattle?”</li><li id="ul0005-0009" num="0132"> 9. User (Correct): “I said San Francisco.”</li><li id="ul0005-0010" num="0133"> 10. System (Confirmation): “Did you say San Francisco?”</li><li id="ul0005-0011" num="0134"> 11. User (Correct): “Yes.”</li><li id="ul0005-0012" num="0135"> 12. System (Question): “When would you like to leave?”</li><li id="ul0005-0013" num="0136"> 13. User (Command): “Help.”</li></ul>

0137Turn 1 is a statement on the part of the System. Since a statement control activates no answer controls in response, the system does not expect input. The system goes on to activate a question control at turn 2. This in turn activates a set of possible answer controls, including one which holds a grammar containing the cities available through the service, including “San Francisco”, “Seattle”, etc., which permits the user to provide such a city in turn 3.

0138The user's turn 3 is misrecognized by the system. Although the system believes it has a value from an answer control for the city, its confidence in that value is low (rightly so, since it has recognized incorrectly). This low confidence value in a just-received answer control is sufficient information for RunSpeech to trigger a confirmation control on the part of the system, as generated at turn 4. The confirmation control in turn activates a deny control, a correct control and an accept control and makes their respective grammars available to recognize the user's next turn. User turns 5, 9 and 11 illustrate example responses for these controls. Turn 5 of the user simply denies the value “no”. This has the effect of removing the value from the system, so the next action of RunSpeech is to ask the question again to re-obtain the value (turn 6).

0139Turns 7 and 8 return us to a confirmation control as with 3 and 4.

0140User turn 9 is a correct control, which has again been activated as a possible response to the confirmation control. A correct control not only denies the value undergoing confirmation, it also provides a new value. So user turn 9 is recognized by the system as a correct control with a new value which, correctly this time, is recognized as “San Francisco”.

0141The system's confidence in the new value is low, however, and yet another confirmation control is generated at turn 10. This in turn activates accept, deny and correct controls in response, and user turn 11 (“Yes” matches an accept control grammar. The recognition of the accept control has the effect of ‘grounding’ the system's belief in the value which it is trying to obtain, and so RunSpeech is now able to select other empty values to obtain. In turn 12, a new question control is output which asks for a date value. The user's response this time (turn 13) is a command: “help”. Command controls are typically activated in global fashion, that is, independently of the different question controls and confirmation controls on the part of the system. In this way the user is able to ask for help at any time, as he does in turn 13. Command controls may also be more sensitively enabled by a mechanism that scopes their activation according to which part of the primary control structure is being talked about.

0142Referring back to the algorithm, in one exemplary embodiment, the client-side script RunSpeech examines the values inside each of the primary controls and an attribute of the QA control, and any selection test of the QA controls on the current page, and selects a single QA control for execution. For example, within the selected QA control, a single question and its corresponding prompt are selected for output, and then a grammar is activated related to typical answers to the corresponding question. Additional grammars may also be activated, in parallel, allowing other commands (or other answers), which are indicated as being allowable. Assuming recognition has been made and any further processing on the input data is complete, the client-side script RunSpeech will begin again to ascertain which QA control should be executed next. An exemplary implementation and algorithm of RunSpeech is provided in Appendix A.

0143It should be noted that the use of the controls and the RunSpeech algorithm or module is not limited to the client/server application described above, but rather can be adapted for use with other application abstractions. For instance, an application such as VoiceXML, which runs only on the client device <b>30</b> or telephony voice browser <b>212</b>, could conceivably include further elements or controls such as question and answer provided above as part of the VoiceXML browser and operating in the same manner. In this case the mechanisms of the RunSpeech algorithm described above could be executed by default by the browser without the necessity for extra script. Similarly, other platforms such as finite state machines can be adapted to include the controls and RunSpeech algorithm or module herein described.

0000Synchronization

0144As noted above, the companion controls <b>306</b> are associated with the primary controls <b>302</b> (the existing controls on the page). As such the companion controls <b>306</b> can re-use the business logic and presentation capabilities of the primary controls <b>302</b>. This is done in two ways: storing values in the primary controls <b>302</b> and notifying the primary controls of the changes <b>302</b>.

0145The companion controls <b>306</b> synchronize or associates their values with the primary controls <b>302</b> via the mechanism called binding. Binding puts values retrieved from recognizer into the primary controls <b>302</b>, for example putting text into a textbox, herein exemplified with the answer control. Since primary controls <b>302</b> are responsible for visual presentation, this provides visual feedback to the users in multimodal scenarios.

0146The companion controls <b>306</b> also offer a mechanism to notify the primary controls <b>302</b> that they have received an input via the recognizer. This allows the primary controls <b>302</b> to take actions, such as invoking the business logic. (Since the notification amounts to a commitment of the companion controls <b>306</b> to the values which they write into the primary controls <b>302</b>, the implementation provides a mechanism to control this notification with a fine degree of control. This control is provided by the RejectThreshold and ConfirmThreshold properties on the answer control, which specify numerical acoustic confidence values below which the system should respectively reject or attempt to confirm a value.)

0147A second exemplary set of companion controls <b>400</b> is illustrated in <figref idref="DRAWINGS">FIG. 11</figref>. In this embodiment, the companion controls <b>400</b> generally include a QA control <b>402</b>, a Command control <b>404</b>, a CompareValidator control <b>406</b>, a Custom Validator control <b>408</b> and a semantic map <b>410</b>. The semantic map <b>410</b> is schematically illustrated and includes SemanticItemSemanticItems <b>412</b> that form a layer between the visual domain primary controls <b>402</b> (e.g. HTML and a non-visual recognition domain of the companion controls <b>400</b>.

0148At this point, it should be emphasized that that although the organization of the companion controls QA and Command is different than that of the first set of companion controls discussed above, the functionality remains the same. In particular, the QA control <b>402</b> includes a Prompt property that references Prompt objects to perform the functions of output controls, i.e. that provide “prompting” client side markups for human dialog, which typically involves the playing of a prerecorded audio file, or text for text-to-speech conversion, the data included in the markup directly or referenced via a URL. Likewise, the input controls are embodied as the QA control <b>402</b> and Command Control <b>404</b> and also follow human dialog and include the Prompt property (referencing a Prompt object) and an Answer property that references at least one Answer object. Both the QA control <b>402</b> and the Command control <b>404</b> associate a grammar with expected or possible input from the user of the client device <b>30</b>. The QA control <b>402</b> in this embodiment can thus be considered a question control, an answer control as well as a confirm control and a statement control since it includes properties necessary for performing these functions.

0149Although the QA control <b>402</b>, Command control <b>404</b>, Compare Validator control <b>406</b> and Custom Validator control <b>408</b> and other controls as well as the general structure of these controls, the parameters and event handlers, are specifically discussed with respect to use as companion controls <b>400</b>, it should be understood that these controls, the general structure, parameters and event handlers can be adapted to provide recognition and/or audible prompting in the other two approaches discussed above with respect to <figref idref="DRAWINGS">FIGS. 6 and 7</figref>. For instance, the Semantic Map <b>410</b>, which comprises another exemplary mechanism to form the association between the companion controls and visual control <b>302</b>, would not be needed when embodied in the approaches of <figref idref="DRAWINGS">FIGS. 6 and 7</figref>.

0150At this point, it may be helpful to provide a short description of each of the controls. Detailed descriptions are provided below in Appendix B.

0000QA Control

0151In general, the QA control <b>402</b> through the properties illustrated can perform one or more of the following: provide output audible prompting, collect input data, perform confidence validation of the input result, allow confirmation of input data and aid in control of dialog flow at the website, to name a few. In other words, the QA control <b>402</b> contains properties that function as controls for a specific topic.

0152The QA control <b>402</b>, like the other controls, is executed on the web server <b>202</b>, which means it is defined on the application development web page held on the web server using the server-side markup formalism (ASP, JSP or the like), but is output as a different form of markup to the client device <b>30</b>. Although illustrated in <figref idref="DRAWINGS">FIG. 11</figref> where the QA control appears to be formed of all of the properties Prompt, Reco, Answers, ExtraAnswers and Confirms, it should be understood that these are merely options wherein one or more may be included for a QA control.

0153At this point it may be helpful to explain use of the QA controls <b>402</b> in terms of application scenarios. Referring to <figref idref="DRAWINGS">FIG. 11</figref> and in a voice-only application QA control <b>402</b> could function as a question and an answer in a dialog. The question would be provided by a Prompt object, while a grammar is defined through grammar object for recognition of the input data and related processing on that input. An Answers property associates the recognized result with a SemanticItem <b>412</b> in the Semantic Map <b>410</b> using an Answer object, which contains information on how to process recognition results. Line <b>414</b> represents the association of the QA control <b>402</b> with the Semantic Map <b>410</b>, and to a SemanticItem <b>412</b> therein. Many SemanticItems <b>412</b> are individually associated with a visual or primary control <b>302</b> as represented by line <b>418</b>, although one or more SemanticItems <b>412</b> may not be associated with a visual control and used only internally. In a multimodal scenario, where the user of the client device <b>30</b> may touch on the visual textbox, for example with a “TapEvent”, an audible prompt may not be necessary. For example, for a primary control comprising a textbox having visual text forming an indication of what the user of client device should enter in the corresponding field, a corresponding QA control <b>402</b> may or may not have a corresponding prompt such as an audio playback or a text-to-speech conversion, but would have a grammar corresponding to the expected value for recognition, and event handlers to process the input, or process other recognizer events such as no speech detected, speech not recognized, or events fired on timeouts.

0154In a further embodiment, the recognition result includes a confidence level measure indicating the level of confidence that the recognized result was correct. A confirmation threshold can also be specified in the Answer object, for example, as ConfirmThreshold equals 0.7. If the confirmation level exceeds the associated threshold, the result can be considered confirmed.

0155It should also be noted that in addition, or in the alternative, to specifying a grammar for speech recognition, QA controls and/or Command controls can specify Dtmf (dual tone modulated frequency) grammars to recognize telephone key activations in response to prompts or questions. Appendix B provides details of a Dtmf object that applies a different modality of grammar (a keypad input grammar rather than, for example, a speech input grammar) to the same question. Some of the properties of the Dtmf object include Preflush, which is a flag indicating if “type-ahead” functionality is allowed in order that the user can provide answers to questions before they are asked. Other properties include the number of milliseconds to wait for receiving the first key press, InitialTimeOut, and the number of milliseconds to wait before adjacent key presses, InterdigitTimeOut. Client-side script functions can be specified for execution through other properties, for example, when no key press is received, OnClientSilence, or when the input is not recognized, OnClientNoReco, or when an error is detected OnClientError.

0156At this point it should be noted that when a Semanticitem <b>412</b> of the Semantic map <b>410</b> is filled, through recognition for example, speech or Dtmf, several actions can be taken. First, an event can be issued or fired indicating that the value has been “changed”. Depending on if the confirmation level was met, another event that can be issued or fired includes a “confirm” event that indicates that the corresponding SemanticItemSemanticItem has been confirmed. These events are used for controlling dialog.

0157The Confirms property can also include answer objects having the structure similar to that described above with respect to the Answers property in that it is associated with a SemanticItem <b>412</b> and can include a ConfirmThreshold if desired. The Confirms property is not intended to obtain a recognition result per se, but rather, to confirm a result already obtained and ascertain from the user whether the result obtained is correct. The Confirms property is a collection of Answer objects used to assert whether the value of a previously obtained result was correct. The containing QA's Prompt object will inquire about these items, and obtains the recognition result from the associated SemanticItem <b>412</b> and forms it in a question such as “Did you say Seattle?” If the user responds with affirmation such as “Yes”, the confirmed event is then fired. If the user responds in the negative such as “No”, the associated SemanticItem <b>412</b> is cleared.

0158It should be noted in a further embodiment, the Confirms property can also accept corrections after a confirmation prompt has been provided to the user. For instance, in response to a confirmation prompt “Did you say Seattle?” the user may respond “San Francisco” or “No, San Francisco”, in which case, the QA control has received a correction. Having information as to which SemanticItem is being confirmed through the Answer object, the value in the SemanticItem can be replaced with the corrected value. It should also be noted that if desired, confirmation can be included in a further prompt for information such as “When did you want to go to Seattle?”, where the prompt by the system includes a confirmation for “Seattle” and a further prompt for the day of departure. A response by the user providing a correction to the place of destination would activate the Confirms property to correct the associated SemanticItem, while a response with only a day of departure would provide implicit confirmation of the destination.

0159The ExtraAnswers property allows the application author to specify Answer objects that a user may provide in addition to a prompt or query that has been made. For instance, if a travel oriented system prompts a user for a destination city, but the user responds by indicating “Seattle tomorrow”, the Answers property that initially prompted the user will retrieve and therefore bind the destination city “Seattle” to the appropriate SemanticItem, while the ExtraAnswers property can process “Tomorrow” as the next succeeding day (assuming that the system knows the current day), and thereby, bind this result to the appropriate SemanticItem in the Semantic Map. The ExtraAnswers property includes one or more Answer objects defined for possible extra information the user may also state. In the example provided above, having also retrieved information as to the day of departure, the system would then not need to reprompt the user for this information, assuming that the confirmation level exceeded the corresponding ConfirmThreshold. If the confirmation level did not exceed the corresponding threshold, the appropriate Confirms property would be activated.

0000Command Control

0160Command controls <b>404</b> are user utterances common in voice-only dialogs which typically have little semantic import in terms of the question asked, but rather seek assistance or effect navigation, e.g. help, cancel, repeat, etc. The Command control <b>404</b> can include a Prompt property to specify a prompt object. In addition, the Command control <b>404</b> can be used to specify not only the grammar (through a Grammar property) and associated processing on recognition (rather like an Answer object without binding of the result to an SemanticItem), but also a ‘scope’ of context and a type. This allows for the authoring of both global and context-sensitive behavior on the client side markup. The Command control <b>404</b> allows additional types of input such as “help” commands, or commands that allow the user of the client device to navigate to other selected areas of the website.

0000CompareValidator Control

0161The CompareValidator control compares two values according to an operator and takes an appropriate action. The values to be compared can be of any form such as integers, strings of text, etc. The CompareValidator includes a property SematicItemtoValidate that indicates the SemanticItem that will be validated. The SemanticItem to be validated can be compared to a constant or another SemanticItem, where the constant or other SemanticItem is provided by properties ValuetoCompare and SematicItemtoCompare, respectively. Other parameters or properties associated with the CompareValidator include Operator, which defines the comparison to be made and Type, which defines the type of value, for example, integer or string of the SemanticItems.

0162If the validation associated with the CompareValidator control fails, a Prompt property can specify a Prompt object that can be played instructing the user that the result obtained was incorrect. If upon comparison the validation fails, the associated SemanticItem defined by SematicItemtoValidate is indicated as being empty, in order that the system will reprompt the user for a correct value. However, it may be helpful to not clear the incorrect value of the associated SemanticItem in the Semantic Map in the event that the incorrect value will be used in a prompt to the user reiterating the incorrect value. The CompareValidator control can be triggered either when the value of the associated SemanticItem changes value or when the value has been confirmed, depending on the desires of the application author.

0000CustomValidator Control

0163The CustomValidator control is similar to the CompareValidator control. A property SematicItemtoValidate indicates the SemanticItem that will be validated, while a property ClientValidationFunction specifies a custom validation routine through an associated function or script. The function would provide a Boolean value “yes” or “no” or an equivalent thereof whether or not the validation failed. A Prompt property can specify a Prompt object to provide indications of errors or failure of the validation. The CustomValidator control can be triggered either when the value of the associated SemanticItem changes value or when the value has been confirmed, depending on the desires of the application author.

0000Call Control

0164In a further embodiment, controls are provided that enable application authors to create speech applications that handle telephony transactions. In general, the controls implement or invoke well-known telephony transactions such as ECMA (European Computer Manufactures Associated) CSTA (Computer Supported Telecommunication Application) messages, eventing and services. As is known, CSTA specifies application interfaces and protocols for monitoring and controlling calls and devices in a communication network. These calls and devices may support various media and can reside in various network environments such as IP, Switched Circuit Networks and mobile networks.

0165In the illustrated embodiment, the controls available to the application author include a SmexMessage control (SMEX-Simple Message Exchange), a TransferCall control, a MakeCall control, a DisconnectCall control and an AnswerCall control. Like the controls described above, these controls can be executed on the server so as to generate client-side markup that when executed on the client device perform the desired telephony transaction.

0166Referring to <figref idref="DRAWINGS">FIG. 4</figref>, the client-side markup generated by server <b>202</b> can be executed by voice browser <b>216</b>, which in turn provides telephony transactions instructions (e.g. CSTA service calls) to the media server <b>214</b> and gateway <b>210</b> as necessary to perform the desired telephony transaction. Appendix B provides detailed information regarding each of the properties available in the controls. The controls are commonly used in a voice-only mode such as by voice browser <b>216</b> in <figref idref="DRAWINGS">FIG. 4</figref>; however, it should be understood that applications can be written also to be executed in an multi-modal client device.

0000Control Execution Algorithm

0167As in the previous set of controls, a client-side script or module (herein referred to as “RunSpeech”) is provided to the client device for the controls of <figref idref="DRAWINGS">FIG. 11</figref>. Again, the purpose of this script is to execute dialog flow via logic, which is specified in the script when executed on the client device <b>30</b>, i.e. when the markup pertaining to the controls is activated for execution on the client due to values contained therein. The script allows multiple dialog turns between page requests, and therefore, is particularly helpful for control of voice-only dialogs such as through telephony browser <b>216</b>. The client-side script RunSpeech is executed in a loop manner on the client device <b>30</b> until a completed form is submitted, or a new page is otherwise requested from the client device <b>30</b>.

0168Generally, in one embodiment, the algorithm generates a dialog turn by outputting speech and recognizing user input. The overall logic of the algorithm is as follows for a voice-only scenario (reference is made to Appendix B for properties or parameters not otherwise discussed above): <ul id="ul0006" list-style="none"><li id="ul0006-0001" num="0000"><ul id="ul0007" list-style="none"><li id="ul0007-0001" num="0169"> 1. Find the first active (as defined below) QA, CompareValidator or CustomValidator control in speech index order. </li><li id="ul0007-0002" num="0170"> 2. If there is no active control, submit the page. </li><li id="ul0007-0003" num="0171"> 3. Otherwise, run the control. <br /> A QA is considered active if and only if: </li><li id="ul0007-0004" num="0172"> 1. The QA's clientActivationFunction either is not present or returns true, AND </li><li id="ul0007-0005" num="0173"> 2. If the Answers property collection is non empty, the State of all of the SemanticItems pointed to by the set of Answers is Empty OR </li><li id="ul0007-0006" num="0174"> 3. If the Answers property collection is empty, the State at least one SemanticItem in the Confirm array is NeedsConfirmation. <br /> However, if the QA has PlayOnce true and its Prompt has been run successfully (reached OnComplete) the QA will not be a candidate for activation. <br /> A QA is run as follows: </li><li id="ul0007-0007" num="0175"> 1. If this is a different control than the previous active control, reset the prompt Count value. </li><li id="ul0007-0008" num="0176"> 2. Increment the Prompt count value </li><li id="ul0007-0009" num="0177"> 3. If PromptSelectFunction is specified, call the function and set the Prompt's inlineprompt to the returned string. </li><li id="ul0007-0010" num="0178"> 4. If a Reco object is present, start it. This Reco should already include any active command grammar. <br /> A Validator (either a CompareValidator or a CustomValidator) is active if: </li><li id="ul0007-0011" num="0179"> 1. The SemanticItemToValidate has not been validated by this validator and its value has changed. <br /> A CompareValidator is run as follows: </li><li id="ul0007-0012" num="0180"> 1. Compare the values of the SemanticItemToCompare or ValueToCompare and SemanticItemToValidate according to the validator's Operator. </li><li id="ul0007-0013" num="0181"> 2. If the test returns false, empty the text field of the SemanticItemToValidate and play the prompt. </li><li id="ul0007-0014" num="0182"> 3. If the test returns true, mark the SemanticItemToValidate as validated by this validator. <br /> A CustomValidator is run as follows: </li><li id="ul0007-0015" num="0183"> 1. The ClientValidationFunction is called with the value of the SemanticItemToValidate. </li><li id="ul0007-0016" num="0184"> 2. If the function returns false, the semanticitem cleared and the prompt is played, otherwise as validated by this validator. <br /> A Command is considered active if and only if: </li><li id="ul0007-0017" num="0185"> 1. It is in Scope, AND </li><li id="ul0007-0018" num="0186"> 2. There is not another Command of the same Type lower in the scope tree. </li></ul></li></ul>

0187In the multi-modal case, the logic is simplified to the following algorithm: <ul id="ul0008" list-style="none"><li id="ul0008-0001" num="0000"><ul id="ul0009" list-style="none"><li id="ul0009-0001" num="0188"> 1. Wait for triggering event—i.e., user tapping on a control; </li><li id="ul0009-0002" num="0189"> 2. Collect expected answers; </li><li id="ul0009-0003" num="0190"> 3. Listen in for input; </li><li id="ul0009-0004" num="0191"> 4. Bind result to SemanticItem, or if none, throw event; </li><li id="ul0009-0005" num="0192"> 5. Go back to 1. <br /> Focus Tracking </li></ul></li></ul>

0193The following discussion regarding focus tracking will be described with respect to use of SemanticItems as described above. However, it should be understood that this is but one embodiment and the techniques described below with regard to processing recognition results and maintaining focus on information recently recognized or provided from the user can be applied to the other embodiments described above.

0194The foregoing algorithm for the voice-only scenario uses QA (Question-Answer) controls and the SemanticItem to formulate the dialogs. As described above each SemanticItem contains a recognition result, the confidence that the system has in it, and its current state. QA controls contain information, including prompts and grammars, that are used to ask questions, recognize answers and update the SemanticItems. QA controls also contain answer and extra-answers objects that are used to specify the QA activation logic and the processing to be done with the results. Both answers and extra-answers take the recognition results returned by the speech recognizer and update SemanticItems with the values extracted from the recognition results. The difference between answers and extra-answers lies in the activation logic used by the system: if a SemanticItem already contains a value, the system will not process answers related to it. On the other hand, extra-answers can be activated irrespective of whether their related SemanticItem already contains a value or not.

0195Although the foregoing algorithm works well in many applications, problems can arise as discussed in the Background Section when, for example, extra answers are being processed in a mixed-initiative dialogue with the user. An aspect of the present invention is to allow the system to automatically adapt the dialogue flow so that it stays focused on the user's most recent input. In the algorithm discussed above, the dialogue flow is constrained by two main sources: the activation logic of the QA controls (based on the SemanticItem state and the QAs' answer/confirm/extra-answer specification) and the speech index of the QA control. Generally, this aspect of the invention adds a third constraint, herein referred to as “focus”. Whenever a SemanticItem is modified, which herein represents recently received recognition results, this information is retained in a manner so as to provide an order indicating when SemanticItems have been changed relative to each other. In this manner, the most recently changed SemanticItem can be identified. In one form, memory is used in the form of a “stack”, which is pictorially illustrated in <figref idref="DRAWINGS">FIG. 13</figref> at <b>450</b>. The stack <b>450</b> comprises identifiers such as <b>451</b>, <b>452</b>, <b>453</b> and <b>454</b> of SemanticItems related to recognition results received. As a SemanticItem is changed through the receipt of recognition results, it is added to the stack <b>450</b>. Then, when the RunSpeech algorithm looks for a suitable QA control to execute next, it will only consider QA controls that are related to the SemanticItem at the top of the stack <b>450</b>. This means that QAs that are later in speech index order than other QAs can be “promoted” and run before them, provided that they are related to the top-most SemanticItems whereas the others are not, and it is active. If no suitable QA can be found, the stack <b>450</b> is “popped” or decremented and the RunSpeech algorithm searches for suitable QAs again. This process may repeat until the stack <b>450</b> is empty, in which case the RunSpeech algorithm acts with the usual (non-focused) behavior as described above.

0196A system wide _[RL3]“focussing” value can be used to identify if focussing is to be performed or not. With focussing, the general algorithm described above can be represented as follows, where other portions are the same. <ul id="ul0010" list-style="none"><li id="ul0010-0001" num="0000"><ul id="ul0011" list-style="none"><li id="ul0011-0001" num="0197"> 1. If focussing is desired and the stack is not null (indicating focused SemanticItems_[RL4] are present), find the first active (as defined above) QA_[RL5] corresponding to the SemaniticItem at the top of the stack. <ul id="ul0012" list-style="none"><li id="ul0012-0001" num="0198"> Otherwise, if focussing is not desired or the stack is null (indicating no SemanticItems are present), find the first active (as defined above) QA, CompareValidator or CustomValidator control in speech index order. </li></ul></li><li id="ul0011-0002" num="0199"> 2. If there is no active control, submit the page. </li><li id="ul0011-0003" num="0200"> 3. Otherwise, run the control. </li></ul></li></ul>

0201Another way to describe this technique is that all QA controls that are not related to the SemanticItem at the top of the stack are removed and the active QA is then selected as usual.

0202As appreciated by those skilled in the art, the use of a stack is but one form to accomplish focusing as described above. Other forms of focussing or prioritizing which QA control will be executed in order to maintain focus include, but are not limited to, counters, pointers, indices, time stamps, etc. as well known to those skilled in the art.

0203It should also be noted in a further embodiment, that the mechanism or manner in which the most recent SemanticItems have been saved need not ensure that they all be saved indefinitely. Rather, referring to <figref idref="DRAWINGS">FIG. 13</figref>_where the stack <b>450</b>, illustrated by way of example for storing such information, is some selected or finite length such that when the stack <b>450</b> is full and a further SemanticItem placed thereon, it causes the lowest or oldest SemanticItem to be pushed_[RL6] off. This technique may be convenient in that the dialogue created thereby will not return to some item of information that the user spoke long ago.

0204The stack or other form of memory is also accessible to the application author through program logic such that it can be erased or reset for example if the user moves on to a different subject where the information related to the semantic information will not be used.

0205In one exemplary embodiment, the use of focus is controlled by a Boolean property on each QA control herein referred to as “focusing”. If the focus property is set to true, the SemanticItems modified by that QA are put on the stack <b>450</b> and the focusing mechanism operates until the stack <b>450</b> is emptied as described above, if a system wide focussing parameter is not present or is set for focussing. If the focus property set to false, the SemanticItems are not put on the stack <b>450</b> and focusing does not take place, at least with respect to that SemanticItem(s).

0206An exemplary embodiment for activation logic with respect to determining if any Qas are related to recently received recognition results for the QA is illustrated in <figref idref="DRAWINGS">FIG. 14</figref>. Generally, at least one answer or confirm must be related to the focused SemanticItem.

0207At step <b>460</b> the most recent SemanticItem is identified from the stack <b>450</b>. At step <b>462</b>, each QA control's corresponding answers are compared for a relation to the most recent SemanticItem. If a related answer is found, the QA control considered for execution. This is subject to the QA being active under the usual activation conditions (semantic item should be empty, etc.)_[RL7]

0208If at step <b>462</b> no QA control is found based on related answers, the method continues at step <b>464</b> whereat each QA control's corresponding confirms are compared for a relation to the most recent SemanticItem. If a related confirm is found the QA control is considered for execution._[RL8]

0209If at step <b>464</b> no QA control is found based on related confirms, the method continues at step <b>466</b> whereat the Semantic Item is removed from the stack. If the stack is not empty or null, the method returns to step <b>460</b>.

0210In the embodiment described above, one SemanticItem at a time is added to the stack <b>450</b> when each recognition result is obtained. In another embodiment, each element <b>451</b>, <b>452</b>, <b>453</b> and <b>454</b> in the stack <b>450</b> can represent an array each array contains one or more SemanticItems. The method of activating a QA illustrated in <figref idref="DRAWINGS">FIG. 14</figref> is essentially the same however, each SemanticItem in the array for each layer of the stack <b>450</b> is examined before the array is removed from the stack <b>450</b>.

0211In some cases a QA control may need to be played in speech index order, irrespective of being identified by the method of <figref idref="DRAWINGS">FIG. 14</figref>. In a further embodiment, a property is provided for each QA control specifying whether or not it should be included in the focusing mechanism, if identified.

0212The following provides an example of how the focussing mechanism retains order or focus in a mixed-initiative travel dialogue requiring a departure city and a destination city. Suppose the question or prompt is rendered “What are your travel plans?”. A user may answer “I'd like to go to Seattle.” or “I'd like to leave from Paris”. In the first case, the dialogue should go on with the confirmation: “Did you say Seattle?” and then ask for the departure city since this information was not given.

0213In the second case, the system should confirm the departure city first and then ask about the destination city second. If the user provided both the departure city and the destination city, the application author may want to confirm the departure city first and then the arrival city. Writing such a dialogue flow without using automated focusing is time consuming and error prone. Using the focusing mechanism, the application author does not have to worry about getting the ordering right_[RL9]. (However, the application author will still need to worry about some of the ordering (e.g., which city to confirm when both are given at the same time) although not as much as before.) If the user provides the departure city, the associated SemanticItem is pushed on the stack. When the control algorithm RunSpeech looks for a suitable QA control to execute, only QA controls related to that SemanticItem will be considered. In this case the QA confirming the departure city will be executed, even if the QA asking for the destination city comes earlier in speech index order.

0214The focusing problem becomes quickly intractable if three or more pieces of information can be provided. In the example above, assume the airline to be used is also desired besides the departure and destination cities. A user may provide input to the initial question of travel plans by stating, “On United Airlines, I want to depart from Seattle”, or “I want to fly to Minneapolis on American Airlines”, or “I want to fly from Seattle to Chicago.” Each of these examples provides a different set of information. Trying to predict all possible dialogue flows and making sure that the system appropriately confirms (and asks again in case the user denies that the recognition result is correct) and asks for remaining required information in a logical manner is a very difficult task. However, this becomes straightforward using the focusing mechanism.

0000Assisted Multi-Modal Dialogue

0215The foregoing has provided separate algorithms for controlling dialogue in a voice-only scenario and in a multi-modal scenario. Described below is a single algorithm that can be used to control the dialog in either the voice-only scenario or the multi-modal scenario, which, among other benefits, would allow the user to easily switch between modes of operation for any page loaded on the client device.

0216Currently, in the voice-only scenario, the algorithm starts once the page has been loaded on the client device, for example, the voice browser <b>216</b>, and stops once all the information has been obtained. The page is then sent from the client device to the server <b>202</b>.

0217In a modified form discussed below, pressing on a textbox causes the algorithm to run a dialogue associated with that textbox, rather than starting at the beginning of the page. The dialogue can include focusing as described above. This gives the user the ability to enter information as he/she desires. It should be noted in the multi-modal algorithm discussed earlier such a dialog was not run.

0218<figref idref="DRAWINGS">FIG. 13</figref> pictorially illustrates information to be gathered organized as “topics” in order to execute portions of the dialog. In the illustrative example, the topics pertain to a travel site that allows users to input information related to a departure city <b>500</b>, a departure date and time <b>502</b>, an arrival city <b>504</b> and an arrival date and time <b>506</b>. Each topic <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> comprises a collection of one or more questions, answers, commands or validators such as illustrated in <figref idref="DRAWINGS">FIG. 11</figref> to form a dialog for each corresponding topic. Each of the collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> includes a label or identifier <b>500</b>A, <b>502</b>A, <b>504</b>A and <b>506</b>A, respectively. In addition, the collections can be grouped in two or more sets also identified by a label or identifier. In the illustrated example, a larger collection is identified as <b>508</b>A (representative of the complete page), which comprises the collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> as a group or hierarchy.

0219Although the each of the collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> can be constructed by using a combination of the various controls illustrated in <figref idref="DRAWINGS">FIG. 11</figref> and discussed above, if desired, the controls can be further grouped together in a larger control forming a template. In this manner, an application author can select the larger control and modify the individual controls therein as necessary depending upon the topic under development. Graphical user interfaces can be employed where the application author can select the desired controls and “drag and drop” on a panel to construct a topic. Such techniques are well-known in website design and other application development environments.

0220Organization of the controls in this manner allows convenient execution of the dialog in both the voice-only scenario and the multi-modal scenario. In particular, by using the collection identifiers <b>500</b>A, <b>502</b>A, <b>504</b>A, <b>506</b>A and <b>508</b>A the control algorithm can be instructed to execute the corresponding dialog for each collection <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b>, individually, or as a group <b>508</b>. For example, a simple J-script command such as of the form: <ul id="ul0013" list-style="none"><li id="ul0013-0001" num="0221"> Runspeech.ActiveQA=(Collection Identifier) <br /> can be used to identify collection and thus the corresponding dialog to execute. </li></ul>

0222In the voice-only mode scenario, the “Collection Identifier” can be set to identifier <b>508</b>A, in which case the control algorithm will execute in the manner discussed above for the voice-only mode of operation to execute the complete dialog. However, it should be noted that in an alternative embodiment, a separate manager algorithm or module <b>512</b> can be used to individually and sequentially activate each of the collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b>. In the example illustrated in <figref idref="DRAWINGS">FIG. 13</figref>, the manager algorithm <b>512</b> would issue a command identifying that collection <b>502</b> is active, whereupon after control algorithm executes the dialog of collection <b>502</b>, control returns back to the manager algorithm <b>512</b>. The manager algorithm <b>512</b> would then issue a command identifying that collection <b>504</b> is now active. This process is repeated until each of the collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> have been activated as prescribed by the manager algorithm <b>512</b>.

0223For the multi-modal application, the control algorithm maintains a list of those collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> that are considered active, for instance, a textbox on a page that needs input data. It should be noted in the illustrated embodiment, the control algorithm can ascertain the SemanticItems associated with each collection that needs to be filled. Whereupon, the data in the SemanticItem is used to fill in the corresponding textbox.

0224<figref idref="DRAWINGS">FIG. 14</figref> illustrates an exemplary display rendering <b>520</b> for the travel page. As data is entered, more collections may become active or may not be relevant and thus deactivated. As described above, each collection <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b> has an associated identifier or label <b>500</b>A, <b>502</b>A, <b>504</b>A and <b>506</b>A in the dialog. Each textbox in the page provided to the client also has an associated identifier or label (not shown). When a textbox, or other button such as button <b>522</b> associated with each textbox, is activated by the user, a simple function can then be called using the label or identifier of the textbox or other button <b>522</b> as an input parameter to identify the corresponding collection identifier that the selected textbox or button <b>522</b> is associated with. With the collection identifier determined, the control algorithm can be executed upon the dialog of the corresponding collection, for example, by issuing the J-script command provided above.

0225Organization of the page into topics with corresponding dialogs identified by collection identifiers provides additional benefits not previously available in the multi-modal scenario. As stated above, the control algorithm in the multi-modal scenario begins execution of the dialog associated with the textbox that has been selected. Once the dialogue has been completed for the selected textbox or a group of textboxes, having obtained the speech input and performed any required validation or confirmation, the control algorithm stops, and possibly waits for further direction from the user. Alternatively, depending on the author of the application, an additional “stop” button <b>526</b> can be provided such that when a user initiates the stop button <b>526</b> the dialogue for the previously activated textbox would stop. In yet another embodiment, the user can provide an audible command such as “cancel” via a command control, which would also stop the control algorithm with respect to the textbox that has been selected. Each of the afore-mentioned techniques, enable the application author to allow the user to selectively stop the dialog in the multi-modal scenario. Suitable mechanisms or methods can be provided in the control algorithm to selectively stop execution of the control algorithm based on user action. For example, an application program interface can be used to stop an executing topic and direct the control algorithm to begin execution of another topic.

0226Another situation which may require the control algorithm to halt execution occurs when a confirmation prompt or other confirmation output is provided in the multi-modal scenario. By contrast, in a voice-only browser once input speech is obtained from the user, the control algorithm may execute a confirmation control (automatically or based on a confidence threshold not being exceeded), where the confirmation control audibly returns back to the user what has been recognized. The confirmation control then asks if what has been recognized is correct. The user answers whether or not it has been recognized as correct and the control algorithm proceeds to the next control such as the next question or QA control.

0227However, in the multi-modal scenario, the input speech that has been recognized is generally rendered in the textbox that has been selected. Again, based upon automatic confirmation or whether or not a confidence threshold has been exceeded, a confirmation prompt can be displayed asking whether or not the input speech has been properly recognized. In <figref idref="DRAWINGS">FIG. 14</figref>, a confirmation prompt is illustrated at <b>530</b> in response to a confidence threshold not being exceeded. In this example, the prompt <b>530</b> includes a “yes” button <b>532</b> and a “no” button <b>534</b>. The confirmation prompt could be rendered audibly and/or the user's response could be provided by buttons <b>532</b> and <b>534</b> or via speech input.

0228At this point, it should be noted that displaying a prompt rather than audibly rendering the prompt when available through a multi-modal capable device may be preferred depending on the data being rendered or the current operating environment. For example, audible rendering of sensitive data such as confirmation of a social security number may not be preferred in view that such information could possibly be overheard by others. Thus, parameters can be established and associated with information being gathered allowing the application author to designate that if said information is rendered it should be rendered as a default as a prompt if a multi-modal client is being used. Likewise, given a noisy operating environment, audible rendering of prompts may not be practical. Methods can be employed by the application author to enable the user to change the settings of these parameters, if desired.

0229Also, audible rendering of prompts typically includes active monitoring of the length of silence that may result after rendering the audible prompt. If a sufficient amount of silence occurs after playing the prompt, the user may not have heard the prompt and some methods are then employed to continue the dialog, for example, by replaying the prompt. However, when a prompt is displayed, such as the confirmation <b>530</b> of <figref idref="DRAWINGS">FIG. 14</figref>, the notion of time may be irrelevant. Thus, if a prompt is being displayed rather than being rendered audibly, it may be appropriate to disable or otherwise modify silence measuring methods occurring after rendering. In effect, the control algorithm could suspend the dialog after displaying a prompt, such as confirmation prompt <b>530</b>, and begin again with the user selecting one of the buttons “yes” or “no” in the prompt <b>530</b>. Depending on if any measurement of inactivity is being monitored by the control algorithm, activation of the buttons “yes” or “no” could employ a method to resume processing of the dialog by the control algorithm.

0230Referring back to <figref idref="DRAWINGS">FIG. 14</figref>, if the user indicates that the recognition was correct, the recognized input can be rendered in the textbox, whereas if the user indicates that the recognition was incorrect, the recognized input would be discarded. However, in the multi-modal scenario, it is also desirable to allow the user to ignore answering the displayed or otherwise rendered confirmation question, and proceed to another textbox or operation with respect to the form provided on the client device. Thus, it is desirable to allow the control algorithm to stop execution of the portion of the control algorithm with respect to the textbox selected if the user does not respond to the confirmation response. Depending on the author of the application, the author may choose to ignore the input speech provided to the textbox, or accept it with the intent of reconfirming its accuracy at a later time.

0231In many applications, it is common to include a “submit” button <b>532</b> when the user believes that he/she has entered all required information. As indicated above, the user may not have chosen to confirm that a particular value was properly recognized for a given textbox; however, upon activation of the submit button <b>532</b> the author of the application may at that time force confirmation of the previously ignored confirmation prompt, or choose to accept the recognized input as correct and return the form to the server for processing.

0232Another improvement for the multi-modal scenario allows the user to change the value for the textbox either through voice recognition or through standard graphical user interface methods such as with a keyboard, a handwriting recognition, etc. Using voice recognition, the control algorithm initially receives input speech and ascertains a recognized input for the input speech. This recognized input is retained by the control algorithm in memory, for example in the corresponding SemanticItem discussed above along with status information such as whether or not the recognized input has been confirmed. At sometime prior to submission of the page to the web server, the recognized input is associated with the primary control. However, in the multi-modal scenario, the user also has the option of entering the value through a graphical user interface rather than using voice recognition. If the user chooses to input a value using a graphical user interface, the value entered by the user is also replicated in the corresponding SemanticItem where the status information, for example, can be considered as confirmed because the user manually entered the assumed correct value. The SemanticItems and the status information is exposed through suitable methods to allow the author when writing the application to update these values if the user of the client device chooses to use a graphical user interface to input values. Likewise, if the user has provided input speech for a particular entry which was recognized and displayed back to the user, using the graphical user interface, the user can correct the value rather than using the confirmation control. Again, by exposing the SemanticItems and status information maintained by the control algorithm, the control algorithm and status information can be maintained in correspondence.

0233Exposing the SemanticItems and the status information, also allows the application author to reset selected portions of the dialog information as desired during execution. For instance, a reset button can be provided for the each portion of the dialog separately based on the collections <b>500</b>, <b>502</b>, <b>504</b> and <b>506</b>. These buttons are indicated at <b>550</b>, <b>552</b>, <b>554</b> and <b>556</b>, respectively. If the user, activates any of the buttons <b>550</b>, <b>552</b>, <b>554</b> or <b>556</b>, the control algorithm can ascertain which collection has been identified for resetting using a simple function (in a manner similar to that discussed above with respect to identifying textboxes) and then remove the corresponding values in the associated SemanticItems for that collection and/or change the status information to signify that new data is required. Although in <figref idref="DRAWINGS">FIG. 14</figref> use of the reset buttons <b>550</b>, <b>552</b>, <b>554</b> and <b>556</b> may appear simplistic, it should be noted the embodiment illustrated is merely exemplary, and that the concept can be applied to more complex data entry forms where resetting would involve more textboxes or complexity.

0234In the multi-modal scenario where the user has the ability to select a textbox for entry of data, typically the user will know initially what the form is asking for due to the fact that there is a visual prompt associated with the textbox. For example, it is clear in <figref idref="DRAWINGS">FIG. 14</figref> that textbox <b>536</b> is for the “Departure City”. Thus, although the control algorithm is running the dialogue associated with the textbox in the multi-modal scenario, there is probably no need to ask the initial prompt in the collection <b>500</b>, as would be necessary in the voice-only scenario, since the user probably is provided with a visual prompt. However, it is also desirable that the page be renderable in either a multi-modal scenario or a voice-only scenario. Therefore, the control algorithm can maintain in memory status information as to whether or not the user is operating in a multi-modal scenario, or whether the page is being rendered in a voice-only scenario such as through voice browser <b>216</b>. In one embodiment, information can be easily ascertained by the client device upon receipt of the form to determine the appropriate mode of entry. For example, if the client device is a voice browser <b>216</b>, the mode of entry needs to be operation of the control algorithm in a voice-only mode. The voice-only mode is particularly suitable for focusing as described above. However, if the client device is a multi-modal device such as a PDA, then the mode of entry can be optionally defaulted to a preselected mode of entry as well as be changed such as through activation of a button <b>540</b>.

0235Being able to switch the mode of entry for a page rendered on the client device can be very advantageous. For instance, if the user is entering data in a multi-modal scenario by selecting textboxes and providing voice or speech input which is recognized and displayed in the corresponding textboxes, the user may want to switch to a voice-only mode of entry, for instance, if the user needs to perform another activity which prevents him/her from selecting textboxes for entry such a case when the user may be driving. Button <b>540</b> or other suitable indicating device allows the mode of entry to be changed. If the user has been operating in a multi-modal for of entry, the control algorithm can then begin processing the page, for example, at the beginning and execute the remaining dialog with voice prompts until the form is completed. Switching to the situation using voice prompts for questions and confirmations (although the system would otherwise display the results) would be another form in which focusing may be desired. If, on the other hand, the user has been operating in voice-only operation, upon activation of a button on the display or other form of user input such as a keyword spoken by the user, or merely selecting a textbox, the control algorithm can then switch to a multi-modal for of entry allowing the user to navigate through the page as desired. In such a case, the stack or other memory mechanism retaining focussing information can then be reset since the user will be generally identifying textboxes to which spoken input will be directed. It should be noted that switching from a voice-only mode to a multi-modal mode, or vice-versa, can be for the whole page as described above, or for just a portion of the dialog associated with one or more textboxes or other required input.

0236As indicated above, for a multi-modal form, the control algorithm can automatically determine that the initial prompt associated with any textbox not be played in view of the fact that a visual prompt is probably already associated with the textbox selected by the user. However, if upon selection, the user does not provide any voice input, the client device can then play the initial prompt. However, depending upon the application, there may be other audible prompts that should be played depending upon, for example, entry of incorrect information. For instance, if the user has entered a credit card number of insufficient length, the control algorithm operating in the multi-modal operation, would then play or otherwise render a prompt stating that the credit card number was of insufficient length and should contain a given amount of digits. Thus, although the initial prompt may not be played in a multi-modal scenario, other prompts associated with the dialog for the selected textbox may need to be rendered. Flexibility is provided for the application author to enable the subsequent prompts to be rendered audibly, visually or both audibly and visually, as desired and depending on the capabilities of the device.

0237From the foregoing, a method and system are provided for generating mark-up for client side devices for speech-enabled applications including telephony applications that further provides focussing. The same set of controls can be used in three different forms of interaction including Voice-only, Tap-and-talk (multi-modal) and Hands-free (multi-modal). In Voice-only dialogs are provided on a GUI-less browser such as for telephony applications. This kind of application is driven by a dialog-flow manager that runs on the client (RunSpeech). In Tap-and-talk multi-modal dialogs contain a usable GUI without speech output. System prompts are generally not provided and the interaction is managed by the user's click events on the GUI. In Hands-free multi-modal, dialogs use a GUI display and speech input and output. The dialog may be authored for Tap-and-talk, but may still use the RunSpeech algorithm, or other speech controls features, to enable system driven voice prompting, while confirmation is provided visually or aurally, depending on the active mode of input at the time of confirmation. Switching between multi-modal/hands-free and voice-only is done by detecting the type of client the controls are talking to. Generally, Hands-free is switched on on-demand.

0238Although the present invention has been described with reference to preferred embodiments, workers skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the invention.

Appendix A

00001 QA Speech Control

0239The QA control adds speech functionality to the primary control to which it is attached. Its object model is an abstraction of the content model of the exemplary tags in Appendix A.

02401.1 QA Control <tables id="TABLE-US-00011" num="11"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“...”</entry></row><row><entry /><entry>controlsToSpeechEnable=“...”</entry></row><row><entry /><entry>speechIndex=“...”</entry></row><row><entry /><entry>ClientTest=“...”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Question ...></entry></row><row><entry /><entry><Statement ...></entry></row><row><entry /><entry>...</entry></row><row><entry /><entry><Answer ...></entry></row><row><entry /><entry><Confirm ...></entry></row><row><entry /><entry>...</entry></row><row><entry /><entry><Command ...></entry></row><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 1.1.1 Core Properties <br /> String ControlsToSpeechEnable

0241ControlsToSpeechEnable specifies the list of IDs of the primary controls to speech enable. IDs are comma delimited.

00001.1.2 Activation Mechanisms

0000Int SpeechIndex

0242SpeechIndex specifies the ordering information of the QA control—this is used by RunSpeech. Note: If more than one QA control has the same SpeechIndex, RunSpeech will execute them in source order. In situations where some QA controls have SpeechIndex specified and some QA controls do not, RunSpeech will order the QA controls first by SpeechIndex, then by source order.

0000String ClientTest

0243ClientTest specifies a client-side script function which returns a boolean value to determine when the QA control is considered available for selection by the RunSpeech algorithm. The system strategy can therefore be changed by using this as a condition to activate or de-activate QA controls more sensitively than SpeechIndex. If not specified, the QA control is considered available for activation.

00001.1.3 Questions, Statements, Answers, Confirms and Commands

0000Question[ ] Questions

0244QA control contains an array of question objects or controls, defined by the dialog author. Each question control will typically relate to a function of the system, eg asking for a value, etc. Each question control may specify an activation function using the ClientTest attribute, so an active QA control may ask different kinds of questions about its primary control under different circumstances. For example, the activation condition for main question Q_Main may be that the corresponding primary control has no value, and the activation condition for a Q_GiveHelp may be that the user has just requested help. Each Question may specify answer controlss from within the QA control which are activated when the question control is outputted.

0000Statement[ ] Statement

0245QA control contains an array of statement objects or controls. Statements are used to provide information to the listener, such as welcome prompts.

0000Answer[ ] Answers

0246QA control contains an array of answer objects or controls. An answer control is activated directly by a question control within the QA control, or by a StartEvent from the Primary control. Where multiple answers are used, they will typically reflect answers to the system functions, e.g. A_Main might provide a value in response to Q_Main, and A_Confirm might providing a yes/no+correction to Confirm.

0000Confirm[ ] Confirm

0247QA control may contain a confirm object or control. This object is a mechanism provided to the dialog authors which simplify the authoring of common confirmation subdialogs.

0000Command[ ] Command

0248A Command array holds a set of command controls. Command controls can be thought of as answer controls without question controls, whose behavior on recognition can be scoped down the control tree.

00001.2 Question Control

0249The question control is used for the speech output relating to a given primary control. It contains a set of prompts for presenting information or asking a question, and a list of ids of the answer controls, which may provide an answer to that question. If multiple answer controls are specified, these grammars are loaded in parallel when the question is activated. An exception will be thrown if no answer control is specified in the question control. <tables id="TABLE-US-00012" num="12"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Question</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“...”</entry></row><row><entry /><entry>ClientTest=“...”</entry></row><row><entry /><entry>Answers=“...”</entry></row><row><entry /><entry>Count=“...”</entry></row><row><entry /><entry>initialTimeout=“...”</entry></row><row><entry /><entry>babbleTimeout=“...”</entry></row><row><entry /><entry>maxTimeout=“...”</entry></row><row><entry /><entry>Modal=“...”</entry></row><row><entry /><entry>PromptFunction=“...”</entry></row><row><entry /><entry>OnClientNoReco=“...” ></entry></row><row><entry /><entry><prompt ... /></entry></row><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> String ClientTest

0250ClientTest specifies the client-side script function returning a boolean value which determines under which circumstances a question control is considered active within its QA control (the QA control itself must be active for the question to be evaluated). For a given QA control, the first question control with a true condition is selected for output. For example, the function may be used to determine whether to output a question which asks for a value (“Which city do you want?”) or which attempts to confirm it (“Did you say London?”). If not specified, the question condition is considered true.

0000Prompt[ ] Prompts

0251The prompt array specifies a list of prompt objects, discussed below. Prompts are also able to specify conditions of selection (via client functions), and during RunSpeech execution only the first prompt with a true condition is selected for playback.

0000String Answers

0252Answers is an array of references by ID to controls that are possible answers to the question. The behavior is to activate the grammar from each valid answer control in response to the prompt asked by the question control.

0000Integer initialTimeOut

0253The time in milliseconds between start of recognition and the detection of speech. This value is passed to the recognition platform, and if exceeded, an on Silence event will be thrown from the recognition platform. If not specified, the speech platform will use a default value.

0000Integer babbleTimeout

0254The period of time in milliseconds in which the recognition server or other recognizer must return a result after detection of speech. For recos in “tap-and-talk” scenarios this applies to the period between speech detection and the recognition result becoming available. For recos in dictation scenarios, this timeout applies to the period between speech detection and each recognition return—i.e. the period is restarted after each return of results or other event. If exceeded, the on ClientNoReco event is thrown but different status codes are possible. If there has been any kind of recognition platform error that is detectable and the babbleTimeout period has elapsed, then an on ClientNoReco is thrown but with a status code −3. Otherwise if the recognizer is still processing audio—e.g. in the case of an exceptionally long utterance or if the user has kept the pen down for an excessive amount of time—the onClientNoReco event is thrown, with status code −15. If babbleTimeout is not specified, the speech platform will default to an internal value.

0000Integer maxTimeout

0255The period of time in milliseconds between recognition start and results returned to the client device browser. If exceeded, the on MaxTimeout event is thrown by the browser—this caters for network or recognizer failure in distributed environments. For recos in dictation scenarios, as with babbleTimeout, the period is restarted after the return of each recognition or other event. Note that the maxTimeout attribute should be greater than or equal to the sum of initialTimeout and babbleTimeout. If not specified, the value will be a browser default.

0000Bool Modal

0256When modal is set to true, no answers except the immediate set of answers to the question are activated (i.e. no scoped Answers are considered). The defaults is false. For Example, this attribute allows the application developer to force the user of the client device to answer a particular question.

0000String PromptFunction(prompt)

0257PromptFunction specifies a client-side function that will be called once the question has been selected but before the prompt is played. This gives a chance to the application developer to perform last minute modifications to the prompt that may be required. PromptFunction takes the ID of the target prompt as a required parameter.

0000String OnClientNoReco

0258OnClientNoReco specifies the name of the client-side function to call when the NoReco (mumble) event is received.

00001.2.1 Prompt Object

0259The prompt object contains information on how to play prompts. All the properties defined are read/write properties. <tables id="TABLE-US-00013" num="13"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><prompt</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“...”</entry></row><row><entry /><entry>count=“...”</entry></row><row><entry /><entry>ClientTest=“...”</entry></row><row><entry /><entry>source=“...”</entry></row><row><entry /><entry>bargeIn=“...”</entry></row><row><entry /><entry>onClientBargein=“...”</entry></row><row><entry /><entry>onClientComplete=“...”</entry></row><row><entry /><entry>onClientBookmark=“...” ></entry></row><row><entry /><entry>. . . text/markup of the prompt . . .</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></prompt></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Int Count

0260Count specifies an integer which is used for prompt selection. When the value of the count specified on a prompt matches the value of the count of its question control, the prompt is selected for playback. Legal values are 0-100. <tables id="TABLE-US-00014" num="14"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Question id=Q_Ask”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt count=″1″> Hello </prompt></entry></row><row><entry /><entry><prompt count=″2″> Hello again </prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0261In the example, when Q_Ask.count is equal to 1, the first prompt is played, and if it is equal to 2 (i.e. the question has already been output before), the second prompt is then played.

0000String ClientTest

0262ClientTest specifies the client-side script function returning a boolean value which determines under which circumstances a prompt within an active question control will be selected for output. For a given question control, the first prompt with a true condition is selected. For example, the function may be used to implement prompt tapering, eg (“Which city would you like to depart from?” for a function returning true if the user if a first-timer, or “Which city?” for an old hand). If not specified, the prompt's condition is considered true.

0000String InlinePrompt

0263The prompt property contains the text of the prompt to play. This is defined as the content of the prompt element. It may contain further markup, as in TTS rendering information, or <value> elements. As with all parts of the page, it may also be specified as script code within <script> tags, for dynamic rendering of prompt output.

0000String Source

0264Source specifies the URL from which to retrieve the text of the prompt to play. If an inline prompt is specified, this property is ignored.

0000Bool BargeIn

0265BargeIn is used to specify whether or not barge-in (wherein the user of the client device begins speaking when a prompt is being played) is allowed on the prompt. The defaults is true.

0000String onClientBargein

0266onClientBargein specifies the client-side script function which is invoked by the bargein event.

0000String onClientComplete

0267onClientComplete specifies the client-side script function which is invoked when the playing of the prompt has competed.

0000String OnClientBookmark

0268OnClientBookmark accesses the name of the client-side function to call when a bookmark is encountered.

00001.2.2 Prompt Selection

0269On execution by RunSpeech, a QA control selects its prompt in the following way: <ul id="ul0014" list-style="none"><li id="ul0014-0001" num="0270"> ClientTest and the count attribute of each prompt are evaluated in order. The first prompt with both ClientTest and count true is played. A missing count is considered true. A missing ClientTest is considered true. <br /> 1.3 Statement Control </li></ul>

0271Statement controls are used for information-giving system output when the activation of grammars is not required. This is common in voice-only dialogs. Statements are played only once per page if the playOnce attribute is true. <tables id="TABLE-US-00015" num="15"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Statement</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“...”</entry></row><row><entry /><entry>playOnce=“...”</entry></row><row><entry /><entry>ClientTest=“...”</entry></row><row><entry /><entry>PromptFunction=“...” ></entry></row><row><entry /><entry><prompt ... /></entry></row><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></Statement ></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Bool playOnce

0272The playOnce attribute specifies whether or not a statement control may be activated more than once per page. playOnce is a Boolean attribute with a default (if not specified) of TRUE, i.e., the statement control is executed only once. For example, the playOnce attribute may be used on statement controls whose purpose is to output email messages to the end user. Setting playOnce=“False” will provide dialog authors with the capability to enable a “repeat” functionality on a page that reads email messages.

0000String ClientTest

0273ClientTest specifies the client-side script function returning a boolean value which determines under which circumstances a statement control will be selected for output. RunSpeech will activate the first Statement with ClientTest equal to true. If not specified, the ClientTest condition is considered true.

0000String PromptFunction

0274PromptFunction specifies a client-side function that will be called once the statement control has been selected but before the prompt is played. This gives a chance to the authors to do last minute modifications to the prompt that may be required.

0000Prompt[ ] Prompt

0275The prompt array specifies a list of prompt objects. Prompts are also able to specify conditions of selection (via client functions), and during RunSpeech execution only the first prompt with a true condition is selected for playback. <tables id="TABLE-US-00016" num="16"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_Welcome”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“Label1”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Statement id=“WelcomePrompt” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt bargeIn=“False”> Welcome </prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Statement></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 1.4 Confirm Control

0276Confirm controls are special types of question controls. They may hold all the properties and objects of other questions controls, but they are activated differently. The RunSpeech algorithm will check the confidence score found in the confirmThreshold of the answer control of the ControlsToSpeechEnable. If it is too low, the confirm control is activated. If the confidence score of the answer control is below the confirmThreshold, then the binding is done but the on ClientReco method is not called. The dialog author may specify more than one confirm control per QA control. RunSpeech will determine which confirm control to activate based on the function specified by ClientTest. <tables id="TABLE-US-00017" num="17"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Answer ConfirmThreshold=... /></entry></row><row><entry /><entry><Confirm></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>...all attributes and objects of Question...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Confirm></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 1.5 Answer Control

0277The answer control is used to specify speech input resources and features. It contains a set of grammars related to the primary control. Note that an answer may be used independently of a question, in multimodal applications without prompts, for example, or in telephony applications where user initiative may be enabled by extra-answers. Answer controls are activated directly by question controls, by a triggering event, or by virtue of explicit scope. An exception will be thrown if no grammar object is specified in the answer control. <tables id="TABLE-US-00018" num="18"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Answer</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“...”</entry></row><row><entry /><entry>scope=“...”</entry></row><row><entry /><entry>StartEvent=“...”</entry></row><row><entry /><entry>StopEvent=“...”</entry></row><row><entry /><entry>ClientTest=“...”</entry></row><row><entry /><entry>onClientReco=“...”</entry></row><row><entry /><entry>onClientDTMF=“...”</entry></row><row><entry /><entry>autobind=“...”</entry></row><row><entry /><entry>server=“...”</entry></row><row><entry /><entry>ConfirmThreshold=“...”</entry></row><row><entry /><entry>RejectThreshold=“...” ></entry></row><row><entry /><entry><grammar ... /></entry></row><row><entry /><entry><grammar ... /></entry></row><row><entry /><entry>...</entry></row><row><entry /><entry><dtmf ... /></entry></row><row><entry /><entry><dtmf ... /></entry></row><row><entry /><entry>...</entry></row><row><entry /><entry><bind ... /></entry></row><row><entry /><entry><bind ... /></entry></row><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> String Scope

0278Scope holds the id of any named element on the page. Scope is used in answer control for scoping the availability of user initiative (mixed task initiative: i.e. service jump digressions) grammars. If scope is specified in an answer control, then it will be activated whenever a QA control corresponding to a primary control within the subtree of the contextual control is activated.

0000String StartEvent

0279StartEvent specifies the name of the event from the primary control that will activate the answer control (start the Reco object). This will be typically used in multi-modal applications, eg on MouseDown, for tap-and-talk.

0000String StopEvent

0280StopEvent specifies the name of the event from the primary control that will de-activate the answer control (stop the Reco object). This will be typically used in multi-modal applications, eg on MouseUp, for tap-and-talk.

0000String ClientTest

0281ClientTest specifies the client-side script function returning a boolean value which determines under which circumstances an answer control otherwise selected by scope or by a question control will be considered active. For example, the test could be used during confirmation for a ‘correction’ answer control to disable itself when activated by a question control, but mixed initiative is not desired (leaving only accept/deny answers controls active). Or a scoped answer control which permits a service jump can determine more flexible means of activation by specifying a test which is true or false depending on another part of the dialog. If not specified, the answer control's condition is considered true.

0000Grammar[ ] Grammars

0282Grammars accesses a list of grammar objects.

0000DTMF[ ] DTMFs

0283DTMFs holds an array of DTMF objects.

0000Bind[ ] Binds

0284Binds holds a list of the bind objects necessary to map the answer control grammar results (dtmf or spoken) into control values. All binds specified for an answer will be executed when the relevant output is recognized. If no bind is specified, the SML output returned by recognition will be bound to the control specified in the ControlsToSpeechEnable of the QA control.

0000String OnClientReco

0285OnClientReco specifies the name of the client-side function to call when spoken recognition results become available.

0000String OnClientDTMF

0286OnClientDTMF holds the name of the client-side function to call when DTMF recognition results become available.

0000Boolean autobind

0287The value of autobind determines whether or not the system default bindings are implemented for a recognition return from the answer control. If unspecified, the default is true. Setting autobind to false is an instruction to the system not to perform the automatic binding.

0000String Server

0288The server attribute is an optional attribute specifying the URI of the speech server to perform the recognition. This attribute over-rides the URI of the global speech server attribute.

0000Integer ConfirmThreshold

0289Holds a value representing the confidence level below which a confirm control question will be automatically triggered immediately after an answer is recognized within the QA control. Legal values are 0-100.

0290Note that where bind statements and on ClientReco scripts are both specified, the semantics of the resulting Tags are that binds are implemented before the script specified in on ClientReco.

0000Integer RejectThreshold

0291RejectThreshold specifies the minimum confidence score to consider returning a recognized utterance. If overall confidence is below this level, a NoReco event will be thrown. Legal values are 0-100.

00001.5.1 Grammar

0292The grammar object contains information on the selection and content of grammars, and the means for processing recognition results. All the properties defined are read/write properties. <tables id="TABLE-US-00019" num="19"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>ClientTest=“...”</entry></row><row><entry /><entry>Source=“...”</entry></row><row><entry /><entry>></entry></row><row><entry /><entry>...grammar rules...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammar></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> String ClientTest

0293The ClientTest property references a client-side boolean function which determines under which conditions a grammar is active. If multiple grammars are specified within an answer control (e.g. to implement a system/mixed initiative strategy, or to reduce the perplexity of possible answers when the dialog is going badly), only the first grammar with a true ClientTest function will be selected for activation during RunSpeech execution. If this property is unspecified, true is assumed.

0000String Source

0294Source accesses the URI of the grammar to load, if specified.

0000String InlineGrammar

0295InlineGrammar accesses the text of the grammar if specified inline. If that property is not empty, the Source attribute is ignored.

00001.5.2 Bind

0296The object model for bind follows closely its counterpart client side tags. Binds may be specified both for spoken grammar and for DTMF recognition returns in a single answer control. <tables id="TABLE-US-00020" num="20"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><bind</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>Value=“...”</entry></row><row><entry /><entry>TargetElement=“...”</entry></row><row><entry /><entry>TargetAttribute=“...”</entry></row><row><entry /><entry>Test=“...”</entry></row><row><entry /><entry>/></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> String Value

0297Value specifies the text that will be bound into the target element. It is specified as an XPath on the SML output from recognition.

0000String TargetElement

0298TargetElement specifies the id of the primary control to which the bind statement applies. If not specified, this is assumed to be the ControlsToSpeechEnable of the relevant QA control.

0000String TargetAttribute

0299TargetAttribute specifies the attribute on the TargetElement control in which bind the value. If not specified, this is assumed to be the Text property of the target element.

0000String Test

0300The Test attribute specifies a condition which must evaluate to true on the binding mechanism. This is specified as an XML Pattern on the SML output from recognition.

00001.5.2.1 Automatic Binding

0301The default behavior on the recognition return to a speech-enabled primary control is to bind certain properties into that primary control. This is useful for the dialog controls to examine the recognition results from the primary controls across turns (and even pages). Answer controls will perform the following actions upon receiving recognition results: <ul id="ul0015" list-style="none"><li id="ul0015-0001" num="0000"><ul id="ul0016" list-style="none"><li id="ul0016-0001" num="0302"> 1. bind the SML output tree into the SML attribute of the primary control </li><li id="ul0016-0002" num="0303"> 2. bind the text of the utterance into the SpokenText attribute of the primary control </li><li id="ul0016-0003" num="0304"> 3. bind the confidence score returned by the recognizer into the Confidence attribute of the primary control. </li></ul></li></ul>

0305Unless autobind=“False” attribute is specified on an answer control, the answer control will perform the following actions on the primary control: <ul id="ul0017" list-style="none"><li id="ul0017-0001" num="0000"><ul id="ul0018" list-style="none"><li id="ul0018-0001" num="0306"> 1. bind the SML output tree into the SML attribute; </li><li id="ul0018-0002" num="0307"> 2. bind the text of the utterance into the SpokenText attribute; </li><li id="ul0018-0003" num="0308"> 3. bind the confidence score returned by the recognizer into the Confidence attribute; </li></ul></li></ul>

0309Any values already held in the attribute will be overwritten. Automatic binding occurs before any author-specified bind commands, and hence before any on ClientReco script (which may also bind to these properties).

1.5.3 DTMF

0310DTMF may be used by answer controls in telephony applications. The DTMF object essentially applies a different modality of grammar (a keypad input grammar rather than a speech input grammar) to the same answer. The DTMF content model closely matches that of the client side output Tags DTMF element. Binding mechanisms for DTMF returns are specified using the targetAttribute attribute of DTMF object. <tables id="TABLE-US-00021" num="21"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><DTMF</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>firstTimeOut=“...”</entry></row><row><entry /><entry>interDigitTimeOut=“...”</entry></row><row><entry /><entry>numDigits=“...”</entry></row><row><entry /><entry>flush=“...”</entry></row><row><entry /><entry>escape=“...”</entry></row><row><entry /><entry>targetAttribute=“...”</entry></row><row><entry /><entry>ClientTest=“...”></entry></row><row><entry /><entry><dtmfGrammar ...></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></DTMF></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Integer firstTimeOut

0311The number of milliseconds to wait between activation and the first key press before raising a timeout event.

0000Integer interDigitTimeOut

0312The number of milliseconds to wait between key presses before raising a timeout event.

0000Int numDigits

0313The maximum number of key inputs permitted during DTMF recognition.

0000Bool Flush

0314A flag which states whether or not to flush the telephony server's DTMF buffer before recognition begins. Setting flush to false permits DTMF key input to be stored between recognition/page calls, which permits the user to ‘type-ahead’.

0000String Escape

0315Holds the string value of the key which will be used to end DTMF recognition (eg ‘#’).

0000String targetAttribute

0316TargetAttribute specifies the property on the primary control in which to bind the value. If not specified, this is assumed to be the Text property of the primary control.

0000String ClientTest

0317The ClientTest property references a client-side boolean function which determines under which conditions a DTMF grammar is active. If multiple grammars are specified within a DTMF object, only the first grammar with a true ClientTest function will be selected for activation during RunSpeech execution. If this property is unspecified, true is assumed.

00001.5.4 DTMFGrammar

0318DTMFGrammar maps a key to an output value associated with the key. The following sample shows how to map the “1” and “2” keys to text output values. <tables id="TABLE-US-00022" num="22"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><dtmfgrammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><key value=“1”>Seattle</key></entry></row><row><entry /><entry><key value=“2”>Boston</key></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></dtmfgrammar></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 1.6 Command Control

0319The command control is a special variation of answer control which can be defined in any QA control. Command controls are forms of user input which are not answers to the question at hand (eg, Help, Repeat, Cancel), and which do not need to bind recognition results into primary controls. If the QA control specifies an activation scope, the command grammar is active for every QA control within that scope. Hence a command does not need to be activated directly by a question control or an event, and its grammars are activated in parallel independently of answer controls building process. Command controls of the same type at QA controls lower in scope can override superior commands with context-sensitive behavior (and even different/extended grammars if necessary). <tables id="TABLE-US-00023" num="23"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Command</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“...”</entry></row><row><entry /><entry>scope=“...”</entry></row><row><entry /><entry>type=“...”</entry></row><row><entry /><entry>RejectThreshold=“...”</entry></row><row><entry /><entry>onClientReco=“...” ></entry></row><row><entry /><entry><Grammar ...></entry></row><row><entry /><entry><dtmf ... ></entry></row><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></Command></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> String Scope

0320Scope holds the id of a primary control. Scope is used in command controls for scoping the availability of the command grammars. If scope is specified for a command control, the command's grammars will be activated whenever a QA control corresponding to a primary control within the subtree of the contextual control is activated.

0000String Type

0321Type specifies the type of command (eg ‘help’, ‘cancel’ etc.) in order to allow the overriding of identically typed commands at lower levels of the scope tree. Any string value is possible in this attribute, so it is up to the author to ensure that types are used correctly.

0000Integer RejectThreshold

0322RejectThreshold specifies the minimum confidence level of recognition that is necessary to trigger the command in recognition (this is likely to be used when higher than usual confidence is required, eg before executing the result of a ‘Cancel’ command). Legal values are 0-100.

0000String onClientReco

0323on Command specifies the client-side script function to execute on recognition of the command control's grammar.

0000Grammar Grammar

0324The grammar object which will listen for the command.

DTMF DTMF

0325The dtmf object which will activate the command.

00002 Types of Initiatives and Dialog Flows

0326Using the control described above, various forms of initiatives can be developed, some examples are provided below:

00002.1 Mixed initiative Dialogs

0327Mixed initiative dialogs provide the capability of accepting input for multiple controls with the asking of a single question. For example, the answer to the question “what are your travel plans” may provide values for an origin city textbox control, a destination city textbox control and a calendar control (“Fly from Puyallup to Yakima on September 30^th”).

0328A robust way to encode mixed initiative dialogs is to handwrite the mixed initiative grammar and relevant binding statements, and apply these to a single control.

0329The following example shows a single page used for a simple mixed initiative voice interaction about travel. The first QA control specifies the mixed initiative grammar and binding, and a relevant prompt asking for two items. The second and third QA controls are not mixed initiative, and so bind directly to their respective primary control by default (so no bind statements are required). The RunSpeech algorithm will select the QA controls based on an attribure “SpeechIndex” and whether or not their primary controls hold valid values. <tables id="TABLE-US-00024" num="24"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry><%@ Page language=″c#″ AutoEventWireup=″false″</entry></row><row><entry>inherits=″SDN.Page″ %></entry></row><row><entry><%@ Register tagPrefix=″SDN″ Namespace=″SDN″ Assembly=″SDN″</entry></row><row><entry>%></entry></row><row><entry><html></entry></row><row><entry><body></entry></row><row><entry><Form id=″WebForm1″ method=post runat=″server″></entry></row><row><entry><ASP:Label id=″Label1″ runat=″server″>Departure</entry></row><row><entry>city</ASP:Label></entry></row><row><entry><ASP:TextBox id=″TextBox1″ runat=″server″ /></entry></row><row><entry><br></entry></row><row><entry><ASP:Label id=″Label2″ runat=″server″>Arrival</entry></row><row><entry>city</ASP:Label></entry></row><row><entry><ASP:TextBox id=″TextBox2″ textchanged=″TextChanged″</entry></row><row><entry>runat=″server″ /></entry></row><row><entry><!-speech information --></entry></row><row><entry><Speech:QA id=”QAmixed” controlsToSpeechEnable=”TextBox1”</entry></row><row><entry>speechIndex=”1” runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><Question id=”Q1” Answers=”A1”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt>”Please say the cities you want to fly</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>from and to”</prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer id=”A1” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=”...”/></entry></row><row><entry /><entry><bind targetElement=”TextBox1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>value=”/sml/path1”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><bind targetElement=”TextBox2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>value=”/sml/path2”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry></Speech:QA></entry></row><row><entry><Speech:QA id=”QA1” controlsToSpeechEnable=”TextBox1”</entry></row><row><entry>speechIndex=”2” runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><Question id=”Q1” Answers=”A1”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt>”What's the departure city?”</prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer id=”A1”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=”...”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry></Speech:QA></entry></row><row><entry><Speech:QA id=”QA2” controlsToSpeechEnable=”TextBox2”</entry></row><row><entry>speechIndex=”3” runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><Question id=”Q1” Answer=”A1”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><prompt>”What's the arrival city”</prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer id=”A1” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=”...”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry></Speech:QA></entry></row><row><entry></Form></entry></row><row><entry></body></entry></row><row><entry></html></entry></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 2.2 Complex Mixed Initiative

0330Application developers can specify several answer to the same question control with different levels of initiatives. Conditions are specified that will select one of the answers when the question is asked, depending on the initiative settings that they require. An example is provided below: <tables id="TABLE-US-00025" num="25"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_Panel2”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“Panel2”</entry></row><row><entry /><entry>runat=“server” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="56PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry><Question</entry><entry>answers=“systemInitiative,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>mixedInitiative” .../></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="42PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer</entry><entry>id=“systemInitiative”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>ClientTest=“systemInitiativeCond”</entry></row><row><entry /><entry>onClientReco=“SimpleUpdate” ></entry></row><row><entry /><entry><grammar src=“systemInitiative.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="42PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer</entry><entry>id=“mixedInitiative”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>ClientTest=“mixedInitiativeCond”</entry></row><row><entry /><entry>onClientReco=“MixedUpdate” ></entry></row><row><entry /><entry><grammar src=“mixedInitiative.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0331Application developers can also specify several question controls in a QA control. Some question controls can allow a mixed initiative style of answer, whilst others are more directed. By authoring conditions on these question controls, application developer can select between the questions depending on the dialogue situation.

0332In the following example the mixed initiative question asks the value of the two textboxes at the same time (e.g., ‘what are your travel plans?’) and calls the mixed initiative answer (e.g., ‘from London to Seattle’). If this fails, then the value of each textbox is asked separately (e.g., ‘where do you leave from’ and ‘where are you going to’) but, depending on the conditions, the mixed-initiative grammar may still be activated, thus allowing users to provide both values. <tables id="TABLE-US-00026" num="26"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_Panel2”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“TextBox1, TextBox2”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Question</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>ClientTest=“AllEmpty( )”</entry></row><row><entry /><entry>answers=“AnsAll”</entry></row><row><entry /><entry>.../></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Question</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>ClientTest=“TextBox1IsEmpty( )”</entry></row><row><entry /><entry>answers=“AnsAll, AnsTextBox1” .../></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Question</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>ClientTest=“TextBox2IsEmpty( )”</entry></row><row><entry /><entry>answers=“AnsAll, AnsTextBox2” .../></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“AnsTextBox1”</entry></row><row><entry /><entry>onClientReco=“SimpleUpdate”></entry></row><row><entry /><entry><grammar src=“AnsTextBox1.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row><row><entry /><entry><Answer</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“AnsTextBox2”</entry></row><row><entry /><entry>onClientReco=“SimpleUpdate” ></entry></row><row><entry /><entry><grammar src=“ AnsTextBox2.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row><row><entry /><entry><Answer</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“AnsAll”</entry></row><row><entry /><entry>ClientTest=“IsMixedInitAllowed( )”</entry></row><row><entry /><entry>onClientReco=“MixedUpdate”</entry></row><row><entry /><entry>></entry></row><row><entry /><entry><grammar src=“AnsAll.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 2.3 User Initiative

0333Similar to the command control, a standard QA control can specify a scope for the activation of its grammars. Like a command control, this QA control will activate the grammar from a relevant answer control whenever another QA control is activated within the scope of this context. Note that its question control will only be asked if the QA control itself is activated. <tables id="TABLE-US-00027" num="27"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_Panel2”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“Panel2”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Question ... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="56PT" align="left" /><colspec colname="2" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer</entry><entry>id=“AnswerPanel2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="91PT" align="left" /><colspec colname="1" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry>scope=“Panel2”</entry></row><row><entry /><entry>onClientReco=“UpdatePanel2( )” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=“Panel2.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0334This is useful for dialogs which allow ‘service jumping’—user responses about some part of the dialog which is not directly related to the question control at hand.

00002.4 Short Time-Out Confirms

0335Application developers can write a confirmation as usual but set a short time-out. In the timeout handler, code is provided to that accept the current value as exact. <tables id="TABLE-US-00028" num="28"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_Panel2”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“Panel2”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Confirm timeOut=“20”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>onClientTimeOut=“AcceptConfirmation”... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="56PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry><Answer</entry><entry>id=“CorrectPanel2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="98PT" align="left" /><colspec colname="1" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry>onClientReco=“UpdatePanel2( )” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=“Panel2.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 2.5 Dynamic Prompt Building and Editing

0336The promptFunction script is called after a question control is selected but before a prompt is chosen and played. This lets application developers build or modify the prompt at the last minute. In the example below, this is used to change the prompt depending on the level of experience of the users. <tables id="TABLE-US-00029" num="29"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><script language=javascript></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>function GetPrompt( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>if(experiencedUser == true)</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>Prompt1.Text = “What service do you</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>want?”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>else</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>Prompt1.Text = “Please choose between</entry></row><row><entry /><entry>e-mail,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="112PT" align="left" /><colspec colname="1" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>calendar and news”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>return;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>id=”QA_Panel2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>ControlsToSpeechEnable=”Panel2”</entry></row><row><entry /><entry>runat=”server” ></entry></row><row><entry /><entry><Question PromptFunction=”GetPrompt”... ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=”Prompt1” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Question></entry></row><row><entry /><entry><Answer ... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 2.6 Using Semantic Relationships

0337Recognition and use of semantic relationships can be done by studying the result of the recognizer inside the on Reco event handler. <tables id="TABLE-US-00030" num="30"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><script language=“javascript”></entry></row><row><entry /><entry>function Reco( ) {</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>/*</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0338Application developers can access the SML returned by the recogniser or recognition server. If a semantic relationship (like sport-news) is identified, the confidence of the individual elements can be increased or take any other appropriate action. <tables id="TABLE-US-00031" num="31"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>*/</entry></row><row><entry /><entry>}</entry></row><row><entry /><entry></script></entry></row><row><entry /><entry><Speech:QA</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>id=“QA_Panel2”</entry></row><row><entry /><entry>ControlsToSpeechEnable=“Panel2”</entry></row><row><entry /><entry>runat=“server” ></entry></row><row><entry /><entry><Question ... /></entry></row><row><entry /><entry><Answer onClientReco=“Reco” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=“Panel2.gram” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 3 Implementation and Application of RunSpeech

0339A mechanism is needed to provide voice-only clients with the information necessary to properly render speech-enabled pages. Such a mechanism must provide the execution of dialog logic and maintain state of user prompting and grammar activation as specified by the application developer.

0340Such a mechanism is not needed for multimodal clients. In the multimodal case, the page containing speech-enabled controls is visible to the user of the client device. The user of the client device may provide speech input into any visible speech-enabled control in any desired order using the a multimodal paradigm.

0341The mechanism used by voice-only clients to render speech-enabled pages is the RunSpeech script or algorithm. The RunSpeech script relies upon the SpeechIndex attribute of the QA control and the SpeechGroup control discussed below.

00003.1 SpeechControl

0342During run time, the system parses a control script or webpage having the server controls and creates a tree structure of server controls. Normally the root of the tree is the Page control. If the control script uses custom or user control, the children tree of this custom or user control is expanded. Every node in the tree has an ID and it is easy to have name conflict in the tree when it expands. To deal with possible name conflict, the system includes a concept of NamingContainer. Any node in the tree can implement NamingContainer and its children lives within that name space.

0343The QA controls can appear anywhere in the server control tree. In order to easily deal with SpeechIndex and manage client side rendering, a SpeechGroup control is provided. The Speechgroup control is hidden from application developer.

0344One SpeechGroup control is created and logically attached to every NamingContainer node that contain QA controls in its children tree. QA and SpeechGroup controls are considered members of its direct NamingContainer's SpeechGroup. The top level SpeechGroup control is attached to the Page object. This membership logically constructs a tree—a logical speech tree—of QA controls and SpeechGroup controls.

0345For simple speech-enabled pages or script (i.e., pages that do not contain other NamingContainers), only the root SpeechGroup control is generated and placed in the page's server control tree before the page is sent to the voice-only client. The SpeechGroup control maintains information regarding the number and rendering order of QA controls on the page.

0346For pages containing a combination of QA control(s) and NamingContainer(s), multiple SpeechGroup controls are generated: one SpeechGroup control for the page (as described above) and a SpeechGroup control for each NamingContainer. For a page containing NamingContainers, the page-level SpeechGroup control maintains QA control information as described above as well as number and rendering order of composite controls. The SpeechGroup control associated with each NamingContainer maintains the number and rendering order of QAs within each composite.

0347The main job of the SpeechGroup control is to maintain the list of QA controls and SpeechGroups on each page and/or the list of QA controls comprising a composite control. When the client side markup script (e.g. HTML) is generated, each SpeechGroup writes out a QACollection object on the client side. A QACollection has a list of QA controls and QACollections. This corresponds to the logical server side speech tree. The RunSpeech script will query the page-level QACollection object for the next QA control to invoke during voice-only dialog processing.

0348The page level SpeechGroup control located on each page is also responsible for: <ul id="ul0019" list-style="none"><li id="ul0019-0001" num="0000"><ul id="ul0020" list-style="none"><li id="ul0020-0001" num="0349"> Determining that the requesting client is a voice-only client; and </li><li id="ul0020-0002" num="0350"> Generating common script and supporting structures for all QA controls on each page. </li></ul></li></ul>

0351When the first SpeechGroup control renders, it queries the System.Web.UI.Page.Request.Browser property for the browser string. This property is then passed to the RenderSpeechHTML and RenderSpeechScript methods for each QA control on the page. The QA control will then render for the appropriate client (multimodal or voice-only).

00003.2 Creation of SpeechGroup Controls

0352During server-side page loading, the on Load event is sent to each control on the page. The page-level SpeechGroup control is created by the first QA control receiving the on Load event. The creation of SpeechGroup controls is done in the following manner: (assume a page containing composite controls).

0353Every QA control will receive on Load event from run time code. onLoad for a QA: <ul id="ul0021" list-style="none"><li id="ul0021-0001" num="0000"><ul id="ul0022" list-style="none"><li id="ul0022-0001" num="0354"> Get the QA's NamingContainer N1 </li><li id="ul0022-0002" num="0355"> Search for SpeechGroup in the N1's children <ul id="ul0023" list-style="none"><li id="ul0023-0001" num="0356"> If already exists, register QA control with this SpeechGroup. onLoad returns. </li><li id="ul0023-0002" num="0357"> If not found: <ul id="ul0024" list-style="none"><li id="ul0024-0001" num="0358"> Create a new SpeechGroup G1, inserts it into the N1's children </li><li id="ul0024-0002" num="0359"> If N1 is not Page, find N1's NamingContainer N2 </li><li id="ul0024-0003" num="0360"> Search for SpeechGroup in N2's children, if exists, say G2, add G1 to G2. If not, create a new one G2, inserts in to N2's children </li><li id="ul0024-0004" num="0361"> Recursion until the NamingContainer is the Page (top level) </li></ul></li></ul></li></ul></li></ul>

0362During server-side page rendering, the Render event is sent to the speech-enabled page. When the page-level SpeechGroup control receives the Render event, it generates client side script to include RunSpeech.js and inserts it into the page that is eventually sent to the client device. It also calls all its direct children to render speech related HTML and scripts. If a child is SpeechGroup, the child in turn calls its children again. In this manner, the server rendering happens along the server side logical speech tree.

0363When a SpeechGroup renders, it lets its children (which can be either QA or SpeechGroup) render speech HTML and scripts in the order of their SpeechIndex. But a SpeechGroup is hidden and doesn't naturally have a SpeechIndex. In fact, a SpeechGroup will have the same SpeechIndex as its NamingContainer, the one it attaches to. The NamingContainer is usually a UserControl or other visible control, and an author can set SpeechIndex to it.

00003.3 RunSpeech

0364The purpose of RunSpeech is to permit dialog flow via logic which is specified in script or logic on the client. In one embodiment, RunSpeech is specified in an external script file, and loaded by a single line generated by the server-side rendering of the SpeechGroup control, e.g.: <tables id="TABLE-US-00032" num="32"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><script language=“javascript”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“/scripts/RunSpeech.js” /></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0365The RunSpeech.js script file should expose a means for validating on the client that the script has loaded correctly and has the right version id, etc. The actual validation script will be automatically generated by the page class as inline functions that are executed after the attempt to load the file.

0366Linking to an external script is functionally equivalent to specifying it inline, yet it is both more efficient, since browsers are able to cache the file, and cleaner, since the page is not cluttered with generic functions.

00003.4 Events

00003.4.1 Event Wiring

0367Tap-and-talk multimodality can be enabled by coordinating the activation of grammars with the on MouseDown event. The wiring script to do this will be generated by the Page based on the relationship between controls (as specified in the ControlsToSpeechEnable property of the QA control in).

0368For example, given an asp:TextBox and its companion QA control adding a grammar, the <input> and <reco> elements are output by each control's Render method. The wiring mechanism to add the grammar activation command is performed by client-side script generated by the Page, which changes the attribute of the primary control to add the activation command before any existing handler for the activation event: <tables id="TABLE-US-00033" num="33"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><!-- Control output --></entry></row><row><entry /><entry><input id=”TextBox1” type=”text” .../></entry></row><row><entry /><entry><reco id=”Reco1” ... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><grammar src=”...” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></reco></entry></row><row><entry /><entry><!-- Page output --></entry></row><row><entry /><entry><script></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>TextBox1.onMouseDown =</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>“Reco1.Start( );”+TextBox1.onMouseDown;</entry></row><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0369By default, hook up is via onmousedown and onmouseup events, but both StartEvent and StopEvent can be set by web page author.

0370The textbox output remains independent of this modification and the event is processed as normal if other handlers were present.

00003.4.2 Page Class Properties

0371The Page also contains the following properties which are available to the script at runtime: <ul id="ul0025" list-style="none"><li id="ul0025-0001" num="0372"> SML—a name/value pair for the ID of the control and it's associated SML returned by recognition. </li><li id="ul0025-0002" num="0373"> SpokenText—a name/value pair for the ID of the control and it's associated recognized utterance </li><li id="ul0025-0003" num="0374"> Confidence—a name/value pair for the ID of the control and it's associated confidence returned by the recognizer. <br /> 4 RunSpeech Algorithm </li></ul>

0375The RunSpeech algorithm is used to drive dialog flow on the client device. This may involve system prompting and dialog management (typically for voice-only dialogs), and/or processing of speech input (voice-only and multimodal dialogs). It is specified as a script file referenced by URI from every relevant speech-enabled page (equivalent to inline embedded script).

0376Rendering of the page for voice only browsers is done in the following manner: <ul id="ul0026" list-style="none"><li id="ul0026-0001" num="0377"> The RunSpeech module or function works as follows </li><li id="ul0026-0002" num="0378"> (RunSpeech is called in response to document.onreadystate becoming “complete”): <ul id="ul0027" list-style="none"><li id="ul0027-0001" num="0379"> (1) Find the first active QA control in speech index order (determining whether a QA control is active is explained below). </li><li id="ul0027-0002" num="0380"> (2) If there is no active QA control, submit the page. </li><li id="ul0027-0003" num="0381"> (3) Otherwise, run the QA control. </li></ul></li></ul>

0382A QA control is considered active if and only if: <ul id="ul0028" list-style="none"><li id="ul0028-0001" num="0000"><ul id="ul0029" list-style="none"><li id="ul0029-0001" num="0383"> (1) The QA control's ClientTest either is not present or returns true, AND </li><li id="ul0029-0002" num="0384"> (2) The QA control contains an active question control or statement control (tested in source order), AND </li><li id="ul0029-0003" num="0385"> (3) Either: <ul id="ul0030" list-style="none"><li id="ul0030-0001" num="0386"> a. The QA control contains only statement controls, OR </li><li id="ul0030-0002" num="0387"> b. At least one of the controls referenced by the QA control's ControlsToSpeechEnable has an empty or default value. </li></ul></li></ul></li></ul>

0388A question control is considered active if and only if: <ul id="ul0031" list-style="none"><li id="ul0031-0001" num="0000"><ul id="ul0032" list-style="none"><li id="ul0032-0001" num="0389"> (1) The question control's ClientTest either is not present or returns true, AND </li><li id="ul0032-0002" num="0390"> (2) The question control contains an active prompt object. </li></ul></li></ul>

0391A prompt object is considered active if and only if: <ul id="ul0033" list-style="none"><li id="ul0033-0001" num="0000"><ul id="ul0034" list-style="none"><li id="ul0034-0001" num="0392"> (1) The prompt object's ClientTest either is not present or returns true, AND </li><li id="ul0034-0002" num="0393"> (2) The prompt object's Count is either not present, or is less than or equal to the Count of the parent question control. </li></ul></li></ul>

0394A QA control is run as follows: <ul id="ul0035" list-style="none"><li id="ul0035-0001" num="0000"><ul id="ul0036" list-style="none"><li id="ul0036-0001" num="0395"> (1) Determine which question control or statement control is active and increment its Count. </li><li id="ul0036-0002" num="0396"> (2) If a statement control is active, play the prompt and exit. </li><li id="ul0036-0003" num="0397"> (3) If a question control is active, play the prompt and start the Recos for each active answer control and command control. </li></ul></li></ul>

0398An answer control is considered active if and only if: <ul id="ul0037" list-style="none"><li id="ul0037-0001" num="0000"><ul id="ul0038" list-style="none"><li id="ul0038-0001" num="0399"> (1) The answer control's ClientTest either is not present or returns true, AND </li><li id="ul0038-0002" num="0400"> (2) Either: <ul id="ul0039" list-style="none"><li id="ul0039-0001" num="0401"> a. The answer control was referenced in the active question contol's Answers string, OR </li><li id="ul0039-0002" num="0402"> b. The answer control is in Scope </li></ul></li></ul></li></ul>

0403A command control is considered active if and only if: <ul id="ul0040" list-style="none"><li id="ul0040-0001" num="0000"><ul id="ul0041" list-style="none"><li id="ul0041-0001" num="0404"> (1) It is in Scope, AND </li><li id="ul0041-0002" num="0405"> (2) There is not another command control of the same Type lower in the scope tree. </li></ul></li></ul>

0406RunSpeech relies on events to continue driving the dialog—as described so far it would stop after running a single QA control. Event handlers are included for Prompt.OnComplete, Reco.OnReco, Reco.OnSilence, Reco.OnMaxTimeout, and Reco.OnNoReco. Each of these will be described in turn.

0407RunSpeechOnComplete works as follows: <ul id="ul0042" list-style="none"><li id="ul0042-0001" num="0000"><ul id="ul0043" list-style="none"><li id="ul0043-0001" num="0408"> (1) If the active Prompt object has an OnClientComplete function specified, it is called. </li><li id="ul0043-0002" num="0409"> (2) If the active Prompt object was contained within a statement control, or a question control which had no active answer controls, RunSpeech is called. </li></ul></li></ul>

0410RunSpeechOnReco works as follows: <ul id="ul0044" list-style="none"><li id="ul0044-0001" num="0000"><ul id="ul0045" list-style="none"><li id="ul0045-0001" num="0411"> (1) Some default binding happens—the SML tree is bound to the SML attribute and the text is bound to the SpokenText attribute of each control in ControlsToSpeechEnable. </li><li id="ul0045-0002" num="0412"> (2) If the confidence value of the recognition result is below the ConfidenceThreshold of the active answer control, the Confirmation logic is run. </li><li id="ul0045-0003" num="0413"> (3) Otherwise, if the active answer control has on OnClientReco function specified, it is called, and then RunSpeech is called. </li></ul></li></ul>

0414RunSpeechOnReco is responsible for creating and setting the SML, SpokenText and Confidence properties of the ControlsToSpeechEnable. The SML, SpokenText and Confidence properties are then available to scripts at runtime.

0415RunSpeechOnSilence, RunSpeechOnMaxTimeout, and RunSpeechOnNoReco all work the same way: <ul id="ul0046" list-style="none"><li id="ul0046-0001" num="0000"><ul id="ul0047" list-style="none"><li id="ul0047-0001" num="0416"> (1) The appropriate OnClientXXX function is called, if specified. </li><li id="ul0047-0002" num="0417"> (2) RunSpeech is called. </li></ul></li></ul>

0418Finally, the Confirmation logic works as follows: <ul id="ul0048" list-style="none"><li id="ul0048-0001" num="0000"><ul id="ul0049" list-style="none"><li id="ul0049-0001" num="0419"> (1) If the parent QA control of the active answer control contains any confirm controls, the first active confirm control is found (the activation of a confirm control is determined in exactly the same way as the activation of a question control). </li><li id="ul0049-0002" num="0420"> (2) If no active confirm control is found, RunSpeech is called. </li><li id="ul0049-0003" num="0421"> (3) Else, the QA control is run, with the selected confirm control as the active question control. </li></ul></li></ul>

0422For multi-modal browsers, only the grammar loading and event dispatching steps are carried out.

Appendix B

00001 Design Principles

0423In this embodiment, there is no concept of primary control to speech-enable as it existed in Appendix A. The speech layer provides input to the visual layer as well as explicit support for dialog flow management. The semantic layer implements the logic needed for confirmation and validation. In a multimodal interaction, the semantic layer does not need to be used as confirmation and validation are visual and implemented using standard ASP.NET constructs. If desired though, the sematic layer can be updated with value changes made through visual or GUI interfaces in order that confirmation and validation can be still implemented.

0424<figref idref="DRAWINGS">FIG. 12</figref> illustrates the speech controls inheritance diagram.

00002 Authoring Scenarios

0425The following provides examples of various forms of application scenarios.

04262.1 Multimodal App, Tap-and-Talk <tables id="TABLE-US-00034" num="34"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:Answer SemanticItem=“siText” ID=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="98PT" align="left" /><colspec colname="2" colwidth="77PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value”</entry><entry>runat=“server”></entry></row><row><entry /><entry></speech:Answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row><row><entry /><entry><Reco StartEvent=“textbox1.onmousedown”</entry></row><row><entry /><entry>StopEvent=“textbox1.onmouseup” ID=“reco1”</entry></row><row><entry /><entry>Mode=“Single”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:Grammar</entry></row><row><entry /><entry>Src=“http://mysite/mygrammar.grxml”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="70PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry>ID=“Grammar1”</entry><entry>runat =“server”></entry></row><row><entry /><entry></speech:Grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04272.2 Multimodal App, Click-and-Wait-for-Recognition <tables id="TABLE-US-00035" num="35"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” StartEvent=“textbox1.onmousedown”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“htp://mysite/mygrammar.grxml”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>rnat=“server”></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value” SemanticItem=“siText”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04282.3 Multimodal App, Do-Field <tables id="TABLE-US-00036" num="36"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>StartEvent=“dofieldButton.onmousedown”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>StopEvent=“dofieldButton.onmouseup”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>mode=“multiple”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/mylargegrammar.xml” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value1” SemanticItem=“siOne”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row><row><entry /><entry><speech:answer id=“answer2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value2” SemanticItem=“siTwo”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row><row><entry /><entry>speech:answer id=“answer3”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value3” SemanticItem=“siThree”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row><row><entry /><entry></speech:answer></entry></row><row><entry /><entry><speech:answer id=“answer4”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value4” SemanticItem=“siFour”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row><row><entry /><entry><speech:answer id=“answer5”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/value5” SemanticItem=“siFive”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04292.4 Voice Only App, Statement <tables id="TABLE-US-00037" num="37"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“welcome” PlayOnce=“true” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt InLineprompt=“Hello there!”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04302.5 Voice Only App, Simple Question <tables id="TABLE-US-00038" num="38"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/citygrammar.grxml”</entry></row><row><entry /><entry>runat=“server”></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Prompt InLinePrompt=“Which city do you want to fly</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>to?”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/city” SemanticItem=“siCity”</entry></row><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04312.6 Voice Only App, Question With Mixed-Initiative (Optional Answers) <tables id="TABLE-US-00039" num="39"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/cityANDstate.xml”</entry></row><row><entry /><entry>runat=“server”></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Prompt InLinePrompt=“Which city do you want to fly</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>to?”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/city” SemanticItem = “siCity”</entry></row><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row><row><entry /><entry><ExtraAnswers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/state” SemanticItem = “siState”</entry></row><row><entry /><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></ExtraAnswers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04322.7 Voice Only App, Explicit Confirmation <tables id="TABLE-US-00040" num="40"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/citygrammar.xml” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Prompt InLinePrompt=“Which city do you want to fly</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>to?”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/city” SemanticItem=“siCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="112PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry>confirmThreshold=“0.75”</entry><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry><speech:QA id=“qa2” runat=“server”</entry></row><row><entry /><entry>xpathAcceptConfirms=“/sml/accept”</entry></row><row><entry /><entry>xpathDenyConfirms=“/sml/deny”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt InLinePrompt=“Did you say</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><SALT:value>textbox1.value</SALT:value>”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/yes_no_city.xml”</entry></row><row><entry /><entry>runat=“server”></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer2”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/city” SemanticItem=“siCity”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="112PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry>confirmThreshold=“0.75”</entry><entry>runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04332.8 Voice Only App, Short Time-Out Confirmation <tables id="TABLE-US-00041" num="41"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”</entry></row><row><entry /><entry>xpathAcceptConfirms=“/sml/accept”</entry></row><row><entry /><entry>xpathDenyConfirms=“/sml/deny”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>firstInitialTimeout=“500”></entry></row><row><entry /><entry><Prompt InLinePrompt=“Did you say</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry><SALT:value>textbox1.value</SALT:value>”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” InitialTimeout=“350”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/yes_no_city.grxml”</entry></row><row><entry /><entry>runat=“server”></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer XpathTrigger=“/sml/city”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItem=“siCity” confirmThreshold=“0.75”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></entry></row><row><entry /><entry></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04342.9 Voice Only App, Commands <tables id="TABLE-US-00042" num="42"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=“prompt1” InLinePrompt=“Where do you want</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>to fly to?”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/city.grxml”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/city” SemanticItem=“siCity”</entry></row><row><entry /><entry>runat=“server”></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry><speech:Command id=“command1” type=“cancel” scope=“qa1”</entry></row><row><entry /><entry>OnClientCommand=“myCommand”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></speech:Command></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><script></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>function myCommand( )</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="28PT" align="left" /><colspec colname="2" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry><entry> CallControl.Hangup( ); }</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04352.10 Voice Only App, Prompt Selection <tables id="TABLE-US-00043" num="43"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=″qa1″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″prompt1″ InLinePrompt=″Where do you want</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>to fly to?″></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=″reco1″ mode=″automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=″http://mysite/city.grxml″</entry></row><row><entry /><entry>runat=″server″></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″answer1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=″/sml/city″ SemanticItem=″siCity″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry><speech:Command id=″command1″ type=″cancel″ scope=″qa1″</entry></row><row><entry /><entry>OnClientCommand=″myCommand″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:Command></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><script></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>function myCommand( )</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="28PT" align="left" /><colspec colname="2" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry><entry>CallControl.Hangup( ); }</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></script></entry></row><row><entry /><entry><speech:qa id=″qa1″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″prompt1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>PromptSelectFunction=″promptSelection″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=″reco1″ mode=″automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar src=″http://mysite/city.xml″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″answer1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=″/sml/city″ SemanticItem=″siCity″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:qa></entry></row><row><entry /><entry><script></entry></row><row><entry /><entry>function promptSelection (lastCommandOrException, count,</entry></row><row><entry /><entry>answerArray)</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>if (lastCommandOrException == “Silence”)</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>return “Sorry, I couldn't hear you. Please speak</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>louder. Where do you want to fly to?”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>else if (count>3)</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>return “Communication problems are preventing me</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>from hearing the arrival city. Please try again later.”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>return “Where do you want to fly to?”; //Default</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>prompt</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04362.11 Voice Only App, Implicit Confirmation <tables id="TABLE-US-00044" num="44"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:qa id=″qa1″ runat=″server″</entry></row><row><entry /><entry>xpathDenyConfirms=″/sml/deny″</entry></row><row><entry /><entry>xpathAcceptConfirms=″/sml/accept″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″prompt1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>PromptSelectFunction=″promptSelection″></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=″reco1″ mode=″automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=″http://mysite/yes_no_city.xml″</entry></row><row><entry /><entry>runat=″server″></speech:grammar></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″answer1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=″/sml/date″ SemItem=″siDate″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row><row><entry /><entry><Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″confirm1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=″/sml/city″ SemItem=″siCity″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:qa></entry></row><row><entry /><entry><script></entry></row><row><entry /><entry>function promptSelection (lastCommandOrException, count,</entry></row><row><entry /><entry>SemanticItemList)</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>var myPrompt = “”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>if (SemanticItemList[“siCity”].value != null)</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>myPrompt = “Flying from “ +</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItemList[“siCity”].value + “. ”;</entry></row><row><entry /><entry>myPrompt += “On what date?”;</entry></row><row><entry /><entry>}</entry></row><row><entry /><entry>else</entry></row><row><entry /><entry>{ myPrompt = “On what date?”;</entry></row><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>return myPrompt;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04372.12 Voice Only App, QA With Reco and dtmf <tables id="TABLE-US-00045" num="45"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:qa id=“qa1” runat=“server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=“prompt1” InLinePrompt=“Press or say one if</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="112PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry>you accept the charges, two</entry><entry>if you</entry></row><row><entry /><entry>don't.”></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=“reco1” mode=“automatic”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“http://mysite/acceptCharges.xml”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></speech:grammar></entry></row><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Dtmf smlContext=“sml/accept”></Dtmf></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=“answer1”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=“/sml/accept”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItem=“siAccept”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=“server”></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:qa></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

04382.13 Voice-Only App, Record-Only QA <tables id="TABLE-US-00046" num="46"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:qa id=″qa1″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″a1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=″/SML/@recordlocation″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItem = “foo”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″></speech:answer></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row><row><entry /><entry><Reco id=″recordonly″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><record beep=″true″></record></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:qa></FORM></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 3 Design Details <br /> 3.1 QA Activation (Voice-Only)

0439QA are tested for activeness in SpeechIndex order (see run-time behavior). <ul id="ul0050" list-style="none"><li id="ul0050-0001" num="0440"> A QA is active when clientActivationFunction returns true AND </li><li id="ul0050-0002" num="0441"> If the Answers array is non empty, the SemanticItems pointed to by the set of Answers are empty OR </li><li id="ul0050-0003" num="0442"> If the answers array is empty, at least one item in the Confirm array does need confirmation. </li></ul>

0443A QA can have only Answers (normal question: Where do you want to go?), only Confirms (explicit confirmation: Did you say Boston? or short time-out confirmation: Boston.), both (implicit confirmation: When do you want to fly to Boston?) or none (statement: Welcome to my application!).

0444A QA can have extra answers even if it has no answers (e.g., mixed initiative).

00003.2 Answer, Confirm.

0445Upon recognition, commands are processed first, followed by Answers, ExtraAnswers and Confirms.

0446A target element (e.g. textbox1.value) can be in one of these states: empty, invalid, needsConfirmation, confirmed. A target is empty before any recognition result is associated with this item, or if the item has been cleared. A target is in needsConfirmation state when a recognition result has been associated with it, but the confidence level is below the confirmationThreshold for this item. And a target is confirmed when either a recognition result has been associated with it with a confidence level high enough or a confirmation loop set it to this state explicitly.

0447Answers are therefore responsible for setting the value in the target element and the confidence level (this is done in a semantic layer). Confirms are responsible for confirming the item, clearing it or setting it to a new value (with a new confidence level).

00003.3 Command Execution (and Scope)

0448Commands specify a scope and are active for all QA's within that scope. The default processing of a command is to set the current QA's lastCommandException to the command's type. If the command specifies a Grammar, this grammar is activated in parallel with any grammars in the current Reco object. QAs can be modal (allowCommands=false), in which case, no commands will be processed for that particular QA.

00003.4 Validators

0449A CompareValidator will be active when the value of the SemanticItemToValidate it refers to has not been validated by this validator. If SemanticItemToCompare is specified (rather than ValueToCompare), then the CompareValidator will only be active if the value of the SemanticItemToCompare is non-empty (i.e. if it has been assigned a value by a previous QA).

0450A CustomValidator will be active when the value of the SemanticItemToValidate it refers to has not been validated by this validator.

00004 Run Time Behavior

00004.1 Client Detection

0451The speech controls do pay attention to the variety of client that they are rendering for. If the client doesn't support SALT, the controls won't render any speech-related tags or script. Client detection is done by checking the browser capabilities and detecting whether it's a voice-only client (browser is Quadrant), or multimodal (IE, PocketIE, etc, with SALT support).

0452Hands-free is not a mode in the client, but rather an application-specific modality, and therefore the only support required is SALT (as in multimodal). Hands-free operation is therefore switched-on by application logic.

00004.2 Multimodal

0453Support for multimodal applications is built in the speech controls. In multimodal operations commands, dtmf, confirm, prompts, etc do not make sense from an interaction point of view, so they won't be rendered. Tap-and-talk (or any other type of interaction, like click-and-wait-for-recognition) is enabled by hooking up the calls to start and stop recognition with GUI events using the Reco object attributes startElement/startEvent and stopElement/stopEvent, plus the Reco object mode attribute.

0454During render time, the speech controls are passed information specifying whether the client is a voice-only client or multmodal client. If the client is multimodal, the rendering process hooks the call to start recognition to the GUI event specified by the StartEvent attribute of the Reco object. The rendering process also hooks the call to stop recognition to the GUI event specified by the StopEvent attribute of the Reco object.

0455The multimodal client needs a mechanism which will invoke author-specified functions to handle speech-related events (e.g., timeouts) or recognition processing. This mechanism is the Multimodal.js script. Multimodal.js is specified in an external script file and loaded by a single line generated by server-side rendering, e.g., <tables id="TABLE-US-00047" num="47"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><script language=’“javascript”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>src=“/scripts/Multimodal.js” /></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0456This method mirrors the ASP.NET way of generating ‘system’ client-side script loaded via URI. Linking to an external script is functionally equivalent to specifying it inline, yet is more efficient since clients are able to cache the file, and cleaner, since the page is not clutered with generic functions.

00004.3 Voice-Only

00004.3.1 Runtime Script (RunSpeech)

0457Unlike in a multimodal interaction, where the user initiates all speech input by clicking/selecting visual elements in the GUI, a mechanism is needed to provide voice-only clients with the information necessary to properly render speech-enabled ASP.NET pages. Such a mechanism must guarantee the execution of dialog logic and maintain state of user prompting and grammar activation as specified by the author.

0458The mechanism used by the Speech Controls is a client-side script (RunSpeech.js) that relies upon the SpeechIndex attribute of the QA control, plus the flow control mechanisms built in the framework (ClientActivationFunction, default activation rules, etc.). RunSpeech is loaded via URI similar to the loading mechanism of Multimodal.js as described above.

00004.3.2 SpeechIndex

0459SpeechIndex is an absolute ordering index within a naming container.

0460If more than one speech control has the same SpeechIndex, they are activated in source order. In situations where some controls have SpeechIndex specified and some controls do not, those with SpeechIndex will be activated first, then the rest in source order.

0461NOTE: Speech index is automatically set to 0 for new controls. Dialog designers should leave room in their numbering scheme to insert new QA's later. Begin with a midrange integer and increment by 100, for example. For example number QA's 1000, 1100, 1200 instead of 1, 2, 3. this leaves room for a large number of QA's at any point the dialog and plenty of room to add QA's at the beginning.

00004.3.3 ClientActivationFunction

0462clientActivationFunction specifies a client-side script function which returns a boolean value to determine when this control is considered available for selection by the run-time control selection algorithm. If not specified, it defaults to true (control is active).

0463The system strategy can therefore be changed by using this as a condition to activate or de-activate QAs more sensitively than SpeechIndex. If not specified, the QA is considered available for activation.

00004.3.4 Count

0464Count is a property of the QA control that indicates how many times that control has been activated consecutively. This Count property will be reset if the previously active QA is different that the current QA (same applies for Validators), otherwise, it is incremented by one. The Count property is exposed to application developers through the PromptSectionFunction of the Prompt object.

0000Controls Reference

0000General Authoring Notes

00001. Script References Are Not Validated at Render Time.

0465The Speech Controls and objects described in this section contain attributes whose values are references to script functions written by the dialog author. These functions are executed on client devices in response to speech-related events (e.g. expiration of timeout) or as run time processing (e.g. modification of prompt text prior to playback). Render time validation is not performed on script references, i.e., no checks for existence of script functions is done during rendering of controls. If an attribute contains a reference to a client-side script function and the function does not exist, client-side exceptions will be thrown.

0466In voice-only mode, script functions generating exceptions during runtime will cause a redirection to the error page defined in the Web.config file. If no error page is defined, RunSpeech will continue to execute without reporting the exception.

00002. All Speech Controls Should be Contained Within ASP.NET <form> Tag or Equivalant.

0467The Speech Control described in this section must all be placed in ASP.NET web pages inside the <form> tag. Behavior of controls placed outside the <form> tag is undefined.

00003. Client-Side Script References Must Refer to Function and Not Include Parenthes.

0468Using the PromptSelectFunction as an example. the following is correct syntax: <ul id="ul0051" list-style="none"><li id="ul0051-0001" num="0469"> <Prompt id=“P1” PromptSelectFunction=“mySelectFunction”/>//using “mySelectFunction( )” is incorrect syntax <br /> 4. IE Requires Exact Cases When Running Jscript. </li></ul>

0470Therefore, the case for event values specified in the StartEvent and StopEvent attributes of the Prompt object must be exactly as those events are defined. This happens to be all lowercase letters for most standard IE events. For example, the onmouseup and onmousedown events must be specified in all lowercase letters.

00005. All Speech Controls Expose the Common Attribute id.

00006. Behavior of Visible and Enabled Properties of Speech Controls.

0471Setting the visible or enabled properies of Speech Controls to “False” will cause them not to render.

00007. Mimimum Client Requirements

0472In one embodiment, clients must be running IE6.0 or greater and JScript 5.5 or greater for speech controls and associated script functions to work properly.

00008. Rendering <smex> to Telserver

0473The speech controls automatically handle rendering <smex> tags to the telephony server on every page as is required by the server. In one embodiiment, smex tags are rendered whether the client is the tel server or the desktop client.

00005 Global Application Settings

0474Speech Controls provide mechanisms that allow dialog authors to specify values to control properties on an application or page basis.

00005.1 Application-Level Settings

00005.1.1 Application Global Variables

0475Dialog authors may use their application's Web.config file to set values of global variables for speech-enabled web applications. The values of the global variables persist throughout the entrie lifetime of the web application. ‘Errorpage’ is the only global variable that may be specified and is set for the application during render time. <tables id="TABLE-US-00048" num="48"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><appSettings></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><add key=“errorpage” value=“...” /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></appSettings></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0476The <appSettings> tag must be placed one level inside the <configuration> tag within the Web.config file.

0477The errorpage key specifies a URI to a default error page. Redirection to this error page will occur during run time when the speech platform or the DTMF engine returns an error. A default error page is included with the SDK; the user can also create a custom error page.

0478Note: Developers who create their own error page must call window.close at the bottom of the error page in the voice only case in order to release the call.

00005.1.2 Application-Level Setting of Common Control Properties

0479Dialog authors may use their application's Web.config file to set values of common control properties and have those values persist during the lifetime of the web application. For example, an author may wish use the Web.config file to set the maxTimeout value for Reco objects in their application. The properties are set in the Web.config file using the following syntax: <tables id="TABLE-US-00049" num="49"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><configuration></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><SpeechStyleSheet></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Style id=“style1” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><QA allowCommands=“false”></entry></row><row><entry /><entry>...</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt bargein=“false” ... /></entry></row><row><entry /><entry><Reco maxTimeout=“5000”... /></entry></row><row><entry /><entry><Dtmf preFlush=“true” ... /></entry></row><row><entry /><entry><Answers confirmThreshold=“0.80” ... /></entry></row><row><entry /><entry><ExtraAnswers confirmThreshold=“0.80”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>.../></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry><Confirms confirmThreshold=“0.80”... /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry></QA></entry></row><row><entry /><entry><Command .../></entry></row><row><entry /><entry><CustomValidator .../></entry></row><row><entry /><entry><CompareValidator .../></entry></row><row><entry /><entry><SemanticItem .../></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Style></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></SpeechStyleSheet></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></configuration></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0480The Reco corresponding Reco object would reference the “style1” Style: <ul id="ul0052" list-style="none"><li id="ul0052-0001" num="0481"> <Reco id=“reco1” . . . StyleReference=“style1” . . . /></li></ul>

0482If the Style id is “globalStyle,” the property values set in the Style apply application-wide to pertinent controls. So, in the above example, if id=“ ” (or the property is omitted from the Style tag), a maxTimeout of 5000 milliseconds will be used for all Reco objects in the application (uless overridden).

0483For a complete list of properties which are settable through the SpeechStyleSheet, see below.

00006 StyleSheet Control

0484The StyleSheet control allows dialog authors to set values to common control properties at a page-level scope. The StyleSheet control is a collection of Style objects. The Style object exposes properties of each control that are settable on a page-level basis. The StyleSheet control is rendered for both multimodal and voice-only modes. An exception will be thrown if the StyleSheet control contains an object which is not a Style object. <tables id="TABLE-US-00050" num="50"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class Stylesheet : SpeechControl</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>id{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="63PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry>StyleCollection</entry><entry>Styles{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 6.1 StyleSheet Properties <br /> Styles

0485Optional. Used in both multimodal and voice-only modes. The Styles property is a collection of Style objects used to set property values for Speech Controls and their objects. The property values last during the lifetime of the current page.

00007 Style Object

0486The Style object is used to set property values for Speech Controls and their objects. The property values last during the lifetime of the current page. <tables id="TABLE-US-00051" num="51"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class Style : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="70PT" align="left" /><colspec colname="3" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row><row><entry /><entry /><entry>QAStyle</entry><entry>QA{get; set;};</entry></row><row><entry /><entry /><entry>CommandStyle</entry><entry>Command{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><colspec colname="3" colwidth="98PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>CustomValidatorStyle</entry><entry>CustomValidator{get; set;};</entry></row><row><entry /><entry /><entry>CompareValidatorStyle</entry><entry>CompareValidator{get; set;};</entry></row><row><entry /><entry /><entry>SemanticItemStyle</entry><entry>SemanticItem{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 7.1 Style Properties <br /> id

0487Required. The programmatic name of the Style object.

0000StyleReference

0488Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the StyleSheet control will search for the named Style object and also set property values specified in the named Style. An exception is thrown for an invalid StyleReference.

0489For every property of a speech control with a StyleReference, the value is determined as follows: <ul id="ul0053" list-style="none"><li id="ul0053-0001" num="0000"><ul id="ul0054" list-style="none"><li id="ul0054-0001" num="0490"> 1. the value is set directly in the speech control </li><li id="ul0054-0002" num="0491"> 2. the style object directly referenced </li><li id="ul0054-0003" num="0492"> 3. any style referenced by a style </li><li id="ul0054-0004" num="0493"> 4. the global style object </li><li id="ul0054-0005" num="0494"> 5. the speech control default value. </li></ul></li></ul>

0495The following example sets shows two QA properties are set using StyleReference: <tables id="TABLE-US-00052" num="52"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:Stylesheet id=“SS”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:Style id=“base_style” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><QA OnClientActive=“myOnClientActive”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:Style></entry></row><row><entry /><entry><speech:Style id=“derived_style”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>StyleReference=“base_style”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><QA PlayOnce=“true”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:Style></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:Stylesheet></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> QA

0496Optional. The QA property of the Style object is used to set property values for all QA controls on a page that reference this Style. The following example shows how to set the AllowCommands and PlayOnce properties for the QA controls that reference this Style: <tables id="TABLE-US-00053" num="53"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:Stylesheet id=“SS1”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:Style id=“WelcomePageQA_Style” ></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry><QA AllowCommands=“false”</entry></row><row><entry /><entry>PlayOnce=“true”/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:Style></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:StyleSheet></entry></row><row><entry /><entry><QA id=“...”</entry></row><row><entry /><entry>StyleReference=“WelcomePageQA_Style” .../></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0497The next example shows how to set the bargein property of all Prompt objects on a given page using Params: <tables id="TABLE-US-00054" num="54"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:Stylesheet id=”SS2”></entry></row><row><entry /><entry><Style Name=″Style1″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry><QA></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry><Answers ConfirmThreshold=″0.8″</entry></row><row><entry /><entry>Reject=″0.4″/></entry></row><row><entry /><entry><Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><Params></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="77PT" align="left" /><colspec colname="1" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry><Param name=″BargeinType″</entry></row><row><entry /><entry>value=″grammar″/></entry></row><row><entry /><entry><Param name=″foo″ value=″bar″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry><Params></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry></QA></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry></Style></entry></row><row><entry /><entry></speech:StyleSheet></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Command

0498Optional. The Command property of the Style object is used to set property values for all Command controls on a page that reference this Style.

0000CustomValidator

0499Optional. The CustomValidator property of the Style object is used to set property values for all CustomValidator controls on a page that reference this Style.

0000CompareValidator

0500Optional. The CompareValidator property of the Style object is used to set property values for all CompareValidator controls on a page that reference this Style.

0000SemanticItem

0501Optional. The SemanticItem property of the Style object is used to set property values for all SemanticItem controls on a page the reference this Style.

0502The following properties may be set using the Style object.

0000QA Properties

0000<ul id="ul0055" list-style="none"><li id="ul0055-0001" num="0503"> AllowCommands </li><li id="ul0055-0002" num="0504"> PlayOnce </li><li id="ul0055-0003" num="0505"> XpathAcceptConfirms </li><li id="ul0055-0004" num="0506"> XpathDenyConfirms </li><li id="ul0055-0005" num="0507"> AcceptRejectThreshold </li><li id="ul0055-0006" num="0508"> DenyRejectThreshold </li><li id="ul0055-0007" num="0509"> FirstInitialTimeout </li><li id="ul0055-0008" num="0510"> ConfirmByOmission </li><li id="ul0055-0009" num="0511"> ConfirmIfEqual </li><li id="ul0055-0010" num="0512"> OnClientActive </li><li id="ul0055-0011" num="0513"> OnClientListening </li><li id="ul0055-0012" num="0514"> OnClientComplete. <br /> Prompt Properties </li></ul>

0515These apply to Prompts in QA, CompareValidator, CustomValidator and Command controls. <ul id="ul0056" list-style="none"><li id="ul0056-0001" num="0516"> Bargein </li><li id="ul0056-0002" num="0517"> OnClientBookmark </li><li id="ul0056-0003" num="0518"> OnClientError </li><li id="ul0056-0004" num="0519"> Prefetch </li><li id="ul0056-0005" num="0520"> Type </li><li id="ul0056-0006" num="0521"> Lang </li><li id="ul0056-0007" num="0522"> Params <br /> Reco Properties </li><li id="ul0056-0008" num="0523"> StartEvent </li><li id="ul0056-0009" num="0524"> StopEvent </li><li id="ul0056-0010" num="0525"> Mode </li><li id="ul0056-0011" num="0526"> InitialTimeout </li><li id="ul0056-0012" num="0527"> BabbleTimeout </li><li id="ul0056-0013" num="0528"> MaxTimeout </li><li id="ul0056-0014" num="0529"> EndSilence </li><li id="ul0056-0015" num="0530"> Reject </li><li id="ul0056-0016" num="0531"> OnClientSpeechDetected </li><li id="ul0056-0017" num="0532"> OnClientSilence </li><li id="ul0056-0018" num="0533"> OnClientNoReco </li><li id="ul0056-0019" num="0534"> OnClientError </li><li id="ul0056-0020" num="0535"> Lang </li><li id="ul0056-0021" num="0536"> Params <br /> Grammar Properties </li></ul>

0537These apply to both Reco and Dtmf grammars. <ul id="ul0057" list-style="none"><li id="ul0057-0001" num="0538"> Type </li><li id="ul0057-0002" num="0539"> Lang <br /> Dtmf Properties </li><li id="ul0057-0003" num="0540"> InitialTimeout </li><li id="ul0057-0004" num="0541"> InterDigitTimeout </li><li id="ul0057-0005" num="0542"> OnClientSilence </li><li id="ul0057-0006" num="0543"> OnClientKeyPress </li><li id="ul0057-0007" num="0544"> OnClientError </li><li id="ul0057-0008" num="0545"> Params <br /> Answer Properties </li></ul>

0546These apply to the Answers, ExtraAnswers and Confirms collections. <ul id="ul0058" list-style="none"><li id="ul0058-0001" num="0547"> ConfirmThreshold </li><li id="ul0058-0002" num="0548"> Reject <br /> Command Properties </li><li id="ul0058-0003" num="0549"> Scope </li><li id="ul0058-0004" num="0550"> AcceptCommandThreshold <br /> CompareValidator Properties </li><li id="ul0058-0005" num="0551"> ValidationEvent </li><li id="ul0058-0006" num="0552"> Operator </li><li id="ul0058-0007" num="0553"> Type </li><li id="ul0058-0008" num="0554"> InvalidateBoth <br /> CustomValidator Properties </li><li id="ul0058-0009" num="0555"> ValidationEvent <br /> SemanticItem Properties </li><li id="ul0058-0010" num="0556"> BindOnChange <br /> 8 QA Control </li></ul>

0557The QA control is responsible for querying the user with a prompt, starting a corresponding recognition object and processing recognition results.

0558The QA control is rendered for both multimodal and voice-only modes. <tables id="TABLE-US-00055" num="55"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class QA : IndexedStyleReferenceSpeechControl</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="49PT" align="left" /><colspec colname="3" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry /><entry>int</entry><entry>SpeechIndex{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>ClientActivationFunction{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientActive{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientComplete{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientListening{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>AllowCommands{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>PlayOnce{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>XpathAcceptConfirms{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>XpathDenyConfirms{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="77PT" align="left" /><colspec colname="3" colwidth="112PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>float</entry><entry>AcceptRejectThreshold{get; set;};</entry></row><row><entry /><entry /><entry>float</entry><entry>DenyRejectThreshold{get; set;};</entry></row><row><entry /><entry /><entry>float</entry><entry>FirstInitialTimeout{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="49PT" align="left" /><colspec colname="3" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>ConfirmByOmission{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>ConfirmIfEqual{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="77PT" align="left" /><colspec colname="3" colwidth="112PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>AnswerCollection</entry><entry>Answers{get;};</entry></row><row><entry /><entry /><entry>AnswerCollection</entry><entry>ExtraAnswers{get;};</entry></row><row><entry /><entry /><entry>AnswerCollection</entry><entry>Confirms{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="49PT" align="left" /><colspec colname="3" colwidth="140PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>Prompt</entry><entry>Prompt{get;};</entry></row><row><entry /><entry /><entry>Reco</entry><entry>Reco{get;};</entry></row><row><entry /><entry /><entry>Dtmf</entry><entry>Dtmf{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}.</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 8.1 QA Properties

0559All properties of the QA control are available to the application developer at design time.

0000SpeechIndex

0560Optional. Default is Zero, which is equivalent to no SpeechIndex. Only used in voice-only mode. Specifies the activation order of speech controls on a page and the activation order of composite controls. All controls with SpeechIndex>0 will be run and then controls with SpeechIndex=0 will be run in source order. If more than one control has the same SpeechIndex, they are activated in source order. In situations where some controls specify SpeechIndex and some controls do not, those with SpeechIndex specified will be activated first, then the rest in source order. SpeechIndex values start at 1. An exception will be thrown for non-valid values of SpeechIndex.

0000ClientActivationFunction

0561Optional. Only used in voice-only mode. Specifies a client-side script function which returns a Boolean value to determine when a QA control is considered available for selection by the run-time control selection algorithm. If not specified, it defaults to true (control is active). The signature for ClientActivationFunction is as follows: <ul id="ul0059" list-style="none"><li id="ul0059-0001" num="0000"><ul id="ul0060" list-style="none"><li id="ul0060-0001" num="0562"> bool ClientActivationFunction (object lastActiveObj, string lastCommandOrException, int count) <br /> where: </li></ul></li><li id="ul0059-0002" num="0563"> lastActiveobj is the last active control, e.g. QA, CustomValidator or CompareValidator. For the first activated QA on a page, lastActiveObj will be null. </li><li id="ul0059-0003" num="0564"> lastCommandOrException is a Command type (e.g., “Help”) or a Reco event (e.g., “Silence” or “NoReco”) of the last active control. For the first activated QA on a page or if the last active control is a validator, lastCommandOrException will be an empty string. </li><li id="ul0059-0004" num="0565"> count number of times the last active QA has been activated consecutively, 1 if this is the first acvtive QA on the page. Count starts at 1 and has no limit. However, for the first activated QA on a page, count will be set to zero. <br /> OnClientActive </li></ul>

0566Optional. Used in both multimodal and voice-only modes. Specifies a client-side script that will be called after RunSpeech determines this QA is active (voice-only mode) or after the startEvent is fired (in multimodal) and before processing the QA (e.g., playing a prompt or starting recognition). The on ClientActive function does not return values. The signature for on ClientActive is as follows: <ul id="ul0061" list-style="none"><li id="ul0061-0001" num="0567"> function onClientActive(string eventsource, string lastCommandOrException, int Count, object SemanticItemList) <br /> where: </li><li id="ul0061-0002" num="0568"> eventsource is the id of the object (specified by Reco.StartEvent) whose event started the Reco associated with the QA (for multimodal). eventsource will be null in voice-only mode. </li><li id="ul0061-0003" num="0569"> lastCommandOrException is a Command type (e.g., “Help”) or a Reco event (e.g., “Silence” or “NoReco”) for voice-only mode. lastCommandOrException is the empty string for multimodal. </li><li id="ul0061-0004" num="0570"> Count is the number of times the QA has been activated consecutively. Count starts at 1 and has no limit for voice-only mode. Count is zero for multimodal. </li><li id="ul0061-0005" num="0571"> SemanticItemList For voice-only mode, SemanticItemList is an associative array that maps semantic item id to semantic item objects. For multimodal, SemanticItemList will be null. <br /> OnClientComplete </li></ul>

0572Optional. Used in both multimodal and voice-only modes. Specifies a client-side script that will be called after execution of a QA (successfully or not) and before passing dialog control back to the RunSpeech algorithm (in voice-only) or the end user (in multimodal). The OnClientComplete function is called before postbacks to the server for QAs whose AutoPostBack attribute of the Answer object is set to true. The on ClientComplete function does not return values. The signature for on ClientComplete is as follows: <ul id="ul0062" list-style="none"><li id="ul0062-0001" num="0573"> function onClientComplete (string eventsource, string lastCommandOrException, int Count, object SemanticItemList) <br /> where: </li><li id="ul0062-0002" num="0574"> eventsource is the id of the object (specified by Reco.StopEvent) whose event stopped the Reco associated with the QA (for multimodal). eventsource will be null in voice-only mode. </li><li id="ul0062-0003" num="0575"> lastCommandOrException is a Command type (e.g., “Help”) or a Reco event (e.g., “Silence” or “NoReco”) for voice-only mode. lastCommandOrException is the empty string for multimodal. </li><li id="ul0062-0004" num="0576"> Count is the number of times the QA has been activated consecutively. Count starts at 1 and has no limit for voice-only mode. Count is zero for multimodal. </li><li id="ul0062-0005" num="0577"> SemanticItemList For voice-only mode, SemanticItemList is an associative array that maps semantic item id to semantic item objects. For multimodal, SemanticItemList will be null. <br /> OnClientListening </li></ul>

0578Optional. Used in both multimodal and voice-only modes. Specifies a client-side script (function) that will be called/executed after successful start of the reco object. The main use is so the GUI can change to show the user that they can start speaking. The function does not return any values. The signature for OnClientListening is as follows: <ul id="ul0063" list-style="none"><li id="ul0063-0001" num="0579"> function on ClientListening(string eventsource, string lastCommandOrException, int Count, object SemanticItemList) <br /> where: </li><li id="ul0063-0002" num="0580"> eventsource is the id of the object (specified by Reco.StartEvent) whose event started the Reco associated with the QA (for multimodal). eventsource will be null in voice-only mode. </li><li id="ul0063-0003" num="0581"> lastCommandOrException is a Command type (e.g., “Help”) or a Reco event (e.g., “Silence” or “NoReco”) for voice-only mode. lastCommandOrException is the empty string for multimodal. </li><li id="ul0063-0004" num="0582"> Count is the number of times the QA has been activated consecutively. Count starts at 1 and has no limit for voice-only mode. Count is zero for multimodal. </li><li id="ul0063-0005" num="0583"> SemanticItemList For voice-only mode, SemanticItemList is an associative array that maps semantic item id to semantic item objects. For multimodal, SemanticItemList will be null. </li></ul>

0584Note: In multimodal mode OnClientListening is only available if author chooses to use StartEvent. If author decides to start reco programmatically, then onClientListening is not called for the author because the author can detect when reco.start returns successfully.

0585Note: OnClientListening is ignored when specified in QA's that do not contain reco objects.

0000AllowCommands

0586Optional. Only used in voice-only mode. Indicates whether or not Commands may be activated for a QA control. When AllowCommands is set to false, no commands may be activated. Defaults to true.

0000PlayOnce

0587Optional. Only used in voice-only mode. Specifies whether or not a QA may be activated more than once per page. If not specified, PlayOnce is set to false. PlayOnce=“true” may be used to author statements like welcoming prompts. When a QA is reduced to a statement (no reco), setting PlayOnce=“false” will provide dialog authors with the capability to enable a “repeat” functionality on a page that reads email messages.

0000XpathAcceptConfirms

0588Optional. Only used in voice-only mode. Specifies the path in the sml document (recognition result) that indicates the confirm items were accepted. Required if Confirms are specified. If XpathAcceptConfirms is specified without a Confirm being specified it is ignored. XpathAcceptConfirms must be a valid xml path. An invalid xml path will cause a redirection to the default error page during run time.

0000XpathDenyConfirms

0589Optional. Used only in voice-only mode. Specifies the path in the sml document that indicates the confirm items were denied. Required if Confirms are specified. If a Confirm is specified and XpathDenyConfirms is not set an exception is thrown. If XpathDenyConfirms is specified without a Confirm being specified it is ignored. XpathDenyConfirms must be a valid xml path. An invalid xml path will cause a redirection to the default error page during run time.

0000AcceptRejectThreshold

0590Optional. Used only in voice-only mode. If confidence for an accept confirm is not above this threshold no action will be taken. Legal values are 0-1 and are platform specific. An exception will be thrown for out of range AcceptRejectThreshold values. Default is zero.

0000DenyRejectThreshold

0591Optional. Used only in voice-only mode. If confidence for a deny confirm is not above this threshold no action will be taken. Legal values are 0-1 and are platform specific. An exception will be thrown for out of range DenyRejectThreshold values. Default is zero.

0000FirstInitialTimeout

0592Optional. Only used in voice-only mode. Specifies the initial timeout in msec for the QA when count==1. The status of the TargetElements specified in the Confirms answer list will be set to “Confirmed” if no speech is detected within firstInitialTimeout milliseconds. If not specified the default value of firstInitialTimeout is 0, which means that silence does not imply confirmation of the Answer. An exception will be thrown if firstInitialTimeout is specified for a QA that does not contain Confirms. An exception will be thrown for negative values of FirstInitialTimeout.

0000StyleReference

0593Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the QA control will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values on the control will override those set on the Style.

0000ConfirmByOmission

0594Optional. Used only in voice-only mode. Default is true. This flag controls confirmation of more than one item. If the flag is set to true, then any semantic items whose xpath is not present in the reco result, will be set to Confirmed. ConfirmByOmission enables the following scenario: <ul id="ul0064" list-style="none"><li id="ul0064-0001" num="0595"> (ConfirmByOmission=true) </li><li id="ul0064-0002" num="0596"> Q: Flying from?</li><li id="ul0064-0003" num="0597"> A: Boston. </li><li id="ul0064-0004" num="0598"> Q: Flying to?</li><li id="ul0064-0005" num="0599"> A: Seattle. </li><li id="ul0064-0006" num="0600"> Q: From Boston to Seattle?</li><li id="ul0064-0007" num="0601"> A: From NY. </li><li id="ul0064-0008" num="0602"> (Seattle is confirmed as destination city). <br /> ConfirmIfEqual </li></ul>

0603Optional. Used only in voice-only mode. Default is true. This flag controls the processing of corrections during confirmation. If ConfirmIfEqual is true and a recognized correction is the same value already in the semantic item, the item is maked confirmed. If ConfirmIfEqual is false and a recognized correction is the same value already in the semantic item, the item is maked as needing confirmation.

0000Answers

0604Optional. An array of answer objects. This list of objects is used both to determine activation, and to carry out semantic processing logic. An exception will be thrown if an Answers collection contains non-answer objects.

0000ExtraAnswers

0605Optional. An array of answer objects. These items are not used for activation, but they are taken into account when processing recognition results. If an ExtraAnswer is recognized, it will overwrite the semantic item it points to, even if it was previously confirmed.

0000Confirms

0606Optional. An array of answer objects. These items are used for activation if the answers array is empty and they affect the confirmation logic.

0000Prompt

0607Optional for multimodal. Required for voice-only. An exception is thrown if a Prompt is not specified in voice-only mode.

0000Reco

0608Optional for multimodal and voice-only. Typically, only one reco can be specified in a QA.

0000Dtmf

0609Optional. Only used in voice-only mode. Typically, only one Dtmf can be specified in a QA.

00009 Command Control

0610The Command control provides a way for obtaining user input that is not an answer to the question at hand (eg, Help, Repeat, Cancel), and which does not map to textual input into primary controls. A Command specifies an activation scope, which means that its grammar is active (in parallel with the current recognition grammar) for every QA within that scope. Commands have a type attribute which is used to implement a chain of events: Commands of the same type at QAs lower in scope can override superior commands with context-sensitive behavior (and even different/extended grammars if necessary) and to notify the QA what command was uttered (via the reason parameter).

0611Commands are not rendered for multimodal mode. <tables id="TABLE-US-00056" num="56"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>class Command : SpeechControl</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="196PT" align="left" /><tbody valign="top"><row><entry>{</entry><entry /></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="63PT" align="left" /><colspec colname="3" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry>string</entry><entry>Scope{get; set;};</entry></row><row><entry /><entry>string</entry><entry>Type{get; set;};</entry></row><row><entry /><entry>string</entry><entry>XpathTrigger{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><colspec colname="3" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>float</entry><entry>AcceptCommandThreshold{get;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="63PT" align="left" /><colspec colname="3" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>OnClientCommand{get; set;};</entry></row><row><entry /><entry>bool</entry><entry>AutoPostBack{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><colspec colname="3" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>TriggeredEventHandler</entry><entry>OnTriggered;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="63PT" align="left" /><colspec colname="3" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row><row><entry /><entry>Prompt</entry><entry>Prompt{get;};</entry></row><row><entry /><entry>Grammar</entry><entry>Grammar{get;};</entry></row><row><entry /><entry>Grammar</entry><entry>DtmfGrammar{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>}</entry></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 9.1 Command Properties

0612All properties of the Command control are available to the application developer at design time.

0000Scope

0613Required. Only used in voice-only mode. Specifies the id of a QA or other ASP.NET control (e.g., form, panel, or table). Scope is used in Commands to specify when the Command's grammars will be active. Exceptions are thrown if Scope is invalid or not specified.

0000Type

0614Required. Only used in voice-only mode. Specifies the type of command (eg ‘help’, ‘cancel’ etc.) in order to allow the overriding of identically typed commands at lower levels of the scope tree. Any string value is possible in this attribute, so it is up to the author to ensure that types are used correctly. An exception is thrown if Type is not specified.

0615Note: An exception will be thrown if more than 1 Command of same Type has the same Scope. For example, 2 Type=“Help” Commands for the same QA (Scope=“QA1”).

0000AcceptCommandThreshold

0616Optional. Only used in voice-only mode. Specifies the minimum confidence level of recognition that is necessary to trigger the command (this is likely to be used when higher than usual confidence is required, e.g. before executing the result of a ‘Cancel’ command). Legal values are 0-1. Default value is 0. Exceptions will be thrown for out of range AcceptCommandThreshold values.

0617If a command is matched (its xpathTrigger is present in the recoResult) no further commands will be processed, and no Answers, ExtraAnswers, Confirms, etc. will be processed. Then, if the confidence of the node specified by XpathTrigger is greater than or equal to the acceptThreshold, the active QAs LastCommandOrException is set to the Command's type, and the Command's on Command function is called. Otherwise (if the confidence of the node is less than the acceptThreshold) the active QAs LastCommandOrException is set to “NoReco” and the active QAs Reco's OnClientNoReco function is called.

0000XpathTrigger

0618Required. Only used in voice-only mode. SML document path that triggers this command. An exception will be thrown if XpathTrigger is not specified. XpathTrigger must be a valid xml path. An invalid xml path will cause a redirection to the default error page during run time.

0000OnClientCommand

0619Optional. Only used voice-only mode. Specifies the client-side script function to execute on recognition of the Command's grammar. The function does not return any values. The signature for OnClientCommand is as follows: <ul id="ul0065" list-style="none"><li id="ul0065-0001" num="0000"><ul id="ul0066" list-style="none"><li id="ul0066-0001" num="0620"> function OnClientCommand(XMLNode smlNode) <br /> where: smlNode is the matched SML node. </li></ul></li></ul>

0621Note: If AutoPostBack is set to true, the OnClientCommand function is executed before posting back to the server. If the author wishes to persist any page state across postback, the OnClientCommand function is a good place to invoke the ClientViewState object of RunSpeech.

0000AutoPostBack

0622Optional. Only used in voice-only mode. Specifies whether or not the Command control posts back to the server each time a Command grammar is recognized. Default is false. If set to true, the server-side Triggered event is fired.

0623The internal state of the voice-only page is maintained automatically during postback. Authors may use the ClientViewState object of RunSpeech to declare and set additional values they wish to persist across postbacks.

0000OnTriggered

0624Optional. Only used in voice-only mode. Specifies a server-side script function to be executed when the Triggered event is fired (see autopostback attribute above). This handler must have the form (in C#—the signature would look slightly different in other languages): <ul id="ul0067" list-style="none"><li id="ul0067-0001" num="0625"> void myFunction (object sender, CommandTriggeredEventArgs e); </li></ul>

0626The handler can be assigned to in two different ways— <ul id="ul0068" list-style="none"><li id="ul0068-0001" num="0627"> declaratively: </li><li id="ul0068-0002" num="0628"> <speech:Command . . . OnTriggered=“myFunction” . . . /></li><li id="ul0068-0003" num="0629"> or programmatically: </li><li id="ul0068-0004" num="0630"> Command.Triggered+=new TriggeredEventHandler(myFunction); </li><li id="ul0068-0005" num="0631"> TriggeredEventHandler is what is called a “delegate”—it basically specifies the signature of functions which can handle its associated event type. It looks like this: <ul id="ul0069" list-style="none"><li id="ul0069-0001" num="0632"> public delegate void TriggeredEventHandler(object sender, TriggeredEventArgs e); <br /> where: </li></ul></li><li id="ul0068-0006" num="0633"> TriggeredEventArgs is a class derived from System.EventArgs which contains one public property, string Value. </li></ul>

0634An exception will be thrown if AutoPostBack is set to true and no handler is specified for the Triggered event. An exception will be thrown if AutoPostBack is set to false and a handler is specified for the Triggered event.

0000StyleReference

0635Optional. Only used in voice-only mode. Specifies the name of a Style object. At render time, the QA control will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values on the control will override those set on the Style.

0000Prompt

0636Optional. May be used to specify prompt to be played for global commands.

0000Grammar

0637Optional. The grammar object which will listen for the command.

0638Note: The grammar object is optional because the QA scoped by this command may contain the rule that generates this command's Xpath. The author has the flexibility of specifying the rule in the QA control or the Command control.

0000DtmfGrammar

0639Optional. The DtmfGrammar object which will activate the command. Available at run time.

0640Note: The DtmfGrammar object is optional because the QA scoped by this command may contain the rule that generates this command's Xpath. The author has the flexibility of specifying the rule in the QA control or the Command control. DtmfGrammars for all Commands along the QA's scope chain will be combined into the Grammars collection for the QA's Dtmf object.

0641Speech Controls does not provide a set of common commands—e.g., help, cancel, repeat.

000010 CompareValidator Control

0642This control compares two values, applying the operator, and if the comparison is false, invalidates the item specified by SemanticItemToValidate. Optionally, both items (ToCompare and ToValidate) are invalidated. The CompareValidator is triggered on the client by change or confirm events; however, validation prompts are played in SpeechIndex order.

0643The CompareValidator control is rendered for voice-only mode. For multimodal, ASP.NET validator controls may be used. <tables id="TABLE-US-00057" num="57"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>class CompareValidator : IndexedStyleReferenceSpeechControl</entry></row><row><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="77PT" align="left" /><colspec colname="3" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry>int</entry><entry>SpeechIndex{get; set;};</entry></row><row><entry /><entry>ValidationType</entry><entry>Type{get; set;};</entry></row><row><entry /><entry>string</entry><entry>ValidationEvent{get; set;};</entry></row><row><entry /><entry>string</entry><entry>SemanticItemToCompare{get;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="77PT" align="left" /><colspec colname="3" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>ValueToCompare{get; set;};</entry></row><row><entry /><entry>string</entry><entry>SemanticItemToValidate{get;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><colspec colname="3" colwidth="77PT" align="left" /><tbody valign="top"><row><entry /><entry>ValidationCompareOperator</entry><entry>Operator(get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="77PT" align="left" /><colspec colname="3" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>bool</entry><entry>InvalidateBoth{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row><row><entry /><entry>Prompt</entry><entry>Prompt{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>}</entry></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 10.1 CompareValidator Properties

0644All properties of the CompareValidator control are only used in voice-only mode and are available to the application developer at design time.

0000SpeechIndex

0645Optional. Specifies the activation order of CompareValidator controls on a page. If more than one control has the same SpeechIndex, they are activated in source order. In situations where some controls specify SpeechIndex and some controls do not, those with SpeechIndex specified will be activated first, then the rest in source order. SpeechIndex values start at 1. An exception will be thrown for non-valid values of SpeechIndex.

0000Type

0646Required. Sets the datatype of the comparison. Legal values are “String”, “Integer”, “Double”, “Date”, and “Currency”. Default value is “String”.

0000ValidationEvent

0647Default is “onconfirmed”. ValidationEvent may be set to one of two values, either “onchange” or “onconfirmed”.

0648If ValidationEvent is set to “onchanged”, the CompareValidator will be run each time the value of the Text property of the associated SemanticItem changes. The CompareValidator control will be run before the SemanticItem's OnChanged handler is called. The SemanticItem's OnChanged handler will only be called if the CompareValidator does indeed validate the changed data. If the CompareValidator invalidates the data, the State of the SemanticItem is set to Empty and the OnChanged handler is not called.

0649If ValidationEvent is set to “onconfirmed”, the CompareValidator will be run each time the State of the associated SemanticItem changes to Confirmed. The CompareValidator control will be run before the SemanticItem's OnConfimed handler is called. The SemanticItem's OnConfirmed handler will only be called if the CompareValidator does indeed validate the changed data. If the CompareValidator invalidates the data, the State of the SemanticItem is set to Empty and the OnConfirmed handler is not called.

0650After processing all SemanticItems involved a recognition turn, RunSpeech starts again. At that point, the previously failed validators will be active and RunSpeech will select the first QA/Validator that is active in SpeechIndex order. It is the author's responsibility to place the validator controls directly before the QA control that collects the answer for the SemanticItem in order to get the correct behavior.

0000SemanticItemToCompare

0651Optional. Either SemanticItemToCompare or ValueToCompare must be specified. Specifies the Id of the SemanticItem which will be used as the basis for the comparison. Available at design time and run time. An exception will be thrown if either SemanticItemToCompare or ValueToCompare is not specified.

0000ValueToCompare

0652Optional. Either SemanticItemToCompare or ValueToCompare must be specified. Specifies the value to be used as the basis for the comparison. The author may wish to specify the value here instead of taking the value from the semantic item. If both ValueToCompare and SemanticItemToCompare are set, SemanticItemToCompare takes precedence. An exception will be thrown if either SemanticItemToCompare or ValueToCompare is not specified. An exception will be thrown if ValueToCompare can not be converted to a valid Type.

0000SemanticItemToValidate

0653Required. Specifies the Id of the SemanticItem that is being validated against either ValueToCompare or SemanticItemToCompare. An exception will be thrown for unspecified SemanticItemToValidate.

0000Operator

0654Optional. One of “Equal”, “NotEqual”, “GreaterThan”, GreaterThanEqual”, “LesserThan”, “LesserThanEqual”, “DataTypeCheck”. Default value is “Equal”. The values are compared in the following order: Value to Validate [operator] ValueToCompare.

0000InvalidateBoth

0655Optional. If true, both SemanticItemToCompare and SemanticItemToValidate are marked Empty. Default is false (i.e., invalidate only the SemanticItemtToInvalidate). If SemanticItemToValidate has not been set (i.e. ValueToCompare has been specified), InvalidateBoth is ignored.

0656The following example illustrates the usage of the InvalidateBoth attribute. The scenario is an itinerary application. The user has already been prompted and answered the question for departing city. At this point in the dialog an ASP.NET textbox control has been filled with the recognition results (assume txtDepartureCity.Value=“Austin”).

0657The next QA prompts the user for the arrival city, the SemanticItem object binds to txtArrivalCity.Value. In response to the prompt, the user says “Boston”. However, the recognition engine returns “Austin” (e.g. arrival city is same as departing city).

0658The CompareValidator control may be used to direct the dialog flow in this case to re-prompt the user for both departing and arriving cities: <tables id="TABLE-US-00058" num="58"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="77PT" align="left" /><colspec colname="2" colwidth="126PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><CompareValidator</entry><entry>id=“compareCities” SpeechIndex=“5”</entry></row><row><entry /><entry>Type=“String”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItemToCompare=“si_DepartureCity”</entry></row><row><entry /><entry>SemanticItemToValidate=“si_ArrvivalCity”</entry></row><row><entry /><entry>Operator=“NotEqual”</entry></row><row><entry /><entry>InvalidateBoth=“True”</entry></row><row><entry /><entry>runat=“server”</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></CompareValidator></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> StyleReference

0659Optional. Specifies the name of a Style object. At render time, the QA control will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values on the CompareValidator control will override those set on the Style.

0000Prompt

0660Optional. Prompt to indicate the error.

000011 CustomValidator Control

0661The CustomValidator control is used to validate recognition results when complex validation algorithms are required. The control allows dialog authors to specify their own validation routines. The CustomValidator is triggered on the client by change or confirm events; however, validation prompts are played in SpeechIndex order.

0662The CustomValidator control is only rendered for voice-only mode. For multimodal, ASP.NET validator controls may be used. <tables id="TABLE-US-00059" num="59"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class CustomValidator : IndexedStyleReferenceSpeechControl</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="42PT" align="left" /><colspec colname="3" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry><entry /><entry /></row><row><entry /><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry /><entry>int</entry><entry>SpeechIndex{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>ValidationEvent{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>SemanticItemToValidate{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>ClientValidationFunction{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row><row><entry /><entry /><entry>Prompt</entry><entry>Prompt{get;};</entry></row><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 11.1 CustomValidator Properties

0663All properties of the CustomValidator control are only used in voice-only mode and are available to the application developer at design time.

0000SpeechIndex

0664Optional. Only used in voice-only mode. Specifies the activation order of speech controls on a page and the activation order of composite controls. If more than one control has the same SpeechIndex, they are activated in source order. In situations where some controls specify SpeechIndex and some controls do not, those with SpeechIndex specified will be activated first, then the rest in source order. SpeechIndex values start at 1. An exception will be thrown for non-valid values of SpeechIndex.

0000ValidationEvent

0665Default is “onconfirmed”. ValidationEvent may be set to one of two values, either “onchange” or “onconfirmed”.

0666If ValidationEvent is set to “onchanged”, the CustomValidator will be run each time the value of the Text property of the associated SemanticItem changes. The CustomValidator control will be run before the SemanticItem's OnChanged handler is called. The SemanticItem's OnChanged handler will only be called if the CustomValidator does indeed validate the changed data. If the CustomValidator invalidates the data, the State of the SemanticItem is set to Empty and the OnChanged handler is not called.

0667If ValidationEvent is set to “onconfirmed”, the CustomValidator will be run each time the State of the associated SemanticItem changes to Confirmed. The CustomValidator control will be run before the SemanticItem's OnConfimed handler is called. The SemanticItem's OnConfirmed handler will only be called if the CustomValidator does indeed validate the changed data. If the CustomValidator invalidates the data, the State of the SemanticItem is set to Empty and the OnConfirmed handler is not called.

0668After processing all SemanticItems involved a recognition turn, RunSpeech starts again. At that point, the previously failed validators will be active and RunSpeech will select the first QA/Validator that is active in SpeechIndex order. It is the author's responsibility to place the validator controls directly before the QA control that collects the answer for the SemanticItem in order to get the correct behavior.

0000SemanticItemToValidate

0669Required. Specifies the id of the SemanticItem that is being validated. An exception will be thrown for unspecified SemanticItem ToValidate.

0000ClientValidationFunction

0670Required. Specifies a function that checks the value of the SemanticItemToValidate.AttributeToValidate and returns true or false indicating whether the value is valid or invalid. The signature for ClientValidationFunction is as follows: <ul id="ul0070" list-style="none"><li id="ul0070-0001" num="0000"><ul id="ul0071" list-style="none"><li id="ul0071-0001" num="0671"> bool ClientValidationFunction (string value) <br /> where: </li></ul></li><li id="ul0070-0002" num="0672"> value is the contents of ElementToValidate.AttributeToValidate. </li></ul>

0673An exception will be thrown if ClientValidationFunction is not specified.

0000StyleReference

0674Optional. Specifies the name of a Style object. At render time, the QA control will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values on the control will override those set on the Style.

0000Prompt

0675Optional. Prompt to indicate the error.

000012 Answer Object

0676The Answer object contains information on how to process recognition results and bind the results to controls on an ASP.NET page.

0000How Answer Object is Used.

0000Voice-Only Mode.

0677The RunSpeech script uses the Answer object to perform answer processing on the client. Answer processing begins when the OnReco event fired by the speech platform is received by the client. The resultant SML document returned by the speech platform is searched for the node specified by the required XpathTrigger attribute. If the XpathTrigger node is found in the SML document and contains a non-null value, the value is is filled into the semantic item specified in the SemanticItem property of the answer. For non-existant XpathTrigger in the SML document or null value of XpathTrigger, RunSpeech looks for the next QA to activate.

0678After the non-null value of the XpathTrigger node is found, RunSpeech invokes the ClientNormalization function (if specified). The ClientNormalizationFunction returns a text string that reflects the author-defined transformation of the value of the XpathTrigger node. For example, the author may wish to transform the date “Nov. 17, 2001” returned by the speech platform to “11/17/2001”. Semantic items are used for both simple and complex data binding.

0679The SML document returned by the speech platform may contain a platform-specific confidence rating for each XpathTrigger node. During answer processing, RunSpeech compares this confidence rating to the value specified in the ConfirmThreshold attribute of the Answer object. Results of the comparison are then used to set the internal confirmed state of the semantic item. This state information is subsequently used to determine whether or not an answer requires confirmation from the user.

0680RunSpeech internally marks an answer as needing confirmation if the confidence returned with the XpathTrigger is less than or equal to the value of the ConfirmThreshold attribute. Otherwise RunSpeech internally marks the semantic item associated with the answer as confirmed. This internal state information is used during confirmation processing.

0000Multimodal.

0681The Answer object is used in multimodal scenarios by the Multimodal.js script just as it is used by RunSpeech in voice-only (described above) with one exception. In multimodal, platform-specific confidence ratings are not compared to the ConfirmThreshold attribute of the Answer object, therefore internal state information of each answer is not maintained. Confirmation of results is done visually. If an incorrect result is bound to a visual control, the user senses the problem visually and may then initiate another speech input action to correct the error.

0682Rendered for both multimodal and voice-only modes <tables id="TABLE-US-00060" num="60"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class Answer : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>id{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry>float</entry><entry>Reject{get; set;};</entry></row><row><entry /><entry>float</entry><entry>ConfirmThreshold{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>XpathTrigger{get; set;};</entry></row><row><entry /><entry>string</entry><entry>SemanticItem{get; set;};</entry></row><row><entry /><entry>string</entry><entry>ClientNormalizationFunction{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 12.1 Answer Properties

0683All properties of the Answer object are available to the application developer at design time.

0000Reject

0684Optional. Used in both multimodal and voice-only modes. Specifies the rejection threshold for the Answer. Answers having confidence values below Reject will cause a noReco event to be thrown. If not specified, the value 0 will be used. Legal values are 0-1 and are platform specific. An exception will be thrown for out of range Reject values.

0685Rejected Answers are treated as if they were not present in the reco result to begin with. If, after this processing, no relevant information remains (no Answers, ExtraAnswers, Confirms, Commands, or xpathAcceptConfirms/xpathDenyConfirms), an onnoreco event is fired (which mimics exactly the tags version).

0000ConfirmThreshold

0686Optional. Used in voice-only mode. Specifies the minimum confidence level of recognition that is necessary to mark this item as confirmed. If the confidence of the matched item is less than or equal to this threshold, the item is marked as needing confirmation. Legal values are 0-1. Default value is 0. An exception will be thrown for out of range ConfirmThreshold values.

0000XpathTrigger

0687Required for Answers and ExtraAnswers. Optional for Confirms. Used in both multimodal and voice-only modes. Specifies what part of the SML document this answer refers to. It is specified as an XPath on the SML output from recognition. An exception will be thrown if XpathTrigger is not specified for Answers or ExtraAnswers. XpathTrigger must be a valid xml path. An invalid xml path will cause a redirection to the default error page during run time.

0688For Confirms, if XpathTrigger is not set or set to the empty string, the confirm won't allow for correction. Yes/no confirmations are enabled when XpathTrigger is used in this way.

0000SemanticItem

0689Optional. Used in both multimodal and voice-only modes.

0000ClientNormalizationFunction

0690Optional. Used in both multimodal and voice-only modes. Specifies a client-side function that will take the matched sml node as a parameter and returns a string that reflects author-specified normalization (transformation) of the recognized item. The signature for ClientNormalizationFunction is as follows: <tables id="TABLE-US-00061" num="61"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>string ClientNormalizationFunction (XMLNode SMLnode,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>object SemanticItem)</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> where: <ul id="ul0072" list-style="none"><li id="ul0072-0001" num="0691"> SMLnode is the node specified in the Xpath. </li><li id="ul0072-0002" num="0692"> SemanticItem is the client-side SemanticItem object specified in the Answer object. <br /> StyleReference </li></ul>

0693Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the Answer object will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values by the Answer object will override those set on the referenced Style.

000013 SemanticMap Control

0694SemanticMap is a container of SemanticItem objects. <tables id="TABLE-US-00062" num="62"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class SemanticMap : SpeechControl</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItemCollection SemItems{get;};</entry></row><row><entry /><entry>SemanticItem GetSemanticItem (string name);</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 13.1 SemanticMap Properties <br /> SemItems

0695A collection of SemanticItem objects.

000013.2 SemanticMap Methods

0000GetSemanticItem

0696This is a function that takes the id of a SemanticItem and returns the SemanticItem object. The signature of GetSemanticItem is: <ul id="ul0073" list-style="none"><li id="ul0073-0001" num="0000"><ul id="ul0074" list-style="none"><li id="ul0074-0001" num="0697"> function GetSemanticItem(string id) <br /> 14 SemanticItem Object </li></ul></li></ul>

0698The SemanticItem object describes where and when an Answer's recognition results are written to visual controls on a page. The object also keeps track of the current state of Answers, i.e., whether an Answer has changed or been confirmed. <tables id="TABLE-US-00063" num="63"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class SemanticItem : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="63PT" align="left" /><colspec colname="3" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>TargetElement{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>TargetAttribute{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>BindOnChanged{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>BindAt{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>AutoPostBack{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientChanged{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientConfirmed{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><colspec colname="3" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>SemanticEventHandler</entry><entry>Changed;</entry></row><row><entry /><entry /><entry>SemanticEventHandler</entry><entry>Confirmed;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="63PT" align="left" /><colspec colname="3" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>Text{get;};</entry></row><row><entry /><entry /><entry>SemanticState</entry><entry>State{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><colspec colname="3" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>StringDictionary</entry><entry>Attributes{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="14PT" align="left" /><colspec colname="2" colwidth="63PT" align="left" /><colspec colname="3" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>StyleReference{get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 14.1 SemanticItem Properties <br /> id

0699Required. The programmatic id of this semantic item.

0000TargetElement

0700Optional. Used in both multimodal and voice-only modes. Specifies the id of the visual control to which the recognition results should be written. If specified, default binding will occur when the value is changed or confirmed depending on the value of BindOnChanged. An exception is thrown if TargetElement is the id of multiple controls.

0000TargetAttribute

0701Optional. Used in both mutimodal and voice-only modes. Specifies the property name of the TargetElement to which this answer should be written. The default value is null. An exception will be thrown if TargetElement is specified and TargetAttribute is not specified.

0000BindOnChanged

0702Optional. Used voice-only mode, ignored in multimodal. Default is false. In VoiceOnly mode, BindOnChanged controls when to bind recognition results to visual elements.

0703A value of true causes binding everytime the value of the SemanticItem changes.

0704A value of false causes binding only when the SemanticItem has been confirmed.

0000BindAt

0705Optional. Used in both mutimodal and voice-only modes. Can be omitted or set to “server”. Default is null (omitted). If BindAt is set to “server”, it indicates that the TargetElement/TargetAttribute pair refers to a server-side control or property. An exception will be thrown when BindAt is set to an invalid value.

0706If BindAt is “server”, an exception will be thrown if: <ul id="ul0075" list-style="none"><li id="ul0075-0001" num="0000"><ul id="ul0076" list-style="none"><li id="ul0076-0001" num="0707"> SemanticItem.TargetElement is not a server-side control, or </li><li id="ul0076-0002" num="0708"> SemanticItem.TargetAttribute is not a member of the control specified by SemanticItem.TargetElement, or </li><li id="ul0076-0003" num="0709"> SemanticItem.TargetAttribute is a member of SemanticItem.TargetElement, but is not of type string, or </li><li id="ul0076-0004" num="0710"> SemanticItem.TargetAttribute is a string, but is read-only. <br /> AutoPostBack </li></ul></li></ul>

0711Optional. Used in both multimodal and voice-only modes. Specifies whether or not the control posts back to the server when the binding event is fired. The binding event can be on Changed or on Confirmed and is controlled by the value of BindonChange. Default is false.

0712The state of the voice-only page is maintained automatically during postback. Authors may use the ClientViewState object of RunSpeech to declare and set any additional values they wish to persist across postbacks.

0000OnClientChanged

0713Optional. Used in both multimodal and voice-only modes. Specifies a client-side function to be called when the value of the Text property of this SemanticItem changes. The function does not return any values. The signature for OnClientChanged is as follows: <ul id="ul0077" list-style="none"><li id="ul0077-0001" num="0000"><ul id="ul0078" list-style="none"><li id="ul0078-0001" num="0714"> function OnClientChanged(object SemanticItem) <br /> where SemanticItem is the client-side SemanticItem object. </li></ul></li></ul>

0715Note: If AutoPostBack is set to true, the OnClientChanged function is executed before posting back to the server. If the author wishes to persist any page state across postback, the OnClientChanged function is a good place to access the ClientViewState object of RunSpeech.

0000OnClientConfirmed

0716Optional. Used in both multimodal and voice-only modes. Specifies a client-side function to be called when this SemanticItem's [value is confirmed. The function does not return any values. The signature for OnClientConfirmed is as follows: <ul id="ul0079" list-style="none"><li id="ul0079-0001" num="0000"><ul id="ul0080" list-style="none"><li id="ul0080-0001" num="0717"> function OnClientConfirmed(object SemanticItem) <br /> where SemanticItem is the client-side SemanticItem object. </li></ul></li></ul>

0718Note: If AutoPostBack is set to true, the OnClientConfirmed function is executed before posting back to the server. If the author wishes to persist any page state across postback, the OnClientConfirmed function is a good place to access the ClientViewState object of RunSpeech

0000Changed

0719Optional. Used in both multimodal and voice-only modes. Specifies a server-side script function to be executed when the Changed event is fired.

0720The signature of a SemanticEventHandler is: (in C#—the signature would look slightly different in other languages) <tables id="TABLE-US-00064" num="64"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>public delegate void SemanticEventHandler ( object</entry></row><row><entry /><entry>sender, SemanticEventArgs e ) ;</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> where:

0721SemanticEventArgs is a class derived from System.EventArgs. <tables id="TABLE-US-00065" num="65"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>public class SemanticEventArgs : EventArgs</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="56PT" align="left" /><colspec colname="2" colwidth="112PT" align="left" /><tbody valign="top"><row><entry /><entry>public string</entry><entry>Text {get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>public StringDictionary Attributes {get;}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0722Text

0723Returns the value that this SemanticItem has been set to.

0724State

0725Returns the state of this SemanticItem.

0000Confirmed

0726Optional. Used in both multimodal and voice-only modes. Specifies a server-side script function to be executed when the Confirmed event is fired. In multimodal mode, the Confirmed event will be fired immediately after the Changed event.

0727The signature of a SemanticEventHandler is: (in C#—the signature would look slightly different in other languages) <ul id="ul0081" list-style="none"><li id="ul0081-0001" num="0000"><ul id="ul0082" list-style="none"><li id="ul0082-0001" num="0728"> public delegate void SemanticEventHandler (object sender, SemanticEventArgs e); <br /> where: </li></ul></li></ul>

0729SemanticEventArgs is a class derived from System.EventArgs. <tables id="TABLE-US-00066" num="66"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>public class SemanticEventArgs : EventArgs</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>public string Text {get;}</entry></row><row><entry /><entry>public StringDictionary Attributes {get;}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0730Text

0731Read only. Returns the value that this SemanticItem has been set to.

0732State

0733Read only. Returns the state of this SemanticItem.

0000Text

0734The text value that this SemanticItem has been set to. Default is null.

0000State

0735The confirmation state of this SemanticItem. Values of State will be one of SemanticState.Empty, SemanticState.NeedsConfirmation or SemanticState.Confirmed.

0000Attributes

0736Optional. Used in both multimodal and voice-only modes. This is a collection of name/value pairs. Attributes is used to pass user defined information to the client-side semantic item and back to the server (they are kept synchronized). Attributes may only be set programmatically. For example: <ul id="ul0083" list-style="none"><li id="ul0083-0001" num="0737"> SemanticItem.Attributes [“myvarname”]=“myvarvalue”</li></ul>

0738Attributes are not cleared when the SemanticItem is reset by the system. If developers wish to reset the attributes, they must do so manually.

0000StyleReference

0739Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the QA SemanticItem object will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values by the SemanticItem object will override those set on the referenced Style.

000014.2 SemanticItem Client-Side Object

0740//Notation doesn't imply programming language <tables id="TABLE-US-00067" num="67"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class SemanticItem</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItem (sco, id, targetElement, targetAttribute,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>bindOnChanged, bindAtServer, autoPostback,</entry></row><row><entry /><entry>onClientChanged, onClientConfirmed,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>hiddenFieldID,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>value, state);</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>SetText (string text, boolean isConfirmed);</entry></row><row><entry /><entry>Confirm( );</entry></row><row><entry /><entry>Clear( );</entry></row><row><entry /><entry>Empty( );</entry></row><row><entry /><entry>AddValidator (validator);</entry></row><row><entry /><entry>IsEmpty( );</entry></row><row><entry /><entry>NeedsConfirmation( );</entry></row><row><entry /><entry>IsConfirmed( );</entry></row><row><entry /><entry>Encode( );</entry></row><row><entry /><entry>Object value; //Read only</entry></row><row><entry /><entry>string state; //Read only</entry></row><row><entry /><entry>object attributes;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> SetText (String Text, Boolean is Confirmed)

0741The SetText method of the client side semantic item object is used to alter the value property. The partmeters are <ul id="ul0084" list-style="none"><li id="ul0084-0001" num="0000"><ul id="ul0085" list-style="none"><li id="ul0085-0001" num="0742"> string text the string which will become the value of the the Semantic Item </li><li id="ul0085-0002" num="0743"> Boolean is Confirmed determines whether the Semantic Item state property is “confirmed” (if true) or “needs confirmation” if false <br /> Confirm( ) </li></ul></li></ul>

0744This method sets the state property of the Semantic Item property to “confirmed.”

0000Clear( )

0745This method sets the value property of the Semantic Item to NULL and sets the state property to “empty.”

0000Empty( )

0000AddValidator (Validator)

0000IsEmpty( )

0746This method checks to see if the state property of the Semantic Item and returns true if it is “empty” and false if it is “needs confirmation” or “confirmed.”

0000NeedsConfirmation( )

0747This method checks to see if the state property of the Semantic Item and returns true if it is “needs confirmation” and false if it is “empty” or “confirmed.”

0000IsConfirmed( )

0748This method checks to see the state property of the Semantic Item and returns true if it is “confirmed”and false if it is “needs confirmation” or “empty.”

0000Encode( )

0000Object Value

0749ReadOnly.

0000String State

0750Read Only.

0000Object Attributes

000014.3 Run-Time Behavior

0751As a general rule, the order of execution for every transition Empty->NeedsConfirmation or NeedsConfirmation->Confirmed: <ul id="ul0086" list-style="none"><li id="ul0086-0001" num="0000"><ul id="ul0087" list-style="none"><li id="ul0087-0001" num="0752"> Client-side binding (if needed) </li><li id="ul0087-0002" num="0753"> Client-side event </li><li id="ul0087-0003" num="0754"> If (Autopostback), trigger submit. </li></ul></li></ul>

0755On the server, the order of execution is: <ul id="ul0088" list-style="none"><li id="ul0088-0001" num="0000"><ul id="ul0089" list-style="none"><li id="ul0089-0001" num="0756"> Server-side binding (if needed) </li><li id="ul0089-0002" num="0757"> Server-side event. </li></ul></li></ul>

0758If the semantic item is programmatically changed in the server, no events (server or client side) will be thrown. If (BindOnChanged=false) and (Autopostback=true) and we have both Changed and Confirmed handlers, both events will be triggered, in order.

0759Changed events will be thrown in the server (if needed and handlers are set) even if the server-side value is the same as the previous one (didn't change apparently).

0760If AutoPostBack is set to true, the controls will cause two postbacks, synchronized with on Changed, and on Confirmed.

000015 Prompt Object

0761The prompt object contains information on how to play prompts. All the properties defined are read/write properties.

0762Rendered for voice-only. Not rendered for multimodal.

0000How Prompt Object is Used

0000Voice-Only

0763The Prompt object is a required element of the QA control. RunSpeech uses the Prompt object to select the appropriate text for the prompt and then play the prompt on the client.

0764After RunSpeech determines which QA to activate it either increments or initializes the count attribute of the QA. The count attribute is incremented if the QA being activated was the same QA that was active during the last loop through RunSpeech. The count attribute is initialized to count=1 if this is the first time the QA has been activated. The QA's count attribute may be used by the script specified in the PromptSelectFunction attribute of the Prompt object.

0765RunSpeech then sets out to determine which text will be synthesized and played back to the user. The dialog author has the option of providing a script function for prompt text that is complex to build, or simply specifying the prompt text as content of the Prompt object. If RunSpeech detects the existence of an author-specified PromptSelectFunction, it passes the text returned from the PromptSelectFunction to the speech platform for synthesis and playback to the user. Otherwise RunSpeech will pass the text in the content of the Prompt object to the speech platform.

0766If a serious or fatal error occurs during the synthesis process, the speech platform will fire the on Error event. RunSpeech receives this event, sets lastCommandOrException to “PromptError” and calls the script function specified by the OnClientError attribute. The dialog author may then choose to take appropriate action based upon the type of error that occurred.

0767After the prompt playback has finished, the speech platform fires the oncomplete event which is caught by RunSpeech. RunSpeech then looks for the Reco object associated with the current QA. If a Reco object is found (i.e., the QA is not just a prompting mechanism), RunSpeech requests the speech platform to start the recognition process.

0768Finally, RunSpeech examines the value of the PlayOnce attribute of the QA containing the Prompt object. If PlayOnce is true, RunSpeech disables the Prompt object for subsequent activations of this same QA.

0769If speech is detected during the playing of the prompt, the playback of the prompt will be stopped automatically by the platform. RunSpeech catches the onbargein event and halts execution. Since a prompt.OnComplete event may not follow a bargein, RunSpeech resumes when a listen event is received.

0770If a bookmark is encountered, Runspeech activates the function specified by the OnClientBookmark property.

0000Multimodal.

0771The Prompt object is not used in multimodal scenarios.

0000PromptSelectFunction

0772The following three examples illustrate using the PromptSelectionFunction to select or modify prompt text using the parameters available to PromptSelectFunction.

0773The first example shows how to use the count parameter to select a prompt based upon the number of times the QA has been activated. The scenario is:

0774A user calls a menu based service, enters password. Server-side processing determines the user's first and last name and inserts the name information into hidden textboxes (txtFirstName.value and txtLastName.value) on the welcome page. The welcome page contains a QA which prompts the user to enter the desired service. The QA's Prompt object is built to handle 1) the prompt to play for a first time pass and 2) the prompt to play if the user fails to select a service at the first prompting (i.e., the same QA is activated after a timeout expires). <tables id="TABLE-US-00068" num="68"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:QA id=″welcomeQA″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″welcomePrompt″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>PromptSelectFunction=″SelectWelcomePrompt″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>/></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=″welcomeReco″ mode=″automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar id=″welcomeGrammar″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>src=″http://mysite/services.xml″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″servicesAnswer″ SemanticItem</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="70PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>=</entry><entry>″siService″ runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:QA></entry></row><row><entry /><entry><script></entry></row><row><entry /><entry>function SelectWelcomePrompt(lastCommandOrException, count,</entry></row><row><entry /><entry>assocArray)</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>switch(count)</entry></row><row><entry /><entry>{</entry></row><row><entry /><entry>case 1: return “Welcome to Acme Services</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><SALT:value>txtFirstName.value</SALT:value>. Please select</entry></row><row><entry /><entry>the Email, Calendar or Stock service.”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>case 2: return “Welcome Please select the Email,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>Calendar or Stock service.”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>case 3: return “Welcome Please select the Email,</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>Calendar or Stock service.”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>default: return “I'm sorry</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry><SALT:value>txtFirstName.value</SALT:value>, we're having</entry></row><row><entry /><entry>communication problems. Good Bye.”;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0775The next example shows how to use the lastCommandOrException parameter to modify a prompt based upon a event previous event in the dialog. The scenario is:

0776A user is asked to provide the name of a departing airport. The QA contains a Prompt object that is built to handle the initial prompt, a prompt if the user asks for help, and a prompt if the user fails to respond (i.e. a timeout occurs). <tables id="TABLE-US-00069" num="69"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><speech:qa id=″qa1″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″prompt1″</entry></row><row><entry /><entry>PromptSelectFunction=″SelectDepartingAirport″ /></entry></row><row><entry /><entry><Reco id=″reco1″ mode=″automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar id=″gram1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>src=″http://mysite/NYAirport.xml″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″ans1″ SemanticItem=″siAns1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry></speech:qa></entry></row><row><entry /><entry><speech:command id=″command1″ runat=″server″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="98PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>XpathTrigger=″/sml/help″</entry><entry>scope=″qa1″ type=″HELP″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammar src=″http://mysite/help.xml″ runat=″server″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>/></entry></row><row><entry /><entry></speech:command></entry></row><row><entry /><entry><script></entry></row><row><entry /><entry>function SelectDepartingAirport (lastCommandOrException,</entry></row><row><entry /><entry>count, assocArray)</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>if (count==1) return “From which airport would you</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>like to depart?”;</entry></row><row><entry /><entry>switch(lastCommandOrException)</entry></row><row><entry /><entry>{</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><ul id="ul0090" list-style="none"><li id="ul0090-0001" num="0000"><ul id="ul0091" list-style="none"><li id="ul0091-0001" num="0777"> case “SILENCE”: return “I'm sorry I didn't catch that. From which airport would you like to depart?”; </li><li id="ul0091-0002" num="0778"> case “HELP”: return “You may choose from Kennedy, La Guardia, or that little airport on Long Island. From which airport would you like to depart?”; </li></ul></li></ul>

0779default return “What we have here is a failure to communicate. Good bye.”; <tables id="TABLE-US-00070" num="70"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="105PT" align="left" /><colspec colname="1" colwidth="112PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="91PT" align="left" /><colspec colname="1" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry></script></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0780The last example shows how to use the assocArray parameter to modify a prompt during a confirmation pass. The scenario is:

0781The user is asked to provide itinerary details: departing and arrival cities and travel date. The QA is constructed to implicitly confirm the departing and arrival city information and explicitly confirm the travel date. The Prompt object is built to provide appropriate prompting of items requiring confirmation. <tables id="TABLE-US-00071" num="71"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry><speech:qa id=″qa1″ runat=″server″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″prompt1″ InLinePrompt=″What is your</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="70PT" align="left" /><colspec colname="2" colwidth="147PT" align="left" /><tbody valign="top"><row><entry>desired</entry><entry>itinerary?″></Prompt></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=″reco1″ mode=″Automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar id=″grm1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="70PT" align="left" /><colspec colname="1" colwidth="147PT" align="left" /><tbody valign="top"><row><entry /><entry>src=″http://mysite/city_date.xml″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="84PT" align="left" /><colspec colname="1" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Answers></entry></row><row><entry /><entry><speech:answer id=″A1″ XpathTrigger=″/sml/departCity″</entry></row><row><entry /><entry>SemanticItem=″siTb1″ ConfirmThreshold=″0.90″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″A2″ XpathTrigger=″/sml/arrivalCity″</entry></row><row><entry /><entry>SemanticItem=″siTb2″ ConfirmThreshold=″0.90″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″A3″ XpathTrigger=″/sml/departDate″</entry></row><row><entry /><entry>SemanticItem=″siTb3″ ConfirmThreshold=″1.00″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Answers></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry></speech:qa></entry></row><row><entry><speech:qa id=″qa2″ runat=″server″</entry></row><row><entry>XpathDenyConfirms=″/sml/deny″</entry></row><row><entry>XpathAcceptConfirms=″/sml/accept″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Prompt id=″prompt2″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>PromptSelectFunction=″myPromptFunction″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><Reco id=″reco2″ mode=″automatic″></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:grammar id=″grm2″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>src=″http://mysite/cityANDdateANDyes_no.xml″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry></Grammars></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Reco></entry></row><row><entry /><entry><Confirms></entry></row><row><entry /><entry><speech:answer id=″conf1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="112PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry>XpathTrigger=″/sml/departCity″</entry><entry>SemanticItem=″siTb1″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>ConfirmThreshold=″0.90″ runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″conf2″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="112PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry>XpathTrigger=″/sml/arrivalCity″</entry><entry>SemanticItem=″siTb2″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>ConfirmThreshold=″0.90″ runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:answer id=″conf3″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>XpathTrigger=″/sml/departDate″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>SemanticItem=″siTb2″ ConfirmThreshold=″1.00″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>runat=″server″ /></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Confirms></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry></speech:qa></entry></row><row><entry><script></entry></row><row><entry>function myPromptFunction(lastCommandOrException, count,</entry></row><row><entry>assocArray)</entry></row><row><entry>{</entry></row><row><entry>var promptext = ”Did you say “;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>if (assocArray[“siTb1”] !=null && assocArray[“siTb1”]</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>!=””)</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>promptText += “from” + assocArray[“siTb1”];</entry></row><row><entry /><entry>return promptText;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry>if (assocArray[“siTb2”] !=null && assocArray[“siTb2”]</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>!=””)</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>promptText += “to” + assocArray[“siTb2”];</entry></row><row><entry /><entry>return promptText;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry>if (assocArray[“siTb1”] !=null && assocArray[“siTb3”]</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>!=””)</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry>promptText += “on” + assocArray[“siTb3”];</entry></row><row><entry /><entry>return promptText;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>}</entry></row><row><entry></script></entry></row><row><entry>class Prompt : Control</entry></row><row><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="77PT" align="left" /><colspec colname="2" colwidth="112PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry>string</entry><entry>type{get; set;};</entry></row><row><entry /><entry>bool</entry><entry>prefetch{get; set};</entry></row><row><entry /><entry>string</entry><entry>lang{get; set;};</entry></row><row><entry /><entry>bool</entry><entry>bargein{get; set;};</entry></row><row><entry /><entry>string</entry><entry>src{get; set;};</entry></row><row><entry /><entry>string</entry><entry>PromptSelectFunction{get; set;};</entry></row><row><entry /><entry>string</entry><entry>OnClientBookmark{get; set;};</entry></row><row><entry /><entry>string</entry><entry>OnClientError{get; set;};</entry></row><row><entry /><entry>string</entry><entry>InlinePrompt{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="91PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><tbody valign="top"><row><entry /><entry>ParamCollection</entry><entry>Params{get; set:};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="1"><colspec colname="1" colwidth="217PT" align="left" /><tbody valign="top"><row><entry>}</entry></row><row><entry namest="1" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 15.1 Prompt Properties

0782All properties of the Prompt object are available at design time.

0000Type

0783Optional. Only used in voice-only mode. The mime-type corresponding to the speech output format used. No default value. The type attribute mirrors the type attribute on the SALT Prompt object.

0000Prefetch

0784Optional. Only used in voice-only mode. Flag to indicate whether the prompt should be immediately synthesized and cached at browser when the page is loaded. Default value is false. The prefetch attribute mirrors the prefetch attribute on the SALT Prompt object.

0000Lang

0785Optional. Only used in voice-only mode. Specifies the language of the prompt content. The value of this attribute follows the RFC xml:lang definition. Example: lang=“en-us” denotes US English. No default value. If specified, this over-rides the value set in the Web.config file. The lang attribute mirrors the lang attribute on the SALT Prompt object.

0000Bargein

0786Optional. Used only for voice-only mode. Flag that indicates whether or not the speech platform is responsible for stopping prompt playback when speech or DTMF input is detected. If true, the platform will stop the prompt in response to input and flush the prompt queue. If false, the platform will take no default action. If unspecified, default to true.

0000PromptSelectFunction

0787Optional. Only used in voice-only mode. Specifies a client-side function that allows authors to select and/or modify a prompt string prior to playback. The function returns the prompt string. PromptSelectFunction is called once the QA has been activated and before the prompt playback begins. If PromptSelectFunction is specified, src and InLinePrompt are ignored.

0788The signature for PromptSelectFunction is as follows: <ul id="ul0092" list-style="none"><li id="ul0092-0001" num="0789"> String PromptSelectFunction(string lastCommandOrException, int Count, object SemanticItemList) <br /> where: <ul id="ul0093" list-style="none"><li id="ul0093-0001" num="0790"> lastCommandOrException is a Command type (e.g., “Help”) or a Reco event (e.g., “Silence” or “NoReco”). </li></ul></li><li id="ul0092-0002" num="0791"> Count is the number of times the QA has been activated consecutively. Count starts at 1 and has no limit. </li><li id="ul0092-0003" num="0792"> SemanticItemList For voice-only mode, SemanticItemList is an associative array that maps semantic item id to semantic item objects. For multimodal, SemanticItemList will be null. </li></ul>

0793If the PromptSelectFunction is being called from within a Prompt object specified by a CustomValidator control, the SemanticItemList will contain the SemanticItem being validated.

0794If the PromptSelectFunction is being called from within a Prompt object specified by a CompareValidator control, the SemanticItemList will contain the SemanticItem being validated and (if specified) the SemanticItem to which it is being compared.

0000OnClientBookmark

0795Optional. Only used in voice-only mode. Specifies a client side function which is called when a Bookmark is reached in the prompt text during playback. The function does not return a value. The signature for OnClientBookmark is as follows: <ul id="ul0094" list-style="none"><li id="ul0094-0001" num="0000"><ul id="ul0095" list-style="none"><li id="ul0095-0001" num="0796"> function OnClientBookmark( ) <br /> OnClientError </li></ul></li></ul>

0797Optional. Only used in voice-only mode. Specifies a client side function which is called in response to an error event in the client. Error events are generated from the event object. The function returns a Boolean value. The RunSpeech algorithm will continue executing if an OnClientError script returns true. The RunSpeech algorithm will navigate to the default error page specified in the Web.config file if an OnClientError script returns false or if an error occurs and the OnClientError function is not specified. When navigating to the error page, both status and description will be passed in the query string. For example, if the error page is http://myErrorPage, we will navigate to http://myErrorPage?status=X&description=Y (where X is the status code associated with the error and Y is the description of that error given in the Speech Tags Specification. The signature for OnClientError is as follows: <ul id="ul0096" list-style="none"><li id="ul0096-0001" num="0000"><ul id="ul0097" list-style="none"><li id="ul0097-0001" num="0798"> bool OnClientError(int status) <br /> where status is the code returned in the event object. </li></ul></li></ul>

0799Note: For the SDK Beta release, it is advisable to specify a default error page using the syntax described in Section 5 Global Application Settings

0000InlinePrompt

0800Optional. Only used in voice-only mode. The text of th prompt to be played. It may contain further markup, as in TTS rendering information, or <value> elements. If a PromptSelectFunction function is specified, the InlinePrompt is ignored.

0000StyleReference

0801Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the Prompt object will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values by the Prompt object will override those set on the referenced Style.

0000Params

0802Optional. An collection of param objects that specify additional, non-standard configuration parameter values to the speech platform. The exact nature of the configurative parameters will differ according to the proprietary platform used. Values of parameters may be specified in an XML namespace, in order to allow complex or structured values. An exception will be thrown if the Params collection contains a non-param object.

0803For example, the following syntax could be used to specify the location of a remote prompt engine for distributed architectures: <tables id="TABLE-US-00072" num="72"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Params></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:param name=″promptServer″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=”server”>//myplatform/promptServer</speech:param></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="189PT" align="left" /><tbody valign="top"><row><entry /><entry></Params></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 16 Reco Object

0804Reco is rendered for both multimodal and voice-only modes.

0805The Reco object is used to specify speech input resources and features as well as provide for the management of cases when vaild recognition results are not returned.

0000How Reco Object is Used.

0000Voice-Only

0806During the processing of the Prompt object, RunSpeech determines whether or not the currently active QA contains a Reco object. If it does, RunSpeech asks the speech platform to start the recognition process using the grammar specified by the Reco's Grammar object. RunSpeech calls the function specified by OnClientListening immediately after activating the Reco's underlying <listen> tag. The recognition process is stopped depending on the value of the mode attribute. RunSpeech processes successful recognition results using information specified in the Answer object.

0807RunSpeech uses the Reco object to handle the situations when the speech platform is not able to return valid recognition results, i.e., speech platform errors, timeouts, silence, or inability of the speech platform to recognize an utterance. In each of these cases, RunSpeech calls the appropriate handler (if specified) after setting the value of the lastCommandOrException attribute.

0000Multimodal

0808The Reco object is used by the Multimodal.js client-side script just as it is used by the RunSpeech voice-only client-side script (as described above) with one exception, starting/stopping the recognition process. Multimodal scenarios do not require speech output as a mechanism to prompt the user for input. In fact, prompting in speech controls is not available in multimodal scenarios as the Prompt object is not rendered to the client. Therefore, an alternate mechanism is required to start the recognition process.

0809Multimodal.js uses the event specified in the StartElement/StartEvent attributes to start the recognition process. The function specified by the OnClientListening attribute is called after the recognition process has started. Multimodal.js uses the combination of the StopEvent and mode attributes to stop the recognition process. <tables id="TABLE-US-00073" num="73"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class Reco : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StartElement{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StartEvent{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StopElement{get; set;};</entry></row><row><entry /><entry>string</entry><entry>StopEvent{get; set;};</entry></row><row><entry /><entry>int</entry><entry>initialTimeout{get; set;};</entry></row><row><entry /><entry>int</entry><entry>babbleTimeout{get; set;};</entry></row><row><entry /><entry>int</entry><entry>maxTimeout{get; set;};</entry></row><row><entry /><entry>int</entry><entry>endSilence{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="70PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry>float</entry><entry>reject{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>mode{get; set;};</entry></row><row><entry /><entry>string</entry><entry>lang{get; set;};</entry></row><row><entry /><entry>string</entry><entry>GrammarSelectFunction{get; set;};</entry></row><row><entry /><entry>string</entry><entry>OnClientSpeechDetected{get; set;};</entry></row><row><entry /><entry>string</entry><entry>OnClientSilence{get; set;};</entry></row><row><entry /><entry>string</entry><entry>OnClientNoReco{get; set;};</entry></row><row><entry /><entry>string</entry><entry>OnClientError{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="70PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="98PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry>GrammarCollection</entry><entry>Grammars{get; set;};</entry></row><row><entry /><entry>ParamCollection</entry><entry>Params{get;set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="70PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry>Control</entry><entry>record{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 16.1 Reco Properties

0810All properties are available at design time.

0000Start Element

0811Optional, but must be present if StartElement is specified. Used only in multimodal mode. Specifies the name of the GUI element with which the start of the Reco is associated. See StartEvent. No default value.

0000StartEvent

0812Optional, but must be present if StartElement is specified. Only used in multimodal mode. Specifies the name of the event that will activate (start) the underlying client-side Reco object. See start Element No default value.

0000Start Element

0813Optional, but must be present if StopElement is specified. Used only in multimodal mode. Specifies the name of the GUI element with which the stop of the Reco is associated. See StopEvent. No default Value.

0000StopEvent

0814Optional, but must be present if StartElement is specified. Only used in multimodal mode. Specifies the name of the event that will stop the underlying client-side Reco object. See stop Element. No default value.

0815StartEvent and StopEvent will be used in multi-modal applications, typically for tap-and-talk interactions. E.g. StartEvent=Button1.onmousedown, StopEvent=Button1.onmouseup.

0816StartEvent and StopEvent are allowed to be the same (click to start, click to stop). However, it is the author's responsibility to de-activate Recos before starting new ones in the case when the end user fires two StartEvents in succession (e.g., click on one control to start a reco then click on a different control to start another reco before stopping first reco).

0817Note: IE requires exact cases when running Jscript. Therefore, the the case for event values specified in the StartEvent and StopEvent attributes must be exactly as those events are defined. For example, the onmouseup and onmousedown events are specified in all lower case letters.

0818Note: StartEvent and StopEvent are not rendered for voice-only mode.

0000initialTimeout

0819Optional. Used in both multimodal and voice-only modes. The max time in milliseconds between start of recognition and the detection of speech. This value is passed to the recognition platform, and if exceeded, an on Silence event will be thrown from the recognition platform. If not specified, the speech platform will use a default value. No default value. An exception will be thrown for non-integer or negative integer value.

0820Note: The sum of the initialTimeout and babbleTimeout values should be smaller or equal to the global maxTimeout attribute or the Reco attribute maxTimeout (see below) if it is set.

0821Note: The initialTimeout attribute mirrors the initialTimeout attribute on the SALT Reco object.

0000babbleTimeout

0822Optional. Used in both multimodal and voice-only modes. Optional. The maximum period of time in milliseconds for an utterance. For recos in automatic and single mode, this applies to the period between speech detection and the speech endpoint or stop call. For recos in ‘multiple’ mode, this timeout applies to the period between speech detection and each phrase recognition—i.e. the period is restarted after each return of results or other event. If exceeded, the onnoreco event is thrown with status code −15. This can be used to control when the recognizer should stop processing excessive audio. For automatic mode listens, this will happen for exceptionally long utterances, for example, or when background noise is mistakenly interpreted as continuous speech. For single mode listens, this may happen if the user keeps the audio stream open for an excessive amount of time (eg by holding down the stylus in tap-and-talk). If the attribute is not specified, the speech platform will use a default value.

0823No default value. An exception will be thrown for non-integer or negative integer values.

0824Note: The sum of the initialTimeout and babbleTimeout values should be smaller or equal to the global maxTimeout attribute or the Reco attribute maxTimeout (see below) if it is set.

0825Note: The babbleTimeout attribute mirrors the babbleTimeout attribute on the SALT Reco object.

0000maxTimeout

0826Optional. Used in both multimodal and voice-only modes. The period of time in milliseconds between recognition start and results returned to the browser. If exceeded, an OnError event is thrown by the browser—this provides for network or recognizer failure in distributed environments. For Recos in “multiple” mode, as with babbleTimeout, the period is restarted after the return of each recognition or other event. No default value. An exception will be thrown for non-integer or negative integer values.

0827Note: maxTimeout should be greater than or equal to the sum of initialTimeout and babbleTimeout. If specified, the value of this attribute over-rides the value of maxTimeout set in the Web.config file. No default value.

0828Note: The maxTimeout attribute mirrors the maxTimeout attribute on the SALT Reco object.

0000endSilence

0829Optional. Used in both multimodal and voice-only modes. For Reco objects in “automatic” mode, the period of silence in milliseconds after the end of an utterance which must be free of speech after which the recognition results are returned. Ignored for Recos of modes other than “automatic”. If not specified, defaults to platform internal value. An exception will be thrown for non-integer or negative integer values.

0000Reject

0830Optional. Used in both multimodal and voice-only modes. Specifies the rejection threshold, below which the platform will throw the noReco event. If not specified, the speech platform will use an internal default value. Legal values are 0-1 and are platform specific. An exception will be thrown for out of range reject values. Default is 0.

0000Lang

0831Optional. Used in both multimodal and voice-only modes. Specifies the language of the speech recognition engine. The value of this attribute follows the RFC xml:lang definition. Example: lang=“en-us” denotes US English. No default value. This over-rides the global setting in the Web.config file. The lang attribute mirrors the lang attribute on the SALT Reco object.

0000Mode

0832Optional. Used in both multimodal and voice-only modes. Specifies the recognition mode to be followed. Default is “automatic”. Legal values are “automatic”, “single”, and “multiple”.

0000Mode=“Automatic”

0833Used for recognitions in telephony scenarios. The speech platform itself (not the application) is in control of when to stop the recognition process. Mode=“automatic” is the only mode setting that works in voice-only, other modes will be ignored and “automatic” will be used.

0000Mode=“Single”

0834Used for multimodal (tap-to-talk) scenarios. The return of a recognition result is under the control of an explicit call to stop the recognition process by the application. However, exceeding babbleTimeout or maxTimeout will stop recognition. Mode=“single” is ignored for voice-only.

0000Mode=“Multiple”

0835Used for “open-microphone” or dictation scenarios. Recognition results are returned at intervals until the application makes an explicit call to stop the recognition process (or babbleTimeout or maxTimeout periods are exceeded). Multiple mode recos are not supported in voice-only mode dialogs. If the browser is a voice-only browser and reco mode is set to “multiple”, an exception will be thrown at render time. Mode=“multiple” is ignored for voice-only.

0000GrammarSelectFunction

0836Optional. Used in both multimodal and voice-only modes. Specifies a client-side script that will be called prior to starting the recognition process. The script is written by the dialog author and may be used to select or modify the Grammar objects associated with the Reco object. The script may also be used to adjust speech recognition features or confidence/rejection thresholds. The GrammarSelectFunction function does not return values. The signature for GrammarSelectFunction is as follows: <ul id="ul0098" list-style="none"><li id="ul0098-0001" num="0000"><ul id="ul0099" list-style="none"><li id="ul0099-0001" num="0837"> function GrammarSelectFunction(object recoObj, string lastCommandOrException, int Count, object SemanticItemList) <br /> where: </li></ul></li><li id="ul0098-0002" num="0838"> recoObj is the Reco object about to start. </li><li id="ul0098-0003" num="0839"> lastCommandOrException is a Command type (e.g., “Help”) or a Reco event (e.g., “Silence” or “NoReco”). For multimodal dialogs, lastCommandOrException will be an empty string </li><li id="ul0098-0004" num="0840"> Count is the number of times the QA containing the Reco object has been activated consecutively. Count starts at 1 and has no limit. For multimodal dialogs, count will be zero. </li><li id="ul0098-0005" num="0841"> SemanticItemList For voice-only mode, SemanticItemList is an associative array that maps semantic item id to semantic item objects. For multimodal dialogs, SemanticItemList will be null. <br /> OnClientSpeechDetected </li></ul>

0842Optional. Used in both multimodal and voice-only modes. Specifies a client-side script function that will be called when the onspeechdetected event is fired by the speech recognition platform on the detection of speech. Determining the actual time of firing is left to the platform (which may be configured on certain platforms using the <param> element. This may be anywhere between simple energy detection (early) or complete phrase or semantic value recognition (late). This event also triggers onbargein on a prompt which is in play and may disable the initial timeout of a started dtmf object. This function can be used in multimodal scenarios, for example, to generate a graphical indication that recognition is occurring, or in voice-only scenarios to enable fine control over other processes underway during recognition. The function does not return any values. The signature for OnClientSpeechDetected is as follows: <ul id="ul0100" list-style="none"><li id="ul0100-0001" num="0000"><ul id="ul0101" list-style="none"><li id="ul0101-0001" num="0843"> function OnClientSpeechDetected( ) </li></ul></li></ul>

0844If a Dtmf object is active when the OnClientSpeechDetected function is called, the timeouts of the Dtmf object will be disabled.

0000OnClientSilence

0845Optional. Used in both multimodal and voice-only modes. Specifies a client-side script that will be called after detecting silence (in response to SALT reco on Silence event). The function does not return any values. The signature for OnClientSilence is as follows: <ul id="ul0102" list-style="none"><li id="ul0102-0001" num="0000"><ul id="ul0103" list-style="none"><li id="ul0103-0001" num="0846"> function OnClientSilence(int status) <br /> where status is the code returned in the event object. </li></ul></li></ul>

0847If a Dtmf object is active when the OnClientSilence function is called, the Dtmf object will be stopped.

0000OnClientNoReco

0848Optional. Used in both multimodal and voice-only modes. Specifies a client-side script that will be called after detecting no recognition (in response to SALT reco on NoReco event). The function does not return any values. The signature for OnClientNoReco is as follows: <ul id="ul0104" list-style="none"><li id="ul0104-0001" num="0000"><ul id="ul0105" list-style="none"><li id="ul0105-0001" num="0849"> function OnClientNoReco(int status) <br /> where status is the code returned in the event object. </li></ul></li></ul>

0850If a Dtmf object is active when the OnClientNoReco function is called, the Dtmf object will be stopped.

0000OnClientError

0851Optional. Used in both multimodal and voice-only modes. Specifies a client side function which is called in response to an error event in the client. Error events are generated from the event object. The function returns a boolean value. The RunSpeech algorithm will continue executing if an OnClientError script returns true. The RunSpeech algorithm will navigate to the default error page specified in the Web.config file if an OnClientError script returns false or if an error occurs and the OnClientError function is not specified. When navigating to the error page, both status and description will be passed in the query string. For example, if the error page is http://myErrorPage, we will navigate to http://myErrorPage?status=X&description=Y (where X is the status code associated with the error and Y is the description of that error given in the Speech Tags Specification. The signature for OnClientError is as follows: <ul id="ul0106" list-style="none"><li id="ul0106-0001" num="0000"><ul id="ul0107" list-style="none"><li id="ul0107-0001" num="0852"> bool OnClientError(int status) <br /> where status is the code returned in the event object. </li></ul></li></ul>

0853Note: the return value of OnClientError is ignored in multimodal mode.

0854If a Dtmf object is active when the OnClientError function is called, the Dtmf object will be stopped.

0000StyleReference

0855Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the Reco object will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values by the Reco object will override those set on the referenced Style.

0000Grammars

0856Optional. An array of grammar objects as specified below. An exception will be thrown if a Grammars collection contains a non-grammar object.

0000Params

0857Optional. Used in both multimodal and voice-only modes. An collection of param objects that specify additional, non-standard configuration parameter values to the speech platform. The exact nature of the configurative parameters will differ according to the proprietary platform used. Values of parameters may be specified in an XML namespace, in order to allow complex or structured values. An exception will be thrown if the Params collection contains a non-param object.

0858For example, the following syntax could be used to specify the location of a remote speech recognition server for distributed architectures: <tables id="TABLE-US-00074" num="74"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Params></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="28PT" align="left" /><colspec colname="1" colwidth="91PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:param</entry><entry>name=″recoServer″</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>runat=”server”>//myplatform/recoServer</speech:param></entry></row><row><entry /><entry></Params></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Record

0859Optional. Used in both multimodal and voice-only modes. The record object is used for recording audio input from the user. Recording may be used in addition to recognition or in place of it, according to the abilities of the platform and its profile. Only one record object is permitted in a single <reco>.

000017 Grammar Object

0860The grammar object contains information on the selection and content of grammars, and the means for processing recognition results. All the properties defined are read/write properties. <tables id="TABLE-US-00075" num="75"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class Grammar : Control</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="42PT" align="left" /><colspec colname="2" colwidth="42PT" align="left" /><colspec colname="3" colwidth="112PT" align="left" /><tbody valign="top"><row><entry /><entry>{</entry><entry /><entry /></row><row><entry /><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>type{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>lang{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>src{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>InLineGrammar{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 17.1 Grammar Properties

0861Grammar is rendered for both multimodal and voice-only modes. All properties are available at design time and run time.

0000Type

0862Optional. Used in both multimodal and voice-only modes. The mime-type corresponding to the grammar format used. No default value. The type attribute mirrors the type attribute on the SALT Grammar object.

0000Lang

0863Optional. Used in both multimodal and voice-only modes. String indicating which language the grammar refers to. The value of this attribute follows the RFC xml:lang definition. Example: lang=“en-us” denotes US English. No default value. Over-rides the global value set in the Web.config file. The lang attribute mirrors the lang attribute on the SALT Grammar object.

0000src

0864Optional. Used in both multimodal and voice-only modes. Specifies the URI of the grammar to load. If an inline grammar and src are both specified the inline grammar takes precendence and src is ignored. The src attribute mirrors the src attribute on the SALT Grammar object. An exception will be thrown if one of src or InlineGrammar is not specified.

0000InlineGrammar

0865Optional. Used in both multimodal and voice-only modes InlineGrammar accesses the text of the grammar specified inline. If InlineGrammar and src are both specified, InlineGrammar takes precendence and src is ignored. An exception will be thrown if one of src or InlineGrammar is not specified.

0866Inline grammars must be HTML Encoded, they are HTML encoded when sent down to the server. Authors must use &gt for > and &lt for < and adhere to all other HTML Encoding standards. It is recommended that authors use the property builder in DET, which will handle the HTML encoding automatically.

0000StyleReference

0867Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the Grammar object will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values by the Grammar object will override those set on the referenced Style.

000018 Dtmf Object

0868Dtmf may be used by QA controls in telephony applications. The Dtmf object essentially applies a different modality of grammar (a keypad input grammar rather than a speech input grammar) to the same question. <tables id="TABLE-US-00076" num="76"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class Dtmf : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="49PT" align="left" /><colspec colname="3" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>id{get; set;};</entry></row><row><entry /><entry /><entry>bool</entry><entry>preflush{get; set;};</entry></row><row><entry /><entry /><entry>int</entry><entry>initialTimeOut{get; set;};</entry></row><row><entry /><entry /><entry>int</entry><entry>interDigitTimeOut{get; set;};</entry></row><row><entry /><entry /><entry>int</entry><entry>endSilence{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientSilence{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientKeyPress{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientError{get; set;};</entry></row><row><entry /><entry /><entry>string</entry><entry>StyleReference{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="21PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><colspec colname="3" colwidth="91PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>ParamCollection</entry><entry>Params{get; set;};</entry></row><row><entry /><entry /><entry>GrammarCollection</entry><entry>Grammars{get;set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="203PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 18.1 Dtmf Properties

0869All properties are available at design time.

0000Preflush

0870Optional. Flag to indicate whether to automatically flush the DTMF buffer on the underlying telephony interface card before activation. Default is “false” (to enable type-ahead functionality). The preflush attribute mirrors the preflush attribute on the SALT DTMF object.

0000InitialTimeOut

0871Optional. The number of milliseconds to wait for receiving the first key press before raising a timeout event. If this timeout occurs the DTMF collection end automatically. If unspecified, initialTimeout defaults to a telephony platform internal setting. An exception is thrown if initialTimeout is a negative value. The initialTimeout attribute mirrors the initialTimeout attribute on the SALT DTMF object.

0000InterdigitTimeOut

0872Optional. The timeout period in milliseconds for adjacent DTMF presses before raising a timeout event. If this timeout occurs the DTMF collection ends automatically. If unspecified, interdigitTimeout defaults to a telephony platform internal setting. An exception is thrown if initialTimeout is a negative value. The interdigitTimeout attribute mirrors the interdigitTimeout attribute on the SALT DTMF object.

0000EndSilence

0873Optional. The timeout period in milliseconds when input matches a complete path through the grammar but further input is still possible. This timeout specifies the period of time in which further input is permitted after the complete match. Once exceeded, onreco is thrown. (For a complete grammar match where further input is not possible, the endsilence period is not required, and onreco is thrown immediately.) If this attribute is not supported directly by a platform, or unspecified in the application, the value of endsilence defaults to that used for interdigittimeout. An exception is thrown if endSilence is a negative value.

0000OnClientSilence

0874Optional. Specifies a client-side script function to be called if there is no DTMF key press before initialTimeout expires. The platform halts DTMF collection automatically. The QA treats this as a silence. The function returns no values. The signature for OnClientSilence is as follows: <ul id="ul0108" list-style="none"><li id="ul0108-0001" num="0000"><ul id="ul0109" list-style="none"><li id="ul0109-0001" num="0875"> function OnClientSilence( ) </li></ul></li></ul>

0876If a Reco object is active when the OnClientSilence function is called, the Reco object will be stopped.

0000OnClientKeyPress

0877Optional. Specifies a client-side script function that is called on every pressing of a DTMF key which is legal according to the input grammar. If a prompt is in playback, the onkeypress event will trigger the onbargein event on the prompt (and cease its playback if the prompt's bargein attribute is set to true). If a Reco object is active, the first onkeypress event will disable the timeouts of the Reco object.

0000OnClientError

0878Optional. Specifies a client-side function which is called in response to a serious or fatal error with the DTMF collection/recognition process. Error events are generated from the event object. The function returns a boolean value. The RunSpeech algorithm will continue executing if an OnClientError script returns true. The RunSpeech algorithm will navigate to the default error page specified in the Web.config file if an OnClientError script returns false or if an error occurs and the OnClientError function is not specified. When navigating to the error page, both status and description will be passed in the query string. For example, if the error page is http://myErrorPage, we will navigate to http://myErrorPage?status=X&description=Y (where X is the status code associated with the error and Y is the description of that error given in the Speech Tags Specification. The signature for OnClientError is as follows: <ul id="ul0110" list-style="none"><li id="ul0110-0001" num="0000"><ul id="ul0111" list-style="none"><li id="ul0111-0001" num="0879"> bool OnClientError(int status) <br /> where status is the code returned in the event object. </li></ul></li></ul>

0880If a Reco object is active when the OnClientError function is called, the Reco object will be stopped.

0000OnClientNoReco

0881Optional. Specifies a client side function which is called in response to a failure to recognize by the DTMF collection/recognition process. This is most lokely to occur when the input detected does not match an path through the active grammars. The function does not need to return a value. The prototype for the function is: <ul id="ul0112" list-style="none"><li id="ul0112-0001" num="0000"><ul id="ul0113" list-style="none"><li id="ul0113-0001" num="0882"> OnClientNoReco(int status) <br /> Where status is the code returned the in the event object. <br /> StyleReference </li></ul></li></ul>

0883Optional. Used in both multimodal and voice-only modes. Specifies the name of a Style object. At render time, the Dtmf object will search for the named Style control and will use any property values specified on the Style as default values for its own properties. Explicitly set property values by the Dtmf object will override those set on the referenced Style.

0000Grammars

0884Optional. An array of grammar objects.

0000Params

0885An collection of param objects that specify additional, non-standard configuration parameter values to the speech platform. The exact nature of the configurative parameters will differ according to the proprietary platform used. Values of parameters may be specified in an XML namespace, in order to allow complex or structured values. An exception will be thrown if the Params collection contains a non-param object.

0886For example, the following syntax shows how to specify a parameter on particular DTMF platform. <tables id="TABLE-US-00077" num="77"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry><Params></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="63PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry><speech:param</entry><entry>name=″myDTMFParam″</entry></row><row><entry /><entry>runat=”server”></entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>myDTMFValue </speech:param></entry></row><row><entry /><entry></Params></entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 19 Param Object

0887The param object allows authors to specify the names and values of additional, non-standard configuration parameters to the speech platform. The exact nature of the configurative parameters will differ according to the proprietary platform used. Values of parameters may be specified in an XML namespace, in order to allow complex or structured values. <tables id="TABLE-US-00078" num="78"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class param : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="63PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>name{get; set;};</entry></row><row><entry /><entry>string</entry><entry>Value{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0888Note that the value of a param object is specified between the param tags.

000019.1 Param Properties

0000Name

0889Required. The name of the parameter to be configured. An exception will be thrown for <param> elements that do not contain the name attribute.

0000Value

0890Optional. The value which will be assigned to the named parameter.

000020 Record Object

0891The record object is used to record audio input from the user. Recording may be used in addition to recognition or in place of it, according to the abilities of the platform and its profile. <tables id="TABLE-US-00079" num="79"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class record : Control</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="63PT" align="left" /><colspec colname="2" colwidth="105PT" align="left" /><tbody valign="top"><row><entry /><entry>bool</entry><entry>enabled{get; set;};</entry></row><row><entry /><entry>string</entry><entry>type{get; set;};</entry></row><row><entry /><entry>bool</entry><entry>beep{get; set;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="182PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 20.1 Record Properties <br /> Enabled

0892Optional. Flag to indicate whether or not to record the user input. Defaults to “false”.

0000Type

0893Optional. MIME type of the recording. MIME types can be specified such as “audio/wav” for WAV (RIFF header) 8 kHz 8-bit mono mu-law [PCM] single channel or “audio/basic” for Raw (headerless) 8 kHz 8-bit mono mu-law [PCM] single channel. If unspecified, defaults to G.711 wave file.

0000Beep

0894Optional. Boolean value, if true, the platform will play a beep before recording begins. Defaults to false.

000021 Call Control

0895All call-related server-side controls deal with a single device and a single active call at any given time. If the dialog author needs to monitor more than one device or handle more than one active call, the custom SmexMessage can be used and the author will have to handle CSTA messages.

0896All call control controls are only used in voice-only mode.

0897The SpeechControls.dll will implement a support class (CallInfo), a base class (SmexMessageBase), and the following WebControls: <ul id="ul0114" list-style="none"><li id="ul0114-0001" num="0000"><ul id="ul0115" list-style="none"><li id="ul0115-0001" num="0898"> SmexMessage <ul id="ul0116" list-style="none"><li id="ul0116-0001" num="0899"> for custom/advanced CSTA messages, and messages to any non-CSTA <smex> elements by specifying a client side <smex> element </li></ul></li><li id="ul0115-0002" num="0900"> TransferCall <ul id="ul0117" list-style="none"><li id="ul0117-0001" num="0901"> for CSTA SingleStepTransfer service </li></ul></li><li id="ul0115-0003" num="0902"> MakeCall <ul id="ul0118" list-style="none"><li id="ul0118-0001" num="0903"> for CSTA MakeCall service </li></ul></li><li id="ul0115-0004" num="0904"> DisconnectCall <ul id="ul0119" list-style="none"><li id="ul0119-0001" num="0905"> for CSTA ClearConnection service </li></ul></li><li id="ul0115-0005" num="0906"> AnswerCall <ul id="ul0120" list-style="none"><li id="ul0120-0001" num="0907"> for CSTA AnswerCall service <br /> 21.1 Common Classes </li></ul></li></ul></li></ul>

090821.1.1 CallInfo <tables id="TABLE-US-00080" num="80"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class CallInfo</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="154PT" align="left" /><tbody valign="top"><row><entry /><entry>string MonitorCrossRefId {get;};</entry></row><row><entry /><entry>string DeviceId {get;};</entry></row><row><entry /><entry>string CallId {get;};</entry></row><row><entry /><entry>string CallingDevice {get;};</entry></row><row><entry /><entry>string CalledDevice {get;};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.1.1.1 CallInfo Properties

0909MonitorCrossRefId: The id returned by the start page's MonitorStart.

0910DeviceId: The device id for the current active call.

0911CallId: The call id for the current active call. These properties can be used in the custom SmexMessage object to form the correct CSTA xml message on the web server side.

0912CallingDevice: This represents the calling device information provided by the network (ANI, for example). This information will always remain with the call and will never change (unlike the callingDevice).

0913CalledDevice: This represents the called device information provided by the network (DNIS, for example). This information will always remain with the call and will never change (unlike the calledDevice).

000021.1.2 SmexMessageBase

0914This is an internal class. Authors that need to create new call-control controls should derive from SmexMessage. <tables id="TABLE-US-00081" num="81"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>internal class abstract SmexMessageBase</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="35PT" align="left" /><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="133PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>ID {get; set };</entry></row><row><entry /><entry>int</entry><entry>Timer (get; set};</entry></row><row><entry /><entry>bool</entry><entry>AutoPostback {get; set};</entry></row><row><entry /><entry>string</entry><entry>ClientActivationFunction {get; set});</entry></row><row><entry /><entry>string</entry><entry>OnClientError {get, set};</entry></row><row><entry /><entry>string</entry><entry>OnClientTimeout {get; set};</entry></row><row><entry /><entry>CallInfo</entry><entry>CurrentCall {get; }</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.1.2.1 SmexMessageBase Properties

0915ID: ASP.NET control ids.

0916SpeechIndex: Same as for other speech controls controls. This index controls the order of the object within RunSpeech. Default 0, meaning source order after all non-zero indexed speech objects.

0917Timer: Number in milliseconds indicating the time span before a timeout event will be triggered. This set on the client side <smex> object before the CSTA message is sent. The default is 0, meaning no timeout. An exception will be thrown for neagtive values of Timer.

0918AutoPostback: Whether to cause a postback when the object's event is fired. Default is false.

0919ClientActivationFunction: The client side function called by RunSpeech to determine whether an object is active. When not specified, the object is considered active only once (the PlayOnce behavior). ClientActivationFunction returns a bool to indicate whether the associated object should be active (true) or not (false). The signature for ClientActivationFunction is: <ul id="ul0121" list-style="none"><li id="ul0121-0001" num="0000"><ul id="ul0122" list-style="none"><li id="ul0122-0001" num="0920"> function ClientActivationFunction(object sender) <br /> where sender is the current object </li></ul></li></ul>

0921OnClientError: Optional. Default is false when not specified. The client side function called when <smex> fires the onerror event. OnClientError returns a bool—true to continue RunSpeech and false to go to the error page. The signature for OnClientError is: <ul id="ul0123" list-style="none"><li id="ul0123-0001" num="0000"><ul id="ul0124" list-style="none"><li id="ul0124-0001" num="0922"> function OnClientError(object sender, int status) <br /> where </li></ul></li><li id="ul0123-0002" num="0923"> sender is the current object, and </li><li id="ul0123-0003" num="0924"> status is the value of the object's status property. </li></ul>

0925OnClientTimeout: Optional. Default is true when not specified. The client side function called when <smex> fires the ontimeout event. OnClientTimeout returns a bool—true to continue RunSpeech and false to go to the error page. The signature for OnClientTimeout is: <ul id="ul0125" list-style="none"><li id="ul0125-0001" num="0000"><ul id="ul0126" list-style="none"><li id="ul0126-0001" num="0926"> function OnClientTimeout(object sender <br /> where </li></ul></li><li id="ul0125-0002" num="0927"> sender is the current object. </li></ul>

0928CurrentCall: Returns the current active call object.

000021.2 Server-Side Classes

000021.2.1 SmexMessage

0929This is a generic class for sending raw CSTA messages and receiving CSTA events.

0930Since the number and types of events generated by this message is unknown, the author needs to be careful about when RunSpeech can continue. <ul id="ul0127" list-style="none"><li id="ul0127-0001" num="0000"><ul id="ul0128" list-style="none"><li id="ul0128-0001" num="0931"> RunSpeech will be paused just before calling author's OnClientBeforeSend function when the message is about to be sent. </li><li id="ul0128-0002" num="0932"> If OnClientReceive is not specified, RunSpeech will resume when any smex event is received after message is sent. </li><li id="ul0128-0003" num="0933"> If OnClientReceive is specified, the author returns true to indicate RunSpeech can resume after receiving the expected event. </li><li id="ul0128-0004" num="0934"> RunSpeech will resume after Error or Timeout happens. </li></ul></li></ul>

0935The Smex Timer will be set to the given value before the message is sent and back to zero right before RunSpeech resumes.

0936When an unexpected smex event arrives, i.e. when the current active object in RunSpeech is not a call related object, the smex event is ignored.

0937When AutoPostback is set to true, all events will execute the client handler, then cause a post-back to the web server where the corresponding server event will be fired. <tables id="TABLE-US-00082" num="82"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class SmexMessage : SmexMessageBase</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>string Message {get; set};</entry></row><row><entry /><entry>string ClientSmexId {get; set};</entry></row><row><entry /><entry>string OnClientBeforeSend {get; set};</entry></row><row><entry /><entry>string OnClientReceive {get; set};</entry></row><row><entry /><entry>event Receive;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.2.1.1 SmexMessage Properties

0938Message: Required. The CSTA XML message to be sent. An exception will be thrown if Message is not specified.

0939OnClientBeforeSend: Optional. Client side function called just before the message is sent. This is to give the author a last chance to modify the message. OnClientBeforeSend returns a string containing the new message. If null is returned, original message will be sent. The signature for OnClientBeforeSend is: <tables id="TABLE-US-00083" num="83"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>function OnClientBeforeSend(object sender, string Message</entry></row><row><entry /><entry>)</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> where: <ul id="ul0129" list-style="none"><li id="ul0129-0001" num="0940"> sender is the client-side SmexMessage object, and </li><li id="ul0129-0002" num="0941"> Message is the original message. </li></ul>

0942Receive: Optional. Server side event when client side <smex> object receives smex events. The signature of a ReceiveEventHandler is: <ul id="ul0130" list-style="none"><li id="ul0130-0001" num="0000"><ul id="ul0131" list-style="none"><li id="ul0131-0001" num="0943"> void ReceiveEventHandler(object sender, ReceiveEventArgs e) </li><li id="ul0131-0002" num="0944"> where </li></ul></li></ul>

0945sender will be the server side SmexMessage object. The second argument e is of following type: <tables id="TABLE-US-00084" num="84"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class ReceiveEventArgs : EventArgs</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="63PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry>string</entry><entry>Received {get};</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="168PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><ul id="ul0132" list-style="none"><li id="ul0132-0001" num="0000"><ul id="ul0133" list-style="none"><li id="ul0133-0001" num="0946"> where </li><li id="ul0133-0002" num="0947"> Received contains the event message received from <smex>. </li></ul></li></ul>

0948OnClientReceive: Optional. Client-side function called when client side <smex> object receives smex events. OnClientReceive returns a bool—true means that this object has got all the events and RunSpeech can continue, false means that this object expects more events before RunSpeech can continue. The signature for OnClientReceive is: <ul id="ul0134" list-style="none"><li id="ul0134-0001" num="0949"> function OnClientReceive(object sender, string Message) <br /> where </li><li id="ul0134-0002" num="0950"> sender is the client-side SmexMessage object, and </li><li id="ul0134-0003" num="0951"> Message is the received message. </li></ul>

0952ClientSmexId: Optional. This is the client side <smex> element id. If not set, messages will be sent through the default Call Manager <smex> element. If set to non-empty string, it has be to be id of an existing SALT <smex> element, which the author has to add to the page.

000021.2.2 TransferCall

0953The TransferCall control transfers the current call using CSTA SingleStepTransfer service. When RunSpeech runs this object, it blocks any further speech dialog until transfer succeeds or fails. <tables id="TABLE-US-00085" num="85"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class TransferCall : SmexMessageBase</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="35PT" align="left" /><colspec colname="2" colwidth="42PT" align="left" /><colspec colname="3" colwidth="119PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>TransferredTo {get; set};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientFailed {get; set};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientTransferred {get; set};</entry></row><row><entry /><entry /><entry>event</entry><entry>Transferred;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.2.2.1 TransferCall Properties

0954TransferredTo: Required. The device identifier associated with the transferred to endpoint.

0955Transferred: Optional. Server side event fired when the call is transferred. The signature of an EventHandler is: <ul id="ul0135" list-style="none"><li id="ul0135-0001" num="0000"><ul id="ul0136" list-style="none"><li id="ul0136-0001" num="0956"> void EventHandler(object sender, EventArgs e); <br /> where </li><li id="ul0136-0002" num="0957"> sender is the server side TransferCall object, and </li><li id="ul0136-0003" num="0958"> e is of the standard EventArgs type. </li></ul></li></ul>

0959OnClientTransferred: Optional. Client side function called when the call is transferred. OnClientTransferred returns nothing. The signature of OnClientTransferred is <ul id="ul0137" list-style="none"><li id="ul0137-0001" num="0960"> function OnClientTransferred(object sender) <br /> where: </li><li id="ul0137-0002" num="0961"> sender is the client-side TransferCall object. </li></ul>

0962OnClientFailed: Client-side function called when CSTA returns FAILED event. OnClientFailed returns a bool—true to continue RunSpeech and false to go to error page. The signature for OnClientFailed is: <ul id="ul0138" list-style="none"><li id="ul0138-0001" num="0963"> function OnClientFailed(object sender, string cause) <br /> where </li><li id="ul0138-0002" num="0964"> sender is the client-side TransferCall object, and </li><li id="ul0138-0003" num="0965"> cause is the reason for failure returned from <smex>. <br /> 21.2.3. MakeCall </li></ul>

0966The MakeCall control makes an outbound call to the given number on the given device when RunSpeech runs this object. Further speech dialog is blocked until the call is connected or fails to connect. <tables id="TABLE-US-00086" num="86"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class MakeCall : SmexMessageBase</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="28PT" align="left" /><colspec colname="2" colwidth="42PT" align="left" /><colspec colname="3" colwidth="126PT" align="left" /><tbody valign="top"><row><entry /><entry /><entry>string</entry><entry>CallingDevice {get; set}</entry></row><row><entry /><entry /><entry>string</entry><entry>CalledDirectoryNumber {get; set};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientFailed {get; set};</entry></row><row><entry /><entry /><entry>string</entry><entry>OnClientConnected {get; set};</entry></row><row><entry /><entry /><entry>event</entry><entry>Connected;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="21PT" align="left" /><colspec colname="1" colwidth="196PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.2.3.1 MakeCall Properties

0967CallingDevice: Required. Default is the internal CallInfor DeviceId. The control will use this device to place the outbound call.

0968CalledDirectoryNumber: Required. Phone number to dial. An exception will be thrown if CalledDirectoryNumber is not specified.

0969Connected: Server side event when the call is connected. The signature of an EventHandler is: <ul id="ul0139" list-style="none"><li id="ul0139-0001" num="0000"><ul id="ul0140" list-style="none"><li id="ul0140-0001" num="0970"> void EventHandler(object sender, EventArgs e) <br /> where </li></ul></li><li id="ul0139-0002" num="0971"> sender is the server side MakeCall object, and </li><li id="ul0139-0003" num="0972"> e is of the standard EventArgs type. </li></ul>

0973At this point, the CurrentCall property should contain the information about the call in progress.

0974OnClientConnected: Client side function called when the call is connected. OnClientConnected returns nothing. The signature for OnClientConnected is: <ul id="ul0141" list-style="none"><li id="ul0141-0001" num="0975"> function OnClientConnected(object sender, string CalledDirectoryNumber <br /> where: <ul id="ul0142" list-style="none"><li id="ul0142-0001" num="0976"> sender is the client-side MakeCall object, and </li><li id="ul0142-0002" num="0977"> CalledDirectoryNumber is the property of the MakeCall object. </li></ul></li></ul>

0978OnClientFailed: Client side function called when CSTA returns FAILED event. OnClientFailed returns a bool—true to continue RunSpeech and false to goto error page. The signature for OnClientfailed is: <ul id="ul0143" list-style="none"><li id="ul0143-0001" num="0979"> function OnClientFailed(object sender, string cause) <br /> where </li><li id="ul0143-0002" num="0980"> sender is the client-side MakeCall object, and </li><li id="ul0143-0003" num="0981"> cause is the reason for failure returned from <smex>. </li></ul>

098221.2.4 DisconnectCall <tables id="TABLE-US-00087" num="87"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class DisconnectCall : SmexMessageBase</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>string OnClientFailed {get; set};</entry></row><row><entry /><entry>string OnClientDisconnected {get; set};</entry></row><row><entry /><entry>event Disconnected;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.2.4.1 DisconnectCall Properties

0983Disconnected: Optional. Server side event when the call is disconnected. The signature of an EventHandler is: <ul id="ul0144" list-style="none"><li id="ul0144-0001" num="0000"><ul id="ul0145" list-style="none"><li id="ul0145-0001" num="0984"> void EventHander(object sender, EventArgs e) </li><li id="ul0145-0002" num="0985"> where: </li><li id="ul0145-0003" num="0986"> sender is the server side DisconnectCall object and, </li><li id="ul0145-0004" num="0987"> e is of the standard EventArgs type. </li></ul></li></ul>

0988OnClientDisconnected: Optional. Client side function called when the call is disconnected. OnClientDisconnected returns nothing. The signature for OnClientDisconnected is: <ul id="ul0146" list-style="none"><li id="ul0146-0001" num="0989"> function OnClientDisconnected(object sender) <br /> where sender is the client-side Disconnect Call object. </li></ul>

0990OnClientFailed: Optional. Client side function called when CSTA returns FAILED event. OnClientFailed returns a bool—true to continue RunSpeech and false to goto error page. The signature for OnClientFailed is: <ul id="ul0147" list-style="none"><li id="ul0147-0001" num="0991"> function OnClientFailed(object sender, string cause) <br /> where </li><li id="ul0147-0002" num="0992"> sender is the client-side Disconnect Call object, and </li><li id="ul0147-0003" num="0993"> cause is the reason for failure returned from <smex>. <br /> 21.2.5 AnswerCall </li></ul>

0994The AnswerCall control answers incoming calls on the given device. When activated, this object will block RunSpeech until an incoming call is answered.

0995Server-Side Class: <tables id="TABLE-US-00088" num="88"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>class AnswerCall : SmexMessageBase</entry></row><row><entry /><entry>{</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="56PT" align="left" /><colspec colname="1" colwidth="161PT" align="left" /><tbody valign="top"><row><entry /><entry>string OnClientConnected {get; set};</entry></row><row><entry /><entry>string OnClientFailed {get; set};</entry></row><row><entry /><entry>event Connected;</entry></row></tbody></tgroup><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="175PT" align="left" /><tbody valign="top"><row><entry /><entry>}</entry></row><row><entry /><entry namest="OFFSET" nameend="1" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 21.2.5.1 AnswerCall Properties

0996Connected: Optional. Server side event when the call is connected. The signature of a ConnectedEventHandler is: <ul id="ul0148" list-style="none"><li id="ul0148-0001" num="0000"><ul id="ul0149" list-style="none"><li id="ul0149-0001" num="0997"> void EventHandler(object sender, EventArgs e) </li><li id="ul0149-0002" num="0998"> where: </li><li id="ul0149-0003" num="0999"> sender is the server side AnswerCall object and </li><li id="ul0149-0004" num="1000"> e is of the standard EventArgs type. </li></ul></li></ul>

1001At this point, the CurrentCall property should contain information of the call in progress.

1002OnClientConnected: Optional. Client side function called when the call is connected. OnClientConnected returns nothing. The signature for OnClientConected is: <ul id="ul0150" list-style="none"><li id="ul0150-0001" num="1003"> function OnClientConnected(object sender, string callid, string CallingDevice, string CalledDevice) <br /> where: </li><li id="ul0150-0002" num="1004"> sender is the client side AnswerCall object </li><li id="ul0150-0003" num="1005"> callid is the id of the current call </li><li id="ul0150-0004" num="1006"> CallingDevice is the caller's network device id </li><li id="ul0150-0005" num="1007"> CalledDevice is the recipient's network device id. </li></ul>

1008OnClientFailed: Optional. Client side function called when CSTA returns FAILED event. OnClientFailed returns a bool—true to continue RunSpeech and false to go to error page. The signature of OnClientFailed is: <ul id="ul0151" list-style="none"><li id="ul0151-0001" num="1009"> function OnClientFailed(object sender, string cause) <br /> where </li><li id="ul0151-0002" num="1010"> sender is the client-side AnswerCall object. </li><li id="ul0151-0003" num="1011"> cause is the reason for failure returned from <smex>. <br /> 22 RunSpeech <br /> 22.1 Dialog Processing Algorithm </li></ul>

1012The RunSpeech algorithm is used to drive dialog flow on a voice-only client. This involves system prompting and dialog management and processing of speech input. It is specified as a script file referenced by URI from every relevant speech-enabled page (equivalent to inline embedded script).

1013Important: the RunSpeech script will be completely exposed to the public. Since it will be hosted on the application web site, authors of dialogs will be at liberty to examine, edit, replace or ignore the RunSpeech script code.

1014Rendering of the page for voice only browsers is done in the following manner:

1015The RunSpeech function works as follows (RunSpeech is called in response to document.onreadystate becoming “complete”):

1016Controls considered for activation are the QA, CompareValidator and CustomValidator controls. <ul id="ul0152" list-style="none"><li id="ul0152-0001" num="0000"><ul id="ul0153" list-style="none"><li id="ul0153-0001" num="1017"> 1. Find the first active QA or Validator control in speech index order (determining whether a QA/Validator is active is explained below). </li><li id="ul0153-0002" num="1018"> 2. If there is no active control, submit the page. </li><li id="ul0153-0003" num="1019"> 3. Otherwise, run the control. </li></ul></li></ul>

1020A QA is considered active if and only if: <ul id="ul0154" list-style="none"><li id="ul0154-0001" num="0000"><ul id="ul0155" list-style="none"><li id="ul0155-0001" num="1021"> 1. The QA's clientActivationFunction either is not present or returns true, AND </li><li id="ul0155-0002" num="1022"> 2. If the Answers collection is non empty, the State of at least one of the SemanticItems pointed to by the set of Answers is Empty OR </li><li id="ul0155-0003" num="1023"> 3. If the Answers collection is empty, the State at least one SemanticItem in the Confirm array is NeedsConfirmation. </li></ul></li></ul>

1024However, if the QA has PlayOnce true and its Prompt has been run successfully (reached OnComplete) the QA will not be a candidate for activation.

1025A QA is run as follows: <ul id="ul0156" list-style="none"><li id="ul0156-0001" num="0000"><ul id="ul0157" list-style="none"><li id="ul0157-0001" num="1026"> 1. If this is a different control than the previous active control, reset the prompt Count value. </li><li id="ul0157-0002" num="1027"> 2. Increment the Prompt count value </li><li id="ul0157-0003" num="1028"> 3. If PromptSelectFunction is specified, call the function and set the Prompt's inlinePrompt to the returned string. </li><li id="ul0157-0004" num="1029"> 4. If a Reco object is present, start it. This Reco should already include any active command grammar. </li><li id="ul0157-0005" num="1030"> 5. Start the DMTF object if present. (Same concerns apply with regard to command Dtmf grammars). </li></ul></li></ul>

1031A Validator (either a CompareValidator or a CustomValidator) is active if: <ul id="ul0158" list-style="none"><li id="ul0158-0001" num="0000"><ul id="ul0159" list-style="none"><li id="ul0159-0001" num="1032"> 1. The SemanticItemToValidate has not been validated by this validator. </li></ul></li></ul>

1033A CompareValidator is run as follows: <ul id="ul0160" list-style="none"><li id="ul0160-0001" num="0000"><ul id="ul0161" list-style="none"><li id="ul0161-0001" num="1034"> 1. Compare the values of the ElementToCompare or ValueToCompare and SemanticItemToValidate ToValidate according to the validator's Operator. </li><li id="ul0161-0002" num="1035"> 2. If the test returns false, empty the text field of the SemanticItemToValidate (or both if the InvalidateBoth flag is set) and play the prompt. </li><li id="ul0161-0003" num="1036"> 3. If the test returns true, mark the SemanticItemToValidate as validated by this validator. </li></ul></li></ul>

1037A CustomValidator is run as follows: <ul id="ul0162" list-style="none"><li id="ul0162-0001" num="0000"><ul id="ul0163" list-style="none"><li id="ul0163-0001" num="1038"> 1. The ClientValidationFunction is called with the value of the SemanticItemToValidate. </li><li id="ul0163-0002" num="1039"> 2. If the function returns false, the semanticitem cleared and the prompt is played, otherwise as validated by this validator. </li></ul></li></ul>

1040A Command is considered active if and only if: <ul id="ul0164" list-style="none"><li id="ul0164-0001" num="0000"><ul id="ul0165" list-style="none"><li id="ul0165-0001" num="1041"> 1. It is in Scope, AND </li><li id="ul0165-0002" num="1042"> 2. There is not another Command of the same Type lower in the scope tree. <br /> 22.2 LastCommandOrException </li></ul></li></ul>

1043LastCommandOrException is a global variable and its value is passed to several author-defined functions as a parameter.

1044LastCommandOrException is a global variable maintained by RunSpeech. The value is set to the last Command.Type or recognition exception that occurred. The value will be reset to “ ” when there is a QA transition (the current active QA is different than the previously active QA, or is the first active QA). There is one exception to this rule: If the QA is in a Short time-out confirmation state, and the current recognition result is “Silence”, the LastCommandOrException will be set to “ ” (silence in Short time-out confirmation is not an exception, but a valid input.)

1045In this fashion, ClientActivationFunction will always get the LastCommandOrException that occurred anywhere in the page, but the rest of the functions of the active QA will only get a non-empty LastCommandOrException if they have been activated more than once in a row.

1046If, after processing all the Answers, ExtraAnswers and Confirms in a QA, nothing is matched (either due to a mismatch in the sml returned or to a high reject threshold), the LastCommandOrException will be set to “NoReco”.

1047Active Validators will also reset the global LastCommandOrException.

1048Possible values of LastCommandOrException are: <tables id="TABLE-US-00089" num="89"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="14PT" align="left" /><colspec colname="1" colwidth="105PT" align="left" /><colspec colname="2" colwidth="98PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row><row><entry /><entry>platform event</entry><entry>LastCommandOrException</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>Prompt fires an onerror event</entry><entry>″PromptError″.</entry></row><row><entry /><entry>Reco fires an onerror event</entry><entry>″RecoError″.</entry></row><row><entry /><entry>Dtmf fires an onerror event</entry><entry>″DtmfError″.</entry></row><row><entry /><entry>Reco fires an onnoreco event</entry><entry>″NoReco″.</entry></row><row><entry /><entry>Reco fires a silence event</entry><entry>″Silence″.</entry></row><row><entry /><entry>Command is Activated</entry><entry>Command.type</entry></row><row><entry /><entry>Transition to new QA</entry><entry>“”</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

1049Also, a PromptSelectFunction's LastCommandOrException will have the value “ShortTimeoutConfirmation” when its QA is in Short Time-out Confirmation mode (i.e., when count==1, firstInitialTimeout is non-zero, etc.)

000022.3 Count

1050Count is exclusively local—both in ClientActivationFunction and the rest of the functions which are passed count. That is, these functions are always passed the count of their own QA. To avoid confusion, the function ClientActivationFunction will receive the value that the PromptSelectFunction would receive if this QA was active.

000022.4 Postback Support

1051In their simplest form, ASP.NET pages are stateless. They are instantiated, executed, rendered, and disposed of on every round trip to the server. In the visual world, ASP.NET provides the ViewState mechanism to keep track of server control state values that don't otherwise postback as part of an HTTP form. The ASP.NET framework uses ViewState to manage and restore page properties prior to and after postback.

1052For voice-only pages, the ASP.NET ViewState mechanism is not available to the web developer. However, a similar mechism is provided by RunSpeech. RunSpeech maintains an object that can be used to store values which authors wish to be persisted across postbacks. The syntax is: <ul id="ul0166" list-style="none"><li id="ul0166-0001" num="1053"> RunSpeech.ClientViewState[“MyVariableName”]=myVariableValue; </li></ul>

1054Any JScript built-in type can be persisted—string, number, boolean, array, object, Date, RegExp, or function. The main difference between the ASP.NET ViewState (for visual pages) and the voice-only ClientViewState mechanism is that authors of voice-only pages must manually declare and set values they wish to maintain across postbacks.

1055If AutoPostBack is set to true in any speech control, the matching client-side function will always be executed before posting back to the server. If the author wishes to persist any page state across postback, these client-side functions are a good place to invoke the ClientViewState object of RunSpeech.

000023 Confirmation Algorithm

0000Semantic Processing Algorithm:

1056There are three stages for semantic processing:

00001) Preprocessing, Carried Out When a QA is Active:

1057This stage is responsible for creating the array of answers to be considered in this iteration. This includes all the Answers and the Confirms that need confirmation. Internally, it creates a structure as follows. <tables id="TABLE-US-00090" num="90"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="42PT" align="left" /><colspec colname="1" colwidth="84PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>Answer ID</entry><entry>CurrentValue</entry></row><row><entry /><entry>Answer ID</entry><entry>CurrentValue</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

1058This information that is also passed to the PromptSelectFunction, GrammarSelectFunction, etc.

00002) Answer Processing

1059In this stage, we process the Answer objects in the Answers and ExtraAnswers collections. If any item from the Answers collection is matched, a flag indicating this fact is set. Answer processing sets the confirmation status of the associated semantic item—this status can be either NEEDS_CONFIRMATION or CONFIRMED. If the confidence value associated with the smlNode specified by the Answer's XpathTrigger is less than or equal to the Answer's confirmationThreshold, the status of the semantic item is set to NEEDS_CONFIRMATION. Otherwise it is set to CONFIRMED.

00003) Confirmation Processing:

0000<ul id="ul0167" list-style="none"><li id="ul0167-0001" num="1060"> a) Examine at the sml document and search for XpathAcceptConfirms and XpathDenyConfirms. Set a global confirmation state to NEUTRAL (none was present), ACCEPT (xpathAcceptConfirms was present) or DENY (XPathDenyConfirms was present). In short-timeout confirmation, silence sets the confirmation state to ACCEPT. </li><li id="ul0167-0002" num="1061"> b) For all items to be confirmed, <ul id="ul0168" list-style="none"><li id="ul0168-0001" num="1062"> If there is a value in the sml document that matches the XpathTrigger of the confirm item <ul id="ul0169" list-style="none"><li id="ul0169-0001" num="1063"> If the new value is the same as the value to be confirmed, the item is confirmed </li><li id="ul0169-0002" num="1064"> Else, the item is set to the new value, and processed as an answer. </li></ul></li></ul></li><li id="ul0167-0003" num="1065"> c) If no Answer object is matched from the Answers or Confirms collections, <ul id="ul0170" list-style="none"><li id="ul0170-0001" num="1066"> If the confirmation state is CONFIRM Upgrade all items that need confirmation to confirmed. </li><li id="ul0170-0002" num="1067"> If the confirmation state is DENY <ul id="ul0171" list-style="none"><li id="ul0171-0001" num="1068"> Clear (empty) all items that need confirmation. </li></ul></li><li id="ul0170-0003" num="1069"> Else, <ul id="ul0172" list-style="none"><li id="ul0172-0001" num="1070"> Mark all unmatched items that needed confirmation as confirmed. <br /> 24 Exceptions </li></ul></li></ul></li></ul>

1071The following table lists the exceptions thrown by Speech Controls during render time. <tables id="TABLE-US-00091" num="91"><table frame="none" colsep="0" rowsep="0" pgwide="1"><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="1" colwidth="63PT" align="left" /><colspec colname="2" colwidth="84PT" align="left" /><colspec colname="3" colwidth="91PT" align="left" /><colspec colname="4" colwidth="98PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="4" align="center" rowsep="1" /></row><row><entry /><entry>Attribute/</entry><entry /><entry /></row><row><entry>Control/</entry><entry>Method/</entry></row><row><entry>object</entry><entry>Object</entry><entry>Condition</entry><entry>Exception</entry></row><row><entry namest="1" nameend="4" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>QA</entry><entry>SpeechIndex</entry><entry>SpeechIndex < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>XpathDenyConfirms</entry><entry>XpathDenyConfirms</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>not specified if</entry></row><row><entry /><entry /><entry>Confirm specified</entry></row><row><entry /><entry>Answers</entry><entry>Answers collection</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>contains a non-</entry></row><row><entry /><entry /><entry>answer object</entry></row><row><entry /><entry>Prompt</entry><entry>Prompt non-</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>existant in Voice-</entry></row><row><entry /><entry /><entry>only mode QA</entry></row><row><entry /><entry>FirstInitialTimeout</entry><entry>FirstInitialTimeout</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>specified</entry></row><row><entry /><entry /><entry>without Confirms</entry></row><row><entry /><entry /><entry>being specified</entry></row><row><entry /><entry>FirstInitialTimeout</entry><entry>FirstInitialTimeout < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>AcceptRejectThreshold</entry><entry>AcceptRejectThreshold <</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>0 or > 1</entry></row><row><entry /><entry>DenyRejectThreshold</entry><entry>DenyRejectThreshold <</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>0 or > 1</entry></row><row><entry>Command</entry><entry>SpeechIndex</entry><entry>SpeechIndex < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>Scope</entry><entry>Scope not valid</entry><entry>ArgumentException</entry></row><row><entry /><entry>Scope</entry><entry>Scope not</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>specified</entry></row><row><entry /><entry>Type</entry><entry>Type not specified</entry><entry>ArgumentNullException</entry></row><row><entry /><entry>Type/Scope</entry><entry>More than 1</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>Command of same</entry></row><row><entry /><entry /><entry>Type has same</entry></row><row><entry /><entry /><entry>Scope</entry></row><row><entry /><entry>AcceptCommandThreshold</entry><entry>AcceptCommandThreshold <</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>0 or > 1</entry></row><row><entry /><entry>XpathTrigger</entry><entry>XpathTrigger not</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>specified</entry></row><row><entry /><entry>AutoPostBack</entry><entry>AutoPostBack is</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>true and Triggered</entry></row><row><entry /><entry /><entry>handler not</entry></row><row><entry /><entry /><entry>specified</entry></row><row><entry /><entry>AutoPostBack</entry><entry>AutoPostBack is</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>false and</entry></row><row><entry /><entry /><entry>Triggered handler</entry></row><row><entry /><entry /><entry>is specified</entry></row><row><entry>CompareValidator</entry><entry>SpeechIndex</entry><entry>SpeechIndex < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>SemanticItemToCompare</entry><entry>one of</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>SemanticItemToCompare</entry></row><row><entry /><entry /><entry>and</entry></row><row><entry /><entry /><entry>ValueToCompare is</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry /><entry>ValueToCompare</entry><entry>one of</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>SemanticItemToCompare</entry></row><row><entry /><entry /><entry>and</entry></row><row><entry /><entry /><entry>ValueToCompare is</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry /><entry>ValueToCompare</entry><entry>ValueToCompare can</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>not be converted</entry></row><row><entry /><entry /><entry>to a valid Type.</entry></row><row><entry /><entry>SemanticItemToValidate</entry><entry>SemanticItemToValidate</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry>CustomValidator</entry><entry>SpeechIndex</entry><entry>SpeechIndex < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>SemanticItemToValidate</entry><entry>SemanticItemToValidate</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry /><entry>ClientValidationFunction</entry><entry>ClientValidationFunction</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry>Answer</entry><entry>XpathTrigger</entry><entry>XpathTrigger not</entry><entry>ArgumentNullException</entry></row><row><entry>object</entry><entry /><entry>specified for</entry></row><row><entry /><entry /><entry>Answers or</entry></row><row><entry /><entry /><entry>ExtraAnswwers</entry></row><row><entry /><entry>ConfirmThreshold</entry><entry>ConfirmThreshold <</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>0 or > 1</entry></row><row><entry /><entry>Reject</entry><entry>Reject < 0 or > 1</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>AutoPostBack</entry><entry>Answer.Triggered</entry><entry>InvalidOperationException</entry></row><row><entry /><entry /><entry>has a handler but</entry></row><row><entry /><entry /><entry>Answer.AutoPostBack</entry></row><row><entry /><entry /><entry>is false</entry></row><row><entry>SemanticItemobject</entry><entry>TargetElement</entry><entry>TargetElement</entry></row><row><entry /><entry /><entry>specifies multiple</entry></row><row><entry /><entry /><entry>ids</entry></row><row><entry /><entry>TargetAttribute</entry><entry>TargetAttribute is</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>not specified when</entry></row><row><entry /><entry /><entry>TargetElement is</entry></row><row><entry /><entry /><entry>specified</entry></row><row><entry /><entry>BindAt</entry><entry>BindAt set to an</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>invalid value</entry></row><row><entry /><entry>BindAt</entry><entry>BindAt is “server”</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>and</entry></row><row><entry /><entry /><entry>SemanticItem.TargetElement</entry></row><row><entry /><entry /><entry>is not a server-side</entry></row><row><entry /><entry /><entry>control</entry></row><row><entry /><entry>BindAt</entry><entry>BindAt is “server”</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>and</entry></row><row><entry /><entry /><entry>SemanticItem.TargetAttribute</entry></row><row><entry /><entry /><entry>is not a member of the</entry></row><row><entry /><entry /><entry>control specified</entry></row><row><entry /><entry /><entry>by</entry></row><row><entry /><entry /><entry>SemanticItem.TargetElement</entry></row><row><entry /><entry>BindAt</entry><entry>BindAt is “server”</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>and</entry></row><row><entry /><entry /><entry>SemanticItem.TargetAttribute</entry></row><row><entry /><entry /><entry>is a member of</entry></row><row><entry /><entry /><entry>SemanticItem.TargetElement,</entry></row><row><entry /><entry /><entry>but is not of type</entry></row><row><entry /><entry /><entry>string,</entry></row><row><entry /><entry>BindAt</entry><entry>BindAt is “server”</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>and</entry></row><row><entry /><entry /><entry>SemanticItem.TargetAttribute</entry></row><row><entry /><entry /><entry>is a string, but is</entry></row><row><entry /><entry /><entry>read-only.</entry></row><row><entry>Reco</entry><entry>initialTimeout</entry><entry>initialTimeout</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry>object</entry><entry /><entry>negative</entry></row><row><entry /><entry>babbleTimeout</entry><entry>babbleTimeout</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>negative</entry></row><row><entry /><entry>maxTimeout</entry><entry>maxTimeout</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>negative</entry></row><row><entry /><entry>endSilence</entry><entry>endSilence</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>negative</entry></row><row><entry /><entry>reject</entry><entry>reject < 0 or > 1</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>Grammars</entry><entry>Grammars</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>collection</entry></row><row><entry /><entry /><entry>contains a non-</entry></row><row><entry /><entry /><entry>grammar object</entry></row><row><entry /><entry>Params</entry><entry>name not specified</entry><entry>ArgumentNullException</entry></row><row><entry /><entry>Params</entry><entry>contains a non-</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>param object</entry></row><row><entry>Grammar</entry><entry>src/InlineGrammar</entry><entry>one of src or</entry><entry>ArgumentNullException</entry></row><row><entry>object</entry><entry /><entry>InlineGrammar is</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry>Prompt</entry><entry>Params</entry><entry>name not specified</entry><entry>ArgumentNullException</entry></row><row><entry>object</entry></row><row><entry /><entry>Params</entry><entry>contains a non-</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>param object</entry></row><row><entry>Dtmf</entry></row><row><entry>object</entry></row><row><entry /><entry>initialTimeout</entry><entry>initialTimeout < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>interdigitTimeout</entry><entry>interdigit-</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry /><entry>Timeout < 0</entry></row><row><entry /><entry>endSilence</entry><entry>endSilence < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry /><entry>Params</entry><entry>name not specified</entry><entry>ArgumentNullException</entry></row><row><entry /><entry>Params</entry><entry>contains a non-</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>param object</entry></row><row><entry>\</entry></row><row><entry>StyleSheet</entry><entry /><entry>contains an object</entry><entry>ArgumentException</entry></row><row><entry /><entry /><entry>which is not a</entry></row><row><entry /><entry /><entry>Style object</entry></row><row><entry>Style</entry><entry>StyleReference</entry><entry>StyleReference is</entry><entry>ArgumentException</entry></row><row><entry>object</entry><entry /><entry>invalid</entry></row><row><entry>SmexMessageBase</entry><entry>Timer</entry><entry>Timer < 0</entry><entry>ArgumentOutOfRangeException</entry></row><row><entry>SmexMessage</entry><entry>Message</entry><entry>Message not</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>specified</entry></row><row><entry>MakeCall</entry><entry>CalledDirectoryNumber</entry><entry>CalledDirectoryNumber</entry><entry>ArgumentNullException</entry></row><row><entry /><entry /><entry>not specified</entry></row><row><entry namest="1" nameend="4" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

107226 Terms and Defintions <tables id="TABLE-US-00092" num="92"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="168PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row><row><entry>Term</entry><entry>Definition</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Voice-only</entry><entry>A mode of dialog that utilizes only speech input</entry></row><row><entry /><entry>and ouput. There are no visual elements presented</entry></row><row><entry /><entry>to the end user. Voice-only dialog typically</entry></row><row><entry /><entry>implies the end user communication via the</entry></row><row><entry /><entry>telephone. However, voice-only interaction may</entry></row><row><entry /><entry>occur in a desktop computer setting.</entry></row><row><entry>Multimodal</entry><entry>A mode of dialog that utilizes speech input</entry></row><row><entry /><entry>and visual ouput. Multimodal typically implies</entry></row><row><entry /><entry>end user communication with a dialog via a</entry></row><row><entry /><entry>hand-held computing device such as a pocket PC.</entry></row><row><entry>Tap-and-talk</entry><entry>A form of dialog interaction that utilizes speech</entry></row><row><entry /><entry>input and visual ouput. This form of dialog</entry></row><row><entry /><entry>interaction typically occurs on a hand-held</entry></row><row><entry /><entry>computer such a pocket PC. The end user selects</entry></row><row><entry /><entry>(“taps”) the visual element with a stylus</entry></row><row><entry /><entry>or pen-like device and provides input to the</entry></row><row><entry /><entry>visual element using speech (“talk”).</entry></row><row><entry>Mixed</entry><entry>A form of dialog interaction model, whereby the</entry></row><row><entry>Initiative</entry><entry>user is permitted to share the dialog initiative</entry></row><row><entry /><entry>with the system, eg by providing more answers</entry></row><row><entry /><entry>than requested by a prompt, or by switching task</entry></row><row><entry /><entry>when not prompted to do so.</entry></row><row><entry>SAPI SML</entry><entry>SAPI Semantic markup language. The XML document</entry></row><row><entry /><entry>returned by SAPI 6.0 when an utterance is</entry></row><row><entry /><entry>determined to be in-grammar. (SAPI SML is a</entry></row><row><entry /><entry>SAPI-specific return format. Speech tags</entry></row><row><entry /><entry>interpreters are agnostic to the actual content</entry></row><row><entry /><entry>format of the returned document, provided it</entry></row><row><entry /><entry>is an XML document). SAPI SML contains semantic</entry></row><row><entry /><entry>values, confidence scores and the words used</entry></row><row><entry /><entry>by the speaker. (It is generated by script or</entry></row><row><entry /><entry>XSLT instructions contained within the grammar</entry></row><row><entry /><entry>rules.) SAPI SML is described in greater detail</entry></row><row><entry /><entry>in the Speech Core document SML Generation..</entry></row><row><entry>CSTA</entry><entry>Computer Supported Telecommunications</entry></row><row><entry /><entry>Applications - an ECMA standard. From the ECMA</entry></row><row><entry /><entry>document: “CSTA is an interface that</entry></row><row><entry /><entry>provides access to telecommunication functions</entry></row><row><entry /><entry>that may be used with your phone (or many</entry></row><row><entry /><entry>other communication devices) and may also be</entry></row><row><entry /><entry>used by 3rd party applications such as</entry></row><row><entry /><entry>Contact/Call Centres (e.g. ACD systems).”</entry></row><row><entry /><entry>http://www.ecma.ch/ecma1/TOPICS/TC32/TG11/</entry></row><row><entry /><entry>CSTA.HTM</entry></row><row><entry>System</entry><entry>A form of dialog interaction model, whereby</entry></row><row><entry>Initiative</entry><entry>the system holds the initiative, and drives</entry></row><row><entry /><entry>the dialog with typically simple questions</entry></row><row><entry /><entry>to which only a single answer is possible.</entry></row><row><entry>XPath</entry><entry>XML Path language, a W3C recommendation for</entry></row><row><entry /><entry>addressing parts of an XML document. See</entry></row><row><entry /><entry>http://www.w3.org/TR/xpath.</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 27 Platform Parameter Settings

1073The <param> mechanism (described in sections Error! Reference source not found. Prompt object contents, Error! Reference source not found. Reco object contents and Error! Reference source not found. Dtmf object contents) 31 is used to configure platform settings. The following “params” are recognized by all Microsoft platforms: <tables id="TABLE-US-00093" num="93"><table frame="none" colsep="0" rowsep="0" pgwide="1"><tgroup align="left" colsep="0" rowsep="0" cols="5"><colspec colname="1" colwidth="28PT" align="left" /><colspec colname="2" colwidth="28PT" align="left" /><colspec colname="3" colwidth="70PT" align="left" /><colspec colname="4" colwidth="70PT" align="left" /><colspec colname="5" colwidth="70PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="5" align="center" rowsep="1" /></row><row><entry>Object</entry><entry>Name</entry><entry>Value</entry><entry>Default</entry><entry>Description</entry></row><row><entry namest="1" nameend="5" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Prompt</entry><entry>server</entry><entry>URI describing</entry><entry>http://localhost</entry><entry>This configuration</entry></row><row><entry /><entry /><entry>the location</entry><entry>(client)</entry><entry>setting selects the</entry></row><row><entry /><entry /><entry>of the speech</entry><entry>and registry setting</entry><entry>speech server used</entry></row><row><entry /><entry /><entry>server</entry><entry>(telephony server)</entry><entry>for speech processing</entry></row><row><entry /><entry>bargein</entry><entry>This attribute</entry><entry>The default setting is</entry><entry>The barge-in types</entry></row><row><entry /><entry>type</entry><entry>sets the type</entry><entry>“speech”. If</entry><entry>are defined as:</entry></row><row><entry /><entry /><entry>of recognition</entry><entry>the platform does not</entry><entry>speech: This represents</entry></row><row><entry /><entry /><entry>input event</entry><entry>support the type</entry><entry>speech/sound/energy</entry></row><row><entry /><entry /><entry>that the browser</entry><entry>selected, the browser</entry><entry>(“SOUND_START”)</entry></row><row><entry /><entry /><entry>uses to determine</entry><entry>defaults to “speech”.</entry><entry>detected by the</entry></row><row><entry /><entry /><entry>whether an onbargein</entry><entry /><entry>recognition engine.</entry></row><row><entry /><entry /><entry>event should be fired.</entry><entry /><entry>grammar: This</entry></row><row><entry /><entry /><entry>There are three</entry><entry /><entry>represents the audio</entry></row><row><entry /><entry /><entry>types of bargein-</entry><entry /><entry>partially matching</entry></row><row><entry /><entry /><entry>type that can</entry><entry /><entry>the recognition</entry></row><row><entry /><entry /><entry>be set:</entry><entry /><entry>grammar. The speech</entry></row><row><entry /><entry /><entry>“speech”,</entry><entry /><entry>server will generate</entry></row><row><entry /><entry /><entry>“grammar”</entry><entry /><entry>a “PHRASE_START”</entry></row><row><entry /><entry /><entry>and</entry><entry /><entry>event, and possibly</entry></row><row><entry /><entry /><entry>“final”.</entry><entry /><entry>a semantic event (a</entry></row><row><entry /><entry /><entry /><entry /><entry>semantic property in</entry></row><row><entry /><entry /><entry /><entry /><entry>the phrase hypo-</entry></row><row><entry /><entry /><entry /><entry /><entry>thesis has confi-</entry></row><row><entry /><entry /><entry /><entry /><entry>dence greater</entry></row><row><entry /><entry /><entry /><entry /><entry>than the confidence</entry></row><row><entry /><entry /><entry /><entry /><entry>threshold). The</entry></row><row><entry /><entry /><entry /><entry /><entry>client decides when</entry></row><row><entry /><entry /><entry /><entry /><entry>to throw “onbar-</entry></row><row><entry /><entry /><entry /><entry /><entry>gein” based on</entry></row><row><entry /><entry /><entry /><entry /><entry>the capabilities</entry></row><row><entry /><entry /><entry /><entry /><entry>sent by the speech</entry></row><row><entry /><entry /><entry /><entry /><entry>server when a ses-</entry></row><row><entry /><entry /><entry /><entry /><entry>sion is opened. The</entry></row><row><entry /><entry /><entry /><entry /><entry>confidence thresh-</entry></row><row><entry /><entry /><entry /><entry /><entry>old used by the</entry></row><row><entry /><entry /><entry /><entry /><entry>semantic event is a</entry></row><row><entry /><entry /><entry /><entry /><entry>client platform</entry></row><row><entry /><entry /><entry /><entry /><entry>setting. final: This</entry></row><row><entry /><entry /><entry /><entry /><entry>represents using a</entry></row><row><entry /><entry /><entry /><entry /><entry>“valid” final</entry></row><row><entry /><entry /><entry /><entry /><entry>recognition result</entry></row><row><entry /><entry /><entry /><entry /><entry>(i.e. a result where</entry></row><row><entry /><entry /><entry /><entry /><entry>the utterance</entry></row><row><entry /><entry /><entry /><entry /><entry>confidence level is</entry></row><row><entry /><entry /><entry /><entry /><entry>above the “reject”</entry></row><row><entry /><entry /><entry /><entry /><entry>threshold). Run in</entry></row><row><entry /><entry /><entry /><entry /><entry>conjunction with</entry></row><row><entry /><entry /><entry /><entry /><entry>multiple recognition</entry></row><row><entry /><entry /><entry /><entry /><entry>mode, this repre-</entry></row><row><entry /><entry /><entry /><entry /><entry>sents the recognizer</entry></row><row><entry /><entry /><entry /><entry /><entry>continuously lis-</entry></row><row><entry /><entry /><entry /><entry /><entry>tening for a valid</entry></row><row><entry /><entry /><entry /><entry /><entry>result, for hotword/</entry></row><row><entry /><entry /><entry /><entry /><entry>wake-up style</entry></row><row><entry /><entry /><entry /><entry /><entry>scenarios. Note</entry></row><row><entry /><entry /><entry /><entry /><entry>that in this case</entry></row><row><entry /><entry /><entry /><entry /><entry>the browser must</entry></row><row><entry /><entry /><entry /><entry /><entry>fire onbargein</entry></row><row><entry /><entry /><entry /><entry /><entry>before firing onreco.</entry></row><row><entry>Reco</entry><entry>server</entry><entry>URI describing</entry><entry>http://localhost</entry><entry>This configuration</entry></row><row><entry /><entry /><entry>the location</entry><entry>(client) and registry</entry><entry>setting selects the</entry></row><row><entry /><entry /><entry>of the speech</entry><entry>setting (telephony</entry><entry>speech server used</entry></row><row><entry /><entry /><entry>server</entry><entry>server)</entry><entry>for speech processing</entry></row><row><entry namest="1" nameend="5" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> 28 DET Descriptions

1074The following table lists brief descriptions for each control, object and attribute. These descriptions will be used by the DET tool and exposed to the dialog author using Visual Studio. <tables id="TABLE-US-00094" num="94"><table frame="none" colsep="0" rowsep="0" pgwide="1"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="63PT" align="left" /><colspec colname="2" colwidth="91PT" align="left" /><colspec colname="3" colwidth="105PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row><row><entry>Control/</entry><entry>Attribute/Method/</entry><entry /></row><row><entry>object</entry><entry>Object</entry><entry>Brief description</entry></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>QA</entry><entry>Id</entry><entry>Programmatic name of the</entry></row><row><entry /><entry /><entry>control</entry></row><row><entry /><entry>SpeechIndex</entry><entry>Activation order of the control</entry></row><row><entry /><entry>ClientActivationFunction</entry><entry>Client-side function used to</entry></row><row><entry /><entry /><entry>determine whether or not to</entry></row><row><entry /><entry /><entry>activate the QA control</entry></row><row><entry /><entry>OnClientActive</entry><entry>Client-side function called</entry></row><row><entry /><entry /><entry>after QA is determined to be</entry></row><row><entry /><entry /><entry>active</entry></row><row><entry /><entry>OnClientComplete</entry><entry>Client-side function called</entry></row><row><entry /><entry /><entry>after execution of QA</entry></row><row><entry /><entry /><entry>(successfully or not).</entry></row><row><entry /><entry>OnClientListening</entry><entry>Client-side function called</entry></row><row><entry /><entry /><entry>after successful start of the</entry></row><row><entry /><entry /><entry>reco object</entry></row><row><entry /><entry>AllowCommands</entry><entry>Whether or not Commands may be</entry></row><row><entry /><entry /><entry>activated for this QA</entry></row><row><entry /><entry>PlayOnce</entry><entry>Whether or not this QA may be</entry></row><row><entry /><entry /><entry>activated more than once per</entry></row><row><entry /><entry /><entry>page</entry></row><row><entry /><entry>XpathAcceptConfirms</entry><entry>The path in the sml document</entry></row><row><entry /><entry /><entry>that indicates the confirm</entry></row><row><entry /><entry /><entry>items were accepted</entry></row><row><entry /><entry>XpathDenyConfirms</entry><entry>The path in the sml document</entry></row><row><entry /><entry /><entry>that indicates the confirm</entry></row><row><entry /><entry /><entry>items were denied</entry></row><row><entry /><entry>FirstInitialTimeout</entry><entry>Specifies initial timeout when</entry></row><row><entry /><entry /><entry>QA.Count == 1.</entry></row><row><entry /><entry>Answers</entry><entry>An array of answer objects</entry></row><row><entry /><entry>ExtraAnswers</entry><entry>An array of answer objects</entry></row><row><entry /><entry>Confirms</entry><entry>An array of answer objects.</entry></row><row><entry /><entry>Prompt</entry><entry>The Prompt object for this QA</entry></row><row><entry /><entry>Reco</entry><entry>The Reco object for this QA</entry></row><row><entry /><entry>Dtmf</entry><entry>The Dtmf object for this QA</entry></row><row><entry>Command</entry><entry>Id</entry><entry>Programmatic name of the</entry></row><row><entry /><entry /><entry>control</entry></row><row><entry /><entry>SpeechIndex</entry><entry>Activation order of the control</entry></row><row><entry /><entry>Scope</entry><entry>The id of ASP.NET control that</entry></row><row><entry /><entry /><entry>activates this Command grammar</entry></row><row><entry /><entry>Type</entry><entry>The type of this Command in</entry></row><row><entry /><entry /><entry>order to allow the overriding</entry></row><row><entry /><entry /><entry>of identically typed commands</entry></row><row><entry /><entry>XpathTrigger</entry><entry>SML document path that triggers</entry></row><row><entry /><entry /><entry>this command</entry></row><row><entry /><entry>AcceptCommandThreshold</entry><entry>Confidence level of recognition</entry></row><row><entry /><entry /><entry>that is necessary to trigger</entry></row><row><entry /><entry /><entry>this command</entry></row><row><entry /><entry>OnClientCommand</entry><entry>Function to execute on</entry></row><row><entry /><entry /><entry>recognition of this Command's</entry></row><row><entry /><entry /><entry>grammar</entry></row><row><entry /><entry>AutoPostBack</entry><entry>Whether or not Command control</entry></row><row><entry /><entry /><entry>posts back to server when</entry></row><row><entry /><entry /><entry>Command grammar is recognized.</entry></row><row><entry /><entry>Prompt</entry><entry>A Prompt object</entry></row><row><entry /><entry>Grammar</entry><entry>The grammar object which will</entry></row><row><entry /><entry /><entry>listen for the command</entry></row><row><entry /><entry>Dtmf</entry><entry>The Dtmf object which will</entry></row><row><entry /><entry /><entry>activate the command</entry></row><row><entry>CompareValidator</entry><entry>Id</entry><entry>Programmatic name of the</entry></row><row><entry /><entry /><entry>control</entry></row><row><entry /><entry>SpeechIndex</entry><entry>Activation order of the control</entry></row><row><entry /><entry>Type</entry><entry>Sets the datatype of the</entry></row><row><entry /><entry /><entry>comparison</entry></row><row><entry /><entry>ElementToCompare</entry><entry>The JScript variable or Id of</entry></row><row><entry /><entry /><entry>the SemanticItem used as the</entry></row><row><entry /><entry /><entry>basis for the comparison</entry></row><row><entry /><entry>SemanticItemToValidate</entry><entry>The Id of the control that is</entry></row><row><entry /><entry /><entry>being validated</entry></row><row><entry /><entry>SemanticItemToCompare</entry><entry>The Id of the control that is</entry></row><row><entry /><entry /><entry>the basis for comparison</entry></row><row><entry /><entry>Operator</entry><entry>Validation operator</entry></row><row><entry /><entry>InvalidateBoth</entry><entry>Whether or not to invalidate</entry></row><row><entry /><entry /><entry>both ElementToCompare and</entry></row><row><entry /><entry /><entry>ElementToValidate</entry></row><row><entry /><entry>Prompt</entry><entry>Prompt to indicate the error</entry></row><row><entry>CustomValidator</entry></row><row><entry /><entry>id</entry><entry>Programmatic name of the</entry></row><row><entry /><entry /><entry>control</entry></row><row><entry /><entry>SpeechIndex</entry><entry>Activation order of the control</entry></row><row><entry /><entry>SemanticItemToValidate</entry><entry>The Id of the control that is</entry></row><row><entry /><entry /><entry>being validated</entry></row><row><entry /><entry>AttributeToValidate</entry><entry>Attribute of the</entry></row><row><entry /><entry /><entry>ElementToValidate that contains</entry></row><row><entry /><entry /><entry>the value being validated</entry></row><row><entry /><entry>ClientValidationFunction</entry><entry>Validation function</entry></row><row><entry /><entry>Prompt</entry><entry>Prompt to indicate the error</entry></row><row><entry>Answer</entry></row><row><entry>object</entry></row><row><entry /><entry>id</entry><entry>Programmatic name of the object</entry></row><row><entry /><entry>XpathTrigger</entry><entry>The part of the SML document</entry></row><row><entry /><entry /><entry>this answer refers to</entry></row><row><entry /><entry>ClientNormalizationFunction</entry><entry>Function that returns author-</entry></row><row><entry /><entry /><entry>specified transformation of the</entry></row><row><entry /><entry /><entry>recognized item</entry></row><row><entry /><entry>SemanticItem</entry><entry>The semantic item to which this</entry></row><row><entry /><entry /><entry>answer should be written</entry></row><row><entry /><entry>ConfirmThreshold</entry><entry>The minimum confidence level of</entry></row><row><entry /><entry /><entry>recognition necessary to mark</entry></row><row><entry /><entry /><entry>this item as confirmed</entry></row><row><entry /><entry>Reject</entry><entry>Rejection threshold for the</entry></row><row><entry /><entry /><entry>Answer</entry></row><row><entry /><entry>OnClientAnswer</entry><entry>Function to be called when the</entry></row><row><entry /><entry /><entry>XpathTrigger is matched</entry></row><row><entry /><entry>AutoPostBack</entry><entry>Whether or not to post back to</entry></row><row><entry /><entry /><entry>the server each time user</entry></row><row><entry /><entry /><entry>interacts with the control</entry></row><row><entry>Prompt</entry></row><row><entry>object</entry></row><row><entry /><entry>id</entry><entry>Programmatic name of the object</entry></row><row><entry /><entry>type</entry><entry>Mime-type corresponding to the</entry></row><row><entry /><entry /><entry>speech output format</entry></row><row><entry /><entry>prefetch</entry><entry>Whether or not the prompt</entry></row><row><entry /><entry /><entry>should be immediately</entry></row><row><entry /><entry /><entry>synthesized and cached at</entry></row><row><entry /><entry /><entry>browser when the page is loaded</entry></row><row><entry /><entry>lang</entry><entry>The language of the prompt</entry></row><row><entry /><entry /><entry>content</entry></row><row><entry /><entry>bargein</entry><entry>Whether or not the speech</entry></row><row><entry /><entry /><entry>platform is responsible for</entry></row><row><entry /><entry /><entry>stopping prompt playback when</entry></row><row><entry /><entry /><entry>speech or DTMF input is</entry></row><row><entry /><entry /><entry>detected.</entry></row><row><entry /><entry>PromptSelectFunction</entry><entry>Function that selects and/or</entry></row><row><entry /><entry /><entry>modifies a prompt string prior</entry></row><row><entry /><entry /><entry>to playback</entry></row><row><entry /><entry>OnClientBookmark</entry><entry>Function which is called when a</entry></row><row><entry /><entry /><entry>bookmark is reached in the</entry></row><row><entry /><entry /><entry>prompt text during playback</entry></row><row><entry /><entry>OnClientError</entry><entry>Function called in response to</entry></row><row><entry /><entry /><entry>an error event in the client</entry></row><row><entry /><entry>InLinePrompt</entry><entry>Text of the prompt</entry></row><row><entry /><entry>Params</entry><entry>Specifies non-standard speech</entry></row><row><entry /><entry /><entry>platform configuration values</entry></row><row><entry>Reco</entry></row><row><entry>object</entry></row><row><entry /><entry>Id</entry><entry>Programmatic name of the object</entry></row><row><entry /><entry>StartElement</entry><entry>Name of the GUI element to</entry></row><row><entry /><entry /><entry>throw the start event</entry></row><row><entry /><entry>StartEvent</entry><entry>Name of the GUI event that</entry></row><row><entry /><entry /><entry>will activate the underlying</entry></row><row><entry /><entry /><entry>client-side Reco object</entry></row><row><entry /><entry>StopElement</entry><entry>Name of the GUI element to</entry></row><row><entry /><entry /><entry>throw the stop event</entry></row><row><entry /><entry>StopEvent</entry><entry>Name of the GUI event that</entry></row><row><entry /><entry /><entry>will deactivate the underlying</entry></row><row><entry /><entry /><entry>client-side Reco object</entry></row><row><entry /><entry>initialTimeout</entry><entry>The time in milliseconds</entry></row><row><entry /><entry /><entry>between start of recognition</entry></row><row><entry /><entry /><entry>and the detection of speech</entry></row><row><entry /><entry>babbleTimeout</entry><entry>The period of time in</entry></row><row><entry /><entry /><entry>milliseconds in which the</entry></row><row><entry /><entry /><entry>recognizer must return a result</entry></row><row><entry /><entry /><entry>after detection of speech</entry></row><row><entry /><entry>maxTimeout</entry><entry>The period of time in</entry></row><row><entry /><entry /><entry>milliseconds between</entry></row><row><entry /><entry /><entry>recognition start and results</entry></row><row><entry /><entry /><entry>returned to the browser</entry></row><row><entry /><entry>endSilence</entry><entry>Period of silence in</entry></row><row><entry /><entry /><entry>milliseconds after the end of</entry></row><row><entry /><entry /><entry>an utterance which the</entry></row><row><entry /><entry /><entry>recognition results are</entry></row><row><entry /><entry /><entry>returned</entry></row><row><entry /><entry>Reject</entry><entry>The rejection threshold below</entry></row><row><entry /><entry /><entry>which the platform will throw</entry></row><row><entry /><entry /><entry>the noReco event</entry></row><row><entry /><entry>Lang</entry><entry>The language of the speech</entry></row><row><entry /><entry /><entry>recognition engine</entry></row><row><entry /><entry>Mode</entry><entry>Specifies the recognition mode</entry></row><row><entry /><entry /><entry>to be followed</entry></row><row><entry /><entry>GrammarSelectFunction</entry><entry>Client-side function called</entry></row><row><entry /><entry /><entry>prior to starting the</entry></row><row><entry /><entry /><entry>recognition process</entry></row><row><entry /><entry>OnClientSilence</entry><entry>Client-side function that will</entry></row><row><entry /><entry /><entry>be called after detecting</entry></row><row><entry /><entry /><entry>silence</entry></row><row><entry /><entry>OnClientNoReco</entry><entry>Client-side function that will</entry></row><row><entry /><entry /><entry>be called after detecting no</entry></row><row><entry /><entry /><entry>recognition</entry></row><row><entry /><entry>OnClientError</entry><entry>Client-side function that will</entry></row><row><entry /><entry /><entry>be called after recognition</entry></row><row><entry /><entry /><entry>errors</entry></row><row><entry /><entry>OnClientSpeechDetected</entry><entry>Client-side function called</entry></row><row><entry /><entry /><entry>when recognition platform</entry></row><row><entry /><entry /><entry>detects speech</entry></row><row><entry /><entry>Grammars</entry><entry>An array of grammar objects.</entry></row><row><entry /><entry>Params</entry><entry>Specifies non-standard speech</entry></row><row><entry /><entry /><entry>platform configuration values</entry></row><row><entry /><entry>Record</entry><entry>Used for recording audio input</entry></row><row><entry /><entry /><entry>from the user.</entry></row><row><entry>Grammar</entry></row><row><entry /><entry>id</entry><entry>Programmatic name of the object</entry></row><row><entry /><entry>type</entry><entry>Mime-type of the grammar format</entry></row><row><entry /><entry /><entry>used</entry></row><row><entry /><entry>lang</entry><entry>Language of the grammar</entry></row><row><entry /><entry>src</entry><entry>URI of the grammar to load</entry></row><row><entry /><entry>InLineGrammar</entry><entry>Text of the grammar</entry></row><row><entry>Dtmf</entry></row><row><entry>object</entry></row><row><entry /><entry>id</entry><entry>Programmatic name of the object</entry></row><row><entry /><entry>numDigits</entry><entry>Number of key presses required</entry></row><row><entry /><entry /><entry>to end the DTMF collection</entry></row><row><entry /><entry /><entry>session</entry></row><row><entry /><entry>autoflush</entry><entry>Whether or not to automatically</entry></row><row><entry /><entry /><entry>flush the DTMF buffer on the</entry></row><row><entry /><entry /><entry>underlying telephony interface</entry></row><row><entry /><entry /><entry>card before activation</entry></row><row><entry /><entry>terminalChar</entry><entry>Terminating key to end the DTMF</entry></row><row><entry /><entry /><entry>collection session</entry></row><row><entry /><entry>initialTimeout</entry><entry>Number of milliseconds to wait</entry></row><row><entry /><entry /><entry>between activation and the</entry></row><row><entry /><entry /><entry>first key press before raising</entry></row><row><entry /><entry /><entry>a timeout event</entry></row><row><entry /><entry>interdigitTimeout</entry><entry>Number of milliseconds to wait</entry></row><row><entry /><entry /><entry>between key presses before</entry></row><row><entry /><entry /><entry>raising a timeout event</entry></row><row><entry /><entry>SMLContext</entry><entry>DTMF results wrapped in SML</entry></row><row><entry /><entry /><entry>tags</entry></row><row><entry /><entry>OnClientSilence</entry><entry>Function that executes if there</entry></row><row><entry /><entry /><entry>is no DTMF key press before</entry></row><row><entry /><entry /><entry>initialTimeout expires</entry></row><row><entry /><entry>OnClientKeyPress</entry><entry>Function that executes on every</entry></row><row><entry /><entry /><entry>pressing of a legal DTMF key.</entry></row><row><entry /><entry>OnClientError</entry><entry>Function that executes if</entry></row><row><entry /><entry /><entry>serious or fatal error occurs</entry></row><row><entry /><entry /><entry>with the DTMF</entry></row><row><entry /><entry /><entry>collection/recognition process</entry></row><row><entry>Params</entry><entry>Params</entry><entry>Specifies non-standard DTMF</entry></row><row><entry /><entry /><entry>engine configuration values</entry></row><row><entry /><entry>name</entry><entry>The name of the parameter to be</entry></row><row><entry /><entry /><entry>configured.</entry></row><row><entry>record</entry><entry>Value</entry><entry>The value assigned to the named</entry></row><row><entry /><entry /><entry>parameter</entry></row><row><entry /><entry>enabled</entry><entry>Whether or not to record user</entry></row><row><entry /><entry /><entry>input.</entry></row><row><entry /><entry>type</entry><entry>MIME type of the file</entry></row><row><entry /><entry /><entry>containing the recorded audio.</entry></row><row><entry /><entry /><entry>Whether or not to play a beep</entry></row><row><entry /><entry /><entry>before recording begins.</entry></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>