Initiating voice access to a session from a visual access channel to the session in a composite services delivery system

The present invention relates to the field of next generation networking (NGN), and more specifically to the placement and transmission of complex services on NGN networks.

Next Generation Networking (NGN) is an emerging computing networking technology that inherently supports data, video, and audio transmission. Unlike past circuit switching telephone networks, NGN networks perform packet switching, combining voice and data in a single network. Generally, NGN networks are categorized by the division between call control and call transmission. Also, in NGN networks, all information is transmitted via packets that can be labeled according to their respective types. Therefore, individual packets are treated differently depending on the type indicated on the corresponding label.

The IP Multimedia Subsystem (IMS) is an open, standardized, operator-friendly NGN multimedia architecture for mobile and fixed services. IMS implements Voice over Internet Protocol (VoIP), which is based on a variant of Session Initiation Protocol (SIP), and is the standard Internet Protocol (Internet). Run on protocol: IP). Telephone communication operators in NGN networks provide network-controlled multimedia services using IMS. The purpose of IMS is to provide users of NGN networks with new services in addition to those currently available. This broad purpose of IMS is supported through the widespread use of the underlying IP compatibility protocol and the corresponding IP compatibility interface. In this way, IMS can integrate the Internet with a wireless cellular space to provide cellular technology with useful services for ubiquitous access located on the Internet.

Multimedia services can be delivered in the same way both within NGN networks and within non-NGN networks through the use of documents with markup specified. For services that have a visual interface, visual-oriented markup, such as the extensible hypertext markup language (XHTML) and many of its common species, can be used, for example, in hypertext transfer in a visual content browser. You can specify a visual interface to a service when rendered through a visual content channel, such as a channel managed by the hypertext transfer protocol (HTTP). In comparison, the voice interface is a voice extensible markup. It can be specified for the service by voice-oriented markup such as language: VoiceXML). In the case of a voice interface, for example, it is done through a separate voice channel managed according to SIP.

In many situations, it is preferable to configure the service to be propagated across multiple different channels of different modalities, including audio and visual modes. In this regard, service providers cannot always predict the interactive modality of services that will be accessed by a given end user. To address this uncertainty, services can be prepared for communication through each expected modality, for example by voice and visual markups. However, generating multiple different markup documents to meet different access modality can be a tedious and tedious task. As a result, fusion technologies such as XHTML + VoiceXML (X + V) have been used to simplify the development process.

In particular, X + V represents one of the technological efforts to create a multimodal application development environment. In X + V, XHTML and VoiceXML can be mixed in a single document. The XHTML part of the document can manage the visual dialogue with the end user, and the VoiceXML part of the document can manage the voice dialogue with the end user. X + V allows command, control, and content navigation while simultaneously rendering multimodal content. In this regard, the X + V profile specifies how to calculate the grammar based on the visual hyperlinks present on the page.

<p> However, processing X + V documents requires the use of a unique browser within the client device used by the end user to access the content. Delivering multimedia services to a large number of end-user devices, including devices that are widespread across NGN networks, is unique to all end-user devices dealing with X + V and other unified technologies. It can be difficult if it is assumed to be configured. On the contrary, at best, the devices in the NGN network are designed to process visual dialogues within one standard communication channel and voice dialogues within a second standard communication channel. It can only be presumed to be.</p><p> Thus, despite the promising X + V, different communication channels are different in order to truly support multiple modalities of interaction with services delivered on NGN or even non-NGN networks. Must be established for each access modality. In addition, each service must be specified separately for each different modality. Finally, once a session is established over one access modality for a service, the intermediate session cannot be changed to different access modality for the same service within the same session. As a result, dialogues across different channels that address different dialogue modality remain out of sync and disjointed. As a result, end users are not free to switch between access modality for services in the NGN network.</p>

<p> Embodiments of the present invention address technical shortcomings relating to the placement and transmission of services to be accessed through different access channels in the NGN network, in order to place and transmit complex services in the NGN network. It provides new and non-trivial methods, systems, and equipment. As used herein, a composite service is accessed through multiple different access modality on different channels to accommodate in a common session, while maintaining synchronization of service state across different access channels. It is a service deployed across the NGN network that is enabled to be.</p><p> The present invention provides the method of claim 1 as well as the corresponding systems and computer programs.</p><p> Preferably, in order to establish a voice access channel for a common session for a complex service, the steps of processing a request from the visual access channel are the step of determining the phone number from the request and the voice enabler of the SIP request. It may include dialing a telephone number to transfer to and establish the voice access channel for a common session. Finally, in yet another aspect of the invention, in the per-channel view for the common session, the step of synchronizing the state changes for the common session maintains the state for the common session in the model for the common session. Steps to create a listener for state changes for the model for each voice and visual access channel, detect state changes for the model in the listener, and the model in the listener. It may include updating the view for each voice and visual access channel for a common session in response to detecting a change in state.</p><p> Preferably, the data processing system that enables the composite service may include multiple channel Servlets that can establish multiple different access channels for a common session for the composite service. At least one of the channel Servlets can include a voice enabler. The system may also include a location registry containing a table of entries that associate different access channels with a common session for complex services. Furthermore, the system joins the model for the common session, modifies the state data in the model for the common session, and has a different per-channel view of the common session depending on the changes detected in the model. May include model Servlets configured to synchronize. Finally, at least one view of the visual access channel for a single session can contain hyperlinks and establish a voice access channel for the common session for the voice enabler. Can provide a request to do so.</p><p> Further aspects of the invention will be described in part in the following description and may be partially apparent from this description or may be found by practicing the invention. Aspects of the present invention may be realized and achieved by the elements and combinations thereof specifically pointed out in the appended claims. It should be understood that both the above overview and the detailed description below are exemplary and for illustration purposes only and are not intended to limit the invention described in the claims.</p><p> The accompanying drawings are included in and constitute a part of the present specification, show embodiments of the present invention, and together with the present description, serve to explain the principles of the present invention. Fulfill. Although the embodiments described herein are preferred at this time, it is understood that the invention is not limited to the detailed sequences and means shown.</p>

Embodiments of the present invention provide methods, systems, and computer programs for transmitting complex services in NGN networks. According to one embodiment of the invention, the composite service enabler may establish different access channels for a common session in order to access the common session through corresponding different access modality including audio and visual modes. it can. Specifically, dialogue with a common session for a complex service can be provided across a selected channel of different channels, each corresponding to a different access modality for the common session. In the case of audio and visual modality, separate markup documents are used in each selected channel according to the particular modality of that channel.

The important thing is that within a complex services enabler, they can be associated to access a common session. As a result, the state of the common session is stored in the model in the Model-View-Controller architecture in the composite services enabler and is retained regardless of the channel used to change the state of the service. Can be done. In addition, the composite service enabler can synchronize the representation of the service in each view for a selected channel of different channels.

According to the present invention, a voice access channel for a common session for a composite service can be established through an established visual channel for the common session for the composite service. Specifically, the visual links placed within the page at the endpoint for the visual access channel can be invoked by the end user who wants to establish a separate audio channel for the common session. Depending on the activation of the link, it is possible to send a message instructing the voice enabler in the combined service enabler to dial the number specified by the link. The voice enabler then dials the number to try to establish a separate voice access channel for the common session. Once the telephone connection is accepted by the speaker, the common session can be associated with the newly established voice channel, synchronizing the model for the common session between the voice and visual access channels. be able to.

Fortunately, the system of the invention can be embodied within IMS in an NGN network. In the illustration, FIG. 1 is configured to be used in an NGN network with a data processing system that allows a voice access channel for a session for a complex service to be established from a visual access channel for that session. It is a realistic diagram of IMS. As shown in FIG. 1, the data processing system 200 that enables the composite service can be configured to deploy and transmit the composite multimedia service 180 in the NGN network 120. As used herein, a "composite multimedia service" may be a service configured to be accessed through multiple different views of different modality across different communication channels correspondingly. ..

More specifically, the composite multimedia service 180 is accessible through several different modality, including visual mode, instant messaging mode, and voice mode. Each access modality can be created by developer 190 through the use of service development tool 170. The service development tool 170 can be configured to create different access modality for the composite multimedia service 180, with visual markup and composite multi to provide visual access to the composite multimedia service 180. Includes voice markup to provide or audible access to media service 180.

One or more gateway server platforms 110 can be combined with a data processing system 200 that enables complex services. Each gateway server platform 110 can facilitate the establishment of communication channels to access the composite multimedia service 180 according to a particular access modality. For example, the gateway server platform 110 may include a content server such as a web server that can provide visual markup for accessing the composite multimedia service 180 on the NGN network 120 through visual mode. Similarly, the gateway server platform 110 may include a voice server capable of providing audible access to the composite multimedia service 180 on the NGN network 120 through audible mode.

The end user 130 can access the composite multimedia service 180 using any one of the client access device 150 choices. The application logic within the client access device 150 can provide an interface for a particular access modality. Examples include content browsers in personal computing devices, audible user interfaces in popular devices, telephone user interfaces in telephones, and the like. Importantly, each provided access modality is separate of multiple channels 160 established with the corresponding gateway server platform 110 on network 120 for the same session with composite multimedia service 180. It means that you can use one of them. In this regard, a session with the composite multimedia service 180 has multiple channels 160 to provide different access modality to the composite multimedia service 180 to one of the end users 130. Can exist across.

In a more specific diagram, FIG. 2 is a schematic diagram of a data processing system 200 that enables the combined services of FIG. The data processing system 200, which enables complex services, can operate on application server 275 and is a composite multimedia on different access channels 245,250,255 for different endpoint types 260A, 260B, 260C in the NGN network. It may include multiple channel servlets 235 configured to handle communication interactions with the corresponding session 225 for the service. In this regard, Channel Servlet 235 provides Real Time over HTTP. As a voice enabler and voice server for a visual endpoint 260A that implements a voice interface utilizing Protocol: RTP) or a voice endpoint 260 that utilizes SIP, it can handle voice dialogue. Similarly, Channel Servlet 235 can handle visual dialogues as a web application for the visual endpoint 160A. As yet another example, Channel Servlet 235 can handle instant message dialogues as an instant messaging server for the instant messaging endpoint 260C.

More specifically, Channel Servlet 235 may be able to handle HTTP requests for dialogue with the corresponding session 225 for composite multimedia services. HTTP requests can be made in voice mode from a visual mode-oriented web page on visual channel 245, from a visual mode-oriented instant messaging interface on instant messaging channel 255, or on voice channel 250 enabled by SIP. Can also be emitted. Similarly, Channel Servlet 235 is coupled to SIPlet, which is well known in the art and is useful in combination to handle voice dialogue for Corresponding Session 225 for composite multimedia services. VoiceXML and call control extensible markup Through a voice enabler that may include appropriate voice markup (language: CCXML), it may be possible to handle SIP requests for dialogue with the corresponding session 225 for composite multimedia services.

Each channel Servlet 235 can be combined with Model Servlet 220. Model Servlet 220 can arbitrate a dialogue with model 210 for the associated session of session 225. Each session 225 is manageable within Session Manager 215, which correlates different communication channels established through Channel Servlet 235 with the corresponding session of Session 225. Can be done. The interassociation of different communication channels can be facilitated through the use of the combined location registry 230. The location registry 230 can contain a table showing the host name of the system and the active channel for one of the corresponding sessions in session 225.

Model Servlet 220 can now access Model 210 for Correspondence Session 225 for Composite Multimedia Services, which provides different access channels 245,250,255 from each other through different endpoints 260A, 260B, 260C. May include program code. For example, model 210 can be encapsulated within an entity bean within a bean container. In addition, model 210 is the corresponding one of session 225, regardless of the access channel 245,250,255 for which session data is created, removed, or modified for the corresponding cache of session 225. Session data for a session can be stored.

In particular, session-by-session state changes for composite multimedia services can be synchronized across different views 260 for different access channels 245,250,255 through listener architecture. The listener architecture can include one or more listeners 240 per model 210. Each listener can accommodate different access channels 245,250,255 and can detect state changes for model 210. In response to detecting a state change for model 210 in one of session 225 for composite multimedia services, listener 240 joins through the corresponding one in channel Servlet 235. Notifications can be provided to the view 260 in use so that the view 260 in subscription can refresh to incorporate the detected state changes for the model 210.

FIG. 3 is a flow chart showing the process for managing multiple access channels for a single session for a complex service in the data processing system of FIG. Starting at block 310, the first access channel is opened for the composite multimedia service and at block 320 a session is established with the composite multimedia service. The data for the session is stored in the model for the session which can be established in block 330. If additional access channels are to be established for the session in decision block 340, processing can continue in block 350. At block 350, as many additional access channels as needed can be established for the same session.

If it is not necessary to establish any more access channels in the determination block 340, a listener may be registered in the block 360 for each access channel established for the session. Then, in block 370, an event may be received at each listener. If a model change is detected in decision block 380, then in block 390 the model change may be provided to each endpoint for the selected channel of the established access channels. As a result, the endpoint receives the change and of the selected channel of the established access channels for the same session, regardless of the particular access channel to which the change to the model was applied. The change may be applied to the corresponding view for.

In particular, once a visual access channel is established for a session, a new voice access channel for that session can be established through the endpoint for the visual access channel. In a more specific illustration, FIG. 4 is a flow chart showing the process of establishing a voice access channel for a session for a complex service from a visual access channel for that session in an NGN network. Starting at block 410, a visual channel can be established for the session. The endpoint for the visual channel is a user, such as a hyperlink, configured to send a request to a composite service enabler to establish a separate voice access channel for the session for a particular telephone communication endpoint. -Can include interface elements.

For this purpose, if in decision block 420 a user interface element is invoked to indicate a request to dial a new voice access channel, processing may continue in block 440. Otherwise, the visual access channel may remain intact in block 430. In block 440, if it is determined that a new voice access channel is to be established by invoking a user interface element, then in block 440, the voice end identified for the composite service enabler. A request can be issued to dial a new voice access channel for the point. Then, in block 450, a SIP invite may be issued to the voice enabler with a SIP information request identifying the endpoint's phone number.

At block 460, the voice enabler can dial the endpoint's phone number, and at block 470, a voice access channel for the session can be established. Once a voice access channel for a session is established, end-user dialogue with the session can continue through either the voice access channel or the visual access channel. Changes applied to the model for sessions through either the voice access channel or the visual access channel can be synchronized across all access channels each time the change is detected through the listener architecture. ..

Embodiments of the invention can be entirely hardware-only, completely software-only, or include both hardware and software elements. In a preferred embodiment, the invention is implemented in software including, but is not limited to, firmware, resident software, microcode, and the like. In addition, the present invention provides computer programs accessible from computer-enabled or computer-readable media that provide program code for use by or in connection with a computer or any instruction execution system. It can take the form of a product.

For the purposes of this description, computer-enabled or computer-readable media includes programs that provide program code for use by or in connection with instruction execution systems, devices, or devices. , Can be any device capable of storing, communicating, propagating, or transmitting. The medium can be electronic, magnetic, optical, electromagnetic, infrared, or a semiconductor system (or device or device) or propagation medium. Examples of computer-readable media include semiconductor or solid-state memory, magnetic tape, removable computer diskettes, random access memory (RAM), and read-only memory (ROM). , As well as fixed magnetic disks and optical disks. Current examples of optical discs are compact disk-read only memory (CD-ROM), compact disk-read / write (compact). disk-read / write: CD-R / W), and DVD included.

A data processing system suitable for storing and / or executing program code includes at least one processor that is directly or indirectly coupled to a memory element through the system bus. Memory elements are at least some local memory used during the actual execution of program code, mass storage, and at least some to reduce the number of times code must be retrieved from mass storage during execution. It may include cache memory that provides temporary storage of program code. Input / output or I / O devices (including keyboards, displays, pointing devices, etc.) can be coupled to the system either directly or through an intervening I / O controller. A network adapter may also be coupled to the system to allow the data processing system to be coupled through a dedicated or public network that intervenes with other data processing systems or remote printers or storage devices. Modems, cable modems, and Ethernet (R) cards are just a few of the currently available types of network adapters.

<figref num="1">A substantive diagram of IMS configured to be used in an NGN network with a data processing system that allows voice access channels for sessions for complex services to be established from visual access channels for sessions. ..</figref><figref num="2">FIG. 5 is a schematic diagram of a data processing system arranged in an NGN network so as to establish a voice access channel for a session for a complex service from a visual access channel for the session.</figref><figref num="3">FIG. 2 is a flow chart showing the processing for managing multiple access channels for a single session for a complex service in the data processing system of FIG.</figref><figref num="4">It is a flow chart which shows the process for establishing the voice access channel for a session for a complex service from the visual access channel for the session in an NGN network.</figref>