Converged conferencing appliance and methods for concurrent voice and data conferencing sessions over networks
Claim Score by NHIP
Abstract
A converged conferencing appliance having at least one voice port and one data port for managing multi-device conferences allowing multiple participants to concurrently connect diverse devices over public switched, mobile, IP, wireless local or wide area, personal networks, and cable or fixed wireless networks. Each of the ports can be connected to an individual, respective device and all of the ports can be configured for simultaneous operation. In addition to the voice and data ports, at least one broadband port and at least one wireless port can be provided in the appliance. A mechanism is also provided to synchronize multi-modal communications and conferences among a number of users. Participants may participate in integrated voice, data and video conferences by simultaneously connecting from one or more devices such as traditional phones, mobile phones, voice and data capable smart phones, computers, VoIP devices, wireless devices and other intelligent handheld devices.

Term
Projected expiry 22 December 2027.
- Priority
- Filed
- Published
- Today
- Projected expiry
6 claims: 2 independent, 4 dependent
- 1A data converging appliance, comprising:a) a first data input/output (I/O) port for receiving and transmitting data of a first data type to and from a first device having a first device type and being adapted to send and receive data of said first data type, said first device being operably connected to said first I/O port;b) a second data (I/O) port for receiving and transmitting data of a second data type to and from a second device having a second device type and being adapted to send and receive data of said second data type, said second device being operably connected to said second I/O port;c) a third data (I/O) port for receiving and transmitting data of at least one of said first data type and said second data type to and from a third device adapted to send and receive data of at least one of said first data type and said second data type, said third device being operably connected to said third I/O port;and d) means for formatting data disposed between at least two of said first, second, and third I/O ports for formatting data from at least one of said first, second and third devices into a form compatible with at least one other of said first, second, and third devices;at least two of said first, second, and third devices being used substantially simultaneously by a single user for concurrently sending and receiving data of said first and second data types on at least two respective ones of said first, second, and third devices.
- 3Broadest claimClaim Score 92, very broad(NHIP)The data converging appliance in accordance with claims 2 , further comprising at least one wireless port for facilitating communications with wireless devices.
- 4An apparatus for facilitating coordinated, concurrent, multi-modal conferences, comprising an appliance comprising at least one voice port and at least one data port, each of said ports being connectable to an individual device and all of said ports configurable for substantially simultaneous operation.
Independent claims3
124 paragraphs in 5 sections, as filed
RELATED APPLICATION
P-0001[0001] This continuation-in-part application claims priority in accordance with 35 U.S.C. §119(e) to U.S. Provisional Patent Application Serial No. 60/375,558 filed Apr. 25, 2002, included herein in its entirety by reference. The application is also related to U.S. patent application Ser. No. 10/106,852, filed Mar. 26, 2002.
BACKGROUND OF THE INVENTION
P-0002[0002] 1. Field of the Invention
P-0003[0003] The present invention relates to electronic conferencing and, more particularly, to a conferencing appliance that enables remote and local participants to connect to one another using disparate devices and for establishing and managing concurrent voice, data and video conferencing sessions initiated by one of more of such devices over heterogeneous networks.
P-0004[0004] 2. Discussion of the Related Prior Art
P-0005[0005] Many conferencing technologies span such areas as voice conferencing, video teleconferencing, data collaboration and instant messaging. However, no systems deliver converged content (e.g., data and voice) accessed both as voice and data synchronously over multiple and heterogeneous networks using disparate devices which operate concurrently in an integrated manner.
P-0006[0006] There is an increasing demand in-the business community and elsewhere for a facility that allows interaction among geographically distributed participants in a manner similar to face to face interaction in a conference room setting. However, distributed participants may not have video conferencing equipment or a powerful desktop computer but rather a mobile phone and a personal digital assistant with intermittent wireless coverage. For that matter, the participant may be in a hotel room where using an Internet connection for all communication as this approach may be more economical than using a traditional telephone. To meet their basic conferencing needs of interacting with voice and data, the business community today relies on two separate conferences: one for data and one for voice, generally though not necessarily delivered from two separate vendors. One problem is that besides the economics and incompatible infrastructure, conferences are disjointed. Neither does the present conferencing strategy offer interactivity amongst the voice and data sessions. Additionally it does not span the gamut of device support and network coverage that is needed in today's market for the mobile work force. For video conferences, special infrastructure at all ends is generally needed and there is no provision for voice controls or interactivity with the data.
P-0007[0007] These problems are compounded with a rapidly growing mobile workforce and such disparity in communication technology where a wireless device may be incapable of operating over another's network and where voice, data, broadband and wireless networks are holistic and mutually exclusive. Therefore, there is a compelling need for a conferencing appliance that enables participants to connect using disparate devices over heterogeneous networks and which delivers a converged voice, data and video session in an integrated way. Beyond general integration of devices and networks, the appliance needs the capacity to control, manage and distribute merged and repurposed content to any device, over any network and in any media format for each participant within the context of the conferencing session. It is therefore an object of the present invention to provide conferencing interactivity among various conferencing participants using disparate devices working in concert, over different media streams such as voice, data and video.
P-0008[0008] Therefore, a need exists for an apparatus that enables participants to interact in a conferencing mode via a combination of media (e.g., voice, data and video) from a variety of devices (e.g., computer, wireless devices, mobile phones), from a variety of networks (e.g., PSTN, IP, Wireless, Cable and Broadband) from any global location. Furthermore, a need exists for a general purpose voice, data, video conferencing appliance delivering new conferencing capability and interactivity.
P-0009[0009] It is therefore an object of the present invention to provide a conferencing appliance that enables multiple users to connect to one another.
P-0010[0010] It is an additional object of the present invention to provide a conferencing appliance wherein one or more devices may be connected across multiple networks in a manner that all of a user's devices operate synchronously and concurrently.
P-0011[0011] It is a further object of the present invention to provide a conferencing appliance wherein users may participate in a multi-media (voice, data and video) converged conference.
P-0012[0012] It is yet another object of the present invention to provide a conferencing appliance supporting multiple network interfaces for connecting to a wide range of diverse devices.
P-0013[0013] It is a still further object of the present invention to provide a conferencing appliance wherein end users can participate in a rich-media (voice, data and video) conferencing session enabling users to talk, view video, exchange and share files, and collaborate data substantially simultaneously.
P-0014[0014] It is an additional object of the present invention to provide a conferencing appliance which provides support for next generation devices that are capable of delivering voice, data and video but which need to connect to such an appliance controls network connections and support concurrent delivery of voice, data and video within the context of a conferencing session.
P-0015[0015] It is also an object of the present invention to provide a conferencing appliance to optimize data shared during conference to ensure best viewing by each conference participant.
P-0016[0016] It is an additional object of the present invention to provide a conferencing appliance that transforms data by reformatting, repurposing and compressing files shared during the conference based upon parameters such as screen size, rendering capability, bandwidth and the network prior to delivering the data to a participant's display devices.
P-0017[0017] It is a further object of the present invention to provide a conferencing appliance wherein intelligent content transformation enables a range of disparate devices to be used for conferencing, even over low-bandwidth networks, thereby avoiding premature obsolescence of the devices.
P-0018[0018] It is a still further object of the present invention to provide a conferencing appliance to provide methods for establishing, managing and switching concurrent voice and data conferencing sessions for each participant over heterogeneous networks.
P-0019[0019] It is an additional object of the present invention to provide a conferencing appliance wherein dedicated channels for each device converge into a media interchange where, based upon user controls, voice and data can be simultaneously delivered to each participant depending upon application controls, device capability and device signature.
P-0020[0020] It is yet another object of the present invention to provide a conferencing appliance wherein conferencing data or conferencing commands are purposed in real time so that they can be accessed by each device for appropriate media delivery.
P-0021[0021] It is also an object of the present invention to provide a conferencing appliance, which enables switching of sessions among channels and devices based upon certain trigger events that can occur before or during conferencing.
P-0022[0022] It is an additional object of the present invention to provide a conferencing appliance that schedules a conference, controls a conference and sets up and tears down rich-media conferences using voice or data controls over one channel, while data or content is delivered over another channel.
SUMMARY OF THE INVENTION
P-0023[0023] In accordance with the present invention, there is provided a converged conferencing appliance capable of establishing and managing a multi-device concurrent voice, data and video conference by enabling multiple conference participants to connect from one or more devices concurrently over public switched telephone networks (PSTN), mobile networks, IP (Internet Protocol), wireless local or wide area networks, personal networks, and cable or fixed wireless networks (coax, fiber, hybrid fiber coax). The appliance has at least one vo9ice port and at least one data port. Each of the ports can be connected to an individual, respective device and all of the ports can be configured for simultaneous operation. In addition to the voice and data ports, at least one broadband port and at least one wireless port can be provided in the appliance. A mechanism is also provided to synchronize multi-modal communications and conferences among a number of users. Participants may connect and participate in an integrated voice, data and video conferencing session by connecting simultaneously from one or more diverse devices such that all devices of a participant operate concurrently and in concert. The combined effect of connecting from multiple devices enables a user to experience rich-media voice and data interactivity in a single conferencing session. This enables users to talk, view video and collaborate with data—all simultaneously and within the context of a single session operating over multiple devices, channels and networks. Users can participate in a conference from devices such as traditional phones, mobile phones, voice and data capable smart phones, computers, voice over IP devices, wireless devices (e.g., personal digital assistants, tablet personal computers, wireless notebook computers), next generation of voice and data capable and intelligent handheld devices including voice over IP devices, Bluetooth devices (e.g., Bluetooth enabled mobile phone, tablet PCs, notebook computers), infrared devices (handheld computers, overhead displays), broadband devices and residential gateways.
BRIEF DESCRIPTION OF THE DRAWINGS
P-0024[0024] A complete understanding of the present invention may be obtained by reference to the accompanying drawings, when considered in conjunction with the subsequent detailed description, in which:
P-0025[0025]FIG. 1 is a system block diagram including the voice and data conferencing appliance of the present invention;
P-0026[0026]FIG. 1<i>a </i>is a schematic block diagram of the components residing in the appliance shown in FIG. 1;
P-0027[0027]FIG. 2 is a schematic block diagram of a voice conferencing system of the prior art;
P-0028[0028]FIG. 3 is a schematic block diagram of a data collaboration and conferencing system of the prior art;
P-0029[0029]FIG. 4 is a schematic block diagram of a server based voice over IP system of the prior art;
P-0030[0030]FIG. 5 is a schematic block diagram of a peer-to-peer voice over IP system of the prior art;
P-0031[0031]FIG. 6 is a schematic block diagram of a server based video conferencing system of the prior art;
P-0032[0032]FIG. 7 is a schematic block diagram of a peer-to-peer server based video conferencing system of the prior art;
P-0033[0033]FIG. 8 is a schematic block diagram of an instant messaging system of the prior art;
P-0034[0034]FIG. 9 is a schematic block diagram of a unified messaging system of the prior art;
P-0035[0035]FIG. 10 is a schematic block diagram of a server based voice over IP system in accordance with the present invention;
P-0036[0036]FIG. 11 is a schematic block diagram of a voice port portion of the convergence appliance of FIG. 1;
P-0037[0037]FIG. 12 is a table of certain voice port protocols supported by the voice port of FIG. 11;
P-0038[0038]FIG. 13 is a schematic block diagram of an analog <b>8</b> voice port configuration of the convergence appliance of FIG. 1;
P-0039[0039]FIG. 14 is a schematic block diagram of a digital <b>24</b> port configuration of the convergence appliance of FIG. 1;
P-0040[0040]FIG. 15 is a schematic block diagram <b>4</b> data port configuration (10/100/1000 Mbps) of the convergence application of FIG. 1;
P-0041[0041]FIG. 16 is a schematic block diagram of Bluetooth ports of the convergence application of FIG. 1;
P-0042[0042]FIG. 17 is a flow chart/timing diagram depiction of voice conferencing session initiation;
P-0043[0043]FIG. 18 is a flow chart/timing diagram depiction of data conferencing session initiation;
P-0044[0044]FIG. 19 is a flow chart/timing diagram depiction of voice over IP conferencing session initiation;
P-0045[0045]FIG. 20 is a flow chart/timing diagram depiction of voice and data converged conferencing session initiation;
P-0046[0046]FIG. 21 is a block diagram of the conference convergence engine of the invention;
P-0047[0047]FIG. 22 is a block diagram depicting structure required to manage a voice and data conference;
P-0048[0048]FIG. 23 is a block diagram depicting structure required to schedule a voice and data conference;
P-0049[0049]FIG. 24 is a block diagram depicting conference code and organizer code;
P-0050[0050]FIG. 25 is a flow diagram of multi-media conferencing notification;
P-0051[0051]FIG. 26 is a block diagram depicting user registration;
P-0052[0052]FIG. 27 is a flow chart of system operations of the voice and data operational engine; FIG. 28 is a block diagram depicting the conferencing dashboard;
P-0053[0053]FIG. 29 is a table of certain functions used in a conferencing telephony dashboard; and
P-0054[0054]FIG. 30 is a structured flow chart depicting a conference session setup and tear down procedure.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
P-0055[0055] The present invention provides a conferencing appliance that allows participants to connect directly to the appliance through various means either locally or remotely through any network. Referring first to FIG. 1, there is shown a schematic block diagram of such a conferencing appliance <b>10</b> wherein a participant, not shown, may connect remotely from public switched telephony network (PSTN) <b>20</b>, a mobile data network <b>30</b>, an Internet Protocol (IP) based local area network (LAN) or wide area network (WAN) <b>40</b>, a wireless LAN or WAN <b>50</b> and cable or fixed wireless networks <b>70</b>. A participant may also connect locally to a device over personal wireless networks <b>60</b> such as those utilizing Bluetooth or infrared connection technologies.
P-0056[0056] Each of these networks supports a multitude of devices that a user may use to participate in a conference. Examples of these devices include a phone <b>80</b>, mobile phone <b>82</b>, smart phone <b>84</b>, computer <b>86</b>, voice over IP device <b>88</b>, wireless devices such as pager and personal digital assistant <b>90</b>, next generation wireless device <b>92</b>, Bluetooth-equipped device <b>94</b>, IR-enabled device <b>96</b>, video equipment or other broadband device <b>98</b>, residential gateway <b>99</b> and a host of other devices, not shown. The inventive conferencing appliance <b>10</b> may be extended to any suitable communications device, known or not yet invented, and the invention is not considered limited to the devices described-for purposes of disclosure. These devices can be used by participants to connect to the appliance <b>10</b> through any one or more of the available means to schedule a conference, join a conference or manage a conference.
P-0057[0057] Referring to FIG. 2, a voice conferencing device <b>110</b> of the prior art enables voice conferencing amongst two or more participants, enabling them to use any traditional phone <b>80</b><i>a</i>, <b>80</b><i>b </i>and mobile phones <b>82</b><i>a</i>, <b>82</b><i>b</i>. Each user “dials” into a conference bridge using either a toll or toll-free number. Upon connecting, the user authenticates himself by entering a pre-set password and/or meeting number. Upon gaining access, the user can talk or listen “normally” and participate in a voice-only conference. The voice conferencing device <b>110</b> is not capable of enabling users to share data, nor is it capable of allowing the user to issue special commands through the voice circuits to control any other device capable of delivering data. Such devices operate within the PSTN networks and do not generally interoperate on IP, broadband, cable or fixed Wireless networks.
P-0058[0058] Referring to FIG. 3, a data collaborating device <b>120</b> of the prior art enables data-collaboration amongst two or more participants enabling them to use general purpose personal computers <b>86</b><i>a</i>, <b>86</b><i>b </i>with browsers or with other client software to collaborate and share data amongst themselves. Each user points to a universal record locator (URL) on the Internet from their browser, authenticates himself by entering a password and/or meeting number, thereby enabling him to share PowerPoint® presentations, Word® documents, or other files and even electronic white-board content. Such a prior art system enables data sharing in data-only mode with no controls for voice-conferencing. If the participants want to also “talk” while sharing data, the users have to connect via separate voice-conferencing service perhaps something similar to a voice conferencing bridge <b>110</b> (FIG. 2) as a separate unit. The voice-conferencing session and the data-collaboration sessions are mutually exclusive; there is no “connection” between the voice and data sessions. Also, this prior art system falls short in that it operates only on an IP network; it does not offer voice conferencing capability, and does not provide an integrated voice and data collaborative session.
P-0059[0059] Referring to FIGS. 4 and 5, voice conferencing is enabled over IP networks of the prior art using so called voice over IP (VoIP) technology. Two or more computers or handheld devices, with voice over IP software installed as an application, can establish either a server-based voice over IP conferencing session <b>130</b> or a point-to-point <b>140</b> conference session such that participants can simply bypass the PSTN network by talking directly with or without microphones connected with various devices <b>88</b><i>a</i>-<b>88</b><i>d </i>such as VoIP enabled computers, handhelds or VoIP devices. This prior art system can deliver voice as data but falls short of delivering data concurrently with the voice over IP session. Users cannot collaborate with files or invoke data deliver using VoIP commands. Also, the prior art method used with this system operates only over IP networks and not on the PSTN network.
P-0060[0060] Referring to FIGS. 6 and 7, server-based <b>150</b> or point-to-point <b>160</b> videoconference of the prior art enables two or more participants (or group of participants) to “view” each other through a feed from local cameras mounted at each participating location with a computer with video application and equipment <b>151</b>, <b>153</b> or proprietary video endpoint <b>152</b> or <b>154</b>. Each video feed from a location is fed to other participating sites through a central server or through a point-to-point connection between endpoints and computers. Voice from each of these conference locations is also distributed and broadcast from each location to the others. Voice and video can be delivered over PSTN, IP, or proprietary network connections <b>156</b>. However, these approaches cannot provide data collaboration so that data from a desktop can be shared for editing with the other users. They also lack converged voice and data controls enabling voice to control delivery or distribution of data. Additionally, they do not support wireless network and devices operating on those networks and generally require bulky equipment at each endpoint.
P-0061[0061] Referring to FIG. 8, users connected via their local Internet Service Providers (ISPs) (e.g., AOL, MSN, Yahoo, etc.) or via their mobile carriers (e.g., Verizon Wireless, AT&T Wireless, Cingular, etc.) to instant messaging servers <b>170</b> can send and receive messages instantly to each other. For example, a user connected on the Internet can send an instant message from a computer <b>152</b> to a friend's mobile phone <b>153</b> so that a message is displayed on the screen of the friend's mobile phone <b>153</b>. Alternatively, a user of a mobile phone <b>153</b> can send an instant “SMS” text message from his mobile phone <b>153</b> to another user's mobile phone, not shown. Messages (primarily text and images) can be sent from one user to another. This conventional system does not deliver conferencing capability as it simply enables messages of fixed length and size to be shared amongst participants without any voice capability or connectivity to broadband or cable networks.
P-0062[0062] Referring to FIG. 9, combining voice, fax, email and other message media such as SMS and Instant Messaging, into a single mailbox of the prior art allows the mailbox to be accessed by any web device (such as a browser or wireless PDA) or touchtone telephone. Emails or fax messages can also be forwarded, for example, to a nearby fax machine (e.g., at a hotel or at the airport). A user can also prioritize message delivery enabling him to receive messages from the boss or the spouse first, for example, before others in the inbox queue. A message in one media such as voice from a mobile phone <b>184</b> can be forwarded in another media such as email on a computer <b>182</b>. A fax message can be forwarded from a fax machine <b>183</b> as an email on a computer <b>182</b>. Conferencing capability, however, is not provided, nor can simultaneous delivery of voice and data between participants be effected. The system is limited to certain devices and message types.
P-0063[0063] Referring now to FIG. 10, there is shown a schematic block diagram of a converging appliance <b>10</b><i>a </i>of the present invention. It should be noted that reference numbers <b>10</b><i>a</i>, <b>10</b><i>b</i>, etc. are used hereinbelow to refer to portions of appliance <b>10</b> and do not describe devices other than appliance <b>10</b>. Device <b>202</b> such as a phone connected over a network <b>200</b> such as the PSTN is capable of delivering a single media—such as voice <b>204</b>. Another device <b>203</b> such as a wireless personal digital assistant, connected over another network <b>201</b> such as a wireless LAN may be capable of delivering a single media also—such as data <b>205</b>.
P-0064[0064] Without convergence appliance <b>10</b><i>a</i>, device <b>202</b> and device <b>203</b> cannot: (a) operate together as a synchronous unit; (b) simultaneously deliver presentation content and instructions as a single unit; and (c) control delivery of content under instructions of one device <b>202</b> to the other device <b>203</b>, for example. With the current embodiment of the convergence conferencing appliance <b>10</b><i>a</i>, however, as shown in FIG. 10, the two devices <b>202</b> and <b>203</b> can: (a) operate together as a synchronous unit; (b) simultaneously deliver presentation content and instructions as if the two devices <b>202</b> and <b>203</b> were a single unit; and (c) control delivery of content to one device <b>203</b> when instructed by the other device <b>202</b>, for example.
P-0065[0065] Referring again to FIG. 1, the convergence conferencing appliance <b>10</b> has physical ports to connect it to various networks <b>20</b>-<b>70</b>. To connect to the public telephone network <b>20</b> and traditional mobile phone network <b>30</b>, connectivity is provided via different types of voice ports <b>12</b>. To connect to data networks such as traditional IP <b>40</b> and wireless LAN or WAN <b>50</b>, network connection capability is provided through various data ports <b>14</b>. To connect to local Bluetooth devices <b>94</b> or IR enabled devices <b>96</b>, the appliance <b>10</b> includes Bluetooth and IR capabilities with appropriate ports <b>16</b> for network connection. The broadband ports <b>18</b> connect to traditional coax, hybrid fiber coax or proprietary broadband devices.
P-0066[0066]FIG. 1<i>a </i>describes the physical components in the appliance <b>10</b>. The appliance includes a CPU with internal cache <b>2</b>, internal memory <b>3</b>, PCI or cPCI bus <b>4</b>, internal storage <b>5</b>, LED indicators <b>6</b>, video output <b>7</b>, external read/writable storage <b>8</b> such as CD R/W or flash card, H.100 bus and connector <b>9</b>. The H.100 interface enables trunk switching, addition of analog station interfaces, loop start line, subscriber loop, or direct inward dialing or any additional DSP resources that may be warranted. Various protocol interfaces can be used to connect the appliance <b>10</b>.
P-0067[0067] Date devices with TCP/IP data port connectivity are connected through IP line cards <b>14</b>. Devices capable of delivering voice are connected to the appliance <b>10</b> via either a public service telephone network or the wireless network. For both types of connections, the appliance <b>10</b> supports POTS phone connectors <b>12</b><i>a </i>and digital connectors <b>12</b><i>b</i>. For devices connecting to the appliance <b>10</b> via Bluetooth or infrared protocol, the appliance <b>10</b> provides Bluetooth and IR ports <b>16</b>. The appliance can also support native video endpoints or connectivity to the hybrid fiber coax, coax and broadband network and devices through broadband port <b>18</b>.
P-0068[0068] A pool of digital signal processing (DSP) resources <b>11</b> contains a number of individual DSP resources, each individually capable of being programmed to process messages from the line cards and ports. For instance, voice connection through circuit switch POTS port <b>12</b><i>a </i>may warrant an embedded announcement to be played, DTMF tone detection or generation, voice recording, playback or any other call processing capability. On the other hand, for CPU <b>2</b> to process such individual streams of media, the DSPs <b>11</b> can process the streams resulting in lower CPU utilization and higher level of concurrent usage and scalability. The appliance <b>10</b> includes switching fabric <b>278</b> to switch between users' device sessions, a UnifiedXML media interchange <b>279</b>, embedded finite state machine <b>280</b> with conferencing application controls <b>285</b>, and a set of protocol drivers and services <b>286</b>.
P-0069[0069] Referring to FIG. 11, the conferencing appliance <b>10</b><i>b </i>supports both analog and digital voice ports <b>12</b><i>a</i>. The appliance <b>10</b><i>b </i>offers connection capability to connect any standard analog “plain old telephone service” (POTS) trunk <b>13</b><i>a</i>, DSL/xDSL line <b>13</b><i>b</i>, ISDN line <b>13</b><i>c</i>, T1/E1 digital lines <b>13</b><i>d</i>, high capacity T3 line <b>13</b><i>e </i>or other standard interfaces. Each of the ports can be configured to support various trunk signaling protocols to enable the converged conferencing appliance <b>10</b><i>b </i>to be deployed in various countries utilizing different communications protocols. A trunk signaling protocol enables the appliance <b>10</b><i>b </i>to communicate with a specific public telephone and wireless network. For instance, trunk signaling protocol for loop start uses the presence or absence of current flow in the telephone circuit as the signaling information during call set-up and tear down processes. Usually for residential or small to medium sized organizations having between 8 and 16 analog trunks, local loop start signaling is pre-configured within the conferencing appliance <b>10</b><i>b</i>. An entry level appliance <b>10</b><i>b </i>can be pre-configured for an 8 port configuration with 4 physical ports on the conferencing appliance.
P-0070[0070]FIG. 12 depicts a list of signaling protocols supported by the voice ports <b>12</b><i>a </i>(FIG. 11) on the conferencing appliance <b>10</b><i>b</i>. The signaling protocols are Analog loop start, Australian P2 Protocol, European digital channel associated signaling protocols, Feature Group D protocol, ground start protocol, MF-socotel protocol, Multifrequency compelled protocols based on the R2 standard (MFC), NEC PBX protocol, Off-premise station protocol, Pulsed E and M protocols, SS5 (Signaling System #5), SS7, System R1.5 protocol, digital and analog wink start protocols and other protocols under development. It will be recognized that other signaling protocols could be developed and that converging appliance <b>10</b><i>b </i>could be configured to accommodate any new signaling protocol. Consequently, the invention is not considered limited to the known protocols chosen for purposes of disclosure.
P-0071[0071] Referring to FIG. 13, there is shown a schematic block diagram of the voice ports portion <b>12</b><i>b </i>of converging appliance <b>10</b><i>c</i>. Eight POTS phone lines <b>13</b><i>f </i><b>13</b><i>i </i>can be physically connected on the appliance <b>10</b><i>c </i>typically using four RJ12 ports <b>13</b><i>j</i>. Unlike analog trunks, the digital trunks multiplex the signals on many different channels into one physical interface or port. For example, referring now to FIG. 14, the conferencing appliance <b>10</b><i>d </i>can support up to 24 simultaneous telephone channels through the T1 trunk line <b>13</b><i>k </i>interface, enabling one physical port <b>13</b><i>m </i>to be used for 24 concurrent user channels.
P-0072[0072] Referring to FIG. 15, there is shown a schematic block diagram of a data ports, portion <b>14</b><i>a </i>of converging appliance <b>10</b><i>e</i>. Appliance <b>10</b><i>e </i>supports data ports <b>14</b><i>a </i>that enable TCP/IP connectivity <b>15</b><i>a</i>-<b>15</b><i>d </i>through two or more fully independent IEEE 802.3 (i.e., Ethernet) compliant ports <b>15</b><i>e </i>that support traditional 10 megabits per second (Mbps), 100 Mbps Fast Ethernet or 1000 Mbps Gigabit Ethernet protocols over unshielded twisted pair cables. This provides an aggregate 2 to 4 Gbps and higher system level interface. The data ports <b>14</b><i>a </i>support 10Base-T, 100Base-TX and 1000Base-T LAN protocols. The speed and mode of the TCP/IP connection can be selected either automatically via an auto-negotiation procedure or manually. The interface <b>15</b><i>e </i>on the appliance <b>10</b><i>e </i>works in multiple concurrent modes: Individual Stream based and Constant Flow based. Individual Stream based mode allows up to 256 streams of data per port enabling 256 participants <b>15</b><i>a </i>to concurrently join one or more conferences. Constant flow based mode allows up to 32,000 traffic flows enabling thousands of concurrent users. In either case, each TCP/IP port can be assigned many different IP addresses.
P-0073[0073] Referring again to FIG. 1, the converging appliance <b>10</b> provides data ports <b>14</b> for participants to collaborate, access, retrieve and share presentation data by enabling them to connect via traditional computers <b>86</b> through a private LAN/WAN connection <b>50</b> or via the public Internet <b>40</b>. Data ports <b>14</b> also enable participants to engage in voice conferencing using voice over IP (VoIP) devices <b>88</b>. VoIP connections enable participants to use any standard computer <b>86</b> or VoIP device <b>88</b> such as a phone to participate in a conference. Typically, mobile executives may avoid paying high telephone rates from hotel rooms as they can bypass the hotel and telephone companies by connecting through VoIP computers <b>86</b> and devices <b>88</b> through an ordinary modem or a T1 line. Although connecting from a computer, the users actually interact by voice. The program on the computer <b>86</b> or the VoIP device <b>88</b> transforms voice into data (VoIP) when sending it to the conferencing appliance <b>10</b> and retransforms it into voice on the return. A footprint of the VoIP capability is also embedded in the conferencing appliance <b>10</b>.
P-0074[0074] The data ports <b>14</b> provided by the appliance <b>10</b> also allow participants to connect over wireless networks <b>50</b> using wireless devices <b>90</b> such as personal digital assistants and next generation of devices <b>92</b> such as smartphones. These wireless devices <b>90</b>, <b>92</b> can be connected over a wireless LAN <b>50</b> such as IEEE 802.11a, 802.11b or 802.11g networks or a wireless WAN <b>50</b> such as GPRS. Either way, participants can come in from wireless networks and participate in a voice and data conferencing session.
P-0075[0075] Referring to FIG. 16, there is shown a schematic block diagram of a Bluetooth ports <b>16</b><i>a </i>portion of converging appliance <b>10</b><i>f</i>. Bluetooth is a wireless packet radio networking technology designed for a very short range (roughly 30 feet), well known to those of skill in the art. Bluetooth technology was originated by Swedish mobile phone maker Ericsson, and is designed to interconnect up to eight devices located close to one another. By implementing the Bluetooth stack, the conferencing appliance <b>10</b><i>f </i>supports a short range network called Personal Area Network (PAN) or piconet. One or more participants in a conference room can concurrently share and access presentation related files such as agenda or presentation material by wirelessly connecting their wireless personal digital assistants <b>94</b><i>a</i>, mobile phones <b>94</b><i>b</i>, laptop or tablet PCs <b>94</b><i>c</i>, electronic white boards <b>94</b><i>d</i>, printer <b>94</b><i>e </i>or other devices with the Bluetooth enabled conferencing appliance <b>10</b><i>f</i>. PSM security is built into the appliance <b>10</b><i>f </i>enabling multiple participants to share personal calendars, data and files. Protocols such as L2CAP, RFCOMM, BNEP and others are supported by the Bluetooth stack in the appliance <b>10</b><i>f. </i>
P-0076[0076] Referring again to FIG. 1, a variation of the conferencing appliance <b>10</b> also provides broadband connectivity in two ways. First, directly through physical broadband ports <b>18</b> supporting cable, HFC and fixed wireless networks on the backplanes, and secondly, through the data ports <b>14</b>. Either way, third party broadband devices <b>98</b> with various endpoints and residential gateways <b>99</b> can be directly connected to the conferencing appliance <b>10</b>.
P-0077[0077] Procedures to Connect Devices:
P-0078[0078] Still referring to FIG. 1, each of the devices <b>80</b>-<b>99</b> is capable of delivering voice, data or voice over IP at any one time. The procedure to connect from all the voice devices is same irrespective of whether the network is wireless <b>60</b> or PSTN <b>20</b>. FIG. 17 is a chart showing a voice conferencing initiation sequence. Similarly the procedure to connect from all data devices is consistent and is independent of the network, as shown in FIG. 18. Finally each VoIP device <b>88</b> may be connected in one or two ways depending upon its capability as shown in FIG. 19.
P-0079[0079] The appliance <b>10</b> provides not only the network connections, but also the embedded application logic to process the incoming device connections. It consolidates multiple connections from each user within the-auspices of a single user session.
P-0080[0080] A Multi-Device Multi-Channel Session Initiation
P-0081[0081] Scheduling a Converged Conference:
P-0082[0082] Prior to describing the initiation of a multi-device conferencing session, it is more appropriate to describe how such a conference is created. FIG. 22 illustrates one such mechanism. A moderator or a conference host, not shown, logs securely into the appliance with a web browser. Upon logging in, the host clicks the “Manage conference” hyperlink or icon, leading the conference host to a “Manage Conference,” reference numeral <b>210</b>. The host also has options to delete <b>211</b> a conference, modify <b>212</b> a conference or schedule a new conference <b>213</b>.
P-0083[0083] The host clicks the “Schedule” button or a hyperlink <b>213</b> to go to the schedule conference <b>215</b>, shown in FIG. 23. On the Schedule Conference page <b>215</b>, the host can schedule a new conference by selecting a number of participants by clicking the “Participants” icon or hyperlink <b>216</b>, schedule a time when the conference starts <b>217</b>, define the Mode as Voice, Data, Video or All <b>218</b>, Upload files for sharing <b>219</b>, Enable notifications <b>220</b> to be sent to all participants assuming that they have enabled the notification flag, and send a personal email <b>221</b> informing participants of the scheduled conference. A status window <b>222</b> updates the status of the scheduled conference. If the conference is scheduled for Mode=Voice and Data then the conference allows all participants to connect via their phones as well as log in through a data window to share and collaborate data and files.
P-0084[0084] Upon completing all the attributes for scheduling a conference, the host submits the schedule to the appliance <b>10</b>. The appliance <b>10</b> validates the data, checks for any schedule conflict and eventually returns with a “Conference Schedule Complete,” page <b>225</b> as shown in FIG. 24. This page <b>225</b> shows the machine generated “Conference Code” <b>230</b> and an “Organizer's Code” <b>232</b>. These codes are unique for the conference. Each participant eventually connects from multiple devices via voice and data using the same Conference Code, making the connection process simple for all users. The record of the conference is stored in a database on the appliance <b>10</b> (FIG. 1). The conference record is accessed in real time when a user connects to the appliance <b>10</b> from any device <b>80</b>-<b>99</b>.
P-0085[0085] Sending Conference Notifications:
P-0086[0086] After a conference has been scheduled, each participant is notified about the conference through a preferred notification method of their choice. Referring to FIG. 25, after the conference has been scheduled, step <b>240</b>, the “send notification” process is invoked that sends voice or data notifications and alerts, step <b>241</b>. For each conference that is just scheduled, all of the participants are grouped, based upon their preferred methods of notification, step <b>242</b>. If the user has disabled one's notification, step <b>244</b>, that user is ignored and control moves on to the next notification mode. For participants who have enabled their primary notification, step <b>243</b>, the notification process checks the user's choice. It can be phone <b>245</b>, email <b>246</b>, SMS/MMS <b>247</b>, pager <b>248</b>, fax <b>249</b> or push <b>250</b>. Each of the messages warrants custom message composition, step <b>251</b>. For example, although an email message can be of unlimited length, an SMS message is 80 to 128 characters depending upon the carrier. Once a message is composed, the user is informed through his phone, step <b>252</b>, email, step <b>253</b>, SMS/MMS, step <b>254</b>, pager, step <b>255</b>, fax, step <b>256</b> or push mechanism, step <b>257</b>.
P-0087[0087] Session Initiation from Devices:
P-0088[0088] A user may initiate a multi-channel, multi-device session with either a voice device or a data device. It is possible that a participant may join the conference through data, immediately before the voice conference is to start. Alternatively, a participant may join the conference through a phone followed by the data side later. The following describes a process of connecting from a phone <b>80</b>, <b>82</b> or <b>84</b>, a wireless personal digital assistant <b>90</b>, <b>92</b>, <b>94</b> or <b>96</b>, and a Voice over IP device <b>88</b>. Typically a user may connect from any voice device, and any data device one after the other. A VoIP session may be connected as opposed to a phone for the voice session.
P-0089[0089] Step <b>1</b>: Initiating a Voice Conferencing Session Independent of the Data Session:
P-0090[0090] The procedure to connect from a voice device (phone, mobile phone) to invoke a conferencing session is illustrated in FIG. 17. A participant initiates the conference call from his mobile or PSTN phone by dialing the telephone number of the conferencing appliance, step <b>400</b>. The phone number terminates at one of the voice ports of the Conferencing appliance, step <b>402</b>. The request is received by the media controller, step <b>404</b>. The media controller in the appliance initiates a voice session and delivers the command and requests the application logic for further instructions, step <b>406</b>. The service logic tells the media controller to seek application specific authentication—the conference code, which was generated during scheduling a new conference. The media controller, cognizant of the device's signature and media, requests the participant to authenticate, step <b>408</b> and enter the conference number, step <b>410</b>. The user enters the four digit conference code, step <b>412</b>, using the keypad on the phone, sent to the port, step <b>414</b>, the DTMF signal being detected by the port, step <b>416</b> and sent to the media controller for the service logic to process, step <b>416</b>. The service logic validates the conference code, step <b>418</b>, by querying the database, step <b>420</b>. Upon validation it instantiates the conference and allows the user to participate in the conference, step <b>422</b>, and confirms the command, step <b>424</b>. If the service logic concludes that the conference is a multi-channel voice and data conference then the media controller instructs the user to enter, for example, the first four digits of his last name, step <b>426</b>. Should there be a conflict in the last name, the user may have to enter his first name as well. If the conference was voice and data enabled, the converger is notified that the conference warrants a multi-media concurrent voice and data session. The converger remains on standby until the user connects from a data device. A similar process is executed by the user to authenticate the login ID (name) which, upon validation results in instantiation of the multi-media conferencing session, step <b>428</b>-<b>436</b>. The user is then invited to participate in the conference call, steps <b>438</b>-<b>442</b>.
P-0091[0091] Step <b>2</b>: Initiating a Data Conferencing Session Independent of the Voice Session:
P-0092[0092] The procedure to connect from a data device (wireless PDA, web browser, PC, etc.) to invoke a conferencing session is illustrated in FIG. 18. A participant initiates the data conferencing by entering a URL on the browser on a personal computer or on a wireless device, step <b>450</b>. The URL translates into an IP address of the port of the conference appliance, step <b>454</b>. The appliance takes the request as an HTTP request and instantiates the application logic to process the transaction, step <b>456</b>. The server sends a page for user authentication. The user enters the conference code that was generated during conference scheduling by the host and the username through one or more pages, step <b>462</b>. If the parameters are correct, the server logic instantiates a collaborative session for the user. The context of the session is stored in the database. The database records are updated in a ConfInProgress table which is part of the conferencing database schema. If the user had already logged in through the phone, his record is updated to reflect the timestamp of the login from a data window. If the user logs in for the first time, a new record is created in the ConfInProgress table. If the conference that this user is about to participate in was scheduled as a voice and data collaborative conference, then the conference manager informs the converger to stay awake for another session from the user. Should the user already be connected from the voice and data devices, the converger manages user context and user session of the conference in a multimedia format.
P-0093[0093] Step <b>3</b>: Initiating a Voice Over IP Session Independent of the Other Sessions:
P-0094[0094] A participant armed with a VoIP enabled computer or a wireless personal digital assistant can invoke a VoIP session with the convergence conferencing appliance and participate in a conference with other participants who may be using PSTN phones, mobile phones, VoIP phones or similar VoIP enabled computers and devices. To invoke a VoIP session with the appliance, as illustrated in FIG. 19, a user opens up an application on his device and enters the IP address or phone number of the server, step <b>480</b>. The client software connects with the IP address of the appliance on one of the data ports, step <b>482</b>. The port sends the request to a VoIP server application running as a service on the appliance, step <b>484</b>. The request is delivered to the media controller that requests an instance of the user session by interacting with the service logic, step <b>486</b>. The service logic grants the connection and forwards an authenticate request initiating a request from the user to authenticate himself along with the conference in which the user desires to participate, step <b>488</b>. The user enters the username and conference code data, step <b>490</b>, and submits the request, step <b>492</b>. The response is submitted as a client/server request, step <b>494</b>. The media controller translates media requests to logical data requests for the service logic, steps <b>496</b>,<b>498</b>. The service logic queries the database and retrieves the results of the parameters in order to qualify the authentication request, step <b>500</b>. If the user is invalid, the user may reenter some of the information. Upon successful validation, step <b>502</b>, a user's session is deemed verified, step <b>504</b>. In a similar way, the user's login in authenticated, step <b>506</b>-<b>514</b>. A Voice over IP channel is opened and interaction with the user is purely voice. If the active conference also supports data, the convergence manager advises the converger to stay awake for another potential session from the participant, steps <b>516</b>-<b>520</b>.
P-0095[0095] Step <b>4</b>: Multiple Sessions and Devices:
P-0096[0096] Through a method of registration that can be performed any time prior to the connection process, each user can pre-register his device(s) as follows. All participants scheduled for a conference must be registered users. There are two mechanisms by which a user can be registered: (a) the conference administrator is responsible for creating a user registration, and (b) a user may self register himself, assuming that the administrator has enabled this option. Also, ad hoc participants and guests can participate in a conference through guest logins.
P-0097[0097] Referring to FIG. 26, each participant creates his own personal profile from the user registration screen <b>260</b> and enters information such as name/password <b>261</b>, phone <b>262</b>, email address <b>263</b>, personal digital assistant information <b>264</b>, primary notification method <b>264</b>, account information <b>266</b> and other similar personal information. Once registered, the participant is available to be scheduled in a conference by others, assuming they have access privileges to schedule this participant. The process of user registration is provisioned from a web browser and the database is stored in the appliance <b>10</b>. This pre-registration process “informs” the appliance <b>10</b> of the various devices that a user can use. During this registration process, the appliance <b>10</b> collects and stores information such as phone number and service provider of the user's mobile phone while other dynamic device addresses are retrieved from the device when the device connects to the appliance. The latter is generally true with endpoint or IP addresses when a computer or a wireless handheld device is connected to an IP network, a wireless local area network or a mobile IP network uses Dynamic Host Control Protocol, 802.11x or Mobile IP protocols, respectively. By knowing the endpoint or IP address or, for instance, the phone number, the appliance <b>10</b> can appropriately distribute data or voice content to each particular device or channel. By knowing the device type, the content is reformatted in a particular media and delivered in a single media, (i.e. voice, data or video).
P-0098[0098] Content can also be delivered on multiple channels and devices being used by a user simultaneously. This enables the appliance to allow each participant, for instance using a mobile phone, to participate in a conference and enables a user not only to talk but also to use special commands available on the touch-tone pad of a phone to initiate email delivery to his computer or issue whisper commands to request data or communicate with a subset of the participants. A participant using a mobile phone can invoke these commands from the phone's keypad. However, a participant's ability to invoke such commands is controlled by the status and context of the conference and the user's privileges. The appliance therefore delivers the controls for only appropriate commands to a user through a touch-tone keypad not only based upon a user's authorization profile, but also based upon the context of the conference.
P-0099[0099] To achieve real time device awareness, the appliance <b>10</b> keeps track of all the devices from which each participant has previously connected. The appliance <b>10</b> constantly updates its awareness of each user's device connection through polling or presence or the like. This enables the appliance <b>10</b> to be sensitive to scenarios in which where a device such as a wireless personal digital assistant looses connectivity when a mobile user leaves the wireless coverage area.
P-0100[0100]FIG. 20 illustrates a converged voice and data session in which a user connects first through the phone followed by the browser. The voice session is established followed by the data session, the detailed steps of which have been provided with reference to FIGS. <b>17</b>-<b>19</b> hereinabove. FIG. 21 illustrates a block diagram of the components of the conference convergence engine <b>274</b> and its operation. The engine <b>274</b> interacts with the conference manager and appliance ports <b>276</b> to deliver converged content. The converger supports three media streams and media types: Voice, Data and Video <b>277</b>. Switching fabric <b>278</b> is responsible for switching between voice, data and video streams. It is a combination of hardware and software and allows for the switching paths amongst these ports to be controlled. The switching fabric <b>278</b> is a high-speed, non-blocking and switched serial packet network that allows for asynchronous operation. Although internal to the converger, it interacts with CompactPCI Packet Switching Backplane (cPSB) standard that is developed by the PCI Industrial Computer Manufacturer Group and few emerging standards such as one developed by Intel. The standard architecture considers each cPCI board as a standalone processing node or blade that communicates via Ethernet with other boards at speeds of 1 GB and higher. Multiple Voice and Data ports can therefore be “invoked” with converger switching fabric <b>278</b>.
P-0101[0101] The converger switching fabric <b>278</b> interacting with finite state machine <b>280</b> determines the port on a specific card for data exchange (both inbound and outbound). A typical chassis configuration, not shown, can support <b>16</b> such voice and data cards that can be operated by the converger switching fabric <b>278</b>. Each chassis can also be extended over the TCP/IP packet network to other chassis via TCP/IP cable to create an “extended” backplane.
P-0102[0102] The media interchange <b>279</b> is an interchange of different media streams that the switching fabric <b>278</b> interacts with. A voice stream in XML (e.g., VoiceXML) may have to be transformed into a data stream (e.g., WML or HTML). The interchange is responsible for converting or repurposing the content in real time and delivering it to the switching fabric <b>278</b> for transmission through an appropriate port. The interchange converts the voiceXML into WML or HTML. The conversion can be completely dynamic or may be pre-defined by the conferencing application. The media interchange interacts with the intelligence of the conferencing application by interacting with the finite state machine <b>280</b>.
P-0103[0103] The finite state machine <b>280</b> stores the various states of the conferencing application and is instantiated for all participants. It includes a state manager <b>281</b>, a context manager <b>282</b> and a session manager <b>283</b>. Each attendee in a conference is instantiated a state, context and session. Interactivity with an attendee is a function of the state, context and session manager components. The state manager <b>281</b> manages the state of the current conference. A state, for example, could be “login” when the user logs in, a “telephony interface” (TI) command when the user issues a computer telephony command, etc.
P-0104[0104] The context manager <b>282</b> manages the context of the user session. For example, a user may simply issue a “mute” command from the browser resulting in a predefined set of attendees to be muted. The muting of the pre-defined set of attendees was made possible due to the context inherited into the new state. The muting of the set of attendees was a consequence of the pre-defined session context.
P-0105[0105] The finite state machine <b>280</b> interacts with the application controls <b>285</b> and accesses XML and other resources <b>284</b> for delivery to the media interchange. A request from one device over one media (e.g., voice) may result in results over another media (e.g., data) over another device.
P-0106[0106] Referring to FIG. 27, a user viewing the conferencing dashboard from a browser is viewing an HTML file that results in the flow of inbound data stream <b>299</b> over the data port <b>301</b>. The content being delivered on the browser is a static or a dynamic HTML file <b>302</b>. An HTML file by definition does not have any voice tags or provision to invoke voice application and therefore cannot offer concurrent voice interactivity. The converger <b>304</b> therefore relies on the actions embedded within each HTML file to interpret the next action. Each action corresponds to initiation of either a voice or data session over the appropriate channel. In order to determine the next action, the converger <b>304</b> retrieves the context <b>305</b>, session <b>306</b>, and state <b>305</b> of the transaction. After loading these variables, the converger <b>304</b> requests the application controls <b>309</b> over line <b>308</b>. If it is determined that the next action is a voice session, then the converger <b>304</b> retrieves the resource manager repository <b>310</b> over line <b>311</b> to retrieve the appropriate static voiceXML file <b>312</b> that would be delivered over the new channel <b>319</b>. In some cases the static file <b>312</b> is embedded with dynamic variables before delivery.
P-0107[0107] The next step is for the converger <b>304</b> to reformat and repurpose the content through the media interchange <b>313</b>. Once the content is repurposed or reformatted, the switching fabric <b>314</b> switches the session from data to voice and submits the voiceXML <b>316</b> file via line <b>315</b> over the voice port <b>317</b> to the appropriate device <b>319</b>. The aforementioned process illustrates the mechanism to invoke a parallel voice session to an existing data session. The reverse holds true as well, when an ongoing voice session invokes a parallel data session. By delivering voice and data files or dynamic content over multiple devices, a user simultaneously interacts with both voice and data.
P-0108[0108] The conferencing appliance <b>10</b> (FIG. 1) takes the two inbound streams of data, which were started independently, to convergence. The content from one stream is “mixed” with the content from another stream, thereby in effect joining (i.e., converging) the two streams of data.
P-0109[0109] To deliver a satisfying user experience in viewing and accessing data, any content delivered on a user's data device must not take copious amounts of/time to download or render. This is especially true with handheld devices that are connected via wireless connectivity. The appliance therefore delivers any shared content on a user's wireless device based upon device characteristics, the bandwidth and the network the device is on, and media stream. Generally available applications such as Microsoft Word, Microsoft PowerPoint presentation, Microsoft Excel are repurposed and reformatted before delivering to a handheld device. Each file is converted into an HTML file by using vendor provided DLLs and APIs (e.g., Microsoft DLLs and Microsoft APIs in this case), to convert a standard Microsoft document to an HTML format. Similarly, a standard PowerPoint file is converted into a number of HTML files using a commonly available scripting language such as PERL, VB Script and others. Once an HTML file is available, a DOM and SAX parser (another set of commonly available tools well known to those skilled in the art) are used to convert the HTML files into XML objects.
P-0110[0110] Each XML object is capable of being repurposed and reformatted to meet the needs of any type of device. For example, for a 4 line by 40 character device connected over a 9.6 Kbps network, a colored background with fancy graphics and animation may not be reasonable, especially given the low bandwidth of network connection. In this specific case, a set of objects with back-and-white images is reformatted for an optimal viewing experience. Similarly, every file being uploaded for conferencing is probably compressed, resized, reformatted and generally optimized. In some cases, the file may not be optimized during the time it is being uploaded, but rather is repurposed during runtime. The objective is to allow participants to view their PowerPoint presentations, Word documents, Excel spreadsheets and other files to be seen from handheld devices while they are mobile. As new devices emerge and network bandwidth improves, the mechanisms for optimization may evolve and improve as well.
P-0111[0111] Referring now to FIG. 28, there is shown a block diagram of a high level overview of the conferencing dashboard <b>325</b>. A conferencing data dashboard enables conference participants to operate, administer, manage and interact with the conference. Participants can view the status <b>326</b> of the conference. Status <b>326</b> includes the start time, end time, lapsed time, time zone and other variables. Participants can also view from a graphical interface the status of all the participants. Those joined and active, for example, may be marked with green icons and those who are not active may be marked as red. A conference host controls a series of programming controls for each participant. For instance, a host can “mute” a specific user or “disconnect” him from the conference. The mute option initiated from the data side on the dashboard makes the voice channel mute. Participants can click the data collaboration icon <b>328</b> or hyperlink to view all the files being shared and presented. Each user within the conference has the right to upload and delete his own files. Files can be shared or collaborated with in real time.
P-0112[0112] Security on file sharing such as view only, downloadable, and password protection, is controlled by each participant. The video conferencing icon or hyperlink <b>329</b> enables the participants to view a real time picture of each participant assuming they have a mounted camera at each location. No special hardware is required as the image is transmitted over the IP network. The voice conferencing icon or hyperlink <b>330</b> gives the status of the voice conferencing session. This allows calls to be forwarded to another phone, enables new attendees to be included, provides callbacks and other telephony functions. The SMS, MMS and Chat link <b>331</b> enables participants to send instant messages or instant SMS and MMS messages over computers and mobile phones instantly. Messages could be sent as private messages to a subset or all of the conference participants. The special function icon or hyperlink <b>332</b> enables special voice and data sessions to be invoked. For instance, participants can request all shared files to be sent as emails or the email and contact information of each participant can be delivered to one user's email box. A status window <b>333</b> gives the status of the ongoing conference.
P-0113[0113] A conceptual dashboard enabling telephony functions is also available to those using a phone. Using special touchtone commands, participants can forward calls, join more parties to the call, deliver agenda and presentation to their email address invoke voice commands, whisper commands and do a number of other functions, as illustrated in FIG. 28. Some of these result in invoking data commands such as receiving email and contact information of all participants via email.
P-0114[0114]FIG. 30 shows a converged conference scenario illustrating a 14 step process in which participants use both voice to confer with each other and data to collaborate within the same session. They may be using their mobile phones, PSTN phones or VoIP phones for voice and they may be using their laptop, desktop PC, Blackberry, Palm V or HP Jornada type devices to share and collaborate with data. The sample session hereinbelow described illustrates four users participating in the session, one of whom is the conference host or presenter. Each of them is connected with different devices but each participates in a converged conference session. Any number of users can participate within the scope of the invention.
P-0115[0115] The conference host (Cathy) initiates the conference from her office from the PC and by dialing on the phone number of the MCB switch. Attendee number 1 (Amy) participates in the conference via her mobile phone and her HP Jornada handheld wireless device. Attendee number 2 (Bob) participates in the conference via his Compaq ipaq or PC through VoIP because he is located internationally or is in a hotel where toll charges are at a premium. As a result he wants to use VoIP to connect for voice. Additionally, he does not want to sacrifice his data-session. He also wants data from the same device (be it ipaq handheld or PC laptop) as he goes through the conference. Attendee number 3 (David) participates from his mobile phone and BlackBerry handheld device.
P-0116[0116] Cathy, the conference host, sets up the conference by either calling via her phone or connecting to the URL of the switch via her IP connected PC or wirelessly connected handheld device. When she calls, she is greeted by an automated conference setup routine that asks her for the various conference parameters such as duration of the conference, participants, email, if available, their contact information, if available, etc.
P-0117[0117] The conference setup parameters and configuration are stored in a persistent repository. If Microsoft Exchange module is enabled and the list of attendees is referenceable from Exchange, then the switch retrieves the email and contact information of the attendees.
P-0118[0118] Amy gets a callback on her phone, as that is her preferred method of callback whenever she is scheduled into a conference. She saves the conference time and schedule. Bob is perhaps traveling internationally and has defined his policy that he should be notified about the conference via an email and an SMS message, if the conference is to be held within four hours, because he is often on the road and he wants to be notified immediately. An SMS message is sent to Bob regarding the conference. David prefers not to be notified by either phone callback or SMS but prefers email. He is often on the road and does not want to get interrupted with SMS messages or phone calls as he prefers to take customer calls during the day. He checks his email on his Blackberry device at his discretion. An email is sent to David that he can see when he wants to.
P-0119[0119] On the day and time of the conference, Cathy, the conference host, logs into the conference through her PC and her PSTN phone. David, who is mostly on the road, receives gets a message on his Blackberry device that the conference has started. He acknowledges that he desires to join the conference and he is immediately connected. He sees the first page of the presentation with the Agenda. He can ask for a phone callback on his mobile phone or, in this case, he prefers to dial the MCB himself. He enters his meeting number and password and he is authenticated. After authentication, he is logged in and can talk with and listen to Cathy.
P-0120[0120] As Amy prefers a phone call, she receives a callback from the MCB switch. She authenticates via touchtone keypad and is authorized access. She can talk with and listen to both Cathy and David, the other two attendees who have already connected. She enters, on her Jornada's browser, a specific URL (by clicking a link in her email) and is greeted with the MCB security screen. After proper authentication, she is able to see the first page of the Agenda. Bob, the attendee who is participating from overseas to save toll charges, uses VoIP over his PC. When traveling, he prefers to use his iPaq through VoIP. The MCB switch establishes a VoIP session with the ipaq over wireless network or a VoIP with the PC. Bob can “talk”-through his PC and view the first slide of the presentation.
P-0121[0121] After all the attendees have been connected, Cathy, the conference host, talks from her phone and gives the presentation from her browser. Each user, whether on his wireless handheld device or on his phone, is able to view the data and speak in the conference. Because David is generally on the road, Amy wants to make sure that he has downloaded the specific work document that will also be discussed. She sends an instant message to David.
P-0122[0122] Each user can also use some “whisper” commands and download additional information. For example, David can issue a whisper command to download a word document because he did not download the copy earlier. This download process is transparent to other conference attendees. In initiating the conference, Cathy also broadcasts a copy of a new price sheet to all the attendees. Each user can download it by clicking an icon that appears on his screen.
P-0123[0123] Since other modifications such as in optical configurations can be made to fit particular operating specifications and requirements, it will be apparent to those skilled in the art that the invention is not considered limited to the examples chosen for purposes of disclosure, and covers all changes and modifications which do not constitute departures from the true spirit and scope of this invention.
P-0124[0124] Having thus described the invention, what is desired to be protected by Letters Patent is presented in the subsequently appended claims.
Contents5
32 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2010299724A1 | Cited by | United States of America | Pre-grant |
| EP2933982B1 | Cited by | European Patent Office (EPO) | Examiner |
| US7894806B2 | Cited by | United States of America | Applicant |
| US2007220113A1 | Cited by | United States of America | Pre-grant |
| US2009265641A1 | Cited by | United States of America | Pre-grant |
| US2004064355A1 | Cited by | United States of America | Pre-grant |
| US2007286366A1 | Cited by | United States of America | Pre-grant |
| US7974661B1 | Cited by | United States of America | Applicant |
| US9131016B2 | Cited by | United States of America | Search report |
| US7920547B2 | Cited by | United States of America | Applicant |
| US2007111743A1 | Cited by | United States of America | Pre-grant |
| US2009102645A1 | Cited by | United States of America | Pre-grant |
| US7343313B2 | Cited by | United States of America | Search report |
| US2009201835A1 | Cited by | United States of America | Pre-grant |
| US2008208812A1 | Cited by | United States of America | Pre-grant |
| US2008065999A1 | Cited by | United States of America | Pre-grant |
| US2006235932A1 | Cited by | United States of America | Pre-grant |
| US2010287242A1 | Cited by | United States of America | Pre-grant |
| US2004189476A1 | Cited by | United States of America | Pre-grant |
| US8064890B1 | Cited by | United States of America | Applicant |
| US2007276910A1 | Cited by | United States of America | Pre-grant |
| US8386560B2 | Cited by | United States of America | Search report |
| US2005144233A1 | Cited by | United States of America | Pre-grant |
| US2015281461A1 | Cited by | United States of America | Pre-grant |
| CN113872778A | Cited by | China | Search report |
| US8819129B1 | Cited by | United States of America | Search report |
| US6934397B2 | Cited by | United States of America | Search report |
| US9270713B2 | Cited by | United States of America | Search report |
| US2011122449A1 | Cited by | United States of America | Pre-grant |
| WO2006021846A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US8560641B2 | Cited by | United States of America | Applicant |
| US9218604B2 | Cited by | United States of America | Search report |
| US10440155B2 | Cited by | United States of America | Search report |
| US2005277409A1 | Cited by | United States of America | Pre-grant |
| US11496330B2 | Cited by | United States of America | Search report |
| US2008066001A1 | Cited by | United States of America | Pre-grant |
| US2008005245A1 | Cited by | United States of America | Pre-grant |
| US2013223606A1 | Cited by | United States of America | Pre-grant |
| US2005047400A1 | Cited by | United States of America | Pre-grant |
| US8121112B2 | Cited by | United States of America | Search report |
| US2004057585A1 | Cited by | United States of America | Pre-grant |
| US2009157469A1 | Cited by | United States of America | Pre-grant |
| US2007127670A1 | Cited by | United States of America | Pre-grant |
| US2010141398A1 | Cited by | United States of America | Pre-grant |
| US2007282793A1 | Cited by | United States of America | Pre-grant |
| US9037651B2 | Cited by | United States of America | Search report |
| US8537704B2 | Cited by | United States of America | Search report |
| US8559319B2 | Cited by | United States of America | Applicant |
| US2015333922A1 | Cited by | United States of America | Pre-grant |
| US2006195354A1 | Cited by | United States of America | Pre-grant |
| US10778456B1 | Cited by | United States of America | Search report |
| US2008005240A1 | Cited by | United States of America | Pre-grant |
| US2009168759A1 | Cited by | United States of America | Pre-grant |
| US2008080692A1 | Cited by | United States of America | Pre-grant |
| US2011134206A1 | Cited by | United States of America | Pre-grant |
| US2023133618A1 | Cited by | United States of America | Search report |
| US10187433B2 | Cited by | United States of America | Applicant |
| US10630617B2 | Cited by | United States of America | Applicant |
| US2020019992A1 | Cited by | United States of America | Search report |
| US2013013708A1 | Cited by | United States of America | Pre-grant |
| EP1841149A3 | Cited by | European Patent Office (EPO) | Search report |
| US11627008B1 | Cited by | United States of America | Search report |
| US2007123239A1 | Cited by | United States of America | Pre-grant |
| US2007236334A1 | Cited by | United States of America | Pre-grant |
| US2008186926A1 | Cited by | United States of America | Pre-grant |
| US7778675B1 | Cited by | United States of America | Applicant |
| US2003046296A1 | Cited by | United States of America | Pre-grant |
| US2006085417A1 | Cited by | United States of America | Pre-grant |
| US7822428B1 | Cited by | United States of America | Search report |
| US2022376939A1 | Cited by | United States of America | Search report |
| US2010110161A1 | Cited by | United States of America | Pre-grant |
| US2009067349A1 | Cited by | United States of America | Pre-grant |
| US8045974B2 | Cited by | United States of America | Search report |
| US2005157704A1 | Cited by | United States of America | Pre-grant |
| US2010332598A1 | Cited by | United States of America | Pre-grant |
| US8250141B2 | Cited by | United States of America | Search report |
| US2013137418A1 | Cited by | United States of America | Pre-grant |
| US9495712B2 | Cited by | United States of America | Applicant |
| US2006067250A1 | Cited by | United States of America | Pre-grant |
| US2011205056A9 | Cited by | United States of America | Pre-grant |
| US10511654B2 | Cited by | United States of America | Applicant |
| US7035865B2 | Cited by | United States of America | Search report |
| US2003208529A1 | Cited by | United States of America | Pre-grant |
| US9232067B2 | Cited by | United States of America | Applicant |
| US8559610B2 | Cited by | United States of America | Search report |
| US8250147B2 | Cited by | United States of America | Search report |
| US7996463B2 | Cited by | United States of America | Applicant |
| US9218603B2 | Cited by | United States of America | Search report |
| US9021041B2 | Cited by | United States of America | Search report |
| US2007198637A1 | Cited by | United States of America | Pre-grant |
| US7688211B2 | Cited by | United States of America | Applicant |
| US2007121165A1 | Cited by | United States of America | Pre-grant |
| US8775511B2 | Cited by | United States of America | Search report |
| US8099512B2 | Cited by | United States of America | Applicant |
| US7675537B2 | Cited by | United States of America | Search report |
| US8843552B2 | Cited by | United States of America | Search report |
| US2011038289A1 | Cited by | United States of America | Pre-grant |
| WO2007059009A3 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9742924B2 | Cited by | United States of America | Search report |
| US2017201391A1 | Cited by | United States of America | Search report |
2 members in 1 office; this record represents the family
Priority claims1
| Document | Office | Kind | Date |
|---|---|---|---|
| 37555802 | United States of America | P |
Members2
| Document | Office | Kind | |
|---|---|---|---|
| US2004034723A1 | United States of America | A1 | |
| US7751347B2 | United States of America | B2 |
62 transactions on the USPTO file
Allowed after 3 non-final rejections.
- Non-final rejections
- 3
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Correspondence Address ChangeC.AD | C.AD | |
| Expire PatentEXP. | EXP. | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Mail-Record Petition Decision of Granted to Accept Delayed Payment of Issue FeeMP005 | MP005 | |
| Record Petition Decision of Granted to Accept Delayed Payment of Issue FeeP005 | P005 | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Petition EnteredPET. | PET. | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Abandonment for Failure to Pay Issue FeeAbandonedMABN6 | MABN6 | |
| Abandonment for Failure to Pay Issue FeeAbandonedABN6 | ABN6 | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Mail Notice of Rescinded AbandonmentAbandonedMNRAB | MNRAB | |
| Notice of Rescinded Abandonment in TCsAbandonedNRAB | NRAB | |
| Mail-Petition to Revive Application - GrantedMPREV | MPREV | |
| Petition to Revive Application - GrantedPREV | PREV | |
| Petition EnteredPET. | PET. | |
| Mail Abandonment for Failure to Respond to Office ActionAbandonedMABN2 | MABN2 | |
| Aband. for Failure to Respond to O. A.AbandonedABN2 | ABN2 | |
| Affidavit(s) (Rule 131 or 132) or Exhibit(s) ReceivedAF/D | AF/D | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Correspondence Address ChangeC.ADB | C.ADB | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Correspondence Address ChangeC.ADB | C.ADB | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Transfer Inquiry to GAUTI1050 | TI1050 | |
| Application Is Now CompleteCOMP | COMP | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| Applicant has submitted new drawings to correct Corrected Papers problemsCORRDRW | CORRDRW | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| Small Entity Statement (37 CFR 1.27)SES | SES | |
| Applicant has submitted new drawings to correct Corrected Papers problemsCORRDRW | CORRDRW | |
| Applicant has submitted a new specification to correct Corrected Papers problemsCORRSPEC | CORRSPEC | |
| Corrected PaperCPAP | CPAP | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Initial Exam Team nnIEXX | IEXX |
7 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Lapse for failure to pay maintenance feesLapsedLAPS | LAPS | |
| Maintenance fee reminder mailedREMI | REMI | |
| AssignmentAS | AS | |
| AssignmentAS | AS |
Numbers
- Application
- 42361503
Titles
- English
- Converged conferencing appliance and methods for concurrent voice and data conferencing sessions over networks
Patent term adjustment
- A delay
- +1,140 daysthe office missed an examination deadline
- B delay
- +1,533 dayspendency past three years
- Overlap
- −471 daysdelays counted once
- Applicant delay
- −500 days
- Net adjustment
- 1,702 days
Classification
- CPC, 3
- H04L12/1822
- H04L12/66
- H04L51/36
- IPC, 2
- G06F3 00
- H04L12 66