Apparatus and method for incorporating virtual video conferencing environments

BACKGROUND OF THE INVENTION

[0001] 1. Field of Invention

[0002] The present invention provides an apparatus and method for conducting virtual meetings in which the environment for the virtual meeting may be chosen and specified by at least one of the participants in the virtual meeting.

[0003] 2. Description of Related Art

[0004] Video conference systems are generally known in the art which provide point to point video conferencing capability between parties in different locations. These systems include, for example, H.320 protocol based systems such as Intel's ProShare™. These systems use the H.320 protocol to deliver audio, video and data from one conferencing endpoint to another.

[0005] When more than two parties are going to participate in a conference call they commonly use a bridge known as a multipoint control unit (MCU). A known MCU based system is disclosed in U.S. Pat. No. 5,684,527 issued to Terui et al., which is hereby incorporated by reference. The MCU allows multiple parties to communicate over these systems and use various mechanisms, such as voice activation and motion detection, to determine which endpoint's picture to put on the screen at any moment in time.

[0006] These systems are limited to the use of video that is picked up by a camera device connected to the endpoint device. Thus, the user of the endpoint device has limited control over the environment in which his/her image is shown to the other participants in the video conference. Thus, there is a need for new technology that would allow the user to have increased control over the images which are transmitted to the other participants in a video conference.

SUMMARY OF THE INVENTION

[0007] In view of the above, the present invention provides an apparatus and method for conducting a video conference. The apparatus includes a video conference apparatus connected to at least one network. The video conference apparatus includes a MCU, an environment processor, a user database interface and an environment database interface. When users log onto the video conference apparatus, it is determined whether each user has designated an alternative environment for use during the video conference. If the user has designated an alternative environment, the environment processor obtains the environment from the environment database and the video conference apparatus uses the designated environment during the video conference.

[0008] However, if the user has not designated an alternative environment, the environment processor sends a request message providing a listing of possible environments which may be used during the video conference. Thus, the user may select a desired environment from the listing and use it during the video conference. If the user does not wish to select an alternative environment, a default environment corresponding to the environment normally detected through the camera device is used during the video conference.

[0009] These and other features and advantages of the present invention will be described in or are readily apparent from the following detailed description of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The embodiments of the present invention will be described with reference to the following figures, wherein like numerals represent like elements, and wherein:

[0011]FIG. 1 shows a video conferencing network according to the present invention;

[0012]FIG. 2 is an example of a user device of FIG. 1;

[0013]FIG. 3 is another example of a user device of FIG. 1;

[0014]FIG. 4 is a block diagram of the video conference apparatus of FIG. 1;

[0015]FIG. 5 is an example of a verification display according to the present invention;

[0016]FIG. 6 is an example of a display of the available environments for selection by a user in accordance with the present invention; and

[0017]FIG. 7 is a flowchart of the operation of the video conference apparatus according to the present invention.

DETAILED DESCRIPTION OF THE INVENTION

[0018]FIG. 1 shows a video conferencing system according to the present invention. The system includes user devices <b>100</b>, <b>110</b> and <b>120</b> in connection with a network <b>106</b> through Local Access Providers (LAPs) <b>102</b>, <b>112</b> and <b>116</b>, and switches <b>104</b> and <b>114</b>. The user devices <b>100</b>, <b>110</b> and <b>120</b> communicate with one another via the network <b>106</b> and the video conference apparatus <b>150</b>.

[0019] When a number of parties wish to conduct a video conference using the user devices <b>100</b>, <b>110</b> and <b>120</b>, each user must first log onto the video conference apparatus <b>150</b> using their respective user devices <b>100</b>, <b>110</b> or <b>120</b>. The user devices <b>100</b>, <b>110</b> and <b>120</b> may be any such device that allows for the sending and receiving of video information and audio information. The user devices <b>100</b>, <b>110</b> and <b>120</b> may further be capable of sending and receiving data and receiving input of user commands. For example, the user devices <b>100</b>, <b>110</b> and <b>120</b> may include a video conferencing device, a personal computer, a video telephone, smart TV, and the like.

[0020] Once the user has logged onto the video conference apparatus <b>150</b>, the video conference apparatus <b>150</b> retrieves information from the user database <b>132</b>. The information retrieved may contain identifiers of preferred environments and a listing of identifiers of available environments. The environment may be a simple background, a virtual environment with which the user will interact, an animated environment, a moving background, and the like. For example, the environment may be a background depicting a company trademark or a virtual environment of an office in which the user sits behind a desk and interacts with virtual objects. Other types of environments may be used without departing from the spirit and scope of the present invention.

[0021] If the retrieved information includes a preferred environment, the user is asked whether they wish to use the preferred environment. If the information does not include a preferred environment or the user does not wish to use the preferred environment, the user is presented with a list of available environments from which he/she can select the environment they wish to use during the video conference. The video conference apparatus <b>150</b> then uses the selected environment with the user's image during the video conference.

[0022]FIGS. 2 and 3 show two examples of user devices that may be used with the present invention. FIG. 2 is a personal computer and FIG. 3 is a video conferencing device as is commonly known in the art. Each device includes a display <b>201</b>, an audio input device <b>202</b>, an image input device <b>203</b>, a user interface <b>204</b> and an audio output device <b>205</b>. The display <b>201</b> may include a computer monitor, television display, touchscreen display, LCD, and the like. The audio input device <b>202</b> may include, for example, a microphone, telephone receiver, and the like. The image input device <b>203</b> may be, for example, a video camera, digital still frame camera and the like. The user interface <b>204</b> may include, for example, a keyboard, pointing device, voice recognition device, and the like. The audio output device <b>205</b> may include, for example, speakers, subwoofers and the like.

[0023] The user logs onto the video conference apparatus <b>150</b> by inputting, through the user interface <b>204</b>, the address of the video conference apparatus <b>150</b>. The address may be, for example, a telephone number, a Universal Resource Locator (URL), TCP/IP address, Local Area Network (LAN) address, Wide Area Network (WAN) address, and the like. Upon entering the address of the video conference apparatus <b>150</b>, the video conferencing signals from the user device <b>100</b>, <b>110</b> or <b>120</b> are sent through the corresponding LAP <b>102</b>, <b>112</b> or <b>116</b> and switch <b>104</b> or <b>114</b> to the video conference apparatus <b>150</b> via the network <b>106</b>.

[0024] The LAPs <b>102</b>, <b>112</b> and <b>116</b> may be any system or device that allows access to the network <b>106</b>. The LAPs <b>102</b>, <b>112</b> and <b>116</b> may be, for example, an Internet Access Provider such as America On-Line™, a Local Exchange Carrier as is typically found in telecommunications systems, and the like. The owner of the user device <b>100</b>, <b>110</b> or <b>120</b> typically must subscribe to the provider of the LAP <b>102</b>, <b>112</b> or <b>116</b> in order to obtain access to the network <b>106</b>.

[0025] The switches <b>104</b> and <b>114</b> may be any system or device that facilitates the routing of signals through the network <b>106</b> from a source device to a destination device. The switches <b>104</b> and <b>114</b> may be, for example, Lucent Technologies Inc. <b>4</b>ESS and <b>5</b>ESS switches and the like.

[0026] The network <b>106</b> may be a single network or a plurality of networks of the same or different types. Thus, network <b>106</b> may be, for example, a single telecommunications network, a plurality of telecommunications networks, a data network, a plurality of data networks, or a combination of one or more data networks and telecommunications networks. The network <b>106</b> facilitates communication between the user devices <b>100</b>, <b>110</b> and <b>120</b>.

[0027]FIG. 4 is a block diagram of the video conference apparatus <b>150</b> of FIG. 1. The video conference apparatus <b>150</b> includes a multipoint control unit (MCU) <b>401</b>, a network interface <b>402</b>, an environment processor <b>403</b>, a user database interface <b>404</b>, an environment database interface <b>405</b> and bus <b>406</b>. The MCU <b>401</b> controls the operation of the video conference apparatus <b>150</b>. The network interface <b>402</b> is used to pass signals between the video conference apparatus <b>150</b> and the network <b>106</b>. The environment processor <b>403</b> performs the processing of video conference environment selections by users. The user database interface <b>404</b> and the environment database interface <b>405</b> facilitate the transfer of data between the video conference apparatus <b>150</b> and the user database <b>132</b> and environment database <b>142</b>, respectively. Information is passed between the components of the video conference apparatus <b>150</b> via the bus <b>406</b>.

[0028] When a user initiates a video conference by inputting the address of the video conference apparatus <b>150</b>, the signals from the corresponding user device <b>100</b>, <b>110</b> or <b>120</b> are received at the conference processor <b>150</b> at the network interface <b>402</b> and are sent to the MCU <b>401</b>. The signals received from the user device <b>100</b>, <b>110</b> or <b>120</b> include information identifying the user device from which they originate. This information may be included, for example, in the signals themselves or may be a separate signal, such as a startup signal or a header to the signals being sent from the user device.

[0029] Based on the identification information received from the user device <b>100</b>, <b>110</b> or <b>120</b>, the MCU <b>401</b> retrieves information corresponding to the identification information from the user database <b>132</b> through user database interface <b>404</b>. The information retrieved from the user database <b>132</b> includes such information as the identity of the user device and various settings for the user device. These settings may include, for example, a list of environment identifiers for environments available to the user device identified by the identification information, a preferred environment for use with the video conference if the user has previously stored a preferred environment identifier in the user database <b>132</b>, and the like.

[0030] Based on the information retrieved from the user database <b>132</b>, the MCU <b>401</b> determines if a preferred environment has been set for the user device <b>100</b>, <b>110</b> or <b>120</b> from which the signals originate. If a preferred environment has been set, the MCU <b>401</b> instructs the environment processor <b>403</b> to retrieve the preferred environment from the environment database <b>142</b> via the environment database interface <b>405</b>.

[0031] The MCU <b>401</b> then sends a message to the user device <b>100</b>, <b>110</b> or <b>120</b> verifying that the user wishes to use the preferred environment. The message may be in the form of an audible message, text message or graphical display on the display <b>201</b>, a combination of audible message and text/graphic or the like. The audible message may be prerecorded or computer synthesized. For example, as shown in FIG. 5, the message may be a prerecorded message asking “Do you wish to use the preferred environment?” with a display of the environment identified by the environment identifier that has been set in the user database <b>132</b>.

[0032] If the user decides to use the preferred environment, this environment is selected for use during the video conference. However, if the user does not wish to use the preferred environment, or if a preferred environment has not been established, the MCU <b>401</b> instructs the environment processor <b>403</b> to retrieve information from the environment database <b>142</b>, via the environment database interface <b>405</b>, corresponding to a list of available environments from the user database <b>132</b> for the user device <b>100</b>, <b>110</b> or <b>120</b> identified by the identification information.

[0033] The environment processor <b>403</b> then sends the information to the user device in the form of minimized displays, commonly known as thumbnail displays, of the available environments and a request message asking that the user choose one of the displayed environments for use with the video conference. This message may be audible, textual, graphical or a combination of any or all of these. For example, the message may be an audible or textual message stating “Please select the environment for use during the video conference.” An example of this display is shown in FIG. 6.

[0034] The user may select the desired environment by, for example, clicking on a thumbnail display with a pointing device, entering a letter or number identifying the environment, speaking an identifier of the environment into the audio input device <b>202</b> (if the user device is equipped with voice recognition software), and the like. The list may also include the option for not choosing an alternative environment and thereby the video conference apparatus <b>150</b> would use a default environment such as the environment in which the user actually resides.

[0035] Alternatively, the default environment may be an environment provided to the video conference apparatus <b>150</b> from a location remote from both the video conference apparatus <b>150</b> and the user. For example, the environment may be obtained from an image pick-up device, such as a digital camera, video camera, and the like, in a location different from the user. In this way, the user may be seen as being in a different location from that in which he/she actually resides. The image pick-up device must be in communication with either the video conference apparatus <b>150</b> or the user device <b>100</b>, <b>110</b> or <b>120</b>.

[0036] Once the user has designated the environment which they wish to use, the video conference proceeds in a normal video conference mode using known head finding software to separate the talking head of the user from the environment. The talking head may then be superimposed on the alternative environment chosen by the user. In this way the user's image is displayed to the other participants in the video conference as being “in” the chosen environment.

[0037] Thus, a user may select an environment that is suitable for the video conference being conducted. For example, the user may select as an environment, the company trademark for a business meeting, household settings for family video conferences, and the like.

[0038]FIG. 7 is a flowchart of the operation of the video conference apparatus <b>150</b>. In step <b>701</b>, the video conference apparatus <b>150</b> receives video conference initiation signals from at least one of the user devices <b>100</b>, <b>110</b> or <b>120</b> and goes to step <b>702</b>. The initiation signals include identifying information identifying the user device <b>100</b>, <b>110</b> or <b>120</b> from which they originate. In step <b>702</b>, based on the identifying information received, the video conference apparatus <b>150</b> retrieves information from the user database <b>132</b> corresponding to the identifying information and goes to step <b>703</b>. The information retrieved may include a preferred environment identifier previously set by the user.

[0039] In step <b>703</b>, the video conference apparatus <b>150</b> determines if the information retrieved from the user database <b>132</b> includes a preferred environment identifier. If there is a preferred environment identifier, the video conference apparatus <b>150</b> goes to step <b>704</b>; otherwise the video conference apparatus <b>150</b> goes to step <b>705</b>. In step <b>704</b>, the video conference apparatus <b>150</b> sends a message to the user device asking if the user wishes to use the preferred environment. If the user wishes to use the preferred environment, the video conference apparatus <b>150</b> goes to step <b>712</b>; otherwise the video conference apparatus <b>150</b> goes to step <b>705</b>. In step <b>712</b>, the video conference apparatus <b>150</b> designates the preferred environment as the environment for use during the video conference.

[0040] In step <b>705</b>, the video conference apparatus <b>150</b> retrieves available environments from the environment database <b>142</b> based on information retrieved from the user database <b>132</b> and goes to step <b>706</b>. In step <b>706</b>, the video conference apparatus <b>150</b> displays these environments to the user through the display <b>201</b> of the user device <b>100</b>, <b>110</b> or <b>120</b>, sends a request message asking the user to select the environment to use with the video conference, receives the user selection and goes to step <b>707</b>.

[0041] In step <b>707</b>, the video conference apparatus <b>150</b> sends a message to the user asking if the chosen environment is to be set as a preferred environment. If it is, the video conference apparatus <b>150</b> goes to step <b>708</b>; otherwise the video conference apparatus <b>150</b> goes to step <b>709</b>. In step <b>708</b>, the video conference apparatus <b>150</b> stores the environment identifier for the chosen environment in the user database <b>132</b> as a preferred environment identifier and goes to step <b>709</b>. In step <b>709</b>, the video conference apparatus <b>150</b> initiates the video conference using the chosen or preferred environment and goes to step <b>710</b>. In step <b>710</b>, the video conference apparatus <b>150</b> monitors for an end condition of the video conference. If an end condition is detected, the video conference apparatus <b>150</b> goes to step <b>711</b> and ends; otherwise the video conference apparatus <b>150</b> goes back to step <b>709</b>.

[0042] The video conference apparatus <b>150</b> may further send different alternative environments to the various parties involved in the video conference. When the user selects the alternative environment for use during the video conference, the user may also select, from a listing of the other parties or party locations involved in the video conference, the party or parties that are to receive that alternative environment. A different video conference data stream is provided to each of the parties receiving different alternative environments through the video conference apparatus <b>150</b> under the control of the multipoint control unit <b>401</b>. Thus, the video conference apparatus <b>150</b> may send an environment corresponding to an office setting to a first party and an environment corresponding to a vacation setting to a second party. The user will be perceived by the first and second parties as being located “in” the office environment and vacation environments, respectively.

[0043] While the above embodiments describe the present invention as having a separate environment processor <b>403</b> and a multipoint control unit <b>401</b>, it is apparent to those of ordinary skill in the art that the functions of the environment processor <b>403</b> may be performed by the multipoint control unit <b>401</b> without departing from the spirit and scope of the present invention. In such a case, there is no need to include the environment processor <b>403</b> and the video conference apparatus <b>150</b> would include only the necessary interfaces and the multipoint control unit <b>401</b>.

[0044] Similarly, the above embodiments describe the present invention as having separate user and environment databases <b>132</b> and <b>142</b>. However, as is apparent to those of ordinary skill in the art, the information stored in the user and environment databases <b>132</b> and <b>142</b> may be combined into one database. Accordingly, there would be no need for both an environment database interface <b>405</b> and a user database interface <b>404</b> in the video conference apparatus <b>150</b>. Only a single database interface would be necessary.

[0045] Further, while the above embodiments describe the selection of an alternative environment using thumbnail displays, the selection of an alternative environment may be facilitated by other means. For example, the selection may be made from a directory listing of environment names. The selection may also be made by cycling through each of the environments as a full screen display. In short, any means that provides for the selection of alternative environments may be used without departing from the spirit and scope of the present invention.

[0046] As shown in FIG. 4, the method of this invention is preferably implemented on a programmed processor. However, the video conference apparatus <b>150</b> can also be implemented on a general purpose or special purpose computer, a programmed microprocessor or microcontroller and peripheral integrated circuit elements, an ASIC or other integrated circuit, a hardware electronic or logic circuit such as a discrete element circuit, a programmable logic device such as a PLD, PLA, FPGA or PAL, or the like. In general, any device on which a finite state machine capable of implementing the flowchart shown in FIG. 7 can be used to implement the video conference apparatus functions of this invention.

[0047] While this invention has been described with specific embodiments thereof, it is evident that many alternatives, modifications, and variations will be apparent to those skilled in the art. Accordingly, the preferred embodiments of the invention as set forth herein are intended to be illustrative, not limiting. Various changes may be made without departing from the spirit and scope of the invention.