Methods, media, and devices for providing visual resources of video conference participants

The present invention relates to methods, media and devices for providing visual resources for video conferencing participants.

Video conferencing systems are widely used to allow participants in different geographic locations far away to hold face-to-face meetings without the need for long-distance trips. When attending such a meeting, knowing when a new participant joins the meeting, watching the participant's video through the meeting, and determining who is attending the meeting at any time during the meeting. It is desirable to be able to.

In traditional systems, new participants use the audio part of the conference to announce by phone. While this can be an effective way to announce who will be attending, it can also be very distracting to those who are listening to the participants. Also, in traditional systems, when a participant's video is degraded or no longer presented, the video is simply presented in degraded form or deleted altogether. This often makes it impossible to determine who is speaking when the listener is not familiar with the speaker's voice. Similar to the announcement of new participants, in the conventional system, when a roll call is made, the audience will announce in the audio part of the conference, which, as mentioned above, of the listening participant. It will be distracting.

Therefore, according to various embodiments, it is desirable to provide a video conferencing system that overcomes these limitations of conventional systems.

Methods, media and devices are provided to provide visual resources for video conferencing participants. In some embodiments, the method of providing visual resources for a participant in a video conference is to access the steps that determine whether the participant joins or leaves the video conference, and the visual resources that identify the participant. And the step of presenting the visual resource to at least one other participant in the video conference.

In some embodiments, the method of providing a participant's visual resources to a video conference is the step of determining whether the participant's video is degraded or not presented, and when the video is degraded or not presented. It comprises a step of accessing a visual resource corresponding to a participant and a step of presenting the visual resource to at least one other participant in the video conference.

In some embodiments, the method of providing visual resources for a participant in a video conference is to wait for the start of a roll call and the video conference participant's video, which includes visual resources for each participant in the video conference. It includes a step of generating a roll call and a step of displaying the video roll call.

In some embodiments, the computer-readable medium comprises a computer-executable instruction that causes the processor to perform a method of providing visual resources for participants in a video conference when executed by the processor. This method involves deciding whether a participant joins or leaves the video conference, accesses a visual resource that identifies the participant, and uses the visual resource to at least one other participant in the video conference. Include the steps presented to.

In some embodiments, the computer-readable medium comprises a computer-executable instruction that causes the processor to perform a method of providing visual resources for participants in a video conference when executed by the processor. This method involves determining whether a participant's video is degraded or not presented, and when the video is degraded or not presented, accessing the visual resource corresponding to that participant, and videoizing the visual resource. Include steps to present to at least one other participant in the conference.

In some embodiments, the computer-readable medium comprises a computer-executable instruction that causes the processor to perform a method of providing visual resources for participants in a video conference when executed by the processor. This method includes a step of waiting for the start of a roll call, a step of generating a video roll call of a participant in a video conference including visual resources for each participant of the video conference, and a step of displaying the video roll call. Prepare.

In some embodiments, the device that provides the visual resources of the participants to the video conference determines whether the participants join or leave the video conference, accesses the visual resources that identify the participants, and It comprises a processor that presents the visual resources to at least one other participant in the video conference.

In some embodiments, the device that provides the participant's visual resources to the video conference determines whether the participant's video is degraded or not presented, and when the video is degraded or not presented, the participant. It comprises a processor that accesses the corresponding visual resource and presents the visual resource to at least one other participant in the video conference.

In some embodiments, the device that provides the visual resources of the participants in the video conference waits for the start of the roll call and the video roll call of the participants in the video conference that includes the visual resources for each participant in the video conference. It is equipped with a processor that generates a video roll call and displays the video roll call.

<figref num="1">It is a block diagram of the system which can be used according to some examples.</figref><figref num="2">It is a diagram showing a process that can be used to direct a new participant when he / she joins a conference, according to some embodiments.</figref><figref num="3">FIG. 5 illustrates a process that can be used when a participant's video deteriorates or does not exist, according to some embodiments.</figref><figref num="4">It is a figure which shows the process which can be used to perform a video roll call by some examples.</figref>

Methods, media and devices are provided to provide visual resources for video conferencing participants. These displays can be one or more visual resources that can be any suitable mechanism for visually distinguishing a video conference participant from other video conference participants. For example, visual resources can be video clips, images, avatars, icons, animations, and so on. Visual resources can be obtained from any suitable source. For example, it can be an image or video clip obtained automatically from a conference participant's endpoint or in response to a request from the participant. In some embodiments, the user interface directs a countdown when an image is acquired, allowing participants to select from multiple acquired images or video clips.

In some embodiments of the invention, the participant's visual resources can be presented when the participant attends the meeting. In some embodiments, the participant's visual resources can be presented when the participant's video deteriorates or is not presented. In some embodiments, the visual resources of one or more conference participants can be presented as part of a video roll call.

With reference to FIG. 1, a system 100 is shown that implements various embodiments of the present invention. As shown in the figure, system 100 includes a multi-conference unit (MCU) 102, endpoint 104, database 106, internal server 108, external server 110 and connections 112,114,116 and 118.

The multi-conference unit (MCU) 102 can be any suitable device for hosting video conferencing. In some embodiments, the MCU 102 can be integrated into one of the endpoints 104. As described below, the MCU 102 may perform one or more of the functions described in connection with FIGS. 2-4 in addition to or in place of the other multi-conference unit functions. The MCU 102 can be implemented using dedicated hardware or any suitable device such as a general purpose controller and can include one or more processors and interfaces.

The endpoint 104 can be any suitable device that provides a unit interface for audio or video conferencing. Some of the endpoints 14 can only host the audio part of the conference, or only part of the video part of the conference (eg, just display an image of a remote participant, and of a local participant. The image may not be sent, or only the image of the local participant may be sent, and the image of the remote participant may not be displayed). At least one of the endpoints 104 may be capable of displaying visual resources that are part of a video conference hosted by the MCU 102.

Each of the database 106, internal server 108 and external server 110 can be any suitable device for storing visual resources. These visual resources can be accessed by the MCU 102 and used as part of a video conferencing, as described below.

The database 106 should be any suitable storage device such as memory (eg random access memory, read-only memory, FLASH memory, etc.), disk drive, optical medium drive (eg compact disc, display video disk, etc.). It may have any suitable logic built into it that makes the MCU 102 accessible to the visual resources stored in it. Database 106 may be embedded in MCU 102 or separated from MCU 102. The database 106 can be connected to the MCU 102 with a connection 114, and this connection can be any suitable mechanism (eg, one or more wires, computer network, communication network, etc.) that connects the database 106 to the MCU 102.

The internal server 108 and / or the external server 110 can be any arbitrary such as memory (eg random access memory, read-only memory, FLASH memory, etc.), disk drive, optical medium drive (eg, compact disk, display video disk, etc.). It can be a digital processing device (eg, a computer, server, network device, etc.) that includes a suitable storage device, and can include any suitable logic that makes the MCU 102 accessible to the visual resources stored in it. The internal server 108 can be incorporated into the MCU 102 and can be connected to the MCU 02 with a connection 116. The external server 110 can be an external device of the MCU 102, and can be connected to the MCU 102 with a connection 118. Connections 116 and / or 118 can be any suitable mechanism (eg, one or more wires, computer networks, communication networks, etc.) that connects the server 108 or 110 to the MCU 102.

In addition or instead, visual resources can also be stored on endpoint 104. In such cases, the endpoint 104 can be any suitable such as memory (eg random access memory, read-only memory, FLASH memory, etc.), disk drive, optical medium drive (eg compact disc, display video disc, etc.). Storage device may be included, and any suitable logic that makes the MCU 102 accessible to the visual resources stored in it may be incorporated.

With reference to FIG. 2, a process 200 is shown for some embodiments to indicate that a new participant joins or leaves the conference. Participants can join or leave the conference using any suitable endpoint 104, such as the audio-only endpoint 104 or the audio and video endpoint 104.

As shown in the figure, process 200 can wait for participants to join or leave in step 202. Any suitable delay can be used in the wait step, but step 202 can be omitted in some embodiments. Then, in step 204, process 200 can determine whether the participant has joined or left. This decision can be made using any suitable mechanism. For example, process 200 indicates that a participant has joined or left the participant's phone number (eg, caller ID) that is calling the conference, such as the participant code, unit identification code, or personal identification number entered by the participant. Can be determined based on the participant's Internet Protocol (IP) address, URL or filename passed as a resource indication and / or any other mechanism.

Process 200 may return to step 202 and wait for the participant to join or leave again if it determines that the participant has not yet joined or left. Process 200 can access the visual resources associated with the participant in step 206 if it decides that the participant has joined or left. As mentioned above, visual resources can be any suitable mechanism for identifying that participant to other participants in the video conference. For example, visual resources can be video clips, images, avatars, icons, animations, and so on. Visual resources can be stored in one or more databases (eg 102), internal servers (eg Server 108), external servers (eg Server 110) and / or any other suitable storage mechanism. The specific visual resource selected for the participant is the telephone number of the participant calling the conference (eg, caller ID), such as the participant code, unit identification code, personal identification number entered by the participant. ), Participant's Internet Protocol (IP) address, and / or can be selected based on any other mechanism. In addition or instead, other criteria can be used to select visual resources, such as who the participants are meeting with, what the meeting is about, when the meeting will take place, and so on. For example, participants can choose different visual resources when talking to colleagues at work and when talking to personal friends. As another example, visual resources can be determined based on the subject or title associated with the meeting. As yet another example, visual resources can be determined based on whether the meeting takes place during business hours or not.

After accessing the visual resource in step 206, the visual resource is presented to other participants in step 208. Prior to presentation, the visual resource can be resized and reformatted. For example, as shown in window 210, an image of the participant can be presented with an identifier of the participant's state, such as the words "join now" or "leave now". This window can be presented to the entire display of one or more endpoints 104, or to only a portion of the display of the endpoint 104. The window can have an opaque background (to obscure other images that are part of the conference) and can have any suitable transparency level. Visual resources can additionally or instead include participant identifiers. For example, this identifier can be a participant's name, nickname, company name, telephone number, IP address, etc. and / or any other suitable identifier. As a more specific example, the identifier can indicate "Jane is joining now". In addition or instead, the audio identifier can be presented with the visual resource. The audio identifier can present the participant's identifier (eg, the participant's oral name) by voice.

The window can be presented until any suitable period (eg 1 second) has elapsed, or until any suitable operation has occurred (eg until the observer acknowledges a new participant by pressing a button). ..

After the visual resource is presented in step 208, process 200 returns to step 202 and waits for more participants.

FIG. 3 illustrates the process 300 of providing visual resources when a participant's video deteriorates or is not presented, according to some embodiments. As shown in the figure, in step 302, process 300 monitors the participant video. Then, in step 304, process 300 determines if the participant's video has deteriorated or is not presented. For example, as shown in 306, a participant's video may deteriorate and the image may not look satisfactory. Such exacerbations can occur for a variety of reasons, such as noise on the connection between the participant's endpoint 104 and the MCU 102 or technical issues related to the participant's endpoint 104. As another example, a participant is turning off the video of the participant's endpoint, the participant's endpoint does not have video capabilities, and the participant's whereabouts are dimly lit. Participant videos may not be presented due to technical reasons associated with the endpoint and / or for other reasons.

If it is determined in step 304 that the participant's video has deteriorated or is not presented, process 300 can access the visual resources in step 308. The visual resource accessed in step 308 can be identical or nearly identical to the visual resource mentioned above in connection with step 206 in FIG. 2, and the visual resource is described above in connection with step 206 in FIG. It can be selected by the same method or almost the same method.

After accessing the visual resource in step 308, the visual resource can be presented to other participants in place of the participant's video in step 310. Visual resources can be resized, reformatted, etc. before presentation. For example, as shown in window 312, an image of the participant can be presented with the words "(video is blocked)". This window can be displayed across the display of one or more endpoints 104 (eg, when using full-screen video for talking participants), and (eg, multiple participants). It can only be presented on a portion of the endpoint 104's display (as part of the composite video if it is displayed simultaneously in the composite video (eg, in a "Hollywood square" style). Visual resources can also include participant identifiers. For example, this identifier can be a participant's name, nickname, telephone number, IP address, etc., and / or any other suitable identifier. In addition or instead, the audio identifier can be presented with the visual resource. The audio identifier can present the participant's identifier (eg, the participant's oral name) by voice.

After the visual resource is presented on screen 310, process 300 returns to screen 302 and continues to monitor the participant's video.

If it is determined in step 304 that the participant's video is presented without deterioration, process 300 will display the participant's video as needed (eg, visual resources are displayed in place of the participant's video). If) Restore and return to step 302.

Process 300 can be implemented as a thread for each participant, and process 300 can monitor each participant's video.

FIG. 4 shows the process 400 of making a video roll call, according to some examples. Video roll calls can be used to identify conference participants using visual resources. As shown in the figure, in step 402, process 400 can wait for the roll call to start. For example, a roll call starts automatically at the start of a meeting, starts in response to a participant's roll call request, starts when a participant joins or leaves the meeting after the meeting starts, and / Or it can be started on the basis of other suitable criteria.

In step 404, process 400 can decide whether the video roll call should be presented in a composite format. If the video role call should be presented in a composite format, process 400 may generate the composite role call in step 406 and display the composite role call in step 408. As shown in window 410, compound role calls can display the visual resources of conference participants in a grid (eg, "Hollywood Square" style). Visual resources can be resized, reformatted, etc. before being included in a composite role call. The visual resource contained in the composite role call can be the same as or nearly the same as the visual resource described above in connection with step 206 of FIG. 2 and with the method described above in connection with step 206 of FIG. It can be selected in the same or almost the same way. As shown in the figure, the compound role call can also include the participant's identifier. For example, this identifier can be a participant's name, nickname, company name, telephone number, IP address, etc. and / or any other suitable identifier. In addition or instead, the audio identifier can be presented with the compound role call. The audio identifier can present the identifier of each participant (for example, the verbal name of the participant) by voice.

The compound roll call can be displayed until any suitable time period (eg, 1 second) elapses, or until any suitable operation occurs (eg, until the observer presses a button). After the compound role call is displayed in step 408, process 400 returns to step 402.

If in step 404 it is determined that the video role call is not a compound role call, process 400 can display the visual resources of the first participant in step 412. Then, in step 414, process 400 can determine that the role call has ended (eg, because the visual resources of all participants have been displayed). If it is determined that the role call has ended, process 400 displays the next participant's visual resource in step 416 and returns to step 414. If it is determined in step 414 that the role call will be executed, process 400 returns to step 402.

The visual resources displayed in steps 412 and 416 can be identical or nearly identical to the visual resources described in connection with step 206 in FIG. 2, the method described above in connection with step 206 in FIG. Can be selected in the same or almost the same way as. Visual resources can be resized, reformatted, etc. before presentation. Each visual resource displayed in steps 412 and 416 should be displayed until any suitable time period (eg 1 second) has elapsed, or until any suitable operation has occurred (eg until the observer presses a button). Can be done.

An example of a video roll call that can be presented according to steps 412,414 and 416 is shown in windows 418,420,422 and 424. The visual resources of the first participant are displayed, as shown in window 418. This visual resource can also include participant identifiers, as mentioned above in connection with step 410. In addition or instead, an audio identifier can also be provided, as described in connection with step 410. The visual resources of the other participants can then be displayed in sequence, as shown in windows 420, 422 and 424.

Windows 418, 420, 422 and 424 can be presented on the entire display or only a portion of one or more endpoints 104. The window can have an opaque background (so that other images that are part of the conference are invisible) and can have any suitable transparency level. These windows should be presented until any suitable time period (eg 1 second) has elapsed, or until any suitable operation has occurred (eg until the observer acknowledges a new participant by pressing a button). Can be done.

Although the present invention has been described for some of the above-mentioned examples, the disclosure of the present specification is made only for one example, and in the practice of the present invention, many details are kept without departing from the spirit and scope of the present invention. Is possible, and the scope of the present invention is not changed only by the claims described below. The features of the disclosed examples can be combined and rearranged in various ways.