Multi-point conference connection system and multi-point conference connection method

The present invention relates to a multipoint conference connection system and a multipoint conference connection method. More specifically, the present invention uses a transmission / reception unit corresponding to each of a plurality of conference points to exchange images and sounds at each conference point. Concerning the conference connection system and the multipoint conference connection method.

In recent years, the use of digital public networks has led to the widespread use of video conferencing systems. In such a video conferencing system, video images and sounds are usually exchanged with each other between a plurality of remote points to hold a conference, and until now, a one-to-one interactive type has been common. .. On the other hand, recently, there has been an increasing demand for a video conferencing system between multiple points (multiple points) from companies and governments whose office buildings and departments are geographically dispersed, and various proposals have been made in response to this. (For example, Patent Document 1, Patent Document 2). In a conventional video conferencing system, a multipoint control unit (Multipoint Control Unit) is installed in the center of a network in which a plurality of video conferencing terminals (hereinafter referred to as terminals) are connected in a star shape, and there are a plurality of multipoint control devices. Performs line connection / disconnection control between terminals, audio signal addition (mixing) processing, image signal switching / composition processing, data signal exchange, etc. Due to the spread and development of Internet technology in recent years, multipoint control devices generally control the connection / disconnection of lines between a plurality of terminals using an IP (Internet Protocol) network.<patcit num="1"><text>Japanese Patent Application Laid-Open No. 2000-59750 (Fig. 1)</text></patcit><patcit num="2"><text>Japanese Patent Application Laid-Open No. 9-261615 (Fig. 6, Fig. 8, Fig. 9)</text></patcit>

<p> The conventional multipoint control device has the following problems.</p><p> (1) When a conventional multipoint control device is connected to multiple terminals by multiple different communication methods, for example, when ISDN connection and IP connection are mixed, the screen sent from multiple terminals is displayed as one screen. There is a problem that it is difficult to display by dividing the screen so that it is displayed at the same time.</p><p> (2) Further, in the conventional multipoint control device, even if a plurality of terminals are connected by the same communication method, if the communication speed of each line is different, the frame of the image transmitted from each terminal is used. It was difficult to split the screen and display it because it had to be synchronized.</p><p> (3) In the conventional multipoint control device, the connection must be completed for each terminal at the time of multipoint connection, and it takes time to complete the connection at all points. Also, when trying to connect to each terminal, if the connection cannot be made (line failure, power is not turned on on the terminal side, etc.), or if the connection with the terminal is possible but a lot of packet loss occurs, The multipoint control device repeatedly issues connection requests and packet retransmission requests, which causes a large burden and a problem that it takes time to complete the connection.</p>

<p> The present invention has the following features as a means for solving the above problems.</p><p> The first aspect of the present invention is proposed as a multipoint conference connection system. This multipoint conference connection system receives a plurality of transmission / reception units and image data output from the plurality of transmission / reception units corresponding to the video conferencing terminal devices provided at each of the plurality of conference points, and image data of the split screen image. It is characterized by having an image dividing means for generating and outputting.</p><p> According to the multipoint conference connection system according to this embodiment, a plurality of transmission / reception units corresponding to the video conference terminal devices provided at each of the plurality of conference points are provided, and the connection with the video conference terminal device is an individual transmission / reception unit. Since it is performed every time, the connection with one of the video conferencing terminal devices is not established, or even if it takes time to retransmit the packet, the connection with the other video conferencing terminal device is not affected and is short. It is possible to make efficient connections between other points in time.</p><p> Further, the multipoint conference connection system further includes a video switch means that receives image data of a split screen image and image data output from a plurality of transmission / reception units and selectively outputs any of these image data. The transmission / reception unit may transmit the image data output from the video switch means to the corresponding video conference terminal device.</p><p> Further, in the multipoint conference connection system, image data output from a plurality of transmission / reception units may be used as analog data. According to such a configuration, even if the transmission speed of the image data sent from each video conferencing terminal device is different, it becomes easy to generate a split screen screen.</p><p> Further, in the multipoint conference connection system, each of the plurality of transmission / reception units may be capable of transmitting / receiving image data and audio data corresponding to a plurality of different communication methods. According to this configuration, even in an environment where each of the video conferencing terminal devices transmits and receives image data and audio data by a different communication method (communication protocol), each transmission / reception unit independently supports the corresponding video conferencing. It is also possible to support a multipoint conference environment in which different communication methods are mixed, which makes it possible to support the communication method (communication protocol) used by the terminal device or the communication network.</p><p> A second aspect of the present invention is proposed as a multipoint conference connection method.</p><p> This method includes a step of individually receiving image data and audio data sent from each of a plurality of conference points, a step of generating and outputting image data of a split screen image from the received image data, and an image of the split screen image. Receives data and image data sent from each of a plurality of meeting points, and outputs the image data output in the step of selectively outputting one of these image data and the step of selectively outputting it to each of the plurality of meeting points. It is characterized by having a step of transmitting.</p><p> According to the multipoint conference connection method according to this aspect, image data and audio data are transmitted and received for each video conference terminal device provided at each of the plurality of conference points, so that the video conferencing terminal device can be used with any of the video conferencing terminal devices. Even if the connection is not established or it takes time to retransmit the packet, it is possible to efficiently connect to other points in a short time without affecting the connection with other video conferencing terminal devices. It becomes.</p><p> In the multipoint conference connection method, the receiving step may include a step of outputting the received image data and audio data as analog data. According to this method, even if the transmission speed of the image data sent from each video conferencing terminal device is different, it becomes easy to generate a split screen screen.</p>

<p> According to the present invention, even in an environment in which a plurality of connection methods for video conferencing terminal devices are mixed or in an environment in which communication speeds with each video conferencing terminal device are different, split screen display can be easily performed at multiple points. It becomes possible to provide connection technology.</p>

Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of the video conferencing system according to the present embodiment. In this example, the conference points MP1 to MPN, which are N conference points, and the conference point MPC, which is the installation location of the multipoint connection system 10 that functions as a multipoint connection device (MCU), are connected, and these conferences are connected. A so-called video conference is held between the point MP1 to the conference point MPN and the conference point MPC.

A video conferencing terminal device 20 is installed at each of the conference point MP1 to the conference point MPN. FIG. 2 is an external perspective view showing an example of the video conferencing terminal device 20. As shown in the figure, the video conferencing terminal device 20 includes a main body unit 201, a camera unit 202 rotatably mounted on the main body unit 201, and a microphone unit 203 installed on the side of the camera unit 202. Have. The main unit 201 has terminals for connecting to an external monitor (not shown) and an external speaker (not shown), and video output and audio output are performed by the external monitor (not shown) and the external speaker (not shown). Will be done.

FIG. 3 is a functional block diagram of the video conferencing terminal device 20. The main unit 201 of the video conferencing terminal device 20 generates video data from the communication interface unit 301 for transmitting and receiving video data and audio data to and from the outside via the communication network, and the image captured from the camera unit 202, and also communicates. The video processing unit 302 that decodes the video data received via the interface unit 301 and displays the image on the external monitor 303, and the audio data is generated from the audio captured from the microphone unit 203, and also via the communication interface unit 301. It has an audio processing unit 304 that decodes the received audio data and outputs the audio to the external speaker 305.

The video conferencing terminal device 20 is connected to another video conferencing terminal device 20 via a communication network, and video data and audio data are transmitted and received between the mutual video conferencing terminal devices 20. FIG. 4 is a diagram showing a state in which a video conference terminal device 20 is used to have a conversation between two points. The video conferencing terminal device 20 transmits its own image and sound to the other video conferencing terminal device 20, and the other video conferencing terminal device 20 reproduces the image and sound sent by the monitor device 400 with speakers.

Returning to Figure 1, we continue to explain the video conferencing system. The video conferencing terminal device 20 provided at each conference point can be connected to the multipoint conference connection system 10 via a communication network. The communication network may be a data communication network, an ISDN communication network, a communication network using a video signal, or the like, and any communication method (communication protocol) may be adopted. The difference in communication method (communication protocol) is that the multipoint conference connection system 10 side transmits and receives data according to the communication method (communication protocol) of the video conferencing terminal device 20 provided at each conference point and the communication network used by the video conferencing terminal device 20. By doing so, it is absorbed. In the example shown in FIG. 1, the video conferencing terminal device 20 provided at the conference points MP1 and MP2 is connected to the multipoint conference connection system 10 via the communication network A (for example, IP network), while being connected to the conference point MPN. The provided video conferencing terminal device 20 shows a configuration in which the video conferencing terminal device 20 is connected to the multipoint conference connection system 10 via a communication network B (for example, an ISDN network) different from the communication network A.

The multipoint conference connection system 10 includes a router HUB 101, a video conferencing terminal compatible unit 102 which is a transmission / reception unit provided corresponding to each of the conference points to be connected, an image division device 103 which is an image division means, and a video switch. It has a video matrix switcher 104 as a means, a system control device 105, an audio processing device 106, and a monitor 107, a video camera 108, a microphone 109, and a speaker 110 which are input / output means for audio and image at a conference point MPC. are doing.

The router HUB 101 passes the packet received from the communication networks A, B, etc. to the corresponding video conferencing terminal compatible unit 102, and also sends the packet sent from the video conferencing terminal compatible unit 102 to the corresponding video conferencing terminal device 20. To do.

The video conferencing terminal compatible unit 102 is a component corresponding to the main unit 201 of the video conferencing terminal device 20, and has a function of transmitting and receiving image data and audio data to and from the corresponding video conferencing terminal device 20.

The image dividing device 103 receives the image data output from each video conferencing terminal compatible unit 102 and the image of the conference point MPC taken by the video camera 108, generates and outputs the image data of the divided screen image, and is required. The image data of the single screen image which is the image of each conference point is output according to the above. FIG. 5 is a diagram showing a display example of a split screen image. In this example, all images of 16 conference points including the conference point MPC, which is the installation location of the multipoint conference connection system 10, are displayed on one screen. The layout in the split screen image, that is, the size and position of each image in the split image can be changed as appropriate. Further, it is not always necessary to display all the images of the conference points connected by the multipoint conference connection system 10, and it is sufficient that at least one of the conference points is displayed.

The single-screen image refers to an image that displays image data output from any one of the video conferencing terminal compatible units 102 on one screen. When a single screen image is displayed, only the image of one of the conference points is displayed on the display device. The single-screen image output by the image dividing device 103 does not have to be an image of all the conference points connected by the multipoint conference connection system 10, and only an image of some conference points is output. It doesn't matter.

The video matrix switcher 104 receives the split screen image and the single screen image output from the image dividing device 103, and the image output from the video camera 108, and selectively outputs at least one of the data of these images. .. The image data selected and output by the video matrix switcher 104 is supplied to each video conferencing terminal compatible unit 102 and also to the monitor 107. The image data supplied to each video conferencing terminal compatible unit 102 is transmitted to the video conferencing terminal devices 20 at each conference point MP1 to MPN via the router HUB101 and the communication network A or B. Each video conferencing terminal device 20 displays the selected image data to a user (such as a conference attendee). In addition, the monitor 107 of the conference point MPC also displays the same selected image data. Therefore, users of all the conference points MP1 to MPN and MPC can proceed with the conference while viewing the same screen.

The control device 105 sets the correspondence relationship (designation of the IP address) between each video conferencing terminal device 20 and each video conferencing terminal compatible unit 102 on the router HUB 101, and switches the output to the video matrix switcher 104 (selected image). It is a computer that has a function to specify data) and is equipped with software for making these settings, for example.

The audio processing device 106 reproduces the audio data from each video conferencing terminal device 20 received by each video conferencing terminal compatible unit 102 and outputs it from the speaker 110, as well as the audio data of the conference point MPC captured from the microphone 109 and the audio data of the conference point MPC. The audio data from each video conferencing terminal device 20 received by each video conferencing terminal compatible unit 102 is synthesized and supplied to each video conferencing terminal compatible unit 102. The voice data supplied to each video conferencing terminal compatible unit 102 is transmitted to the video conferencing terminal devices 20 at each conference point MP1 to MPN via the router HUB101 and the communication network A or B. Each video conferencing terminal device 20 reproduces this audio data and provides the audio of each conference point to all users (conference attendees, etc.). Therefore, all the users of the conference points MP1 to MPN and MPC can proceed with the conference while listening to the remarks of other users.

In the present embodiment, it is preferable to transmit and receive image data and audio data between the video conferencing terminal compatible unit 102, the image dividing device 103, and the video matrix switcher 104 using analog data. With this feature, it is possible to construct a system with high image quality and high sound quality without deterioration of the frame rate. Further, the connection between the multipoint conference connection system 10 and each video conference terminal device 20 is determined by the success or failure of the connection with each other video conference terminal device 20 by the video conference terminal compatible unit 102 corresponding to each video conference terminal device 20. Since it can be performed regardless of the situation, the time required for connecting between multiple points can be shortened, and the operational efficiency can be improved.

[Modification example] As input to the video matrix switcher 104, data other than the above image data and audio data, for example, data from a separately provided personal computer (document data, image data, spreadsheet, etc.) can be input. Is also good. These inputs can be displayed on the video conferencing terminal device 20 or the monitor 107 as a split screen or a single screen. According to such a configuration, it is possible to proceed with the conference while displaying the conference materials on the screen.

[Advantages of this system]

(1) In the conventional multipoint video conferencing by the multipoint connection device (MCU), there are restrictions such as deterioration of the frame rate because the CPU processing capacity of the multipoint connection device (MCU) is limited. Can be used without degrading the performance of the video conferencing terminal device. Since this system does not necessarily require a higher CPU processing capacity than the conventional system, it is possible to make the price equal to or less than that of the conventional system.

(2) It can be used not only as a simple video conferencing system but also as a data transmission system by RGB signal transmission. For example, this system can also be used as a means of communication for medical personnel who exchange diagnostic image data.

(3) Since the connection time required for connecting at multiple points is relatively short, this system is also effective as a means of communication in the event of a disaster such as a disaster prevention center that requires urgency.

(4) Others This system can also be used as a platform for all transmission systems that require the transmission and reception of image data and audio data.

<figref num="1">A block diagram showing a configuration example of a video conferencing system according to an embodiment of the invention.</figref><figref num="2">External perspective view showing an example of a video conferencing terminal device</figref><figref num="3">Functional block diagram of video conferencing terminal device</figref><figref num="4">A diagram showing a conversation between two points using a video conferencing terminal device.</figref><figref num="5">Diagram showing a display example of a split screen image</figref>

Code description

10 ... Multipoint conference connection system 20 ... Video conferencing terminal device 101 ... Router HUB 102 ... Video conferencing terminal compatible unit 103 ... Image segmentation device 104 ... Video matrix switcher