Communication service device

【0001】

[Technical field to which the invention belongs]

The present invention relates to a communication service device that connects to a plurality of multimedia communication terminals to provide a multimedia communication service.

【0002】

[Conventional technology]

In recent years, with the development of image compression technology and the spread of high-speed, high-quality digital lines represented by ISDN, recommendations for multimedia (audio / visual) services have been stipulated in ITU-T Recommendation H.324, etc. , Various multimedia communication services are provided that follow these recommendations. In addition, 64Kbps high-speed transmission by 3G-324M compliant W-CDMA mobile phones will be realized, and the use of multimedia communication terminals such as mobile videophones will be considered for multimedia communication services.

【0003】

In such a multimedia communication service, a multipoint conference system in which a plurality of multimedia communication terminals are connected to provide a multipoint conference service can be considered. As a multipoint conference system, a multipoint conference system that can connect multipoint multimedia communication terminals at three or more points to hold a multipoint conference has already been devised for digital lines such as ISDN. In the multipoint conference system, an MCU is connected by connecting to a multipoint communication control device (hereinafter referred to as an MCU) that controls the multipoint communication for a plurality of multimedia communication terminals participating in the multipoint conference service. A method of forming a multipoint connection via is adopted.

【0004】

As an example of multipoint connection using an MCU, Fig. 8 shows the connection form when a multipoint conference is held at four points. In the figure, in the multimedia communication terminal, the multimedia communication terminals 802 to 805 are connected to the MCU801 via the public network in order to participate in the multipoint conference.

【0005】

According to the conventional multipoint conferencing system that connects multiple points using the MCU801 in this way, the MCU801 distributes video to each multimedia communication terminal 802 to 805 during communication between multiple points. A method of identifying the current speaker terminal by comparing the audio levels from each multimedia communication terminal 802 to 805 and delivering the video sent from the identified speaker terminal, 2) Currently connected A method of sequentially distributing the video sent from the multimedia communication terminals 802 to 805 at regular intervals, 3) The video from all the multimedia communication terminals connected between multiple points by the MCU801 is regarded as one video. A method of synthesizing and distributing the synthesized video, or 4) a method of distributing video from a specific multimedia communication terminal according to an instruction from a control device that manages the MCU801 has been proposed.

【0006】

In addition, in the case of the methods 1), 2) and 4) above, when a new multimedia communication terminal participates in the middle of the multipoint conference or the multimedia communication terminal participating in the multipoint conference leaves. In addition, Japanese Patent Application Laid-Open No. 8-321884 shows a means for knowing a change in the situation of a multipoint conference from a multimedia terminal that has already participated in the multipoint conference.

【0007】

FIG. 9 shows the configuration of the conventional MCU shown in Japanese Patent Application Laid-Open No. 8-321884. In the figure, when the terminal number monitoring unit 902 detects a change in the number of participating multimedia communication terminals, the terminal information of the multimedia communication terminal that has caused the change in the number of participating multimedia communication terminals is displayed. It is taken out from the terminal information storage unit 901 by the terminal information notification unit 903. The extracted terminal information such as the outgoing address is overlaid on the transmitted image by the image synthesizing unit 904 or added to the transmitted voice by the voice synthesizing unit 905 according to the selection of the selection unit 907, together with the information on the change in the number of other terminals. To.

【0008】

In this prior art, when a means for monitoring the number of terminals connected to a multipoint conference and a change in the number of terminals is detected by the terminal number monitoring means, information about the terminals is participated in the multipoint conference. I am trying to notify the multimedia communication terminal that is using it.

【0009】

[Patent Document 1]

Japanese Unexamined Patent Publication No. 8-321884 [0010]

[Problems to be Solved by the Invention]

For example, when the multimedia communication terminal is a mobile videophone, there is no means for superimposing the contents of control information on the screen of the mobile videophone due to restrictions on hardware resources and the like. Therefore, it is not possible to provide guidance information to the mobile videophone receiving the service in response to changes in the situation regarding communication services such as multipoint conferences.

【0011】

Further, even if the multimedia communication terminal can receive the control information and display the character information on the TV screen, when the display content is added, the multimedia communication terminal that participates in the conference is modified. Therefore, even a terminal that can receive character information or the like may not be able to accurately display the information sent from the multipoint communication control device on the screen.

【0012】

Further, the above-mentioned multipoint communication control device that provides the conventional multipoint conference service has a terminal number storage means for storing the number of terminals of the multimedia communication terminals participating in the multipoint conference service, and has the number of terminals. Since the information regarding the change in the number of terminals is notified to the multimedia communication terminals participating in the multipoint conference service due to the change in the number of terminals, there is a problem that only the notification of the video / audio information regarding the change in the number of terminals can be dealt with. There is.

【0013】

In addition, when the multimedia communication terminal is called from the MCU, the call fails, the participating multimedia communication terminal is disconnected due to the termination of the multipoint conference service, or the communication status with the participating multimedia communication terminal is abnormal. There is a problem that there is no means for notifying the multimedia communication terminal participating in the multipoint conference of information on changes in the situation regarding the multipoint conference, such as when the conference is disconnected due to the above.

【0014】

The present invention has been made to solve the above-mentioned problems, and changes in the communication and service status in the multipoint conference etc. for each multimedia communication terminal participating in the multipoint conference service etc. It is an object of the present invention to provide a communication service device capable of transmitting guidance multimedia information capable of confirming changes in various situations to each multimedia communication terminal so that it can be confirmed.

【0015】

[Means for solving problems]

In order to achieve the above object, the present invention is a communication service device that connects to a multimedia communication terminal and provides a multimedia communication service, and the multimedia communication terminal responds to changes in the communication status or the status related to the provided service. On the other hand, it is a communication service device that transmits multimedia information for guidance notifying the change in the above situation.

【0016】

BEST MODE FOR CARRYING OUT THE INVENTION<u style="single">Embodiment 1.</u>FIG. 1 is a configuration diagram showing a first embodiment of a multipoint communication control device to which the present invention is applied. In the figure, 1 is a terminal control / management unit that manages terminal status such as connection and disconnection of multimedia communication terminals and control calls of terminals, and 2 is information on terminals of a multipoint conference in terminal control / management unit 1, for example. The terminal information storage unit that stores information such as outgoing address, incoming address, and user information, 3 is the terminal status that monitors the communication status of each multimedia communication terminal participating in the multipoint conference and the status change of the multipoint conference. It is a monitoring unit. 4 is the video information or voice information or text information for guidance, or the video information, voice information and text information for the multimedia communication terminal participating in the multipoint conference according to the instruction from the terminal control / management unit 1. Guidance video / audio information processing unit for selecting any combination of multimedia information or one of the information, 5 is the guidance video information provided to the multimedia communication terminal participating in the multipoint conference. Is a guidance video information storage unit that stores information, and reference numeral 6 is a guidance voice information storage unit that stores guidance voice information provided to multimedia communication terminals participating in a multipoint conference.

【0017】

Further, in FIG. 1, reference numeral 7 denotes a video processing unit that performs video switching processing, video composition processing, guidance video information synthesis processing, etc. of the multimedia communication terminal participating in the multipoint conference. 8 refers to the addition processing of the voice information of the participating multimedia communication terminals and the addition processing of the guidance voice information as the voice information for the multipoint conference for the multimedia communication terminals participating in the multipoint conference. The audio processing unit that performs switching processing, 9 is the decoding processing of video coding information from the multimedia communication terminal participating in the multipoint conference, and the video information for the multipoint conference generated by the video processing unit 7 described above. The video coding / decoding unit that performs the coding process of, 10 is the decoding process of the audio coding information from the multimedia communication terminal participating in the multipoint conference, and the multipoint conference generated by the audio processing unit 8 described above. This is a voice coding / decoding unit that performs coding processing of voice information for the purpose.

【0018】

Further, in FIG. 1, 11 is a media separation that separates the media multiplexing information from the multimedia communication terminal participating in the multipoint conference into the video coding / decoding unit 9 and the voice coding / decoding unit 10 as each media information. Processing and generating media multiplexing information for transmitting each media coding information from the video coding / decoding unit 9 and the voice coding / decoding unit 10 to the multimedia communication terminal participating in the multipoint conference. A multiplexing separation unit that performs media multiplexing processing, and 12 are line interface units that are connected to a plurality of lines and perform line control with a plurality of multimedia communication terminals. In addition, 13 is a multipoint conference management unit that manages conference information such as conference time and conference mode, registration information of participating multimedia terminals, and controls for requests such as calling terminals from the outside. The multipoint conference management unit 13 makes a call request to the designated multimedia communication terminal to the terminal control / management unit 1 when a participant registered as a multipoint conference calls.

【0019】

Next, the operation will be described. In the above configuration, when an incoming call arrives at the multipoint communication control device from a multimedia communication terminal, the terminal control / management unit 1 determines whether or not to participate, and notifies the line interface unit 12 whether or not the multimedia communication terminal can be connected. .. The connection information of the participating multimedia communication terminals is notified from the line interface unit 12 to the terminal status monitoring unit 3 of the terminal control / management unit 1 as a change in the communication status. By this notification, the terminal status monitoring unit 3 detects that the communication status in the multipoint conference service has changed, and the terminal information storage unit 2 indicates that the terminal has participated in the guidance video / audio information processing unit 4 as a change in the communication status. Notify with the information of participating terminals.

【0020】

In the guidance video / audio information processing unit 4, the guidance video information indicating that a new terminal has participated in the multipoint conference is provided by the guidance video information storage unit 5, and the guidance audio information is provided by the guidance audio information storage unit 6. The video information for reading and guidance is transferred to the video processing unit 7, and the audio information for guidance is transferred to the voice processing unit 8. The video processing unit 7 switches the transferred video information for guidance with the video information of the multipoint conference and transfers it to the video coding / decoding unit 9. Then, the video coding / decoding unit 9 performs a video coding process for transmitting the video information for the multipoint conference to the multimedia communication terminal that has already participated. Further, the voice processing unit 8 performs addition processing as the voice information of the multipoint conference, and transfers the transferred voice information for guidance to the voice coding / decoding unit 10. Then, the voice coding / decoding unit 10 carries out a voice coding process for transmitting the voice information for the multipoint conference to the multimedia communication terminal that has already participated. Then, the video coding information and the audio coding information are multiplexed by the multiplexing separation unit 11 and transmitted to the already participating multimedia communication terminals via the line interface 12.

【0021】

As described above, in the multimedia communication terminal that has already participated in the multipoint conference, the guidance video code that indicates that the new multimedia communication terminal has participated and that the new multimedia communication terminal has participated is transmitted from the multipoint communication control device. It can be confirmed by performing video decoding processing on the computerized information and by performing audio decoding processing on the guidance voice coding information.

【0022】

If the multimedia communication terminal participating in the multipoint conference disconnects and leaves the multipoint conference, the disconnection information of the multimedia communication terminal from the line interface unit 12 is the terminal of the terminal control / management unit 1. The status monitoring unit 3 is notified as a change in communication status. By this notification, the terminal status monitoring unit 3 detects that the communication status in the multipoint conference service has changed, and informs the guidance video / audio information processing unit 4 that the terminal has left the seat as a change in the communication status. Notify with the information of participating terminals.

【0023】

In the guidance video / audio information processing unit 4, the guidance video information indicating that the terminal has left the seat from the multipoint conference is read from the guidance video information storage unit 5, and the guidance audio information is read from the guidance voice information storage unit 6. The guidance video information is transferred to the video processing unit 7, and the guidance audio information is transferred to the voice processing unit 8. The video processing unit 7 switches the transferred video information for guidance with the video information of the multipoint conference and transfers it to the video coding / decoding unit 9. Then, the video coding / decoding unit 9 carries out a video coding process for transmitting the video information to the multimedia communication terminal participating as the video information for the multipoint conference. Further, the voice processing unit 8 performs addition processing as the voice information of the multipoint conference, and transfers the transferred voice information for guidance to the voice coding / decoding unit 10. Then, the voice coding / decoding unit 10 carries out a voice coding process for transmitting to the multimedia communication terminal participating as voice information for the multipoint conference. Then, the video coding information and the audio coding information are multiplexed by the multiplexing separation unit 11 and transmitted to the participating multimedia communication terminals via the line interface 12.

【0024】

From the above, in the multimedia communication terminal participating in the multipoint conference, it is for guidance indicating that the participating multimedia communication terminal has left the seat and that the participating terminal has left the seat, which is transmitted from the multipoint communication control device. It can be confirmed by performing video decoding processing on the video coding information and by performing audio decoding processing on the guidance voice coding information.

【0025】

In the above configuration, the video processing unit 7 synthesizes the video information of the multimedia communication terminal that participates in the multipoint conference and is speaking and the video information for guidance, and transfers it to the video coding / decoding unit 9. By performing the video coding process, it is possible to transmit the video information of the multipoint conference including the video information for guidance to the multimedia communication terminal participating in the multipoint conference.

【0026】

Further, in the above-described configuration, when a specific multimedia communication terminal is called from the multipoint communication control device by an external device or the like, the multipoint conference management unit 13 informs the terminal control / management unit 1 of the specific multimedia communication. Make a terminal call request. The terminal control / management unit 1 requests the line interface unit 12 to call the terminal according to the request from the multipoint conference management unit 13, and the terminal status monitoring unit 3 changes the communication status in the multipoint conference service. This is detected, and the guidance video / audio information processing unit 4 is notified that the terminal is being called as a change in the communication status, together with the information of the terminal being called from the terminal information storage unit 2.

【0027】

In the guidance video / audio information processing unit 4, the guidance video information indicating that the terminal is being called from the multipoint conference is read from the guidance video information storage unit 5, and the guidance audio information is read from the guidance voice information storage unit 6. , Guidance video information is transferred to the video processing unit 7, and guidance audio information is transferred to the audio processing unit 8. The video processing unit 7 combines the transferred video information for guidance with the video information of the multipoint conference and transfers it to the video coding / decoding unit 9. Then, the video coding / decoding unit 9 performs a video coding process for transmitting the video information for the multipoint conference to the multimedia communication terminal that has already participated. Then, the video coding information including the guidance video information is multiplexed with the voice coding information and the like by the multiplexing separation unit 11, and is transmitted to the participating multimedia communication terminals via the line interface 12. Will be done.

【0028】

Based on the above, the multimedia communication terminal that has already participated in the multipoint conference indicates that the specific multimedia communication terminal is being called, and that the specific terminal transmitted from the multipoint communication control device is being called. The guidance video coding information shown can be confirmed by performing video decoding processing.

【0029】

In addition, when a call is made from the above-mentioned multipoint communication control device, but the multimedia communication terminal to be called cannot participate due to being out of service area or busy, the terminal status monitoring unit 3 can be used from the line interface unit 12. The notification that the connection is not possible is detected as a change in the communication status in the multipoint conference service, and the terminal that called from the multipoint communication control device as a change in the communication status to the video / audio information processing unit 4 for guidance cannot participate. This is notified from the terminal information storage unit 2 together with the information of the terminal that could not participate.

【0030】

In the guidance video / audio information processing unit 4, the guidance video information indicating that the terminal was called from the multipoint conference but could not participate is stored in the guidance video information storage unit 5, and the guidance voice information is stored in the guidance voice information. It is read from the unit 6 and the guidance video information is transferred to the video processing unit 7, and the guidance audio information is transferred to the audio processing unit 8. The video processing unit 7 combines the transferred video information for guidance with the video information of the multipoint conference and transfers it to the video coding / decoding unit 9. Then, the video coding / decoding unit 9 performs a video coding process for transmitting the video information for the multipoint conference to the multimedia communication terminal that has already participated. Further, the voice processing unit 8 performs addition processing as the voice information of the multipoint conference, and transfers the transferred voice information for guidance to the voice coding / decoding unit 10. Then, the voice coding / decoding unit 10 carries out a voice coding process for transmitting the voice information for the multipoint conference to the multimedia communication terminal that has already participated. Then, the video coding information and the audio coding information are multiplexed by the multiplexing separation unit 11 and transmitted to the participating multimedia communication terminals via the line interface 12.

【0031】

As described above, in the multimedia communication terminal that has already participated in the multipoint conference, the video coding information for guidance transmitted from the multipoint communication control device that the multimedia communication terminal was called but could not participate is video-decoded. This can be confirmed by performing voice decoding processing on the guidance voice coding information.

【0032】

Figure 2 shows the multimedia communication participating in the multipoint conference when the video processing unit 7 switches the video information for guidance of participation when participating in the multipoint conference due to the arrival of a new multimedia communication terminal. An example of the received video of the terminal is shown.

【0033】

FIG. 3 shows an example of the received video of the multimedia communication terminal participating in the multipoint conference when the video of the multimedia communication terminal participating in the video processing unit 7 and the video information for guidance of participation are combined.

【0034】

Figure 4 shows a case where the video processing unit 7 synthesizes guidance video information indicating that the participating multimedia communication terminal could not participate when a specific multimedia communication terminal was called but could not participate. An example of the received video of the multimedia communication terminal participating in the multipoint conference is shown.

【0035】

In addition, when the end time of the multipoint conference is predetermined, the terminal status monitoring unit is notified from the multipoint conference management unit 13 that the conference will end at the end of the multipoint conference to the terminal control / management unit 1. In 3, the multipoint communication control is performed by detecting that the conference service status has changed and notifying the guidance video / audio information processing unit 4 that the conference will end as a change in the communication status from the terminal information storage unit 2. The device transmits video / audio coding information for guiding the end of the conference to the participants of the conference being held. The multimedia communication terminal participating in the conference can confirm that the conference is completed by decoding the video / audio coding information for guiding the end of the conference.

【0036】

Further, in the above-mentioned multipoint communication control device, when the multimedia communication terminal already participating in the multipoint conference is disconnected due to an abnormality in the communication state and leaves the seat, the terminal control / management unit 1 is contacted with the multi from the line interface unit 12. The disconnection information of the media communication terminal is notified, and the status of the multiplexing information received from the multimedia communication terminal that has left the multiplexing separation unit 11 is notified. The terminal status monitoring unit 3 of the terminal control / management unit 1 detects that the multimedia communication terminal that has left the seat is disconnected due to an abnormality in the communication status and leaves the seat as a change in the communication status of the terminal, and the video / audio information processing unit 4 for guidance. Notifies that the terminal has left due to a communication error as a change in communication status.

【0037】

In the guidance video / audio information processing unit 4, the guidance video information indicating that the terminal has left due to an abnormality in the communication status from the multipoint conference is stored in the guidance video information storage unit 5, and the guidance voice information is stored in the guidance voice information. It is read from the unit 6 and the guidance video information is transferred to the video processing unit 7, and the guidance audio information is transferred to the audio processing unit 8. The video processing unit 7 combines the transferred video information for guidance with the video information of the multipoint conference and transfers it to the video coding / decoding unit 9. The video coding / decoding unit 9 performs video coding processing as video information for a multipoint conference. Further, the voice processing unit 8 performs addition processing as the voice information of the multipoint conference, and transfers the transferred voice information for guidance to the voice coding / decoding unit 10. Then, the voice coding / decoding unit 10 performs voice coding as voice information for the multipoint conference. The encoded video coding information and the audio coding information are multiplexed by the multiplexing separation unit 11 and transmitted to the participating multimedia communication terminals via the line interface 12.

【0038】

As described above, in the multimedia communication terminal that has already participated in the multipoint conference, the video coding information for guidance transmitted from the multipoint communication control device that the multimedia communication terminal has left due to an abnormality in the communication status is video-decoded. This can be confirmed by performing voice decoding processing on the guidance voice coding information.

【0039】

Further, in the above-mentioned multipoint communication control device, when the video coding information from the multimedia communication terminal already participating in the multipoint conference cannot be normally displayed due to an abnormality in the communication state or the like, the video coding / decoding unit 9 is used. Notify the terminal control / management unit 1 that the received video coding information cannot be video-decoded. Then, the terminal status monitoring unit 3 detects that the video coding information cannot be displayed normally as a change in the communication status, and sends a video to the conference participating terminal as a change in the communication status of the terminal to the video / audio information processing unit 4 for guidance. Notify that decryption is not possible.

【0040】

The guidance video / audio information processing unit 4 reads out the guidance video information indicating that the video coding information from the multimedia communication terminal cannot be video-decoded from the guidance video information storage unit 5, and the guidance video information is the video processing unit. Transfer to 7. The video processing unit 7 synthesizes the transferred video information for guidance with the video information of the multipoint conference and transfers it to the video coding / decoding unit 9, and performs video coding as the video information for the multipoint conference. The encoded video coding information is multiplexed with the voice coding information and the like by the multiplexing separation unit 11, and is transmitted to the participating multimedia communication terminals via the line interface 12.

【0041】

Based on the above, the multimedia communication control device that the multimedia communication terminal participating in the multipoint conference cannot provide the video of the multimedia communication terminal as the video of the multipoint conference due to the communication status of the participating multimedia communication terminal. It can be confirmed by performing video decoding processing on the guidance video coding information transmitted from.

【0042】

Further, as shown in FIG. 5, when the guidance video information storage unit 5 and the guidance voice information storage unit 6 are configured to be outside the multipoint communication control device, the terminal status monitoring unit 3 detects the above-mentioned description. Depending on the communication status of the multimedia communication terminal, this can be realized by receiving the guidance video / audio information corresponding to the guidance video / audio information processing unit 4 from the external guidance video / audio storage unit and the guidance audio information storage unit. ..

【0043】

Further, in the present embodiment, if it is specified in advance in the guidance video / audio information processing unit 4 that the guidance video / audio information is notified to a specific multimedia communication terminal, the guidance video / audio information is notified. Switching or synthesizing the video / audio information for guidance according to the change in the situation of multipoint communication to a specific multimedia communication terminal from the audio information processing unit 4 to the video processing unit 7 and the audio processing unit 8. By requesting the addition processing of the audio information, it is possible to notify the guidance video / audio information only to a specific multimedia communication terminal.

【0044】

As described above, the situation change of the participating terminals of the multipoint conference is monitored, the guidance video information and the guidance voice information are stored in advance inside or outside, and the guidance video according to the situation change when necessary. By reading out the information and the guidance audio information, it is possible to transmit the guidance video / audio coding information that can confirm the change in the communication status of the multipoint conference to the participating multimedia communication terminals.

【0045】<u style="single">Embodiment 2.</u>In the above-described first embodiment, the guidance video information is stored in advance inside or outside the multipoint communication control device, and the guidance video information and the guidance voice information stored when necessary are read and already participated. It was provided to the multimedia communication terminals that are already in use, but when it is needed next time, it internally generates guidance video information and guidance audio information and provides it to the multimedia communication terminals that have already participated. Shows morphology.

【0046】

FIG. 6 is a configuration diagram showing a second embodiment of a multipoint communication control device to which the present invention is applied. In FIG. 6, points 1 to 12 are the same as those of the multipoint communication control device of the first embodiment shown in FIG. Further, in the figure, 601 is a terminal control / management unit that registers terminal information from the multipoint conference management unit 613 described later in the terminal information storage unit 602 in addition to the processing of the terminal control / management unit 2 shown in FIG. is there. In 602, in addition to the information of the terminal information storage unit 2 shown in FIG. 1, the name that identifies each participating multimedia communication terminal registered in advance at the time of reservation of the multipoint conference by the terminal control management unit 602 is character information. It is a terminal information storage unit stored as. In addition to the processing of the guidance video / audio processing unit 4 of FIG. 1, 604 is notified from the terminal information storage unit 602 together with the terminal status information from the terminal status monitoring unit 3 when the communication status of the multipoint conference changes. When the character information as the name for identifying the terminal is notified as the terminal information of, the guidance video information generation unit 605 and the guidance voice information generation unit 606, which will be described later, correspond to the multipoint communication status. A guidance video / audio processing unit that requests the generation of guidance video information and guidance audio information and has a means of transferring the corresponding guidance video information and guidance audio information to the video processing unit 7 and the audio processing unit 8. is there.

【0047】

Further, in FIG. 6, 605 generates character information as a name for identifying the terminal as video information, performs a synthesis process with the guidance video information stored in advance, and performs guidance video to the multimedia communication terminal. The guidance video information generation unit, 606, which can generate information, generates text information as a name for identifying a terminal as voice information, and performs synthesis processing with the guidance voice information stored in advance. It is a guidance voice information generation unit that can be generated as guidance voice information to a multimedia communication terminal. In addition to the processing of the multipoint conference management unit 13 shown in FIG. 1, 613 is given a name for identifying the participating multimedia communication terminals registered at the time of booking the multipoint conference to the terminal control / management unit at the start of the multipoint conference. It is a multipoint conference management unit that can transfer to 601 and provide the name of the terminal for the video and audio information for guidance.

【0048】

Next, the operation will be described. Here, as an example, a case where a multimedia communication terminal participates in order to participate in the multipoint communication control device will be described.

【0049】

In the above configuration, when an incoming call is received from a multimedia communication terminal for participation in the MCU, the terminal control / management unit 601 determines whether or not to participate. In the case of a multimedia communication terminal that can participate, the connection information of the multimedia communication terminal from the line interface unit 12 is notified to the terminal control / management unit 601. By this notification, the terminal status monitoring unit 3 detects that the terminal has participated, and the terminal information storage unit 602 indicates that the terminal has participated in the guidance video / audio information processing unit 604 as a name for identifying the terminal. Notify the information together with the information of the participating terminals.

【0050】

The guidance video / audio information processing unit 604 generates guidance video information by adding the text information of the name for identifying the terminal to the guidance video information indicating that a new terminal has participated in the multipoint conference. Request to the video information generation unit 605. The guidance video information generation unit 605 generates guidance video information by adding character information for terminal identification to the guidance video information accumulated in advance indicating that the terminal has participated. The generated guidance video information indicating participation is read from the guidance video / audio processing unit 604 and transferred to the video processing unit 7.

【0051】

Further, the guidance voice information generation unit 606 generates the guidance voice information by synthesizing the character information for terminal identification with the guidance voice information accumulated in advance indicating that the terminal has participated. The generated guidance voice information indicating participation is read from the guidance voice processing unit 604 and transferred to the voice processing unit 8.

【0052】

The video processing unit 7 switches the transferred guidance video information with the video information of the multipoint conference, or combines it with the video information of the multimedia communication terminal that has already participated and transfers it to the video coding / decoding unit 9. Then, video coding is performed as video information for multipoint conferences. Further, the voice processing unit 8 performs addition processing as voice information for the multipoint conference, transfers the transferred voice information for guidance to the voice coding / decoding unit 10, and voice-encodes it as voice information for the multipoint conference. To carry out.

【0053】

The encoded video coding information and audio coding information are multiplexed by the multiplexing separation unit 11 and transmitted to the already participating multimedia communication terminals via the line interface 12.

【0054】

As described above, in the multimedia communication terminal that has already participated in the multipoint conference, the video coding information for guidance transmitted from the multipoint communication control device is video-decoded to indicate who participated as a new multimedia communication terminal. It can be confirmed by processing and by performing voice decoding processing on the guidance voice coding information.

【0055】

FIG. 7 shows an example of the received video of the multimedia communication terminal participating in the multipoint conference when the video of the multimedia communication terminal participating in the present embodiment and the video information for guidance of participation are combined by the video processing unit 7. Is shown.

【0056】

As described above, the change in the status of the terminals participating in the multipoint conference is monitored, and the name that identifies the multimedia communication terminal participating in the multipoint conference is stored internally as text information, and the stored video information for guidance is stored. And, by generating guidance video information and guidance voice information according to the situation change when necessary, along with the guidance voice information, the participating multimedia communication terminals can be identified in the multipoint conference. It is possible to transmit the information to which the name for is added as the video / audio coding information for guidance that can confirm the change in the communication status.

【0057】

In the first and second embodiments, in addition to the case where each multimedia communication terminal is connected to an ISDN line as a communication line for connecting to a multipoint communication control device, PSTN (analog telephone network) and CSPDN (circuit switching) are used. Needless to say, it can be applied to various lines such as switched networks) and LANs (local area networks).

【0058】

Further, in the description of the above embodiment, as the multimedia information for guidance, either video coding information or voice coding information for guidance, or both video and voice coding information is selected. As described above, the present invention is not limited to this, and any multimedia information for guidance may be used. In addition to this information, character data such as text, images such as CG, any combination thereof, and any combination thereof may be used. Of course, multimedia information in any combination of these with video coding information and audio coding information may be used.

【0059】

[Effect of the invention]

As described above, according to the present invention, the multipoint conference to the participating multimedia communication terminals so that the change in the status of the multipoint conference can be confirmed for the multimedia communication terminals participating in the multipoint conference service. It is possible to send multimedia information for guidance that can confirm changes in various situations.

[Simple explanation of drawings]

FIG. 1 is a configuration diagram showing a first embodiment of a multipoint communication control device to which the present invention is applied.

[Fig. 2] When a new multimedia communication terminal receives an incoming call and participates in a multipoint conference, the multimedia communication participating in the multipoint conference when the video processing unit 7 switches the video information for guidance of participation. It is a figure which shows an example of the received image of a terminal.

FIG. 3 is a diagram showing an example of a received video of a multimedia communication terminal participating in a multipoint conference when the video of the multimedia communication terminal participating in the video processing unit 7 and the video information for guidance of participation are combined. is there.

[Fig. 4] When a specific multimedia communication terminal is called but cannot participate, the video processing unit 7 synthesizes guidance video information indicating that the participating multimedia communication terminal cannot participate. It is a figure which shows an example of the received image of the multimedia communication terminal participating in a multipoint conference.

FIG. 5 is a diagram showing a configuration example in which the guidance video information storage unit 5 and the guidance voice information storage unit 6 are configured to be outside the multipoint communication control device.

FIG. 6 is a configuration diagram showing a second embodiment of a multipoint communication control device to which the present invention is applied.

FIG. 7 is an example of a received video of a multimedia communication terminal participating in a multipoint conference when the video of the multimedia communication terminal participating in the video processing unit 7 and the video information for guidance of participation are combined in the present embodiment. It is a figure which shows.

FIG. 8 is a diagram showing a connection form when a multipoint conference is held at four points as an example of multipoint connection using an MCU.

FIG. 9 is a configuration of a conventional MCU shown in JP-A-8-321884.

[Explanation of symbols]

1 Terminal control / management unit, 2 terminal information storage unit, 3 terminal status monitoring unit, 4 guidance video / audio information processing unit, 5 guidance video information storage unit, 6 guidance audio information storage unit, 7 video processing unit, 8 audio Processing unit, 9 video coding / decoding unit, 10 audio coding / decoding unit, 11 multiplexing separation unit, 12 line interface unit, 13 multipoint conference management unit.