Multimedia communication equipment

Description: TECHNICAL FIELD [Detailed description of the invention]

【0001】

[Industrial application field]

The present invention is a multimedia represented by an AV (Audio Visual) communication device such as a videophone device or a video conferencing system capable of multiplexing multimedia information such as voice information, image information, and data for mutual communication. Regarding communication equipment.

【0002】

[Conventional technology]

In recent years, practical application of communication services using ISDN (Integrated Services Digital Network) lines has started, and AV services such as videophone devices and video conferencing systems using such digital lines are attracting attention. Service regulations, protocol regulations, multimedia multiplexing frame structure, video information coding method, etc. for AV services are CCITT (International Telegraph and Telephone Advisory Committee) recommendations "H.320", "H.242", " It is defined as "H.221", "H.230", "H.261", etc. "H.221" defines the frame structure for AV services on 64kbps to 1920kbps channels.

【0003】

Figure 5 shows the frame structure of "H.221" on a 64kbps x 1 channel. The numbers 1 to 8 on the horizontal axis are bit numbers, and the numbers 1 to 80 on the vertical axis are octet numbers, which are 80 octets. Make up one frame with. The FAS (frame synchronization signal) in the figure controls frame synchronization / multi-frame synchronization, communication quality monitoring function, alarm information notification, and so on.

【0004】

FIG. 6A is a diagram showing bit assignments between 1 multiframe = 8 submultiframes (1 submultiframe = 2 frames) of the FAS. In addition, BAS (bit rate allocation signal) is used to specify the capabilities of the terminal, specify the bit rate allocation for each media in the actual frame, and perform various other controls and notifications. As shown in FIG. 6 (b), the BAS is transmitted in even frames, and the corresponding error correction bit is transmitted in odd frames.

【0005】

"H.242" stipulates communication procedures such as capability information exchange sequence and mode switching sequence using BAS in-channel between AV terminals. "H.320" defines the system aspect of AV services in general. "H.230" stipulates various controls and notifications that require transmission frame synchronization or urgent response as additional information for the functions required for AV services. "H.261" defines a coding / decoding method for moving image information at a speed of px64kbps (p = 1 to 30).

【0006】

FIG. 7 shows a basic sequence for multimedia communication such as images, sounds, and data (all user information other than images and sounds) according to the above recommendations. First, when the multimedia communication device (hereinafter referred to as the starting device) that wants to start communication activates, the out-channel call control is activated and the other device is notified of the incoming call. In the case of an ISDN line, the call setting sequence by D channel (ch) is activated.

【0007】

In the called party device, first, in step 701, it is determined whether or not the incoming call is a videophone call. In the ISDN line, the BC (transmission ability) information element and the HLC (higher layer integrity) information element / LLC (lower layer integrity) information element in the setup message on the Dch call control are different depending on whether the call is a telephone call or a videophone call. Judge whether it is a call.

【0008】

If it is considered to be a videophone call, the process proceeds to step 702 to set the Dch call. Next, the process proceeds to step 703, and frame synchronization is established by FAS search / detection and transmission / detection of A bit = 0 on the set connection (corresponding to Bch, Hch, etc. in ISDN). After the synchronization is established, in step 704, the ability of the other device is determined by the ability information exchange sequence by the ability BAS transmission / reception detection. Next, in step 705, the multimedia multiplexing allocation on the first connection is determined, the mode switching sequence is performed by transmitting / receiving the BAS command, and the multimedia multiplexing communication is started.

【0009】

Actually, in this case, when the additional connection is continuously established, there are many cases where only voice information communication is performed. For example, communication is started in the mode of voice 56kbps / H261 image OFF. After that, the process proceeds to step 706, and if it is determined that both the own device side and the partner device side have the additional connection capability, the process proceeds to step 707 to establish the additional connection. After that, in step 708, FAS search / detection of the additional connection, frame synchronization / multi-frame synchronization using the A bit, and synchronization establishment processing with the first channel are performed, and then the process returns to step 706 to perform additional connection again. Determine if it is necessary.

【0010】

When the need for an additional connection is eliminated, the operation mode suitable for using all channels is determined in step 709, the mode switching sequence is performed by transmitting / receiving the BAS command, multimedia multiplex communication is performed, and then this processing operation is terminated. To do. However, the mode switching sequence by the BAS command performed in step 709 may be performed each time immediately after the execution of the synchronization establishment step 708 for each additional connection.

【0011】

Figure 8 shows the basic sequence of the incoming device when the image input / output power supply is ON / OFF controlled by a conventional videophone. First, wait until the incoming call is detected in step 801. When an incoming call is detected, the process proceeds to step 802, and the image input / output power supply unit is turned on. Next, in step 803, the end of communication is monitored in step 804 while actually performing mutual communication of audio and image information. If the activation of the end of communication is detected in step 804, the process proceeds to step 805, the image input / output power supply unit is turned off, and this processing operation is terminated.

【0012】

The starting device turns on the image input / output power supply when the starting operation is activated. In addition, the control to turn off the image input / output power supply is the same control that is normally performed for computer terminals, such as turning off the device if there is no access to the device for a certain period of time after the power is turned on in the non-communication state. Some are doing.

【0013】

[Problems to be Solved by the Invention]

However, in the above conventional example, the image input / output power supply that requires the most power capacity in the above device before determining whether or not the incoming call is a videophone call, that is, whether or not the image information input / output unit is used. The part is turned on unconditionally.

【0014】

Therefore, even when it is not necessary to use the image information input / output unit, such as when the result is a telephone call or when an incoming call is received from another data transmission system, power is wasted. There was a drawback that it would end up.

【0015】

Even if the call is a videophone call as a result, the phase in which the image communication actually starts is after the negotiation procedure on the in-channel, and it is useless to turn on the power supply unit immediately after the incoming call. It was.

【0016】

Further, when the image information output monitor is also used for displaying information such as caller notification by the ISDN line, it is meaningful to turn on the power supply unit for the time being, but the power supply is used even after the communication is started. Although it is not necessary to keep the unit ON, in the past, the power supply unit was kept ON even after the start of communication.

【0017】

The present invention has been made in view of the above circumstances, and an object of the present invention is to prevent the image input / output power supply unit from being turned on unnecessarily, to reduce power consumption and to protect the monitor screen from burn-in. The purpose is to provide the designed multimedia communication device.

【0018】

[Means for solving problems]

In order to achieve the above object, the multimedia communication device of the present invention is used in the image information input unit, the image information output unit, the audio information input unit, the audio information output unit, the line interface unit, the image information input unit and the image information output unit. Communication means that have image input / output power supply units to supply power and can communicate with each other as a telephone device via a communication line, and communication means that can communicate with each other by multiplexing multimedia information such as voice information, image information, and data. In the multimedia communication device having the above, the first detection means for detecting whether or not the incoming call detected from the line interface unit is an incoming call for multimedia mutual communication accompanied by image information communication, and the first detection means described above. When an incoming call of multimedia mutual communication accompanied by image information communication is detected, the operation start means for activating the power supply unit and starting the operation of the image information input unit and the image information output unit, and the multimedia mutual communication The second detection means for detecting the end, and when the end of the multimedia mutual communication is detected by the second detection means, the power supply of the power supply unit is stopped and the operation of the image information input unit and the image information output unit is performed. It is characterized in that it is provided with an operation stopping means for stopping the above.

【0019】

Further, in order to achieve the same purpose, the image information communication is actually started with the start / stop means for stopping the power supply start of the power supply unit when the incoming multimedia mutual communication is detected by the first detection means. When the start of the image information communication is detected by the third detection means and the third detection means, the power supply unit is powered and activated to start the operation of the image information input unit and the image information output unit. It is desirable to provide a second operation starting means.

【0020】

Similarly, when the image information transmission is started, the power supply unit of the image information input unit is powered and activated to start the operation of the image information input unit, and when the image information reception is started, the image information output unit of the image information output unit is started. It is desirable to provide a third operation start means for starting the operation of the image information output unit by supplying power to the power supply unit.

【0021】

Similarly, the fourth operation starting means for starting the operation of the image information output unit by supplying power to the power supply unit of the image information output unit and the image information when an incoming call such as a telephone communication without the image information communication is received. A display means for displaying a message at the time of an incoming call on the output unit, and a second operation stop means for stopping the operation of the image information output unit by stopping the power supply of the image output unit by responding to the incoming call. It is desirable to have.

【0022】

Further, similarly, the power supply unit of the image information output unit is automatically stopped after a certain period of time has passed since the message at the time of incoming call such as telephone communication without the image information communication is displayed on the image information output unit. The third operation stop means for stopping the operation of the image information output unit, the instruction means for instructing the message display from the operation unit, the fourth detection means for detecting the instruction by the instruction means, and the instruction by the instruction means. Based on this, it is desirable to provide a second display means for causing the image information output unit to display the message by supplying power to the power supply unit of the image information output unit.

【0023】

[Action]

The multimedia communication device according to claim 1 determines whether or not the incoming call is a call involving image information communication, and automatically turns on the image input / output power supply unit only when it is determined that the incoming call is image information communication. By automatically turning off the power supply unit by detecting the end, it is possible to prevent wasteful consumption of electric power.

【0024】

Further, even if it can be determined that the multimedia communication device according to claim 2 is an incoming call accompanied by image information communication, the image communication is actually performed without turning on the image input / output power supply unit immediately. Further power saving can be realized by turning on the power supply unit at the time of starting.

【0025】

Further, in the multimedia communication device of claim 3, in consideration of asymmetry in transmission / reception of image information communication, ON / OFF of the power supply unit of the image information output unit such as a monitor and the image information input unit such as a camera. By making it possible to instruct separately, it is possible to further subsidize the reduction of power consumption.

【0026】

Further, when the multimedia communication device of claim 4 is configured to be used as an image information output unit as a means of displaying incoming information even for an incoming call that does not involve image information communication, When an incoming call arrives, the power unit of the image information output unit is turned on to display the incoming call information and prompt the user to answer the incoming call. Then, when the response to the incoming call is returned by the user operation or the like, the power supply unit is turned off so that the necessary information can be displayed when necessary by sharing the display unit and wasting power. You can reduce consumption.

【0027】

Further, the multimedia communication device according to claim 5 displays the incoming call information display at the time of the communication call of the non-image information system for a certain period of time by the internal timer, and the image information output unit also at the time of the non-image information system communication by the user's operation. By turning on the power supply unit based on the instruction to use the display means, the display means resources can be effectively utilized while reducing the power consumption.

【0028】

[Example]

Hereinafter, examples of the present invention will be described with reference to FIGS. 1 to 6.

【0029】

[First Example] FIG. 1 is a block configuration diagram of a multimedia communication device according to the first embodiment of the present invention. In the figure, 1 is a handset that is one of the voice input / output means, 2 is a microphone that is one of the voice input means, 3 is a speaker that is one of the voice output means, and 4 is a voice interface (I / F). ), A function to switch the handset 1, microphone 2, and speaker 3 as audio input / output means, and to detect whether the handset 1 is in the on-hook state or the off-hook state, according to the instruction of the system control unit 15 described later. It has a / off-hook detection function, an echo cancel function for erasing echoes when the microphone 2 and speaker 3 are used as voice input / output means, and a tone generation function for dial tones, ringtones, busy tones, ringtones, etc.

【0030】

5 is a voice coding / decoding unit, which is 64kbps PCM (A-law), 64kbps PCM (μ-law), 64kbps / 56kbps / 48kbps SB-ADPCM, 32kbps ADPCM, 16kbps according to the instruction of the system control unit 15 described later. It has a function to A / D convert and encode the transmitted audio signal and a function to D / A convert and decode the received audio signal according to the audio signal coding / decoding algorithm such as 8kbps.

【0031】

6 is one of the video input means and is a camera for inputting a self-image, 7 is one of the image input means and is a document camera for inputting a picture or drawing, 8 is a camera 6 or a document camera. The display unit that displays the input image from 7, the received image from the other party, the operation screen, etc., 9 is the video interface unit, and according to the instruction of the system control unit 15 described later, the camera 6 and the document camera 7 as image input means are used. It has a switching function, a display switching between an input image, a received image, and an operation screen, and an image signal composition function for displaying them separately on the display unit 8.

【0032】

Reference numeral 10 denotes a video coding / decoding unit (image codec unit), which has a function of A / D converting and encoding a transmitted image signal according to the CCITT recommendation [H.261] and a function of D / A converting and decoding a received video signal. It has a function to change. 11 is an image input / output power supply unit, which is an image information input unit such as 6 cameras, 7 document camera and an image information output unit, a display unit 8, and in some cases, a video interface unit 9, video coding / decoding. It supplies and stops power to unit 10.

【0033】

Reference numeral 12 is a data terminal for transmitting and receiving data, and 13 is a data interface unit. The data transmitted from the data terminal 12 and the system control unit 15 is notified to the demultiplexing unit 16, and the received data is transmitted to the data terminal 12 or described later. The system control unit 15 is notified.

【0034】

14 is an operation unit such as a keyboard used to input control information for controlling the device in general, and 15 is a system control unit equipped with a CPU, ROM, RAM, auxiliary storage device, etc. Monitoring and controlling the entire device, calculating the assigned transmission speed to each media based on input control information, line status, etc., and determining and controlling the final mode, ON / OFF control of the image input / output power supply unit 11, It also executes application programs such as man-machine interfaces.

【0035】

Reference numeral 16 denotes a multiplex separator, which is an audio signal from the audio coding / decoding unit 5, an image signal from the video coding / decoding unit 10, data from the data interface unit 12, according to CCITT recommendation H.221. The data from the system control unit 15 and the control information such as CCITT recommendations "H.221" and "H.242" are multiplexed for each transmission frame, and the reception frame is separated into each media of the configuration unit and notified to each unit. It is a thing.

【0036】

Reference numeral 17 denotes a line interface unit that controls the line 21 according to the ISDN user / network interface. Reference numeral 18 denotes a storage unit that stores various control information. The image input / output power supply unit 11 includes an image information input power supply unit 19 and an image information output power supply unit 20. The image information input power supply unit 19 supplies power to the image information input units such as the camera 6 and the document camera 7. Further, the image information output power supply unit 20 supplies power to the image information output unit such as the display unit 8.

【0037】

FIG. 5 is a diagram showing the frame structure in the 64 kbps channel shown in CCITT Recommendation H.221, and FIG. 6 is a diagram showing the bit signs of FAS and BAS in one multi-frame.

【0038】

Hereinafter, the operation of the multimedia communication device having the above configuration will be described in detail based on the flowchart of FIG.

【0039】

First, in step 201, it waits for an incoming call to be detected. If the incoming call is detected, the process proceeds to step 202 to determine whether or not the incoming call is an explicit non-image communication type incoming call such as a telephone call. Specifically, in the case of an ISDN line, the judgment is made by checking the BC / HLC / LLC information elements in the SETUP message received by the Dch call control.

【0040】

After receiving an incoming call, if there is a possibility that the H.320 terminal is a call that involves image communication, the H.221 frame synchronization is established in step 203, and the ability information exchange sequence by BAS is attempted in step 204. After that, the process proceeds to step 205, and based on the results of executing steps 203 and 204, it is determined whether or not mutual communication such as videophone / conference with image information is possible. Specifically, when the H.221 synchronization frame is established and it can be determined that the H.261 synchronization frame has the H.261 image communication capability as a result of the capability information exchange sequence by BAS with the other device, the process proceeds to the next step 206. , The image on / output power supply unit 11 is automatically turned on, and the camera 6 and the display unit 8 are put into operation.

【0041】

Next, the process proceeds to step 207, and after actually performing multimedia mutual communication such as voice / image information, the process waits until the end of the corresponding communication call is detected in step 208. If the end of communication is detected in step 208, the image input / output power supply unit 11 is turned off in step 209, and the operations of the camera 6 and the display unit 8 are stopped. On the other hand, if it is determined in step 202 that the call is a non-image communication type incoming call, or if it is determined in step 205 that the communication has no image communication capability, for example, the other party is using a 7 kHz voice telephone device. When there is such a situation, this processing operation is terminated without particularly controlling the image input / output power supply unit 11.

【0042】

[Second Example] Next, the operation of the multimedia communication device according to the second embodiment of the present invention will be described in detail based on the flowchart of FIG.

【0043】

First, in step 301, it is monitored whether or not there is an incoming call. If the incoming call is detected, the process proceeds to step 302 to determine whether or not the incoming call is an explicit non-image communication type incoming call such as a telephone call. In the case of an ISDN line as in the first embodiment described above, the determination is made by checking the BC / HLC / LLC information elements in the SETUP message received by the Dch call control.

【0044】

If there is a possibility of an incoming call accompanied by image communication, in step 303, the H.221 frame synchronization establishment and the ability information exchange sequence using BAS are attempted. Next, the process proceeds to step 304, and based on the result of executing the above step 303, it is determined whether or not the H.320 terminal is videophone / conference communication with image communication, and if so, the process proceeds to step 305. .. In this step 305, it is determined whether or not the image transmission from the own terminal side has been started, and if the start of the image transmission is detected, in step 311 the image information input power supply unit 19 is turned on and the camera 6 is started. At the same time, image information multiplexing on "H.221 BAS command video ON" and "H.221" is started to start image transmission, and then the process proceeds to step 306.

【0045】

If the start of image transmission is not detected in step 305, the process proceeds to step 306. In step 306, the start of image information reception from the other device is detected by monitoring the H221BAS command, and when the image is turned on, the BAS command is received to proceed to step 312. The image information output power supply unit 20 is turned on, and the display unit 8 Is started, the received image is displayed, and then the process proceeds to step 307.

【0046】

If the start of image reception is not detected in step 306, the process proceeds to step 307. In step 307, the end of image transmission is monitored, and if a factor of image transmission end such as image transmission OFF by user operation is detected, the process proceeds to step 313, and the image information input power supply unit 19 is turned off. After stopping the operation of the camera 6, the process proceeds to step 308.

【0047】

If the end of image reception is not detected in step 307, the process proceeds to step 308. In this step 308, the cause of the end of image reception such as the received BAS command is monitored, and if the factor can be detected, the process proceeds to step 314, the image information output power supply unit 20 is turned off, and the operation of the display unit 8 is stopped. , Proceed to step 309.

【0048】

If the end of image reception is not detected in step 308, the process proceeds to step 309. In this step 309, it is monitored whether or not the communication is terminated. Then, if the communication is not completed, the process returns to step 305, and if the communication end is detected, the process proceeds to step 310, the image input / output power supply unit 11 is turned off, and this processing operation is terminated.

【0049】

Further, when an incoming call of a non-image communication system is detected in step 302 or when it is determined that the communication is not videophone / conference communication in step 304, this processing operation is terminated without any control.

【0050】

At this time, the image input / output power supply unit 11 may be turned off after the communication end information is displayed on the display unit 8 for a certain period of time without turning off the image input / output power supply unit 11.

【0051】

Further, in the second embodiment, the image information input / output power supply units 19 and 20 are controlled separately, but these may be collectively controlled.

【0052】

[Third Example] Next, a third embodiment of the present invention will be described in detail based on the flowchart of FIG.

【0053】

First, in step 401, it is monitored whether or not there is an incoming call. If the incoming call is detected, the process proceeds to step 402, the image information output power supply unit 20 is turned on, and the display unit 8 is put into the operating state. Next, in step 403, after displaying the incoming call information on the display unit 8, the user operation is awaited as to what to do with the response to the incoming call in step 404.

【0054】

If the incoming call reception response is made in this step 404, the process proceeds to step S405, and it is determined whether or not the corresponding call is a call such as a videophone / conference accompanied by image information communication. If it is a non-image communication system call such as a telephone call, the process proceeds to step 406 to start the timer T, and then the timer T waits for the time to time up in step 407. Then, when the timer T has timed up, the process proceeds to step 408, the image information output power supply unit 20 is turned off, the operation of the display unit 8 is stopped, and then the process proceeds to step 409.

【0055】

In this step 409, it is monitored whether or not a request for turning on the message display is made by the user operation. When a request to turn on the message display is made, the image information output power supply unit 20 is turned on in step 410, and then the message display is executed in step 411.

【0056】

Next, in step 412, the trigger for turning off the message display is monitored, and if the message display off is detected, the image information output power supply unit 20 is turned off in step 413 to stop the operation of the display unit 8. After that, the process proceeds to step 414 to monitor whether or not the communication is completed, and if the communication end is not detected, the process returns to step 409, and if it is detected, the image input / output power supply unit 11 is turned off in step 415. After that, this processing operation is terminated.

【0057】

If it is determined in step 405 that the communication is videophone / conference communication, the process proceeds to step 416, the image information input power supply unit 19 is turned on, the camera 6 and the display unit 8 are put into operation, and then the above. Move to step 414.

【0058】

If the request operation for turning on the message display is not performed in step 409, the process proceeds to step 412.

【0059】

Further, if the message display OFF is not detected in step 412, the process proceeds to step 414.

【0060】

[Effect of the invention]

As described above, according to the multimedia communication device according to claim 1 of the present invention, it is determined that the call involves image communication without unconditionally turning on the image input / output power supply unit when receiving an incoming call. By turning on the image on / output power supply only when, and by automatically turning off the image on / output power supply when communication end detection is detected, wasteful power consumption can be prevented and the monitor can be protected. You can plan.

【0061】

Further, according to the multimedia communication device of claim 2 of the present invention, the image input / output power supply unit is not turned on when it is determined that the call is accompanied by image communication, but an instruction from a higher level or a partner is used. By monitoring the notification from the device and turning on the power supply unit when the image communication is actually started, the power consumption can be further reduced.

【0062】

Further, according to the multimedia communication device of claim 4 of the present invention, in consideration of the asymmetry of the communication mode at the time of mutual communication, only the image information input power supply unit is turned ON / OFF at the start / stop of image transmission to obtain an image. By turning on / off only the image information output power supply unit when reception starts / stops, more effective power consumption can be reduced.

【0063】

Further, according to the multimedia communication device of claim 5, it is determined that it is better to use the display unit in terms of operation even at the time of a call without image communication, at the time of making a call, during an incoming call reception operation, or the like. By turning on the image information output power supply unit and automatically turning off the image information output power supply unit when there is no need for it, in order to temporarily use the image output unit as a display unit for multimedia control only at times. It is possible to reduce power consumption and effectively utilize resources.

[Simple explanation of drawings]

[Figure 1]

It is a block block diagram of the multimedia communication apparatus which concerns on 1st Example of this invention.

[Figure 2]

It is a flowchart for demonstrating operation of this apparatus.

[Fig. 3]

It is a flowchart for demonstrating operation of the multimedia communication apparatus which concerns on 2nd Embodiment of this invention.

[Fig. 4]

It is a flowchart for demonstrating operation of the multimedia communication apparatus which concerns on 3rd Embodiment of this invention.

[Fig. 5]

It is a frame structure diagram shown in CCITT Recommendation "H.221".

[Fig. 6]

It is a bit allocation diagram in the multi-frame of FAS and BAS shown in CCITT Recommendation "H.221".

[Fig. 7]

It is a flowchart which shows the basic sequence at the time of performing multimedia communication in the conventional multimedia communication apparatus.

[Fig. 8]

It is a flowchart which shows the basic sequence of the receiving side device at the time of ON / OFF control of the image input / output power supply part in this device.

[Explanation of symbols]

1 Handset (voice information input / output section) 2 Microphone (audio information output section) 3 Speaker (audio information output section) 4 Voice interface section 5 Voice coding / decoding unit 6 Camera (image information input section) 7 Document camera (image information input section) 8 Display (image information output) 9 Video interface section 10 Video coding / decoding section 11 Image input / output power supply 12 Data terminal 13 Data interface section 14 Operation unit 15 System control unit (1st to 4th detection means, 1st to 4th operation start means, 1st to 3rd operation stop means, start / stop means, instruction means, 1st and 2nd display means) 16 Multiple separation section 17 Line interface section 19 Image information input power supply 20 Image information output power supply