Method and system for multimedia communication control and recording medium where program thereof is recorded
Abstract
[Task] It is a system that distributes and reproduces video / audio information from a server device to a client device on a communication network, and makes it possible to change the accompanying information for using an external device attached to the video / audio information even during video / audio playback.
Solution.The client device 20 sends an incidental information distribution request to the server device 10 together with the video / audio information distribution request. The server device 10 distributes the requested video / audio information and also distributes the requested incidental information. After that, even after the client 20 starts playing the video / audio, new incidental information is periodically distributed, and the client device 20 acquires the latest incidental information. When the user requests the use of the external device 30, the playback position at that time is collated with the accompanying information, the activation condition of the external device 30 is determined, and the external device 30 is called.

Term
Term ended
Projected expiry passed 22 February 2019, 7.6 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
7 claims: 7 independent, 0 dependent
- 1【特許請求の範囲】 【請求項1】 映像・音声情報を配信するサーバ装置と,該サーバ装置から配信された映像・音声情報を受信し再生するクライアント装置と,前記サーバ装置と前記クライアント装置とを接続する通信ネットワークとからなるシステムにおけるマルチメディア通信制御方法において,前記サーバ装置は,映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報を,配信する映像・音声情報の各部分毎に保持し,前記クライアント装置から付随情報の配信要求を受けると,そのクライアント装置に対して映像・音声情報の再生前に必要な付随情報を配信し,その後,定期的に付随情報を配信し,前記クライアント装置は,前記サーバ装置に対して映像・音声情報の配信要求を送信するとともに,前記サーバ装置に対して付随情報の配信要求を送信し,配信された映像・音声情報の再生前に,前記サーバ装置から必要な付随情報を受信し,さらに定期的に前記サーバ装置から配信される付随情報を受信し,古い付随情報を新しい付随情報に置き換え,外部装置の機能を利用する場合には,配信された最新の付随情報に基づいて外部装置を呼び出すことを特徴とするマルチメディア通信制御方法。
- 2【請求項2】 映像・音声情報を配信するサーバ装置と,該サーバ装置から配信された映像・音声情報を受信し再生するクライアント装置と,前記サーバ装置と前記クライアント装置とを接続する通信ネットワークとからなるシステムにおけるマルチメディア通信制御方法において,前記サーバ装置は,映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報を,配信する映像・音声情報の各部分毎に保持し,前記クライアント装置から付随情報の配信要求を受けると,そのクライアント装置に対して,配信する映像・音声情報の各部分に対応した付随情報を,映像・音声情報の各部分の配信と同期して継続的に行い,前記クライアント装置は,前記サーバ装置に対して映像・音声情報の配信要求を送信するとともに,前記サーバ装置に対して付随情報の配信要求を送信し,配信された映像・音声情報の各部分を継続的に受信し再生するともに,その各部分に対応した付随情報を,その各部分の映像・音声情報の再生前に受信し,外部装置の機能を利用する場合には,再生中の映像・音声情報の部分に対応する付随情報に基づいて外部装置を呼び出すことを特徴とするマルチメディア通信制御方法。
- 3【請求項3】 映像・音声情報を配信するサーバ装置と,該サーバ装置から配信された映像・音声情報を受信し再生するクライアント装置と,前記サーバ装置と前記クライアント装置とを接続する通信ネットワークとからなるシステムにおけるマルチメディア通信制御方法において,前記サーバ装置は,映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報を,配信する映像・音声情報の各部分毎に保持し,前記クライアント装置から映像・音声再生位置情報を指定した付随情報の配信要求を受けると,そのクライアント装置に対して,その映像・音声再生位置情報に対応した付随情報を要求元のクライアント装置へ配信し,前記クライアント装置は,前記サーバ装置に対して映像・音声情報の配信要求を送信し,それにより配信された映像・音声情報を再生し,映像・音声情報の再生中に外部装置の機能を利用するために付随情報が必要になったときに,その時点の映像・音声再生位置情報を伴う付随情報の配信要求を前記サーバ装置へ送信し,前記サーバ装置から付随情報を受信し,受信した付随情報に基づいて外部装置を呼び出すことを特徴とするマルチメディア通信制御方法。
- 4【請求項4】 映像・音声情報を配信するサーバ装置と,該サーバ装置から配信された映像・音声情報を受信し再生するクライアント装置と,前記サーバ装置と前記クライアント装置とを接続する通信ネットワークとからなるシステムにおけるマルチメディア通信制御方法において,前記サーバ装置は,映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報を,配信する映像・音声情報の各部分毎に保持し,前記クライアント装置から付随情報の配信要求を受けると,そのクライアント装置に対して映像・音声情報の再生前に必要な付随情報を配信し,その後,付随情報に変更が加えられたかどうかを監視し,付随情報の変更を検出した場合に変更の生じた付随情報を前記クライアント装置に配信し,前記クライアント装置は,前記サーバ装置に対して映像・音声情報の配信要求を送信するとともに,前記サーバ装置に対して付随情報の配信要求を送信し,配信された映像・音声情報の再生前に,前記サーバ装置から必要な付随情報を受信し,変更の生じた付随情報が前記サーバ装置から配信されたときには古い付随情報を新しい付随情報に置き換え,外部装置の機能を利用する場合に配信された最新の付随情報に基づいて外部装置を呼び出すことを特徴とするマルチメディア通信制御方法。
- 5【請求項5】 映像・音声情報を配信するサーバ装置と,該サーバ装置から配信された映像・音声情報を受信し再生するクライアント装置と,前記サーバ装置と前記クライアント装置とを接続する通信ネットワークとからなるマルチメディア通信制御システムにおいて,前記サーバ装置は,映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報を,配信する映像・音声情報の各部分毎に保持する手段と,前記クライアント装置から映像・音声情報の配信要求を受けて,映像・音声情報を一括して,または各部分ごとに継続して配信する手段と,前記クライアント装置から付随情報の配信要求を受信する手段と,前記クライアント装置からの付随情報の配信要求に対して,前記クライアント装置における映像・音声情報の再生前もしくはその各部分の再生前に,少なくとも必要となる最新の付随情報を配信する,または前記クライアント装置からの映像・音声再生位置情報を指定した付随情報の配信要求に対して,その映像・音声再生位置情報に対応した付随情報を配信する手段とを備え,前記クライアント装置は,前記サーバ装置に対して映像・音声情報の配信要求を送信し,配信された映像・音声情報を再生する手段と,配信された映像・音声情報の再生前もしくはその各部分の再生前に,前記サーバ装置に対し付随情報の配信要求を送信する,または配信された映像・音声情報を再生中に付随情報が必要になったときに,前記サーバ装置に対し映像・音声再生位置情報を伴う付随情報の配信要求を送信する手段と,外部装置の機能を利用する場合に,前記サーバ装置から配信された最新の付随情報に基づいて外部装置を呼び出す外部装置制御手段とを備えることを特徴とするマルチメディア通信制御システム。
- 6【請求項6】 映像・音声情報を,通信ネットワークを経由してクライアント装置に配信するマルチメディア通信制御システムにおけるサーバ装置が実行するプログラムを記録した記録媒体であって,配信する映像・音声情報の各部分毎に蓄積された映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報を管理し,前記クライアント装置からの付随情報の配信要求時に読み出す処理と,前記クライアント装置から映像・音声情報の配信要求を受けて,映像・音声情報を一括して,または各部分ごとに継続して配信する処理と,前記クライアント装置から付随情報の配信要求を受信する処理と,前記クライアント装置からの付随情報の配信要求に対して,前記クライアント装置における映像・音声情報の再生前もしくはその各部分の再生前に,少なくとも必要となる最新の付随情報を配信する,または前記クライアント装置からの映像・音声再生位置情報を指定した付随情報の配信要求に対して,その映像・音声再生位置情報に対応した付随情報を配信する処理とを,計算機に実行させるプログラム記録したことを特徴とするマルチメディア通信制御システムにおけるサーバ装置のプログラムを記録した記録媒体。
- 7【請求項7】 映像・音声情報を配信するサーバ装置から通信ネットワークを経由して配信された映像・音声情報を受信し再生するマルチメディア通信制御システムにおけるクライアント装置が実行するプログラムを記録した記録媒体であって,前記サーバ装置に対して映像・音声情報の配信要求を送信し,配信された映像・音声情報を再生する処理と,配信された映像・音声情報の再生前もしくはその各部分の再生前に,前記サーバ装置が映像・音声情報の各部分毎に保持する映像・音声情報に付随する情報であって,外部装置の機能を利用することにより映像・音声情報の内容を補完するための外部装置を利用する方法に関する情報を含む付随情報についての配信要求を前記サーバ装置に対し送信する,または配信された映像・音声情報を再生中に付随情報が必要になったときに,前記サーバ装置に対し映像・音声再生位置情報を伴う付随情報の配信要求を送信する処理と,外部装置の機能を利用する場合に,前記サーバ装置から配信された最新の付随情報に基づいて外部装置を呼び出す処理とを計算機に実行させるプログラム記録したことを特徴とするマルチメディア通信制御システムにおけるクライアント装置のプログラムを記録した記録媒体。
Independent claims7
181 paragraphs in 1 section, as filed
Description: TECHNICAL FIELD [Detailed description of the invention]
【0001】
[Technical field to which the invention belongs]
The present invention relates to a multimedia communication control method and its system for distributing and reproducing video / audio information on a communication network.
【0002】
[Conventional technology]
Currently, in technology that handles the distribution or playback of video / audio information on a network, for the video / audio to be distributed / played, the setting of link anchors between multiple video / audio and the start of video / audio playback There are ways to specify changes in anchor settings over time and how to use the functions of other programs and devices.
【0003】
The method includes a method represented by SMIL of the WWW Consortium (W3C) standard that controls multiple videos and audios in video and audio distribution playback technology on the network, and multiple videos in HTML displayed by a WWW browser. -There are control methods using program languages such as JavaScript and CGI (Common Gateway Interface) that control voice.
【0004】
In the above method, in the storage method and distribution method of information accompanying video / audio information (hereinafter referred to as incidental information) such as a method of setting a hyperlink for video / audio to be distributed / played and a method of using other devices. To show the processing method, there is no difference between the processing method of the specified information of the video / audio to be distributed / reproduced and the processing method of the accompanying information.
【0005】
For example, in SMIL, the designated information of video / audio to be distributed / played and the accompanying information are described in the same place. In JavaScript and CGI, as the database referenced by the program, the designated information of the video / audio to be distributed / played and the accompanying information are described as the same information in the same program.
【0006】
[Problems to be Solved by the Invention]
In the method of reproducing the video / audio information and the method of handling the accompanying information as described above, the anchor information of the link in the client device is used during the reproduction of the video / audio, especially when the live broadcast or the radio broadcast is broadcast on the network. Could not make changes.
【0007】
For example, in SMIL, the client device acquires information about all incidental information from the server device at the start of video playback. Therefore, when the accompanying information is changed after the start of playback, the changed content cannot be notified to the client device that has already acquired the accompanying information from the server device and is playing back the video / audio.
【0008】
In JavaScript, since the WWW browser acquires the contents of all incidental information when the HTML information is acquired, it was not possible to notify the client device of the changed contents of the incidental information for the same reason.
【0009】
In addition, when using CGI, it was possible to notify the client device of the change in accompanying information by specifying the CGI program as the link destination in the display content of the WWW browser, but it was attached from the server device. The timing of sending the change of information and the timing of the client device playing the video / audio were not synchronized.
【0010】
The present invention solves the problem that the accompanying information cannot be changed during the reproduction of the video / audio, which has occurred when the video / audio information is distributed on the communication network by using the conventional technology, and the video / audio is solved. The purpose is to notify the client device of the change of the accompanying information even during the playback of the video / audio, and to synchronize the playback of the video / audio and the change of the accompanying information.
【0011】
[Means for solving problems]
In order to achieve the above object, the present invention is a video / audio distribution method in which video / audio information is distributed from a server device to a client device on a communication network and reproduced, and incidental information is provided separately from the video / audio information. The feature is that the information can be distributed and received, and the accompanying information can be distributed and the change notification can be sent between the server device and the client device even during the playback of video and audio.
【0012】
In order to enable distribution and change of accompanying information between the server device and the client device even during video and audio playback as described above, for example, the server device and the client are provided with means having the following functions. Provided in the device.
【0013】
The server device holds incidental information that accompanies the video / audio information and includes information on how to supplement the content of the video / audio information by using the function of the external device for each part of the video / audio. Ancillary information storage means to store, ancillary information distribution request receiving means to receive ancillary information distribution request from a client device, ancillary information distribution means to distribute ancillary information, management of accumulated ancillary information and management of ancillary information distribution Ancillary information distribution control means for performing the above is provided.
【0014】
In addition, the client device acquires the accompanying information distribution request transmitting means that requests the server device to distribute the accompanying information based on the user's request, and the playback position of the video / audio when the accompanying information distribution request is transmitted. The video / audio reproduction position extraction means, the incidental information receiving means for receiving the incidental information delivered from the server device, and the received incidental information are decoded, and the corresponding video / audio reproduction position of the incidental information is actually reproduced. It is used from the incidental information control means that synchronizes with the playback video / audio position, the incidental information display means that displays the received incidental information, the input of the distribution request from the user of the incidental information, and the incidental information display means. An incidental information operating means for selecting an external device and an external device controlling means for activating the external device based on an input from the incidental information operating means are provided.
【0015】
The action of the present invention is as follows. In the server device and the client device having the above-mentioned means, the accompanying information distribution request transmitting means of the client device and the accompanying information distribution request receiving means of the server device distribute the accompanying information independently of the video / audio information distribution request. The request is being sent from the client device to the server device. In the server device, the incidental information storage means, the incidental information distribution control means, and the incidental information distribution means perform the incidental information distribution processing, so that the incidental information is distributed independently of the video / audio information distribution processing. There is.
【0016】
On the other hand, in the client device, by providing the accompanying information receiving means and the accompanying information control means, the receiving processing of the accompanying information is performed independently of the receiving processing of the video / audio information, and the accompanying information display means and the accompanying information are also provided. By providing information manipulation means and external device control means, the external device is used independently of the reproduction of video and audio.
【0017】
Therefore, in the present invention, it is possible to distribute or receive incidental information independently of the processing of distribution or reproduction of video / audio information, and the server device and client device are distributing or reproducing the video / audio information. Also, it is possible to notify the client device of the change of the accompanying information, and it is possible to synchronize the reproduction of the video / audio and the change of the accompanying information in the client device.
【0018】
The program for realizing each of the processing means of the server device and the client device by the computer can be stored in an appropriate recording medium such as a portable medium memory, a semiconductor memory, or a hard disk that can be read by the computer.
【0019】
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a configuration example of a server device according to the present invention, and FIG. 2 is a diagram showing a configuration example of a client device according to the present invention. The server device 10 and the client device 20 are connected via the communication network 100. Generally, a plurality of client devices 20 are connected to the communication network 100.
【0020】
As shown in FIG. 1, the server device 10 includes a video / audio information storage means 101 for storing video / audio information, a video / audio information distribution control means 102 for controlling the distribution of video / audio information, and a client device 20. Video / audio information distribution request receiving means 103 that receives the video / audio information distribution request from, video / audio information distribution means 104 that distributes the accumulated video / audio information, and an external device attached to the video / audio information. Accidental information including information on how to use the external device 30 to supplement the contents of video / audio information by using the functions of 30 (not shown) is accumulated and retained for each part of the video / audio information. The incidental information storage means 111, the incidental information distribution control means 112 that manages the accumulated incidental information and the distribution of the incidental information, and the incidental information distribution request receiving means 113 that receives the incidental information distribution request from the client device 20. And ancillary information distribution means 114 for distributing ancillary information. Instead of the video / audio information storage means 101, or in addition to the video / audio information storage means 101, a video / audio information input means from a camera or the like can be used.
【0021】
Here, the use of the function of the external device 30 is not necessarily limited to the one described below, but for example, during the reproduction of a certain video / audio, a specific call destination related to the part being reproduced is used. You can use your Internet phone, access a specific homepage with a WWW browser, or access a specific FTP (File Transfer Protocol) server to transfer or acquire a file.
【0022】
As shown in FIG. 2, the client device 20 distributes the reproduced video / audio output means 201 that outputs the reproduced video / audio, the video / audio information operating means 202 that operates the distributed video / audio information, and the distribution. Reproduction control means 203 that controls the reproduction of the transmitted video / audio information, video / audio information distribution request transmission means 204 that transmits the video / audio information distribution request to the server device 10, and reception of the distributed video / audio information. Video / audio information receiving means 205 to be used, video / audio reproduction position extraction means 206 to acquire the video / audio reproduction position when the user issues an accompanying information acquisition request during video / audio reproduction, and the user. The incidental information operation means 211 that inputs the distribution request of the incidental information and selects the external device 30 to be used from the incidental information display means 212, the incidental information display means 212 that displays the received incidental information, and the received incidental information are decoded. Then, the incidental information control means 213 that synchronizes the corresponding video / audio reproduction position of the incidental information with the video / audio reproduction position actually reproduced by the reproduction control means 203, and the incidental information based on the user's request. Ancillary information distribution request transmission means 214 that requests distribution to the server device 10, ancillary information receiving means 215 that receives the ancillary information distributed from the server device 10, and an external device 30 based on the input from the ancillary information operation means 211. It is provided with an external device control means 216 for activating.
【0023】
For example, as incidental information attached to the video / audio information part being played, (a) call destination information when using an Internet telephone for an external device, (b) connection destination information when using a WWW browser for an external device. , (c) When the connection destination information when using the FTP server is set in the external device, when the incidental information operation means 211 inputs the usage request of the incidental information from the user, the incidental information display means 212 is attached. The notification from the information manipulation means 211 indicates that there are (a) Internet telephone, (b) WWW browser, and (c) FTP server as available external devices based on the accompanying information at that time. When the user selects an external device by the incidental information manipulation means 211, the external device control means 216 is notified of the incidental information at that time and the user's selection information, and the external device control means 216 is notified of the notified incidental information. Calls the user-selected external device 30 based on.
【0024】
For example, the following (1) to (3) can be implemented as means for distributing video / audio information in the server device 10 and the client device 20.
【0025】
(1) The video / audio information distribution request transmitting means 204 of the client device 20 transmits a video / audio information distribution request to the server device 10. The video / audio information distribution means 104 of the server device 10 distributes all the video / audio information to the client device 20 before the playback control means 203 of the client device 20 starts reproducing the video / audio.
【0026】
(2) The video / audio information distribution request transmitting means 204 of the client device 20 transmits a video / audio information distribution request to the server device 10. When the server device 10 starts the distribution of the video / audio information, the reproduction control means 203 starts the reproduction of the video / audio at the same time when the client device 20 receives a part of the video / audio information.
【0027】
(3) The video / audio information distribution request transmitting means 204 of the client device 20 transmits a video / audio information distribution request to the server device 10. The video / audio information distribution means 104 of the server device 10 simultaneously distributes the same video / audio information to the single or multiple client devices 20 that have issued the video / audio information distribution request to the server device 10.
【0028】
Further, as a means for distributing incidental information in the server device 10 and the client device 20, for example, the following (1) to (5) can be implemented.
【0029】
(1) The accompanying information distribution request transmitting means 214 of the client device 20 transmits an accompanying information distribution request to the server device 10 at the start of playback of the video / audio information. When the incidental information distribution control means 112 and the incidental information distribution means 114 of the server device 10 receive the incidental information distribution request, the incidental information necessary information to the client device 20 is sent to the client device 20 before the start of playback of the video / audio of the client device 20. To deliver.
【0030】
(2) The incidental information distribution control means 112 and the incidental information distribution means 114 of the server device 10 continue to distribute the incidental information at regular intervals. Further, the incidental information control means 213 of the client device 20 compares the incidental information distributed at regular intervals with the incidental information acquired at the time of transmitting the video / audio distribution information request, and changes the incidental information when they are different. ..
【0031】
(3) Ancillary information distribution request transmission means 214 of the client device 20 issues an ancillary information distribution request to the server device 10 at the start of playback of video / audio information. When the incidental information distribution control means 112 and the incidental information distribution means 114 of the server device 10 receive the incidental information distribution request, the incidental information distribution means and the incidental information distribution are synchronized with each other and correspond to each part of the video. The attached information is distributed to the client device 20.
【0032】
(4) The video / audio reproduction position extraction means 206 of the client device 20 acquires the video / audio reproduction position information when the user issues a request for acquisition of the accompanying information during the reproduction of the video / audio information. Further, the accompanying information distribution request transmitting means 214 transmits a distribution request of the accompanying information accompanied by the acquired video / audio reproduction position information to the server device 10. Upon receiving this distribution request, the incidental information distribution means 114 of the server device 10 distributes the incidental information corresponding to the received video / audio reproduction position.
【0033】
(5) When the incidental information of the server device 10 is changed, the incidental information distribution control means 112 recognizes that the change has occurred, and distributes the incidental information with the change to the incidental information distribution means 114. Instruct. The incidental information distribution means 114 distributes the incidental information in which the change occurs to the client device 20 when the incidental information distribution control means 112 notifies the change of the incidental information.
【0034】
According to each of these means, in the present invention, in addition to the video / audio distribution / playback function in which the server device 10 distributes the video / audio information and the client device 20 reproduces the video / audio, the client device 20 is the server device 10. It has an incidental information distribution function in which the server device 10 that receives the distribution request distributes the incidental information and a client device 20 has an external device activation function that calls the external device 30 based on the incidental information. .. The processing flow in each embodiment will be described below.
【0035】
[First Embodiment] FIG. 3 is a diagram for explaining the flow of processing in the first embodiment. The processing flow shown in FIG. 3 is that when a video / audio information distribution request is transmitted from the client device 20 to the server device 10 between the server device 10 and the client device 20, the client device 20 reproduces the video / audio. Before starting, all the information of the video information and the accompanying information is distributed from the server device 10 to the client device 20, and the accompanying information is periodically distributed from the server device 10 to the client device 20 to be used as the accompanying information. This is when the incidental information is used in the method of changing the incidental information when a change occurs.
【0036】
When the video / audio information distribution request signal and the accompanying information distribution request signal are transmitted from the video / audio information distribution request transmission means 204 of the client device 20 to the server device 10, each signal is transmitted to the video / audio information of the server device 10. It is received by the delivery request receiving means 103 and the accompanying information delivery request receiving means 113 (S101, S102). When the server device 10 receives the video / audio information distribution request signal, it distributes all the necessary information of the requested video / audio information from the video / audio information distribution means 104 to the client device 20 (S103). At that time, all the information of the incidental information accompanying the video / audio information to be distributed is also simultaneously distributed from the incidental information distribution means 114 to the client device 20 (S104).
【0037】
The client device 20 receives all the video / audio information and all incidental information by the video / audio information receiving means 205 and the incidental information receiving means 215, respectively, and starts reproducing the video / audio (S105). However, if the requested video / audio information or accompanying information is not delivered, the client device 20 sends a video / audio information delivery request transmission to the server device 10 to retransmit the video / audio information and the accompanying information, respectively. Means 204, Request for distribution of incidental information Transmission is transmitted from the transmission means 214, and the server device 10 is requested to distribute video / audio information or incidental information again.
【0038】
The server device 10 distributes incidental information from the incidental information distribution means 114 to the client device 20 at regular intervals. Each time the incidental information receiving means 215 receives the incidental information, the incidental information control means 213 of the client device 20 compares the incidental information acquired at the time of requesting the distribution of video / audio information with the newly received incidental information, and performs the video. -If the incidental information acquired at the time of requesting voice information distribution and the newly received incidental information are different, the retained incidental information is replaced with the newly received incidental information (S106).
【0039】
When the user confirms the reproduced video / audio and uses the function of the external device 30, the user inputs a request for using the function of the external device 30 from the incidental information manipulation means 211 to the client device 20 (S107). When a request for using the function of the external device 30 is input, the reproduction control means 203 pauses the reproduction of the video / audio and passes the reproduction stop position information to the video / audio reproduction position extraction means 206 (S108, S109). At the same time, the playback stop position information is also passed to the accompanying information control means 213.
【0040】
When the playback stop position information is received, the incidental information control means 213 refers to the incidental information received from the server device 10 and compares it with the playback stop position information to perform the action to be executed by the external device 30 (hereinafter, the external information activation). (Referred to as a condition) is determined (S110).
【0041】
When the external information activation condition is determined, the accompanying information control means 213 passes the external information activation condition to the external device control means 216. When the external device control means 216 receives the external information activation condition, the external device control means 216 activates the external device 30 based on the external information activation condition.
【0042】
For example, taking the accompanying information as shown in Fig. 4 as an example, when recognizing each part of video and audio by the elapsed time from the start of playback, if the elapsed time is Lt (0 <Lt <L1), then Location Judging from the specific information, information [0] 401 is valid. At this time, if the user has selected the WWW browser as the external device 30, the WWW browser has "Browser [0] = http: //www.**" written in information [0] 401 of the accompanying information. Open the URL of http: // www. ********* according to the "*********" parameter (S111).
【0043】
When the external information activation condition is determined, the accompanying information control means 213 passes the external information activation condition to the external device control means 216. Upon receiving the external information activation condition, the external device control means 216 activates the external device 30 based on the external information activation condition (S112).
【0044】
When the user stops using the external device 30, the external device control means 216 detects the end signal of the external device 30 (S113). When the external device control means 216 detects the end signal of the external device 30, it issues a playback restart request to the playback control means 203. Upon receiving the reproduction restart request, the reproduction control means 203 acquires the reproduction stop position information from the video / audio reproduction position extraction means 206, and resumes the reproduction from the reproduction stop position (S114).
【0045】
As described above, in the present embodiment, the client device 20 periodically receives incidental information. As a result, when the incidental information is changed, the client device 20 acquires the changed incidental information from the server device 10, and the video / audio reproduction in the client device 20 can be synchronized with the changed incidental information. It becomes.
【0046】
[Second Embodiment] FIG. 5 is a diagram for explaining the flow of processing in the second embodiment. The processing flow shown in FIG. 5 shows the video information to be distributed from the server device 10 when the client device 20 sends a video / audio information distribution request to the server device 10 between the server device 10 and the client device 20. This is when the accompanying information is used when the client device 20 receives the accompanying information and starts reproducing the video / audio at the same time.
【0047】
When the video / audio information distribution request signal and the accompanying information distribution request signal are transmitted from the video / audio information distribution request transmitting means 204 of the client device 20 to the server device 10, these signals are transmitted to the video / audio information distribution request signal of the server device 10, respectively. It is received by the voice information distribution request receiving means 103 and the accompanying information delivery request receiving means 113 (S201, S202). When the server device 10 receives the video / audio information distribution request signal, the server device 10 continuously distributes the requested video / audio information from the video / audio information distribution means 104 to the client device 20 (S203). At that time, the incidental information accompanying the video / audio information to be distributed is also continuously distributed from the incidental information distribution means 114 to the client device 20 (S204).
【0048】
When the client device 20 receives the video / audio information and the accompanying information by the video / audio information receiving means 205 and the accompanying information receiving means 215, respectively, the client device 20 starts reproducing the video / audio at the same time as the reception (S205). However, it is confirmed whether or not the information sent on the communication network 100 is lost, and if the information loss is found, the client device 20 sends a video / audio request for resending the lost information to the server device 10. Each of the information and the accompanying information is transmitted from the video / audio information distribution request transmitting means 204 and the accompanying information distribution request transmitting means 214.
【0049】
In addition, it is necessary to synchronize the delivered video / audio information with the accompanying information before playing the video / audio. Therefore, it is necessary to acquire the video / audio information and the accompanying information in advance when the video / audio is reproduced, and the video / audio information and the accompanying information are acquired prior to the reproduction of the video / audio. For example, if it takes 3 seconds to process the information retransmission request, synchronize the video / audio information, and the accompanying information, the client device 20 displays the video / audio information and the accompanying information for at least 3 seconds. Acquire before playing.
【0050】
When the user confirms the reproduced video / audio and uses the function of the external device 30, the user inputs a request for using the function of the external device 30 from the incidental information manipulation means 211 to the client device 20 (S206). When the request for using the function of the external device 30 is input, the reproduction control means 203 passes the reproduction position information at the time when the request for using the function of the external device 30 is input to the incidental information control means 213 (S207, S208). ..
【0051】
Upon receiving the reproduction position information, the incidental information control means 213 refers to the incidental information received from the server device 10 and compares it with the reproduction position information to determine the external information activation condition (S209).
【0052】
Taking the accompanying information shown in Fig. 4 as an example, when recognizing each part of video and audio by the elapsed time from the start of playback, if the elapsed time is Lt (0 <Lt <L1), information [0] 401 will be displayed. validate. At this time, if the user has selected the WWW browser as the external device 30, the WWW browser has "Browser [0] = http: //www.**" written in information [0] 401 of the accompanying information. Open the URL of http: // www. ********* according to the "*********" parameter (S210).
【0053】
When the external information activation condition is determined, the accompanying information control means 213 passes the external information activation condition to the external device control means 216. Upon receiving the external information activation condition, the external device control means 216 activates the external device 30 based on the external information activation condition (S211).
【0054】
When the user stops using the external device 30, the external device control means 216 detects the end signal of the external device 30 and confirms that the external device 30 has ended (S212).
【0055】
As described above, in the present embodiment, the client device 20 continuously receives incidental information. As a result, when the incidental information is changed, the client device 20 always acquires the changed incidental information from the server device 10, and the video / audio reproduction in the client device 20 is synchronized with the changed incidental information. It will be possible.
【0056】
[Third Embodiment] FIG. 6 is a diagram for explaining the flow of processing in the third embodiment. The processing flow shown in FIG. 6 is that when a video / audio information distribution request is transmitted from the client device 20 to the server device 10 between the server device 10 and the client device 20, the client device 20 reproduces the video / audio. All information of the video information is distributed from the server device 10 to the client device 20 before the start of the operation, and the accompanying information is distributed to the server device 10 only when the user inputs a request for using the function of the external device 30. This is when the accompanying information is used in the method of transmitting the request and delivering it to the client device 20.
【0057】
When the video / audio information distribution request signal is transmitted from the video / audio information distribution request transmitting means 204 of the client device 20 to the server device 10, the video / audio information distribution request receiving means 103 of the server device 10 transmits the video / audio information. Receive the delivery request signal (S301). When the server device 10 receives the video / audio information distribution request signal, the server device 10 distributes the requested video / audio information information from the video / audio information distribution means 104 to the client device 20 (S302).
【0058】
When all the video / audio information is received by the video / audio information receiving means 205, the client device 20 starts playing the video / audio (S303). However, if the requested video / audio information is not delivered, the client device 20 sends a video / audio information distribution request transmission means 204, respectively, to the server device 10 to request resending of the video / audio information and accompanying information. Ancillary information distribution request It is transmitted from the transmitting means 214, and the server device 10 is requested to distribute the video / audio information or the incidental information again.
【0059】
When the user confirms the reproduced video / audio and uses the function of the external device 30, the user inputs a request for using the function of the external device 30 from the incidental information manipulation means 211 to the client device 20 (S304). When the usage request for the function of the external device 30 is input, the reproduction control means 203 passes the video / audio reproduction position information at the time when the usage request for the function of the external device 30 is input to the accompanying information control means 213 (S305). , S306).
【0060】
Upon receiving the reproduction position information, the incidental information control means 213 transmits the video / audio reproduction position information to the server device 10, and also transmits a distribution request for the incidental information from the incidental information distribution request transmission means 214 (S307). ). When the video / audio reproduction position information and the incidental information distribution request are received by the incidental information distribution request receiving means 113, the server device 10 determines the incidental information to be distributed to the client device 20 based on the video / audio reproduction position information. , The accompanying information is delivered from the accompanying information delivery means 114 (S308). However, if the requested accompanying information is not delivered, the client device 20 sends a request for resending the accompanying information to the server device 10 from the accompanying information delivery request transmitting means 214, and again to the server device 10. Request the delivery of accompanying information.
【0061】
When the incidental information is received by the incidental information receiving means 215, the external information activation condition is determined based on the incidental information (S309). When the external device start condition is determined, the accompanying information control means 213 passes the external information start condition to the external device control means 216. Upon receiving the external information activation condition, the external device control means 216 activates the external device 30 based on the external information activation condition.
【0062】
Taking the accompanying information shown in Fig. 4 as an example, when recognizing each part of video and audio by the elapsed time from the start of playback, if the elapsed time is Lt (0 <Lt <L1), information [0] 401 will be displayed. validate. At this time, if the user has selected the WWW browser as the external device, the WWW browser has "Browser [0] = http: // www. ***" written in information [0] 401 of the accompanying information. Open the URL of http: // www. ********* according to the "******" parameter (S310).
【0063】
When the external information activation condition is determined, the accompanying information control means 213 passes the external information activation condition to the external device control means 216. Upon receiving the external information activation condition, the external device control means 216 activates the external device 30 based on the external information activation condition (S311).
【0064】
When the user stops using the external device 30, the external device control means 216 detects the end signal of the external device 30 and confirms that the external device 30 has ended (S312).
【0065】
As described above, in the present embodiment, the client device 20 does not hold the accompanying information in advance, but the server device 10 is requested to deliver the accompanying information in response to the request from the user to acquire the accompanying information. .. As a result, when the incidental information is changed, the client device 20 acquires the changed incidental information possessed by the server device 10, and the video / audio reproduction in the client device 20 is synchronized with the changed incidental information. It will be possible.
【0066】
[Fourth Embodiment] FIG. 7 is a diagram for explaining the flow of processing in the fourth embodiment. The processing flow shown in FIG. 7 is that when a video / audio information distribution request is transmitted from the client device 20 to the server device 10 between the server device 10 and the client device 20, the video information to be distributed from the server device 10 is transmitted. Upon receiving, the client device 20 starts playing video / audio, and as for the accompanying information, all the necessary information is acquired from the server device 10 before the client device 20 starts playing video / audio, and the accompanying information is changed. When it occurs, the change information is used when the server device 10 distributes the change information to the client device 20.
【0067】
When the video / audio information distribution request signal and the accompanying information distribution request signal are transmitted from the video / audio information distribution request transmitting means 204 of the client device 20 to the server device 10, the video / audio information distribution request of the server device 10 is requested, respectively. It is received by the receiving means 103 and the accompanying information delivery request receiving means 113 (S401, S402). When the server device 10 receives the video / audio information distribution request signal, the server device 10 distributes the requested video / audio information from the video / audio information distribution means 104 to the client device 20. At that time, all the information of the incidental information accompanying the video / audio information to be distributed is also simultaneously distributed from the incidental information distribution means 114 to the client device 20 (S403, S404).
【0068】
When the video / audio information is received by the video / audio information receiving means 205, the client device 20 starts playing the video / audio (S405). However, it is confirmed whether or not the information sent on the communication network 100 is lost, and if the information loss is found, the client device 20 sends a video / audio request for resending the lost information to the server device 10. Information and incidental information are transmitted from the video / audio information distribution request transmission means 204 and the incidental information distribution request transmission means 214, respectively.
【0069】
In addition, it is necessary to synchronize the delivered video / audio information with the accompanying information before playing the video / audio. Therefore, the video / audio information and the accompanying information must be acquired in advance when the video / audio is reproduced, and the video / audio information and the accompanying information are acquired prior to the reproduction of the video / audio. For example, if it takes 3 seconds to process the information retransmission request, synchronize the video / audio information, and the accompanying information, the client device 20 displays the video / audio information and the accompanying information for at least 3 seconds. Acquire before playing.
【0070】
When the server device 10 detects a change in the incidental information stored in the incidental information storage means 111 by the incidental information distribution control means 112, the server device 10 distributes the changed incidental information to the client device 20 from the incidental information distribution means 114. .. When the client device 20 receives the changed incidental information by the incidental information receiving means 215, the client device 20 compares the incidental information acquired at the time of the video / audio information distribution request with the newly received incidental information, and requests the video / audio information distribution. When the incidental information acquired at that time and the newly received incidental information are different, the retained incidental information is replaced with the newly received incidental information (S406).
【0071】
When the user confirms the reproduced video / audio and uses the function of the external device, the user inputs a request for using the function of the external device 30 from the incidental information manipulation means 211 to the client device 20 (S407).
【0072】
When the usage request for the function of the external device 30 is input, the playback control means 203 passes the video / audio playback position information at the time when the usage request for the function of the external device 30 is input to the incidental information control means 213 ( S408, S409).
【0073】
Upon receiving the reproduction position information, the incidental information control means 213 refers to the incidental information received from the server device 10 and compares it with the reproduction position information to determine the external information activation condition (S410).
【0074】
Taking the accompanying information shown in Fig. 4 as an example, when recognizing each part of video and audio by the elapsed time from the start of playback, if the elapsed time is Lt (0 <Lt <L1), information [0] 401 will be displayed. validate. At this time, if the user has selected the WWW browser as the external device 30, the WWW browser has "Browser [0] = http: //www.**" written in information [0] 401 of the accompanying information. Open the URL of http: // www. ********* according to the "*********" parameter (S411).
【0075】
When the external information activation condition is determined, the accompanying information control means 213 passes the external information activation condition to the external device control means 216. Upon receiving the external information activation condition, the external device control means 216 activates the external device 30 based on the external information activation condition (S412).
【0076】
When the user stops using the external device 30, the external device control means 216 detects the end signal of the external device 30 and confirms that the external device 30 has ended (S413).
【0077】
As described above, in the present embodiment, the client device 20 receives the new incidental information changed when the incidental information is changed. As a result, when the incidental information is changed, the client device 20 acquires the changed incidental information from the server device 10, and the video / audio reproduction in the client device 20 is synchronized with the changed incidental information. It will be possible.
【0078】
In the above description, it goes without saying that the video / audio may be either video or audio, or both. Further, in the description of the above-described embodiment, an example of distributing the video / audio information accumulated in advance has been described, but the video / audio information having a time constraint from the information input to the distribution, such as a live broadcast, is described. In the case of distribution, the present invention can be applied in the same manner.
【0079】
[Effect of the invention]
As described above, by using the present invention, when the video / audio is distributed on the communication network, the distribution processing of the accompanying information can be performed independently of the distribution or reproduction processing of the video / audio information. Therefore, even if the accompanying information is changed during video / audio playback, the change information of the accompanying information can be distributed from the server device to the client device.
[Simple explanation of drawings]
[Figure 1]
It is a figure which shows the configuration example of a server apparatus.
[Figure 2]
It is a figure which shows the configuration example of a client apparatus.
[Fig. 3]
It is a figure for demonstrating the flow of processing in 1st Embodiment.
[Fig. 4]
It is a figure which shows the example of the accompanying information.
[Fig. 5]
It is a figure for demonstrating the flow of processing in 2nd Embodiment.
[Fig. 6]
It is a figure for demonstrating the flow of processing in 3rd Embodiment.
[Fig. 7]
It is a figure for demonstrating the flow of processing in 4th Embodiment.
[Explanation of symbols]
10 Server device 101 Video / audio information storage means 102 Video / audio information distribution control means 103 Video / audio information distribution request receiving means 104 Video / audio information distribution means 111 Ancillary information storage means 112 Ancillary information distribution control means 113 Ancillary information distribution request receiving means 114 Ancillary information distribution means 20 Client device 201 Playback video / audio output means 202 Video / audio information manipulation means 203 Playback control means 204 Video / audio information distribution request transmission means 205 Video / audio information receiving means 206 Video / audio playback position extraction means 211 Ancillary information manipulation means 212 Ancillary information display means 213 Ancillary information control means 214 Ancillary information distribution request transmission means 215 Ancillary information receiving means 216 External device control means 100 communication networks
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| JP2008539627A | Cited by | Japan | Examiner |
| US8565267B2 | Cited by | United States of America | Applicant |
| US7254409B2 | Cited by | United States of America | Applicant |
| JP2002259434A | Cited by | Japan | Search report |
| JPH06209474A | Cites | Japan | Search report |
| JPH08205121A | Cites | Japan | Search report |
| JPH09271011A | Cites | Japan | Search report |
| JPH09327011A | Cites | Japan | Search report |
| JPH10164545A | Cites | Japan | Search report |
| JPH10174007A | Cites | Japan | Search report |
| JPH10257469A | Cites | Japan | Search report |
| JPH1070712A | Cites | Japan | Search report |
| JPH1079931A | Cites | Japan | Search report |
| JPH1093946A | Cites | Japan | Search report |
2 members in 1 office
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 4247799 | Japan | A | |
| JP19990042477 | – | – | – |
Members2
| Document | Office | Kind | |
|---|---|---|---|
| JP2000244889AThis record | Japan | A | |
| JP3544486B2 | Japan | B2 |
16 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of completion of termEXPY | EXPY | |
| Written notification of registration of transferJAPANESE INTERMEDIATE CODE: R350R350 | R350 | |
| Written request for registration of change of domicileJAPANESE INTERMEDIATE CODE: R313531S531 | S531 | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Notification of acceptance of power of attorneyJAPANESE INTERMEDIATE CODE: R3D02RD02 | RD02 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD |
Numbers
- Publication
- 2000-244889
- Publication, DOCDB
- 2000244889
- Publication, EPODOC
- JP2000244889
- Application
- 11042477
- Application, DOCDB
- 4247799
- Application, EPODOC
- JP19990042477
Titles2
- Japanese
- マルチメディア通信制御方法,そのシステムおよびそのプログラムを記録した記録媒体
- English
- PROBLEM TO BE SOLVED: To record a multimedia communication control method, a system thereof, and a program thereof.
Classification
- IPC, 7
- G06F13 00
- H04N7 16
- H04N7 173
- H04N21 235
- H04N21 238
- H04N21 435
- H04N21 4722