Hierarchical coding video distribution system

Description: TECHNICAL FIELD [Detailed description of the invention]

【0001】

[Technical field to which the invention belongs]

The present invention relates to an efficient moving image distribution system according to the capability of a receiving user terminal and the speed of a communication line in an IP network such as the Internet, an intranet, and a mobile communication packet.

【0002】

[Conventional technology]

Conventionally, a video distribution system using IP multicast has a range of use on the Internet or an intranet because it can reduce the load on the sending server or the amount of data on the network as compared with the video distribution system using IP unicast. It is spreading.

【0003】

However, in a video distribution system using simple IP multicast, it is not possible to individually respond according to the capacity and line speed of the receiving user terminal. Therefore, the server side improves the image quality of the original video stream with one video stream containing the minimum data required for video playback so that appropriate information can be received for each receiving terminal. By dividing into multiple video streams containing the data for each video stream and transmitting each video stream on a separate multicast channel, and by requesting only the required multicast channel from the receiving user terminal from the relay router, each video stream is used. A hierarchical video distribution system capable of receiving a multicast channel according to a receiving user terminal, synthesizing and displaying a video stream on the multicast channel has been proposed and put into practical use. References include S.Sakazawa, Y.Takishima, M.Wada and K.Amano, Bandwidth-Adaptive VideoTransmission Method for Heterogeneous Network Environment, Proceedings of International Workshop on New Video Media Technology, pp.49-54 (1997) Shigeyuki Sakazawa, Yasuhiro Takishima, Masahiro Wada: Coded Transmission Control Method in Video Multicast, Journal of Video Information Media Society, Vol.52, No. There are 6, pp.863-870 (1998).

【0004】

[Problems to be Solved by the Invention]

However, in the system having the above-described configuration, the transmitted video stream is hierarchically separated and transmitted on a plurality of multicast channels, and the video stream from the multicast channel registered according to the request of the receiving user terminal is synthesized and displayed on the receiving user terminal. By doing so, the limitation between the processing capacity of the receiving user terminal and the line speed is relaxed, but when the processing capacity of the receiving user terminal is low, such as a small mobile terminal, reception of multiple multicast channels and multiple videos It is difficult to synthesize and display streams. Further, it is necessary for the user to set the amount of distribution data of the desired video stream according to the processing capacity of the receiving user terminal and the communication line speed.

【0005】

Therefore, an object of the present invention is to eliminate the problem that there is a limitation on the processing capacity of the user terminal when receiving, synthesizing, and displaying a plurality of hierarchically divided IP multicast channels on the receiving user terminal. ..

【0006】

[Means for solving problems]

The system of the present invention is characterized in that the multicast channel synthesis processing function is provided in a gateway or a server deployed on a communication network. In addition, by notifying the gateway or server of the number of integrated layers according to the desired bit rate obtained from the capacity of the receiving user terminal and the communication line speed, the data processing capacity and / or the communication line speed of the user terminal is changed. It is characterized by providing a notification interface that enables adaptive distribution of multicast data for the integrated layer.

【0007】

Therefore, the hierarchically coded video distribution system of the present invention has a separation means for hierarchically separating the first video stream into m (m 1) second video streams, and the m second video streams. Presented from the user terminal, a server having a distribution means for delivering using the first multicast channel, a receiving means for receiving each second video stream using m first multicast channels, and a receiving means for receiving each second video stream using m first multicast channels. An integration means for integrating m second video streams into each third video stream for n (n 1) user terminals based on the desired number of integration layers, and n of the above. A gateway having a distribution means for delivering a third video stream, a receiving means for receiving one third video stream, a decoding means for decoding the third video stream, and the decoded signal. It has a user terminal having a display means for displaying.

【0008】

Further, the system of the present invention is based on a separation means for hierarchically separating the first video stream into m (m 1) second video streams and a desired number of integrated layers presented from the user terminal. An integration means for integrating the second video streams into each third video stream to n (n 1) user terminals, and distribution for delivering the n third video streams. A user terminal having a server having means, a receiving means for receiving one third video stream, a decoding means for decoding the third video stream, and a display means for displaying the decoded signal. And have.

【0009】

According to another embodiment of the present invention, the user terminal is a data processing capability of the user terminal, a communication band in which the communication function of the user terminal can be used, and / or a plurality of communication applications operating on the user terminal. The desired bit rate is calculated from the communication band usage state of the above, the number of integrated layers is determined so that the bit rate of the third video stream is the maximum bit rate that does not exceed the desired bit rate, and the number of integrated layers is used as the gateway. Alternatively, it is preferable to further have a decision means for notifying the server.

【0010】

According to another embodiment of the present invention, the delivery means for delivering the third video stream at the gateway or server delivers n third video streams using the second multicast channel, respectively, and the user terminal. The receiving means of the above identifies one second multicast channel and notifies the gateway or server of the registration for the second multicast channel to start and stop the reception of the third video stream and the number of integrated layers. Can be changed.

【0011】

Further, according to another embodiment of the present invention, the distribution means for distributing the third video stream in the gateway or the server distributes n third video streams using the first unicast channel, respectively. , The receiving means of the user terminal enables the start and stop of reception of the third video stream distributed using the unicast channel and the change of the number of integrated layers.

【0012】

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

【0013】

FIG. 1 is a system configuration diagram of the first embodiment according to the present invention. In the system, a server 1, a gateway 2, and a user terminal 3 are deployed on a communication network.

【0014】

The server 1 is composed of a video stream hierarchical coding function 11 and a video stream multicast channel distribution function 12. The video stream input to the video stream hierarchical coding function 11 is hierarchically separated into m lines, encoded, and passed to the video stream multicast channel distribution function 12.

【0015】

The gateway 2 is composed of a video stream multicast channel reception function 13, a multicast channel integration function 14, a video stream distribution function 15, and a user management function 20. The video stream hierarchically separated into m by the video stream multicast channel distribution function 12 is distributed to the video stream multicast channel reception function 13 through the server-gateway communication interface 31 which is m multicast channels. Further, the desired number of integrated layers of the user terminal is notified to the user management function 20 by the desired integrated layer number notification interface 34, and is managed for each user. When there are n desired integration layers of users managed by the user management function 20, the multicast channel integration function 14 integrates into n video streams, and the video stream distribution function 15 to n gateways-user terminals. It is delivered to each user terminal through the inter-communication interface.

【0016】

User terminal # 1 is composed of a video stream receiving function 16, a video stream hierarchical coding / decoding function 17, a video stream display function 18, and a desired integrated layer number determination function 19. The video stream receiving function 16 selects the gateway-user terminal communication interface 33 corresponding to the desired number of integrated layers of the user terminal # 1 from the interfaces 32, and receives the video stream distributed on the interface 33. The received video stream is decoded by the video stream hierarchical coding / decoding function 17 and displayed by the video stream display function 18. Further, the desired number of integrated layers determined by the desired integrated layer number determination function 19 is notified from the desired integrated layer number notification interface 34 to the user management function 20.

【0017】

FIG. 2 is a system configuration diagram of a second embodiment according to the present invention. In the system, a server 1 and a user terminal 3 are deployed on a communication network.

【0018】

The server 1 is composed of a video stream hierarchical coding function 11, a multicast channel integration function 14, a video stream distribution function 15, and a user management function 20. The video stream input to the video stream hierarchical coding function 11 is hierarchically separated into m lines, coded, and passed to the multicast channel integration function 14. Further, the desired number of integrated layers of the user terminal is notified to the user management function 20 by the desired integrated layer number notification interface 34, and is managed for each user. When there are n desired integration layers of users managed by the user management function 20, the multicast channel integration function 14 integrates into n video streams, and the video stream distribution function 15 to n servers-user terminals. It is delivered to each user terminal through the inter-communication interface 32.

【0019】

User terminal # 1 is composed of a video stream receiving function 16, a video stream hierarchical coding / decoding function 17, a video stream display function 18, and a desired integrated layer number determination function 19. The video stream receiving function 16 selects the server-user terminal communication interface 33 corresponding to the desired number of integrated layers of the user terminal # 1 from the interfaces 32, and receives the video stream distributed on the interface 33. The received video stream is decoded by the video stream hierarchical coding / decoding function 17 and displayed by the video stream display function 18. Further, the desired number of integrated layers determined by the desired integrated layer number determination function 19 is notified from the desired integrated layer number notification interface 34 to the user management function 20.

【0020】

FIG. 3 is a system configuration diagram of a third embodiment according to the present invention. In FIG. 3, the mounting means of the desired integrated number determination function 19, the mounting means of the gateway-user terminal communication interface 32, and the gateway-user terminal communication interface 33 among the interfaces 32 are selected with respect to FIG. It stipulates the means to do so.

【0021】

The desired integrated number determination function 19 is desired based on the data processing capacity of the user terminal, the communication band in which the communication function of the user terminal can be used, and / or the communication band usage state of a plurality of communication applications operating on the user terminal. The bit rate is calculated, and the number of integrated layers is determined so as to have the maximum bit rate that does not exceed the desired bit rate.

【0022】

The number of integrated layers determined by the desired integrated number determination function 19 is notified to the user management function 20 through the desired integrated layer number notification interface 34, and is notified to the video stream receiving function 16 from the desired integrated layer number notification internal interface 35. Interface. The gateway-user terminal communication interface, which is n multicast channels from the video stream distribution function 15, distributes using n multicast channels, and the desired number of integrated layers notified in the video stream reception function 16 is reached. The corresponding gateway-user terminal communication interface 33 is identified, registered to the multicast channel, and the video stream can be received.

【0023】

FIG. 4 is a system configuration diagram of a fourth embodiment according to the present invention. In FIG. 4, the mounting means of the desired integrated number determination function 19, the mounting means of the gateway-user terminal communication interface 32, and the gateway-user terminal communication interface 33 among the interfaces 32 are selected with respect to FIG. It stipulates the means to do so.

【0024】

The number of integrated layers determined by the desired integrated number determination function 19 and the user terminal identification information for routing are notified to the user management function 20 through the desired integrated number number notification interface 34. The n video streams distributed from the video stream distribution function 15 are distributed using the gateway-user terminal communication interface, which is n unicast channels, and the desired integration layer notified in the video stream reception function 16 The gateway-user terminal communication interface 33 corresponding to the number and user identification information is identified so that the video stream can be received.

【0025】

FIG. 5 is a system configuration diagram of a fifth embodiment according to the present invention. In FIG. 5, the mounting means of the desired integrated number determination function 19, the mounting means of the server-user terminal communication interface 32, and the server-user terminal communication interface 33 among the interfaces 32 are selected with respect to FIG. It stipulates the means to do so.

【0026】

The number of integrated layers determined by the desired integrated number determination function 19 is notified to the user management function 20 through the desired integrated layer number notification interface 34, and is notified to the video stream receiving function 16 from the desired integrated layer number notification internal interface 35. Interface. The server-user terminal communication interface, which is n multicast channels from the video stream distribution function 15, distributes using n multicast channels, and the desired number of integrated layers notified in the video stream reception function 16 is reached. The corresponding server-user terminal communication interface 33 is identified, registered to the multicast channel, and the video stream can be received.

【0027】

FIG. 6 selects the implementation method of the desired integrated number determination function 19, the implementation method of the server-user terminal communication interface 32, and the server-user terminal communication interface 33 among the interfaces 32 in the configuration of FIG. It is a block diagram which defined the method.

【0028】

The number of integrated layers determined by the desired integrated number determination function 19 and the user terminal identification information for routing are notified to the user management function 20 through the desired integrated number number notification interface 34. The n video streams distributed from the video stream distribution function 15 are distributed using the gateway-user terminal communication interface, which is n unicast channels, and the desired integration layer notified in the video stream reception function 16 The server-user terminal communication interface 33 corresponding to the number and user identification information is identified so that the video stream can be received.

【0029】

Various embodiments of the hierarchically coded video distribution system of the present invention described above can be easily modified, modified and omitted by those skilled in the art within the scope of the technical idea and viewpoint of the present invention. .. The above explanation is just an example and does not attempt to restrict anything. The present invention is limited only to the scope of claims and their equivalents.

【0030】

[Effect of the invention]

As described in detail above, according to the hierarchically coded video distribution system of the present invention, even a receiving user terminal having a low processing capacity such as a small mobile terminal flows on a multicast channel distributed on the Internet. Video stream composition and display processing can be performed.

[Simple explanation of drawings]

[Figure 1]

It is a system block diagram of the 1st Embodiment by this invention.

[Figure 2]

It is a system block diagram of the 2nd Embodiment by this invention.

[Fig. 3]

It is a system block diagram of the 3rd Embodiment by this invention.

[Fig. 4]

It is a system block diagram of the 4th Embodiment by this invention.

[Fig. 5]

It is a system block diagram of the 5th Embodiment by this invention.

[Fig. 6]

It is a system block diagram of the 6th Embodiment by this invention.

[Explanation of symbols]

1 server 2 gateway 3 User terminal 11 Video stream hierarchical coding function 12 Video stream multicast channel distribution function 13 Video stream multicast channel reception function 14 Multicast channel integration function 15 Video stream distribution function 16 Video stream reception function 17 Video stream hierarchical coding / decoding function 18 Video stream display function 19 Desired integrated layer number determination function 20 User management function 31 Server-Gateway Communication Interface 32 Gateway-User terminal communication interface 33 Gateway-User terminal communication interface 34 Desired integrated layer number notification interface 35 Desired integrated layer number notification internal interface