A method, apparatus and system for adjusting multimedia encoding rate
12 claims: 3 independent, 9 dependent
- 1A method for reducing a multimedia encoding rate, comprising:Obtaining (S502), by a multimedia resource control server, a network available bandwidth corresponding to a transmission path of a multimedia service;Obtaining (S506), by the multimedia resource control server, expected quality of experience, QoE, of the multimedia service which reflects an optimal quality of the multimedia service and a current multimedia encoding rate;and for reducing the current multimedia encoding rate to achieve the expected QoE, obtaining an expected multimedia encoding rate by using the network available bandwidth, the expected QoE of the multimedia service, and the current multimedia encoding rate as input parameters and according to a preset multimedia resource decision policy, wherein the expected multimedia encoding rate is used as a reference for reducing the current multimedia encoding rate;wherein the expected QoE is a parameter value expected by the user of the multimedia service
- 6A system for reducing a multimedia encoding rate, comprising a multimedia resource control server (602) and a network resource control server (604), wherein:the multimedia resource control server (602) is configured to: interact with the network resource control server (604) to obtain a network available bandwidth corresponding to a transmission path of a multimedia service;and obtain an expected multimedia encoding rate according to a preset multimedia resource decision policy and by using the network available bandwidth corresponding to the transmission path of the multimedia service, expected quality of experience, QoE, of the multimedia service which reflects an optimal quality of the multimedia service, and a current multimedia encoding rate as input parameters for reducing the current multimedia encoding rate to achieve the expected QoE" wherein the expected multimedia encoding rate is used as a reference for reducing the current multimedia encoding rate;and the network resource control server (604) is configured to: determine the network available bandwidth corresponding to the transmission path of the multimedia service according to a request sent from the multimedia resource control server, and return the network available bandwidth to the multimedia resource control server;wherein the expected QoE is a parameter value expected by the user of the multimedia service.
- 10A multimedia resource control server, comprising an obtaining unit (702) and a multimedia resource deciding unit (704), wherein:the obtaining unit (702) is configured to: obtain a network available bandwidth corresponding to a transmission path of a multimedia service, expected quality of experience, QoE, which reflects an optimal quality of the multimedia service, and a current multimedia encoding rate, and send the obtained information to the multimedia resource deciding unit;and the multimedia resource deciding unit (704) is configured to: receive the information obtained by the obtaining unit, and for reducing the current multimedia encoding rate to achieve the expected QoE, obtain an expected multimedia encoding rate according to a multimedia resource decision policy and by using the network available bandwidth corresponding to the transmission path of the multimedia service, the expected QoE, and the current multimedia encoding rate as input parameters, wherein the expected multimedia encoding rate is used as a reference for reducing the current multimedia encoding rate;wherein the expected QoE is a parameter value expected by the user of the multimedia service
Independent claims3
80 paragraphs in 3 sections, as filed
FIELD OF THE INVENTION
0001The present invention relates to a network technology in the communications field, and in particular, to a method, an apparatus, and a system for adjusting a multimedia encoding rate.
BACKGROUND OF THE INVENTION
0002With the development of multimedia communications technologies, various multimedia services are provided. Therefore, the multimedia service quality plays an important role in multimedia processing and multimedia communications fields.
0003In multimedia services, for example, Internet Protocol Television (IPTV) and radio services, because the traditional quality of service (QoS) parameter of the network layer cannot reflect the quality of experience (QoE) of a user visually, the QoE value is used to measure the user experience on the video quality.
0004In the prior art, in IP multimedia services, the user's QoE is improved according to the QoE value that the user feeds back to the media server. That is, the media server compares the QoE value within a time window with a predetermined threshold; if the video quality is declining and exceeds the threshold, the media server reduces the encoding rate to relieve the congestion. In this way, the QoE of the video is improved, and the user's QoE is improved. The following problems have become apparent in the prior art: <ul id="ul0001" list-style="none" compact="compact"><li>The encoding rate is increased or reduced only according to the QoE fed back by the user. This may not improve the QoE. If the encoding rate is reduced only according to the QoE, some information is lost, and the network performance may not meet the requirement. Thus, the obtained QoE value may not meet the user's expectation and a proper value can be found only by adjusting the rate for multiple times.</li></ul>
0005<nplcit id="ncit0001" npl-type="s"><text>NICOLA CRANLEY ET AL: " User-perceived quality -aware adaptive delivery of MPEG-4 content</text></nplcit>", XP55000335, discloses that an optimum adaptation trajectory exists which indicates how encoding quality should be adapted with respect to user perceived quality in response to network conditions. This optimum adaption trajectory can be used with any transmission adaptation policy with a system architecture that uses knowledge of user perceived quality to make adaption decisions and give an example of how this knowledge can be used to complement the sender-based adaption algorithm, LDA.
0006<nplcit id="ncit0002" npl-type="s"><text>MUNTEAN G-M ET AL: " A New Adaptive Multimedia Streaming System for All-IP Multi-Service Networks</text></nplcit>", XP011108391, discloses that a significant challenge in all-IP multi-service networks is to balance the goal of providing high-quality services to the end-users with the desire to maximize the number of end-users that can be simultaneously served. This paper presents a solution to this challenge by using the Quality-Oriented Adaptation Scheme (QOAS) for delivering multimedia streams. This adaptive mechanism uses feedback from clients regarding the quality of delivery to assist the server in making dynamic adjustments to the transmitted streams.
0007<nplcit id="ncit0003" npl-type="s"><text>David Lopez: "An OWL-S based architecture for self-optimizing multimedia over IP services</text></nplcit>", XP55000332, discloses that an architecture to manage a multimedia over IP delivery service. It considers user's expectations as the main metric that defines the quality of the service thus assuring an efficient resource and effort investment by network operators. The proposed architecture integrates into a single platform both required elements as well as involved processes in a multimedia over IP delivery scenario. In order to achieve a scalable solution, a distributed proposal is made according to proven modeling techniques, with maximum decoupling and composition. Web Services have turned out to be a valid approach to specify involved components. It is necessary, however, to extend the capabilities that web services provide with alternative technologies such as OWL-S to integrate both components and processes into a single unified specification of the management architecture.
Summary of the Invention
0008The present invention provides a method, an apparatus, and a system for adjusting a multimedia encoding rate, so that an optimal point for balancing the effects of the media encoding rate and the network performance on the QoE is found by adjusting the multimedia encoding rate on the current network, thus achieving optimal QoE.
0009To achieve the foregoing objective, the invention provides the following technical solution: <ul id="ul0002" list-style="none" compact="compact"><li>According to the first aspect of the present invention a method for reducing a multimedia encoding rate is provided according to claim 1.</li></ul>
0010According to the second aspect of the present invention a system for reducing a multimedia encoding rate is provided according to claim 6.
0011According to the third aspect of the present invention a multimedia resource control server is provided according to claim 10.
0012In the present invention, under the current network performance, an optimal point for balancing the effects of the media encoding rate and the network performance on the QoE is found by adjusting the multimedia encoding rate, thus achieving optimal QoE. In this way, the adjustment process is simple and fast and the success rate is high, thus improving the QoE.
Brief Description of the Drawings
0013<ul id="ul0003" list-style="none" compact="compact"><li><figref idref="f0001">FIG 1</figref> is a schematic diagram illustrating an IP multimedia evaluation model according to an embodiment of the present invention;</li><li><figref idref="f0001">FIG 2</figref> is a schematic diagram illustrating another IP multimedia evaluation model according to an embodiment of the present invention;</li><li><figref idref="f0001">FIG 3</figref> is a schematic diagram illustrating a multimedia resource decision model according to an embodiment of the present invention;</li><li><figref idref="f0002">FIG. 4</figref> is a flowchart of a method for adjusting a multimedia encoding rate according to an embodiment of the present invention;</li><li><figref idref="f0003">FIG. 5</figref> is a flowchart of a method for adjusting a multimedia encoding rate according to an embodiment of the present invention;</li><li><figref idref="f0004">FIG. 6</figref> illustrates the structure of a system for adjusting a multimedia encoding rate according to an embodiment of the present invention; and</li><li><figref idref="f0005">FIG. 7</figref> illustrates the structure of a multimedia resource control server according to an embodiment of the present invention.</li></ul>
DETAILED DESCRIPTION OF THE EMBODIMENTS
0014To make the technical solutions of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and embodiments.
0015A method for adjusting the multimedia encoding rate in an embodiment includes: obtaining a network available bandwidth corresponding to a transmission path of a multimedia service; obtaining the expected QoE of the multimedia service and the current multimedia encoding rate; and obtaining an expected multimedia encoding rate by using the network available bandwidth, the expected QoE of the multimedia service, and the current multimedia encoding rate as input parameters and according to a preset multimedia resource decision policy, where the expected multimedia encoding rate is used as a reference for adjusting the current multimedia encoding rate.
0016In the following embodiments, the available bandwidth of the current network is the network available bandwidth corresponding to the transmission path of the multimedia service.
0017<figref idref="f0001">FIG. 1</figref> shows a QoE evaluation model of an IP multimedia service. The QoE evaluation model uses a multimedia resource and a network resource as the input parameters, and uses the QoE as the output value. In this way, the QoE evaluation model among the multimedia resource, network resource, and the IP multimedia service is established. Subjective evaluation is performed on the video quality, and each parameter value of the QoE evaluation model is obtained by using the regression algorithm.
0018Further, the two input parameters in the QoE evaluation model, that is, the multimedia resource and network resource, are main factors that reduce the video quality in the video transmission system. Thus, users can enjoy satisfactory QoE only under the joint effect of the multimedia resource and the network resource.
0019The multimedia resource refers to various indexes involved in the process of encoding the IP multimedia service and radio service. These indexes determine the degree of damage in the service encoding process, thus affecting the user's QoE. Specifically, these indexes include the encoding quantization granularity and media encoding rate.
0020The network resource refers to the network QoS performance of services received by the users, namely, packet loss related parameters including the bandwidth resource, packet loss ratio, and packet loss burst event or delay jitter, which are monitored on a real-time basis. The network resource determines the network performance and affects the degree of damage in the service transmission process, thus affecting the user's QoE. Thus, the QoE evaluation model uses the multimedia resource and network resource as the input parameters, and uses the QoE as the output value.
0021<figref idref="f0001">FIG. 2</figref> illustrates another IP multimedia evaluation model.
0022In <figref idref="f0001">FIG. 2</figref>, a QoE evaluation model is established among the media encoding rate, the network available bandwidth, and the IP multimedia service by using the multimedia encoding rate and the network available bandwidth as the input parameters and using the QoE as the output value. The network available bandwidth is the current available bandwidth.
0023The multimedia encoding rate is the main parameter reflecting the multimedia resource. The network available bandwidth is the main parameter reflecting the network resource.
0024Among the indexes of the multimedia resource, the multimedia encoding rate is one of the main factors affecting the user's QoE. The multimedia encoding rate is the bit rate output by the encoder. The higher the media encoding rate is, the clearer the picture is, and vice versa. Experiments show that the media encoding rate is one of the main factors that affect the user's QoE if the network performance remains unchanged and that the user's QoE may be improved by increasing the media encoding rate. However, a higher media encoding rate requires a larger bandwidth and affects the network performance. Thus, it is not enough to increase the media encoding rate merely.
0025Of the indexes of the network resource, the network available bandwidth is the key factor that affects the network performance parameter. For example, if the bandwidth is inadequate in the transmission process, network congestion may occur, which causes the loss of packets and discarding of video packets. As a result, the video quality of the user will be definitely affected. If the discarded packets include important information, the user may be greatly affected. In addition, if the network available bandwidth is inadequate, a delay may occur. Thus, the network available bandwidth is the key factor that affects the network performance parameter.
0026Therefore, a QoE evaluation model of the IP multimedia service is established according to the main parameter of the multimedia resource (that is, the media encoding rate) and the main parameter of the network resource (that is, the network available bandwidth), as shown in <figref idref="f0001">FIG 2</figref>.
0027The relation of the multimedia resource decision model is obtained by using the QoE evaluation model of the IP multimedia service and the relation QoE = f (media encoding rate, network available bandwidth). The relation among the QoE, the media encoding rate, and the network available bandwidth is obtained through constant training with the subjective measurement value. That is, the multimedia resource decision model shown in <figref idref="f0001">FIG. 3</figref> is obtained. The expected QoE of the IP multimedia service, the network available bandwidth, and the current media encoding rate are used as the input parameters of the multimedia resource decision model, and an expected media encoding rate is output according to the multimedia resource decision model.
0028The multimedia resource decision model shown in <figref idref="f0001">FIG. 3</figref> reflects the following process: A most proper media encoding rate (that is, the expected media encoding rate) is calculated by using the relation of the media resource decision model and according to the user's expected QoE, the current network available bandwidth of the network path that the media stream passes through, and the current media encoding rate; the media encoding rate is adjusted to the expected media encoding rate. In this way, under the current network performance, the expected media encoding rate may be selected to meet the user's expected QoE. The multimedia resource decision model is one of the multimedia resource decision polices.
0029In this embodiment, a multimedia resource decision model is established among the user's expected QoE, the current network available bandwidth of the network path that the multimedia stream passes through, the current media encoding rate, and the expected media encoding rate. Thus the user's adjustment process is simplified, and an optimal point for balancing the effects of the media encoding rate and the network performance on the QoE is found, so that the user's expected QoE can be achieved under the current network performance.
0030<figref idref="f0002">FIG. 4</figref> is a flowchart of a method for adjusting the multimedia encoding rate according to an embodiment of the present invention.
0031Step S400: The user sends a multimedia service request to the multimedia resource control server, and the multimedia resource control server determines the expected QoE for the service requested by the user.
0032When the user sends a multimedia service request to the multimedia resource control server, two method are available for determining the expected QoE: querying for and obtaining the expected QoE of the multimedia service according to the user's multimedia service request; or obtaining the expected QoE according to a multimedia service request or a multimedia service QoE improvement request that carries the expected QoE of the multimedia service. The expected QoE is the parameter value that the user expects to obtain and which reflects the optimal video quality of the service. When the querying method is used to obtain the expected QoE of the multimedia service, if the expected QoE of the multimedia service is not found, the user is requested to send the expected QoE of the multimedia service. Step S402: The multimedia resource control server sends a request for obtaining the network resource to the network resource control server according to the service request sent from the user.
0033Specifically, the multimedia resource control server sends a request for obtaining the network resource, where the request includes quintuple information of the service, that is, the IP address of the media server, IP address of the terminal user, source port number of the media server providing the multimedia service, port number and protocol type of the terminal user receiving the multimedia service, requesting to obtain the network resource that the service requested by the user passes through. The network resource is the current available bandwidth information of all physical links of the transmission path that the multimedia service requested by the user passes through.
0034Step S404: The network resource control server receives the request, selects the minimum available bandwidth, and returns it to the multimedia resource control server.
0035Firstly, the network resource control server calculates the transmission path that the multimedia service requested by the user may pass through, and finds the current available bandwidth information corresponding to each physical link of the transmission path stored on the network resource control server according to the transmission path of the multimedia service; or the network resource control server requests the network resource monitoring server to query for the current network available bandwidth information corresponding to each physical link of the transmission path that the multimedia service may pass through. Secondly, the network resource control server selects the minimum value of the current available bandwidth information corresponding to all the physical links as the current available bandwidth information corresponding to the transmission path of the multimedia service, and returns the value to the multimedia resource control server; or the network resource control server sends the current network available bandwidth information to the multimedia resource control server, and the multimedia resource control server selects the minimum value of the current available bandwidth information corresponding to all the physical links as the current available bandwidth information corresponding to the transmission path of the multimedia service.
0036Step S406: The multimedia resource control server obtains an expected media encoding rate according to the multimedia resource decision model, and sends the expected media encoding rate to the media server.
0037The expected media encoding rate is obtained according to the multimedia resource decision model. The expected media encoding rate reflects the optimal point for balancing the effects of the media encoding rate and the network performance on the QoE. In this way, the user can achieve the expected QoE under the current network performance.
0038The expected QoE requested by the user, the network available bandwidth, and the current media encoding rate are used as the input parameters of the multimedia resource decision model. Because it is the first time for the user to request the service, the third input parameter of the multimedia resource decision model, that is, the current media encoding rate, is 0. The expected media encoding rate is output according to the multimedia resource decision model shown in <figref idref="f0001">FIG. 3</figref>.
0039The multimedia resource decision model may be multiple function relations, that is, the relation among the expected QoE, network available bandwidth, current media encoding rate, and expected multimedia encoding rate: Expected multimedia encoding rate = Function (current media encoding rate, current network available bandwidth, expected QoE). For example, the formula is as follows: <maths id="math0001" num=""><math display="block"><mrow><mi mathvariant="normal">Expected multimedia encoding rate</mi><mo>=</mo><mmultiscripts><mrow><mi mathvariant="normal">Currentavailablebandwidth</mi><mo>+</mo><msub><mi mathvariant="normal">p</mi><mn mathvariant="normal">1</mn></msub><msqrt><mi mathvariant="normal">Currentavailablebandwidth</mi></msqrt></mrow><mprescripts /><mrow><msub><mi mathvariant="normal">p</mi><mn mathvariant="normal">0</mn></msub></mrow><none /></mmultiscripts><mo>+</mo><mi mathvariant="normal">p</mi><mmultiscripts><mrow><mi mathvariant="normal">Current multimedia encoding rate</mi><mo>+</mo><msub><mi mathvariant="normal">p</mi><mn>3</mn></msub></mrow><mprescripts /><mn>2</mn><none /></mmultiscripts><msqrt><mi mathvariant="normal">Current multimedia encoding rate</mi></msqrt><mo>+</mo><mi mathvariant="normal">p</mi><mmultiscripts><mi mathvariant="normal">Expected QoE</mi><mprescripts /><mn>4</mn><none /></mmultiscripts></mrow></math><img file="EP2290894B1_D0001.tif" /></maths>
0040In this formula, P0 P1 P2 P3 P4 refer to coefficients and represent the weight of each factor, which may be adjusted. The expected media encoding rate is calculated by using the preceding formula according to the user's expected QoE, current network available bandwidth, and current media encoding rate. This formula gives only one of feasible solutions. This formula features simple relations among the parameters and ease of calculation.
0041The expected media encoding rate calculated by the multimedia resource decision model is sent to the media server for encoding, and the media encoding rate is saved.
0042The media server may be other devices on the network besides the media server in the multimedia system. Other devices on the network may be network devices that are able to adjust and regenerate multimedia resources, for example, a digital subscriber line access multiplexer (DSLAM), a broadband remote access server (BRAS), and a router.
0043Step S408: The media server outputs a media stream to the user according to the received expected media encoding rate.
0044The media server may be other devices on the network besides the media server in the multimedia system. Other devices on the network may be network devices that are able to adjust and regenerate multimedia resources, for example, a DSLAM, a BRAS, and a router.
0045In this embodiment, an expected media encoding rate is obtained by using the expected QoE and the network available bandwidth as the input parameters of the multimedia resource decision model. In this way, an optimal point for balancing the effects of the media encoding rate and the network performance on the QoE is found, and the repeated adjustment process is simplified, thus achieving the user's expected QoE under the current network performance.
0046<figref idref="f0002">FIG. 4</figref> illustrates an application scenario of the method for adjusting the media encoding rate dynamically when the user requests the service for the first time. The following describes an application scenario of the method for adjusting the media encoding rate dynamically in the process of receiving IP multimedia services after the user requests the service for the first time, as shown in <figref idref="f0003">FIG 5</figref>.
0047<figref idref="f0003">FIG. 5</figref> is a flowchart of a method for adjusting the media encoding rate dynamically according to an embodiment of the present invention.
0048Step S500: When the current QoE fails to meet the requirement, the user sends a multimedia service QoE improvement request to the multimedia resource control server.
0049Specifically, the current QoE fails to meet the requirement in the following two scenarios: 1. The user monitors the QoE of the received IP multimedia service on a real-time basis, and compares this QoE with the expected QoE of the service stored by the user. The user may store the expected QoE of the multimedia service and report policies. For example, when the monitored QoE is lower than the expected QoE, or the expected QoE is declining, the user sends a multimedia service QoE improvement request to the multimedia resource control server; 2. The multimedia resource control server monitors the QoE on a real-time basis, and compares the current QoE of the service with the expected QoE of the multimedia service stored on the multimedia resource control server. For example, when the monitored QoE is lower than the expected QoE or the expected QoE is declining, the process proceeds to step 502.
0050Two methods are available for obtaining the expected QoE of the service: querying for and obtaining the expected QoE of the multimedia service according to the multimedia service QoE improvement request from the user; or obtaining the expected QoE according to a multimedia service request or a multimedia service QoE improvement request that carries the expected QoE of the multimedia service. The expected QoE is the parameter value that the user expects to obtain and that reflects the optimal video quality of the service. When the querying method is used to obtain the expected QoE of the multimedia service, if the expected QoE of the multimedia service is not found, the user is requested to send the expected QoE of the multimedia service.
0051Step S502: The multimedia resource control server sends a request for obtaining the network resource to the network resource control server according to the request from the user, requesting to obtain the network resource information of the transmission path that the service requested by the user passes through.
0052The multimedia resource control server sends a request for obtaining the network resource, where the request includes quintuple information of the service, that is, the it address of the media server, IP address of the terminal user, source port number of the media server providing the multimedia service, port number and protocol type of the terminal user receiving the multimedia service, requesting to obtain the network resource information that the service requested by the user passes through. The network resource is the current available bandwidth information of all physical links of the transmission path that the multimedia service requested by the user passes through.
0053Step S504: The network resource control server receives the request, selects the minimum available bandwidth, and returns it to the multimedia resource control server.
0054Firstly, the network resource control server calculates the transmission path that the multimedia service requested by the user may pass through, and finds the current available bandwidth information corresponding to each physical link of the transmission path stored on the network resource control server according to the transmission path of the multimedia service; or the network resource control server requests the network resource monitoring server to query for the current network available bandwidth information corresponding to each physical link of the transmission path that the multimedia service may pass through. Secondly, the network resource control server selects the minimum value of the current available bandwidth information corresponding to all the physical links as the current available bandwidth information corresponding to the transmission path of the multimedia service, and returns the value to the multimedia resource control server; or the network resource control server sends the current network available bandwidth information to the multimedia resource control server, and the multimedia resource control server selects the minimum value of the current available bandwidth information corresponding to all the physical links as the current available bandwidth information corresponding to the transmission path of the multimedia service.
0055Step S506: The multimedia resource control server obtains an expected media encoding rate according to the multimedia resource decision model, and sends the expected media encoding rate to the media server.
0056The expected media encoding rate is obtained according to the multimedia resource decision model. It reflects the optimal point for balancing the effects of the media encoding rate and the network performance on the QoE. In this way, the user can achieve the expected QoE under the current network performance.
0057The expected QoE of the user, the available bandwidth of the network that the user passes through and the current media encoding rate are used as the input parameters of the multimedia resource decision model. The expected media encoding rate is output according to the multimedia resource decision model. The current media encoding rate is stored on the multimedia resource control server and retrieved by the multimedia resource control server. The multimedia resource decision model may be multiple function relations, that is, the relation among the expected QoE, network available bandwidth, current media encoding rate, and expected multimedia encoding rate: Expected multimedia encoding rate = Function (current media encoding rate, current network available bandwidth, QoE). For example, the formula is as follows: <maths id="math0002" num=""><math display="block"><mrow><mi mathvariant="normal">Expected multimedia encoding rate</mi><mo>=</mo><mi mathvariant="normal">p</mi><mmultiscripts><mrow><mi mathvariant="normal">Currentavailablebandwidth</mi><mo>+</mo><msub><mi mathvariant="normal">p</mi><mn mathvariant="normal">1</mn></msub><msqrt><mi mathvariant="normal">Currentavailablebandwidth</mi></msqrt></mrow><mprescripts /><mn>0</mn><none /></mmultiscripts><mo>+</mo><mi mathvariant="normal">p</mi><mmultiscripts><mrow><mi mathvariant="normal">Current multimedia encoding rate</mi><msub><mrow><mo>+</mo><mi mathvariant="normal">p</mi></mrow><mn>3</mn></msub></mrow><mprescripts /><mn>2</mn><none /></mmultiscripts><msqrt><mi mathvariant="normal">Current multimedia encoding rate</mi></msqrt><mo>+</mo><mi mathvariant="normal">p</mi><mmultiscripts><mi mathvariant="normal">Expected QoE</mi><mprescripts /><mn>4</mn><none /></mmultiscripts></mrow></math><img file="EP2290894B1_D0002.tif" /></maths>
0058In this formula, P0 P1 P2 P3 P4 refer to coefficients and represent the weight of each factor, which may be adjusted. The expected media encoding rate is calculated by using the preceding formula according to the user's expected QoE, current network available bandwidth, and current media encoding rate. This formula gives only one of feasible solutions. This formula features simple relations among the parameters and ease of calculation.
0059The expected media encoding rate calculated by the multimedia resource decision model is sent to the media server for encoding, and the media encoding rate is saved.
0060The media server may be other devices on the network besides the media server in the multimedia system. Other devices on the network may be network devices that are able to adjust and regenerate the multimedia resource, for example, a DSLAM, a BRAS, and a router.
0061Step S508: The media server outputs the multimedia service according to the expected media encoding rate.
0062This step may further include the following: The media server dynamically adjusts the expected media encoding rate. Multiple methods for dynamically adjusting the expected media encoding rate are available. If the media server is located in the multimedia system, the media server selects a proper encoding parameter according to the expected media encoding rate, and adjusts and outputs the expected encoding rate according to the new encoding parameter. If the media server is other devices on the network that do not have the re-encoding capability but can identity the frame type, the media server may adjust the multimedia encoding rate according to the frame type. One of the methods is as follows: reducing the encoding rate, discarding the unimportant data frames, for example, B frames, and guaranteeing the transmission of important frames, for example, I frames and P frames; increasing the encoding rate, restoring the important data frames firstly, and then restoring the unimportant frames.
0063All or part of the steps of the method according to the embodiments of the present invention may be implemented by a program instructing relevant hardware. The program may be stored in a computer readable storage medium. When the program runs, the steps of the method according to the embodiments of the present invention are performed. The storage medium may be a read only memory (ROM), a random access memory (RAM), a magnetic disk, or a compact disk read-only memory (CD-ROM).
0064The following describes the system and apparatus for adjusting the multimedia encoding rate.
0065<figref idref="f0004">FIG. 6</figref> illustrates a structure of a system for adjusting the multimedia encoding rate according to an embodiment of the present invention.
0066A system 60 for adjusting the multimedia encoding rate includes a multimedia resource control server 602 and a network resource control server 604.
0067The multimedia resource control server 602 is configured to: interact with the network resource control server to obtain the network available bandwidth corresponding to the transmission path of a multimedia service; obtain an expected multimedia encoding rate according to a preset multimedia resource policy and by using the network available bandwidth corresponding to the transmission path of the multimedia service, expected QoE of the multimedia service, and current multimedia encoding rate as input parameters, where the expected multimedia encoding rate is used as a reference for adjusting the current multimedia encoding rate.
0068The network resource control server 604 is configured to: determine the network available bandwidth corresponding to the transmission path of the multimedia service according to a request sent from the multimedia resource control server 602, and return the network available bandwidth to the multimedia resource control server 602. The network available bandwidth corresponding to the transmission path of the multimedia service is the minimum value of available bandwidths of multiple physical links on the transmission path of the multimedia service.
0069The system for adjusting the encoding rate in the preceding embodiment further includes a network device 606.
0070The network device 606 is configured to: receive the expected media encoding rate sent from the multimedia resource control server 602, and output a multimedia service corresponding to the expected multimedia encoding rate. The network device is the multimedia server or other network devices that are able to adjust and regenerate the multimedia resource.
0071<figref idref="f0005">FIG. 7</figref> illustrates the structure of a multimedia resource control server according to an embodiment of the present invention.
0072A multimedia resource control server includes an obtaining unit 702 and a multimedia resource deciding unit 704.
0073The obtaining unit 702 is configured to: obtain the network available bandwidth corresponding to the transmission path of a multimedia service, expected QoE, and a current multimedia encoding rate, and send the obtained information to the multimedia resource deciding unit.
0074The multimedia resource deciding unit 704 is configured to: receive the information obtained by the obtaining unit, and obtain an expected multimedia encoding rate according to the multimedia resource decision policy and by using the network available bandwidth corresponding to the transmission path of the multimedia service, the expected QoE, and the current multimedia encoding rate as input parameters, where the expected multimedia encoding rate is used as a reference for adjusting the current multimedia encoding rate.
0075The multimedia resource control server further includes: a querying unit 706, configured to query for and obtain the expected QoE of the multimedia service according to the multimedia service request or the multimedia service QoE improvement request.
0076The multimedia resource control server may further include: a requesting unit 708, configured to request the user to send expected QoE of the multimedia service when the querying unit 706 fails to find the expected QoE of the multimedia service.
0077In embodiments of the present invention, under the current network performance, an optimal point for balancing the effects of the media encoding rate and the network performance on the QoE is found by adjusting the multimedia encoding rate, thus achieving optimal QoE. In this way, the adjustment process is simple and fast and the success rate is high, thus improving the QoE.
0078In conclusion, the above are merely some exemplary embodiments of the present invention.
Contents3
7 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| CN1685734A | Cites | China |
| CN1926861A | Cites | China |
| US2004240390A1 | Cites | United States of America |
| US2005089043A1 | Cites | United States of America |
| US2007133441A1 | Cites | United States of America |
| NICOLA CRANLEY ET AL: "User-perceived quality-aware adaptive delivery of MPEG-4 content", PROCEEDINGS OF THE 13TH INTERNATIONAL WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO , NOSSDAV '03, 1 June 2003 (2003-06-01), pages 42-49, XP55000335, New York, New York, USA DOI: 10.1145/776330.776331 ISBN: 978-1-58-113694-4 | Non-patent | – |
| MUNTEAN G-M ET AL: "A New Adaptive Multimedia Streaming System for All-IP Multi-Service Networks", IEEE TRANSACTIONS ON BROADCASTING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 50, no. 1, 1 March 2004 (2004-03-01), pages 1-10, XP011108391, ISSN: 0018-9316, DOI: DOI:10.1109/TBC.2004.824745 | Non-patent | – |
| David Lopez: "An OWL-S based architecture for self-optimizing multimedia over IP services", , 26 October 2006 (2006-10-26), pages 1-18, XP55000332, ISBN: 3-93-073605-5 Retrieved from the Internet: URL:http://jungla.dit.upm.es/~jlopez/publi caciones/mace06.pdf [retrieved on 2011-06-08] | Non-patent | – |
| "Measurement-based methods for improving the robustness of IPTV performance; G.1082 (04/09)", ITU-T STANDARD, INTERNATIONAL TELECOMMUNICATION UNION, GENEVA ; CH, no. G.1082 (04/09), 29 April 2009 (2009-04-29), pages 1-30, XP017436116, [retrieved on 2010-01-15] | Non-patent | – |
8 members in 4 offices; this record represents the family
Priority claims7
| Document | Office | Kind | Date |
|---|---|---|---|
| 200810068194 | China | A | |
| 200810068194 | China | – | |
| 2009072130 | China | W | |
| WO2009CN72130 | – | – | – |
| CN2008168194 | – | – | – |
| 200810068194 | – | – | – |
| 2009072130 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| CN101621351A | China | A | |
| WO2010000168A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP2290894A1 | European Patent Office (EPO) | A1 | |
| US2011090922A1 | United States of America | A1 | |
| EP2290894A4 | European Patent Office (EPO) | A4 | |
| US8467409B2 | United States of America | B2 | |
| CN101621351B | China | B | |
| EP2290894B1This record | European Patent Office (EPO) | B1 |
70 legal events, as 9 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Fee paymentPLFP | PLFP | FR | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent lapsedLapsedMM4A | MM4A | IE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Fee paymentPLFP | PLFP | FR | |
| No opposition filed against granted patent, or epo opposition proceedings concluded without decisionGrantedR097 | R097 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| Patent invalid in the netherlands as no translation has been filedMP | MP | NL | |
| Invalidated european patentMG4D | MG4D | LT | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Reference to at number (ep patent validated in austria)REF | REF | AT | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Intention to grant announcedINTG | INTG | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Intention to grant announcedINTG | INTG | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Request for extension of the european patent (deleted)DAX | DAX | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 2290894
- Publication, DOCDB
- 2290894
- Publication, EPODOC
- EP2290894
- Application
- 9771938
- Application, DOCDB
- 09771938
- Application, EPODOC
- EP20090771938
Titles3
- German
- VERFAHREN, VORRICHTUNG UND SYSTEM ZUR EINSTELLUNG DER MULTIMEDIAKODIERUNGSRATE
- English
- A METHOD, APPARATUS AND SYSTEM FOR ADJUSTING MULTIMEDIA ENCODING RATE
- French
- PROCÉDÉ, APPAREIL ET SYSTÈME D'AJUSTEMENT DE RENDEMENT DE CODAGE MULTIMÉDIA
Classification
- CPC, 3
- H04L65/4092
- H04L65/607
- H04L65/80
- IPC, 2
- H04L29 02
- H04L29 06
Designated states35
- Contracting states, 35
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Croatia
- Hungary
- Ireland
- Iceland
- Italy
- Liechtenstein
- Lithuania
- Luxembourg
- Latvia
- Monaco
and 11 moreShow fewer
- North Macedonia
- Malta
- Netherlands (Kingdom of the)
- Norway
- Poland
- Portugal
- Romania
- Sweden
- Slovenia
- Slovakia
- Türkiye
