Image encoding apparatus
Abstract
An Image Encoding Apparatus converts image data using discrete cosine transformation. A block forming means (26) forms blocks of data and a plurality of code quantity estimating means (40A-40D) estimate amounts of code by coding the data of the blocks, each using respective different quantization steps. A quantization matrix generation means (36) provides a common quantization matrix (W) to each of the code quantity estimation means. The data is encoded by variable length coding using a quantization step derived from the code quantity estimation means operating on data from a previous frame.

Term
Term ended
Projected expiry passed 31 January 2012, 14.6 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
56 claims: 11 independent, 45 dependent
- 1A coding apparatus, comprising:a) a block forming means (26) operable to form blocks of data comprising sample values of an input signal;b) a plurality of code quantity estimation means (40a-40d) each being operable using respective different quantization steps to estimate amounts of code provided by coding the data of the blocks;and c) quantization matrix generation means (36) operate to provide a common quantization matrix (W) to said plurality of code quantity estimation means, wherein said plurality of code quantity estimation means is operable to estimate the code quantity by using the quantization matrix provided by said quantization matrix generation means.
- 10A coding method, comprising steps of:a) forming blocks of data comprising sample values of an input signal;b) estimating by means of a plurality of estimating means (40a-40d) with different quantization steps respective amounts of code provided by coding the data of the blocks;c) providing a common quantization matrix (W) to said plurality of code quantity estimation means, wherein said plurality of code quantity estimation means estimate the code quantity by using the quantization matrix provided by said quantization matrix generation means.
- 16A method according to Claim 15, wherein said control step includes a step of generating quantization control information for control of the quantization step.
- 19An image encoding apparatus comprising:a) conversion means for converting image information into data on a frequency region;b) parallel output means for parallelly outputting the converted data to output the converted data of a plurality of channels;c) quantization means for respectively quantizing the converted data of the plurality of channels output from said parallel output means;d) operation means for calculating a data amount to be obtained when one of the converted data of the plurality of channels output from said quantization means is encoded;e) coefficient generation means for generating a quantization coefficient for controlling a quantization step of converted data of other channels of said quantization means according to an output from said operation means;and f) encoding means for encoding at least one of the converted data of the plurality of channels output from said quantization means.
- 20An apparatus according to Claim 19, wherein said conversion means performs DCT (Discrete Cosine Transform) conversion.
- 21An apparatus according to Claim 19, wherein said encoding means encodes only one of the converted data of the plurality of channels quantized by said quantization means.
- 22An apparatus according to Claim 21, further comprising multiplexing means for multiplexing encoded data output from said encoding means, and the quantization coefficient for obtaining the encoded data.
- 23An apparatus according to Claim 19, wherein the converted data of the plurality of channels output from said parallel output means have a time difference of a predetermined period therebetween.
- 24An apparatus according to Claim 23, wherein said operation means calculates a data amount, which is to be obtained when one of the converted data of the plurality of channels is encoded, in units of predetermined periods.
- 25An apparatus according to Claim 23, wherein said coefficient generation means updates the quantization coefficient in units of predetermined periods.
- 26An apparatus according to Claim 23, wherein the predetermined period is one frame period.
- 27An image processing apparatus comprising:a) conversion means for converting image information into data on a frequency region;b) parallel output means for parallelly outputting the converted data to output the converted data of a plurality of channels;c) a plurality of quantization means for respectively quantizing the converted data of the plurality of channels output from said parallel output means;d) operation means for calculating a data amount to be obtained when one of the converted data output from said plurality of quantization means is encoded;e) coefficient generation means for generating a quantization coefficient for controlling a quantization step of another one of said plurality of quantization means according to an output from said operation means;and f) coefficient supply means for supplying, as a quantization coefficient used in one quantization means, a quantization coefficient used in quantization of another quantization means.
- 28An apparatus according to Claim 27, further comprising encoding means for encoding one of the converted data of the plurality of channels quantized by said plurality of quantization means.
- 29An apparatus according to Claim 27, wherein the converted data of the plurality of channels output from said parallel output means have a time difference of a predetermined period therebetween.
- 30An apparatus according to Claim 29, wherein said operation means calculates a data amount, which is to be obtained when the converted data quantized by one of said plurality of quantization means is encoded, in units of predetermined periods.
- 31An apparatus according to Claim 29, wherein said coefficient generation means updates the quantization coefficient in units of predetermined periods.
- 32An apparatus according to Claim 29, wherein the predetermined period is one frame period.
- 33An image encoding apparatus comprising:a) conversion means for converting image information into data on a frequency region;b) parallel output means for parallelly outputting the converted data to output the converted data of a plurality of channels;c) quantization means for respectively quantizing the converted data of the plurality of channels output from said parallel output means;d) operation means for calculating a data amount to be obtained when at least an AC component of one of the converted data of the plurality of channels output from said quantization means is encoded;e) coefficient generation means for generating a quantization coefficient for controlling a quantization step of converted data of other channels of said operation means;f) first encoding means for encoding at least the AC component of one of the converted data of the plurality of channels output from said quantization means;g) second encoding means for encoding at least a DC component of the one of the converted data of the plurality of channels;and h) multiplexing means for multiplexing outputs from said first and second encoding means.
- 34An apparatus according to Claim 33, wherein the converted data of the plurality of channels output from said parallel output means have a time difference of a predetermined period therebetween.
- 35An apparatus according to Claim 34, wherein said operation means calculates a data amount, which is to be obtained when the AC component of one of the converted data of the plurality of channels is encoded, in units of predetermined periods.
- 36An apparatus according to Claim 34, wherein said coefficient generation means updates the quantization coefficient in units of predetermined periods.
- 37An apparatus according to Claim 34, wherein said second encoding means encodes the converted data delayed by the predetermined period from the converted data encoded by said first encoding means.
- 38An apparatus according to Claim 33, wherein said multiplexing means multiplexes the outputs from said first and second encoding means, so that the output from said second encoding means advances from the output from said first encoding means.
- 39An image encoding apparatus comprising:a) conversion means for converting image information into data on a frequency region;b) parallel output means for parallelly outputting the converted data to output the converted data of a plurality of channels;c) quantization means for respectively quantizing the converted data of the plurality of channels output from said parallel output means;d) operation means for calculating a plurality of data amounts to be obtained when the converted data of the plurality of channels output from said quantization means are encoded;e) coefficient generation means for generating a plurality of quantization coefficients for controlling a quantization step of said quantization means according to an output from said operation means;f) selection means for selecting one of the plurality of quantization coefficients;and g) encoding means for encoding the quantized converted data using the quantization coefficient output from said selection means.
- 40An apparatus according to Claim 39, wherein the converted data of the plurality of channels output from said parallel output means have a time difference of a predetermined period therebetween.
- 41An apparatus according to Claim 39, wherein said selection means selects a quantization coefficient for obtaining a data amount smaller than and closest to a desired data amount from the plurality of data amounts.
- 42An apparatus according to Claim 39, further comprising multiplexing means for multiplexing the encoded data output from said encoding means, and the quantization coefficient for obtaining the encoded data.
- 43An apparatus according to Claim 40, wherein said selection means comprises a circuit for compensating for a time difference in the plurality of quantization coefficients output from said coefficient generation means.
- 44An apparatus according to Claim 40, wherein said operation means calculates data amounts, which are to be obtained when the converted data quantized by said quantization means are encoded, in units of predetermined periods.
- 45An apparatus according to Claim 40, wherein said coefficient generation means updates the quantization coefficient in units of predetermined periods.
- 46An image encoding apparatus comprising:a) conversion means for converting image information into data on a frequency region;b) parallel output means for parallelly outputting the converted data to output the converted data of a plurality of channels;c) quantization means for respectively quantizing the converted data of the plurality of channels output from said parallel output means;d) operation means for calculating a data amount to be obtained when one of the converted data of the plurality of channels output from said quantization means are encoded;e) control means for controlling said quantization means according to an output from said operation means;f) a plurality of encoding means for respectively encoding at least two of the converted data of the plurality of channels quantized by said quantization means;and g) selection means for selectively outputting encoded codes output from said plurality of encoding means.
- 47An apparatus according to Claim 46, wherein the converted data of the plurality of channels output from said parallel output means have a time difference of a predetermined period therebetween.
- 48An apparatus according to Claim 46, wherein said selection means selects an encoded code smaller than and closest to a desired data amount from the encoded codes output from said plurality of encoding means.
- 49An apparatus according to Claim 46, further comprising multiplexing means for multiplexing the encoded code output from said selection means, and a quantization coefficient associated with a quantization step for obtaining the encoded code.
- 50An apparatus according to Claim 47, wherein said selection means comprises a circuit for compensating for a time difference in said control means.
- 51An apparatus according to Claim 47, wherein said operation means calculates a data amount, which is to be obtained when the converted data quantized by said quantization means are encoded, in units of predetermined periods.
- 52An apparatus according to Claim 47, wherein said control means updates a control state of said quantization means in units of predetermined periods.
- 53A transform image encoder including a quantizer and in which there is provided an ordering circuit for ranking the transform coefficients in sequence of their frequency content, characterised in that the ordering circuit ranks the coefficients prior to quantization thereof.
- 54A discrete cosine transform encoder in which transform coefficients are quantized by a quantizer with a variable scale, characterised in that the scale of the quantizer is derived using image data from preceding image frames.
- 55A method of transform encoding a video signal, comprising the step of predicting a quantizer step value to match a desired amount of video image data, characterised in that the prediction is performed from image data of at least one preceding frame.
- 56An adaptive transform encoder including a controllable quantizer, in which the quantizer step size is initially set equal to its value on the preceding frame, and the step size value is then adjusted to adjust the amount of image data that would be generated for the current frame towards a predetermined constant amount.
Independent claims41
98 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
Field of the Invention
0001The present invention relates to an image encoding apparatus and, more particularly, to an image encoding apparatus for quantizing conversion data obtained by converting image information onto a frequency region, and variable-length coding the quantized conversion data.
Related Background Art
0002In recent years, as an encoding method of a color image signal, an adaptive DCT (discrete cosine transformation) encoding method has been receiving a lot of attention. An encoding method in the JPEG (Joint Photographic Expert Group) organized as an international standard organization of encoding methods of this type employs the DCT encoding method.
0003A basic system of an encoding method of this system will be briefly described below.
0004Fig. 2 is a schematic block diagram for explaining an arrangement of a conventional encoding method using DCT conversion, and Figs. 3 to 6 are views for explaining processing of the encoding method shown in Fig. 2. An input terminal 2 receives a digital image signal to be encoded, which signal is obtained by raster scanning. The image signal input to the terminal 2 is input to an 8 x 8 blocking circuit 4, and is two-dimensionally divided into pixel blocks each consisting of (8 x 8) pixels. The image signal is output to the next circuit in units of pixel blocks.
0005A DCT conversion circuit 6 DCT-converts the image signal from the blocking circuit 4, and outputs an (8 x 8) data matrix for a frequency region. More specifically, a pixel block consisting of image data D<sub>11</sub> to D<sub>88</sub>, as shown in Fig. 3, is converted into a data matrix including X<sub>11</sub> to X<sub>88</sub>, as shown in Fig. 4, by the circuit 6.
0006Note that X<sub>11</sub> represents a DC component in the horizontal and vertical directions of the pixel block, i.e., an average value of this pixel block. If X<sub>11</sub> to X<sub>88</sub> are generally represented by X<sub>ij</sub>, a component represented by X<sub>ij</sub> has a higher frequency in the vertical direction as i is larger, and has a higher frequency in the horizontal direction as j is larger.
0007The data matrix output from the DCT conversion circuit 6 is input to a linear quantization circuit 8. A quantization matrix generation circuit 18 generates a quantization matrix (W<sub>11</sub> to W<sub>88</sub>; Fig. 5) indicating weighting coefficients of quantization step sizes for DCT coefficients X<sub>11</sub> to X<sub>88</sub>, and a coefficient generation circuit 16 generates a coefficient C. The quantization matrix (W<sub>11</sub> to W<sub>88</sub>), and the coefficient C are input to a multiplication circuit 20. The multiplication circuit 20 calculates (W<sub>ij</sub> x C), and quantization steps of the linear quantization circuit 8 are determined by outputs Q<sub>11</sub> to Q<sub>88</sub> from the multiplication circuit 20. Note that the coefficient C has a positive value, and controls the image quality and generation data amount.
0008In practice, the linear quantization circuit 8 calculates X<sub>ij</sub>/Q<sub>ij</sub>, and outputs the calculation results. Assume that the outputs from the linear quantization circuit 8 are represented by G<sub>11</sub> to G<sub>88</sub>. The quantized conversion data G<sub>11</sub> to G<sub>88</sub> are output from a zigzag scanning circuit 10 sequentially from DC components. More specifically, the zigzag scanning circuit 10 outputs, to a variable length coding circuit (VLC) 12, the data G<sub>11</sub> to G<sub>88</sub> in the order of G<sub>11</sub>, G<sub>12</sub>, G<sub>21</sub>, G<sub>31</sub>, G<sub>22</sub>, G<sub>13</sub>, G<sub>14</sub>, G<sub>23</sub>, G<sub>32</sub>, G<sub>41</sub>,..., G<sub>85</sub>, G<sub>86</sub>, G<sub>77</sub>, G<sub>68</sub>, G<sub>78</sub>, G<sub>87</sub>, and G<sub>88</sub>.
0009The VLC 12 calculates a predicted value for, e.g., a DC component G<sub>11</sub> among adjacent pixel blocks, and Huffman-encodes a predicted error from the predicted value. Alternatively, the VLC 12 performs equal-length coding of only this DC component. On the other hand, the VLC encodes AC components G<sub>12</sub> to G<sub>88</sub> other than the DC component G<sub>11</sub> while zigzag-scanning quantization outputs from low-frequency components to high-frequency components. The VLC classifies significant coefficients, which do not correspond to a quantization output = 0, into groups according to their values, and Huffman-encodes a set of a group identification number, and a run length of the number of insignificant coefficients which correspond to a quantization output = 0, and are sandwiched between the immediately preceding significant coefficient and a current significant coefficient. The VLC then adds an equal-length code indicating the position of a value in a group.
0010In general, since high-frequency components in an oblique direction of an image have a low probability of generation, it can be expected that the latter half portion of G<sub>ij</sub> after zigzag scanning often becomes 0. Therefore, variable length codes obtained in this manner can be expected to have a very high compression ratio. Assuming a compression ratio between 1/2 to 1/9 as an average, an image almost free from image quality degradation can be decoded.
0011On the other hand, a transmission path generally has a predetermined transmission capacity per unit time. When one frame must be transmitted during each predetermined period like in a case wherein motion pictures are to be transmitted, it is desired that a code to be output has a fixed number of bits in units of frames or in units of pixel blocks.
0012If the above-mentioned coefficient C is increased, a probability that G<sub>ij</sub> becomes 0 is increased, and a total bit count NB of encoded data is decreased. The relationship between the coefficient C and the total bit count NB is expressed by a monotonous decrease function although it varies depending on images, and it is known that this relationship is represented by a logarithmic curve shown in Fig. 6 for an average image.
0013The above-mentioned JPEG, and the like propose a method of predicting a coefficient C0 for obtaining a desired total bit count NB0. More specifically, a given coefficient C1 is encoded, and a total bit count nb1 of the obtained code is calculated. A predicted value C2 of C0 is calculated based on nb1 and C1. This calculation can be predicted since the logarithmic curve shown in Fig. 6 passes (C1, nb1).
0014Upon several repetitions of this operation, an encoding amount including several % of an error from the desired total bit count NB0 can be obtained.
0015However, processing for repetitively performing encoding to determine the value of the coefficient C0 is time-consuming, and is not suitable for an encoding apparatus, which must transmit one frame during a predetermined period of time like in transmission of motion pictures. In particular, when an image signal having a very high bit rate such as a high-definition television signal is to be processed, such processing is impossible.
SUMMARY OF THE INVENTION
0016The present invention has been made in consideration of the above situation, and has as its object to provide an image encoding apparatus for quantizing conversion data obtained by converting image information onto a frequency region, and encoding the quantized conversion data, wherein the image encoding apparatus can perform high-speed processing, and can set a data amount in units of frames to be a desired data amount.
0017For this purpose, according to one preferred aspect of the present invention, an image encoding apparatus comprises conversion means for converting image information into data on a frequency region, parallel output means for parallelly outputting the converted data to output the converted data of a plurality of channels, quantization means for respectively quantizing the converted data of the plurality of channels output from the parallel output means; operation means for calculating a data amount to be obtained when one of the converted data of the plurality of channels output from the quantization means is encoded, coefficient generation means for generating a quantization coefficient for controlling a quantization step of converted data of other channels of the quantization means, and encoding means for encoding at least one of the converted data of the plurality of channels output from the quantization means.
0018Other objects and advantages of the present invention will become apparent from the detailed description to follow taken in conjunction with the appended claims.
BRIEF DESCRIPTION OF THE DRAWINGS
0019<ul id="ul0001" list-style="none" compact="compact"><li>Fig. 1 is a block diagram showing an arrangement of an image encoding apparatus according to the first embodiment of the present invention;</li><li>Fig. 2 is a schematic block diagram for explaining an arrangement of a conventional encoding method using DCT conversion;</li><li>Fig. 3 is a view showing a pixel block consisting of (8 x 8) image data;</li><li>Fig. 4 is a view showing a DCT-converted data matrix;</li><li>Fig. 5 is a view showing a quantization matrix indicating weighting coefficients of quantization step sizes;</li><li>Fig. 6 is a graph showing the relationship between a control coefficient C and a total bit count;</li><li>Fig. 7 is a block diagram showing an arrangement of an image encoding apparatus according to the second embodiment of the present invention;</li><li>Figs. 8A and 8B are views for explaining a convergence state of the control coefficient C;</li><li>Fig. 9 is a block diagram showing an arrangement of an image encoding apparatus according to the third embodiment of the present invention;</li><li>Fig. 10 is a chart for explaining a control operation of a data transmission order in the apparatus shown in Fig. 9;</li><li>Fig. 11 is a chart for explaining a control operation of a data transmission order of DC and AC components, which are simultaneously obtained;</li><li>Fig. 12 is a block diagram showing an arrangement of an image encoding apparatus according to the fourth embodiment of the present invention; and</li><li>Fig. 13 is a block diagram showing an arrangement of an image encoding apparatus according to the fifth embodiment of the present invention.</li></ul>
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
0020The preferred embodiments of the present invention will be described in detail hereinafter with reference to the accompanying drawings.
0021Fig. 1 is a block diagram showing an arrangement of an encoding apparatus according to the first embodiment of the present invention wherein the present invention is applied to a transmission apparatus for transmitting a television signal.
0022In Fig. 1, an input terminal 20 receives a television signal. The television signal input from the terminal 20 is converted into 8-bit digital data by an A/D converter 22, and is divided into (8 x 8) pixel blocks by an (8 x 8) blocking circuit 26 for performing the same operation as that in the blocking circuit shown in Fig. 2. The television signal is supplied to a DCT conversion circuit 28 in units of blocks.
0023Pixel data D<sub>11</sub> to D<sub>88</sub> of each block are converted by the DCT conversion circuit 28 into a data matrix (X<sub>11</sub> to X<sub>88</sub>) for a frequency region in the same manner as in Fig. 2, and the data matrix is supplied to a zigzag scanning circuit 30. The zigzag scanning circuit 30 performs the same operation as the zigzag scanning circuit 10 shown in Fig. 2, and outputs the DCT-converted data matrix (X<sub>11</sub> to X<sub>88</sub>) in the order of X<sub>11</sub>, X<sub>12</sub>, X<sub>21</sub>, X<sub>31</sub>, X<sub>22</sub>, X<sub>13</sub>, X<sub>14</sub>, X<sub>23</sub>, X<sub>32</sub>, X<sub>41</sub>,..., X<sub>85</sub>, X<sub>86</sub>, X<sub>77</sub>, X<sub>68</sub>, X<sub>78</sub>, X<sub>87</sub>, and X<sub>88</sub>.
0024A quantization matrix generation circuit 36 generates the above-mentioned quantization matrix (W<sub>11</sub> to W<sub>88</sub>). In this embodiment, since already zigzag-scanned data are input to quantization circuits 32a to 32e, quantization matrix data W<sub>11</sub> to W<sub>88</sub> are generated in the order corresponding to the zigzag scanning, and are supplied to multiplication circuits 38a to 38e.
0025The multiplication circuit 38a receives an initial coefficient C1 as the above-mentioned coefficient (control coefficient) C from an initial coefficient generation circuit. In this embodiment, the initial coefficient C1 is set to be "1". When the initial coefficient C1 is set to be "1", since <maths id="math0001" num=""><math display="inline"><mrow><msub><mrow><mtext>W</mtext></mrow><mrow><mtext>ij</mtext></mrow></msub><msub><mrow><mtext> = Q</mtext></mrow><mrow><mtext>ij</mtext></mrow></msub></mrow></math><img file="EP0804036A2_D0001.tif" /></maths>, the multiplication circuit 38a can be omitted, and the quantization matrix data W<sub>11</sub> to W<sub>88</sub> can be directly input to the quantization circuit 32a.
0026In this manner, the quantization circuit 32a obtains quantization codes G1<sub>11</sub> to G1<sub>88</sub> based on the control coefficient C1. These quantized conversion codes G1<sub>11</sub> to G1<sub>88</sub> are input to a VLC 40a.
0027In this embodiment, VLCs 40a to 40d do not output actual encoded data, but output only pieces of total bit count information nb1 to nb4 in units of frames obtained upon execution of the same processing as in the VLC 12 in Fig. 2. The total bit count information nb1 output from the VLC 40a is input to a coefficient operation circuit 44a. Coefficient operation circuits 44a to 44d predict a control coefficient C0 corresponding to a desired total bit count NB0 using the pieces of total bit count information nb1 to nb4 from the VLCs 40a to 40d, the initial coefficient C1, and outputs C2 to C4 from the coefficient operation circuits 44a to 44c, and respectively output control coefficients C2 to C5. The coefficient operation circuits 44a to 44d output the control coefficients C2 to C5, obtained based on conversion data for one frame input to the quantization circuits 32a to 32d, at the input timing of conversion data for the next frame to the quantization circuits 32a to 32d.
0028On the other hand, circuits (1FDLs) 34a to 34d delay the outputs from the zigzag scanning circuit 30 by one frame period. Therefore, the control coefficient C2 output from the coefficient operation circuit 44a is input to the multiplication circuit 38b at the input timing of conversion data for one frame, which are used for obtaining the control coefficient C2, to the quantization circuit 32b. The multiplication circuit 38b calculates (W<sub>ij</sub> x C), and inputs the result to the quantization circuit 32b. More specifically, the quantization circuit 32b performs the second quantization for a given frame, and obtains quantization codes G2<sub>11</sub> to G2<sub>88</sub> based on the control coefficient C2. The quantized conversion codes G2<sub>11</sub> to G2<sub>88</sub> are input to the VLC 40b.
0029The operations of coefficient operation circuits 44b to 44d, the multiplication circuits 38c to 38e, the 1FDLs 34b to 34d, the VLCs 40b to 40d, and the quantization circuits 32c to 32e are respectively the same as those of the coefficient operation circuit 44a, the multiplication circuit 38b, the 1FDL 34a, the VLC 40a, and the quantization circuit 32b. These circuits sequentially update the predicted value of a desired control coefficient for a given frame.
0030Thus, the predicted value C5 of the control coefficient obtained from the coefficient operation circuit 44d can be caused to converge to a value very close to the control coefficient C0 corresponding to the desired total bit count NB0. In this embodiment, the control coefficient C5 is supplied to the multiplication circuit 38e as a final control coefficient C. The output from the multiplication circuit 38e is supplied to the quantization circuit 32e. The quantization circuit 32e quantizes the output from the 1FDL 34d, i.e., conversion data, which are delayed by a total of four frame periods, and supplies the quantized data to a VLC 40e.
0031The VLC 40e actually performs encoding that was described earlier with reference to Fig. 2, and outputs encoded data (DATA). The encoded data are output from an entry buffer 46 at a predetermined bit rate, and are multiplexed with the final control coefficient C by a multiplexer 48. The multiplexed data are then output from a terminal 50 onto a transmission path.
0032The second embodiment of the present invention will be described below.
0033Fig. 7 is a block diagram showing an arrangement of an encoding apparatus according to the second embodiment of the present invention wherein the present invention is applied to a transmission apparatus for transmitting a television signal.
0034Note that the same reference numerals in Fig. 7 denote the same parts as in Fig. 1, and a detailed description thereof will be omitted.
0035In this embodiment, a coefficient operation circuit 41 supplies a predicted initial coefficient as the above-mentioned quantization coefficient (control coefficient) C1 to a multiplication circuit 38a. Note that the predicted initial coefficient will be described later. The coefficient operation circuit 41 predicts a control coefficient C0 corresponding to a desired total bit count NB0 using pieces of total bit count information nb1 to nb4 from VLCs 40a to 40d, the initial coefficient C1, and outputs C2 to C4 of this operation circuit 41, and outputs control coefficients C2 to C5. The coefficient operation circuit 41 outputs the control coefficients C2 to C5, obtained based on conversion data for one frame input to quantization circuits 32a to 32d, at the input timing of conversion data for the next frame to the quantization circuits 32a to 32d.
0036The arrangement and operations of the second embodiment are the same as those of the encoding apparatus of the first embodiment, except for the above-mentioned arrangement and operations.
0037The predicted initial coefficient will now be described.
0038In general, motion pictures have a high correlation among frames. For this reason, when adaptive DCT encoding is performed to set a control coefficient (quantization coefficient) so as to maintain a constant total data amount for one picture (one frame), the control coefficients become almost the same among frames.
0039In this embodiment, by utilizing the high correlation among frames, a value obtained in the immediately preceding frame is used as a control coefficient to be input to the multiplication circuit 38a. Thus, a convergence time of the control coefficients C2 to C5 until an optimum control coefficient is obtained can be shortened, and a more accurate control coefficient can be obtained.
0040A further detailed explanation will be made below with reference to Figs. 8A and 8B.
0041Fig. 8A shows values C1 to C5 when a control coefficient of a given frame is obtained. As can be seen from Fig. 8A, the control coefficient converges to a target optimum control coefficient value while oscillating.
0042Fig. 8B shows values C1 to C5 when a control coefficient of a frame next to the given frame is obtained. The initially input value C1 is the control coefficient C2 of the immediately preceding frame, i.e., the value C2 (this value will be referred to as a predicted initial coefficient) shown in Fig. 8A. It can be regarded that an optimum control coefficient of this frame is almost the same as that of the immediately preceding frame. Thus, since the value C1 becomes closer to the optimum control coefficient, the convergence time can be shortened, and a value closer to the optimum control coefficient can be obtained.
0043As the correlation among frames is higher, images having higher image quality can be obtained upon repetition of this operation.
0044The third embodiment of the present invention will be described below.
0045Fig. 9 is a block diagram showing an arrangement of an encoding apparatus according to the third embodiment of the present invention wherein the present invention is applied to a transmission apparatus for transmitting a television signal.
0046Note that the same reference numerals in Fig. 9 denote the same parts as in Fig. 1, and a detailed description thereof will be omitted.
0047In Fig. 9, VLCs 40a to 40d of this embodiment calculate total data amounts of only AC components after encoding, and output pieces of total bit count information nb1 to nb4 in units of frames. On the other hand, DC components are equal-length coded.
0048The operations up to a multiplication circuit 38e, except for the above-mentioned processing operations of the VLCs 40a to 40d, are the same as those in the first embodiment. The processing operations after the multiplication circuit 38e will be described in detail below.
0049The output from the multiplication circuit 38e is supplied to a quantization circuit 32e. The quantization circuit 32e quantizes outputs from a 1FDL 34d, i.e., at least AC components of conversion data delayed by a total of four frame periods, and supplies quantized data G5<sub>12</sub> to G5<sub>88</sub> to a VLC 40e.
0050The VLC 40e actually performs encoding that was described above with reference to Fig. 2, on AC components G5<sub>12</sub> to G5<sub>88</sub>, and outputs encoded data (DATA).
0051On the other hand, DC components are separated from the outputs from a 1FDL 34c by a DC extraction circuit 51, and are input to a quantization circuit 52. The quantization circuit 52 quantizes a DC component X<sub>11</sub> by a predetermined quantization step independently of the above-mentioned coefficient C, and inputs the quantized component to a coding circuit 54.
0052The coding circuit 54 equal-length codes the above-mentioned DC component by, e.g., predicted differential encoding. DC component data equal-length coded by the coding circuit 54, and AC component data variable-length coded by the VLC 40e, as described above, are respectively input to buffer memories 56 and 46.
0053The read operations of encoded data from the memories 46 and 56 are controlled by a buffer control circuit 58. In this case, control is made as follows. That is, as for encoded data for a given frame, all the DC component encoded data of the frame are read out first, and then, AC component encoded data of the same frame are read out.
0054The relationship between read and write timings of data stored in the memories 46 and 56 will be described below.
0055Fig. 10 is a chart showing the data write timings to the memory 46, i.e., the write timings of AC component encoded data (AC), the data write timings to memory 56, i.e., the write timings of DC component encoded data (DC), and the data read timings from these two memories.
0056Since DC component encoded data (DATA-2) is quantized by the constant quantization step independently of the above-mentioned coefficient C, quantization can be performed before determination of the final coefficient C in the coefficient operation circuit 44d.
0057For this reason, in Fig. 9, DC component data are separated and extracted by the DC extraction circuit 51 at the input side of the 1FDL 34d at the final stage, and are quantized by the quantization circuit 52.
0058Thus, during a period for which AC component encoded data (AC) of a frame of interest are written in the memory 46, DC component encoded data (DC) of the same frame already stored in the memory 56 can be read out prior to the AC component encoded data (AC).
0059On the other hand, Fig. 11 is a chart showing the relationship between read and write timings of data corresponding to AC component encoded data (AC) and DC component encoded data (DC) when the AC and DC component data are quantized and encoded during a single frame period without using the DC extraction circuit 51.
0060In this case, since read access is performed to be delayed by one frame from write access to change the transmission order of data, a capacity for two frames is required for a memory of AC component data.
0061As can be understood from the above description, a memory capacity required when the transmission order of data is changed in units of frames corresponds to two frames according to the conventional arrangement. However, in this embodiment, a memory having a capacity for one frame need only be arranged for AC component encoded data (AC) so as to change the data transmission order.
0062Needless to say, the memories 46 and 56 also have a buffer function for reading out data at a predetermined bit rate.
0063At this time, the buffer control circuit 58 controls to slightly delay the data read start timing of each frame from the write start timing, so that the read addresses of data from the memory 46 do not overtake write addresses.
0064The AC component encoded data (AC) and the DC component encoded data (DC) read out from the memories 46 and 56, as described above, are multiplexed by a multiplexer 48 together with the final coefficient C, and the multiplexed data are output from a terminal 60 onto a transmission path at a predetermined bit rate.
0065The fourth embodiment of the present invention will be described below.
0066Fig. 12 is a block diagram showing an arrangement of an encoding apparatus according to the fourth embodiment of the present invention wherein the present invention is applied to a transmission apparatus for transmitting a television signal.
0067Note that the same reference numerals in Fig. 12 denote the same parts as in Fig. 1, and a detailed description thereof will be omitted.
0068This embodiment assumes an apparatus, which does not permit that the total bit count of each frame after variable-length coding exceeds a desired total bit count NB0 even slightly.
0069Therefore, unlike in the first to third embodiments, a predicted control coefficient is not directly used. This embodiment selects, from control coefficients for a given frame, a control coefficient corresponding to a total bit count after variable-length coding, which is less than and closest to the desired total bit count NB0.
0070The arrangement and operations except for those associated with this selection are the same as those of the first embodiment.
0071The operation associated with the above-mentioned selection will be described below.
0072In Fig. 12, a four-frame period delay circuit (4FDL) 55a, a three-frame period delay circuit (3FDL) 55b, a two-frame period delay circuit (2FDL) 55c, and a one-frame period delay circuit (1FDL) 55d respectively delay control coefficients C1, C2, C3, and C4. With these circuits, the control coefficients C1, C2, C3, and C4 input to a coefficient selector 53 become those for an image of a single frame. These coefficients C1 to C4 are input to the coefficient selector 53 at the input timing of an image of the corresponding frame to a quantization circuit 32e through a 1FDL 34d.
0073The timings of pieces of total bit count information nb1 to nb4 obtained when quantization and encoding are performed using these control coefficients C1 to C4 are adjusted to each other by a 3FDL 57a, a 2FDL 57b, and a 1FDL 57c. More specifically, the pieces of total bit count (data mount) information nb1 to nb4 corresponding to the control coefficients C1 to C4 input to the coefficient selector 53 are input to a coefficient decision circuit 59 immediately before a period for which these control coefficients C1 to C4 are input to the coefficient selector 53.
0074The coefficient decision circuit 59 detects information corresponding to a total bit count, which is less than and closest to the desired total bit count NB0, and supplies 2-bit control information to the coefficient selector 53 according to the detection result.
0075Therefore, the coefficient selector 53 selects a control coefficient corresponding to a total bit count, which is less than and closest to the desired total bit count NB0 upon variable-length coding, from the control coefficients C1 to C4, and outputs the selected coefficient.
0076In this embodiment, the control coefficient output from the coefficient selector 53 is determined as a final control coefficient C, and is supplied to a multiplication circuit 38e. The output from the multiplication circuit 38e is supplied to the quantization circuit 32e. The quantization circuit 32e quantizes outputs from the 1FDL 34d, i.e., conversion data delayed by a total of four frame periods, and supplies the quantized data to a VLC 40e.
0077The VLC 40e actually performs encoding that was described above with reference to Fig. 2, and outputs encoded data (DATA). The encoded data are output from an entry buffer 46 at a predetermined bit rate, and are multiplexed with the final control coefficient C by a multiplexer 48. The multiplexed data are then output from a terminal 50 onto a transmission path.
0078The fifth embodiment of the present invention will be described below.
0079Fig. 13 is a block diagram showing an arrangement of an encoding apparatus according to the fifth embodiment of the present invention wherein the present invention is applied to a transmission apparatus for transmitting a television signal.
0080Note that the same reference numerals in Fig. 13 denote the same parts as in Fig. 1, and a detailed description thereof will be omitted.
0081This embodiment assumes an apparatus, which does not permit that the total bit count of each frame after variable-length coding exceeds a desired total bit count NB0 even slightly, like in the above-mentioned fourth embodiment.
0082The arrangement and operations except for those to be described below are the same as those in the first embodiment.
0083In Fig. 13, VLCs 40a to 40d of this embodiment output pieces of total bit count information in units of frames, and actually encoded codes.
0084Pieces of total bit count information nb1 to nb5 calculated by the VLCs 40a to 40e are input to a rate fixer 43. The rate fixer 43 discriminates, from nb1 to nb5 for a single frame, total bit count information corresponding to a total bit count, which is equal to or smaller than and closest to NB0, and determines a control coefficient giving the total bit count and encoded codes as a final control coefficient and encoded codes.
0085Data buffers 45a to 45j are used for supplying encoded codes d1 to d4, output from the VLCs 40a to 40d for the same frame as a frame corresponding to an encoded code d5 output from a VLC 40e, to a data selection switch 47 at the same timing as the encoded code d5. The data buffers 45a to 45j delay (buffer) control coefficients C1 to C4 giving the four encoded codes d1 to d4 for a single frame, so that these control coefficients are supplied to the data selection switch at the same timing as the encoded codes d1 to d4.
0086The rate fixer 43 controls the data selection switch 47 to output one of the encoded code d5 output from the VLC 40e, and the encoded codes d1, d2, d3, and d4 output from the data buffers 45d, 45g, 45i, and 45j as a final encoded code DATA. In addition to the final encoded code, the data selection switch 47 outputs one of the control coefficient C5 output from a coefficient operation circuit 44d, and the control coefficients C1, C2, C3, and C4 output from the data buffers 45d, 45g, 45i, and 45j as a final control coefficient F.
0087The encoded code DATA and the control coefficient F are multiplexed by a multiplexer 48, and are output from a terminal 50 onto a transmission path.
0088According to the arrangement of each of the above embodiments, since the control coefficient C is not fed back at all, a period required for processing for one frame can become the same as that of processing using a constant control coefficient C although a calculation of the control coefficient C for a single frame is performed five times. Thus, very high-speed processing can be realized.
0089In the third embodiment, the data transmission order can be changed, i.e., DC component encoded data (DC) can be output prior to AC component data using a small memory capacity.
0090Note that various modifications of the present invention may be made without departing from the spirit and the principal features of the invention.
0091For example, in order to realize very high-speed processing, the control coefficient F is determined in units of frames. However, if there is a margin for a processing time, a unit (period) for determining the value of the control coefficient F can be decreased (shortened).
0092In each of the above embodiments, the coefficient operation circuits 44b to 44d predict the desired control coefficient C0 using the coefficients C2 to C4 output from the coefficient operation circuits 44a to 44c, and the pieces of total bit count information nb2 to nb4 obtained when quantization and variable-length coding are performed according to the coefficients C2 to C4. These circuits can more accurately predict the control coefficient using coefficients and total bit count information at the immediately preceding stages in addition to the above-mentioned coefficients and information. For example, if the coefficient operation circuit 44b uses the coefficients C1 and C2 and the pieces of total bit count information nb1 and nb2 so as to calculate the coefficient C3, the coefficient C0 can be predicted more accurately.
0093In each of the above embodiments, in order to parallelly output DCT-converted data X having a time difference of one frame period, the 1FDLs 34a to 34d are series-connected at the output side of the DCT conversion circuit 28 and the zigzag scanning circuit 30. When the number of bits of the DCT-converted data X must be increased, a plurality of 1FDLs may be connected in series at the output side of the (8 x 8) blocking circuit 26 so as to save the memory capacity of the 1FDLs, and the outputs of the 1FDLs may be connected to the DCT conversion circuit and the zigzag scanning circuit.
0094In the fifth embodiment, the encoded code output from the VLCs 40a to 40e for a single frame can be output. In practice, the same effect can be obtained in such a manner that the encoded codes from only the VLCs 40d and 40d can be output, or the encoded codes output from the VLCs 40c to 40e can be selectively output. In this case, the capacity of each data buffer can be decreased as compared to the embodiment shown in Fig. 13, and an increase in hardware size can be suppressed.
0095Therefore, the above-mentioned embodiments are merely examples in all respects, and must not be construed to limit the invention.
0096The scope of the present invention is defined by the scope of the appended claims, and is not limited at all by the specific descriptions of this specification. Furthermore, all the modifications and changes belonging to equivalents of the claims are considered to fall within the scope of the present invention.
Contents4
14 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| EP0239076A2 | Cites | European Patent Office (EPO) | Search report |
| EP0267579A2 | Cites | European Patent Office (EPO) | Search report |
| EP0400756A2 | Cites | European Patent Office (EPO) | Search report |
| EP0401854A2 | Cites | European Patent Office (EPO) | Search report |
| EP0469648A2 | Cites | European Patent Office (EPO) | Search report |
| EP0475251A2 | Cites | European Patent Office (EPO) | Search report |
| DE4034535A1 | Cites | Germany | Search report |
| US4984076A | Cites | United States of America | Search report |
26 members in 4 offices
Priority claims23
| Document | Office | Kind | Date |
|---|---|---|---|
| 1646691 | Japan | A | |
| 1646691 | Japan | – | |
| 11318991 | Japan | A | |
| 11322691 | Japan | A | |
| 11318991 | Japan | – | |
| 11322691 | Japan | – | |
| 28495691 | Japan | A | |
| 28495791 | Japan | A | |
| 28495691 | Japan | – | |
| 28495791 | Japan | – | |
| 92300851 | European Patent Office (EPO) | A | |
| EP19920300851 | – | – | – |
| JP19910016466 | – | – | – |
| JP19910113189 | – | – | – |
| JP19910113226 | – | – | – |
| JP19910284956 | – | – | – |
| JP19910284957 | – | – | – |
| 92300851 | – | – | – |
| 1646691 | – | – | – |
| 11318991 | – | – | – |
| 11322691 | – | – | – |
| 28495691 | – | – | – |
| 28495791 | – | – | – |
Members26
| Document | Office | Kind | |
|---|---|---|---|
| EP0498578A2 | European Patent Office (EPO) | A2 | |
| JPH04255170A | Japan | A | |
| JPH04341063A | Japan | A | |
| JPH04341065A | Japan | A | |
| JPH05122530A | Japan | A | |
| JPH05122531A | Japan | A | |
| EP0498578A3 | European Patent Office (EPO) | A3 | |
| US5251029A | United States of America | A | |
| US5333013A | United States of America | A | |
| US5452007A | United States of America | A | |
| US5528298A | United States of America | A | |
| EP0804036A2This record | European Patent Office (EPO) | A2 | |
| EP0804036A3 | European Patent Office (EPO) | A3 | |
| EP0863672A2 | European Patent Office (EPO) | A2 | |
| EP0863672A3 | European Patent Office (EPO) | A3 | |
| EP0498578B1 | European Patent Office (EPO) | B1 | |
| DE69228841D1 | Germany | D1 | |
| DE69228841T2 | Germany | T2 | |
| EP0804036B1 | European Patent Office (EPO) | B1 | |
| DE69231426D1 | Germany | D1 | |
| JP3135271B2 | Japan | B2 | |
| DE69231426T2 | Germany | T2 | |
| EP0863672B1 | European Patent Office (EPO) | B1 | |
| JP3227170B2 | Japan | B2 | |
| DE69232123D1 | Germany | D1 | |
| DE69232123T2 | Germany | T2 |
35 legal events, as 5 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Notification of lapseLapsedST | ST | FR | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Lapsed because of non-payment of the annual feeLapsedV1 | V1 | NL | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| European patent in force as of 2002-01-01IF02 | IF02 | GB | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Fr: translation filedET | ET | EP | |
| Corresponds to:REF | REF | EP | |
| Divisional application: reference to earlier applicationAC | AC | EP | |
| Designated contracting statesAK | AK | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOS IGRAGRAH | GRAH | EP | |
| Despatch of communication of intention to grantORIGINAL CODE: EPIDOS AGRAGRAG | GRAG | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOS IGRAGRAH | GRAH | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Despatch of communication of intention to grantORIGINAL CODE: EPIDOS AGRAGRAG | GRAG | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Divisional application: reference to earlier applicationAC | AC | EP | |
| Designated contracting statesAK | AK | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 0804036
- Publication, DOCDB
- 0804036
- Publication, EPODOC
- EP0804036
- Application
- 97201674
- Application, DOCDB
- 97201674
- Application, EPODOC
- EP19970201674
Titles3
- German
- Vorrichtung zum Kodieren von Bildern
- English
- Image encoding apparatus
- French
- Dispositif de codage d'images
Classification
- CPC, 10
- H04N19/192
- H04N19/124
- H04N19/126
- H04N19/146
- H04N19/149
- H04N19/15
- H04N19/176
- H04N19/196
- H04N19/30
- H04N19/60
- IPC, 3
- G06T9 00
- H04N7 26
- H04N7 30
Designated states6
- Contracting states, 6
- Germany
- Spain
- France
- United Kingdom
- Italy
- Netherlands (Kingdom of the)