Apparatus for decoding a residual block
1 claim: 1 independent, 0 dependent
- 1変換残差ブロックに含まれたサブ変換残差ブロックのうち特定のサブ変換残差ブロックに少なくとも一つの0でない有効変換係数が存在するか否かを示す前記特定のサブ変換残差ブロックの有効係数フラグ をビ ットストリームから獲得する段階と、 前記特定のサブ変換残差ブロックの有効係数フラグが前記特定のサブ変換残差ブロックに前記有効変換係数が存在することを示す場合、前記ビットストリームから獲得された前記有効変換係数の位置情報及びレベル情報に基づいて前記特定のサブ変換残差ブロックの変換係数を獲得する段階と、 前記変換係数に基づいて前記特定のサブ変換残差ブロックを含む前記変換残差ブロックを逆変換する段階を含み、 前記特定のサブ変換残差ブロックの変換係数は、前記変換残差ブロックに含まれた変換係数のうち一部分であり、 前記有効係数フラグは、前記特定のサブ変換残差ブロックが前記サブ変換残差ブロックのうち最も小さい周波数帯域に該当しない場合に獲得され 、 前記有効係数フラグは、前記特定のサブ変換残差ブロックが前記サブ変換残差ブロックのうち最も小さい周波数帯域に該当する場合に獲得されない ことを特徴とする映像復号化方法。
240 paragraphs, as filed
0001The present invention relates to video coding and decoding, and more specifically to residual block coding and decoding.
0002The development and widespread use of hardware capable of playing and storing high resolution or high quality video content has increased the need for video codecs to effectively encode and decode high resolution or high quality video content. ing. According to existing video codecs, video is encoded by a limited coding scheme based on macroblocks of a predetermined size. Also, existing video codecs use small size conversion units such as 4x4, 8x8 to encode residual blocks.
<p num="0003"> An object of the present invention is that the video codec of the related technology encodes a residual block by using only a conversion unit having a small size such as 4x4, 8x8.</p>
<p num="0004"> The present invention provides a method and an apparatus for more efficiently encoding and decoding effective conversion coefficient information in a large-sized conversion residual block.</p>
<p num="0005"> According to the embodiment of the present invention, the scanning process of the frequency band in which the effective conversion coefficient does not exist in the conversion residual block is generated by generating the effective coefficient flag indicating the existence of the effective conversion coefficient for each divided frequency band unit. Can be skipped and the amount of bits generated for encoding the effective conversion coefficient can be reduced.</p>
0006<figref num="1">It is a block diagram of the image coding apparatus by one Embodiment of this invention.</figref><figref num="2">It is a block diagram of the image decoding apparatus according to one Embodiment of this invention.</figref><figref num="3">It is a figure which illustrates the hierarchical coding unit by one Embodiment of this invention.</figref><figref num="4">It is a block diagram of the video coding part based on the coding unit by one Embodiment of this invention.</figref><figref num="5">It is a block diagram of the image decoding part based on the coding unit by one Embodiment of this invention.</figref><figref num="6">It is a figure which illustrates the coding unit and the prediction unit by depth according to one Embodiment of this invention.</figref><figref num="7">It is a figure which illustrates the relationship of the coding unit and the conversion unit by one Embodiment of this invention.</figref><figref num="8">It is a figure which illustrates the coding information by depth according to one Embodiment of this invention.</figref><figref num="9">It is a figure which illustrates the coding unit by depth according to one Embodiment of this invention.</figref><figref num="10">It is a figure which illustrates the relationship of the coding unit, the prediction unit and the frequency conversion unit by one Embodiment of this invention.</figref><figref num="11">It is a figure which illustrates the relationship of the coding unit, the prediction unit and the frequency conversion unit by one Embodiment of this invention.</figref><figref num="12">It is a figure which illustrates the relationship of the coding unit, the prediction unit and the frequency conversion unit by one Embodiment of this invention.</figref><figref num="13">It is a figure which illustrates the relationship of the coding unit, the prediction unit and the conversion unit by the coding mode information of Table 1.</figref><figref num="14A">It is a reference figure for demonstrating the process of encoding a conversion residual block in a related technical field.</figref><figref num="14B">It is a reference figure for demonstrating the process of encoding a conversion residual block in a related technical field.</figref><figref num="14C">It is a reference figure for demonstrating the process of encoding a conversion residual block in a related technical field.</figref><figref num="15">It is a block diagram of the coding apparatus of the residual block by one Embodiment of this invention.</figref><figref num="16A">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16B">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16C">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16D">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16E">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16F">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16G">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16H">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16I">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="16J">It is a figure which showed the embodiment which divides the conversion residual block into a predetermined frequency band unit by this invention.</figref><figref num="17A">It is a reference figure for demonstrating the coding process of the effective conversion coefficient by one Embodiment of this invention.</figref><figref num="17B">It is a reference figure for demonstrating the coding process of the effective conversion coefficient by one Embodiment of this invention.</figref><figref num="18A">It is a reference figure for demonstrating more concretely about the coding process of the residual block by one Embodiment of this invention.</figref><figref num="18B">It is a reference figure for demonstrating more concretely about the coding process of the residual block by one Embodiment of this invention.</figref><figref num="19A">It is a reference figure which showed the embodiment of the coding information of the conversion residual block generated by the effective coefficient coding part.</figref><figref num="19B">It is a reference figure which showed the embodiment of the coding information of the conversion residual block generated by the effective coefficient coding part.</figref><figref num="20">It is a flowchart which showed the coding method of the residual block by one Embodiment of this invention.</figref><figref num="21">It is a block diagram which showed the decoding apparatus of the residual block by one Embodiment of this invention.</figref><figref num="22">It is a flowchart which showed the decoding method of the residual block by one Embodiment of this invention.</figref>
0007The method of encoding the residual block according to the embodiment of the present invention includes a step of generating a predicted block of the current block, a step of generating a residual block which is the difference between the predicted block and the current block, and the residual. A step of converting the difference block into a frequency domain to generate a conversion residual block, a step of dividing the conversion residual block into predetermined frequency band units, and a non-zero effective conversion coefficient for each of the divided frequency band units. It is characterized by including a step of encoding an effective coefficient flag for each frequency band unit indicating whether or not is present.
0008In the residual block coding method according to the embodiment of the present invention, in the step of dividing the conversion residual block into predetermined frequency band units, the divided unit size of the low frequency band is divided into the high frequency band. It is characterized in that the conversion residual block is divided so as to be smaller than the unit size.
0009In the method of encoding the residual block according to the embodiment of the present invention, at the step of dividing the conversion residual block into predetermined frequency band units, the conversion residual block is divided into four equal parts, and the conversion residual is divided into four equal parts. It is characterized by further dividing the lowest frequency band of the difference blocks into four equal parts.
0010In the method of encoding the residual block according to the embodiment of the present invention, the step of dividing the conversion residual block into predetermined frequency band units is to divide the conversion residual block into frequency band units of the same size. It is a feature.
0011In the method of coding a residual block according to an embodiment of the present invention, in the step of dividing the conversion residual block into predetermined frequency band units, horizontal frequencies and vertical frequencies having the same value are connected at predetermined intervals, and the above-mentioned It is characterized by dividing the conversion residual block.
0012In the method of encoding the residual block according to the embodiment of the present invention, the step of dividing the conversion residual block into predetermined frequency band units utilizes the conversion coefficient constituting the conversion residual block, and the conversion residual. Depending on the stage of determining the video characteristics of the block, the stage of determining the size of the conversion residual block to be divided according to the frequency band using the determined video characteristics, and the determined division size of each frequency band. It is characterized by including a step of dividing the conversion residual block.
0013In the residual block coding method according to the embodiment of the present invention, the step of determining the video characteristics of the conversion residual block is the number and distribution diagram of the conversion coefficients existing in each frequency band of the conversion residual block. It is characterized in that at least one of them is used.
0014In the residual block coding method according to the embodiment of the present invention, the step of encoding the effective coefficient flag for each frequency band unit is the smallest low frequency band unit among the divided frequency band units. It is characterized in that the effective coefficient flag is not separately encoded.
0015In the method of coding the residual block according to the embodiment of the present invention, among the divided frequency band units, the effective conversion coefficient indicating the position of the effective conversion coefficient existing in the frequency band unit in which the non-zero effective conversion coefficient exists. It is characterized by further including a step of encoding a coefficient map.
0016In the method of encoding the residual block according to the embodiment of the present invention, the step of encoding the effectiveness map is within the frequency band unit by a predetermined scan order independent for each divided frequency band unit. read the effective transformation coefficients, especially to encode a flag indicating the position of the effective transformation coefficients of the frequency band unit and symptoms.
0017In the method of encoding the residual block according to the embodiment of the present invention, the step of encoding the effectiveness map is to read the total effective conversion coefficient in the conversion residual block according to a predetermined scan order and divide the effect map. It is characterized by encoding a flag indicating the position of an effective conversion coefficient existing for each frequency band unit.
0018In the method of encoding the residual block according to the embodiment of the present invention, the step of encoding the effectiveness map is to read the effective conversion coefficient in the frequency band unit according to a predetermined scan order, and for each frequency band unit. Set a flag (Tlast) to indicate whether the last effective conversion factor exists, and only for the effective conversion factor that exists in the frequency band unit where the last effective conversion factor exists, the last valid of the total conversion residual block. It is characterized in that a flag indicating whether or not it is a conversion coefficient is set.
0019In the method for encoding a residual block according to an embodiment of the present invention, a plurality of steps for dividing the conversion residual block into predetermined frequency band units are determined in advance according to the size and mode of the frequency band unit. The conversion residual block is divided into the frequency band units by one of the divided forms selected, and the divided form index information indicating the selected divided form is added to the encoded bit stream. It is characterized by further including steps.
0020The residual block encoding device according to one embodiment of the present invention is a prediction unit that generates a prediction block of the current block; a subtraction unit that generates a residual block that is the difference between the prediction block and the current block; A converter that converts the difference block into the frequency domain to generate a conversion residual block; and whether the conversion residual block is divided by frequency band and there is a non-zero effective conversion coefficient for each divided frequency band. It is characterized by including an entropy coding unit; which encodes a band-specific effective coefficient flag indicating whether or not.
0021The method for decoding a residual block according to an embodiment of the present invention determines whether or not an effective conversion coefficient exists for each predetermined frequency band unit obtained by dividing the conversion residual block of the current block from the encoded bit stream. Among the steps of extracting the effective coefficient flag shown, the step of dividing the conversion residual block into predetermined frequency band units, and the frequency band unit of dividing the conversion residual block using the effective coefficient flag, effective conversion It is characterized by including a step of determining a frequency band unit in which a coefficient exists.
0022In the method for decoding a residual block according to an embodiment of the present invention, in the step of dividing the conversion residual block into predetermined frequency band units, the divided unit size of the low frequency band is divided into the high frequency band. It is characterized in that the conversion residual block is divided so as to be smaller than the unit size.
0023In the method for decoding a residual block according to an embodiment of the present invention, at the step of dividing the conversion residual block into predetermined frequency band units, the conversion residual block is divided into four equal parts, and the conversion residual is divided into four equal parts. It is characterized by further dividing the lowest frequency band of the difference blocks into four equal parts.
0024In the method for decoding a residual block according to an embodiment of the present invention, the step of dividing the conversion residual block into predetermined frequency band units is to divide the conversion residual block into frequency band units of the same size. It is a feature.
0025In the method for decoding a residual block according to an embodiment of the present invention, in the step of dividing the conversion residual block into predetermined frequency band units, horizontal frequencies and vertical frequencies having the same value are connected at predetermined intervals, and the above-mentioned It is characterized by dividing the conversion residual block.
0026In the method for decoding a residual block according to an embodiment of the present invention, the step of dividing the conversion residual block into a predetermined frequency band unit is determined in advance from the bit stream according to the size and mode of the frequency band unit. Among the plurality of divided forms obtained, the step of extracting the divided form index information indicating the divided form used for dividing the conversion residual block and the conversion residual using the extracted divided form index information. It is characterized by further including a step of dividing the difference block into frequency band units having the predetermined size and form.
0027In the method for decoding a residual block according to an embodiment of the present invention, an effectiveness map (significance map) indicating the position of the effective conversion coefficient existing in the frequency band unit in which the effective conversion coefficient exists is extracted from the bit stream. It is characterized by further including a step and a step of determining the position of the effective conversion coefficient existing in the frequency band unit in which the effective conversion coefficient exists by using the effectiveness map.
0028In the method of decoding the residual block according to the embodiment of the present invention, the effectiveness map is the position of the effective conversion coefficient within the frequency band unit by a predetermined scan order independent for each divided frequency band unit. It is characterized by showing.
0029In the method of decoding a residual block according to an embodiment of the present invention, the effectiveness map is a valid conversion coefficient detected when the total effective conversion coefficient in the conversion residual block is read in a predetermined scan order. It is characterized by indicating a position.
0030In the method of decoding the residual block according to the embodiment of the present invention, the effectiveness map reads the effective conversion coefficient in the frequency band unit according to a predetermined scan order, and the final effective conversion coefficient for each frequency band unit. Only for the flag (Tlast) indicating whether or not is present, and for the effective conversion coefficient existing in the frequency band unit where the last effective conversion coefficient exists, whether or not it is the last effective conversion coefficient of the total conversion residual block. It is characterized by including a flag indicating.
0031The decoding device for the residual block according to the embodiment of the present invention has an effective conversion coefficient for each frequency band unit obtained by dividing the conversion residual block of the current block into predetermined frequency band units from the encoded bit stream. The parsing unit that extracts the effective coefficient flag indicating whether or not; and the conversion residual block are divided into predetermined frequency band units, and the extracted effective coefficient flag is used to determine the effective conversion coefficient among the frequency band units. It is characterized by including an entropy decoding unit; which determines an existing frequency band unit.
0032The method of encoding the residual block according to another embodiment of the present invention includes a step of generating a conversion residual block by converting the residual block into a frequency domain and a step of dividing the conversion residual block into frequency band units. It is characterized by including a step of encoding an effective coefficient flag for each frequency band in which a non-zero effective conversion coefficient exists.
0033Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. An expression such as "at least one" that precedes the component list modifies the entire component list, not the components on the list individually.
0034In embodiments, the coding unit is used on the encoder side to encode the video data, and on the decoder side to decode the encoded video data. Data unit. The coding depth (depth) indicates the depth at which the coding unit is coded.
0035FIG. 1 is a block diagram of a video coding apparatus according to an embodiment of the present invention. Referring to FIG. 1, the video coding apparatus 100 according to the embodiment of the present invention includes a maximum coding unit dividing unit 110, a coding unit determining unit 120, and an output unit 130.
0036The maximum coding unit division unit 110 divides the current picture or the current slice based on the maximum coding unit of the maximum size coding unit. The current picture or current slice is divided into at least one maximum coding unit. The maximum coding unit according to one embodiment is a data unit having a size of 32x32, 64x64, 128x128, 256x256, etc., and may be a square data unit having a size larger than 8 in the vertical and horizontal directions and is the square of 2. The divided video data is also output to the coding unit determination unit 120 for each at least one maximum coding unit.
0037According to one embodiment of the present invention, the coding unit may be represented using the maximum coding unit and the depth. Depth indicates the number of times the coding unit is spatially divided from the maximum coding unit. As the depth becomes deeper, the depth-specific coding unit is divided from the maximum coding unit to the minimum coding unit, the depth of the maximum coding unit is the highest depth, and the minimum coding unit is the lowest coding unit. Is defined as. Since the size of the depth-specific coding unit decreases as the depth of the maximum coding unit increases, the upper depth coding unit can include a plurality of lower depth coding units.
0038As described above, the video data of the current picture is divided into the maximum coding units according to the maximum size of the coding units, and each maximum coding unit can include a coding unit divided by depth. Since the maximum coding unit according to the embodiment of the present invention is divided according to the depth, the video data of the spatial domain included in the maximum coding unit is also classified hierarchically according to the depth.
0039The maximum depth and the maximum size of the coding unit may be preset to limit the total number of times the height and width of the maximum coding unit can be divided hierarchically.
0040The coding depth determination unit 120 encodes at least one divided region in which the region of the maximum coding unit is divided for each depth, and determines the depth at which the final coding result is output for each at least one divided region. That is, the coding depth determination unit 120 encodes the video data in the coding unit for each depth for each maximum coding unit of the current picture, selects the depth at which the smallest coding error occurs, and determines the coding depth. To do. Therefore, the coded video data of the coding unit corresponding to the determined coding depth is finally output. The coding unit corresponding to the coding depth is also regarded as a coded coding unit.
0041The determined coding depth and the video data encoded by the determined coding depth are output to the output unit 130.
0042The video data in the maximum coding unit is encoded based on the depth-specific coding unit by at least one depth below the maximum depth, and the coding results based on the respective depth-specific coding units are compared. As a result of comparing the coding errors of the coding units by depth, the depth with the smallest coding error is also selected. At least one coding depth is determined for each maximum coding unit.
0043As for the size of the maximum coding unit, the coding unit is hierarchically divided as the depth becomes deeper, and the number of coding units increases. Further, even if the coding units have the same depth included in one maximum coding unit, the coding error related to each data is measured, and the division into lower depths is determined. Therefore, even if the data is included in one maximum coding unit, the coding depth for each depth differs depending on the position, so that the coding depth differs depending on the position. Therefore, one or more coding depths are set for one maximum coding unit, and the data of the maximum coding unit is also divided by the coding units of one or more coding depths.
0044Therefore, the coding depth determination unit 120 according to one embodiment can determine the coding unit according to the tree structure currently included in the maximum coding unit. The "tree-structured coding unit" according to one embodiment includes the coding unit of the depth determined by the coding depth among all the coding units by depth currently included in the maximum coding unit. The coding unit of the coding depth is determined hierarchically by the depth in the same region within the maximum coding unit, and independently in the other regions. Similarly, the coding depth for the current region may be determined independently of the coding depth for other regions.
0045The maximum depth according to one embodiment is an index associated with the number of divisions from the maximum coding unit to the minimum coding unit. The first maximum depth according to one embodiment can indicate the total number of divisions from the maximum coding unit to the minimum coding unit. The second maximum depth according to one embodiment can indicate the total number of depth levels from the maximum coding unit to the minimum coding unit. For example, if the depth of the maximum coding unit is 0, the depth of the coding unit where the maximum coding unit is divided once is set to 1, and the depth of the coding unit divided twice is set to 1. Set to 2. In this case, if the coding unit divided four times from the maximum coding unit is the minimum coding unit, there are depth levels of 0,1,2,3 and 4, so the first maximum depth is , 4, 2nd maximum depth is set to 5.
0046Predictive coding and frequency conversion of the maximum coding unit is performed by the maximum coding unit. Predictive coding and conversion by the maximum coding unit is also based on a deeper coding unit with a depth below the maximum depth. The conversion is performed by the orthogonal transformation method or the integer conversion method.
0047The coding process, including predictive coding and transformation, occurs at any lower depth as the depth increases, because the depth increases the number of lower depth coding units each time the maximum coding unit is divided. It is done for the coding unit. For convenience of explanation, predictive coding and conversion will be described in maximum coding units, based on the current depth coding units.
0048The coding device 100 can select data units of various sizes or forms for coding video data. In order to encode video data, operations such as predictive coding process, conversion process and entropy coding process are performed, and the same data unit is used for all operations or different from each other for each operation. Data units are used.
0049For example, the coding apparatus 100 selects not only a coding unit for coding video data but also a data unit different from the coding unit for predictive coding related to the video data in the coding unit. Can be done.
0050For predictive coding of the maximum coding unit, predictive coding is performed on the coding unit of the coding depth, that is, the coding unit that is not divided into the coding units corresponding to the lower depths. Hereinafter, the data unit on which the prediction is based without further division is referred to as a prediction unit. A partition in which a prediction unit is divided can include a prediction unit, or a data unit in which at least one of the height and width of the prediction unit is divided.
0051For example, if the encoding unit of size 2Nx2N (where N is a positive integer) is not divided any further, it will be the predicted unit of size 2Nx2N, and the partition size will be 2Nx2N, 2NxN, Nx2N, NxN, etc. There may be. The partition type according to one embodiment is not only a symmetric partition in which the height or width of the prediction unit is divided in a symmetric ratio, but also a partition in which the height or width is divided in an asymmetric ratio such as 1: n or n: 1. , Partitions divided into geometric forms, partitions of arbitrary form, etc. can be selectively included. The prediction mode of the prediction unit may be at least one of the intra mode, the inter mode, and the skip mode. For example, intra-mode and inter-mode are performed for partitions of 2Nx2N, 2NxN, Nx2N, NxN size. Also, skip mode is only performed for 2Nx2N size partitions. If there are a plurality of prediction units inside the coding unit, each prediction unit is coded independently, and the prediction mode with the smallest coding error is also selected.
0052Further, the video coding device 100 can perform frequency conversion of video data based on a data unit having a size different from that of the coding unit.
0053For frequency conversion of coding units, frequency conversion is performed based on data units smaller than or of the same size as the coding units. For example, the data unit for conversion may include an intra-mode data unit and an inter-mode data unit.
0054Hereinafter, the processing unit that is the basis of frequency conversion will be referred to as a conversion unit. As for the conversion unit, the height and width of the coding unit are divided, and the conversion depth indicating the number of divisions up to the conversion unit is set. For example, if the conversion unit of the current coding unit of size 2Nx2N is a conversion unit of size 2Nx2N that is the same size as the current coding unit, then the conversion depth is set to 0 and the height of the current coding unit and If the width is each halved and all are 4 ^ 1 size NxN conversion units, then the conversion depth is set to 1 and the height and width of the current coding unit are each quadrant, in all. If it is a conversion unit of size N / 2xN / 2 divided into 4 ^ 2, it is set to conversion depth 2. For example, the conversion hierarchical conversion depth sets a conversion unit having a hierarchical tree structure in which the conversion unit of the upper conversion depth is divided into four conversion units of the lower conversion depth.
0055Like the coding unit, the conversion unit within the coding unit is recursively divided into smaller areas, and the conversion unit is determined independently for each area. Therefore, the residual data of the coding unit is also divided by the conversion unit by the conversion depth and by the conversion unit by the tree structure.
0056The coding information for each coding depth requires not only the coding depth but also prediction-related information and frequency conversion-related information. Therefore, the coding unit depth determination unit 120 includes not only the coding depth that caused the minimum coding error, but also the partition type in which the coding prediction unit of the coding depth is divided into the prediction unit partitions, the prediction mode for each prediction unit, and the prediction mode. The size of the conversion unit for frequency conversion can be determined.
0057A method for determining the coding unit and the partition according to the tree structure of the maximum coding unit according to the embodiment of the present invention will be described later with reference to FIGS. 3 to 12.
0058The coding unit determination unit 120 measures the coding error of the coding unit by depth by using the rate-distortion optimization based on the Lagrangeian multiplier.
0059The output unit 130 outputs the video data of the maximum coding unit encoded based on at least one coding depth determined by the coding unit determination unit 120, and the coding mode information by the coding depth as a bit stream. To do.
0060The encoded video data is acquired by encoding the residual data of the video.
0061The coding mode information based on the coding depth may include the coding depth, the information related to the partition type of the prediction unit, the prediction mode information, and the conversion unit size information.
0062The coding depth information is defined by using the depth-specific division information indicating whether or not to code in the lower depth coding unit without coding with respect to the current depth. If the current depth of the current coding unit is the coding depth, then the current coding unit is coded in the coding unit of the current depth, so that the current depth division information is not divided into lower depths. Is defined in. On the other hand, if the current depth of the current coding unit is not the coding depth, coding using the lower depth coding unit must be attempted, so that the current depth division information is divided into lower depth coding units. It is defined to be.
0063If the current depth is not the coding depth, the coding is done for the coding units divided into lower depth coding units. Since there is at least one lower depth coding unit in one current depth coding unit, the coding is iteratively performed for each lower depth coding unit, and the same depth coding. Coding is performed recursively for the coding unit.
0064Since the coding unit of the tree structure is determined within one maximum coding unit, and at least one coding mode-related information must be determined for each coding depth coding unit, one maximum coding is performed. For the unit, information relating to at least one coding mode is determined. Further, the data of the maximum coding unit is divided hierarchically depending on the depth, and the coding depth may differ depending on the position. Therefore, information related to the coding depth and the coding mode is set for the data.
0065Therefore, the output unit 130 can assign the coding information related to the coding depth and the coding mode to at least one of the coding unit, the prediction unit, and the minimum unit included in the maximum coding unit. it can.
0066The minimum unit according to one embodiment is a square data unit having a size in which the minimum coding unit of the lowest coding depth is divided into four. Alternatively, the smallest unit may be the largest size square data unit contained within any coding unit, prediction unit, and conversion unit contained within the maximum coding unit.
0067For example, the coding information output via the output unit 130 is also classified into coding information for each coding unit and coding information for each prediction unit. The coding information for each coding unit may include prediction mode information and partition size information. The coding information for each prediction unit includes information related to the estimation direction of the intermode, information related to the reference video index of the intermode, information related to the motion vector, information related to the chroma component of the intramode, and information related to the interpolation method of the intramode. Etc. may be included. Further, the information related to the maximum size of the coding unit defined for each picture, each slice, or each GOP, and the information related to the maximum depth may be inserted in the header of the SPS (sequence parameter set) or the bit stream.
0068In the video coding apparatus 100, the lower depth coding unit is a coding unit having a size obtained by halving the height and width of the upper depth coding unit. That is, if the magnitude of the current depth coding unit is 2Nx2N, then the magnitude of the lower depth coding unit is NxN. Therefore, the current coding unit of 2Nx2N size may include up to four lower depth coding units of NxN size.
0069Therefore, the video coding apparatus 100 has the optimum form and size for each maximum coding unit based on the size and maximum depth of the maximum coding unit currently determined in consideration of the characteristics of the picture. The coding unit can be determined and the coding unit by the tree structure can be constructed. In addition, since each maximum coding unit can be coded by various prediction modes and frequency conversion methods, the optimum coding mode can be selected in consideration of the video characteristics of the coding units of various video sizes. It is determined.
0070If an image having a very high image resolution or a very large amount of data is encoded in units of conventional macroblocks, the number of macroblocks per picture becomes excessively large. Therefore, since the amount of compressed information generated for each macroblock also increases, the transmission burden of the compressed information increases, and the data compression efficiency decreases. However, the video coding apparatus 100 according to the embodiment of the present invention may adjust the coding unit in consideration of the video characteristics while increasing the maximum size of the coding unit in consideration of the size of the video. Since it can be done, the video compression efficiency is increased.
0071FIG. 2 illustrates a block diagram of a video decoding apparatus according to an embodiment of the present invention. Referring to FIG. 2, the video decoding apparatus 200 according to the embodiment of the present invention includes a receiving unit 210, a video data and coded information extraction unit 220, and a video data decoding unit 230. For the definitions of various terms such as coding unit, depth, prediction unit, conversion unit, and information related to various coding modes for various processing of the video decoding device 200 according to one embodiment, refer to FIG. 1 and the video coding device 100. It is the same as the one described with reference.
0072The receiver 210 receives the bitstream and parses it. The video data and coding information extraction unit 220 extracts the coded video data related to the coding unit of the tree structure for each maximum coding unit, acquires the extracted video data, and obtains the extracted video data, and the video data decoding unit. Output to 230. The video data and coded information extraction unit 220 can extract information related to the maximum size of the coded unit of the received current picture from the header or SPS related to the current picture.
0073Further, the video data and the coded information extraction unit 220 parses the bit stream and extracts the information related to the coding depth and the coding mode related to the coding unit by the tree structure for each maximum coding unit. The extracted information related to the coding depth and the coding mode is output to the video data decoding unit 230. In other words, the video data of the bitstream is divided into the maximum coding units, and the video data decoding unit 230 decodes the video data of each maximum coding unit.
0074The information related to the coding depth and the coding mode for each maximum coding unit is set for one or more coding depth information, and the information related to the coding mode for each coding depth is the partition type information for the coding unit. , Prediction mode information, size information of conversion unit, and the like may be included. Further, as the coding depth information, the division information for each depth is also extracted.
0075The information related to the coding depth and the coding mode for each maximum coding unit extracted by the coding information extraction unit 220 is obtained for each maximum coding unit at the coding end as in the video coding apparatus 100 according to one embodiment. , Information related to the coding depth and the coding mode determined to generate the minimum coding error by repeatedly coding for each depth-based coding unit. Therefore, the video decoding apparatus 200 can decode the data and restore the video by the coding depth and the coding mode that generate the minimum coding error.
0076Since the coding information related to the coding depth and the coding mode is assigned to a predetermined data unit among the coding unit, the prediction unit, and the minimum unit, the coding information extraction unit 220 is predetermined. Information related to the coding depth and the coding mode can be extracted for each data unit. If the information related to the coding depth and the coding mode of the maximum coding unit is recorded for each predetermined data unit, the predetermined data unit having the same information related to the coding depth and the coding mode is It is inferred that it is a data unit included in the same maximum coding unit.
0077The video data decoding unit 230 decodes the video data of each maximum coding unit based on the coding depth and coding mode information for each maximum coding unit extracted by the coding information extraction unit, and presents the picture. To restore. That is, the video data decoding unit 230 is encoded based on the partition type, the prediction mode, and the conversion unit for each coding unit among the coding units having a tree structure included in the maximum coding unit. The video data can be decoded. The decoding process may include a motion prediction process including intra prediction and motion compensation, and an inverse transformation process. The inverse transformation process is performed by the method of inverse orthogonal transformation or inverse integer transformation.
0078The video data decoding unit 230 performs intra-prediction or motion compensation for each coding unit according to each partition and prediction mode based on the partition type information and prediction mode information of the prediction unit of the coding unit according to the coding depth. be able to.
0079Further, in the video data decoding unit 230, for the reverse conversion for each maximum coding unit, the conversion unit for each coding unit is based on the size information of the conversion unit for each coding depth. Inverse conversion can be performed.
0080The video data decoding unit 230 can determine at least one coding depth of the current maximum coding unit that uses the depth-based division information. If the split information indicates that it is the current depth and will not be split any further, then the current depth is the coding depth. Therefore, the video data decoding unit 230 decodes the coding unit of the current depth with respect to the video data of the current maximum coding unit by using the division type of the prediction unit, the prediction mode, and the conversion unit size information. be able to.
0081For example, among the coding unit, the prediction unit, and the minimum unit, the coding information set for a predetermined data unit is observed, and the data units having the coding information including the same division information are collected to collect video data. It is also regarded as one data unit to be decoded in the same coding mode by the decoding unit 230.
0082The video decoding apparatus 200 recursively encodes each maximum coding unit in the coding process, acquires information related to the coding unit that caused the minimum coding error, and currently decodes the picture. Can be used for. That is, for each maximum coding unit, the coded video data of the coding unit according to the tree structure determined by the optimum coding unit is decoded. The maximum size of the coding unit is determined in consideration of the resolution and the amount of video data.
0083Therefore, even for high-resolution video or video with an excessively large amount of data, the size of the coding unit determined adaptively to the characteristics of the video by using the information related to the optimum coding mode transmitted from the coding end. The video data can be efficiently decoded and restored by the coding mode.
0084A method of determining a coding unit, a prediction unit, and a conversion unit of a tree structure according to an embodiment of the present invention will be described with reference to FIGS. 3 to 13.
0085FIG. 3 is a drawing for explaining the concept of the coding unit according to the embodiment of the present invention.
0086The size of the coding unit is expressed as width x height and may include 32x32, 16x16, 8x8 from the coding unit having a size of 64x64. The size 64x64 coding unit is divided into size 64x64,64x32, 32x64, 32x32 partitions, the size 32x32 coding unit is divided into size 32x32, 32x16, 16x32, 16x16 partition, and the size 16x16 coding unit. Is divided into partitions of size 16x16,16x8,8x16,8x8, and the coding unit of size 8x8 is also divided into partitions of size 8x8,8x4,4x8,4x4.
0087For video data 310, the resolution is set to 1920x1080, the maximum coding unit size is set to 64, and the maximum depth is set to 2. For video data 320, the resolution is set to 1920x1080, the maximum size of the coding unit is set to 64, and the maximum depth is set to 3. For the video data 330, the resolution is set to 352x288, the maximum size of the coding unit is set to 16, and the maximum depth is set to 1. The maximum depth illustrated in FIG. 3 indicates the total number of divisions from the maximum coding unit to the minimum coding unit.
0088When the resolution is high or the amount of data is large, it is desirable that the maximum size of the coding size is relatively large in order not only to improve the compression rate but also to accurately reflect the video characteristics. Therefore, the maximum code size of the video data 310,320, which has a higher resolution than the video data 330, is selected to be 64.
0089Since the maximum depth of the video data 310 is 2, the coding unit 315 of the video data 310 is divided twice from the maximum coding unit having a major axis size of 64 to increase the depth by two layers, and the major axis size. May include up to coding units where is 32,16. On the other hand, since the maximum depth of the video data 330 is 1, the coding unit 335 of the video data 330 is divided once from the coding unit having a major axis size of 16 to increase the depth by one layer, and the major axis. It may include up to a coding unit of size 8.
0090Since the maximum depth of the video data 320 is 3, the coding unit 325 of the video data 320 is divided three times from the maximum coding unit having a major axis size of 64 to increase the depth by three layers, and the major axis size. May include up to coding units where is 32,16,8. The deeper the depth, the smaller the coding unit is used to encode the image, which is suitable for encoding an image containing a more precise scene.
0091FIG. 4 shows a block diagram of a video coding unit based on a coding unit according to an embodiment of the present invention.
0092The video coding unit 400 according to the embodiment includes the work of coding the video data by the coding depth determination unit 120 of the video coding device 100 described above. In other words, the intra prediction unit 410 makes an intra prediction for the prediction unit of the intra mode in the current frame 405, and the motion estimation unit 420 and the motion compensation unit 425 perform the current frame 405 and the reference frame for the prediction unit of the inter mode. Inter-prediction and motion compensation are performed using 495.
0093Residual values are generated based on the prediction units output from the intra prediction unit 410, motion estimation unit 420, and motion compensation unit 425, and the generated residual values pass through the frequency conversion unit 430 and the quantization unit 440. It is output as a quantized conversion coefficient. The quantized conversion coefficient is restored to the residual value again via the inverse quantization unit 460 and the frequency inverse conversion unit 470, and the restored residual value is transferred to the deblocking unit 480 and the loop filtering unit 490. After that, it is post-processed and output as reference frame 495. The quantized conversion coefficient is also output as a bit stream 455 via the entropy coding unit 450.
0094In order to apply to the video coding apparatus 100 according to the embodiment of the present invention, the intra prediction unit 410, the motion estimation unit 420, the motion compensation unit 425, the frequency conversion unit 430, and the quantization unit, which are the components of the video coding unit 400. The unit 440, the entropy coding unit 450, the inverse quantization unit 460, the frequency inverse conversion unit 470, the deblocking unit 480, and the loop filtering unit 490 all consider the maximum depth for each maximum coding unit and have a tree structure. Among the coding units, the video coding process is processed based on each coding unit.
0095In particular, the intra prediction unit 410, the motion estimation unit 420, and the motion compensation unit 425 consider the maximum size and maximum depth of the current maximum coding unit, and among the coding units by the tree structure, the partition of each coding unit and the motion compensation unit 425. The prediction mode is determined, and the frequency conversion unit 430 must determine the size of the conversion unit in consideration of the size of the conversion unit in each coding unit among the coding units in the tree structure.
0096FIG. 5 shows a block diagram of the video decoding unit 500 based on the coding unit according to the embodiment of the present invention.
0097The parsing unit 510 parges the encoded video data and the coding information necessary for decoding from the bit stream 505. The encoded video data is output as dequantized data via the entropy decoding unit 520 and the dequantization unit 530, and the dequantized data passes through the frequency inverse conversion unit 540 in the spatial region. It is restored as the video data of.
0098The intra prediction unit 550 performs intra prediction related to the coding unit in the intra mode for the video data in the spatial region, and the motion compensation unit 560 uses the reference picture 585 to perform motion compensation related to the coding unit in the inter mode. Do.
0099The video data in the spatial region that has passed through the intra prediction unit 550 and the motion compensation unit 560 is post-processed and output via the deblocking unit 570 and the loop filtering unit 580. Further, the video data post-processed through the deblocking unit 570 and the loop filtering unit 580 is output as the reference frame 585.
0100In order to apply to the video decoding device 200 according to the embodiment of the present invention, the parsing unit 510, the entropy decoding unit 520, the dequantization unit 530, the frequency inverse conversion unit 540, which are the components of the video decoding device 500, The intra prediction unit 550, the motion compensation unit 560, the deblocking unit 570, and the loop filtering unit 580 perform operations based on the coding unit by the tree structure for each maximum coding unit.
0101In particular, the intra prediction unit 550 and the motion compensation unit 560 operate based on the partition and the prediction mode for each coding unit according to the tree structure, and the frequency inverse conversion unit 540 operates for each coding unit. Perform movements based on size.
0102FIG. 6 illustrates a depth-coded coding unit and a predicted partition according to an embodiment of the present invention.
0103The video coding device 100 according to one embodiment and the video decoding device 200 according to one embodiment use hierarchical coding units in order to consider video characteristics. The maximum height, maximum width, and maximum depth of the coding unit are adaptively determined by the characteristics of the image, and may be variously set according to the user's request. The size of the coding unit for each depth is also determined by the maximum size of the coding unit set in advance.
0104The hierarchical structure 600 of the coding unit according to one embodiment of the present invention illustrates the case where the maximum height and the maximum width of the coding unit are 64 and the maximum depth is 4. Since the depth increases along the vertical axis of the hierarchical structure 600 of the coding unit according to the embodiment, the height and width of the coding unit for each depth are divided. Further, along the horizontal axis of the hierarchical structure 600 of the coding units, the prediction units and partitions that serve as the prediction base of the coding units by depth are shown.
0105The coding unit 610 is the maximum coding unit in the hierarchical structure 600 of the coding unit, the depth is 0, and the size of the coding unit, that is, the height and width is 64x64. The depth increases along the vertical axis, with a depth 1 coding unit 620 of size 32x32, a depth 2 coding unit 630 of size 16x16, a size 8x8 depth 3 coding unit 640, and a size 4x4. There is a coding unit 650 with a depth of 4. The coding unit 650 at depth 4 of size 4x4 is the smallest coding unit.
0106Prediction units and partitions of coding units are arranged along the horizontal axis for each depth. That is, if the maximum coding unit 610 of size 64x64 at depth 0 is the prediction unit, the prediction unit is the partition 610 of size 64x64, the partition 612 of size 64x32, and the size 32x64 contained in the coding unit 610 of size 64x64. It is also divided into partition 614, partition 616 with a size of 32x32.
0107Similarly, the predictive units of size 32x32 coding unit 620 at depth 1 are size 32x32 partition 620, size 32x16 partition 622, size 16x32 partition 624, size 16x16 partition contained in size 32x32 coding unit 620. It is also divided into 626.
0108The predictive unit of the size 16x16 coding unit 630 at depth 2 is divided into the size 16x16 partition 630, the size 16x8 partition 632, the size 8x16 partition 634, and the size 8x8 partition 636 contained in the size 16x16 coding unit 630. It will also be done.
0109The predictive unit of the size 8x8 coding unit 640 at depth 3 is divided into the size 8x8 partition 640, the size 8x4 partition 642, the size 4x8 partition 644, and the size 4x4 partition 646 contained in the size 8x8 coding unit 640. It will also be done.
0110The size 4x4 coding unit 650 at depth 4 is the smallest coding unit and the lowest depth coding unit. The predictive unit of coding unit 650 is set only for partitions of size 4x4.
0111In order to determine the coding depth of the maximum coding unit 610, the coding depth determination unit 120 of the video coding apparatus according to one embodiment codes for each coding unit of each depth included in the maximum coding unit 610. Must be coded.
0112As for the number of depth-specific coding units for containing data of the same range and size, the number of depth-specific coding units increases as the depth increases. For example, for data contained in one coding unit at depth 1, four coding units at depth 2 are required. Therefore, in order to compare the coding results of the same data by depth, one coding unit of depth 1 and four coding units of depth 2 must be used and coded respectively.
0113In order to perform coding by the current depth among the depths, coding is performed for each predicted unit of the coding unit of the current depth along the horizontal axis of the hierarchical structure 600 of the coding unit, and the coding with the smallest current depth is performed. The error is also selected. Further, as the depth becomes deeper along the vertical axis of the hierarchical structure 600 of the coding unit, coding is performed for each depth and the minimum coding error for each depth is compared, and the minimum coding error is searched. The depth and partition where the minimum coding error occurs in the maximum coding unit 610 are also selected as the coding depth and partition type in the maximum coding unit 610.
0114FIG. 7 illustrates the relationship between the coding unit 710 and the conversion unit 720 according to the embodiment of the present invention.
0115The video coding device 100 and the video decoding device 200 divide the video into coding units smaller than the maximum coding unit or the same size for each maximum coding unit, and encode or decode the video. During the coding process, the size of the conversion unit for frequency conversion may also be selected based on data units that are not greater than each coding unit.
0116For example, when the size of the coding unit 710 is 64x64 size, the conversion unit with the smallest error from the original is the conversion unit of 32x32, 16x16, 8x8, 4x4 size after frequency conversion and coding. Be selected.
0117FIG. 8 illustrates the coded information by depth according to the embodiment of the present invention.
0118The coding information output unit 130 of the video coding apparatus 100 according to the embodiment of the present invention is information related to the coding mode, and information 800 related to the partition type and prediction for each coding unit of the coding depth. Information 810 related to the mode and information 820 related to the conversion unit size can be encoded and transmitted.
0119The information 800 related to the partition type indicates information related to the form of the partition in which the prediction unit of the current coding unit is divided as the data unit for predicting the movement of the current coding unit. For example, the current coding unit CU_0 of size 2Nx2N is divided into one of the following types: partition 802 of size 2Nx2N, partition 804 of size 2NxN, partition 806 of size Nx2N, and partition 808 of size NxN. In that case, the information 800 regarding the partition type of the current coding unit is set to indicate one of the partition 802 of size 2Nx2N, the partition 804 of size 2NxN, the partition 806 of size Nx2N and the partition 808 of size NxN. ..
0120Information 810 related to the prediction mode indicates the motion prediction mode of each partition. For example, it is set whether the partition pointed to by the information 800 related to the division type is motion-predicted in one of the intra-mode 812, the inter-mode 814, and the skip mode 816 via the information 810 related to the prediction mode. ..
0121Further, the information 820 relating to the conversion unit size indicates the conversion unit based on which conversion unit is currently used for frequency conversion. For example, the conversion unit may be one of the first intra conversion unit size 822, the second intra conversion unit size 824, the first inter conversion unit size 826, and the second intra conversion unit size 828.
0122The coding information extraction unit 210 of the video decoding apparatus 200 according to the embodiment of the present invention relates to information 800 related to the partition type, information 810 related to the prediction mode, and conversion unit size for each depth-based coding unit. Information 820 can be extracted and used for decoding.
0123FIG. 9 illustrates a depth-based coding unit according to an embodiment of the present invention.
0124Divided information is used to indicate changes in depth. The division information indicates whether or not the coding unit of the current depth is divided into the coding unit of the lower depth.
0125Referring to FIG. 9, the predictive unit 910 for predictive coding of the coding unit 900 of depth 0 and 2N_0x2N_0 size is 2N_0x2N_0 size partition type 912, 2N_0xN_0 size partition type 914, N_0x2N_0 size partition type 916, It may include a partition type 918 of size N_0xN_0. Only partitions 912,914,916,918 whose predictive units are divided by a symmetrical ratio are illustrated, but as mentioned above, the partition type is not limited to this, but is not limited to asymmetric partitions, arbitrary forms of partitions, and geometrical partitions. It may include a form partition or the like.
0126For each partition type, one 2N_0x2N_0 size partition, two 2N_0xN_0 size partitions, two N_0x2N_0 size partitions, and four N_0xN_0 size partitions must be iteratively predicted encoded. .. For partitions of size 2N_0xN_0, size N_0xN_0, size N_0x2N_0 and size N_0xN_0, predictive coding is performed in intra-mode and inter-mode. Skip mode is performed on partitions of size 2N_0x2N_0.
0127The coding errors of the sizes 2N_0x2N_0, 2N_0xN_0, N_0x2N_0 and N_0xN_0 according to the partition types 912,914,916,918 are compared to determine the smallest coding error of the partition types. If the coding error due to one of the partition types 912,914,916 is the smallest, the prediction unit 910 is not divided into lower depths any further.
0128For example, if the coding error due to partition type 918 of size N_0xN_0 is the smallest, then in operation 920 depth 0 is changed to 1 to divide partition type 918 and the coding unit 930 of partition type of depth 2 and size N_0xN_0. Can be iteratively coded to find the minimum coding error.
0129Predictive unit 940 for predictive coding of depth 1 and size 2N_1x2N_1 (= N_0xN_0) coding unit 930 is partition type 942 of size 2N_1x2N_1, partition type 944 of size 2N_1xN_1, partition type 946 of size N_1x2N_1, size N_1xN_1 It may include partition type 948.
0130For example, if the coding error due to partition type 948 of size N_1xN_1 size is the smallest, then in operation 950 depth 1 is changed to depth 2 to divide partition type 949 into depth 2 and coding unit 960 of size N_2xN_2. On the other hand, it is possible to perform coding repeatedly and search for the minimum coding error.
0131When the maximum depth is d, the division operation by depth is performed until the depth is d-1, and the division information is coded for the depth from 0 to d-2. For example, in operation 970, when the coding unit corresponding to the depth d-2 is divided and the coding is performed up to the depth d-1, the depth d-1 and the size 2N_ (d-1) x2N_ (d-1) Prediction unit 990 for coding unit 980 is partition type 992 of size 2N_ (d-1) x2N_ (d-1), partition of size 2N_ (d-1) xN_ (d-1). It may include a partition type 996 of type 994, size N_ (d-1) x2N_ (d-1), and a partition type 998 of size N_ (d-1) xN_ (d-1).
0132In the partition type, one partition of size 2N_ (d-1) x2N_ (d-1), two partitions of size 2N_ (d-1) xN_ (d-1), two sizes N_ (d-) 1) The minimum is that each partition of x2N_ (d-1) and four sizes N_ (d-1) xN_ (d-1) is coded repeatedly through predictive coding. The partition type that causes the coding error is searched.
0133Even if the coding error due to the partition type 998 of size N_ (d-1) xN_ (d-1) is the smallest, the maximum depth is d, so the coding unit CU_ (d-1) of depth d-1 is The coding depth for the maximum coding unit 900 is currently determined to be d-1 and the partition type is determined to be N_ (d-1) xN_ (d-1) without going through the process of dividing into lower depths. Will be done. Further, since the minimum coding unit 980 having the maximum depth d and the lowest depth d-1 is not divided into lower depths, no division information is set for the coding unit 980.
0134The data unit 999 may be the smallest unit currently associated with the largest coding unit. The minimum unit according to one embodiment may be a square data unit obtained by dividing the minimum coding unit 980 into four parts. Through such an iterative coding process, the video coding apparatus 100 compares the coding errors by depth of the coding unit 900, selects the depth at which the smallest coding error occurs, and determines the coding depth. It can be determined and the partition type and prediction mode can be set to the coding depth coding mode.
0135In this way, the minimum coding errors for each depth of depths 0,1, ..., d-1, d are compared, the depth with the smallest error is selected, and the coding depth is determined. The coding depth, the partition type of the prediction unit, and the prediction mode are encoded and transmitted as information related to the coding mode. Further, since the coding unit must be divided from the depth 0 to the coding depth, only the coding depth division information is set to 0, and the depth-specific division information excluding the coding depth is set to 1. ..
0136The coding information extraction unit 220 of the video decoding apparatus 200 can extract the coding depth related to the coding unit 900 and the information related to the prediction unit, and can use it to decode the coding unit 900. The video decoding apparatus 200 can use the depth-specific division information, determine the depth at which the division information is 0 as the coding depth, and use the information related to the coding mode related to the depth for decoding.
013710 to 12 illustrate the relationship between the coding unit, the prediction unit, and the frequency conversion unit according to the embodiment of the present invention.
0138Referring to FIG. 10, the coding unit 1010 is a coding depth-based coding unit determined by the video coding apparatus 100 according to one embodiment with respect to the maximum coding unit. With reference to FIGS. 11 and 12, the prediction unit 1060 is a partition of the prediction unit of each coding depth by coding depth in the coding unit 1010, and the conversion unit 1070 is a code of each coding depth. It is a conversion unit of the conversion unit.
0139Assuming that the depth of the maximum coding unit is 0 in the coding unit 1010 by depth, the coding unit 1012,1054 has a depth of 1, and the coding unit 1014,1016,1018,1028,1050,1052 is The depth is 2, the coding unit 1020,1022,1024,1026,1030,1032,1038 has a depth of 3, and the coding unit 1040,1042,1044,1046 has a depth of 4.
0140In the prediction unit 1060, some partitions 1014,1016,1022,1032,1048,1050,1052,1054 are in the form in which the coding unit 1010 is divided. That is, partition 1014,1022,1050,1054 is a 2NxN partition type, partition 1016,1048,1052 is an Nx2N partition type, and partition 1032 is an NxN partition type. The predicted units and partitions of the depth-coded coding unit 1010 are smaller or the same as their respective coding units.
0141In the conversion unit 1070, the video data of some conversion units 1052 and 1054 is a data unit having a smaller size than the coding unit, and frequency conversion or frequency inverse conversion is performed. Further, the conversion units 1014,1016,1022,1032,1048,1050,1052,1054 are data units of different sizes or forms as compared with the prediction units and partitions in the prediction unit 1060. That is, the video coding device 100 and the video decoding device 200 can perform prediction and frequency conversion / inverse conversion operations related to the same coding unit based on separate data units.
0142The coding unit by the recursive tree structure is constructed by recursively coding for each unit and determining the optimum coding unit. The coding information may include division information related to the coding unit, partition type information, prediction mode information, and conversion unit size information. Table 1 below shows an example set by the video coding device 100 and the video decoding device 200.
0143<tables num="1"><img id="000002" he="90" wi="158" file="JP5934397B2_D0001.tif" img-format="tif" img-content="drawing" /></tables> The output unit 130 of the video coding apparatus 100 outputs the coding information related to the coding unit by the tree structure, and the coding information extraction unit 220 of the video decoding apparatus 200 according to one embodiment outputs the coding information from the received bit stream. , It is possible to extract the coding information related to the coding unit by the tree structure.
0144The division information indicates whether or not the current coding unit is divided into lower depth coding units. If the division information of the current depth d is 0, the current coding unit is the lower coding unit, and the depth that is not further divided is the coding depth. Mode and conversion unit size information are defined. If the division information requires further division by one step, each of the four divided lower depth coding units must be coded independently.
0145The prediction mode can be indicated by one of an intra mode, an inter mode, and a skip mode. Intra mode and intermode are defined for all partition types, and skip mode is defined only for partition type 2Nx2N.
0146The partition type information includes symmetric partition types 2Nx2N, 2NxN, Nx2N and NxN whose predicted unit height or width is divided by symmetric ratio, and asymmetric partition type 2NxnU, 2NxnD, nLx2N divided by symmetric ratio. , NRx2N can be shown. The asymmetric partition types 2NxnU and 2NxnD are divided into heights of 1: 3 and 3: 1, respectively, and the asymmetric partition types nLx2N and nRx2N are divided into widths of 1: 3 and 3: 1, respectively. Shows the form.
0147The conversion unit size is set to two sizes in the intra mode and two sizes in the inter mode. That is, if the conversion unit division information is 0, the size of the conversion unit is currently set to the size of the coding unit 2Nx2N. If the conversion unit division information is 1, the current coding unit is set to the conversion unit of the divided size. Also, if the partition type related to the current coding unit of size 2Nx2N is a symmetric partition type, the size of the conversion unit is set to NxN, and if it is an asymmetric partition type, it is set to N / 2xN / 2. Will be done.
0148The coding information of the coding unit according to the tree structure according to one embodiment is assigned to at least one of the coding unit, the prediction unit, and the minimum unit of the coding depth. The coding unit of the coding depth may include one or more prediction units and the minimum unit having the same coding information.
0149Therefore, if the coding information held by each of the adjacent data units is confirmed, it is confirmed whether or not the coding information is included in the coding units having the same coding depth. Further, if the coding information possessed by the data unit is used, the coding unit of the coding depth can be confirmed, so that the distribution of the coding depth within the maximum coding unit can be inferred.
0150Therefore, in that case, when the current coding unit is predicted by referring to the peripheral data unit, the coding information of the data unit in the lower depth coding unit adjacent to the current coding unit is directly referred to and used. Will be done.
0151In another embodiment, when the current coding unit refers to the peripheral coding unit and predictive coding is performed, the coding information of the adjacent depth-specific coding units is used, and within the depth-specific coding unit, Peripheral coding units are also referenced by searching for data that is currently adjacent to the coding unit.
0152However, it can be understood that other embodiments of the present invention are not limited thereto. For example, if the current coding unit is predicted based on the coding information of the peripheral data unit, the peripheral data unit of the current coding unit is searched using the coding information of the data unit, and the searched peripheral The coding unit is currently referenced for prediction of the coding unit.
0153FIG. 13 illustrates the relationship between the coding unit, the prediction unit, and the conversion unit based on the coding mode information in Table 1.
0154The maximum coding unit 1300 includes a coding depth coding unit 1302,1304,1306,1312,1314,1316,1318. Since one of the coding units 1318 is a coding unit of the coding depth, the division information is set to 0. The partition type information of the encoding unit 1318 of size 2Nx2N is set to one of the partition types 2Nx2N 1322, 2NxN 1324, Nx2N 1326, NxN 1328, 2NxnU 1332, 2NxnD 1334, nLx2N 1336 and nRx2N 1338.
0155If the partition type information is set to one of the symmetrical partition types 2Nx2N 1322, 2NxN 1324, Nx2N 1326 and NxN 1328, and the conversion unit division information (TU size flag) is 0, then the size is 2Nx2N. If the conversion unit 1342 is set and the conversion unit division information is 1, the conversion unit 1344 of size NxN is set.
0156If the partition type information is set to one of the asymmetric partition types 2NxnU 1332, 2NxnD 1334, nLx2N 1336 and nRx2N 1338, the conversion unit is a conversion unit of size 2Nx2N if the TU size flag is 0. If 1352 is set and the conversion unit division information is 1, the conversion unit 1354 of size N / 2xN / 2 is set.
0157Referring to FIG. 13, the conversion unit division information (TU size flag) has 0 or 1, but the conversion unit division information (TU size flag) is not limited to one bit, and the conversion unit division information (TU size flag) is not limited to one bit. As (TU size flag) increases from 0, the conversion unit can be hierarchically divided to have a tree structure.
0158In that case, the size of the conversion unit actually used is expressed by using the conversion unit division information (TU size flag) of the conversion unit together with the maximum size and the minimum size of the conversion unit. According to one embodiment, the coding apparatus 100 can encode the maximum conversion unit size information, the minimum conversion unit size information, and the maximum conversion unit division information (TU size flag). The result of encoding the maximum conversion unit size information, the minimum conversion unit size information, and the maximum conversion unit division information (TU size flag) is inserted into the SPS. According to one embodiment, the decoding device 200 can decode the video by using the maximum conversion unit size information, the minimum conversion unit size information, and the maximum conversion unit division information (TU size flag).
0159For example, if the current coding unit is size 64x64 and the maximum conversion unit size is 32x32, when the conversion unit division information (TU size flag) is 0, the conversion unit size is 32x32 and the conversion unit division information. When (TU size flag) is 1, the size of the conversion unit is set to 16x16, and when the conversion unit division information (TU size flag) is 2, the size of the conversion unit is set to 8x8.
0160As another example, if the current coding unit is size 32x32 and the minimum conversion unit size is 32x32, then the conversion unit size is set to 32x32 when the conversion unit division information (TU size flag) is 0. Since the size of the conversion unit is not smaller than 32x32, no further conversion unit division information is set.
0161In yet another example, if the current coding unit is size 64x64 and the maximum conversion unit division information is 1, then the conversion unit division information (TU size flag) is 0 or 1 and the other conversion unit. The division information is not set.
0162Therefore, the maximum conversion unit division information (TU size flag) is "MaxTransformSizeIndex", the minimum conversion unit size is "MinTransformSize", and the conversion unit size when the conversion unit division information (TU size flag) is 0 is "RootTuSize". The minimum conversion unit size "CurrMinTuSize" currently possible in the coding unit is defined as the following formula (1).
0163CurrMinTuSize = max (MinTransformSize, RootTuSize / (2 ^ MaxTransformSizeIndex)) (1) Compared with the minimum conversion unit size "CurrMinTuSize" that is currently possible in the coding unit, "RootTuSize", which is the conversion unit size when the conversion unit division information is 0, indicates the maximum conversion unit size that can be adopted on the system. be able to. That is, according to the mathematical formula (1), "RootTuSize / (2 ^ MaxTransformSizeIndex)" is the number of times that "RootTuSize", which is the conversion unit size when the conversion unit division information is 0, corresponds to the maximum conversion unit division information. It is the divided conversion unit size, and "MinTransformSize" is the minimum conversion unit size. Therefore, the small value in "RootTuSize / (2 ^ MaxTransformSizeIndex)" and "MinTransformSize" is the minimum conversion unit size "CurrMinTuSize" currently possible in the coding unit.
0164The maximum conversion unit size RootTuSize according to one embodiment may vary depending on the prediction mode.
0165For example, if the current prediction mode is intermode, RootTuSize is determined by the following formula (2). In formula (2), "MaxTransformSize" indicates the maximum conversion unit size, and "PUSize" indicates the current predicted unit size.
0166RootTuSize = min (MaxTransformSize, PUSize) (2) That is, if the current prediction mode is intermode, the conversion unit size "RootTuSize" when the conversion unit division information is 0 is set to the smaller value of the maximum conversion unit size and the current prediction unit size. ..
0167If the prediction mode for each partition is currently the intra mode, the "RootTuSize" is determined by the following formula (3). "Partition Size" indicates the size of the current partition unit.
0168RootTuSize = min (MaxTransformSize, PartitionSize) (3) That is, if the current prediction mode is the intra mode, the conversion unit size "RootTuSize" when the conversion unit division information is 0 is set to the smaller value of the maximum conversion unit size and the current partition unit size. ..
0169However, the current maximum conversion unit size "RootTuSize" according to one embodiment, which varies depending on the prediction mode for each partition, is only one embodiment, and the factors that determine the current maximum conversion unit size are not limited to this. It must be kept in mind.
0170Hereinafter, the coding process of the residual block performed by the entropy coding unit 450 of the video coding device 400 according to the embodiment of the present invention of FIG. 4 and the entropy decoding unit 520 of the video decoding device 500 of FIG. 5 and The decoding process will be specifically described. In the following description, the coding unit is a term that refers to the block that is currently encoded in the video coding stage, and the decoding unit is the term that refers to the block that is currently decoded in the video decoding stage. Is. The terms coding unit and decoding unit are only the difference between the coding stage and the decoding stage of the video, and the coding unit in the coding stage is the decoding stage. It is also called a decoding unit. For the sake of unity of terms, except in special cases, the coding unit is uniformly referred to in the coding stage and the decoding stage. It is also stated that the method for coding and decoding the residual block according to the embodiment of the present invention and the apparatus thereof are also applied to the coding and decoding of the residual block in a general video codec. Those skilled in the art in the art to which the invention belongs will be able to understand it through the specification.
017114A to 14C are reference diagrams for explaining the process of encoding the transformation residual block in the technical field related to the technical field to which the present invention belongs.
0172With reference to FIG. 14A, frequency conversion is performed on the residual block, and once the conversion residual block 1410 is generated, the conversion residual is scanned while scanning the conversion coefficients in the conversion residual block 1410 according to the zigzag scan order. A significance map showing the location of the valid conversion factors with non-zero values in block 1410 and the level information of the valid conversion factors are encoded. For example, when the size of the conversion residual block is 4x4, the process of encoding the conversion residual block 1420 as shown in FIG. 14B will be described. In FIG. 14B, it is assumed that the conversion factor for the position labeled Χ is an effective conversion factor with a non-zero value. In such a case, as shown in FIG. 14C, it is effective to display the effective conversion coefficient as 1 and the conversion coefficient that is 0 as it is as 0 in the conversion coefficient in the residual block 1430. It is a sex map. The validity map is scanned in a given scan order while being context adaptive binary arithmetic. Coding). As an example, when encoding an effectiveness map as shown in Figure 14C with a raster scanning order that scans from left to right and from top to bottom, the binary string "111111110101000" Context-based coding of the validity map corresponding to. After such an effectiveness map is encoded, the level information of the effective coefficient, that is, the sign (sign) and absolute value (abs) of the effective coefficient is encoded.
0173Such a method of encoding a conversion residual block in a related technical field is suitable for coding a relatively small size conversion residual block of 8x8 size or 4x4 size, but the image according to one embodiment of the present invention. It is not suitable for encoding conversion residual blocks with large sizes such as 16x16, 32x32, 64x64, such as coding devices. This is because, for a large size conversion residual block, any conversion coefficient in the conversion residual block may be scanned and encoded by a related technique as described with reference to FIGS. 14A to 14C. This is because the length of the binary string corresponding to the validity map increases and the coding efficiency can decrease.
0174Therefore, the method for coding the residual block according to the embodiment of the present invention and its apparatus divide the conversion residual block into predetermined frequency band units, and each divided frequency band unit has a non-zero effective conversion coefficient. While encoding the effective coefficient flag for each frequency band unit indicating whether or not it exists, the effective conversion coefficient information, that is, the effectiveness map and the effective coefficient only for the frequency band in which the effective coefficient flag for each frequency band unit has a value of 1. By encoding the level information of, the conversion residual block can be encoded more efficiently.
0175FIG. 15 is a block diagram showing a configuration of a residual block coding device 1500 according to an embodiment of the present invention. The residual block coding device 1500 of FIG. 15 corresponds to or is also included in the entropy coding unit 450 of FIG.
0176Referring to FIG. 15, the residual block coding apparatus 1500 includes a frequency band dividing unit 1510, an effective coefficient flag generation unit 1520, and an effective coefficient coding unit 1530.
0177The frequency band division unit 1510 divides the conversion residual block into predetermined frequency band units. With reference to FIG. 14A again, the conversion residual block 1410 corresponds to the conversion coefficient of the low frequency component as the conversion coefficient is located on the upper left side, and the conversion of the high frequency component as it goes to the lower right side. Corresponds to the coefficient. In general, the conversion coefficients of the conversion residual block 1410 are concentrated on the low frequency component side, and the conversion coefficient of the high frequency component is often 0. That is, among the conversion coefficients of the high frequency component, an effective conversion coefficient having a non-zero value rarely exists (sparse). In particular, frequency conversion is performed in 16x16, 32x32, 64x64 and larger conversion units having a size larger than the conventional 4x4,8x8 size conversion unit, such as the video coding apparatus 400 according to the embodiment of the present invention. In the case of the generated conversion residuals, the distribution of the effective conversion coefficients of the high frequency components becomes even rarer. Therefore, the frequency band dividing unit 1510 divides the conversion residual block into predetermined frequency band units in consideration of the distribution characteristic of the conversion coefficient existing in the conversion residual block depending on the frequency band.
017816A to 16J are diagrams showing an embodiment in which the conversion residual block is divided into predetermined frequency band units according to the present invention.
0179Referring to FIG. 16A, the frequency band division unit 1510 divides the conversion residual block from the low frequency band to the horizontal frequency H1 and the vertical frequency V1 at predetermined frequency intervals to generate frequency band units 1611 to 1614. In FIG. 16A, the case where the horizontal side and the vertical side of the frequency band units 1611 to 1614 have the same length is illustrated, but the length is not limited to this, and the lengths of the horizontal side and the vertical side are mutually exclusive. It may be set differently. If the length of the remaining frequency band from the horizontal frequency H1 to the maximum horizontal frequency is less than the frequency interval corresponding to the horizontal side length of the frequency band units 1611 to 1614, or from the vertical frequency V1 to the maximum vertical frequency. If the length of the remaining frequency band is smaller than the frequency interval corresponding to the length of the vertical side of the frequency band units 1611 to 1614, the frequency band division unit 1510 does not further divide the conversion residual block. , Generates one frequency band unit 1615 corresponding to the high frequency band component. In general, the effective conversion coefficient is concentrated in the frequency band units 1611 to 1614 corresponding to the low frequency component, and the distribution of the effective conversion coefficient of the high frequency component is sparse. Therefore, even if the entire remaining high frequency band components other than the frequency band units 1611 to 1614 generated by dividing the conversion residual block at predetermined frequency intervals are generated in one frequency band unit 1615, the frequency band unit The overhead of encoding the conversion coefficients within 1615 does not increase significantly.
0180Further, as shown in FIG. 16B, the frequency band dividing unit 1510 divides the conversion residual block 1620 from the low frequency band to the horizontal frequency H2 and the vertical frequency V2 in the same manner as in FIG. 16A described above, and divides the frequency. The band units 1621 to 1624 can be generated, and the conversion residual block of the remaining high frequency band components can be divided based on the horizontal frequency H2 and the vertical frequency V2 to generate the frequency band units 1625, 1626, 1627.
0181Further, as shown in FIG. 16C, the frequency band dividing unit 1510 divides the conversion residual block 1630 from the low frequency band to the horizontal frequency H3 and the vertical frequency V3 in the same manner as in FIG. 16A described above, and divides the frequency. By generating the band units 1631 to 1634 and dividing the conversion residual block of the remaining high frequency band components into two with reference to the vertical frequency V3, the frequency band units 1635 and 1636 of the high frequency components can be generated. ..
0182Further, as shown in FIG. 16D, the frequency band dividing unit 1510 divides the conversion residual block 1640 from the low frequency band to the horizontal frequency H4 and the vertical frequency V4 in the same manner as in FIG. 16A described above, and divides the frequency. By generating the band units 1641 to 1644 and dividing the conversion residual block of the remaining high frequency band components into two with reference to the horizontal frequency H4, the frequency band units 1645 and 1646 of the high frequency components can be generated. ..
0183As described above, the distribution of effective conversion coefficients is concentrated in the low frequency band and becomes thinner toward the high frequency band. Therefore, in consideration of such distribution characteristics of the effective conversion coefficient, as shown in FIG. 16E, in the frequency band dividing unit 1510, the divided unit size of the low frequency band is divided into the high frequency band. Divide the conversion residual block 1650 so that it is smaller than the unit size. In other words, the frequency band division unit 1510 divides the low frequency band more finely so that the effective conversion coefficient distributed intensively in the low frequency band can be encoded more precisely, and the high frequency band is divided into finer frequencies. Divide relatively large. For example, as illustrated in FIG. 16E, the frequency band divider 1510 has a predetermined horizontal frequency H5 and vertical frequency V5, a horizontal frequency H6 having a value greater than a multiple of the horizontal frequency H5, and a multiple of the vertical frequency V5. By dividing the conversion residual block 1650 with respect to the vertical frequency V6 having a larger value, the frequency band division unit 1651, 1652, 1653, 1654, 1655, 1656, 1657 can be generated. That is, if the size of the frequency band division unit 1651, 1652, 1653, 1654, 1655, 1656, 1657 is A1651, A1652, A1653, A1654, A1655, A1656, A1657, respectively, then A1651 has the minimum size. , Divide so that A1657 has the maximum size.
0184Further, as shown in FIG. 16F, the frequency band dividing unit 1510 can divide the conversion residual block 1660 into frequency band units 1661 of the same size.
0185Further, as shown in FIG. 16G, the frequency band division unit 1510 divides the conversion residual block 1670 into four equal parts, and further divides the smallest low frequency band unit 1671 among the four equal parts of the frequency band unit. By dividing into four equal parts, a frequency band unit can be generated. The frequency band dividing unit 1510 can further divide the smallest low frequency band unit 1672 into four equal parts among the frequency band units obtained by dividing the low frequency band unit 1671 into four equal parts. Such a division process is repeated until the size of the frequency band unit divided into four equal parts becomes a predetermined size or less.
0186Further, as shown in FIG. 16H, the frequency band division unit 1510 generates a frequency band unit 1681 of a low frequency component from a low frequency to a horizontal frequency H7 and a vertical frequency V7, and the rest of the conversion residual block 1680. The high frequency components of can be separated diagonally to generate frequency band units 1682,1683.
0187Further, as shown in FIGS. 16I and 16J, the frequency band dividing unit 1510 can connect the horizontal frequency and the vertical frequency having a predetermined value to divide the conversion residual blocks 1690 and 1695. In the case of FIG. 16I, the case where the horizontal frequency and the vertical frequency having the same frequency interval are connected is illustrated for the conversion residual block 1690, and in the case of FIG. 16J, the frequency interval becomes higher toward the higher frequency side. Concatenate a1 and b1, a2 and b2, a3 and b3, a4 and b4 to increase, i.e. satisfy the relationship a1 <a2 <a3 <a4 and b1 <b2 <b3 <b4, and convert residual This is the case when block 1695 is divided.
0188Further, as shown in FIGS. 16A to 16J, the frequency band division unit 1510 uses the distribution characteristics of the effective conversion coefficients constituting the conversion residual block, or each of them, instead of using the preset division form. The number of effective conversion coefficients existing for each frequency band is used to judge the video characteristics of the conversion residual block, and the determined video characteristics of the conversion residual block are used to divide the conversion residual block for each frequency band. The size of the frequency unit to be used can be determined. For example, the effective conversion coefficient in the conversion residual block exists only in the frequency band smaller than the horizontal frequency H8 and the vertical frequency V8, and the effective conversion coefficient exists in the frequency band larger than the horizontal frequency H8 and the vertical frequency V8. Assuming that it does not, the frequency band division unit 1510 sets the entire conversion residual block from the low frequency band to the horizontal frequency H8 and the vertical frequency V8 in one frequency band unit, or the frequency band unit of the same size. The frequency band larger than the remaining horizontal frequency H8 and vertical frequency V8 may be set in one frequency band unit.
0189The conversion residual block shown in FIGS. 16A to 16J described above is not limited to the embodiment in which the conversion residual block is divided into frequency band units, and various forms are available to those skilled in the art to which the present invention belongs. It will be understood through the contents described herein that the conversion residual block can be divided by.
0190On the other hand, the mode for dividing the conversion residual block by the frequency band division unit 1510 is set to be the same on the coding side and the decoding side, or various divisions as shown in FIGS. 16A to 16J. After assigning a predetermined index for each form, a division index related to the division information used when encoding the conversion residual block on the coding side can be added to the encoded bit stream. For example, assuming that the integer values from 0 to 9 of the split index (div_index) indicate each split form shown in FIGS. 16A to 16J, the split form currently used when encoding the conversion residual block is , If it has the value of div_index = 5 as shown in FIG. 16F, such split index information can be added to the coding information of the current conversion residual block.
0191Referring again to FIG. 15, after the conversion residual block is divided into predetermined frequency band units by the frequency band division unit 1510, the effective coefficient flag generation unit 1520 has an effective conversion coefficient for each frequency band unit. Generates a valid coefficient flag indicating whether or not. At this time, it is desirable that the effective coefficient flag generation unit 1520 does not separately generate the effective coefficient flag for the smallest low frequency band unit. For example, as shown in FIG. 16A, when the conversion residual 1610 is divided, the effective coefficient flag generator 1520 excludes the smallest low frequency band unit 1611 and the remaining frequency band units 1612, 1613, 1614, Generates an effective coefficient flag for each 1615 to indicate whether or not an effective conversion coefficient exists. For each frequency band unit 1612, 1613, 1614, 1615, the effective coefficient flags are set to Coeff_exist_1612, Coeff_exist_1613, Coeff_exist_1614, Coeff_exist_1615, respectively, and in the frequency band units 1612, 1613, 1614, 1615, the frequency band units 1612, Assuming that only 1613 has an effective coefficient, the effective coefficient flag generator 1520 generates an effective coefficient flag for each frequency band such as Coeff_exist_1612 = 1, Coeff_exist_1613 = 1, Coeff_exist_1614 = 0, Coeff_exist_1615 = 0. .. As mentioned above, in the case of the smallest low frequency band unit 1611, it is generally very likely that an effective conversion factor exists, so for the smallest low frequency band unit 1611, the effective conversion factor is separately set. It is desirable not to generate an effective coefficient flag indicating the existence. In addition, instead of separately generating an effective coefficient flag indicating the existence of the effective conversion coefficient in the smallest low frequency band unit 1611, the coded_block_flag indicating whether or not the effective conversion coefficient exists in the conventional residual block is used. It is possible to indicate the existence of the effective conversion coefficient in the smallest low frequency band unit 1611. The above-mentioned effective coefficient flag generation process is not limited to the division form shown in FIG. 16A, and may be similarly applied to other division forms shown in FIGS. 16B to 16J.
0192On the other hand, the conversion process and the inverse conversion process are independently performed in each frequency band unit by using different conversion and inverse conversion methods. Further, the conversion process and the inverse conversion process are performed only for the frequency band unit having the effective coefficient flag having a value of 1, and are skipped for the frequency band unit having the effective coefficient flag having a value of 0.
0193With reference to FIG. 15 again, the effective coefficient coding unit 1530 has a value of 1 for the effective coefficient flag generated by the effective coefficient flag generation unit 1520, that is, exists in the frequency band unit in which the effective conversion coefficient exists. The effectiveness map showing the position of the effective conversion coefficient and the level information of the effective conversion coefficient are encoded.
019417A and 17B are reference diagrams for explaining the coding process of the effective conversion coefficient according to the embodiment of the present invention. 17A and 17B exemplify the division mode corresponding to FIG. 16E described above in which the conversion residual block is divided into four equal parts and the low frequency band is further divided into four equal parts to generate a frequency band unit. The coding process of the effective conversion coefficient described below is similarly applied to the frequency band units of the other division forms shown in FIGS. 16A to 16J described above.
0195The effective coefficient coding unit 1530 scans the entire conversion residual block to encode the effective conversion coefficient, or scans each frequency band unit independently to encode the effective conversion coefficient in each frequency band. Can be done. Specifically, referring to FIG. 17A, the effective coefficient coding unit 1530 converts the entire conversion residual block 1710 while scanning it in a predetermined scanning order, for example, a raster scanning order as shown. An effectiveness map showing the position of the effective conversion coefficients existing in the residual block 1710 and the magnitude and code information of each effective conversion coefficient can be encoded. In that case, the scanning process of the frequency band unit in which the effective coefficient flag has a value of 0, that is, the frequency band unit in which the effective conversion coefficient does not exist is skipped.
0196Further, referring to FIG. 17B, the effective coefficient coding unit 1530 has an effectiveness map and an effective conversion coefficient for each frequency band unit according to the division form of the conversion residual block 1720 divided by the frequency band division unit 1510. Level information can be encoded.
019718A and 18B are reference diagrams for more specifically explaining the coding process of the residual block according to the embodiment of the present invention. In FIGS. 18A and 18B, it is assumed that the conversion coefficient indicated by Χ is an effective conversion coefficient, and the part without any indication is a conversion coefficient having a value of 0.
0198Referring to FIG. 18A, the frequency band division unit 1510 divides the conversion residual block 1810 by one of the division modes as shown in FIGS. 16A to 16J. Although FIG. 18A exemplifies the division form corresponding to FIG. 16E, the division form is not limited to this, and the conversion residual block coding process described below is also applied to various division forms. The effective coefficient flag generation unit 1520 sets the effective coefficient flags of the frequency band units 1811, 1812, 1813 in which the effective conversion coefficient exists to 1, respectively, and the frequency band units 1814, 1815, 1816, in which the remaining effective conversion coefficients do not exist. Set the effective coefficient flags of 1817 to 0 respectively. The effective coefficient coding unit 1530 encodes the effectiveness map showing the position of the effective conversion coefficient and the level information of each effective conversion coefficient while scanning the entire conversion residual block 1810. As mentioned above, the effectiveness map shows whether the conversion factor for each scan index is a valid conversion factor or 0. The level information of the effective conversion coefficient includes the sign and absolute value information of the effective conversion coefficient. For example, an effectiveness map of frequency band units 1811, 1812, 1813 in which the effective conversion factor exists is a binary string value such as "1000100010101110100100100010001" when scanned by the raster scanning sequence as shown in Figure 18A. Has.
0199Further, as shown in FIG. 18A, when the information of the effective conversion coefficient is encoded while scanning the entire conversion residual block 1810, it is shown whether or not the effective conversion coefficient is the last effective conversion coefficient. The EOB (End-Of-Block) flag is set for the entire total conversion residual block 1810, or for each frequency band. When the EOB flag is set for the total conversion residual 1810, in the conversion coefficient shown in FIG. 18A, only the conversion coefficient corresponding to the last effective conversion coefficient in the scanning order, that is, the conversion coefficient corresponding to the drawing code 1802, has the EOB flag. Has a value of 1. That is, as described above, the effectiveness map according to FIG. 18A has a value such as "1000100010101110100100100010001", but the EOB flags corresponding to such an effectiveness map are all 12 included in "1000100010101110100100100010001". In the effective conversion coefficient, since a value of 1 is set only for the last effective conversion coefficient, it has a value such as "000000000001". That is, all 12 bits are required to represent the EOB flag corresponding to the validity map in Figure 18A.
0200According to another embodiment of the present invention, in order to reduce the number of bits required to represent the EOB flag, the effective coefficient coding unit 1530 has a final effective conversion coefficient for each frequency band unit. Define a flag (Tlast) to indicate whether or not, and set Tlast to 1 if the last effective conversion coefficient exists for each frequency band unit, and set Tlast to 0 if the last effective conversion coefficient does not exist. Then, by setting the EOB flag only for the frequency band unit where Tlast is 1, the bits required to identify the position of the effective conversion coefficient and the last effective conversion coefficient in the total conversion residual block. The number can be reduced. Specifically, referring to FIG. 18A, the effective coefficient coding unit 1530 confirms whether or not the final effective conversion coefficient exists for each of the frequency band units 1811, 1812, and 1813 in which the effective conversion coefficient exists. Then, the Tlast value is set to 1 in the frequency band unit 1812 where the last effective conversion coefficient exists, and the Tlast value is set to 0 in the remaining frequency band units 1811 and 1813. Each bit of the Tlast flag is in each frequency band unit 1811, 1812, based on the order of the conversion coefficients that are scanned for the first time. Assuming that 1813 indicates whether or not the last effective conversion factor exists, Tlast's MSB (most significant bit) indicates whether or not the last effective conversion factor exists in the lowest frequency band unit. , LSB (least significant bit) indicates whether or not the last effective conversion coefficient exists in the frequency band unit 1812. That is, since Tlast has a value of "0" for the frequency band unit 1811, "0" for the frequency band unit 1813, and "1" for the frequency band unit (1812), the bit value of "001" is set as a whole. Will be done. At this time, in general, since the effective conversion coefficient often ends in the lowest frequency band 1811 in the conversion residual block, a separate Tlast value is not assigned to the lowest frequency band 1811. That is, the Tlast value is set only for the remaining frequency bands 1812 and 1813 except for the lowest frequency band 1811 among the frequency band units scanned by the scanning order. In this case, the Tlast flag sets a 2-bit value of "01". The MSB "0" of "01" indicates that the last effective conversion factor of the total conversion residual block does not exist in the frequency band unit 1813, and the LSB "1" of "01" is the frequency band. It is shown that the unit 1812 has the last effective conversion factor of the total conversion residual block. Thus, if the last effective conversion factor of the total conversion residual block is in the lowest frequency band unit 1811, then every bit of Tlast is 0, since the Tlast value has a value of "00". In some cases, it can be identified that the lowest frequency band unit 1811 has the last conversion factor of the total conversion residual block. The Tlast value is set only for 1813. In this case, the Tlast flag sets a 2-bit value of "01". The MSB "0" of "01" indicates that the last effective conversion factor of the total conversion residual block does not exist in the frequency band unit 1813, and the LSB "1" of "01" is the frequency band. It is shown that the unit 1812 has the last effective conversion factor of the total conversion residual block. Thus, if the last effective conversion factor of the total conversion residual block is in the lowest frequency band unit 1811, then every bit of Tlast is 0, since the Tlast value has a value of "00". In some cases, it can be identified that the lowest frequency band unit 1811 has the last conversion factor of the total conversion residual block. The Tlast value is set only for 1813. In this case, the Tlast flag sets a 2-bit value of "01". The MSB "0" of "01" indicates that the last effective conversion factor of the total conversion residual block does not exist in the frequency band unit 1813, and the LSB "1" of "01" is the frequency band. It is shown that the unit 1812 has the last effective conversion factor of the total conversion residual block. Thus, if the last effective conversion factor of the total conversion residual block is in the lowest frequency band unit 1811, then every bit of Tlast is 0, since the Tlast value has a value of "00". In some cases, it can be identified that the lowest frequency band unit 1811 has the last conversion factor of the total conversion residual block.
0201Next, the effective coefficient coding unit 1530 sets the EOB flag only for the frequency band unit in which Tlast is 1, that is, the frequency band unit in which the last effective conversion coefficient of the total conversion residual block exists. Referring to FIG. 18A, the effective coefficient coding unit 1530 sets the EOB flag only for each effective conversion coefficient existing in the frequency band unit 1812 in which Tlast is 1. Since there are all four effective conversion coefficients in the frequency band unit 1812, in this case, the EOB flag has a 4-bit value of "0001". According to another embodiment of the present invention, a Tlast value of 2 to 3 bits is set, an EOB flag is set of 4 bits, and an overall 6 to 7 bit value is set in the total conversion residual block. , Used to identify the position of the effective conversion factor and the last effective conversion factor. Therefore, according to the other embodiment of the present invention, 5 to 6 as compared with the case where the EOB flag is set by using all 12 bits as in "000000000001" according to the above-described embodiment of the present invention. You can save a bit.
0202As yet another embodiment of the present invention, if the EOB flag is set for each frequency band unit, the conversion coefficient corresponding to the drawing code 1801 in the frequency band unit 1811 and the drawing code in the frequency band unit 1812. The EOB flag of the conversion coefficient corresponding to 1802 and the conversion coefficient corresponding to the drawing code 1803 in the frequency band unit 1813 is set to 1. Frequency band unit 1814,1815,1816, for which there is no effective conversion factor For 1817, the EOB flag does not need to be set. In this way, when the EOB flag is set for each frequency band unit in which the effective conversion coefficient exists, the effective conversion coefficient for the next frequency band unit is immediately after the scanning of the effective conversion coefficient in the predetermined frequency band unit is completed. Scanning is started. For example, after the scanning of the last effective conversion factor 1803 of the frequency band unit 1813 is completed, the scanning of the conversion coefficients existing in the frequency band unit 1802 is started. FIG. 18B illustrates the case where the effective conversion coefficient information is encoded independently for each frequency band unit. The effective coefficient coding unit 1530 encodes the effectiveness map showing the position of the effective conversion coefficient and the level information of each effective conversion coefficient while independently scanning each frequency band unit of the conversion residual block 1820. For example, the effectiveness map of frequency band unit 1821 has a binary string value such as "1000100010011" when scanned by the raster scanning sequence as shown in FIG. 18B. Further, the effective coefficient coding unit 1530 sets the EOB flag of the effective conversion coefficient of the drawing code 1831 corresponding to the last effective conversion coefficient among the effective conversion coefficients in the frequency band unit 1821 to 1. Similarly, the effective coefficient coding unit 1530 generates a binary string value such as "101010001" as an effective map of the frequency band unit 1822. Further, the effective coefficient coding unit 1530 sets the EOB flag of the effective conversion coefficient of the drawing code 1832 to 1 among the effective conversion coefficients in the frequency band unit 1822. Similarly, the effective coefficient coding unit 1530 generates a binary string value such as "11001" as an effective map of the frequency band unit 1823, and sets the EOB flag of the effective conversion coefficient of drawing code 1833 to 1. ..
0203On the other hand, the effective coefficient coding unit 1530 has a total conversion balance other than the EOB flag indicating that the last effective conversion coefficient 1831, 1832, 1833 of each frequency band unit is the last effective conversion coefficient of the frequency band unit. In the difference block 1820, a flag (End_Of_WholeBlock) indicating whether or not it is the last effective conversion coefficient can be separately encoded. In the case of FIG. 18B, assuming that the frequency band units are scanned independently in the order of drawing codes 1821, 1822, 1823, 1824, 1825, 1826, 1827, the effective conversion coefficient 1833 is the last of the frequency band units 1823. At the same time as the effective conversion coefficient of, it is the final effective conversion coefficient of the total conversion residual block 1820. Therefore, the EOB flag and the End_Of_WholeBlock flag having an effective conversion coefficient of 1833 both have a value of 1. The last effective conversion factor 1831, 1832 of the frequency band unit 1821, 1822 has the EOB flag having a value of 1, while the End_Of_WholeBlock flag has a value of 0.
0204In this way, when the EOB flag and the End_Of_WholeBlock flag are set for the last effective conversion coefficient for each frequency band unit, the effective conversion coefficient is first used for the frequency band unit at the time of decoding. By determining if is present, scanning in frequency band units with an effective coefficient flag of 0 is skipped. Further, when scanning the conversion coefficient in the frequency band unit in which the effective coefficient flag is 1, that is, the frequency band unit in which the effective conversion coefficient exists, if the conversion coefficient in which the EOB flag is 1 is scanned, the next frequency is used. Bandwise scanning can be started. If the effective conversion coefficient is scanned while the EOB flag is 1 and the End_Of_WholeBlock flag is also 1, the scanning of the effective conversion coefficient of the total conversion residual block is completed. Therefore, the scanning of the conversion residual block is completed. End the process.
020519A and 19B are reference diagrams showing an embodiment of the coding information of the conversion residual block generated by the effective coefficient coding unit 1530.
0206With reference to FIG. 19A, the effective coefficient coding unit 1530 can sequentially encode the effectiveness map and the effective coefficient flag information generated for each frequency band. Assuming that the first frequency band is the smallest frequency band of the conversion residual block, as shown, for the first frequency band, only the effectiveness map 1911 information of the first frequency band is encoded. The coding of the first frequency band flag indicating whether or not the effective conversion coefficient exists in the first frequency band is not performed separately. Further, referring to FIG. 19B, the effective coefficient flag 1921 of each frequency band or the like can be encoded first, and the effectiveness map 1925 of each frequency band can be encoded thereafter.
0207FIG. 20 is a flowchart showing a method of encoding a residual block according to an embodiment of the present invention. Referring to FIG. 20, at step 2010, a prediction block is generated via inter-prediction or intra-prediction by intra-prediction unit 410 or motion compensation unit 425.
0208At stage 2020, the subtractor generates a residual block, which is the difference between the predicted block and the current block.
0209At stage 2030, frequency conversion unit 430 converts the residual block into the frequency domain and generates the conversion residual block. As an example, the residual block can be transformed into the frequency domain via DCT (discrete cosine transform).
0210In step 2040, the frequency band division unit 1510 divides the conversion residual block into predetermined frequency band units. As described above, the frequency band division unit 1510 can divide the conversion residual block in various forms as illustrated in FIGS. 16A to 16J. Specifically, the frequency band division unit 1510 divides the conversion residual block so that the divided unit size of the low frequency band is smaller than the divided unit size of the high frequency band, or the conversion residual. By dividing the block into four equal parts and repeating the process of further dividing the lowest frequency band among the four equal parts of the conversion residual block, the conversion residual block can be divided or frequencies of the same size It is determined by dividing the conversion residual block for each band, dividing the conversion residual block by connecting the horizontal and vertical frequencies having the same value, or using the conversion coefficient that constitutes the conversion residual block. By utilizing the video characteristics of the conversion residual block, the size of the conversion residual block to be divided according to the frequency band can be determined, and the conversion residual block can be divided according to the determined frequency band division size.
0211In step 2050, the effective coefficient flag generation unit 1520 generates an effective coefficient flag for each frequency band unit indicating whether or not a non-zero effective conversion coefficient exists for each divided frequency band unit. It is desirable that such an effective coefficient flag is not separately generated for the smallest frequency band unit among the divided frequency band units of the conversion residual block. Further, the effective coefficient coding unit 1530 has described the frequency band unit in which the effective coefficient flag is not 0, that is, the effective conversion coefficient is included, with reference to FIGS. 17A, 17B, 18A, and 18B. In addition, while scanning the entire conversion residual block in a predetermined scanning order or scanning independently for each frequency band unit, the effectiveness map showing the position of the effective conversion coefficient and the level information of the effective conversion coefficient are coded. To become.
0212According to the method for coding the residual block according to the embodiment of the present invention and the apparatus thereof described above, the conversion residual block is divided into frequency band units and processed by dividing the conversion residual block having a large size of 16x16 or more into frequency band units. The effective conversion coefficient information can be encoded more efficiently by the distribution characteristic of the effective conversion coefficient in the block. That is, according to the present invention, a large-sized conversion residual block is divided into frequency band units, and a conversion residual is generated by generating an effective coefficient flag indicating the existence of an effective conversion coefficient for each divided frequency band unit. It is possible to skip the scanning process of the frequency band in which the effective conversion coefficient does not exist in the block, and to reduce the amount of bits generated for encoding the effective conversion coefficient.
0213FIG. 21 is a block diagram showing a residual block decoding device according to an embodiment of the present invention. The residual block decoding device 2100 according to one embodiment of the present invention corresponds to or is included in the entropy decoding unit 520 of FIG.
0214Referring to FIG. 21, the residual block decoding device 2100 includes a frequency band dividing unit 2110, an effective frequency band determining unit 2120, and an effective coefficient decoding unit 2130.
0215The frequency band dividing unit 2110 divides the conversion residual block into predetermined frequency band units. Specifically, in the frequency band dividing unit 2110, as illustrated in FIGS. 16A to 16J described above, the divided unit size of the low frequency band is smaller than the divided unit size of the high frequency band. By repeating the process of dividing the conversion residual block into four equal parts, or dividing the conversion residual block into four equal parts and further dividing the lowest frequency band of the four equal parts of the conversion residual block into four equal parts. , Divide the conversion residual block, or divide the conversion residual block in frequency band units of the same size, or connect the horizontal and vertical frequencies with the same value to divide the conversion residual block, Alternatively, the video characteristics of the conversion residual block determined by using the conversion coefficients constituting the conversion residual block are used to determine the size of the conversion residual block to be divided according to the frequency band, and the determined frequency band. The conversion residual block can be divided according to the separate division size. Among the various division forms, the form in which the conversion residual block is divided depends on the form determined in advance by the encoding device and the decoding device, or a predetermined division index is set for each of the various division forms. If the division index information used for dividing the current conversion residual block is added to the bitstream at the time of encoding, the frequency band division unit 2110 will use the division index information included in the bitstream to display the current conversion residual block. It is also possible to determine what form the is divided into.
0216The effective frequency band determination unit 2120 extracts an effective coefficient flag indicating whether or not an effective conversion coefficient exists for each frequency band unit in which the conversion residual block is divided from the bit stream. Using such an effective coefficient flag, the effective frequency band determination unit 2120 can determine the frequency band unit in which the effective conversion coefficient exists among the frequency band units obtained by dividing the conversion residual block. For example, assuming that the encoded conversion residual block is as shown in FIG. 18B above, the effective coefficient flag has a value of 1 only in the frequency band unit indicated by the drawing reference numerals 1821, 1822, 1823. , The frequency band unit displayed by the drawing code 1824,1825,1826,1827 has a value of 0 for the effective coefficient flag, so that the effective frequency band determination unit 2120 is valid from the extracted frequency band-specific effective coefficient flag. The frequency band unit in which the conversion coefficient exists is determined.
0217The effective coefficient decoding unit 2130 decodes the effective conversion coefficient within the frequency band unit determined by the effective frequency band determination unit 2120 that the effective conversion coefficient exists. Specifically, the effective coefficient decoding unit 2130 extracts an effective map showing the position of the effective conversion coefficient and the level information of the effective conversion coefficient from the bit stream. Then, as shown in FIGS. 17A and 17B described above, the effective coefficient decoding unit 2130 scans the entire conversion residual block, or scans the divided frequency band units independently in a predetermined scanning order. The effectiveness map information extracted while scanning each frequency band unit is used to determine the position of the effective conversion coefficient in the conversion residual block, and the level information is used to restore the value of the effective conversion coefficient. ..
0218FIG. 22 is a flowchart showing a method of decoding a residual block according to an embodiment of the present invention.
0219In step 2210, the effective frequency band determination unit 2120 sets an effective coefficient flag indicating whether or not an effective conversion coefficient exists for each predetermined frequency band unit obtained by dividing the conversion residual block of the current block from the encoded bit stream. Is extracted.
0220In step 2220, the frequency band division unit 2110 divides the conversion residual block into predetermined frequency band units. The frequency band dividing unit 2110 is a conversion residual block so that the divided unit size of the low frequency band is smaller than the divided unit size of the high frequency band, as illustrated in FIGS. 16A to 16J described above. The conversion residual block is divided into four equal parts, or the conversion residual block is divided into four equal parts by repeating the process of further dividing the lowest frequency band into four equal parts. Or divide the conversion residual block in frequency band units of the same size, or connect the horizontal and vertical frequencies with the same value to divide the conversion residual block, or configure the conversion residual block. The size of the conversion residual block to be divided by frequency band is determined by using the video characteristics of the conversion residual block determined by using the conversion coefficient to be performed, and the conversion residual block is determined by the determined frequency band division size. Is divided. Such a division form is determined in the same manner as the coding side as described above, by a predetermined form or by using the division index information separately added to the bit stream. The order of performance of stages 2210 and 2220 may be changed.
0221In step 2230, the effective frequency band determination unit 2110 uses the extracted effective coefficient flag to determine the frequency band unit in which the effective conversion coefficient exists among the divided frequency band units. The effective coefficient decoding unit 2130 restores the effective conversion coefficient by using the effectiveness map related to the frequency band unit determined to have the effective coefficient and the level information of the effective conversion coefficient.
0222The video coding / decoding method according to the present invention can also be embodied as a computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices in which data readable by computer systems is stored. Examples of computer-readable recording media include ROM (read-only memory), RAM (random-access memory), CD-ROM, magnetic tape, floppy (registered trademark) disks, optical data storage devices, and the like. .. Further, the computer-readable recording medium is distributed to the computer system connected to the network, and the computer-readable code is stored and executed in a distributed manner.
0223The present invention has been described above, focusing on its preferred embodiments. Those skilled in the art to which the present invention belongs will be able to understand that it is embodied in a modified form without departing from the essential properties of the present invention. Therefore, the disclosed embodiments must be considered from a descriptive point of view, not from a limiting point of view. The scope of the present invention is set forth in the claims, not in the above description, and any differences within the equivalent scope shall be construed as included in the present invention.
0224Hereinafter, the means taught by the present application will be listed by way of example.
0225(Appendix 1) In the method of decoding the residual block, From the encoded bitstream, the stage of extracting the effective coefficient flag indicating whether or not the effective conversion coefficient exists for each predetermined frequency band unit obtained by dividing the conversion residual block of the current block, and The step of dividing the conversion residual block into predetermined frequency band units, and Decoding of the residual block, which comprises a step of determining the frequency band unit in which the effective conversion coefficient exists among the frequency band units obtained by dividing the conversion residual block by using the effective coefficient flag. Method.
0226(Appendix 2) The step of dividing the conversion residual block into predetermined frequency band units is Decoding of the residual block according to Appendix 1, wherein the conversion residual block is divided so that the divided unit size of the low frequency band is smaller than the divided unit size of the high frequency band. Method.
0227(Appendix 3) The step of dividing the conversion residual block into predetermined frequency band units is The method for decoding a residual block according to Appendix 1, wherein the conversion residual block is divided into four equal parts, and the lowest frequency band of the four equal parts is further divided into four equal parts. ..
0228(Appendix 4) The step of dividing the conversion residual block into predetermined frequency band units is The method for decoding a residual block according to Appendix 1, wherein the conversion residual block is divided into frequency band units of the same size.
0229(Appendix 5) The step of dividing the conversion residual block into predetermined frequency band units is The method for decoding a residual block according to Appendix 1, wherein horizontal frequencies and vertical frequencies having the same value are connected at predetermined intervals to divide the conversion residual block.
0230(Appendix 6) The step of dividing the conversion residual block into predetermined frequency band units is From the bit stream, the division form index information indicating the division form used for the division of the conversion residual block is extracted from the plurality of division forms predetermined according to the size and form of the frequency band unit. Stages and Addendum, which further includes a step of dividing the conversion residual block into frequency band units having the predetermined size and form by using the extracted division form index information. Decoding method of the residual block described in 1.
0231(Appendix 7) From the bitstream, a step of extracting an effectiveness map showing the position of the effective conversion coefficient existing in the frequency band unit in which the effective conversion coefficient exists, and The residual block according to Appendix 1, further comprising a step of determining the position of the effective conversion coefficient existing in the frequency band unit in which the effective conversion coefficient exists by using the effectiveness map. Decryption method.
0232(Appendix 8) The effectiveness map is The method for decoding a residual block according to Appendix 7, wherein the position of the effective conversion coefficient within the frequency band unit is indicated by a predetermined scan order that is independent for each of the divided frequency band units.
0233(Appendix 9) The effectiveness map is The method for decoding a residual block according to Appendix 7, wherein the position of the effective conversion coefficient detected when the total effective conversion coefficient in the conversion residual block is read is indicated by a predetermined scan order.
0234(Appendix 10) The effectiveness map reads the effective conversion coefficient within the frequency band unit according to a predetermined scan order, and a flag indicating whether or not the final effective conversion coefficient exists for each frequency band unit; and the final effective conversion coefficient. The residual block according to Appendix 7, characterized in that it contains a flag; indicating whether or not it is the last effective conversion coefficient of the total conversion residual block only for the effective conversion coefficient existing in the frequency band unit in which is present. Decryption method.
0235(Appendix 11) In the method of encoding the residual block, At the stage of generating the predicted block of the current block, The stage of generating the residual block, which is the difference between the predicted block and the current block, The step of converting the residual block into the frequency domain to generate the conversion residual block, and The step of dividing the conversion residual block into predetermined frequency band units, and The code of the residual block, which comprises a step of encoding an effective coefficient flag for each frequency band unit indicating whether or not a non-zero effective conversion coefficient exists for each of the divided frequency band units. Method of conversion.
0236(Appendix 12) The step of coding the effective coefficient flag for each frequency band unit is The method for coding a residual block according to Appendix 11, wherein the effective coefficient flag is not separately encoded for the smallest low frequency band unit among the divided frequency band units.
0237(Appendix 13) Addendum, which further includes a step of encoding an effectiveness map indicating the position of the effective conversion coefficient existing in the frequency band unit in which the non-zero effective conversion coefficient exists among the divided frequency band units. The method for encoding the residual block described in 11.
0238(Appendix 14) The step of encoding the validity map is It is characterized in that the effective conversion coefficient in the frequency band unit is read by a predetermined scan order independent for each divided frequency band unit, and a flag indicating the position of the effective conversion coefficient in the frequency band unit is encoded. The method for encoding the residual block according to Appendix 13.
0239(Appendix 15) The step of encoding the validity map is According to a predetermined scan order, the effective conversion coefficient in the frequency band unit is read, a flag indicating whether or not the last effective conversion coefficient exists for each frequency band unit is set, and the frequency in which the last effective conversion coefficient exists. The method for encoding a residual block according to Appendix 13, which comprises setting a flag indicating whether or not it is the last effective conversion coefficient of the total conversion residual block only for the effective conversion coefficient existing in the band unit. ..
<p num="0240"><patcit num="1"><text>Korean Patent Application Publication No. 10-2008-0092940</text></patcit></p>
37 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| WO2009049260A1 | Cites | World Intellectual Property Organization (WIPO) |
| JP08280021A | Cites | Japan |
| JP2006501740A | Cites | Japan |
152 members in 23 offices
Members152
| Document | Office | Kind | |
|---|---|---|---|
| US2011096834A1 | United States of America | A1 | |
| KR20110046016A | Republic of Korea | A | |
| CA2777587A1 | Canada | A1 | |
| CA2883913A1 | Canada | A1 | |
| CA2883920A1 | Canada | A1 | |
| CA2883923A1 | Canada | A1 | |
| CA2883978A1 | Canada | A1 | |
| WO2011053020A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2011053020A3 | World Intellectual Property Organization (WIPO) | A3 | |
| AU2010313967A1 | Australia | A1 | |
| MX2012004803A | Mexico | A | |
| EP2471266A2 | European Patent Office (EPO) | A2 | |
| CN102598664A | China | A | |
| JP2013509782A | Japan | A | |
| RU2493669C1 | Russian Federation | C1 | |
| US8811479B2 | United States of America | B2 | |
| AU2010313967B2 | Australia | B2 | |
| US2014314149A1 | United States of America | A1 | |
| KR101457894B1 | Republic of Korea | B1 | |
| AU2014268181A1 | Australia | A1 | |
| RU2013128302A | Russian Federation | A | |
| AU2015201329A1 | Australia | A1 | |
| AU2015201330A1 | Australia | A1 | |
| AU2015201452A1 | Australia | A1 | |
| AU2015201452B2 | Australia | B2 | |
| JP5711247B2 | Japan | B2 | |
| US2015156502A1 | United States of America | A1 | |
| US2015156503A1 | United States of America | A1 | |
| US2015156504A1 | United States of America | A1 | |
| US2015156505A1 | United States of America | A1 | |
| JP2015109685A | Japan | A | |
| EP2471266A4 | European Patent Office (EPO) | A4 | |
| CN104780370A | China | A | |
| CN104780371A | China | A | |
| CN104780372A | China | A | |
| CN102598664B | China | B | |
| CN104796707A | China | A | |
| CN104796708A | China | A | |
| EP2899979A1 | European Patent Office (EPO) | A1 | |
| EP2899980A1 | European Patent Office (EPO) | A1 | |
| EP2899981A1 | European Patent Office (EPO) | A1 | |
| EP2903279A1 | European Patent Office (EPO) | A1 | |
| JP2015144465A | Japan | A | |
| JP2015144466A | Japan | A | |
| JP2015144467A | Japan | A | |
| RU2564631C2 | Russian Federation | C2 | |
| ZA201203084B | South Africa | B | |
| AU2014268181B2 | Australia | B2 | |
| AU2015201330B2 | Australia | B2 | |
| ZA201504999B | South Africa | B | |
| BR112012009722A2 | Brazil | A2 | |
| JP5934397B2This record | Japan | B2 | |
| JP5941176B2 | Japan | B2 | |
| JP5941177B2 | Japan | B2 | |
| JP5941178B2 | Japan | B2 | |
| AU2015201329B2 | Australia | B2 | |
| AU2015201330C1 | Australia | C1 | |
| RU2015108338A | Russian Federation | A | |
| RU2015108351A | Russian Federation | A | |
| RU2015108352A | Russian Federation | A | |
| CA2777587C | Canada | C | |
| ZA201504997B | South Africa | B | |
| ZA201504998B | South Africa | B | |
| RU2607247C2 | Russian Federation | C2 | |
| RU2607249C2 | Russian Federation | C2 | |
| RU2607250C2 | Russian Federation | C2 | |
| AU2015201329C1 | Australia | C1 | |
| CN104780370B | China | B | |
| CA2883913C | Canada | C | |
| CA2883978C | Canada | C | |
| CN104796708B | China | B | |
| CA2883923C | Canada | C | |
| MY166069A | Malaysia | A | |
| ZA201505000B | South Africa | B | |
| CN104796707B | China | B | |
| CN104780372B | China | B | |
| EP2471266B1 | European Patent Office (EPO) | B1 | |
| EP2903279B1 | European Patent Office (EPO) | B1 | |
| EP2899979B1 | European Patent Office (EPO) | B1 | |
| EP2899981B1 | European Patent Office (EPO) | B1 | |
| EP2899980B1 | European Patent Office (EPO) | B1 | |
| DK2471266T3 | Denmark | T3 | |
| DK2899979T3 | Denmark | T3 | |
| DK2899981T3 | Denmark | T3 | |
| DK2903279T3 | Denmark | T3 | |
| LT2471266T | Lithuania | T | |
| LT2899979T | Lithuania | T | |
| LT2899981T | Lithuania | T | |
| LT2903279T | Lithuania | T | |
| PT2471266T | Portugal | T | |
| DK2899980T3 | Denmark | T3 | |
| PT2903279T | Portugal | T | |
| PT2899979T | Portugal | T | |
| PT2899981T | Portugal | T | |
| ES2687471T3 | Spain | T3 | |
| ES2687479T3 | Spain | T3 | |
| LT2899980T | Lithuania | T | |
| PT2899980T | Portugal | T | |
| SI2471266T1 | Slovenia | T1 | |
| SI2899979T1 | Slovenia | T1 |
14 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 |
Numbers
- Publication
- 5934397
- Application
- 5065
Titles2
- Japanese
- 映像復号化方法
- English
- Video decoding method
Classification
- CPC, 14
- H04N19/44
- H04N19/119
- H04N19/46
- H04N19/109
- H04N19/13
- H04N19/136
- H04N19/176
- H04N19/18
- H04N19/60
- H04N19/61
- H04N19/63
- H04N19/635
- H04N19/70
- H04N19/96
- IPC, 2
- H04N19 61
- H04N19 70
