Method and apparatus for coding video, and method and apparatus for decoding video accompanied by inter prediction using collocated image.
Abstract
The present invention suggests a method for inter prediction comprising the steps of: deciding a collocated block with respect to a current block of a current image from blocks of an image which is recovered prior to the current image; deciding one collocated reference list by preliminarily confirming whether a first reference list is referenced from reference lists of the collocated block, and then selectively confirming whether a second reference list is referenced according to whether the first reference list is referenced; and performing inter prediction with respect to the current block by using a reference block of the current block, which is decided according to movement information of the collocated reference list.

Term
No projected expiry on record.
- Priority
- Filed
- Granted
- Today
3 claims: 3 independent, 0 dependent
- 1INSTITUTO MEXICANO DE LA PROPIEDAD •, INDUSTRIAL MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY CLAIMS Having described the invention as above, the content of the following claims is claimed as property:REIVINDICACIONES Habiéndose descrito la invención como antecede, se reclama como propiedad lo contenido en las siguientes reivindicaciones: 1. A video decoding method, characterized in that it comprises: 1. Un método de decodificación de video, caracterizado porque comprende: obtain, from a stream of bits, co-located image list information, indicating whether to determine a reference image of a current block to determine a co-located image of the current block when using LO list and list Ll, and a index of reference of the image co- localized;when images of reference, what are available for prediction of block current, to be sent before to a current image including the current block, selecting a motion vector that corresponds to a reference list of the current block, between a motion vector LO and a motion vector L1 of the co-located block;obtener, de una corriente de bitios, información de lista de imagen co-localizada, que indica si se determina una imagen de referencia de un bloque actual para determinar una imagen co-localizada del bloque actual al utilizar lista LO y lista Ll, y un índice de referencia de la imagen co- localizada;cuando imágenes de referencia, que están disponibles para predicción del bloque actual, se van a enviar antes a una imagen actual incluyendo el bloque actual, seleccionar un vector de movimiento que corresponde a una lista de referencia del bloque actual, entre un vector de movimiento LO y un vector de movimiento L1 del bloque colocalizado;cuando imágenes de referencia, que están disponibles para predicción del bloque actual, se van a enviar después que la imagen actual, y cuando la información de lista de imagen co-localizada indica que es la lista LO, seleccionar el vector de movimiento L1 de conformidad con la when reference images, which are available for prediction of the current block, are to be sent after the current image, and when the co-located image list information indicates that it is the LO list, select the motion vector L1 accordingly with the IMPI IMPI INSTITUTO MEXICANO DE LA PROPERTY INDUSTRIAL LI list of co-located block;INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL lista LI del bloque co-localizado;cuando imágenes de referencia, que están disponibles para predicción del bloque actual, se van a enviar después que la imagen actual, y cuando la información de lista de imagen co-localizada indica que es la lista Ll, seleccionar el vector de movimiento LO de conformidad con la lista LO del bloque co-local izado ,determinar un candidato de pronosticador de vector de movimiento de conformidad con el bloque co-localizado al utilizar el vector de movimiento seleccionado;y obtener un pronosticador de vector de movimiento del bloque actual entre candidatos de pronosticador incluyendo el candidato de pronosticador de vector de movimiento de conformidad con el bloque co-localizado. when reference images, which are available for prediction of the current block, are to be sent after the current image, and when the co-located image list information indicates that it is the list Ll, select the motion vector LO accordingly with the LO list of the co-located block, determining a motion vector predictor candidate in accordance with the co-located block using the selected motion vector;and obtaining a motion vector forecaster of the current block among forecaster candidates including the motion vector forecaster candidate in accordance with the co-located block.
- 2El método de conformidad con la reivindicación two. The method according to claim 1, caracterizado porque el bloque co-localizado es un bloque que está co-localizado con una ubicación de bloque del bloque actual, en una imagen co-localizada que se determina entre imágenes decodificadas antes de la imagen actual. 1, characterized in that the co-located block is a block that is co-located with a block location of the current block, in a co-located image that is determined between decoded images before the current image.
- 3The method according to claim 3. El método de conformidad con la reivindicación 1, caracterizado porque la imagen actual está dividida en una pluralidad de unidades de codificación máxima, una unidad de codificación máxima entre la pluralidad de unidades de codificación máxima está jerárquicamente dividida en unidades de codificación de profundidades, incluyendo una profundidad -aiLnal y una í IMPI ;· INSTITUTO MEXICANO (· . DE LA PROPIEDAD .· INDUSTRIAL profundidad inferior, de conformidad con información de división, cuando la información de división indica una 5 división para la profundidad actual, la unidad de codificación de la profundidad actual está dividida en cuatro unidades de codificación cuadrada de una profundidad inferior independientemente de unidades de codificación adyacentes, cuando la información de división indica una falta 1, characterized in that the current image is divided into a plurality of maximum coding units, a maximum coding unit among the plurality of maximum coding units is hierarchically divided into depth coding units, including a depth -aiLnal and an í IMPI ;· MEXICAN INSTITUTE (·. OF THE PROPERTY. · INDUSTRIAL bottom depth, in accordance with information of division, when the information division indicates a 5 division for the depth current, the Unit The current depth coding unit is divided into four squared coding units of a lower depth regardless of adjacent coding units, when the division information indicates a fault 10 of division for the current depth, at least one prediction unit is obtained from the coding unit of the current depth being divided, and the current block is one of the at least one prediction unit. 10 de división para la profundidad actual, al menos una unidad de predicción es obtenida de la unidad de codificación de la profundidad actual que es dividida, y el bloque actual es una de la por lo menos una unidad de predicción. INSTITUTO MEXICANO DE LA PROPIEDAD MEXICAN INSTITUTE OF PROPERTY INDUSTRIAL INDUSTRIAL RESUMEN DE LA INVENCIÓN' SUMMARY OF THE INVENTION ' An interprediction method is described which includes determining a co-located block of a current block of a current image from among the blocks of an image that is' restored before the current image;preferably checking whether or not a first reference list is referred from among the reference lists of the co-located block, and selectively verifying whether or not a second reference list is referred according to whether or not the first reference list is referred ;Based on the result of the verification, a simple co-located reference list is determined from between the first reference list and the second reference list;determining a reference block of the current block, by using the movement information of the colocalized reference list;and performing the inter-prediction on the current block by using the determined reference block. Se describe un método de ínter predicción que incluye determinar un bloque co-localizado de un bloque actual de una imagen actual de entre los bloques de una imagen que es ‘restaurada antes de la imagen actual;verificando preferentemente si es o no referida una primera lista de referencia de entre las listas de referencia del bloque co-localizado, y verificando selectivamente si es o no referida una segunda lista de referencia de acuerdo a si es o no referida la primera lista de referencia;con base en el resultado de la verificación, se determina una lista de referencia co-localizada simple de entre la primera lista de referencia y la segunda lista de referencia;determinando un bloque de referencia del bloque actual, mediante el uso de la información de movimiento de la lista de referencia colocalizada;y realizando la ínter predicción sobre el bloque actual mediante el uso del bloque de referencia determinado.
Independent claims3
592 paragraphs in 108 sections, as filed
PATENT TITLE NO. 336708
MCRtTARÍA Bl: «OTOMÍA,
Headlines):
Address:
Denomination:
Classification: In
Mexican Institute of Industrial Property
SAMSUNG ELECTRONICS CO., LTD.
129, Samsung-ro, Yeongtong-gu, Suwon-s¡, Gyeongg¡-do, 443-742, REPUBLIC OF KOREA
METHOD AND APPARATUS FOR VIDEO ENCODING, AND METHOD AND APPARATUS FOR VIDEO DECODING ACCOMPANIED BY INTER PREDICTION USING CO-LOCATED IMAGE.
Int.CI.8: H04N19 / 103; H04N19 / 176; H04N19 / 513
<img file="MX336708B_D0001.tif" />
Established from the FedQ of presentation of the request.
Who subscribes to the present title hereby based on what is stated in the document.
improi igable years, it is the and of '08/02/1994, 10/25/1996, 12/26/1997, 17 | 5/1999, section V subsection a), 4th and 12th fractions I and III of the Regulations of the Mexican Institute of Industrial Property (DOF 12/14/1999, amended on 07/01/2002, 07/15/2004, 07/28/2004 and 09/07/2007); Articles 1, 3, 4, 5 section V¡ Subsection a), 16 sections I and III and 30 of the Organic Statute of the Mexican Institute of Industrial Property (DOF 12/27/1999, amended on 10/10/2002, 07/29/2004, 08/04/2004 and 09/13/2007); 1st, 3rd and 5th subsection a) of the Agreement that delegates powers to the Deputy General Directors, Coordinator, Divisional Directors, Heads of Regional Offices, Divisional Deputy Directors, Departmental Coordinators and other subordinates of the Mexican Institute of Industrial Property. (DOF 12/15/1999, amended on 02/04/2000, 07/29/2004, 08/04/2004 and 09/13/2007).
Industrial piety (Official Dlari of 31/2006,
<img file="MX336708B_D0002.tif" />
Arenal No. 550. Floor 1,
Coi Pueble Santa María Tepepan. Xochimilco Delegation,
CP 16020, Mexico, Mexico City Tel. (55¡ 53 34 07 00 www.¡mpi qob mx
Issue Date: January 28, 2016
THE DIVISIONAL DIRECTOR OF PATENTS
I
NAHANNY CANAL REYES
<img file="MX336708B_D0003.tif" />
MX / 2016/9439
<img file="MX336708B_D0004.tif" />
<img file="MX336708B_D0005.tif" />
METHOD
APPARATUS
MEXICAN INSTITUTE OF PROPERTY
AND APPARATUS FOR VIDEO ENCODING, iTISfStt & DO FOR ACCOMPANIED VIDEO DECODING PDK INTER
PREDICTION USING CO-LOCATED IMAGE
Field of Invention
The present invention relates to a method and for encoding a video via interprediction and motion compensation apparatus and a method and apparatus for decoding a video via interprediction and motion compensation.
Background of the Invention
As the physical equipment (hardware) for playing and storing high-resolution, high-quality video content is being developed and supplied, there is an increasing need for a video encoder-decoder to effectively encode or decode high-resolution video content. or high quality. According to a conventional video codec (hereinafter code), a video is encoded according to a limited encoding method based on a macroblock having a predetermined size.
The image data of a spatial region is transformed into coefficients of a frequency region via the frequency transformation. According to a video code, an image is divided into blocks that have a size
Ref: 254951
MEXICAN INSTITUTE <sup>OF</sup> THE INDUSTRIAL PROPERTY
<img file="MX336708B_D0006.tif" />
By default, the discrete teaching transform (DCT) is performed for each respective block, and the frequency coefficients are encoded in block units, for quick calculation of the frequency transformation. Compared to the image data of a spatial region, the coefficients of a frequency region are easily compressed. In particular, since an image pixel value of a spatial region is expressed according to a prediction error via the inter-prediction or the intra-prediction of a video code, when the frequency transformation is performed on the prediction error , a large amount of data can be transformed to 0. According to a video code, an amount of data can be reduced by replacing the data that is consecutively and repeatedly generated with data of small size.
Brief Description of the Invention
Technical problem
The present invention provides an inter-prediction method and apparatus for determining a reference image by using a co-localized image, a video coding method, and a video decoding method via inter-prediction and decoding method. - video encoding and a video decoding apparatus via inter-prediction.
aauaamc = aocai
1,
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0007.tif" />
Technical Solution
According to one aspect of the present invention, there is provided an interprediction method that includes determining a co-located block of a current block of a current image from between blocks of an image that is restored before the current image; preferably it is checked whether a first reference list from among the reference lists of the co-located block is referred, and it is selectively verified whether a second reference list is referred according to whether the first reference list is referenced; Based on a result of the verification, a simple colocalized reference list is determined from among the first reference list and the second reference list; a reference block of the current block is determined by using the movement information of the collocated reference list; and the interprediction is performed on the current block by using the determined reference block. Advantageous Effects
Without checking all of a plurality of reference images included in the reference list of the co-located block in order to determine the reference image of the current block, the interprediction apparatus may preferably verify the first reference list that includes the reference images placed
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0008.tif" />
in a direction opposite to a direction coming from the current block to the co-located block in the co-located image. The Interprediction apparatus can selectively check the remaining reference lists. In this way, an unnecessary process is skipped in a process to determine the reference image of the current block, by using the co-located block, thereby increasing the efficiency of a reference image determination process for the Inter prediction.
Brief Description of Figures
Figure 1 is a block diagram of an interprediction apparatus according to an embodiment of the present invention;
Figure 2 shows a conventional method of determining a reference image by using a co-located block;
Figure 3 shows a method of determining a reference image by using a colocalized block, according to an embodiment of the present invention;
Figure 4 is a flow chart of an interprediction method according to one embodiment of the present invention;
Figure 5 is a flow chart of a video coding method via inter-prediction according to <sup>, nst</sup>'Heh<sup>or</sup>l<sup>t</sup>a ° mw'ca<sub>N</sub>or <sup>OF</sup> , ÍÍ®<sup>p,</sup>industrial age
<img file="MX336708B_D0009.tif" />
an embodiment of the present invention;
Figure 6 is a flow chart of a video coding method via interprediction according to an embodiment of the present invention;
Figure 7 is a block diagram of a video coding apparatus based on a coding unit according to a tree structure, according to an embodiment of the present invention;
Figure 8 is a block diagram of a video decoding apparatus based on a coding unit according to a tree structure, according to an embodiment of the present invention;
Figure 9 is a diagram to describe a concept of encoding units according to an embodiment of the present invention,
Figure 10 is a block diagram of an image encoder based on encoding units according to one embodiment of the present invention;
Figure 11 is a block diagram of an image encoder based on encoding units according to one embodiment of the present invention;
Figure 12 is a diagram illustrating deeper coding units according to depths, and divisions according to one embodiment of the present invention;
<img file="MX336708B_D0010.tif" />
Figure 13 is a diagram for describing a relationship between a coding unit and transformation units, according to an embodiment of the present invention;
Figure 14 is a diagram for describing the encoding information of the encoding units corresponding to a encoded depth, according to an embodiment of the present invention;
Figure 15 is a diagram of deeper encoding units according to depths, according to one embodiment of the present invention;
Figures 16 to 18 are diagrams for describing a relationship between coding units, prediction units, and transformation units, according to one embodiment of the present invention; Y
Figure 19 is a diagram for describing a relationship between a coding unit, a prediction unit or a division, and a transformation unit, according to the coding mode information in the Table.
1.
Detailed description of the invention
According to one aspect of the present invention, an interprediction method is provided that includes determining a co-located block of a current block of a current image from among the blocks of an image that is
<img file="MX336708B_D0011.tif" />
restored before current image; preferably it is verified whether a first reference list from among the reference lists of the co-located block is referred and it is selectively verified whether a second reference list is referred according to whether the first reference list is referred; Based on a result of the verification, a simple co-located reference list is determined from between the first reference list and the second reference list; a reference block of the current block is determined by using the movement information of the co-located reference list; and the interprediction is performed on the current block by using the determined reference block.
The first reference list may include images that are positioned opposite one direction from the current image to the co-located block.
Selective checking of the second reference list may include when the first reference list is referred for Interprediction, skipping an operation to check if the second reference list is referenced.
The determination of the colocalized reference list may include, when a picture order count number (POC) of an image of the co-located block is always smaller than that of the
IMPI
INSTITUTO MEXICANO Μ LA PROPERTY INDUSTRIAL current image, determining a reference list of the current block as the co-located reference list.
The selective verification of the second reference list may include the verification of the first reference list or the second reference list according to whether the movement information of the first reference list or the second reference list exists or not.
According to yet another aspect of the present invention, there is provided an interprediction apparatus including a co-located reference list checking unit for determining a co-located block of a current block of a current image from among the blocks of an image that is restored before the current image, and preferably it is checked whether a reference is made to a first reference list from among the reference lists of the co-located block, and it is selectively verified whether or not a second reference list is referenced according to whether or not the first reference list is referenced; a reference block determiner for, based on a verification result, determining a simple co-located reference list from between the first reference list and the second reference list, and determining a reference block of the current block by using the movement information from the co-located reference list; and a unit of Interprediction
<img file="MX336708B_D0012.tif" />
IMPI
<img file="MX336708B_D0013.tif" />
INSTITUTO MEXICANO DE LA FROPIEDAp to perform the inter-prediction of the current block<sup>, Nl</sup>ttteaaa the use of the given reference block.
According to yet another aspect of the present invention, a video decoding apparatus is provided that includes a parser for performing entropy decoding on a bit string obtained by parsing a received bit stream. to restore samples; an inverse transformer to perform inverse quantization and inverse transformation on a quantized transformation coefficient from among the restored samples, to restore the samples; an inter-predictor, to perform the intra-prediction on the blocks in an intra-prediction mode among the samples restored by the inverse transformer; and a motion compensator to preferably check whether or not a first reference list is referenced from among the reference lists of a co-located block of the current block, selectively verifying whether or not a second reference list is referenced. according to whether or not the first reference list is referenced, determining a simple co-located reference list from between the first reference list and the second reference list, based on a result of the verification, and performing the Interprediction on the current block by using a
<img file="MX336708B_D0014.tif" />
INSTITUTO MEXICANO DE LA PROPERTY reference block of the current block, with ba ^<sup>UST</sup>In the movement information of the collocated τβ £ tiltí'flCia list, to perform the inter-prediction on a current block in an Inter-mode between the samples restored by the inverse transformer; and a restorer for restoring an image by using blocks that are restored via interprediction or intraprediction.
According to yet another aspect of the present invention, there is provided a video coding apparatus that includes an intra-predictor for performing intra-prediction on blocks in an intra-prediction mode between blocks of a video; an inter-predictor to preferably verify whether a first reference list among the reference lists of a co-located block of the reference block is or is not referenced, selectively verifying whether or not a second reference list is referenced according to whether the second reference list is or is not referenced, determining a simple colocalized reference list from between the first reference list and the second reference list, based on a verification result, and performing the Interprediction on the current block by using a reference block from the current block, based on the movement information of the co-located reference list, for the Interprediction of a current block in an inter mode; a quantifier of
IMPI • Mexican NSTITUTE of industrial property
<img file="MX336708B_D0015.tif" />
transformation to carry out the trans £ exmacióll ___ X____ quantification on a result of the intra prediction or the inter prediction; and an output unit for outputting a stream of bits generated by performing entropy coding on the samples including a quantized transformation coefficient, generated as a result of the transformation and quantization.
In accordance with yet another aspect of the present invention, there is provided a computer-readable recording medium having a program recorded therein for executing the interprediction method.
Modality of the Invention
Hereinafter, an interprediction method and apparatus using a reference list of a co-located block will be described, with reference to Figures 1 to 5. A video encoding method and a decoding method Video via inter-prediction will be described with reference to Figures 5 and 6. Furthermore, a video encoding method and a video decoding method via interprediction based on a coding unit having a tree structure will be described with reference to Figures 7 to 19. Hereinafter, the The term image can refer to a still image or a moving image, that is, a video itself.
First, with reference to Figures 1 to
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0016.tif" />
4, an interprediction method and an interprediction apparatus using a reference list of a co-located block will be described according to an embodiment of the present invention. Furthermore, with reference to Figures 5 and 6, a video encoding method and a video decoding method via inter-prediction according to an embodiment of the present invention will be described.
Figure 1 is a block diagram of an apparatus
<td>by Inter</td><td>prediction 10</td><td>of</td><td>according to a</td><td>fashion1ity of</td><td>the</td>
<td colspan="2">present invention.</td><td></td><td></td><td></td><td></td>
<td></td><td>The apparatus of</td><td colspan="2">inter prediction</td><td>10 includes</td><td>a</td>
<td>unit of</td><td>check</td><td> 12</td><td>from the list of</td><td>reference,</td><td>a</td>
<td>unit of</td><td>determination</td><td> 14</td><td colspan="2">of the reference block, and</td><td>a</td>
interprediction unit 16.
Interprediction apparatus 10 encodes each video image for each respective block. A block can have a square shape, a rectangular shape, or any geometric shape and is not limited to a data unit having a predetermined size. According to an embodiment of the present invention, a block can be a maximum coding unit, a coding unit, a prediction unit, a transformation unit, or the like from among the coding units according to a tree structure. . Video encoding and decoding methods based on encoding units
<img file="MX336708B_D0017.tif" />
to. „„ A „, ...„ ™ „a. «A», .Íí8L onwards with reference to Figures 7 to ~ T9L ♦
The checklist checking unit may determine a co-located block of a current block of a current image from among the blocks of an image that is restored before the current image. The co-located block of the current block of the current image can be determined from among the blocks of the image that is restored before the current image and then a co-located block placed in a block position in a co-located image, corresponding to a block position of the current block in the current image, can be determined.
The reference list verification unit may determine a reference list of the current block by using a reference list of the co-located block.
The reference list verification unit can verify the reference list of the collocated block is preferably referenced. The first reference list according to the present embodiment may include images that are located in a direction opposite to a direction of the current image to the co-located block in the co-located block.
The checklist verification unit can selectively check whether a second checklist
<img file="MX336708B_D0018.tif" />
INSTITUTO MEXICANO DE LA PROPERTY INDUSTRIAL reference is or is not referenced, according to whether or not the first reference list is referenced. When the first reference list is referred, it does not have to be checked if the second reference list is referenced.
When the first reference list is referred to the inter-prediction of the co-located block, the reference list verification unit 12 may skip a verification process if the second reference list is referred.
The reference list verification unit can verify whether the first reference list or the second reference list is referenced or not, according to whether the movement information of the first reference list or the second reference list exists or not. reference.
The reference block determining unit 14 may determine a reference block of the current block, according to a result of checking whether or not the first reference list or the second reference list is referenced.
Unit 14 for determining the. Reference block can determine a simple colocated reference list from the first reference list and the second reference list. When the reference block determining unit 14 verifies that the first reference list is capable of being referenced, the
<img file="MX336708B_D0019.tif" />
reference block determining unit 14 determines that the first reference list is the co-located reference list. When the reference block determining unit 14 verifies that the second reference list is capable of being referred, the reference block determining unit 14 determines that the second reference list is the co-located reference list.
The reference block determining unit 14 may determine the reference block of the current block by using the movement information of the co-located reference list. A co-located reference image can be determined according to the co-located reference list. A picture of
<td>reference</td><td>from image</td><td>current may</td><td>to be</td><td>determined</td><td>of</td>
<td>according to</td><td>one direction</td><td>and distance</td><td>of</td><td>the picture</td><td>co-</td>
<td>located</td><td>in the image of</td><td>reference co</td><td colspan="3">-located. What's more,</td>
the motion information of the current block can be determined by modifying the motion information of the list of co-located information in proportion to the direction and distance of the co-located image to the co-located reference image, and the block Reference image can be determined in the reference image of the current image according to the modified motion information of the reference list co16
<img file="MX336708B_D0020.tif" />
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0021.tif" />
located.
However, when a picture order count number (POC) of a picture of the co-located block is always smaller than that of the current picture, the reference block determining unit 14 can replace the reference list with -located with the reference list of the current block. Thus, the reference image of the current block can be determined according to the reference list of the current block.
The reference block determining unit 14 may determine the reference picture of the current block according to the reference list of the current block in a low-delay condition to prevent video encoding from being delayed. For example, when a list 0 and a list 1 of the reference list of the current block include the same reference images, that is, in a generalized mode P and B (GPB), the reference image can be determined according to the reference list of the current block. When a current condition for decoding an image satisfies the low delay condition, the reference block determining unit 14 can determine the reference image of the current block according to the reference list of the current block.
The Interprediction Unit 16 can perform the
Interprediction on the current block by using the
<img file="MX336708B_D0022.tif" />
Mexican INSTITUTE reference block determined by the determination of the reference block.
The interprediction apparatus 10 may include a central processor (not shown) to generally control the checklist check unit 12, the check block determination unit and the interprediction unit 16. Alternatively, the reference list checking unit 12, the reference block determining unit 14 and the interprediction unit 16 can be controlled by respective processors (not shown) and the processors can cooperatively interact with each other to thus controlling a general operation of the interprediction apparatus 10. Alternatively, the reference list checking unit 12, the reference block determining unit 14 and the interprediction unit 16 may be controlled according to the control of an external processor (not shown) of the interprediction apparatus 10. .
Interprediction apparatus 10 may include at least one data storage unit (not shown) for storing data that is input to and sent from.
The reference list checking unit 12, the reference block determining unit 14 and the Interprediction unit 16. The Interprediction apparatus may include a controller (not shown) for controlling
<img file="MX336708B_D0023.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0024.tif" />
the data input / output of a data storage unit (not shown).
The interprediction apparatus 10 can preferably check the first reference list that includes the reference images placed in a direction opposite to a direction from the current block to the colocated block in the co-located image. The interprediction apparatus 10 may selectively check the remaining reference lists, without checking all of a plurality of reference images included in the reference list of the co-located block, in order to determine the reference image of the current block.
When the Interprediction apparatus 10 verifies that the first reference list of the colocalized block is used for the Interprediction of the co-located image, since the Interprediction apparatus 10 can determine the reference image of the current block based on In the first reference list of the co-located block, a process can be skipped to check whether the remaining references of the co-located block are referred or not. In this way, an unnecessary process is skipped in a process to determine the reference image of the current block by using the co-located block, thereby increasing the efficiency of a reference image determination process for the Inter prediction.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0025.tif" />
Figure 2 shows a conventional_dg method, determining a reference image by using a co-located block.
A reference picture of a current block 25 of a current picture 20 can be determined with reference to a reference list of a co-located block 27 of the current block 25.
The indexes of the reference lists can be expressed by the list 0 28 and the list 1 29. According to a POC order of the images 22, 20, 21 and 23, a reference list that includes the reference images in front of the current image 2 0 can be expressed by the list 0 LO and the reference images that include the reference images behind the current image 20 can be expressed by the list 1 Ll.
A colDir value of a co-located image 21 of the current block 25 indicates a direction towards the co-located image 21. Since the co-located image 21 is included in a list 1 26 of the current image 20, the colDir may be 1. As yet another example, a value of co-located_of_10_ flag can be used as a parameter to search for co-located image 21. The colocalized_of_10_indicator value may indicate that the colocalized image 21 is an image from list 0 of the current image 20. Thus, the co-localized_of_10_indicator value
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL the current image 20 can be determined as u.
The co-located block 27 can be placed in a block position in the co-located image 21, corresponding to a block position of the current block 25 in the current image 20. In a conventional method, a reference image of the current block 25 can be determined by verifying whether or not a list 0 28 and a list 1 29 of a reference list of the co-located block 27 is referred.
Typically, the reference image of the current block 25 can be determined by starting from the co-located block 27 in a reference direction through the current image 20. Since the reference direction through the current image 20 from the co- located 27 is an address towards list 0 28, the reference image of the current block 25 is probably going to be placed in the direction towards list 0 28. Thus, conventionally, an event whether or not a verification process of list 1 29 is to be referred is likely to be unnecessary, if list 0 28 and list 1 29 of the reference list of the block co- located 27 are referred, they need to be verified.
Figure 3 shows a method of determining a reference image by using a colocalized block, according to an embodiment of the present
MEXICAN INSTITUTE
OF industrial property
<img file="MX336708B_D0026.tif" />
invention.
In general, a reference image of a current block 25 can be determined from a colocated block 37 in a reference direction through a current image 30. That is, if a co-located image 31 is included in a list 1 36 of current block 35, the reference image of current block 35 is likely to be determined from co-located block 37 in a reference direction to a list 0 38 through current image 30.
If another co-located image is placed in the reference direction towards list 0 38, the reference image of current block 35 is probably going to be determined from the image co-located in a reference direction towards list 1 36 through current image 30.
Thus, according to the present embodiment, in order to determine the reference image of the current block 35, the interprediction apparatus 10 can preferably check whether a simple reference list from among the reference lists, that is, lists 0 and 1 38 and 39 of a co-located block 39, is or is not referred. Whether or not a corresponding reference list is referenced, this can be determined according to whether or not the co-located block 37 has movement information regarding the reference list.
IMPI
INSTITUTO MEXICANO OE LA PROPERTY INDUSTRIAL
<img file="MX336708B_D0027.tif" />
corresponding reference, as a result He «ϊ the corresponding reference list has or has not been previously referenced during the restoration of the co-located block 37.
If the reference list that is preferably verified has not been used for the interprediction of the co-located block 37, the interprediction apparatus 10 can verify whether or not the remaining reference list of the co-locator block 37 is referenced.
As described above, a reference list can be determined from the colocated block 37 in the reference direction through the current image 30. Thus, if the co-located image 31 is included in list 1 36 of the current block 35, the interprediction apparatus 10 can check whether or not the 0 list 38 is referenced from the co-locator block 37 along a direction through the current image 30. When it is determined that list 0 38 is referenced, it does not have to be verified if reference is made to a list 1 39. However, if the images in list 0 38 of the collocator block 36 are not referenced for interprediction, the interprediction apparatus 10 can simply check whether the list 1 39 of the co-locator block 36 is referred or not.
Similarly, if a co-located image of a current block is included in a list 0 of the current block, the interprediction apparatus 10 can check
INSTITUTO MEXICANO V ^ wboc ;. OF THE PROPERTY ^<sup>8</sup>¾¾
INDUSTRIAL 'preferably if a list 1 of a block "col-lóóall2dLlu is referred or not.
In this way, the inter-prediction apparatus 10 can determine a reference list that is subjected to an operation of preferably verifying whether the reference list is referenced or not, from among the reference lists of a co-located block, based on in a reference direction from a current block to a colocated image.
That is, the inter-prediction apparatus 10 determines a direction towards a reference list that is subjected to an operation of preferably checking whether the reference list is referenced or not, from among the reference lists of a co-located block, such as a direction opposite to the reference direction of the current block to the co-located image. Thus, if the co-located image is an image of a list 0 of the current image, if a list 1 of the co-located block is referred, this can preferably be verified. If the co-located image is an image from list 1 of the current image, if list 0 of the co-located block is referred, this can preferably be verified.
For example, a reference list that is subjected to an operation of preferably checking whether or not the reference list is referenced from among the lists of
INSTITUTO MEXICANO Dt LA PROPERTY
INDUSTRIAL
<img file="MX336708B_D0028.tif" />
reference of the co-located block, fr r> ------ childish to be determined opposite a reference direction of the current block to the co-located image. Thus, when the reference address of the current block to the colocated image is expressed by colDir, the interprediction apparatus 10 can determine a reference list which is subjected to an operation of preferably checking whether or not the list of references is referred to. reference along 1-colDir, from among the reference lists of the co-located block.
As yet another example, when a co-located image is an image from list 0 of a current image, a co-located_of_10_indicator value of a current block is 1. When the co-located image is an image from list 1 of the current image , the colocalized_of_10_indicator value is 0. In this way, the inter-prediction apparatus 10 can determine a direction towards a reference list which is subjected to an operation of preferably verifying whether or not the reference list is referenced from among the reference lists of the collocated block according to the value. colocalizado_de_10_indicator of the current block.
In this way, the interprediction apparatus 10 can determine the reference block of the current block by using the movement information from a co-located reference list that is selected based on institute. -JÍ;
whether or not the first reference list is referenced. ihws ™ · 'However, in a low or low-rise condition, the interprediction apparatus 10 can determine the reference image of the current block based on the reference list of the current block, instead of the reference list of the co-located block. For example, when a POC number of an image of the co-located block is always smaller than that of the current image, or when a predetermined condition that includes a GPB prediction mode, in which lists 0 and 1 of the lists The reference images of the current block include the same reference images, it is satisfied, an image is decoded in the low delay condition. In the low-delay condition, the interprediction apparatus 10 can replace the co-located reference list with the reference list of the current block, and then can determine the reference block of the current block by using the motion information. from the co-located reference list.
Figure 4 is a flow chart of an interprediction method according to one embodiment of the present invention.
In step 41, a co-located block of a current block of a current image is determined from among the blocks of an image that is restored before the current image.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0029.tif" />
In step 42, if a first reference list preferably referred from among the reference lists of the co-locator block is verified, and if a second reference list verified according to whether or not the first reference list is referred .
According to the present embodiment, the first reference list may include images that are placed opposite a direction from the current image to the collocated block. When the first reference list is referred to the. Inter-prediction of the co-located block, a verification process of whether or not the second reference list is referred can be skipped.
In step 43, based on a verification result of step 42, a simple colocated reference list is determined from the first reference list and the second reference list. When a video is decoded in the low delay condition, the reference list of the current block is determined as a co-located reference list and a reference picture can be determined according to the reference list of the current block.
<td>In</td><td>the</td><td>operation 44, a</td><td>block</td><td>reference</td><td>of</td>
<td colspan="2">current block</td><td>is determined</td><td>through</td><td>the use of</td><td>the</td>
<td>information</td><td>of</td><td>movement of the</td><td>list</td><td>reference</td><td>co-</td>
located. In operation 45, the Interprediction is' ™ TUT<sub>OR</sub> MEXICANO DC IA industrial PROPERTY
<img file="MX336708B_D0030.tif" />
performed on the current block using the reference DI Oque determined in operation 44.
Thus, in the method of determining a reference image for inter-prediction according to the present modality, if it is verified that the first reference list of the co-located block is used for the inter-prediction of the co-located image. located, an unnecessary process for the re-verification of whether or not the remaining reference lists of the co-located block are referred can be skipped, thereby increasing the efficiency of the inter-prediction.
Figure 5 is a flow chart of a video coding method via interprediction according to an embodiment of the present invention.
In step 51, the inter-prediction is performed on the blocks in an intra-prediction mode between the blocks of a video.
In step 52, it is checked whether or not a first reference list among the reference lists of a co-located block of a current block is preferably referenced, for the Inter-prediction of the current block in an Inter-mode. The first reference list may include images that are positioned in a direction opposite to a direction from the current image to the collocated block.
<img file="MX336708B_D0031.tif" />
If-'ilh UTO MEXICANO DC THE INDUSTRIAL PROPERTY
<img file="MX336708B_D0032.tif" />
When the first reference list is capable<sup>-</sup> if referred, it does not have to be verified if a second reference list is referred. When the first reference list is not referred, it can be verified whether or not the second reference list is referred. Based on a result of the verification, a simple colocated reference list can be determined from the first reference list and the second reference list, and a reference block of the current block can be determined based on the movement information. from the co-located reference list. Interprediction can be performed on the current block by using the reference block of the current block to generate a residual value.
In step 53, transformation and quantization is performed on the result of the intra-prediction or the inter-prediction to generate a quantized transformation coefficient. At step 55, a stream of bits generated by performing entropy coding on the samples that include the quantized transform coefficient from step 53 is output. A colDir parameter that indicates a direction towards the co-located image of the current block or a parameter co-located_of_10_indicator that indicates whether or not the current image of the co-located image is a
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0033.tif" />
Image from list 0 can be transmitted.
Furthermore, during the inter-prediction of operation 52, when an image is restored in a low-delay condition, a reference image can be determined according to the reference list of the current block, notwithstanding the reference list with the current block. located.
A video encoding apparatus that performs a video encoding method of Figure 5 may include interprediction apparatus 10 in accordance with one embodiment of the present invention. The video coding apparatus including the interprediction apparatus 10 can perform intraprediction, interprediction, transformation and quantization for each image block to generate samples and can perform entropy coding on samples to generate a stream of bits. In the video encoding apparatus including the interprediction apparatus 10, the interprediction apparatus 10 may interact with a video encoding processor or an external video encoding processor, which is mounted on the recording apparatus. video encoding to perform a video encoding operation including transformation, in order to output a video encoding result. According to an embodiment of the present invention, in an internal video coding processor of the video coding apparatus, since a
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0034.tif" />
Video encoding apparatus, a central processing apparatus, or a graphics processing apparatus may include a video encoding module, as well as a separate processor, a basic video encoding operation may be performed.
Figure 6 is a flow chart of a video coding method via interprediction according to an embodiment of the present invention.
In step 61, entropy coding is performed on a bit stream obtained by parsing a received bit stream to restore the samples. In step 62, inverse quantization and inverse transformation are performed on a quantized transformation coefficient from among the samples, to restore the samples. In step 63, the intra prediction is performed on the samples in an intra mode. In step 64, motion compensation is performed on samples in an interprediction mode. In operation 65, an image is restored by using blocks that are restored via intra-prediction of operation 63 or motion compensation of operation
64.
In step 64, a co-located block of a current block is determined from among the samples, for inter-prediction of a current block in an Inter mode. A
<img file="MX336708B_D0035.tif" />
colDir parameter that indicates an address -haei-to — the —co-located image__ of the current block or a collocated_of_10_indicator parameter that indicates whether or not the current image of the co-located image is an image from list 0, it can be parsed from a bit stream and restored. The co-localized block of the current block can be determined based on the colDir parameter or the co-localized_of_IO_indicator parameter.
Whether or not a first reference list among the reference lists of the co-located blocks is referenced, this is preferably verified. The first reference list may include images that are positioned in a direction opposite to a direction from the current image to the co-located block.
When the first reference list is capable of being referred, it does not have to check whether or not a second reference list is referred. When the first reference list is not referred, it can be verified whether or not the second reference list is referred. Based on a result of the verification, a simple colocated reference list can be determined from the first reference list and the second reference list and a reference block of the current block can be determined based on the movement information of the co-located reference list. Compensation for movement of the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0036.tif" />
Current block can be performed on the current block by using the current block reference block to generate a block pixel sample value.
Furthermore, during the motion compensation of operation 63, when an image is restored in a low-delay condition, a reference image can be determined according to a reference list of the current block, notwithstanding the reference list as -located.
A video decoding apparatus that performs the video decoding method of Figure 6 may include interprediction apparatus 10 according to one embodiment of the present invention. The video decoding apparatus including the inter-prediction apparatus 10 can parse the samples obtained by encoding a stream of bits and can perform inverse quantization, inverse transformation, intra-prediction, and motion compensation for each block. Image to restore the samples. In the video decoding apparatus, the interprediction apparatus 10 may interact with a video encoding processor or an external video encoding processor, which is mounted on the video decoding apparatus to perform a video decoding operation that includes inverse transformation or prediction / compensation, in order to output a
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0037.tif" />
video decoding result. In addition to an embodiment of the present invention, in an internal video decoder processor or the video decoding apparatus, since a video decoding apparatus, a central processing apparatus or a graphics processing apparatus may include a video encoding module, as well as a separate processor, a basic video decoding operation may be performed.
In the inter-prediction apparatus 10, the blocks obtained by dividing the video data are divided into coding units that have a tree structure and the prediction units are used for the inter-prediction of the coding units, as described. previously. Hereinafter, with reference to Figures 7 to 19, a method and apparatus for encoding a video and a method and apparatus for decoding a video were described, based on an encoding unit having a tree structure and a encoding unit.
Figure 7 is a block diagram of a video encoding apparatus 100 in an encoding unit according to a tree structure, according to an embodiment of the present invention.
The video coding apparatus 100 via video prediction based on a coding unit of
<img file="MX336708B_D0038.tif" />
MEXICAN INSTITUTE OF THE ΡΡΟΡίΕΠΑΟ
<img file="MX336708B_D0039.tif" />
According to a tree structure, it includes a maximum encoding unit splitter 110, an encoding unit determiner 120, and an output unit 130. Hereinafter, for convenience of description, the video encoding apparatus 100 via video prediction based on a coding unit according to a tree structure, it is referred to as the video coding apparatus
100 .
Maximum encoding unit divider 110 can divide a current image based on a maximum encoding unit for the current image of an image. If the current image is larger than the maximum coding unit, the image data of the current image can be divided into at least one maximum coding unit. The maximum encoding unit according to one embodiment of the present invention can be a data unit having a size of 32x32, 64x64, 128x128, 256x256, etc., wherein a shape of the data unit is a square having a a width and a length in frames of 2. Image data can be output to 120 according to at least one maximum encoding unit.
A coding unit according to one embodiment of the present invention can be characterized by a maximum size and a depth. Depth denotes a number of times the encoding unit is
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0040.tif" />
spatially divided from the maximum coding unit, and as the depth gets larger, deeper coding units according to depths can be divided from the maximum coding unit to a minimum coding unit. The maximum coding unit depth is a higher depth and a minimum coding unit depth is a lower depth. Since a size of a coding unit corresponding to each depth decreases as the depth of the maximum coding unit deepens, a coding unit corresponding to a higher depth may include a plurality of coding units corresponding to the lower depths.
As described above, the image data of the current image is divided into the maximum coding units according to a maximum coding unit size, and each of the maximum coding units can include coding units deeper than they are divided according to depths. Since the maximum coding unit according to a unit of the present invention is divided according to depths, the image data of a spatial domain included in the maximum coding unit can be hierarchically classified according to the
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0041.tif" />
depths.
A maximum depth and a maximum size of a coding unit, which limit the total number of times that a maximum coding unit height and width can be determined, are hierarchically divided.
The encoding unit determiner 120 encodes at least one division region obtained by dividing a region of the maximum encoding unit according to depths, and determines a depth to output a finally encoded image data, according to the least to a divided region. In other words, the encoding unit determiner 120 determines a encoded depth by encoding the image data into deeper encoding units according to depths, according to the maximum encoding unit of the current image, and selecting a depth that has the least coding error. Thus, the encoded image data from the encoding unit corresponding to the determined encoded depth is finally output. Also, the encoding units that correspond to the encoded depth can be considered as encoded encoding units. The determined encoded depth and The image data encoded according to the determined encoded depth is sent out to the
<img file="MX336708B_D0042.tif" />
INSTITUTO MEXICANO Di LA PROPERTY INDUSTRIAL exit unit 130.., ___
The image data in the maximum encoding unit is encoded based on the deepest encoding units corresponding to at least a depth equal to or below the maximum depth, and the encoding results of the image data are compared. based on each of the deepest coding units. A depth that has at least the smallest coding error can be selected after comparing the coding errors of the deeper coding units. At least one encoded depth can be selected for each maximum encoding unit.
The size of the maximum coding unit is divided as a coding unit is hierarchically divided according to depths, and as the number of coding units increases.
Also, even if the coding units correspond to the same depth in a maximum coding unit, it is determined whether or not each of the coding units corresponding to the same depth are divided to a smaller depth by measuring an error of encoding d The image data of each encoding unit, separately. Consequently, even when the image data is included in a maximum encoding unit, the
<img file="MX336708B_D0043.tif" />
INSTITUTO MEXICANO DE LA PROI'IEDAD
INDUSTRIAL
<img file="MX336708B_D0044.tif" />
Image data is divided into regions according to depths and coding errors can differ according to regions by a maximum coding unit, and thus the coded depths can differ according to regions in the image data. Thus, one or more encoded depths can be determined in a maximum encoding unit, and the image data of the maximum encoding unit can be divided according to the encoding units of at least one encoded depth.
Accordingly, the coding unit determiner 120 can determine the coding units that have tree structure included in the maximum coding unit. The coding units that have a tree structure according to one embodiment of the present invention include the coding units that correspond to a certain depth to be the encoded depth, out of all the deepest coding units included in the unit of maximum encoding. A coding unit of a coded depth can be hierarchically determined according to the depths in the same region of the maximum coding unit, and can be independently determined in different regions. Similarly, a depth encoded in a current region can be
<img file="MX336708B_D0045.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0046.tif" />
independently determined from a depth encoded in another region.
A maximum depth according to one embodiment of the present invention is an index related to a number of times the division is performed from a maximum coding unit to a minimum coding unit. A first maximum depth according to an embodiment of the present invention may denote the total number of times that the division is performed from the maximum coding unit to the minimum coding unit. A second maximum depth according to one embodiment of the present invention may denote the total number of depth levels from the maximum coding unit to the minimum coding unit. For example, when a maximum coding unit depth is 0, a depth of a coding unit, in which the maximum coding unit is divided once, can be set to, and a depth of one coding unit, in which the maximum encoding unit is divided twice, it can be set to 2. Here, if the minimum coding unit is a coding unit in which the maximum coding unit is divided four times, 5 depth levels of depths 0, 1, 2, 3 and 4 exist, and thus the first maximum depth can be set to 4, and the second maximum depth can be set to 5.
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0047.tif" />
The prediction coding and transformation can be performed according to the maximum coding unit. The prediction coding and transformation are also performed based on the deepest coding units according to a depth equal to or depths less than the maximum depth, according to the maximum coding unit. The transformation can be performed according to an orthogonal transformation method or an integer transformation.
Since the number of deepest coding units increases whenever the maximum coding unit is divided according to depths, the coding that includes the prediction coding and the transformation is performed on all the deepest coding units generated. as the depth increases. For the sake of description, the prediction coding and transformation will now be described based on a coding unit of a current depth, in a maximum coding unit.
The video encoding apparatus 100 may variously select a size or shape of a data unit for encoding the image data. In order to encode the image data, operations, such as prediction encoding, transformation, and entropy encoding, are performed and this time, the same
IMPI
OF THE <INDUSTRIAL PROPERTY
Mexican INSTITUTE
<img file="MX336708B_D0048.tif" />
Data unit can be used for all operations or different data units can be used for each operation.
For example, the video encoding apparatus
100 You can select not only a coding unit for coding the image data, but also a different data unit from the coding unit to thereby perform prediction coding on the image data in the coding unit. In order to carry out the prediction coding on the maximum coding unit, the prediction coding can be carried out based on a coding unit that corresponds to a coded depth, that is, based on a coding unit that no longer it is divided into coding units that correspond to a lower depth. Hereinafter, the coding unit that is no longer divided and becomes a base unit for prediction coding will now be referred to as a prediction unit. A division obtained by dividing the prediction unit may include a prediction unit or a data unit obtained by dividing at least one of a height and a width of the prediction unit. The division is a unit of data obtained by dividing the prediction unit from the coding unit, and the prediction unit can be a division that has the same size
<img file="MX336708B_D0049.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0050.tif" />
than the decoding unit. '
For example, when an encoding unit of
2Nx2N (where N is a positive integer) is no longer divided and becomes a prediction unit of 2Nx2N, a division size can be 2Nx2N, 2NxN, Nx2N, or NxN. Examples of a type of division include symmetric divisions that are obtained by symmetrically dividing a height or width of the prediction unit, fractions obtained by asymmetrically dividing the height or width of the prediction unit, such as l: non: l , the fractions that are obtained by geometrically dividing the prediction unit, and the fractions that have arbitrary shapes.
A prediction mode of the prediction unit may be at least one of an intra mode, an inter mode or a skip mode. For example, the intra mode or the inter mode can be performed on the division of 2Nx2N, 2NxN, Nx2N, or NxN. Also, the jump mode can only be performed on the 2Nx2N fraction. Encoding is independently performed on a prediction unit in a coding unit, whereby a prediction mode having at least one coding error is selected.
The video encoding apparatus 100 can also perform the transformation on the image data
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0051.tif" />
in a coding unit based not only on the coding unit for coding the image data, but also based on a transformation unit that is different from the coding unit. In order to perform the transformation in the coding unit, the transformation can be carried out based on a data unit having a size smaller than or equal to the coding unit. For example, the transformation unit for transformation may include a transformation unit for an intra mode and a data unit for an inter mode.
Similar to the coding unit according to the tree structure according to the present embodiment, the transformation unit in the coding unit can be recursively divided into smaller size regions and the residual data in the coding unit They can be divided according to the transformation of the tree structure according to the transmission depths.
According to one embodiment of the present invention, a transformation depth that indicates the number of times the division is performed to reach the transformation unit by dividing the height and width of the encoding unit, can also be adjusted in the transformation unit. For example, when the size of
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0052.tif" />
A transformation unit of a current όβΛίΓΙ'δδδ'ϊ'βϊϊ unit is 2Nx2N, a transformation depth can be set to 0. When the size of a transformation unit is NxN, the transformation depth can be set to 1. Also, when the transformation unit size is N / 2xN / 2, the transformation depth can be set to 2. That is, the transformation unit according to the tree structure can also be adjusted according to the transformation depth.
The encoding information according to the encoding units corresponding to a encoded depth requires not only the information regarding the encoded depth, but also regarding the information related to the prediction encoding and the transformation. Consequently, the encoding unit determiner 120 not only determines a encoded depth that has a minimum encoding error, but also determines a fraction type in a prediction unit, a prediction mode according to the prediction units, and a size of a transform unit for the transform.
The coding units and a prediction / division unit according to a tree structure into a maximum coding unit, and a method of determining a transformation unit, according to
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0053.tif" />
The embodiments of the present invention will be described in detail below with reference to Figures 7 to 19.
Coding unit determiner 120 can measure a coding error of deeper coding units according to depths by using Ratio Distortion Optimization, based on Lagrangian multipliers.
The output unit 130 sends the image data from the maximum encoding unit, which is encoded based on at least one encoded depth determined by the encoding unit determiner 120 and the information regarding the encoding mode according to the depth. encoded, in bit streams.
The encoded image data can be obtained by encoding residual data from an image.
The information regarding the encoding mode according to the encoded depth may include the information regarding the encoded depth, the type of fraction in the prediction unit, the prediction mode, and the size of the transform unit.
The information regarding the encoded depth can be defined by using the depth split information, which indicates whether or not the encoding is performed on encoding units of a lesser depth rather than an actual depth. Yes
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0054.tif" />
the current depth of the current encoding unit is the encoded depth, The image data in the current encoding unit is encoded and sent out, and thus the split information can be defined not to split the current encoding unit at a shallower depth. Alternatively, if the current depth of the current coding unit is not the coding depth, the coding is performed on the coding unit of the smallest depth, and thus the division information can be defined to divide the current coding unit , to obtain the coding units of the smallest depth.
If the current depth is not the encoded depth, the encodings performed on the encoding unit that is divided into the smallest depth encoding unit. Since at least one shallow depth coding unit exists in a current depth coding unit, the coding is not repeatedly performed on each shallow depth coding unit, and thus the coding can be recursively performed to encoding units that have the same depth.
Since the coding units having a tree structure are determined for a maximum coding unit, and the information regarding at least one
<img file="MX336708B_D0055.tif" />
Γ
Ρ '-
<img file="MX336708B_D0056.tif" />
encoding mode is determined for one unit
<img file="MX336708B_D0057.tif" />
encoding of an encoded depth, information regarding at least one encoding mode can be determined for a maximum encoding unit. Also, a coded depth of the image data of the maximum coding unit can be different according to the positions since the image data is hierarchically divided according to the depths, and thus the information regarding the coded depth and The encoding mode can be set for Image data.
Accordingly, the output unit 130 can assign the coding information regarding a corresponding coding depth and coding mode to at least one coding unit, the prediction unit, and a minimum unit included in the maximum coding unit.
The minimum unit according to one embodiment of the present invention is a rectangular data unit obtained by dividing the minimum coding unit that constitutes the lowest depth by 4. Alternatively, the minimum unit can be a maximum rectangular data unit that it has a maximum size, which is included in all coding units, prediction units, fraction units, and transformation units included in the maximum coding unit.
<img file="MX336708B_D0058.tif" />
Mexican Institute of Industrial Property
For example, the output of the coding information through the output unit 130 can be classified into the coding information according to the coding units, and the coding information according to the prediction units. The coding information according to the coding units may include the information regarding the prediction mode and regarding the size of the fractions. The coding information according to the prediction units may include the information regarding a direction estimated in an inter mode, relative to a reference image index of the Inter mode, relative to a motion vector, relative to a color component of an intra mode, and with respect to an intra mode interpolation method.
Also, the information regarding a maximum size of the coding unit defined according to the images, slices or GOPs, and the information regarding a maximum depth can be inserted in a header of a bit stream, a Group of Parameters of Sequence (SPS) or Picture Parameter Group (PPS).
In addition, information regarding a maximum size of a transformation unit and information regarding a minimum size of a transformation, which are acceptable
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0059.tif" />
for current video they can also be output via a bit stream header, an SPS or a
PPS. The output unit 130 can encode and output the reference information, the prediction information, the one-way prediction information, and the information regarding a type of slice that includes a fourth type of slice, which are related to the prediction described with reference to Figures 1 to 6.
In video coding apparatus 100, the deepest coding unit may be a coding unit obtained by dividing a height or width of a coding unit of a higher depth, which is one layer above, by two. Among other words, when the size of the current depth coding unit is 2Nx2N, the size of the lowest depth coding unit is NxN. Also, the current depth coding unit having the size 2nx2N may include a maximum value of 4 of the lowest depth coding unit.
Consequently, the video encoding apparatus 100 can form the. coding units that have the tree structure, by determining the coding units that have an optimal shape and optimal size for each maximum coding unit, based on the size of the maximum coding unit and the maximum depth determined considering the
<img file="MX336708B_D0060.tif" />
current image. Also, since coding can be performed on each maximum coding unit by using any of the various prediction modes and transformations, an optimal coding mode can be determined by considering the characteristics of the coding unit of various image sizes. .
Thus, if an image having a high resolution or large amount of data is encoded in a conventional macroblock, a number of macroblocks per image is excessively increased. Consequently, a number of pieces of compressed information generated for each macroblock is increased, and thus it is difficult to transmit the compressed information and the efficiency of data compression decreases. However, by using the video coding apparatus 100, the image compression efficiency can be increased, since a coding unit is adjusted while considering the characteristics of an image while increasing a maximum size of a unit of encoding while it is considered an image size.
The video encoding apparatus 100 of Figure 7 can perform the operation of the Interprediction apparatus 10 as described with reference to Figure 1.
The encoding unit determiner 120 can
<img file="MX336708B_D0061.tif" />
IMPI <sup>, NST,</sup>™ TO MEXICAN <sup>OF</sup> INDUSTRIAL PROPERTY carry out an operation of the protili rri on 10.
For each maximum coding unit, a prediction unit for the interprediction can be determined in coding units according to a tree structure, and the Interprediction can be determined in coding units according to a tree structure and the Inter-prediction can be done in prediction units.
In particular, if a first reference list among the reference lists of a co-located block of a current block is referred this is preferably verified, for inter-prediction of a current prediction unit in a prediction mode. The first reference list may include images that are positioned in a direction opposite to a direction of the current image to the co-located block.
When the first reference list is capable of being referenced, it does not have to be checked whether or not a second reference list is referenced. When the first reference list is not referenced, it can be checked whether the second reference list is referenced. Based on the result of the verification, a simple co-located reference list can be determined from the first reference list and the second reference list, and a reference block from a
<img file="MX336708B_D0062.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0063.tif" />
Current prediction unit can be determined -eon based on the movement information of the co-located reference list. Interprediction can be performed on the current prediction unit by using the reference block of the current prediction unit to generate a residual value, a co-located parameter_of_IO_indicator or a colDir parameter that indicates a co-located block of the unit. current prediction, can be transmitted.
Figure 8 is a block diagram of a video decoding apparatus 200 based on a coding unit according to a tree structure, according to an embodiment of the present invention.
<td colspan="6">The video decoding apparatus 200 based on</td>
<td>a unit of</td><td>coding</td><td colspan="2">according to</td><td>structure</td><td>of</td>
<td>tree includes</td><td>a receiver</td><td> 210,</td><td>a data of</td><td>image and</td><td>a</td>
<td>extractor</td><td>information</td><td>of</td><td>coding</td><td>220, and</td><td>a</td>
<td>decoder</td><td colspan="2">image data</td><td>23 0. From here</td><td colspan="2">onwards,</td>
For the sake of description, the video decoding apparatus 200 using video prediction based on a coding unit according to a tree structure will be referred to as the video decoding apparatus.
200.
Definitions of various terms, such as a coding unit, a depth, a prediction unit, a transformation unit, and information
<img file="MX336708B_D0064.tif" />
IMPI
<img file="MX336708B_D0065.tif" />
regarding various encoding modes
<img file="MX336708B_D0066.tif" />
Decoding operations of the video decoding apparatus 200 are identical to those described with reference to Figure 7 and the video encoding apparatus 100.
Receiver 210 receives and parses a stream of coded video bits. The image data and the encoding information extractor 220 extracts the encoded image data for each encoding unit from the parsed bit stream, where the encoding units have a tree structure according to each encoding unit. output, and outputs the extracted image data to the image data decoder 230. The image data and encoding information extractor 220 can extract information regarding a maximum size of an encoding unit from a current image, a header relative to the current image, an SPS, or a PPS.
Also, the image data and encoding information extractor 220 extracts information regarding a encoded depth and encoding mode for encoding units that have a tree structure according to each maximum encoding unit, from the parsed bit stream. The information extracted regarding the
<img file="MX336708B_D0067.tif" />
¿Ira * »encoded depth and encoding mode. ........
output to image data decoder
<img file="MX336708B_D0068.tif" />
words, the image data in an ios bit stream is divided into the maximum encoding unit, so that the image data decoder 230 decodes the image data for each maximum encoding unit.
The information regarding the encoded depth and the encoding mode according to the maximum encoding unit may be set for the information regarding at least one encoding unit corresponding to the encoded depth, and the information regarding one encoding mode may include information regarding a fraction type of a corresponding encoding unit corresponding to the encoded depth, regarding a prediction mode, and a size of a transformation unit. Also, the depth division information can be extracted as the encoded depth information.
The information regarding the encoded depth and the encoding mode according to each maximum encoding unit extracted by The image data and encoding information extractor 220, is information regarding a encoded depth and a determined encoding mode to generate minimal encoding error when an encoder, such as the
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL video encoding apparatus 100, repeatedly performs encoding for each deepest encoding unit according to depths according to each maximum encoding unit. Consequently, the apparatus of »
video decoding 200 can restore an image by decoding the image data according to a encoded depth and encoding mode that generates the minimum encoding error.
Since the encoding information regarding encoded depth and encoding mode can be assigned to a predetermined data unit out of a corresponding encoding unit, a prediction unit, and a minimum unit, the image data and the extractor encoding information 220 can extract the information regarding encoded depth and encoding mode according to predetermined data units. The predetermined data units to which the same information regarding encoded depth and encoding mode is assigned can be inferred to be the data units included in the same maximum encoding unit.
The image data decoder 230 restores the current image by decoding the image data in each maximum encoding unit, based on the depth information encoded to the mode of recording.
Mexican Institute of Industrial Property
<img file="MX336708B_D0069.tif" />
encoding according to decoding units— maximum. In other words, the image data decoder 230 can decode the encoded image data based on the extracted information regarding the fraction type, the prediction mode, and the transformation unit for each encoding unit among the encoding units. encoding that have the tree structure included in each maximum encoding unit. A decoding process can include prediction including intra prediction and motion compensation, and inverse transformation. The inverse transformation can be performed according to an inverse orthogonal transformation or inverse integer transformation method.
The image data decoder 230 can perform intra-prediction or motion compensation according to a partition and a prediction number of each coding unit, based on information regarding the partition type and the prediction mode of the image. prediction unit of the coding unit according to the coded depths.
Furthermore, the image data decoder 230 can read the information from the transform unit according to a tree structure for each encoding unit, to thereby determine the transform units for each encoding unit and perform the
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0070.tif" />
Inverse transformation based on the transformation units for each coding unit, for the inverse transformation for each maximum coding unit. By means of the inverse transformation, a pixel value of a spatial region of the coding unit can be restored.
The image data decoder 230 can determine at least one encoded depth of a current maximum encoding unit by using the depth-split information. If the split information indicates that the image data is no longer split at the current depth, the current depth is a coded depth. Consequently, the image data decoder 230 can decode the encoded data of at least one encoding unit corresponding to each encoded depth in the current maximum encoding unit, by using the information regarding the partition type of the unit. of prediction, the prediction mode, and the size of the transform unit for each encoding unit that corresponds to the encoded depth, and output the image data of the current maximum encoding unit.
In other words, the data units that contain the encoding information that includes the same r
IMPI <sup>, NSTI</sup>df '?? Í'<sup>former</sup>'<sup>Spout </sup>OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0071.tif" />
division information, can be obtained — ai— £ »haa £ var_the set of coding information assigned for the predetermined data unit from among the coding unit, the prediction unit and the minimum unit, and the obtained data units can be considered as the unit of a data to be decoded by the image data decoder 230 in the same decoding mode. For each coding unit determined as described above, information regarding a coding mode can be obtained to thereby decode the current coding unit.
The image data decoder 230 of the video decoding apparatus 200 of FIG. 8 can perform the operation of the interprediction apparatus 10 as described above with reference to FIG. 1.
The image data decoder 230 can determine a prediction unit for Interprediction for each coding unit according to a tree structure, and can perform Interprediction for each prediction unit, for a maximum coding unit.
In particular, a co-located block of a current block is determined from among the restored samples, for the inter-prediction of a current block in an inter mode. A co-located block of a current prediction unit can be determined based on a parameter co59
IMPI
<img file="MX336708B_D0072.tif" />
INSTITUTO MEXICANO DE LA PROPIEDAD located_de_10_indicador or a colDir parameter <sup>lf</sup>^ F &<sup>M</sup>'is current prediction unit obtained-at-analyze<sup>1</sup> syntactically a stream of bits.
If a first reference list from among the reference lists of the co-located block is referred this is preferably verified. The first reference list may include images that are positioned in the opposite direction to one direction from the current image of the colocated block.
When the first reference list is capable of being referenced, it does not have to be checked if a second reference list is referenced. When it does not refer to the first reference list, if the second reference list is referred this can be verified. Based on the result of the verification, a simple co-located reference list can be determined from between the first reference list and the second reference list, and a reference block of the current prediction unit can be determined based on in the movement information of the co-located reference list. Motion compensation can be performed on the current prediction unit by using the reference block of the current prediction unit to generate a block pixel sample value.
Also, when an image is restored to a
<img file="MX336708B_D0073.tif" />
low delay condition, a reference picture can be determined according to a reference list of the current prediction unit, however from the co-located reference list.
The video decoding apparatus 200 can obtain the information regarding at least one coding unit that generates the minimum coding error when the coding is recursively performed for each maximum coding unit, and can use the information to decode the current picture. In other words, the coding units that have the tree structure determined to be the optimal coding units in each maximum coding unit, can be decoded. Also, the maximum size of a coding unit is determined by considering the resolution and an amount of image data.
Consequently, even if the image data has high resolution and a large amount of data, the image data can be efficiently decoded and restored by using a encoding unit size and encoding mode, which are adaptively determined. according to the characteristics of the image data, by using the information regarding an optimal encoding mode received from an encoder.
Figure 9 is a diagram to describe a
IMPI
INSTITUTO MEXICANO concept of the coding units of agreement
<img file="MX336708B_D0074.tif" />
embodiment of the present invention.
A size of an encoding unit can be expressed in width by height, and it can be 64x64, 32x32,
16x16 and 8x8. A 64x64 encoding unit can be divided into 64x64, 64x32, 32x64, or 32x32 partitions, and a 32x32 encoding unit can be divided into 32x32, 32x16, 16x32, or 16x16 partitions, a 16x16 encoding unit can be divided into 16x16, 16x8, 8x16, or 8x8 partitions, and an 8x8 encoding unit can be divided into 8x8, 8x4, 4x8, or 4x4 partitions.
In 310 video data, a resolution is 1920x1080, a maximum size of an encoding unit is 64, and a maximum depth is 2. In video data 32 0, a resolution is 1920x1080, a maximum size of an encoding unit is 64, and a maximum depth is 3. In video data 330, a resolution is 352x288, a maximum size of an encoding unit is 16, and a maximum depth is 1. The maximum depth shown in Figure 9 denotes a total number of divisions from a maximum coding unit to a minimum decoding unit.
If a resolution is high or an amount of data is large, a maximum size of an encoding unit can be large not only to increase efficiency
<img file="MX336708B_D0075.tif" />
encoding, but also to accurately reflect the characteristics of an image. Accordingly, the maximum size of the encoding unit of the video data 310 and 320 having the higher resolution than the video data 330 can be 64.
Since the maximum depth of the video data 310 is 2, the encoding units 315 of the video data 310 may include a maximum encoding unit that has a longitudinal axis size of 64, and the encoding units that have axis sizes longitudinal 32 and 16 since the depths are deepened to two layers by dividing the maximum coding unit twice. Meanwhile, since the maximum depth of video data 330 is 1, the encoding units 335 of the video data 330 may include a maximum encoding unit having a longitudinal axis size of 16, and encoding units having a longitudinal axis size of 9 since the depths are deepened to one layer by dividing the maximum coding unit once.
Since the maximum depth of the video data 320 is 3, the encoding units 325 of the video data 320 may include a maximum encoding unit that has a longitudinal axis size of 64, and the encoding units that have axis sizes longitudinal 32, 16 and 8 since the depths are deepened to 3 layers at the
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0076.tif" />
divide the maximum encoding unit three times. As a depth becomes greater, detailed information can be accurately expressed.
Figure 10 is a block diagram of an image encoder 400 based on encoding units, according to one embodiment of the present invention.
The image encoder 400 performs the operations of the encoding unit determiner 120 of the video encoding apparatus 100 to encode image data. In other words, an intra predictor 410 performs the intra prediction on the coding units in an intra mode, out of a current structure 405, and a motion estimator 42 0 and a motion compensator 425 performs the inter estimate and the compensation of movement over the encoding units in an inter-mode between the current frame 405 by using the current frame 405, and a reference frame 495.
The data sent out from the intra predictor
410, motion estimator 420, and motion compensator 425 are output as a quantized transform coefficient, through a transformer 430 and a quantizer 440. The quantized transform coefficient is restored as data in a spatial domain to through an inverse quantizer 460 and a transformer <sup>, nst</sup>'™ tomex,<sub>Spout </sub>θ £ THE PROPERTY
INDUSTRIAL
<img file="MX336708B_D0077.tif" />
inverse 470, and the restored data in the spatial domain is output as the reference structure 495 after being post-processed through an unblocking unit 480 and a loop filtering unit 490. The quantized transformation coefficient It can be output as an ios 455 bit stream through a 450 entropy encoder.
In order for the image encoder 400 to be applied to the video encoding apparatus 100, all the elements of the image encoder 400, that is, the intra predictor 410, the motion estimator 420, the motion compensator 425, transformer 430, quantizer 440, entropy encoder 450, inverse quantizer 460, inverse transformer 470, unblocking unit 480, and the loop filtering unit 490 performs operations based on each coding unit among the coding units having a tree structure, while the maximum depth of each maximum coding unit is considered.
Especially, the intra predictor 410, the motion estimator 420, and the motion compensator 425 determine the partitions and a prediction mode of each coding unit among the coding units having a tree structure while considering the size. maximum and maximum depth of a unit of
IMPIAS
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL current maximum encoding, and the transformer 430 determines the size of the transform unit in each transform unit among the coding units having a tree structure.
In particular, in order to determine a reference image for the inter-prediction of a current prediction unit, the motion compensator 425 preferably checks whether or not a first reference list of a co-located block is referred, and does not return to verify if the remaining reference lists of the co-located block are referred, a when the movement information of the first reference list exists since the first reference list of the co-located block is preferably referenced. However, when the movement information of the first reference list does not exist since the first reference list of the co-located block is not referenced, the movement compensator 425 can recheck whether the remaining reference lists of the block co -located are referred. The motion compensator 425 may determine a reference list of the current prediction unit by using the reference list of the co-located block on which the verification operation has been performed.
Figure 11 is a block diagram of an image decoder 500 based on the units of
MEXICAN INSTITUTE <sup>OF</sup> THE PROPERTY
INDUSTRIAL
<img file="MX336708B_D0078.tif" />
a 'of — the present syntactic 510 parses encoded imacren to be encoding, according to invention.
A parser The decoding data, and the information regarding the encoding required for decoding from a stream of 505 bits. The encoded image data is sent as inverse quantized data through an entropy decoder 520 and a quantif inverse icator 530, and the inverse quantized data 10 is restored to image data in a spatial domain through an inverse transformer 540.
An intra predictor 550 performs intra prediction on the coding units in an intra mode with respect to image data in the spatial domain, and a motion compensator 560 performs motion compensation on the coding units in a mode
Inter by using a 585 reference structure.
The image data in the spatial domain, which passed through the intra predictor 550 and the motion compensator 560, can be sent as a restored frame 595 after being post-processed through an unlock unit 570 and a unit loop filtering unit 580. Also, the image data that is post-processed through the deblocking unit 570 and the loop filtering unit 580 can be sent as the structure
IMPI
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0079.tif" />
reference 585.
In order to decode the image data in the image data decoder 230 of the video decoding apparatus 200, the image decoder 500 can perform operations that are carried out after the parser 510 performs an operation.
In order for the image decoder 500 to be applied in the video decoding apparatus 200, all the elements of the image decoder 500, that is, the parser 510, the entropy decoder 520, the inverse quantizer 530, the reverse transformer 540, intra predictor 550, motion compensator 560, unlocking unit 570, and the loop filter unit 580 performs operations based on the coding units having a tree structure for each maximum coding unit.
Specifically, the intra predictor 550 and motion compensator 560 perform operations based on partitions and a prediction mode for each of the coding units that have a tree structure, and the inverse transformer 540 performs operations based on a size of a transformation unit for each encoding unit.
In particular, in order to determine an image
<img file="MX336708B_D0080.tif" />
<img file="MX336708B_D0081.tif" />
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL of reference for the inter-prediction of a current prediction unit, the motion compensator 560 preferably verifies if a first reference list of a co-located block is referred, and does not check again if the lists of Remaining references of the co-located block are referred when the movement information of the first reference list exists, since the first reference list of the co-located block is preferably referenced. However, when the motion information of the first reference list does not exist since the first reference list of the co-located block is not referenced, the motion compensator 560 can recheck whether the remaining reference lists of the co-located block -located are referred. Motion compensator 560 may determine a reference list of the current prediction unit by using the reference list of the co-located block on which the verification operation has been performed.
Figure 12 is a diagram illustrating deeper coding units according to depths, and partitions, according to one embodiment of the present invention.
The video encoding apparatus 100 and the video decoding apparatus 200 use hierarchical encoding units to thus account for the
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL characteristics of an image. A maximum height, a maximum width, and a maximum depth of the encoding units can be adaptively determined according to the characteristics of the image, or they can be adjusted differently by a user. The deepest coding unit sizes according to depths can be determined according to the predetermined maximum coding unit size.
In a hierarchical structure 600 of the coding units, according to one embodiment of the present invention, the maximum height and the maximum width of the coding units are each 64, and the maximum depth is 4. In this case , the maximum depth refers to a total number of times the coding unit is divided from the maximum coding unit to the minimum coding unit. As a depth becomes greater along a vertical axis of the hierarchical structure 600, a height and a width of the deepest coding unit are each divided. Also, a prediction unit and the partitions, which are bases for the prediction coding of each deeper coding unit, are displayed along a horizontal axis of the hierarchical structure.
600.
In other words, a 610 encoding unit
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0082.tif" />
is a maximum encoding unit in hierarchical structure 600, where a depth of 0 and a size, that is, a height by width is 64x64. The depth becomes greater along the vertical axis, and a 620 encoding unit that has a size of 32x32 and a depth of 1, a 630 encoding unit that has a size of 16x16 and a depth of 2, and a unit encoding 640 that has a size of 8x8 and a depth of 3, exist. The coding unit 640 having the size of 8x8 and the depth of 3 is a minimum coding unit.
The prediction unit and the partitions of a coding unit are arranged along the horizontal axis according to each depth. In other words, if the coding unit 610 having the size 64x64 and the depth 0 is a prediction unit, the prediction unit can be divided into partitions included in the coding unit 610, that is, a partition 610 having a 64x64 size, 612 partitions that are 64x32 size, 614 partitions that are 32x64 size, or 616 partitions that are 32x32 size.
Similarly, a prediction unit of the encoding unit 620 having the size of 32x32 and the depth of 1 can be divided into partitions included in the encoding unit 620, i.e. a partition 620
IMPI
MEXICAN INSTITUTE OF INDUSTIUAI PROPERTY.
which is 32x32 in size, 622 partitions that are 32x16 in size, 624 partitions that are 16x32 in size, and 626 partitions that are 16x16 in size.
Similarly, a coding unit 630 prediction unit having the size 16x16 and the depth 2 can be divided into partitions included in the coding unit 630, that is a partition having a size 16x16 included in encoding unit 630, partitions 632 that are 16x8 in size, partitions 634 that are 8x16 in size, and partitions 636 that are 8x8 in size.
Similarly, a coding unit 640 prediction unit having the size of 8x8 and the depth of 3 can be divided into partitions included in the coding unit 640, that is a partition having a size of 8x8 included in encoding unit
0, 642 partitions that are 8x4 in size, 644 partitions that are 4x8 in size, · and 646 partitions that are 4x4 in size.
In order to determine at least one encoded depth of the encoding units that make up the maximum encoding unit 610, the encoding unit determiner 120 of the video encoding apparatus 100 performs encoding for the encoding units corresponding to each depth. included in the unit
INSTITUTO MEXICANO OE LA PROPERTY industrial
<img file="MX336708B_D0083.tif" />
maximum encoding 610. ----- A number of deeper encoding units according to depths that include data in the same interval and the same size increases as depth increases. For example, four coding units corresponding to a depth of 2 are required to cover the data that is included in one coding unit corresponding to a depth of 1. Consequently, in order to compare the encoding results of the same data according to depths, the encoding unit corresponding to depth 1 and four encoding units corresponding to depth 2 are each encoded.
In order to perform the encoding for a current depth from among the depths, at least one encoding error can be selected for the current depth by performing the encoding for each prediction unit in the encoding units corresponding to the current depth. , along the horizontal axis of the hierarchical structure 600. Alternatively, the minimum coding error can be searched for by comparing at least the coding errors according to depths, by performing the coding for each depth as the depth increases along the vertical axis of the depth.
<img file="MX336708B_D0084.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0085.tif" />
hierarchical structure 600. A depth and partition having the least coding error in the coding unit 610 can be selected as the coding depth and a share type of the coding unit 610.
Figure 13 is a diagram for describing a relationship between an encoding unit 710 and the units
<td>transformation 720,</td><td>according to</td><td>a</td><td>modality of</td><td>the</td>
<td>present invention.</td><td></td><td></td><td></td><td></td>
<td>The apparatus of</td><td>coding</td><td> 100</td><td>or 200 encodes</td><td>or</td>
<td>decode an image</td><td>in agreement</td><td>to</td><td>the units</td><td>of</td>
encoding that have sizes smaller than or equal to a maximum encoding unit for each maximum encoding unit. The sizes of the transformation units for transformation during encoding can be selected based on data units that are not larger than a corresponding encoding unit.
For example, in the video encoding apparatus
100 or 200, if a size of the 710 encoding unit is
64x64, the transformation can be performed by using the 720 transformation units which have a size of
32x32.
Also, data in encoding unit 710 having the size 64x64 can be encoded by the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0086.tif" />
performing the transformation on each one — of — Xas.
transform units having the size of 32x32, 16x16, 8x8 and 4x4, which are smaller than 64x64, and then a transform unit having the least encoding error can be selected.
Figure 14 is a diagram for describing the encoding information of the encoding units corresponding to a encoded depth, according to an embodiment of the present invention.
The output unit 130 of the video encoding apparatus 100 can encode and transmit information 800 regarding a partition type, information 810 regarding a prediction mode, and information 820 regarding a size of a transform unit for each unit of encoding corresponding to an encoded depth, such as information regarding an encoding mode.
The information 800 indicates the information regarding a shape of a partition obtained by dividing a prediction unit from a current coding unit, wherein the partition is a data unit for the prediction coding of the current coding unit. For example, a current encoding unit Cu_0 that is 2Nx2N in size can be split into any one of an 802 partition that is 2Nx2N in size, an 804 partition that is 2Nx2N in size, an 806 partition that is Nx2N in size, ί
ί
<img file="MX336708B_D0087.tif" />
<img file="MX336708B_D0088.tif" />
and a partition 808 that is' NxN in size. Here, the information 800 regarding a partition type is set to indicate one of partition 804 which is 2NxN in size, partition 806 which is Nx2N in size, and partition 808 which is NxN in size.
Information 810 indicates the prediction of each partition mode. For example, the information 810 may indicate a prediction coding mode performed on a partition indicated by the information 800, that is, an intra mode 812, an inter mode 814, or a skip mode 816.
Information 820 indicates a transformation unit to be based when transforming into a current coding unit. For example, the transformation unit may be a first intra transformation unit 822, a second intra transformation unit 824, a first inter transformation unit 826, or a second inter transformation unit 828.
The image data and the encoding information extractor 220 of the video decoding apparatus 200 can extract and use the information 800, 810, and 820 for decoding, according to each deeper encoding unit.
Figure 15 is a diagram of deeper encoding units according to depths, from IMPI
Mexican Institute of Industrial Property
<img file="MX336708B_D0089.tif" />
according to a modality of the present invitation.
The split information can be used to indicate a change of a depth. The division information indicates whether a coding unit of a current depth is divided into coding units of a lower depth.
The prediction unit 910 for the prediction encoding of the encoding unit 900 that has a depth of 0 and a size of 2N_Ox2N_0 may include partitions of a partition type 912 that has a size of 2N_0x2N_0, a partition type 914 that has a size of 2N_0xN_0, a partition type 916 that has a size of N_0x2N_0, and a partition type 918 that has a size N_0xN_0. Figure 15 only illustrates the partition types 912 through 918 that are obtained by symmetrically dividing the prediction unit 910, but a partition type is not limited to this, and the partitions of the prediction unit 910 may include asymmetric partitions, partitions that have a default shape, and partitions that have a geometric shape.
The prediction encoding is repeatedly performed on one partition that is 2N_0x2N_0 in size, two partitions that are 2N_0x2N_0, two partitions that are N_Ox2N_0, and four partitions of N_0xN_0, according to each type of
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0090.tif" />
partition. The prediction encoding in ..nn mode .., .intra and in an inter mode can be performed on partitions having the sizes of 2N_0x2N0, N_0x2N_0, 2N_0xN_0, and N_0xN_0. The prediction encoding in a jump mode is performed only on the partition having the size 2N 0x2N 0.
The coding errors that include the prediction coding in the partition types 912 through 918 are compared, and the smallest coding error is determined among the partition types. If a coding error is the smallest in one of the partition types 912 through 916, the prediction unit 910 may not be divided to a lower depth.
If the encoding error is the smallest in partition type 918, a depth is changed from 0 to 1 to divide partition type 918 in step 920, and encoding is not repeatedly performed on encoding units 930 that They have a depth of 2 and a size of N_0xN_0 to look for a minimal encoding error.
A prediction unit 940 for the prediction encoding of the encoding unit 930 having a depth of 1 and a size of 2N_lx2N_l (= N_0xN_0) may include partitions of a partition type 942 having a size of 2N_lx2N_l, a partition 944 which has a size of
IMPI
MEXICAN INSTITUTE 'OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0091.tif" />
2N_lxN_l, a partition 946 that has a size of N_lx2N_l, and a partition 948 that has a size of N_lxN_l.
If an encoding error is the smallest in partition type 948, a depth is changed from 1 to 2 to divide partition type 948 in step 950, and encoding is repeatedly performed on encoding units 960, which They have a depth of 2 and a size of N_2xN_2 to look for a minimal encoding error.
When a maximum depth is d, the division operation according to each depth can be performed up to when a depth becomes d-1, and the division information can be encoded as up to when a depth is 0 to d-2. In other words, when the coding is performed up to when the depth is d-1 after a coding unit corresponding to a depth of d-2 is divided in step 970, a prediction unit 990 for the prediction coding of a 980 encoding unit that has a depth of d-1 and a size of 2N_ (d-1) x2N_ (d-1) can include partitions of a partition type 992 that has a size of 2N_ (dl) x2N_ (dl ), a partition type 994 that has a size of 2N_ (dl) xN_ (dl), a partition type 996 that has a size of N_ (dl) x2N_ (dl), and a partition type 998 that has a size of N_ (dl) xN_ (dl).
<img file="MX336708B_D0092.tif" />
Prediction encoding can be repeatedly performed on one partition having a size of 2N_ (d-1) x2N_ (d-1), two partitions having a size of 2N_ (dl) xN_ (dl), two partitions having a size size of N_ (d-1) x2N_ (d-1), four partitions having a size of N_ (dl) xN_ (dl) from partition types 992 to 998 to find a partition type that has minimal error encoding.
Even when partition type 998 has the minimum encoding error, since a maximum depth is d, a CU_ (dl) encoding unit having a depth of d-1 is no longer divided to a lower depth, and a encoded depth for the encoding units constituting a current maximum encoding unit 900 is determined to be d-1 and a partition type of the current maximum encoding unit 900 can be determined to be N- (d-1) xN_ ( d-1). Also, since the maximum depth is d and a maximum coding unit 980 having a depth lower than d-1 is no longer divided at a lower depth, the division information for the minimum coding unit 980 is not set.
A data unit 999 can be a minimum unit for the current maximum coding unit. A minimum unit according to a modality of the present<sup>in</sup>-<sup>st</sup>£ e<sup>or</sup>™<sup>m</sup>"'Spout <sup>OF</sup> THE PROPERTY • ndustríac
<img file="MX336708B_D0093.tif" />
An invention can be a fectanqillaT data unit obtained by dividing a minimum 980 coding unit by 4. By repeatedly encoding, the video encoding apparatus 100 can select a depth that has the least encoding error by comparing encoding errors according to the depths of the encoding unit 900, to determine a encoded depth, and set a corresponding partition type and a prediction mode as an encoded depth encoding mode.
As such, the minimum coding errors according to depths are compared at all depths of 1 to d, and a depth that has at least a coding error can be determined as a coding depth. The encoded depth, the prediction unit partition type, and the prediction mode can be encoded and transmitted as information regarding a coding mode. Also, since a coding unit is divided from a depth of 0 to a coded depth, only the divided information of the encoded depth is set to 0, and the divided information of the depths excluding the encoded depth is set to.
Image data and information extractor
IMPI
MEXICAN INSTITUTE OF PROPERTY
<img file="MX336708B_D0094.tif" />
code 220 of the decoder device<sup>ND</sup>tif§<sup>, IM</sup>vid & tJ '200 can extract and use the information - regarding Ϊ3Γ encoded depth and the prediction unit of the encoding unit 900 to decode the partition 912. The video decoding apparatus 200 can determine a depth, in which the divided information is 0, as a coded depth by using the depth-split information, and use the information regarding a coding mode of the corresponding depth, for decoding.
Figures 16 to 18 are diagrams to describe a relationship between encoding units
1010, prediction units 1060, and transformation units 107 0, according to one embodiment of the present invention.
The coding units 1010 are coding units having a tree structure, corresponding to the coding depths determined by the video coding apparatus 100, in a maximum coding unit. The prediction units 1060 are prediction unit partitions of each of the coding units 1010, and the transformation units 1070 are transformation units of each of the coding units.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0095.tif" />
1010 .
When a depth of a maximum coding unit is 0 in the coding units
1010, the depths of the coding units 1012 and 1054 are 1, the depths of the coding units 1014, 1016, 1018, 028, 1050 and 1052 are 2, the depths of the coding units 1020, 1024,
1026, 1030, 1032, and 1048 are 3, and the depths of the encoding units 1040, 1042, 1044, and 1046 are 4.
In the prediction units 1060, some coding units 1014, 1016, 1022, 1032, 1048,
1050, 1052, and 1054 are obtained by dividing the encoding units into the 1010 encoding units. In other words, the partition types in the 1014, 1022, 1050, and 1054 encoding units have a size of
2NxN, partition types in encoding units 1016, 1048, and 1052 have a size of Nx2N, and a partition type in encoding unit 1032 has a size of NxN. The prediction units and partitions of the coding units 1010 are smaller than or equal to each coding unit.
The transformation or inverse transformation is performed on image data from the encoding unit 1052 in the transformation units 1070 into a data unit that is smaller than the unit of
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAC · INDUSTRIAL
<img file="MX336708B_D0096.tif" />
1052 encoding. Also, the units of πηΗίίΐΡ3Ρ · ϊΛρ.
1014, 1016, 1022, 1032, 1048, 1050, and 1052 in transformation units 1070 are different from those in prediction units 1060 in terms of sizes and shapes. In other words, video encoding and decoding apparatuses 100 and 200 can perform intra-prediction, motion estimation, motion compensation, transformation, and inverse transformation individually on a unit of data in the same coding unit.
Consequently, the coding is recursively performed on each of the coding units that have a hierarchical structure in each region of a maximum coding unit, to determine an optimal coding unit, and thus the coding units that have a structure recursive tree can be obtained. The encoding information may include the division information regarding a coding unit, the information regarding a partition type, the information regarding a prediction mode, and the information regarding a transformation unit size. Table 1 shows the encoding information that can be adjusted by encoding and decoding apparatus 100 and 200.
IMPI
Mexican Institute of Industrial Property
<img file="MX336708B_D0097.tif" />
Table 1
<td colspan="5">Division 0 Information (Coding About the Coding Unit which has 2Nx2N Size and Actual Depth</td><td rowspan="2">Information Division 1</td>
<td></td><td colspan="4">From d)</td>
<td>Mode of</td><td colspan="2">Kind of</td><td>Size</td><td>of the Unit</td><td>Encode</td>
<td>Prediction</td><td colspan="2">Partition</td><td colspan="2">of Transformation</td><td>Repeatedly</td>
<td>Intra</td><td></td><td></td><td></td><td>NxN</td><td>the units</td>
<td>Inter</td><td></td><td></td><td></td><td>(Kind</td><td>of</td>
<td></td><td>2Xx2N</td><td>2NxnU</td><td></td><td>Symmetrical)</td><td>Coding</td>
<td>Jump</td><td>2NxN</td><td>2NxnD</td><td></td><td></td><td>that have</td>
<td>(Only</td><td>2Nx2N</td><td>nLx2N</td><td>2Nx2N</td><td>N / 2xN / 2</td><td>depth</td>
<td>2Nx2N)</td><td>NxN</td><td>nRx2N</td><td></td><td>(Kind</td><td>less than d + 1</td>
<td></td><td></td><td></td><td></td><td>Asymmetric)</td><td></td>
The output unit 130 of the video encoding apparatus 100 can output the encoding information regarding the encoding units having a tree structure, and the image data and the encoding information extractor 220 of the apparatus. video decoder 200 can extract encoding information regarding encoding units having a tree structure from a received bit stream.
The division information indicates whether a current coding unit is divided into the units of
IMPI
Mexican Institute of Industrial Property
<img file="MX336708B_D0098.tif" />
If the information
0, a current depth va is not encoding a lower depth, a current depth division d is in which a coding unit divided into a lower depth, is a depth 5 encoded, and thus the information regarding A partition type, prediction mode, and a transformation unit size can be defined for the encoded depth. If the current coding unit is further divided according to the division information, the coding is independently performed in four division coding units of a lower depth.
A prediction mode can be one of an intra mode, an inter mode, and a jump mode. The intra mode and the Inter mode can be defined in all partition types, and the jump mode is defined only in a partition type that has a size of 2Nx2N.
The information regarding the partition type can indicate the symmetric partition types that have sizes of 2Nx2N, 2NxN, Nx2N, and NxN, which are obtained by dividing
V symmetrically is a height or width of a prediction unit, and asymmetric partition types that have sizes of 2NxnU, 2NxnD, nLx2N, and nRx2N, which are obtained by asymmetrically dividing the height or width of the prediction unit. The asymmetric partition types that have
<img file="MX336708B_D0099.tif" />
<img file="MX336708B_D0100.tif" />
the sizes of 2NxnU and 2NxnD can be obtained by dividing the height of the prediction unit into 1: 3 and 3: 1, and the asymmetric partition types having the sizes of nLx2Ñ and nRx2N can be obtained respectively by dividing the width of the prediction unit in 1: 3 and 3: 1.
The size of the transform unit can be set to be two types in the intra mode and two types in the inter mode. In other words, if the division information of the transform unit is 0, the size of the transform unit can be 2Nx2N, which is the size of the current encoding unit. If the division information of the transformation unit is 1, the transformation units can be obtained by dividing the current coding unit. Also, if a partition type of the current encoding unit that has the size of 2Nx2N is an asymmetric partition type, a size of a transform unit can be NxN, and if the partition type of the current encoding unit It is a type of asymmetric partition, the size of the transform unit can be N / 2xN / 2.
The coding information regarding the coding units having a tree structure may include at least one coding unit corresponding to a coding depth, a unit of "oaseasuau
IMPI
INSTITUTO MEXICANO Dt LA INDUSTRIAL PROPERTY
<img file="MX336708B_D0101.tif" />
prediction, and a minimum unit. The nniHaA—<sub>r</sub>-[<sub>L</sub> The udif i corresponding to the encoded depth can include at least one of a prediction unit and a minimum unit that contains the same encoding information.
Accordingly, it is determined whether or not the adjacent data units are included in the same coding unit corresponding to the encoded depth by comparing the coding information of the adjacent data units. Also, a corresponding coding unit corresponding to a coded depth is determined by using the coding information of a data unit, and thus a distribution of coded depths in a maximum coding unit can be determined.
Consequently, if a current coding unit is predicted based on the coding information
<td>of the units</td><td>of</td><td>data</td><td>adjacent, the</td><td>information</td><td>of</td>
<td>encoding of</td><td>the</td><td colspan="2">data units</td><td>in units</td><td>of</td>
<td>encoding plus</td><td colspan="2">deep</td><td>adjacent to</td><td>unit</td><td>of</td>
<td colspan="2">current encoding</td><td>may</td><td colspan="2">be directly referred</td><td>Y</td>
used.
Alternatively, if a current coding unit is predicted based on the coding information of the adjacent data units, the data units adjacent to the current coding unit are searched.
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX336708B_D0102.tif" />
using the encoded information from the data units, and the adjacent sought-after encoding units can be referenced to predict the current encoding unit.
Figure 19 is a diagram for describing a relationship between a coding unit, a prediction unit or a partition, and a transformation unit, according to the information of the coding mode of the
Table 1.
A maximum coding unit 1300 includes the
<td>units 1302, 1304, 1306,</td><td> 1313,</td><td> 1314,</td><td>1316 and 1318 of</td><td>the</td>
<td>encoded depths.</td><td>Here,</td><td>already</td><td>that unit</td><td>of</td>
<td>encoding 1318 is a</td><td>Unit</td><td>of</td><td>encoding of</td><td>a</td>
encoded depth, the split information can be set to 0. The information regarding a partition type of the encoding unit 1318 having a size of 2Nx2N, can be set to be one of a kind of
<td>partition</td><td> 1322</td><td>what</td><td>It has</td><td>a</td><td>size</td><td>of</td><td>2Nx2N,</td><td>a</td><td>kind</td><td>of</td>
<td>partition</td><td> 1324</td><td>what</td><td>It has</td><td>a</td><td>size</td><td>of</td><td>2Nx2N,</td><td>a</td><td>kind</td><td>of</td>
<td>partition</td><td> 1326</td><td>what</td><td>It has</td><td>a</td><td>size</td><td>of</td><td>2Nx2N,</td><td>a</td><td>kind</td><td>of</td>
<td>partition</td><td> 1328</td><td>what</td><td>It has</td><td colspan="2">a size</td><td>of</td><td>NxN,</td><td>a</td><td>kind</td><td>of</td>
<td>partition</td><td> 1332</td><td>what</td><td>It has</td><td>a</td><td>size</td><td>of</td><td>2NxnU,</td><td>a</td><td>kind</td><td>of</td>
<td>partition</td><td> 1334</td><td>what</td><td>It has</td><td>a</td><td>size</td><td>of</td><td>2NxnD,</td><td>a</td><td>kind</td><td>of</td>
<td>partition</td><td> 1336</td><td>what</td><td>It has</td><td>a</td><td colspan="3">nLx2N size, and</td><td>a</td><td>kind</td><td>of</td>
partition 1338 which is nRx2N in size.
<img file="MX336708B_D0103.tif" />
tt ·. '<sub>r</sub>
Bk<sub>%</sub>- LA PWVffn ^ rj I ·,> 5
The division information (denoted ·.; From táWSH »^ TU £ ¿vr (Unit of Transformation)) of a unit of Traí is a type of a transformation index. The size of the transformation unit that corresponds to the transformation index can be changed according to a type of prediction unit or the partition type of the coding unit.
For example, when the partition type is set to be symmetric, that is, partition type 1322, 1324, 1326, or 1328, a transformation unit 1342 that has a size of 2Nx2N is set if the division information (indicator of TU size of a transformation unit is 0, and a 1344 transformation unit having a size of NxN is adjusted if a TU size indicator is 1.
When the partition type is set to be asymmetric, that is, the partition type 1332, 1334, 1336 or
1338, a transformation unit 1352 that has a size of 2Nx2N is adjusted if a size indicator TU is 0, and a transformation unit 1354 that has a size of N / 2xN / 2 is adjusted if a size indicator TU is 1 .
Referring to Figure 19, the size indicator TU is an indicator that has a value of 0 or 1, but the size indicator TU is not limited to 1 bit, and a transformation unit can be hierarchically divided
IMPI
MEXICAN INSTITUTE OF PROPERTY
<img file="MX336708B_D0104.tif" />
having a tree structure while the TU size inciic is incremented from 0. The division information (TU size indicator) of a transform unit may be an example of a transform index.
In this case, the size of a transformation unit that has been effectively used can be expressed by using a size indicator TU of a transformation unit, according to an embodiment of the present invention, together with a maximum size and a minimum transformation unit size. According to one embodiment of the present invention, the video encoding apparatus 100 is capable of encoding the maximum transformation unit size information, the minimum transformation unit size information and a maximum size indicator TU. The result of encoding the maximum transformation unit size information, the minimum transformation unit size information, and the maximum TU size indicator can be inserted into an SPS. According to one embodiment of the present invention, the video decoding apparatus 200 can decode the video by using the information of the maximum transformation unit size, the information of the minimum transformation unit size, and the size indicator TU maximum.
For example, (a) if the size of a unit of
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL current encoding is 64x64 and a maximum transform unit size is 32x32, (a-1) then the size of a transform unit can be 32x32 when a TU size indicator is 0, (a-2) can be 16x16 when the TU size indicator is 1, and (a-3) can be 8x8 when the TU size indicator is 2.
As yet another example, (b) if the current encoding unit size is 32x32 and a minimum transform unit size is 32x32, (b-1) then the transform unit size can be 32x32 when the prompt of size Tu is 0. Here, the size indicator TU cannot be set to a value other than 0, since the size of the transformation unit cannot be less than
32x32.
As yet another example, (c) if the current encoding unit size is 64x64 and a maximum TU size indicator is 1, then the TU size indicator can be 0 or 1. Here, the TU size indicator cannot be set to a value other than 0 or 1.
Thus, if the maximum TU size indicator is defined as MaxTransformSizelndex, a minimum transform unit size is MinTransformSize, and a transform unit size is RootTuSize when the TU size indicator is 0, then a unit size current minimum transformation CurrMinTuSize which can be
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0105.tif" />
determined in an annual coding unit can be defined by Equation (1):
CurrMinTuSize = max (MinTransformSize,
RootYourSize / (2 * MaxTransformSizelndex)) ... (1)
Compared to the current minimum transformation unit size CurrMinTuSize that can be determined in the current encoding unit, a RootTuSize transformation unit size when the TU size indicator is 0, can denote a maximum transformation unit size that can be selected in the system. In equation (1),
RootTuSize / (2<sup>TO</sup>MaxTransformSizeIndex denotes a transformation unit size when the transformation unit size RootTuSize when the TU size indicator is 0, it is divided a number of times corresponding to the maximum TU size indicator, and MinTransformSize denotes a minimum transformation size. Thus, a smaller value between RootTuSize / (2<sup>TO</sup>MaxTransformSizelndex) and MinTransformSize can be the size of the current minimum transformation unit CurrMinTuSize which can be determined in the current encoding unit.
According to one embodiment of the present invention, the maximum transformation unit size
Root Your size may vary according to the type of a root mode.
ΙΜΡΙ ^>
mexican institute
OF PROPERTY CU / W
INDUSTRIAL prediction. ______
For example, if a current prediction mode is an Inter mode, then RootYourSize can be determined by using Equation (2) below. In Equation (2), MaxTransformSize denotes a maximum transform unit size and PUTSize denotes a current prediction unit size.
RootTuSize = min (MaxTransformSize, PUTSize)
...... (2)
That is, if the current prediction mode is Inter mode, the size of the transformation unit RootTuSize, when the size indicator TU is 0, can be a smaller value between the maximum transformation unit size and the size current prediction unit.
If a prediction mode of a current partition unit is an intra mode, RootYourSize can be determined by using equation (3) below. In Equation (3), PartitionSize denotes the size of the current partition drive.
RootYourSize = min (MaxTransformSize, PUTSize)
...... (3)
That is, if the current prediction mode is intra mode, the size of the transformation unit
RootTuSize when TU size indicator is 0 can be
-4'
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX336708B_D0106.tif" />
a smaller value between the maximum transform drive number ~ cfe and the size of the current partition drive.
However, the size of the current maximum transformation unit RootTuSize that varies according to the type of a prediction mode in a partition unit is only an example and the present invention is not limited thereto.
According to the video coding method based on the coding units that has a tree structure as described with reference to the
Figures 7 to 19, The image data of a spatial region is encoded for each encoding unit of a tree structure. According to the video decoding method based on the coding units having a tree structure, the decoding is performed for each maximum coding unit to restore the image data of a spatial region. In this way, an image and a video that is a sequence of images can be restored. The restored video can be played back by a playback apparatus, stored on a storage medium, or transmitted over a network.
The embodiments of the present invention can be written as computer programs and can be implemented in general-purpose digital computers that
<img file="MX336708B_D0107.tif" />
computer readable. Examples of computer-readable recording media include magnetic storage media (eg, ROMs, floppy disks, hard drives, etc.) and optical recording media (eg, CD-ROMs or DVDs).
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and the scope of the present invention as defined by the following claims.
It is noted that in relation to this date, the best method known to the applicant for putting the aforementioned invention into practice is the one that is clear from the present description of the invention.
Contents108
121 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117 Sheet 118 Sheet 119 Sheet 120 Sheet 121
107 members in 16 offices
Priority claims8
| Document | Office | Kind | Date |
|---|---|---|---|
| 201161504177 | United States of America | P | |
| 61504177 | United States of America | – | |
| 201161548415 | United States of America | P | |
| 61548415 | United States of America | – | |
| 61504177 | – | – | – |
| 61548415 | – | – | – |
| US201161504177P | – | – | – |
| US201161548415P | – | – | – |
Members107
| Document | Office | Kind | |
|---|---|---|---|
| CA2840726A1 | Canada | A1 | |
| CA2982301A1 | Canada | A1 | |
| KR20130004435A | Republic of Korea | A | |
| WO2013005963A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2013005963A3 | World Intellectual Property Organization (WIPO) | A3 | |
| TW201313025A | Taiwan Province of China | A | |
| AU2012278479A1 | Australia | A1 | |
| MX2014000159A | Mexico | A | |
| CN103765894A | China | A | |
| EP2728862A2 | European Patent Office (EPO) | A2 | |
| US2014133571A1 | United States of America | A1 | |
| KR20140085386A | Republic of Korea | A | |
| JP2014521243A | Japan | A | |
| KR20150000854A | Republic of Korea | A | |
| KR101495725B1 | Republic of Korea | B1 | |
| EP2728862A4 | European Patent Office (EPO) | A4 | |
| KR101519818B1 | Republic of Korea | B1 | |
| KR20150060617A | Republic of Korea | A | |
| KR20150060618A | Republic of Korea | A | |
| KR20150060619A | Republic of Korea | A | |
| US2015172697A1 | United States of America | A1 | |
| US2015172698A1 | United States of America | A1 | |
| SG10201503685RA | Singapore | A | |
| SG10201503690QA | Singapore | A | |
| SG10201503692UA | Singapore | A | |
| CN104780363A | China | A | |
| CN104780380A | China | A | |
| JP2015130707A | Japan | A | |
| JP2015130708A | Japan | A | |
| US2015201210A1 | United States of America | A1 | |
| US2015201211A1 | United States of America | A1 | |
| CN104796698A | China | A | |
| CN104796699A | China | A | |
| RU2014103484A | Russian Federation | A | |
| JP2015149776A | Japan | A | |
| US9118926B2 | United States of America | B2 | |
| JP2015156702A | Japan | A | |
| TW201540046A | Taiwan Province of China | A | |
| TW201541940A | Taiwan Province of China | A | |
| TW201541941A | Taiwan Province of China | A | |
| CN105100798A | China | A | |
| JP5832646B2 | Japan | B2 | |
| JP5832683B2 | Japan | B2 | |
| JP5832684B2 | Japan | B2 | |
| ZA201400765B | South Africa | B | |
| US9232229B2 | United States of America | B2 | |
| AU2012278479B2 | Australia | B2 | |
| MX336708BThis record | Mexico | B | |
| TWI520581B | Taiwan Province of China | B | |
| US9253488B2 | United States of America | B2 | |
| US9253502B2 | United States of America | B2 | |
| MX337234B | Mexico | B | |
| SG10201600009WA | Singapore | A | |
| TWI526052B | Taiwan Province of China | B | |
| AU2016201369A1 | Australia | A1 | |
| US9313517B2 | United States of America | B2 | |
| KR101626006B1 | Republic of Korea | B1 | |
| KR101626448B1 | Republic of Korea | B1 | |
| US2016182914A1 | United States of America | A1 | |
| TWI542198B | Taiwan Province of China | B | |
| KR101639335B1 | Republic of Korea | B1 | |
| PH12016501350A1 | Philippines | A1 | |
| PH12016501350B1 | Philippines | B1 | |
| PH12016501351A1 | Philippines | A1 | |
| PH12016501351B1 | Philippines | B1 | |
| PH12016501352A1 | Philippines | A1 | |
| PH12016501352B1 | Philippines | B1 | |
| PH12016501353A1 | Philippines | A1 | |
| PH12016501353B1 | Philippines | B1 | |
| JP5997316B2 | Japan | B2 | |
| JP5997317B2 | Japan | B2 | |
| AU2016201369B2 | Australia | B2 | |
| RU2605915C2 | Russian Federation | C2 | |
| CN104780380B | China | B | |
| ZA201502916B | South Africa | B | |
| ZA201502917B | South Africa | B | |
| ZA201502918B | South Africa | B | |
| ZA201502919B | South Africa | B | |
| AU2017200249A1 | Australia | A1 | |
| CN104796698B | China | B | |
| CN103765894B | China | B | |
| TWI594618B | Taiwan Province of China | B | |
| US2017238007A1 | United States of America | A1 | |
| AU2017200249B2 | Australia | B2 | |
| US9762924B2 | United States of America | B2 | |
| TW201735636A | Taiwan Province of China | A | |
| RU2636100C1 | Russian Federation | C1 | |
| CA2840726C | Canada | C | |
| AU2017268677A1 | Australia | A1 | |
| SG10201708530WA | Singapore | A | |
| CN104796699B | China | B | |
| CN104780363B | China | B | |
| MY166149A | Malaysia | A | |
| US10034014B2 | United States of America | B2 | |
| CN105100798B | China | B | |
| RU2665230C1 | Russian Federation | C1 | |
| US2018332300A1 | United States of America | A1 | |
| TWI643489B | Taiwan Province of China | B | |
| AU2017268677B2 | Australia | B2 | |
| KR101946575B1 | Republic of Korea | B1 |
Numbers
- Publication
- 336708
- Publication, DOCDB
- 336708
- Publication, EPODOC
- MX336708
- Application
- 2015002606
- Application, DOCDB
- 2015002606
- Application, EPODOC
- MX20150002606
Titles2
- English
- METHOD AND APPARATUS FOR CODING VIDEO, AND METHOD AND APPARATUS FOR DECODING VIDEO ACCOMPANIED BY INTER PREDICTION USING COLLOCATED IMAGE.
- Spanish
- METODO Y APARATO PARA LA CODIFICACION DE VIDEO, Y METODO Y APARATO PARA LA DECODIFICACION DE VIDEO ACOMPAÑADA POR INTER PREDICCION UTILIZANDO IMAGEN CO-LOCALIZADA.
Classification
- CPC, 13
- H04N19/52
- H04N19/513
- H04N19/583
- H04N19/159
- H04N19/105
- H04N19/103
- H04N19/176
- H04N19/46
- H04N19/51
- H04N19/573
- H04N19/577
- H04N19/96
- H04N19/503
- IPC, 3
- H04N19 103
- H04N19 176
- H04N19 513