Method for inducing a merge candidate block and device using same.
Abstract
The present invention relates to a method for inducing a combination candidate block and a device using the same. An image decoding method involves the decoding of the information in relation to the region (MER) of motion estimation; determine whether or not an objective block of prediction and a candidate block of spatial combination are included in the same MER; and determining the space combination candidate block to be a candidate block of unavailable combination when the prediction target block and the space combining candidate block are included in the same MER. Consequently, by parallelizing the method for inducing a combination candidate, parallel processing is available and the amount of computation and the complexity of implementation are reduced.

Term
6 yearsleft in the term
Expires 6 September 2032.
- Priority
- Filed
- Granted
- Today
- Expires
6 claims: 1 independent, 5 dependent
- 1REIVINDICACIONES IMPI INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL 1. Un método para decodificar una señal de vídeo con un aparato de decodificación, que comprende:determinar si previamente un candidato de combinación espacial es decodificado o no;determinar si el candidato de combinación espacial se incluye en una misma MER (Región de Estimación de movimiento) como un bloque de predicción actual;cuando el candidato de combinación espacial es decodificado previamente y no está incluido en la misma MER como el bloque de predicción actual, determinar que el candidato de combinación espacial es un candidato de combinación disponible para predicción Ínter del bloque de predicción actual;generar una lista de candidatos de combinación del bloque de predicción actual, la lista de candidatos de combinación incluye el candidato de combinación disponible;y obtener muestras de predicción del bloque de predicción actual basado en la lista de candidato de combinación, en donde el candidato de combinación espacial incluye al menos uno de los bloques vecinos adyacente al bloque de predicción actual, los bloques vecinos, incluyen un bloque de vecino izquierdo, un bloque vecino superior, un bloque vecino superior derecho, un bloque vecino inferior izquierdo y un bloque vecino superior izquierdo, 51 IMPI ¿5^ INSTITUTO MEXICANO DE LA PROPIEDAD en donde, cuando el tamaño de la MER es , '*W?* , ^x *^-ün tamaño de un bloque de codificación es 8x7) 1 SI candidato de combinación espacial se sustituye con un bloque situado fuera de la MER, el bloque de codificación incluye el bloque de predicción actual cuyo tamaño es 8x4 o 4x8, y en donde, cuando el tamaño de la MER no es 8x8 y el tamaño del bloque de codificación no es 8x8, el candidato de combinación espacial no se sustituye con el bloque situado fuera de la MER.
- 2El método de la reivindicación 1, en donde si el candidato de combinación espacial está incluido en el mismo MER como el bloque de predicción actual se determina mediante el uso de la información de nivel de combinación paralela.
- 3El método de la reivindicación 2, en donde la información de nivel de combinación paralela está relacionada con el tamaño de la MER.
- 4El método de la reivindicación 2, en donde si el candidato de combinación espacial está incluido en la misma MER como el bloque de predicción actual se determina mediante uso de información de posición, además de la información del nivel de combinación paralela, la información de posición incluye la información de posición de la predicción actual bloque y posición del candidato de combinación espacial.
- 5El método de la reivindicación 4, en donde cuando un valor resultante de una operación de desplazamiento de bit de 52 INSTITUTO MEXICANO DE LA PROPIEDAD -, . industrial · la información de posición del bloque de predicción actual no es igual a un valor resultante de la operación de desplazamiento de bit de la información de posición del candidato de combinación espacial, se determina que el candidato de combinación espacial no está incluido en la misma MER como el bloque de predicción actual.
- 6El método de la reivindicación 5, en donde la operación de desplazamiento de bit se realiza utilizando la información de nivel de combinación paralela. IMPI
Independent claims6
294 paragraphs in 71 sections, as filed
(54) Title: METHOD TO INDUCE A CANDIDATE BLOCK OF COMBINATION AND DEVICE USING THE SAME.
(54) Title: METHOD FOR INDUCING A MERGE CANDIDATE BLOCK AND DEVICE USING SAME.
(57) Summary
The present invention relates to a method of inducing a combination candidate block and a device using the same. An image decoding method involves decoding the information in relation to the motion estimation region (MER); determining whether or not a prediction target block and a spatial combination candidate block are included in the same MER; and determining the spatial combination candidate block to be an unavailable combination candidate block when the prediction target block and the spatial combination candidate block are included in the same MER. Consequently, by performing the method to induce a combination candidate in parallel, parallel processing is available and the amount of computation and the complexity of implementation are reduced.
(57) Abstract
The present invention relates to a method for inducing a merge candidate block and a device using the same. An image decoding method involves decoding motion estimation region (MER) related information; determining whether or not a predicted target block and a spatial merge candidate block are included in the same MER; and determining the spatial merge candidate block to be an unavailable merge candidate block when the predicted target block and the spatial merge candidate block are included in the same MER. Accordingly, by parallely performing the method for inducing a merge candidate, parallel Processing is enabled and the computation amount and implementation complexity are reduced.
PATENT TITLE No. 352017
Holders): KT CORPORATION
Address: 90 Buljeong-ro, Bundang-gu, Seongnam-city, Kyeonggi-do, 463-711, REPUBLIC OF
KOREA
D nomination: METHOD TO INDUCE A CANDIDATE BLO CK OF CO MBINATION AND
Inventor (s)
DEVICE THAT US
CIP:
Classification ^
<img file="MX352017B_D0001.tif" />
nal d asses 1 '2 ° unit
2,
7 "inas
04/19/19/5
H04N1 & / 64
CPC :, ^ 04 ^ 9/513:
-. U04N19 / 82; H04 ΒΑξ KEUN L ^ E;
H04N19 / 182, H04N19 / 583; 9/593 | H04N19 / 182; H04N19 / 61;<sup>r</sup> in:
..Λ
Number:
MX / a / 20167941509 ntetnacionali
2012 $ 'w A *!
ro:
¿96138
039500
Validity: V ^ t Date of Ve Date of Exp
The reference patent is ^^ l In accordance with Article 23 from the filing date jjpDe * irt | y¡Jenaa ta # rSara mant
Whoever signs this title lo h $ M (Official Gazette of the Federation (Dx 01/25/2006, 05/06/2009, 06/01/2010, 18 / Regulation of the Mexican Institute of Articles 1<sup>or</sup>, 3rd, 4th, 5th section V subsection a), 16 fra 12/27/19 99, amend ed 10/10/2002, 07/29/2004. 04/08 General Deputy. Coordinator. Divisional Directors, to
10/19 rne ^ l 26 lity Industrial.
year # non-extendable, counted the rights.
the Industrial Property Law 5/1999, 01/26/2004, 06/16/2005, subsection a), 4<sup>or</sup> and 12 'sections I and III of 07/15/2004, 07/28/2004 and 09/07/2007);
13Λ1
TituM or Mexican Industrial Property (DOF the Agreement that delegates powers to Regional Directors, Divisional Deputy Directors, Coordinators
Departmental and other subordinates of the Mexican Institute of Industrial Property. (DOF 12/15/1999, amended on 02/04/2000, 07/29/2004,
08/04/2004 and 09/13/2007).
This document is signed with an advanced electronic signature (FIEL), based on articles 7 BIS 2 of the Industrial Property Law; 3 of its Regulations, and 1 section III, 2 section V, 26 BIS and 26 TER of the Agreement establishing the guidelines for the use of the Payment and Electronic Services Portal (PASE) of the Mexican Institute of Industrial Property, in the procedures indicated.
THE DIVISIONAL DIRECTOR OF PATENTS
NAHANNY CANAL REYES
<img file="MX352017B_D0002.tif" />
Original string:
NAHANNY MARISOL CANAL REYES | 00001000000403252793 | Administration Service
Tax | 1695 || MX / 2017/90686 | MX / a / 2016/011509 | Normal patent title with divisional PCT | 1223 | GAGV | Page (s) | dZs8OBIIZMmlHxRUmRLUIrkvPM =
Digital stamp:
io2p15uCSLIkjaPPSppR3ZJ + PQv4BG3fz4cUWt0u999wFvzKJIwvn7VEOgqo1NbLd¡WtcRTH35SyYlggRb5uZGRu8W sd427PN3gD5aQjT9KIEFt4phZeM / A5y8nysmt02c4UqLRZpyBR9fPvwRMDJISeK5JZHjvMRsSA5¡9KySxyb6WuS3Un aCu9uOW986sM5xll73qhiCIFYIUe80Z30R4SWAX4fAC8TOfmtLgkw1JLLaoPFJYM7lpeRhlbRRolBwmM / KkyB / LRT> SeO1S4o / KBFoMDXgpDBIm2diPbAjfGflsgrrbYpckZQ5mgYNf8CelRoZdR2 + == GT7jzy1Vnk1w
Arenal No. 550, Floor 1, Pueblo Santa María Tepepan, Xochimilco, 16020,
Mexico City.
(55) 53340700 www.gob.mx/impi
<img file="MX352017B_D0003.tif" />
<img file="MX352017B_D0004.tif" />
METHOD TO INDUCE A COI CANDIDATE BLOCK
INDUSTRIAL CttCCBDAD
<img file="MX352017B_D0005.tif" />
DEVICE USING THE SAME
FIELD OF THE INVENTION
The present invention relates to a video encoding and decoding method, and more particularly to a method of deriving a combination candidate block and an apparatus using the same.
BACKGROUND ART
Recently, a demand for high-resolution, high-quality video such as high-definition video (HD) and ultra-high-definition video (UHD) has increased in various fields of application. As the resolution and quality of video is higher, a quantity of video increases relatively compared to an existing video, and therefore, in a case where the video is transmitted using a medium such as a wired or wireless broadband network or by storing on an existing storage medium, a transmission cost and a storage cost can be increased. To solve these problems generated as resolution and quality are increasing, you can use highly efficient video compression techniques.
Video compression techniques include various techniques such as an Inter (image) prediction technique to predict a pixel value included in a current image.
IMPI INSTITUTO MEXICANO DE U MONEDAD, INDUSTRIAL of an image before or after the current image, a
<img file="MX352017B_D0006.tif" />
intra (image) prediction technique to predict the pixel value included in a current image using the pixel information within the current image, and an entropy coding technique to assign a short code to a value of high frequency of occurrence and by assigning a long code to a low occurrence frequency value, and the video data can be effectively compressed to be transmitted or stored using such a video compression technique.
DESCRIPTION
TECHNICAL PROBLEM
The first purpose of the present invention is to provide a method of deriving a combination candidate with parallel processing.
The second purpose of the present invention is to provide an apparatus for performing a method of deriving the combination candidate with parallel processing.
TECHNICAL SOLUTION
In accordance with one aspect of the present invention to achieve the first objective of the present invention described above, a method of deriving a combination candidate is provided. The method may include motion estimation region related information decoding (MER); determine whether a prediction block target and a combination candidate block are
IMPIé ^
MEXICAN INSTITUTE
PE LA MONEDA »include in the same MER; and decide the spatial combination candidate block as a candidate block with the combination unavailable if determining a combination candidate block that does not use the spatial combination candidate block when the prediction target block and the spatial combination candidate block are included in the same MER. The method may further include adaptively determining a combination candidate block according to a MER size and a prediction target block size if the prediction target block and the spatial combination candidate block are included in the same MER. If the size of the MER is 8x8 and the size of the prediction target block is 8x4 or 4x8, in at least one of the spatial combination candidate blocks of the prediction target block it can be replaced with a block that includes a point located outside of lick. The method may further include determining whether the spatial combining candidate block is included in a MER that is not yet decoded. The method may include additional by replacing the spatial combination candidate block with a block included in another MER if the prediction target block and the spatial combination candidate block are included in the same MER. The replaced spatial merge candidate block may be a spatial merge candidate block that is adaptively replaced to be included in
IMPI • NSTnVTO MEXICANO --M LA CURRENCY a different MER from the target block of prediction <5ff<sup>us</sup>3£<sup>t</sup> adSUEUr to a location of the candidate block of change or 16n — eap & e-ia 1 included in the same MER. The information related to the MER can be the information related to the size of the MER and transmitted in the unit of an image. Determining whether the prediction target block and the spatial combination candidate block are included in the same MER may include determining whether the prediction target block and the spatial combination candidate block are included in the same MER according to an equation of determination based on the location information of the prediction target block, the location information of the spatial combination candidate block, and the size information of the MER.
In accordance with another aspect of the present invention to achieve the second objective of the present invention described above, image decoding is provided. The apparatus may include an entropy decoding unit for the region (MER) of the decoded motion estimation region relative to the information and a prediction unit for determining whether a prediction target block and spatial combination candidate block are include in the same MER and decide the spatial combination candidate block as an unavailable combination candidate block if the prediction target block and the candidate block of spatial combination is included in the same MER. The unit of
IMPI INSTITUTO MEXICANO PE LA FROfltOAD prediction can be a unit of predicts i όη ^ φ® *<sup>1</sup> det ^ SfeSi adaptively match a candidate block of ien- according to a MER size and a prediction target block size if the prediction target block and the combination candidate block are included in the same MER. If the size of the MER is 8x8 and the size of the prediction target block is 8x4 or 4x8, the prediction unit may replace at least one of the spatial combination candidate blocks of the prediction target block with a block that includes a point located outside the MER. The prediction unit can determine whether the spatial combination candidate block is included in a MER that is not yet decoded. The prediction unit may be a prediction unit that replaces the spatial combination candidate block with a block included in another MER when the prediction target block and the spatial combination candidate block are included in the same MER. The replaced spatial combination candidate block may be a spatial combination candidate block that is adaptively replaced to be included in a different MER of the prediction target block according to a location of the spatial combination candidate block included in the same MER. The information related to the MER can be information relating to the size of the MER, and transmitted in unit of an image. The prediction unit can be a prediction unit that
IMPI ^^
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL ™ determines whether the prediction target block and the spatial combination candidate block are included in the same MÉR based on a determination equation according to the location information of the prediction target block, the location information of the combination candidate block spatial, and the size information of the MER.
ADVANTAGED EFFECTS
According to a method of deriving a combination candidate block and an apparatus using the same described in exemplary embodiments of the present invention, parallel processing can be achieved by performing the parallel combination candidate block derivation method, therefore, a computational quality and implementation complexity can be reduced.
DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram illustrating a video encoder according to an exemplary embodiment of the present invention.
FIG. 2 is a block diagram illustrating a video encoder according to another exemplary embodiment of the present invention.
Figure 3 is a conceptual view illustrating candidate blocks for applying a blend mode and a skip mode according to an exemplary embodiment of the present invention.
IMPI ^^
MEXICAN INSTITUTE
OF THE PROPERTY
FIG. 4 is a conceptual view illustrating a method of deciding an emergency candidate block according to an exemplary embodiment of the present invention.
FIG. 5 is a conceptual view illustrating a method of deciding a combining candidate block according to a size of a MER according to an exemplary embodiment of the present invention.
Figure 6 is a conceptual view illustrating a method of determining whether a spatial combination candidate block is available from a current block.
FIG. 7 is a flow chart illustrating a method of obtaining a spatial combining candidate block in a combining mode according to an exemplary embodiment of the present invention.
FIG. 8 is a flow chart illustrating an Interprediction method applying a combining mode according to an exemplary embodiment of the present invention.
BEST MODE FOR THE INVENTION
Since various modifications and example embodiments can be made, only the particular example embodiments will be more fully described herein with reference to the accompanying drawings. However, the present invention should not be construed as limited to just the exemplary embodiments set forth herein but rather should be understood to
<img file="MX352017B_D0007.tif" />
cover all modifications
IMPI
DWTTTUTO MEXICANO DE LA PROPERTY INDUSTRIAL equivalents or alternatives that fail within the close and technical terms of the invention. Like numbers refer to like items throughout the drawings.
It should be understood that, although the first terms, second, etc. can be used here to describe various elements, these elements should not be limited by those terms. These terms are used only to distinguish one item from another. For example, a first element must be finished a second element without departing from the teachings of the present invention, and similarly, the second element must be finished the first element. The term and / or includes a combination of a plurality of associated listed items or any of the plurality of associated listed items.
It should be understood that, when a figure or element is referred to as being connected or coupled to another figure or element, it can be directly connected or coupled to the other intervening element or elements may be present. In contrast a figure or element is referred to as being directly connected or coupled directly to another element, it should be understood that there are no intervening elements present.
The terminology used herein is for the purpose of the particular embodiments described only and is not intended to be limited to the exemplary embodiments of the invention. The singular forms a, an, and the industrial plural forms are intended as well, unless the context is clearly stated otherwise. The terms should be understood to comprise, or include, when used herein, specifically the presence of figures of indicated features, integers, steps, operations, elements, components, or any combination thereof, but not preclude the presence or addition of one or more other figures, integers, steps, operations, elements, components, or any combination thereof.
Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the same reference numerals are used throughout the drawings to refer to the same parts and a repetitive explanation of the same parts. \
FIG. 1 is a block diagram illustrating a video encoder according to an exemplary embodiment of the present invention.
Referring to FIG. 1, a video encoder 100 may include an image partition mode 110, an inter-prediction module 120, an intra-prediction module 125, a transform module 130, a quantization module 135, a reorganization module 160, an entropy encoding module 165, a dequantization module 140, an inverse transform module 145, a
IMPI
INSTITUTO MEXICANO M LA PROPERTY INDUSTRIAL filtration module 150, and a memory 155. industrial
Each module shown in Figure T ™ is independently illustrated to provide different figures of functions in the video encoder and is not intended to mean that each module is configured as a separate hardware or software component unit. That is, each module is listed as a respective element for illustrative purposes, and at least two modules between modules can be combined into one element or one module can be divided into a plurality of elements to perform a function, and a mode in which the respective modules combined or divided are included within the scope of the claims of the present invention without departing from the essence of the present invention.
Also, an element part may not be an indispensable element to perform an essential function in the present invention but simply a selective element to improve performance. The present invention can be implemented with only essential elements to implement the essence of the present invention and excluding elements used simply to improve performance, and a configuration that includes only the essential elements that excludes selective elements, which are used only to improve performance. performance, is also included in the vicinity of the claims of the present invention.
IMPI ^^
MEXICAN INSTITUTE
DC THE PROPERTY
The partitioning module 110 can **<sup>or</sup>SWidi ^^ 5th input image in at least one unit of 'processing<sup>-</sup>· Here, the processing unit can be a prediction unit (PU), a transformation unit (TU), or a coding unit (CU). The image partition module 110 can divide an image into a combination of a plurality of coded units, the prediction units and the transform units and can code the image by selecting a combination of a coded unit, prediction unit (s) and transform unit (s) based on a predetermined criterion (eg, a cost function).
For example, an image can be partitioned into a plurality of encoded units. To partition the coding unit, a recursive tree structure such as a frame tree structure can be used, and a coding unit that is divided into other coding units with an image or a larger coding unit as a root. it can be divided to have a secondary node as any as a number of coding units divided. An encoding unit does not divide any additional according to a certain restriction it becomes an external node. In other words, when it is assumed that only one square partition is available for a coding unit, one coding unit can divide up to four different coding units.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX352017B_D0008.tif" />
Hereinafter, in modalities as cie éj'emplb “dé<sup>-</sup> the? In the present invention, the encoding unit can be used to refer to not only a unit for encoding but also a unit for decoding.
The prediction unit can be partitioned into a shape of squares or rectangles having the same size within a coding unit.
When the prediction unit is generated to perform an intra-prediction based on the coding unit, if the coding unit is not a very small coding unit, the intra-prediction can be performed without being divided into a plurality of prediction units in one NxN unit.
The prediction module may include the interprediction module 120 for performing an interprediction and the intraprediction module 125 for performing an intraprediction. Regarding the prediction unit, the prediction module can determine whether to perform the inter-prediction or whether to perform the intra-prediction, and it can determine the specific information (for example, an intra-prediction mode, a motion vector, an image of reference, etc.) according to each prediction method. Here, a processing unit to perform the prediction and a processing unit to determine the method of
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL prediction and a specific detail may be different. For example, the prediction method and the prediction mode can be determined in the prediction unit and the prediction can be performed in the transformation unit. A residual value (a residual block) between a generated prediction block and an original block can be transmitted to the transform module 130. Also, the information of the prediction mode, the information of the motion vector, etc. used for the prediction can be encoded in the entropy encoding module 135 along with the residual value to be transmitted to the encoder. When a specific encoding mode is used, it is possible that the prediction block is not generated through the prediction module 120, 125 but the original block is encoded as it is transmitted to the encoder.
The inter-prediction module can predict in the prediction unit based on the information of at least one image among the before or after images for a current image. The interprediction module may include a reference image interpolation module, a motion prediction module, and a motion compensation module.
The reference image interpolation module can be provided with reference image information from memory 155 and can generate pixel information generated in less than one integrated pixel unit. In case of a pixel of
ΙΜΡΙ ^ ι
INSTITUTE M £ X1CANO
OF THE Luminance PROPERTY, a touch 8 base DCT filter of '^ T ^ f ^ tpoí ^ í ^ n can be used in which a coefficient of tiitfó üd UJlia could generate generated pixel information smaller than the pixel unit integrated by a 1/4 pixel unit. In case of a chroma signal, a 4-touch interpolation filter filter base DCT can be used in which a filter coefficient is varied to generate pixel information less than the unit pixel composed of a 1/8 unit pixel.
The motion prediction module can perform motion prediction based on a reference image interpolated by the reference image interpolation module. For a method of obtaining the motion vector, various methods such as FBMA (Total Headquarters Search Block Match Algorithm), TSS (Three-Step Search), or NTS (New Three-Step Search Algorithm) can be used. . The motion vector can have a motion value in a unit of 1/2 or 1/4 pixel based on the interpolated pixel. The motion prediction module can predict a current prediction unit by varying the motion prediction method. As a motion prediction method, various methods such as a skip mode, a combination mode, or a forward motion vector prediction mode (AMVP) can be used.
According to exemplary embodiments of the present invention when performing inter-prediction, the motion estimation region (MER) may be defined to perform the prediction in parallel. For example, when you perform Interprediction using combine mode or skip mode, if a prediction target block is not included in the same MER, and when the prediction target block and spatial combination candidate block are not included in the same MER, the spatial combination candidate block can be determined as not available or a spatial combination candidate block can be determined by determining whether the spatial combination candidate block is included in a MER that is not yet encoded. Hereinafter, in the exemplary embodiments of the present invention, an operation of the prediction unit when performing inter-prediction is described.
The Interprediction unit can generate the prediction unit based on information in neighboring reference pixels of a current block, where the reference pixels are pixels within the current image. If a neighboring block of the current prediction unit is a block in which the inter-prediction is carried out such that some reference pixels are pixels in which the inter-prediction is carried out, the reference pixels included in the block in which the inter-prediction is carried out performed can be replaced with the reference pixels of the neighboring block in which the intra prediction is performed. In other words, when the pixel of
IMPI ^
MEXICAN INSTITUTE
OF THE PROMISED reference, the reference pixels that are not can be replaced with at least one reference pixel among the available reference pixels.
Intra-prediction can have directional prediction modes that use information in the reference pixels according to a prediction direction and non-directional modes that do not use directional information when predicting. A mode for predicting information in luminosity samples and a mode for predicting information in chroma samples may be different. Furthermore, information in the intra-prediction mode that is used for luminosity samples or information in predicted luminosity signals can be used to predict information in chroma samples.
In case where a prediction unit size and a transform unit size are the same when performing the intra-prediction, the intra-prediction can be performed in the prediction unit based on pixels that exist on a left side of the unit. of prediction, the pixels that exist in an upper left region, and pixels that exist in an upper region. However, in a case where the size of the prediction unit and the size of the transform unit are different when performing the intra prediction, the intra prediction can be performed using the reference pixels based on the unit of
IMPI ^ á
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL transformation. Also, intra-prediction using division of NxN only with respect to the smallest coding unit can be used.
In the intra prediction method, according to the prediction mode, an intra smoothed filter dependent mode (MDIS) can be applied to the reference pixel to generate the prediction block. A kind of the MDIS filter that you apply to the reference pixel may be different. To perform intra prediction, the intra prediction mode of the current intra prediction unit is neighboring the current prediction unit. When predicting the prediction mode of the current prediction unit using the predicted mode information from a neighboring prediction unit, if the intra prediction modes of the current prediction unit and the neighboring prediction unit are the same, the information that the prediction modes of the current prediction unit and the neighboring prediction unit are the same can be transmitted using the predetermined flag information, and if the prediction modes of the current prediction unit and the neighboring prediction unit are different, the prediction mode information of the current block can be decoded by the entropy encoder.
Also, a residual block that includes residual value information that is a difference between the prediction unit in which the prediction is made based on the unit
IMPI
MEXICAN INSTITUTE
OF THE PREDICTION PROPERTY generated in modulo 120, 125 of ^^ éíü'cc wn<sup>-</sup>and "an original block of the generated residual block ET prediction unit can be transmitted to the transformation module 130. The transform module 130 may transform the residual block including the residual value information from the original block and the prediction unit generated in the module 120, 125 using a transform method such as a discrete cosine transform (DCT) or a transform. (DST) discrete sine. Whether to apply DCT or DST to transform the residual block can be determined based on the intra-prediction mode information of the prediction unit used to generate the residual block.
The quantization module 135 can quantize values transformed into a domain frequency by the transform module 130. Depending on a block or an importance of an image, a quantization parameter can be varied.
/
A value emitted by the quantization module 135 may be provided to the dequantization module 140 and the reorganization module 160.
The reorganization module 160 may reorganize the value of the quantized coefficient with respect to the residual value.
The reorganization module 160 can modify a coefficient of a two-dimensional matrix in a form of a
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX352017B_D0009.tif" />
dimensional vector through a coefficient scan method. For example, in the reorganization modulus, a DC coefficient to a coefficient in a high frequency domain can be scanned to be rearranged to a single dimension vector formed using a diagonal scan mode. According to a size of a transform unit and the intra-prediction mode, a vertical scan mode of scanning three-dimensional coefficients in a block of a column direction or a horizontal scan mode of scanning two-dimensional coefficients in the block from in a row direction can be used instead of the diagonal scan mode. In other words, it can be determined that the scan mode between the diagonal scan mode, the vertical scan mode, and the horizontal scan mode is used according to the size of the transform unit and the intra-prediction mode.
Entropy encoding module 165 performs entropy encoding based on values emitted from reorganization module 160. Entropy encoding can use various encoding methods such as, for example, Golomb Exponential, Contextual Binary Arithmetic (CABAC) Coding.
The entropy encoding unit 165 may encode various information such as information on the residual information coefficient of the encoding unit and the
IMPIAS
MEXICAN INSTITUTE I *
FROM PROPERTY block-type information, transformation information, vector information from muu imiewfe », ·· reference image information, interpolation information in a block, filtering information, MER information, and so on from reorganization module 160 and prediction module 120, 125.
The entropy coding unit 165 can perform entropy coding on the coefficient value in the coding unit emitted from the reorganization module 160 using the entropy coding method such as CABAC.
The dequantization module 140 and the inverse transform module 145 dequantize values quantized by the quantization module 135 and inversely transforms the values transformed by the transform module 130. The residual value generated by the dequantization module 140 and the inverse transform module 145 can be added to the predicted prediction unit through the motion estimation module, the motion compensation module and the intra prediction module included in the prediction modulo 120, 125 to generate a reconstructed block.
Filtration module 150 may include at least one of an unblocking filter, a drift correction module, and an adaptive loop filter (ALF).
<img file="MX352017B_D0010.tif" />
IMPI MEXICAN INSTITUTE OF PROPERTY
The unblocking filter may remove a block generated due to a boundary between bloilU'éS Sñ a reconstructed image. To determine whether to perform unblocking filtering, it can be determined whether to apply the unblocking filter to the current block based on pixels included in various columns or rows included in the block. When applying the unblocking filter to the block, a strong filter or a weak filter can be applied depending on a required strong unblocking filtration. Also, in the unblocking filter application, when performing vertical filtration and horizontal filtration, horizontal direction filtration and vertical direction filtration can be processed in parallel.
The skew correction module can correct a skew of an original image by one pixel unit from the image on which the deblocking filtering is performed. To perform deviation correction with respect to a specific image, a pixel classification method included in the image in a predetermined number of regions, which determines a region in which the deviation will be performed and the application of the deviation to a corresponding region or a deviation application method considering the edge information of each pixel can be used.
The adaptive loop filter (ALF) can perform the
IMPI ^
INSTITUTO MEXICANO JR
CURRENCY filtering based on a comparison of the reconstructed image fflTration and the originate image. After Ia7 classification of pixels included in the image in a predetermined group and the determination of a filter to be applied to a corresponding group, and then the filtration can be applied to each determined group for differentially with each filter. Information about whether to apply the ALF can be transmitted by the coding unit (GU) and a size and a coefficient of the ALF to be applied can be different for each block. The ALF can have several forms, and therefore a number of coefficients in the filter can be different for each filter. Filtering refers to the ALF information (filtering coefficient information, ALF On / Off information, filter shape information, etc.) can be included and transmitted in a predetermined parameter setting in a stream or bit stream.
The memory 155 can store a reconstructed block or the image output from the filter module 150, and the stored reconstructed block or image can be provided to the prediction module 120, 125 when it performs the interprediction.
Figure 2 is a block diagram illustrating an image encoder according to another exemplary embodiment of the present invention.
IMPI
IMTIIUIU MUUCANO OF INDUSTRIAL CURRENCY
Referring to FIG. 2, a video encoder may include an entropy decoding module 210, a reorganization module 215, a dequantization module 220, an inverse transform module 225, a prediction module 230, 235, a module 240 filter, and a memory 245.
When a video bit stream is transmitted from the video encoder, the input bit stream can be decoded in an order opposite to the order of processing in the video encoder.
The entropy decoding module 210 can perform entropy decoding in an opposite order of performing entropy encoding in the entropy encoding module of the video encoder. The information to generate the prediction block between the information encoded by the entropy decoding module 210 can be provided to the prediction module 230, 235 "and the residual values that the entropy is encoded in the entropy encoding module can be transmitted. to reorganization module 215.
The entropy decoding module 210 can decode the information regarding the intra-prediction and the inter-prediction made by the encoder. As described above, when there is a predetermined restriction for Intraprediction and Interprediction in video encoding, the information refers to the
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD _ INDUSTRIAL intra-prediction and inter-prediction of the current block can be provided by performing He entropy decoding based on the constraint.
The reorganization module 215 can perform the reordering of the entropy decoding bit stream by the entropy decoding module 210 based on an encoder reorganization method. The coefficients represented in a single dimensional vector shape can be reconstructed and rearranged into a two dimensional block shape.
The dequantization module 220 can perform dequantization based on the quantization parameter provided from the encoder and the reorganization coefficient block.
The inverse transform module 225 performs an inverse DCT and an inverse DST on a quantization result performed by the video encoder with respect to the DCT and DST performed by the transform module. The inverse transform can be performed based on the transmission unit determined by the video encoder. In the video encoder transform module, DCT and DST can be selectively performed according to a plurality of information such as prediction method, current block size, and prediction direction, and modulus 225 inverse transform video encoder
IMPI ^
INSTITUTO MEXICANO DB LA PROPERTY can perform the inverse transform ba ^ S ^ S ^ *<sup>1,</sup> in ^ ia information of the transform carried out in module 35 Ta * transformed of the video encoder.
The prediction module 230, 235 may generate the prediction block based on information related to the generation of the prediction block provided from the entropy decoding module 210 and the information of the previously decoded block or image provided from memory 245.
The prediction module 230, 235 may include a prediction unit determination module, an inter-prediction module, and an intra-prediction module. The prediction unit determination module can receive various information such as prediction unit information, prediction mode information of the intra-prediction method, and information regarding motion prediction of the inter-prediction method transmitted from the entropy encoder, distinguish the prediction unit in the current coding unit based on the received information, and determining whether the inter-prediction is performed in the prediction unit or the intra-prediction is performed in the prediction unit. The Interprediction unit can perform the interprediction with respect to the current prediction unit based on the information included in at least one image between the previous images and subsequent images of the current image that
IMPI
INSTITUTO MEXICANO • E LA PROPERTY •. _. INDUSTRIAL 7 include the uni
<img file="MX352017B_D0011.tif" />
current prediction provided by the video encoder.
To perform inter-prediction, it can be determined based on the coding unit whether the motion prediction method in the prediction unit included in a corresponding coding unit is the skip mode, the combination mode, or the AMVP mode.
According to an exemplary embodiment of the present invention, when performing inter-prediction, the motion estimation region (MER) may be defined ♦ to perform prediction in parallel. For example, when interpredicting using the skip combination , whether the prediction target block and the spatial combination candidate block are included in the same MER can be determined. When the prediction target block and the spatial combination candidate block are not included in the same MER, the spatial combination candidate block can be determined as a combination candidate block by determining whether the spatial combination candidate block is included in a MER that still exists. it is not decoded. An operation of the prediction module will be described in detail in an exemplary embodiment of the present invention.
The intra-prediction module can generate a prediction block based on the pixel information within the current image. When the prediction unit is a unit of
<img file="MX352017B_D0012.tif" />
IMPI INSTITUTO MEXICANO DE LA NIEDAD ___ j · _.<sub>to</sub>_ ____. τ _. _ _j · INDUSTRIAL prediction To perform the intra prediction, the prediction can be performed based on the mode mrormation of the prediction unit provided by the video encoder. The intra-prediction module may include the MDIS filter, a reference pixel interpolation module, and a DC filter. The MDIS filter is a module for filtering the reference pixel of the current block, and if applying the filter can be determined and applied according to the prediction mode of the current prediction unit. Filtering can be performed on the reference pixel of the current block using the prediction mode of the prediction unit and the MDIS filter information provided by the video encoder. When the prediction mode of the current block is a non-filtering mode, you may not apply the MDIS filter.
The reference pixel interpolation module can generate a reference pixel in the pixel unit less than an integrated value by interpolating the reference pixel when the prediction mode of the prediction unit is the prediction unit to perform the intra-based prediction at a pixel value of the interpolated reference pixel. When the prediction mode of the current prediction unit is a prediction mode that generates the prediction block without interpolating the reference pixel, the reference pixel may not be interpolated. The DC filter can generate the block
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL prediction through filtration if the prediction mode of the current block is a DC mode.
The reconstructed block or image can be provided to the filter module 240. The filter module 240 may include an unblocking filter, an offset correction module, an ALF.
Information on whether the unblocking filter is applied to a corresponding block or picture and whether a strong filter or a weak filter is applied if the debugging filter is applied can be provided from the video encoder. The unblocking filter of the video encoder can be provided with information about the unblocking filter from the video encoder and perform unblocking filtering for the corresponding blocking in the video encoder. The same as the video encoder, a vertical unlocking filtering and a horizontal unblocking filtering are performed first since at least one of the vertical unlocking and horizontal unlocking can be performed in an overlapping area. In the overlapping area of the vertical release filtration and the horizontal release filtration, the vertical release filtration or the horizontal release filtration that has not previously been performed can be performed. Through this unblocking filtration process, a parallel processing of the unblocking filtration may be possible.
IMPI ^
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL
The deviation correction module can perform deviation correction applied to the image and deviation value information.
The ALF can perform filtering based on a comparison value to the original image and the reconstructed image through filtering. The ALF can be applied to the encoding unit based on information about itself to apply the ALF, the information about an ALF coefficient provided from the encoder. The ALF information can be included in a setting of the particular parameter to be provided.
The memory 245 can store the reconstructed image or block to be used as the reference image or the reference block and the reconstructed image can be provided to the output module.
As described above, although the coding unit is used to refer to a coding unit in exemplary mode, the coding unit may be a unit for performing not only coding but also coding. Hereinafter, a prediction method described in Figures 3 through 11 according to an exemplary embodiment of the present invention may be performed by an element such as the prediction module included in Figure 1 and Figure two.
Figure 3 is a conceptual view illustrating candidate blocks to apply the combination mode and the matching mode.
<img file="MX352017B_D0013.tif" />
IMPI •• MEXICAN STITUTE
M LA FXONEDAD industrial omission according to an exemplary embodiment of the present invention.
Hereinafter, for illustrative purposes, a description is made with respect to the mode of combination in an exemplary embodiment of the present invention; however, the same method can be applied to the skip mode and such mode is also included in the vicinity of the claims in the present invention.
Referring to FIG. 3, to perform inter-prediction through the combination mode, blocks 300, 305, 310, 315, 32 0 spatial combination candidates and blocks 250, 255 temporary combination candidates can be used.
When a point (xP, yP) located in an upper left portion of the prediction target block relative to a prediction target block location, with a prediction target block width, nPSW and a prediction target block height, sPSH , each block of the spatial combination candidate blocks 300, 205, 310, 315, 320 may be one of a first block 300 that includes a point (xP-Ι, yP + nPSH-MinPuSize), a second block 305 that includes a point (xP + nPSW-MinPuSize, yP-Ι), a third block 310 that includes a point (xP + nPSW, yP-Ι), a fourth block 315 that includes a point (xP-Ι , yP + nPSH), and a fifth block 320 that includes a point (xP-MinPuSize, yP-Ι).
IMPI ^
MEXICAN INSTITUTE
OF THE «INDUSTRIAL OEIETY -The temporary combination candidate can use a plurality of candidate blocks and a first Column block 350 (placed block) can be a block that includes a point (xP + nPSW, yP + nPSH) located in an image column (image placed). If the first Column block 350 does not exist or is not available (for example, if the first Column block does not perform the Interprediction), a second Column block 355 including a point (xP + (nPSW >> l), yP + ( nPSH >> l)) located in the Column image can be used instead.
According to an exemplary embodiment of the present invention, to perform the inter-prediction using the parallel combination mode when performing the motion prediction, yes to use the combination candidate block in relation to a certain area can be determined . For example, to determine the combination candidate block to perform the combination mode, relative to a predetermined area of a certain size, it can be determined whether the combination candidate block exists with the predetermined area together with the prediction target block for determine whether to use the join candidate block or not, or replace with another join candidate block, therefore make the prediction of movement in parallel in relation to the predetermined area. Hereinafter, a parallel motion prediction method using the combination mode will be described in a mode by way of
ΙΜΡΙ £ ^
MEXICAN INSTITUTE
BE THE INDUSTRIAL PROPERTY an example of the present invention.
FIG. 4 is a conceptual view illustrating a method of determining a combination candidate block according to an exemplary embodiment of the present invention.
Referring to FIG. 4, it is assumed that a larger coding unit (LCU) is divided into four motion estimation regions (MER).
In case of a first prediction PUO block in a first MER (MERO), similar to figure 4, when the inter-prediction is performed using the combination mode with respect to the first prediction PUO block, five blocks 400, 405, 410 , 415, 420 spatial combination candidates may exist as the spatial combination candidate blocks. The five blocks 400, 405, 410, 415, 420 spatial combination candidates may exist in a location not included in the first MER (MERO) and may be blocks in which encode / decode have already been performed.
The second prediction block (PUI) is a prediction block included in a second MER (MER1) and four blocks 430, 435, 445, 450 combination candidates among blocks 430, 435, 440, 445, 450 combination candidates for performing the inter-prediction using the combination mode can be blocks that exist within the second MER (MER1) and blocks that belong to the same MER that currently performs the prediction. The remainder of a 440 candidate block of
INSTITUTO MEXICANO DE LA PROPIEDAD combination can be a block that exists in u.n '^' a & o right of the current MER and a block included in Ia<sup>J</sup> LCU or MER where encoding / decoding has not been done yet.
According to an exemplary embodiment of the present invention, when the combination candidate block of the current block and the current block belong to the same MER, the combination candidate block of the current block is excluded and the movement information of at Minus one block in another location can be added as the combination candidate according to a current block size and a MER size.
A block that includes a point that exists in another MER in a vertical or horizontal direction can be added as the candidate combination block. Alternatively, a block remains at another MER in a location very close to the candidate block can be added as the combination candidate block. Alternatively, a block at a predetermined location according to a shape and size of the current block can be added as a combination candidate block.
For example, in the case of combination candidate block 435 located on an upper side of the second prediction unit (PU1) and combination candidate block 450 located on an upper left side of the second prediction unit, blocks 455, 460 including
IMPI Mexican institute DE LA PROPIEDAD INDUSTRIAL points located outside the second MER in the vertical direction can be used as replacement combination candidate blocks. For the combination candidate block 430 located on a left side of the second prediction unit and the combination candidate block 445 located on a lower left side of the second prediction unit, blocks 465, 470 include points outside the MER in the horizontal direction can be used as the replacement combination candidate blocks. When a block is included in the same MER with the current prediction unit and therefore cannot be used as the combination candidate block, the combination candidate block can be replaced with another block that includes a point in another MER according to a location of the combination candidate block.
In case of a third prediction block (PU2), a combination candidate block 475 including the same MER with the third prediction block can be replaced to be used by a block 480, which exists on an upper side in the vertical direction. . Additionally, as another exemplary embodiment of the present invention, it is possible to replace the location of the combination candidate block in another MER in a direction not the vertical or horizontal direction and this exemplary embodiment is also included in the vicinity of claiming the present invention.
The following steps can be performed to perform
IMPI
INSTITUTO MEXICANO DE LA MONEDAD INBUSTUAL a method to determine the candidate combination blocks.
1) Region step (MER) of encoding movement estimation in relation to the information.
The MER in relation to the information can include information in a size of the MER. Whether the prediction target block is included in the MER can be determined based on the information in the MER size and the size of the prediction target block.
2) Step of determining whether the prediction target block and the combination candidate block are included in the same MER.
In the case that the prediction target block and the spatial combination candidate block are included in the same MER, the following steps can be performed to adaptively determine the spatial combination candidate block according to the size of the MER and the size of the block. prediction target.
3) Step of determining that the spatial combination candidate block is not available when the prediction target block and the spatial combination candidate block are included in the same MER.
When the prediction target block and the spatial combination candidate block are included in the same MER, the spatial combination candidate block can be determined as unavailable and the
IMPI
INSTITUTO MEXICANO DE LA EROHEDAH industrial. candidate block
<img file="MX352017B_D0014.tif" />
spatial combination included in the same MER can be replaced with another candidate combination block. Also, as described above, it is possible that the combination candidate block that is determined to be unavailable may not be used in the inter-prediction with the combination mode.
According to another exemplary embodiment of the present invention, a method that does not use the combining candidate block included in the same MER with the prediction target block can also be applied.
For example, between combination candidate blocks, blocks that are included in a MER that encoding / decoding has already been performed on, and if different from a current MER that the prediction is currently performed on, are available for the Inter-prediction that apply the parallel combination mode. The blocks can be used as the interprediction candidate blocks with the combination mode. However, the blocks belonging to the MER in which the prediction is currently performed may not be used as the candidate interprediction block for the interprediction with the combination mode. The block in which the encoding / decoding is not performed or cannot be used as the candidate block for Interprediction. This modality by way of example is also included in the proximity
<img file="MX352017B_D0015.tif" />
of the claim of the present invention.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL CURRENCY
FIG. 5 is a conceptual view illustrating a method of determining a combining candidate block based on a size of a MER in accordance with an exemplary embodiment of the present invention.
Referring to Figure 5, the candidate combination can be adaptively determined according to the size of the MER and the size of the current prediction unit. For example, in a case where a combination candidate corresponding to one of the location combination candidates A, B, C, D, E is included in the same MER with the current prediction unit, the combination candidate is determined as unavailable. Here, the movement information of at least one block in another location can be added as the combination candidate according to the current block size and the size of the MER.
In Figure 5, the size of the MER is assumed to be 8x8 and the target prediction block is 4x8. When the size of the MER is 8x8, a block of A included in the prediction target block belongs to the same MER with the prediction target block and the blocks of B, C, D and E are included in a different MER from the prediction target block.
In case of A's block, the block can be replaced with a one-block location (for example, A's block)
IMPI
INSTITUTO MEXICANO DE LA PROPERTY INDUSTRIAL which is included in the different MER. Therefore, according to an exemplary embodiment of the present invention, when the current block's combination candidate block and the current block belong to the same MER, the current block's combination candidate block can be excluded from a block for the combination candidate such that the movement information of at least one block in another location can be added as the combination candidate according to the current block size and the size of the MER.
According to an exemplary embodiment of the present invention, the MER size information can be included in the higher level syntax information to be transmitted.
Table 1 below is associated with a method of transmitting the size information in the MER in the top-level syntax.
<img file="MX352017B_D0016.tif" />
IMPI
MUICANO INSTITUTE
Ot THE INDUSTRIAL PROPERTY
TABLE 1
<td>pic_parameter_adjustar_rbsp () {</td><td>Description</td>
<td>pic_parameter_adjustar_id</td><td>eu (v)</td>
<td>seq_parameter_adjustar_id</td><td>eu (v)</td>
<td>flag_mode_entropy_entropy</td><td>u (l)</td>
<td>num Jemporal_layer_commutationj) untó_banderas</td><td>eu (v)</td>
<td>for (i = 0; ¡<num Time_layer_flags_point_ switching layer: i-)</td><td></td>
<td>temporaLcapa_switching_point_flag [i]</td><td>u (l)</td>
<td>num_refjdx_10_default_act¡vo_less1</td><td>ιιφ)</td>
<td>num_ref_idx_11 _default_active_minus1</td><td>eu (v)</td>
<td>picjnit_qp_minus26 1 * in relation to 267</td><td>se (v)</td>
<td>restrictedJntra_pred_flag</td><td>u (l)</td>
<td>shared_ppsjnfo_enabled_flag</td><td>u (l)</td>
<td>if (shared_pps_¡nfo_habil¡tado_bandera</td><td></td>
<td>if (adaptive_lazo_f¡ltro_hairrtado_bandera)</td><td></td>
<td>alf_param ()</td><td></td>
<td>yes (cu_qp_delta_enabled_barndera)</td><td></td>
<td>max_cu_qp_delta_depth</td><td></td>
<td>Iog2_parallel_combination_level_minus2</td><td>eu (v)</td>
<td>rbsp_final_bits ().</td><td></td>
<td> /</td><td></td>
Referring to Table 1, the size information of the
MER can be obtained based on an element Iog2_parallel_level_minus2 included in a high-level syntax structure such as an image parameter setting. An element Iog2_parallel_combination_level_less2 of syntax may also be included in a high-level syntax structure other than picture parameter setting, and this exemplary embodiment is also included in the vicinity of the claim of the present invention.
Table 2 below describes a relationship between a value of
<img file="MX352017B_D0017.tif" />
IMPI
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL
Iog2_parallel_combination_level_minus2 and the size of the MER.
TABLE 2
<td></td><td>\ rrn Observation</td>
<td>Iog2_parallel_c »mbination_n¡vel_minus2</td><td>AltK size</td>
<td> 0</td><td>Skip Combination ™ Sequence Mode! It is 4x4 for all PUs in an LCU due to the minimum PU size allowed by HEVC</td>
<td> 1</td><td>S skip merge mode to * stop searched for all PUs</td>
<td></td><td>within an 8x8 block</td>
<td>·> A »</td><td>z ।z The skip mode of searched parallel join allowed for all PUs within a 16x16 block</td>
<td> 3</td><td>32x32 B skip mode d © combination in * searched parameter allowed for all »PUs within a 32x32 block</td>
<td> 4</td><td>zj_ct by way of skipping combination in stop search allowed for all Pites within a 64x64 block</td>
Referring to Table 2, the value of Iog2_parallel_combination_level_minus2 can have a value from 0 to 4 inclusive, and the size of the MER size can be specified differently according to the value of the syntax element. When the MER is 0, it is the same as how you perform the Interprediction using the combination mode without using the
MER.
ΙΜΡΙ ^ 7
MEXICAN INSTITUTE
OF THE PROPERTY
The syntax element that includes the SWPWHiacTon - ^^ e size of the MER may be, in an exemplary embodiment of the present invention, represented and used as the term MER size information syntax element and defining the size information syntax element as in Table 2 is an example and it is possible to specify the size of the MER using several different methods and such method The expression of the syntax element is also included in the vicinity of the claim of the present invention.
Fig. 6 is a conceptual view illustrating a method of determining whether a spatial combination candidate block of the current block is available.
Referring to FIG. 6, based on locations of a prediction target block 600 and a spatial combination candidate block 650 neighboring the prediction target block 600 and the MER size information syntax element, the availability of the candidate block of spatial combination can be determined.
When it is assumed that (xP, yP) is a point in the upper left of the prediction target block and (xN, yM) is a point in the upper left of the combination candidate block, if the spatial combination candidate block is available it can be determined through the following Mathematics 1 and Mathematics 2.
MATH 1
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX352017B_D0018.tif" />
(xP »(log2_parallel_combination_level_minus2 + 2)) == (xN» (log2_parallel_combination_level_minus2 + 2))
MATH 2 (yP »(log2_parallel_combination_level_minus2 + 2)) == (yN» (log2_parallel_conibination._level_minus2 + 2))
Math 1 and Math 2 above are equations to determine whether the combining candidate block and the prediction target block are included in the same MER. In addition, whether the combination candidate block and the prediction target block are included in the same MER can be determined using a method other than the above determination method as long as it does not depart from the scene of the present invention.
FIG. 7 is a flow chart illustrating a method of obtaining a spatial combining candidate block in a combining mode according to an exemplary embodiment of the present invention.
Referring to FIG. 7, the MER refers to the information being decoded (step S700).
The MER refers to the information as being syntax element information, as described above, and can be included in the high-level syntax structure. Based on the MER decoded in relation to information,
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL can be determined if the candidate block of spatial combination and the objective prediction block is included in the same MER or in different MERs.
It is determined whether the spatial combination candidate block and the prediction target block are included in the same MER (step S710).
According to an exemplary embodiment of the present invention, when the candidate block combining the current block and the current block are included in the same MER, the candidate block combining the current block can be excluded and the movement information of at least one block from different location of the combination candidate block can be added as a combination candidate according to the current block size and the MER size (step S720). According to another exemplary embodiment of the present invention, when a candidate spatial combination block and the prediction target block are included in the same MER, instead of using the candidate spatial combination block included in the MER as the Combination candidate block, a block included in another MER with another location can replace the combination candidate block to perform the interprediction.
Also, in another exemplary embodiment, when a spatial combination candidate block and the prediction target block are included in the same MER, the candidate block
<img file="MX352017B_D0019.tif" />
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL The spatial combination included in the MER may not be used as the candidate combination block, as described above.
When the candidate space combination block and the candidate prediction block are not included in the same MER, the inter-prediction is performed based on a corresponding candidate space combination block (step S730).
FIG. 8 is a flow chart illustrating an interprediction method using a combining mode according to an exemplary embodiment of the present invention.
Referring to FIG. 8, the information related to the motion prediction is derived from the spatial combination candidate (step S800).
The spatial combination candidate can be derived from the neighboring prediction unit of the prediction target block. To derive the spatial combination candidate, the prediction unit width and height information, the MER information, the singleMCLFlag information, and the information on the partition location can be provided. Based on the previous input information, information (availableFlagN) about the availability of the spatial combination candidate, the reference image information (refldxLO, refldxLl), list utilization information (predFlagLON, predFlagLlN), and vector information of motion (mvLON, mvLIN) can be derived according to a
<img file="MX352017B_D0020.tif" />
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL location of spatial combination candidate. The spatial combination candidate can be a plurality of blocks neighboring the prediction target block.
According to an exemplary embodiment of the present invention, the spatial combination candidate block may be classified into three as follows: 1) a spatial combination candidate block that is not included in the same MER and is already encoded or decoded, 2) a candidate block of spatial combination that is included in the same MER, and 3) a candidate block of spatial combination in which it encodes and decodes a have not been processed.
According to an exemplary embodiment of the present invention to perform the interprediction in parallel in the MER unit, between the candidate blocks of spatial combination to perform the Interprediction, the candidate block of spatial combination that is not included in the same MER and is already encoded or decoded it can be used as the candidate block of spatial combination. Additionally, the spatial combination candidate block that replaces a location of the spatial combination candidate block included in the same MER can be used as the spatial combination candidate block. In other words, according to an exemplary embodiment of the present invention, when the combination candidate block of the current block is excluded and the movement information of at least one block
IMPI
INSTITUTO MEXICANO Oí INDUSTRIAL PROPERTY from another location can be added as the combination candidate according to the current block size and the size of the MER. As described above, a method of determining the combination candidate block can be performed through a step of information regarding the decoding MER (Motion Estimation Region), a step of determining whether the prediction target block and the combination candidate block are included in the same MER, and a step of determining that the combination candidate block is unavailable for the inter-prediction with combination mode when the combination candidate block and the prediction target block are included in the same MER.
According to another embodiment, by way of example of the present invention, among the spatial combination candidate blocks to perform the inter-prediction, only the spatial combination candidate block that is not included in the same MER and has already been encoded or decoded can be used to perform the Interprediction.
A reference image index value is derived from the temporal combination candidate (step S810).
The reference image index value of the temporary join candidate is an index value of the Column image that includes the temporary join candidate (Column block) and can be derived through a particular condition as follows. For example,
IMPI
INSTITUTO MEXICANO Μ LA MONEDAD INDUSTRIAL when a point in the upper left of the prediction target block is (xP, yP), a width of it is nPSW, and a height of the prediction target block is nPSH, the reference image index value of the temporary combination candidate can be determined as the same value as the reference image index value of the neighboring prediction unit (hereinafter referred to as referred to as neighbor prediction unit for the derivation of the reference image index) if 1) there is the neighbor prediction unit of the prediction target block that corresponds to a location (xP-Ι, yP + nPSH-1), 2) a partition index value of the neighboring prediction unit to derive the reference image index is 0, 3) the neighboring prediction unit for <sup>1</sup> deriving the reference image index is not a block that performs the prediction using the intra-prediction mode, and 4) the prediction target block and the neighboring prediction unit to derive the reference image index is not included in it MER (Movement Estimation Region).
If the above conditions are not satisfied, the reference image index value of the temporary combination candidate can be set to 0.
The temporal combination candidate is determined and the information regarding the motion prediction is derived from the temporal combination candidate (step S820).
To determine the candidate combination block
IMPI (ΝΓΓΠνΤΟ MEXICANO Μ LA «INDUSTRIAL ONEDAD temporal (Column block) and derive the information in relation to the motion prediction based on the candidate block of the determined temporal combination (Column block), a location of the Column block that is used to derive a temporal prediction motion vector can be determined based on conditions such as, for example, if the Column block is available to the prediction target block, or where a location of the prediction target block is relative to the LCU (for example, if the location of the prediction target block is located on a bottom boundary or a right boundary relative to the LCU). Through the derivation of the information regarding the motion prediction based on the determined reference image information from the Column block and the information from the motion prediction vector, the information regarding the motion prediction can be derived. from the temporary join candidate block (Column block).
A join candidate list is constructed (step S83 0). ...
The join candidate list can be constructed including at least one spatial join candidate and the temporal join candidate. The spatial join candidate and the temporal join candidate included in the join candidate list can be arranged with a
<img file="MX352017B_D0021.tif" />
set priority.
IMPI
INSTITUTO MEXICANO Ht LA PxeUEDAD INDUSTRIAL
The combination candidate list can · be constructed including a fixed number of combination candidates.
When the combination candidates are deficient to generate the fixed number of combination candidates, a combination candidate can be generated by combining the information regarding the prediction of movement of the combination candidate or the combination list can be generated by adding a vector zero as the combination candidate.
As described above, the above method of derivation of the combination candidate can be used not only in the inter-frame prediction method using the combination mode but also in the inter-frame prediction mode using the skip mode and this mode to by way of example is also included in the vicinity of the claim of the present invention.
While the present description has been described with reference to exemplary embodiments thereof, it should be understood by those of ordinary skill in the art that various changes and modifications may be made in this without departing from the spirit and proximity of the present. invention as defined by the following claims.
<img file="MX352017B_D0022.tif" />
Contents71
31 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31
207 members in 15 offices
Priority claims14
| Document | Office | Kind | Date |
|---|---|---|---|
| 1020110096138 | Republic of Korea | – | |
| 20110096138 | Republic of Korea | A | |
| 20110096138 | Republic of Korea | A | |
| 1020120039500 | Republic of Korea | – | |
| 20120039500 | Republic of Korea | A | |
| 20120039500 | Republic of Korea | A | |
| 2012007176 | Republic of Korea | W | |
| 2012007176 | Republic of Korea | W | |
| 1020110096138 | – | – | – |
| 1020120039500 | – | – | – |
| KR20110096138 | – | – | – |
| KR20120039500 | – | – | – |
| PCTKR2012007176 | – | – | – |
| WO2012KR07176 | – | – | – |
Members207
| Document | Office | Kind | |
|---|---|---|---|
| KR101197176B1 | Republic of Korea | B1 | |
| CA2824755A1 | Canada | A1 | |
| CA2968598A1 | Canada | A1 | |
| WO2013042888A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2013042888A3 | World Intellectual Property Organization (WIPO) | A3 | |
| AU2012310514A1 | Australia | A1 | |
| US2013279595A1 | United States of America | A1 | |
| MX2013008349A | Mexico | A | |
| CN103444172A | China | A | |
| GB201402657D0 | United Kingdom | D0 | |
| SE1450126A1 | Sweden | A1 | |
| GB2507910A | United Kingdom | A | |
| JP2014520478A | Japan | A | |
| EP2787728A2 | European Patent Office (EPO) | A2 | |
| AU2012310514B2 | Australia | B2 | |
| CN104349170A | China | A | |
| AU2015200359A1 | Australia | A1 | |
| ES2532857A2 | Spain | A2 | |
| ES2532857R1 | Spain | R1 | |
| PL407774A1 | Poland | A1 | |
| US2015172695A1 | United States of America | A1 | |
| EP2787728A4 | European Patent Office (EPO) | A4 | |
| JP5746792B2 | Japan | B2 | |
| JP2015180074A | Japan | A | |
| JP2015180075A | Japan | A | |
| RU2013134438A | Russian Federation | A | |
| ES2532857B1 | Spain | B1 | |
| JP2016007043A | Japan | A | |
| JP2016007044A | Japan | A | |
| AU2015200359B2 | Australia | B2 | |
| US9253498B2 | United States of America | B2 | |
| US9253499B2 | United States of America | B2 | |
| AU2016200597A1 | Australia | A1 | |
| RU2576499C2 | Russian Federation | C2 | |
| US2016100182A1 | United States of America | A1 | |
| US2016105683A1 | United States of America | A1 | |
| US9357225B2 | United States of America | B2 | |
| ES2572577A2 | Spain | A2 | |
| ES2572577R1 | Spain | R1 | |
| SE1651050A1 | Sweden | A1 | |
| SE1651051A1 | Sweden | A1 | |
| JP5969654B2 | Japan | B2 | |
| ES2580278A2 | Spain | A2 | |
| SE1651199A1 | Sweden | A1 | |
| SE1651201A1 | Sweden | A1 | |
| SE1651202A1 | Sweden | A1 | |
| SE1651203A1 | Sweden | A1 | |
| MX341932B | Mexico | B | |
| ES2580278R1 | Spain | R1 | |
| AU2016228181A1 | Australia | A1 | |
| AU2016228183A1 | Australia | A1 | |
| AU2016228184A1 | Australia | A1 | |
| US2016295236A1 | United States of America | A1 | |
| JP6009633B2 | Japan | B2 | |
| US2016323593A1 | United States of America | A1 | |
| SE1651199A2 | Sweden | A2 | |
| SE1651201A2 | Sweden | A2 | |
| SE1651202A2 | Sweden | A2 | |
| SE1651203A2 | Sweden | A2 | |
| JP6062509B2 | Japan | B2 | |
| US9554144B2 | United States of America | B2 | |
| CN103444172B | China | B | |
| ES2602201A2 | Spain | A2 | |
| US9578348B2 | United States of America | B2 | |
| US2017094309A1 | United States of America | A1 | |
| ES2612493A2 | Spain | A2 | |
| ES2612494A2 | Spain | A2 | |
| JP6130430B2 | Japan | B2 | |
| JP2017085609A | Japan | A | |
| JP2017085611A | Japan | A | |
| ES2602201R1 | Spain | R1 | |
| ES2612493R1 | Spain | R1 | |
| ES2612494R1 | Spain | R1 | |
| ES2572577B1 | Spain | B1 | |
| CN106878743A | China | A | |
| CN106878744A | China | A | |
| ES2580278B1 | Spain | B1 | |
| AU2016200597B2 | Australia | B2 | |
| CN107071456A | China | A | |
| CN107087193A | China | A | |
| CN107094259A | China | A | |
| CN107105267A | China | A | |
| CN107105268A | China | A | |
| CN107105269A | China | A | |
| CN107105279A | China | A | |
| ES2631477A2 | Spain | A2 | |
| MX352016B | Mexico | B | |
| MX352017BThis record | Mexico | B | |
| ES2631477R1 | Spain | R1 | |
| GB201717600D0 | United Kingdom | D0 | |
| GB201717601D0 | United Kingdom | D0 | |
| ES2647572A2 | Spain | A2 | |
| ES2647600A2 | Spain | A2 | |
| ES2647622A2 | Spain | A2 | |
| CA2824755C | Canada | C | |
| ES2602201B1 | Spain | B1 | |
| ES2612493B1 | Spain | B1 | |
| ES2612494B1 | Spain | B1 | |
| SE1850140A1 | Sweden | A1 | |
| SE539969C2 | Sweden | C2 |
Numbers
- Publication
- 352017
- Publication, DOCDB
- 352017
- Publication, EPODOC
- MX352017
- Application
- 2016011509
- Application, DOCDB
- 2016011509
- Application, EPODOC
- MX20160011509
Titles2
- Spanish
- MÉTODO PARA INDUCIR UN BLOQUE CANDIDATO DE COMBINACIÓN Y DISPOSITIVO QUE USA EL MISMO.
- English
- METHOD TO INDUCE A COMBINATION CANDIDATE BLOCK AND DEVICE USING THE SAME.
Classification
- CPC, 14
- H04N19/436
- H04N19/52
- H04N19/122
- H04N19/44
- H04N19/593
- H04N19/61
- H04N19/82
- H04N19/625
- H04N19/51
- H04N19/176
- H04N19/182
- H04N19/513
- H04N19/137
- H04N19/91
- IPC, 9
- H04N19 513
- H04N19 52
- H04N19 176
- H04N19 182
- H04N19 583
- H04N19 61
- H04N19 82
- H04N19 436
- H04N19 593