Image coding device, image coding method, image coding program, transmission device, transmission method, transmission program, image decoding device, image decoding method, image decoding program, reception device, reception method, and reception program.
Abstract
Un dispositivo de codificación de imágenes que divide la información diferencial entre una imagen que es un objetivo de codificación y una imagen que es un objetivo de predicción en una pluralidad de sub-bloques y codifica los sub-bloques divididos en una secuencia predeterminada, un controlador de codificación de información de sub-bloque significativo (708) y un codificador de cálculo (701) codifican la información de sub-bloque significativo que representa si todos los valores de los coeficientes diferenciales que pertenecen al sub-bloque son o no cero. Un controlador de codificación de información de coeficiente significativo (706) y el codificador de cálculo (701) codifican la información de coeficiente diferencial significativo que representa si el valor del coeficiente diferencial es o no cero. A controlador de codificación de valor del coeficiente diferencial (707) y el codificador de cálculo (701) codifican el valo del coeficiente diferencial.

Term
6.5 yearsleft in the term
Expires 12 April 2033.
- Priority
- Filed
- Granted
- Today
- Expires
5 claims: 5 independent, 0 dependent
- 1REIVINDICACIONES Habiéndose descrito la invención como antecede, se reclama como propiedad lo contenido en las siguientes 5 reivindicaciones:1. Un dispositivo de decodificación de imagen que decodifica una corriente de bits en la cual la información diferencial entre una imagen que es un objetivo de decodificación y una imagen que es un objetivo de predicción 10 se divide en una pluralidad de sub-bloques, y los sub-bloques divididos son codificados en una secuencia predeterminada, el cual caracterizado porque comprende: un decodificador de información de sub-bloque significativo que decodifica información de sub-bloque 15 significativo que representa si todos los valores de coeficientes diferenciales que pertenecen al sub-bloque son cero o no;un decodificador de información de coeficiente diferencial significativa que decodifica información de 20 coeficiente diferencial significativa que representa si el valor del coeficiente diferencial es cero o no;un decodificador de valor de coeficiente diferencial que decodifica el valor del coeficiente diferencial;y 25 un derivador de contexto que deriva un índice en 126 ΜΡΙ ' τ 'ΤΟ MEXICANO ':· LA propiedad industrial base en la información de sub-bloque significativo de uri'SUBbloque decodificado que está aledaño al sub-bloque que es un objetivo de decodificación en la dirección horizontal y la información de sub-bloque significativo de un sub-bloque 5 decodificado que está aledaño , en la dirección vertical y deriva un contexto utilizado para decodificar la información de coeficiente diferencial significativa del coeficiente diferencial que es un objetivo de decodificación en base en el índice y la posición del coeficiente diferencial que es el 10 objetivo de decodificación en el sub-bloque que es el objetivo de decodificación, en donde el derivador de contexto deriva el contexto sin hacer referencia a la información de coeficiente diferencial significativa que pertenece al sub-bloque que es 15 el objetivo de decodificación.
- 2Un método de decodificación de imagen que decodifica una corriente de bitios en la cual la información diferencial entre una imagen que es un objetivo de decodificación y una imagen que es un objetivo de predicción 20 se divide en una pluralidad de sub-bloques, y los sub-bloques divididos son codificados en una secuencia predeterminada, el cual caracterizado porque comprende:decodificar información de sub-bloque significativo que representa si todos los valores de coeficientes 25 diferenciales que pertenecen al sub-bloque son cero o no;127 IMPI INSTITUTO MEXICANO „ nt i.a mohedad INDUSTRIAL decodificar información de coeficiente difL-xLiiu'iztÍ significativa que representa si el valor del coeficiente diferencial es cero o no;decodificar el valor del coeficiente diferencial;y
- 35 derivar un índice en base en la información de subbloque significativo de un sub-bloque decodificado que está aledaño al sub-bloque que es un objetivo de decodificación en la dirección horizontal y la información de sub-bloque significativo de un sub-bloque decodificado que está aledaño
- 410 en la dirección vertical y derivar un contexto utilizado para decodificar la información de coeficiente diferencial significativa del coeficiente diferencial que es un objetivo de decodificación en base en el índice y la posición del coeficiente diferencial que es el objetivo de decodificación
- 515 en el sub-bloque que es el objetivo de decodificación, en donde el derivador de contexto deriva el contexto sin hacer referencia a la información de coeficiente diferencial significativa que pertenece al sub-bloque que es el objetivo de decodificación. 128 IMPI INSTtTCTO MEXICANO 0€ LA PROPIEDAD INDUSTRIAL
Independent claims5
761 paragraphs in 173 sections, as filed
(54) Title: IMAGE ENCODING DEVICE, IMAGE ENCODING METHOD, AND IMAGE ENCODING PROGRAM AND IMAGE DECODING DEVICE, IMAGE DECODING METHOD AND IMAGE DECODING PROGRAM.
(54) Title: IMAGE CODING DEVICE, IMAGE CODING METHOD, IMAGE CODING PROGRAM, TRANSMISSION DEVICE, TRANSMISSION METHOD, TRANSMISSION PROGRAM, IMAGE DECODING DEVICE, IMAGE DECODING METHOD, IMAGE DECODING PROGRAM, RECEPTION DEVICE, RECEPTION METHOD, AND RECEPTION PROGRAM.
(57) Summary
An image coding device that divides the differential information between an image that is a coding target and an image that is a prediction target in a plurality of sub-blocks and encodes the divided sub-blocks in a predetermined sequence, a significant sub-block information encoding controller (708) and a calculation encoder (701) encode the significant sub-block information representing whether or not all values of the differential coefficients belonging to the sub-block are zero . A significant coefficient information encoding controller 706 and calculation encoder 701 encode the significant differential coefficient information representing whether or not the value of the differential coefficient is zero. The differential coefficient value encoding controller (707) and the calculation encoder (701) encode the differential coefficient value.
(57) Abstract
An image coding device for dividing difference Information between an image to be coded and an image to be predicted into a plurality of sub-blocks, and coding the divided sub-blocks in a predetermined order, where a significant subblock Information coding control unit (708 ) and a calculation coding unit (701) code significant sub-block Information indicating whether or not all of the values of difference coefficients belonging to the sub-block are zero. A significant coefficient Information coding control unit (706) and the calculation coding unit (701) code significant difference coefficient
Information indicating whether or not the value of the difference coefficient is zero. A difference coefficient valué coding control unit (707) and the calculation coding unit (701) code the valué of the difference coefficient.
i
SF.
Institute
Mexican Property
Industrial
<img file="MX339686B_D0001.tif" />
PATENT TITLE NO. 339686
Title (s): JVC KENWOOD CORPORATION
Address: 12, Mor¡ya-cho 3-chome, Kanagawa-ku, Yokohama-shi, Kanagawa, 2210022,
JAPAN
Name: IMAGE ENCODING DEVICE, IMAGE ENCODING METHOD AND IMAGE ENCODING PROGRAM, AND IMAGE DECODING DEVICE, IMAGE DECODING METHOD AND IMAGE DECODING PROGRAM.
Classification: lnt.CI.8: H04N19 / 159; H04N19 / 44; H04N19 / 50; H04N19 / 593 lnv «gtor (<Bf»): .TORU KUMAKURA, SH1GERU FUKUSH ΙΛλ
REQUEST
Internal filing date for April 2013
PRIORITY
Number:
. MX / a / 2014/012155
Country:
JP
JP <sub>¿</sub> i
Validity: Twenty years
Date:
April 2012 April 13, 2012
Number:
<img file="MX339686B_D0002.tif" />
2012-092077
2012-092078
Venciabiento date April 12, 2033
B'YSBllS: <mil8 1
The reference point is O! orga with Andamento e / T> 23 of the law of the Proplei
Nonconformity with cited from ddbechos, I detect
Oteen signs this Industrial Property (Diario 2A1 / 2OM, 06/16/2005, 2! <sup>to go</sup>W .. ^ - 4UfcJ2 · - * fraction V, 6 ° fraction lll, / SS of the Industrial Property Law.
adíate 23 of the 'Law of Property lnduitnat% .preccnte patent has a validity of twenty non-extendable years, the date of presexjpclón de la sófeitud' niernansortél and will be subject to. payment of the fee to keep alive the
Stulo does it based on NiS Mcial de te Federación (DOF) 27/06 / 1ÓW; d 11/2006, 0005 / 2009,06 / 01/2010, 18/06/2010, 2871 I and III di
6s lll and 7 ° bis 2 of 10/25/1996, 12/26/1997, 2012 and 04/09/2012); articles 1, 31 ey of the / 05/1999, clcl V __________ _ __ ____________ signed on
07/01/2002, 07/15/2004, 07/28/2004 and 09/07/2007); articles1 ", 3<sup>0</sup>,4°,5<sup>or</sup>fraaí6nVíncíso á), 16fracc¡onesiyHi y3ÓdeT Organic Statute of the Mexican Institute of Industrial Property (DOF 12/27/1999, amended on 10/10/2002, 07/29/2004, 08/04/2004 and 09/13/2007) ; 1, 3 and 5 Clause a) of the Agreement that delegates powers to the Deputy Directors General, Coordinator, Divisional Directors, Holders of the Regional Offices, Divisional Deputy Directors, Departmental Coordinators and other subordinates of the Mexican Institute of Industrial Property. (DOF 12/15/1999, amended on 02/04/2000, 07/29/2004, 08/04/2004 and 09/13/2007).
BeetaMtaáafeMil »
Issue Date: June 6, 2016
<img file="MX339686B_D0003.tif" />
33% 6é ¡W / 7l- (Sg <sup>1</sup> IMPIí
MEXICANÍ INSTITUTE> '(
DE LA PR # PIEOAI '' industrial
IMAGE CODING DEVICE, CODING METHOD OF
PICTURE AND PICTURE CODING PROGRAM, AND DEVICE
IMAGE DECODING, IMAGE DECODING METHOD AND
IMAGE DECODING PROGRAM
FIELD OF THE INVENTION
The present invention relates to an image encoding and decoding technology, and more particularly, to a technology for entropic encoding and decoding of a residual signal.
BACKGROUND OF THE INVENTION
<img file="MX339686B_D0004.tif" />
In MPEG-4 AVC, which is an international standard for moving image encoding, like an entropic encoding system, context-switched arithmetic encoding called CABAC is employed. CABAC includes a plurality of variables called a context that stores the probability of occurrence of information to be encoded. An optimal context is selected from the information characterized by n of neighboring encoding and used for encoding. Furthermore, because the probability of occurrence is updated according to a coding process also in each context, the probability of occurrence of the information coding can be calculated with the utmost accuracy, whereby efficient coding can be performed.
Patent Literature 1: JP 2007-300517 A
REF: 251579
ΙΜΡΙ
INSTITUTO mexican · Dt LA FROflEDAD INDUSTRIA!
<img file="MX339686B_D0005.tif" />
BRIEF DESCRIPTION OF THE INVBH0I0H ........— In the MPEG-4 AVC, in addition to calculating the probability of occurrence of the information to switch a context based on the neighboring decoded information, the probability of occurrence is known according to a decoding result. The probability of occurrence of information to be decoded can be optimized for each context, and consequently, the improvement of the coding efficiency is performed. However, for all the significant differential coefficient information in the block to be processed, it is necessary to sequentially process the calculation of the context indices and the decoding of the significant differential coefficient information, and a time of calculation.
In Patent Literature 1, a technique for decreasing decoding-related processing delay is described by providing a context for a syntax element that has a high frequency of occurrence in a memory that has a short access delay time. However, the technique described in Patent Literature 1 does not resolve the dependency between the calculation of the context index and the decoding of a syntax element, and these processes cannot be performed in a parallel way and it is not an essential solution. for processing delay.
The present invention manages with the situation in mind, and an object thereof is to provide a
IMPI
XSTTrVTO MEXICANO DE LA MOPIEÜAf; industrial
<img file="MX339686B_D0006.tif" />
image encoding technology, in the encoding / decoding of the differential coefficient, performing a context index calculation method that has a small amount of calculation enabling a parallel process, that has a simple configuration, and that is appropriate for processing in real time. Furthermore, another objective thereof is to provide an image encoding and decoding technology that has high encoding efficiency by performing the calculation of a context index that refers to the neighboring differential coefficient that is appropriate in terms of correlation.
To solve the problem, an image coding device according to one aspect of the present invention is one that divides the differential information between an image that is a decoding target and an image that is a prediction target in a plurality of sub -blocks and encodes the divided sub-blocks in a predetermined sequence, and the image encoding device includes: a significant sub-block information encoder (708, 701) encoding the significant sub-block information representing whether or not all values of the differential coefficients belonging to the sub-block are zero; a significant differential coefficient information encoder (706, 701) that encodes the significant differential coefficient information that represents whether the value
IΜ ΡI
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL ^ ,, - ¾ of differential coefficient is zero or not; a differential coefficient dé Váiur (707, 701) encoding the value of the differential coefficient; and a context derivation device (703) that derives an index based on the significant sub-block information of a coded sub-block that is neighbor to the sub-block that is a horizontally coded target and the sub information -significant block of an encoded sub-block of an encoded sub-block that is a neighbor in the vertical direction and derives the context used for the encoding of the significant differential coefficient information from the coefficient differential that is a coding target based on the index and position of the differential coefficient that is the coding target in the sub-block that is the coding target.
In accordance with another aspect of the present invention, a method for encoding images is provided. This method is an image coding method in which the differential information between an image that is a coding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the partitioned sub-blocks are encoded in a predetermined sequence, including the image encoding method: encode the significant sub-block information that represents whether or not all the values of the differential coefficients belonging to the sub-block are zero; encode the coefficient information
IMPI
INSTITUTO MEXICANO nt LA FXOFIEDAIJ industrial
<img file="MX339686B_D0007.tif" />
significant differential that represents if the 'val oté! £! of the 'differential coefficient are or are not zero; encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is neighbor to the sub-block that is a horizontal direction encoding target and the significant sub-block information of an encoded sub-block that is a neighbor in the vertical direction and derives a context used to encode the significant differential coefficient information from the differential coefficient which is a coding target based on the index and position of the differential coefficient that is the coding target in the sub-block that is the coding target.
In accordance with another aspect of the present invention, a transmission device is provided. This device is a transmission device that includes: a packet processing unit configured to obtain a data encoding by forming bitstream stream packets which is encoded using an image encoding method in which the differential information between an image that is an encoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence; and a transmitter configured to transmit the packet encoded data. The method of coding
WJT1 MEXICAN PROPERTY GUIDELINE
INDUSTRIAL images include: encode the informadl. '<3n 3S .....' StlE ^ blogUS 'meaningful representing whether all values of the differential coefficients belonging to the sub-block are zero or not; encoding the significant differential coefficient information that represents whether or not the value of the differential coefficient is zero; encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is neighbor to the sub-block that is a horizontal direction encoding target and the significant sub-block information of an encoded sub-block that it is a neighbor in a vertical direction and that derives a context used to encode the information of significant differential coefficient from the differential coefficient that is a coding objective based on the index and position of the differential coefficient that is the coding target in the sub-block that is the coding target.
In accordance with another aspect of the present invention, a transmission method is provided. This method is a transmission method that includes: obtaining encoding information by packaging a bitstream that is encoded using an image encoding method in which the differential information between an image that is an encoding target and an image that is is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence; and
IMPI
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX339686B_D0008.tif" />
transmit the information encoded in paqufcTÜSy. The above-described image decoding mútudu includes: encoding the significant sub-block information that represents whether or not all the values of the differential coefficients belonging to the sub-block are zero; encoding the significant differential coefficient information that represents whether or not the value of the differential coefficient is zero; encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is neighbor to the sub-block that is a horizontally encoding target and the significant sub-block information of an encoded sub-block that it is a neighbor in a vertical direction and that it derives a context used to encode the information of significant differential coefficient of the differential coefficient that is an index and position based encoding objective of the differential coefficient that is the coding target in the sub-block that is the coding target.
In accordance with one aspect of the present invention, an image decoding device is provided that decodes a bitstream where the differential information between an image that is a coding target and an image that is a prediction target it is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence. The device
IMPI
MEXICAN INSTITUTE OF LA raoriEDA · INDUSTRIAL
<img file="MX339686B_D0009.tif" />
image decoding includes: a significant sub-block information decoder (1008, 1001) configured to decode the significant sub-block information representing whether or not all the differential coefficient values belonging to the sub-block are zero; a significant differential coefficient information decoder (1006, 1001) configured to decode the significant differential coefficient information representing whether or not the value of the differential coefficient is zero; a differential coefficient value decoder (1007, 1001) configured to decode the differential coefficient value; and a context derivation device (1003) configured to derive an index based on the significant sub-block information of a decoded sub-block that is neighbor to the sub-block that is a horizontal direction decoding target and the information significant sub-block of a decoded sub-block that is a neighbor in the vertical direction and derives a context used to decode the significant differential coefficient information from the differential coefficient which is a decoding target based on the index and position of the differential coefficient which is the decoding target in the sub-block which is the decoding target.
In accordance with another aspect of the present invention, an image decoding method is provided. This method is an image decoding method that decodes a
IMPI msTrrvro Mexican DE LA PKOPIEDA »INDUSTRIAL
<img file="MX339686B_D0010.tif" />
bitstream in which the differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in sequence default. The image decoding method includes: decoding the significant sub-block information representing whether or not all values of differential coefficients belonging to the sub-block are zero;
decode the significant differential coefficient information that represents whether or not the value of the differential coefficient is zero; decode the value of the differential coefficient; and deriving an index based on the significant sub-block information of a decoded sub-block that is neighbor to the sub-block that is a horizontal direction decoding target and the significant sub-block information of a decoded sub-block which is a neighbor in the vertical direction and which derives a context used for decoding the information of the significant differential coefficient of the differential coefficient which is a decoding objective based on the index and the position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
In accordance with another aspect of the present invention, a receiving device is provided. This device is a receiving device that receives a bitstream stream
K iKjmvro mengano OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0011.tif" />
wherein a moving image is encoded and decodes the received bit stream. The receiving device includes: a receiving unit configured to receive the encoded information obtained by packaging a bitstream in which the differential information between an image that is a decoding target and an image that is a predictive target is divides into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence; a restore unit configured to restore the bitstream stream by performing packet processing of the received packet encoded information; a significant sub-block information decoder (1008, 1001) configured to decode the significant sub-block information that represents whether or not all values of the differential coefficients belonging to the sub-block are zero from the current of bitstream restored; a significant differential coefficient information decoder (1006, 1001) configured to decode the significant differential coefficient information representing whether or not the value of the differential coefficient is from the restored bitstream; a differential coefficient value decoder (1007, 1001) configured to decode the differential coefficient value from the restored bitstream; and a context bypass device (1003) configured to
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0012.tif" />
derive an information-based index<sup>1</sup> dÓ''Sílb-trTO Significant sub-block of a decoded sub-block that is neighbor with the sub-block that is a decoding target in horizontal direction and the significant sub-block information of a decoded sub-block that is neighbor in vertical direction and derives a context used to decode the significant differential coefficient information from the differential coefficient which is a decoding target based on the index and position of the differential coefficient which is the decoding target in the sub-block that is the decoding target.
In accordance with another aspect of the present invention, a receiving method is provided. This method is a receive method that receives a bitstream stream in which a moving image is encoded and decodes the received bitstream stream. The reception method includes: receiving the encoded information obtained by packaging a bitstream where the differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub- blocks, and the divided sub-blocks are encoded in a predetermined sequence; restoring the bitstream stream by performing packet processing of the received packet encoded information; decode the significant sub-block information that represents whether all the values of the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0013.tif" />
differential coefficients belonging to the éub-block áóñ o'rt'ó zero from the restored bitstream;
decode the significant differential coefficient information representing whether or not the value of the differential coefficient is from the restored bitstream; decode the value of the differential coefficient from the restored bitstream; and deriving an index based on the significant sub-block information of a decoded sub-block that is neighbor to the sub-block that is a horizontal direction decoding target and the significant sub-block information of a decoded sub-block which is neighbor in vertical direction and derive a context used for decoding the information of significant differential coefficient of the differential coefficient which is a decoding target based on the index and the position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
Furthermore, an arbitrary combination of the constituent elements, described above or a conversion of the representation of the present invention between a method, a device, a system, a recording medium, a computer program, and the like is also valid as an aspect of the present invention.
According to the present invention, it can be done
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PRORITY
<img file="MX339686B_D0014.tif" />
encoding a differential signal that-eg — a'prppÍ-tSfda- ^ njra<sup>1 </sup>the process in real time using a simple circuit setup.
BRIEF DESCRIPTION OF THE FIGURES
Figure 1 is a flow chart illustrating a conventional differential coefficient decoding sequence;
Figure 2 is a flow chart illustrating a conventional sub-block differential coefficient decoding sequence;
Figure 3 is a flowchart illustrating a conventional decoding sequence of significant differential coefficients;
Figure 4 is a flowchart illustrating a conventional decoding sequence of differential coefficient values;
Figure 5 is a block diagram illustrating the configuration of an image coding device, which is used to execute a method for coding differential coefficients, according to one embodiment;
Figure 6 is a block diagram illustrating the configuration of an image decoding device, which is used to execute a method for decoding differential coefficients, according to one embodiment;
Figure 7 is a diagram illustrating the scanning sequence of the sub-block differential coefficients;
<img file="MX339686B_D0015.tif" />
Figure 8 is a block diagram<sup>-</sup> illustrating the detailed configuration of the image decoding device, which is illustrated in Figure 6, according to a first example;
Figure 9 is a diagram illustrating the definition of a neighboring differential coefficient in the decoding sequence of the significant differential coefficients illustrated in Figure 3;
Figure 10 is a diagram illustrating the definition of a neighboring differential coefficient in the decoding sequence of the significant differential coefficients illustrated in Figure 4;
Figure 11 is a diagram illustrating the definition of a context in the decoding sequence of the significant differential coefficients illustrated in Figure 4;
Figure 12 is a diagram illustrating a sub-block division of the differential coefficients;
Figure 13 is a flow chart illustrating the decoding sequence of the differential coefficient values according to the first example;
Figure 14 is a diagram illustrating the size of the coding block;
Figure 15 is a block diagram illustrating the detailed configuration of the image coding device, illustrated in Figure 5, according to the first
ΙΜΡΙ
MEXICAN INSTITUTE OT LA MONEDAD
INDUSTRIAL
<img file="MX339686B_D0016.tif" />
example;
Figure 16 is a flow chart illustrating the coding sequence of the differential coefficients according to the first example;
Figure 17 is a flowchart illustrating the coding sequence of the sub-block differential coefficients according to the first example;
Figure 18 is a flow chart illustrating the coding sequence of significant differential coefficients according to the first example;
Figure 19 is a flowchart illustrating the coding sequence of the differential coefficient values according to the first example;
Figure 20 is a diagram illustrating the configuration in which a sub-block position is included in the calculation of the context information of significant differential coefficient;
Figure 21 is a flowchart illustrating the coding sequence of the significant differential coefficients according to a second example;
Figure 22 is a flow chart illustrating the decoding sequence of the significant differential coefficients according to the second example;
Figure 23 is a diagram illustrating the definition of a context in the decoding sequence of the coefficients.
<img file="MX339686B_D0017.tif" />
<sup>16</sup> IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY significant differences according to the second example; _
Figure 24 is a flow chart illustrating the coding sequence of significant differential coefficients according to a third example; and
Figure 25 is a flow chart illustrating the decoding sequence of the significant differential coefficients according to the third example.
DETAILED DESCRIPTION OF THE INVENTION
First, the technologies that are the premise of the modalities of the present invention will be described.
A technique of associating a plurality of contexts with each encoding syntax and selecting a context based on the correlation between the syntax elements can optimize code allocation, thereby allowing efficient encoding.
As an example of text switching entropy encoding, the decoding sequence of an orthogonal transform coefficient of quantization of a differential signal that is encoded in the size of 16X16 will be described with reference to a flowchart illustrated in Figure 1. Figure 12 illustrates an orthogonal transformation coefficient of quantification to be processed. Henceforth, the orthogonal transformation coefficient of quantification will be referred to as the differential coefficient. In this sequence, a 16 x 16 differential coefficient to be processed is divided
IMPI
MEXICAN INSTITUTE OF FROFIEDAD
INDUSTRIAL
<img file="MX339686B_D0018.tif" />
in sub-blocks 401 to 416 each having the size of 4x4, and a scan in sub-block units is first performed.
A sub-block to be processed is determined according to the scanning sequence to be described later (S101). When scanning of all sub-blocks is complete, the differential coefficient decoding process ends. The scanning sequence of the sub-blocks is indicated by reference number 902 illustrated in Figure 7. The scanning sequence of the sub-blocks is indicated by the reference number 902 illustrated in Figure 7. In this sequence, the scanning starts from a sub-block arranged on the lower right side of the differential coefficient region. , scanning is performed according to a rule from the lower right side to the upper left side, and scanning is completed in a sub-block arranged on the upper left side. Reference number 901 illustrated in Figure 7 illustrates the scanning sequence of the sub-blocks using arrows. In a case where the scanning sequence illustrated in Figure 7 is applied, in all the sub-blocks to be processed, the scanning of the spatially placed sub-blocks respectively on the right side and the bottom side is in full state.
With reference again to the flow chart illustrated in Figure 1, the decoding process of all the values of the differential coefficient of the sub-block to be performed is performed.
IMPI ^
MEXICAN INSTITUTE
OF PROPERTY U * · »·! _
INDUSTRIAL to process (S102). After completing the deqoeÍ¿ £ ¿<gaoi.prnÍlie · the sub-block differential coefficient values, the process proceeds to step S101.
The process of decoding the sub-block differential coefficient values will be described in detail with reference to a flowchart illustrated in Figure 2.
The significant sub-block information is decoded (S201). Significant sub-block information is a one-bit flag used to represent the presence of a differential coefficient that has a value other than 0 in a sub-block to be processed. In a case where the information for the significant sub-block is 1, it represents that at least one differential coefficient having a value other than 0 is present in a sub-block to be processed. On the other hand, in the case where the information of the significant sub-block is 0, this represents that all the differential coefficients of a sub-block to be processed are 0s.
Subsequently, the value of the significant sub-block information is determined (S202). When the significant sub-block information has a value of 0, all the values of the differential coefficient of the sub-block to be processed are set to 0 (S209), and the decoding process of the value of the differential coefficient of the sub-block block ends.
On the other hand, when the significant sub-block information is 1, the decoding process of
IMPI
MEXICAN INSTITUTE OR € LA FWMtnAO INDUSTRIAL
<img file="MX339686B_D0019.tif" />
all the differential coefficient information Sl ^ ñicative'deT sub-block to be processed (S203). Significant differential coefficient information is a one-bit flag used to represent that a differential coefficient value of a target processing position is not 0. In a case where the significant coefficient information is 1, it represents the coefficient value. Processing target position differential is not 0. On the other hand, in a case where the significant coefficient information is 0, this represents that the value of the differential coefficient of the processing target position is 0. The decoding sequence of the significant differential coefficient information of a sub-block it will be described in detail later. After completing the decoding of all the sub-block significant differential coefficient information, the process continues to decode the differential coefficient values which is performed in step S204.
Subsequently, the decoding process of the differential coefficient values is performed (S204). The process of decoding the differential coefficient values will be described in detail later. After completing the decoding process of the differential coefficient values, the process continues to step S101, and scanning of the next sub-block is performed.
Sequence of the Coefficient Decoding Process
IMPI
MEXICAN INSTITUTE OI LA MONEDAD
INDUSTRIAL
<img file="MX339686B_D0020.tif" />
Significant Differential
The decoding sequence of the sub-block significant differential coefficient information that is performed in step S203 will be described with reference to the flowchart illustrated in Figure 3.
A sub-block to be processed is determined according to a predetermined scanning sequence (S301). It is assumed that the scanning sequence of the differential coefficients in the sub-block, similar to the scanning sequence of the sub-block in the region of the differential coefficient, follows the rule illustrated in Figure 7.
A sum of the significant neighbor differential coefficient countCoeff is calculated which is the sum of the numbers of the decoded differential coefficients, which are neighbors of the differential position of the processing target, which has values other than 0 (S3 02). The
Figure 9 illustrates an example of the differential coefficient position used to calculate the sum of the significant neighbor differential coefficient countCoeff. Reference number 202 indicates the neighboring differential coefficients of a case where the target processing position is indicated by reference number 201, and reference number
204 indicates the neighboring differential coefficients where the target processing position is as indicated in reference number 203. As illustrated in Figure 9, the five
IMPI
MEXICAN PROPERTY INSTITUTE
INDUSTRIAL
<img file="MX339686B_D0021.tif" />
Differential coefficients that are located on the right side and the lower side of the processing target differential coefficient position and are neighboring to the processing target differential coefficient position are configured as neighboring differential coefficients. Because the scanning sequence of the differential coefficients follows the sequence illustrated in Figure 7, the decoding of the differential coefficients belonging to the same sub-block as that of the target processing differential coefficient is completed and located respectively in the right side and bottom side of the differential coefficient position of the processing target. Similarly, the decoding of the significant differential coefficients belonging to the sub-blocks located respectively on the right side and the bottom side of the sub-block to which the processing target position belongs is completed.
The sum of the neighboring differential coefficient countCoeff is a variable used to calculate the probability of occurrence of the significant differential coefficient. According to the characteristics of an image and the visual characteristics, such as the significant differential coefficient, 1 can be concentrated in the low region, and 0 can be easily concentrated in the high region. Because the significant differential coefficients have a spatial correlation, the differential coefficients neighboring the target processing position are set as
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0022.tif" />
objectives for the calculation of the sum of the coefficient άϊΊάΙ'έΗΐυΐΡΐ 'neighbor countCoeff. Neighbor differential coefficients representing the outside of the differential coefficient region are excluded from the calculation of the sum of the neighbor significant coefficient countCoeff.
Referring again to the flowchart illustrated in Figure 3, it is determined whether the sum of the neighbor significant coefficient countCoeff is 0 (S303). In a case where the sum of the neighbor significant coefficient countCoeff is 0, a ctxldx context index used to decode the significant differential coefficient information is set to 0 (S304), and the significant differential coefficient information is decoded using a corresponding context with the ctxldx context index. Then, the significant differential coefficient information is set to the value of the differential coefficient (S308).
In a case where the sum of the neighbor significant coefficient countCoeff is not 0, it is determined whether the sum of the neighbor significant coefficient countCoeff is less than or equal to 2 (S305). In a case where the sum of the neighbor significant coefficient countCoeff is less than or equal to 2, the context index ctxldx used to decode the significant differential coefficient information is set to 1 (S306), and the significant differential coefficient information is decoded using a context that corresponds to the ctxldx context index. Then the differential coefficient information
IMPI
MEXICAN INSTITUTE OE LA MOHEDAL
INDUSTRIAL
<img file="MX339686B_D0023.tif" />
significant is set to the value of the differential coefficient (3 * 300) r In a case where the sum of the neighbor significant coefficient countCoeff is not less than or equal to 2, in other words, in a case where the sum of the neighbor significant coefficient countCoeff is greater than or equal to 3, the ctxldx context index used to decode the significant differential coefficient information is set to 2 (S307), and the significant differential coefficient information is decoded using a context that corresponds to the context index ctxldx. Then, the significant differential coefficient information is set to the value of the differential coefficient (S308).
A context is a variable used to store the probability of occurrence of the information to be decoded, and the assignment of a codeword changes based on the probability of occurrence represented by the context. In the example described above, three contexts that encode the significant differential coefficient are defined, and the context that decodes the significant differential coefficient is determined based on the magnitude of the sum of the neighboring significant differential coefficient. It is established in advance that, for a context that corresponds to the context index ctxldx = 0 at a time when the sum of the neighbor significant coefficient countCoeff is 0, the probability of occurrence of the information of the significant coefficient is 0 is high, and for a context that corresponds to the context index ctxldx = 2 at a time
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0024.tif" />
When the sum of the neighbor significant coefficient countCoeft is greater than or equal to 3, the probability of occurrence of the information of the significant coefficient that is 1 is high. For information whose probability of occurrence is high, the amount of coding can be decreased, and consequently increasing the accuracy of the calculation of the probability of occurrence, the coding efficiency can be improved.
In MPEG-4 AVC, by switching between contexts based on neighboring decoded information, in addition to calculating the probability of occurrence of the information, the probability of occurrence is obtained according to a decoding result. In this way, the probability of occurrence of the information to be decoded for each context can be optimized, thereby improving the decoding efficiency.
Generally, in orthogonally transformed components of an image, the information can be easily concentrated in the lower region. Furthermore, because there is a low degradation influence of a high region component on visual characteristics, frequently, the high region component is approximately quantified for practical use. Consequently, the information of the significant coefficient tends to be concentrated in the component of the low region. The information of the significant coefficient has a high correlation with the neighboring significant coefficient, and is
ΙΜΡΙ mexican institute
FROM THE RROHEOAD INDUSTRIAL
<img file="MX339686B_D0025.tif" />
Reasonable switching between contexts based fcill tib number of pieces of neighbor significant coefficient information from a coding efficiency standpoint.
Decoding Process of the Differential Value of
Coefficient
The decoding sequence of the sub-block differential coefficient values in step S204 of the flow diagram illustrated in Figure 2 will be described with reference to a flow diagram illustrated in Figure 13.
A sub-block to be processed is determined according to a predetermined scanning sequence (S501). The sequence of scanning the differential coefficients arranged in a sub-block, similar to the sequence of scanning the significant differential coefficient information, is assumed to follow the rule illustrated in Figure 7. When the scanning of all the differential coefficients of the sub-block is completed, the decoding process of the differential coefficient values is completed, and the process continues to the next sub-block determining sequence (S101).
Subsequently, it is determined whether or not the position value of the differential coefficient of the processing target is 0 (S502). In a case where the value of the differential coefficient of the position of the differential coefficient of the processing target is 0, the decoding of the value of the differential coefficient of the position of the
IMPI
MEXICAN INSTITUTE Dt THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0026.tif" />
differential coefficient of the process target Jhi'éñCCf; · and the process continues to step S501.
In a case where the value of the differential coefficient of the position of the differential coefficient of the processing target is 1, the absolute value of the differential coefficient of the position of the differential coefficient of the processing target is decoded (S503). In a case where the sequence is performed, it is determined that the value of the differential coefficient is not 0, and, as a bitstream, a codeword corresponding to a derived value is encoded by decreasing one of the absolute value of the coefficient differential. Consequently, as an absolute value of the differential coefficient, a derived value is set by adding 1 to a value that is derived by performing the entropy decoding of a codeword.
Subsequently, the sign of the differential coefficient of the position of the differential coefficient of the processing target is decoded (S504). A value of the differential coefficient is determined based on the absolute value of the differential coefficient and the sign of the differential coefficient.
In the decoding sequence of the significant differential coefficient information described above, a differential coefficient 201 illustrated in Figure 9, as represented in the scanning sequence indicated by reference number 902 illustrated in Figure 7, is scanned at the end
IMPI
MEXICAN INSTITUTE OF ΕΛ INDUSTRIAL PROPERTY
<img file="MX339686B_D0027.tif" />
in the sub-block, and its scanning sequence is l comcTse indiÓcT by reference number 902 illustrated in Figure 7.
Furthermore, among the neighboring differential coefficients 202 of the differential coefficient 201, the scanning sequence from a neighboring position to the bottom side of the differential coefficient 201 is 15 and is scanned immediately before the differential coefficient 201. Because the ctxldx context index that is required to decode the significant differential coefficient information of the differential coefficient 201 is calculated based on the sum of the significant differential coefficient of the differential coefficients 202, the context index ctxldx of the differential coefficient 201 does not it can be determined until the decoding of the significant differential coefficient information of the differential coefficient 202 is complete. This means that it is necessary to process the calculation of the context index ctxldx and the decoding of the significant differential coefficient information so that all the significant differential coefficient information cannot be obtained in the sub-block, and a decrease in time or amount of calculation through a parallel process. Meanwhile, the rate of occupancy of the differential coefficient in the bitstream is high, and the process of calculating the context index and the decoding process of the significant differential coefficient information takes a long time and a large amount of calculation
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0028.tif" />
busy in the whole process of decoding icacióflTMl''paTatUlay,<sup>1</sup> the process of decoding the information of the significant coefficient is the most significant bottleneck in the process of decoding in real time.
In Patent Literature 1, a technique has been described to decrease a processing delay related to a decoding process by providing a context for a syntax element that has a high frequency of occurrence in a memory that has a short delay time of access. However, the technique described in Patent Literature 1 does not solve the dependency between the calculation of a context index and the decoding of a syntax element and cannot perform the process of it in a parallel way, therefore it cannot be an essential solution for processing delay.
Thus, an embodiment of the present invention provides an image encoding technology that, in encoding / decoding the differential coefficients, eliminates the dependency between the calculation of context indices and the encoding / decoding of the information. of significant differential coefficient, performs a method to compute a context index that can process in a parallel way and has a small amount of computation, and it has a simple circuit configuration to make it appropriate for the real-time process. Furthermore, by calculating the context indices made with reference to the coefficients
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0029.tif" />
Neighbor differentials, which is appropriate in terms of correlation, provides an image coding technology that has high coding efficiency. Hereinafter, embodiments of the present invention will be described.
In the description presented below, a block to be processed is an encoding target block in case an encoding process is performed by an image encoding device and is a decoding target block in case an decoding process is performed using an image decoding device. Furthermore, a processed block is a decoded block whose encoding has been completed in the case of an encoding process performed by the image encoding device and is a block whose decoding has been completed in the case of a decoding process performed by the image encoding device. image decoding device. Hereinafter, the meaning will be used unless otherwise indicated.
Coding Device
A preferred image coding device in accordance with the present invention will be described with reference to the figures. Figure 5 is a block diagram illustrating the configuration of the image coding device according to one embodiment. The image coding device according to the embodiment includes: a subtractor 501; an orthogonal transformer / quantizer 502; a quantifier
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0030.tif" />
reverse / reverse transformer 503; an adder 504; a decoded image memory 505; a 506 predictor; an information differential encoder 507; a prediction information encoder 508; and a 509 mode determiner.
Mode determiner 509 tentatively encodes all prediction candidates and determines the prediction information that is optimal for each block of the image. Like the prediction information, a divided block size and a prediction mode that represents an inter-prediction or an intra-prediction. Furthermore, in a case where the prediction mode is inter-prediction, the motion information such as a motion vector and a reference image index is included in the prediction information. On the other hand, in a case where the prediction mode is intra-prediction, an intra-prediction mode is included in the prediction information. The mode determiner 509 provides the determined prediction information to the predictor 506 and the encoder of the prediction information 508.
The prediction information encoder 508 performs variable length encoding of the input prediction information and outputs a bitstream of the prediction information.
Predictor 506 generates a predicted image using the input prediction information and the decoded image stored in the decoded image memory 505 and provides
IMPI
HfSnTUTO MEXICANO of the INDUSTRIAL nomoMi the predicted image generated to subtractor 501.
Subtractor 501 generates a differential image by subtracting the predicted image from the original image which is a coding target and provides the generated differential signal to the orthogonal transformer / quantizer 502.
The orthogonal transformer / quantizer 502 generates the differential coefficients by performing an orthogonal transformation and quantization of the differential image and provides the differential coefficients to the inverse quantizer / inverse transformer 503 and the differential information encoder 507.
The differential information encoder 507 performs the entropy encoding of the differential coefficients and results in a bitstream of the differential information.
The inverse quantizer / inverse transformer 503 generates a decoded differential signal by performing the inverse quantization and the inverse orthogonal transformation of the differential coefficients received from the orthogonal transformer / quantizer 502 and provides the generated decoded differential signal to the adder 504.
Adder 504 generates a decoded image by adding the predicted image and the decoded differential signal and stores the generated decoded image in the memory of the decoded image 505.
<img file="MX339686B_D0031.tif" />
IMPI
IHSTITUTO MEXICANO DE LA FROFIEDAD
INDUSTRIAL
<img file="MX339686B_D0032.tif" />
Decoding Device
A preferred image decoding device in accordance with the present invention will be described with reference to the figures. Figure 6 is a block diagram illustrating the configuration of the image decoding device according to one embodiment. The image decoding device according to the embodiment includes: a differential information decoder 801; an inverse quantizer / inverse transformer 802; a prediction information decoder 803; an adder 804; a decoded image memory 805; and an 806 predictor.
The decoding process of the image decoding device illustrated in Figure 6 corresponds to the decoding process arranged within the image encoding device illustrated in Figure 5. Consequently, the configurations of the inverse quantizer / inverse transformer 802, the adder 804, the decoded image memory 805, and the predictor 806 illustrated in Figure 8 have functions corresponding respectively to the configurations of the inverse quantizer / inverse transformer 503 , the adder 504, the decoded image memory 505, and the predictor 506 of the image encoding device illustrated in Figure 5.
Prediction information decoder 803 generates prediction information by performing a decoding of
IMPI Mexican institute OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0033.tif" />
entropy of an input prediction ixifurting-bitstream stream and provides the prediction information generated to the predictor 806.
Predictor 806 generates a predicted image using the input prediction information and the decoded image that is stored in the decoded image memory 805 and provides the generated predicted image to the adder 804.
The differential information decoder 801 generates differential information by performing an entropy decoding of the differential information. The differential information decoder 801 then provides the generated differential information to the inverse quantizer / inverse transformer 802.
The inverse quantizer / inverse transformer 802 generates a decoded differential signal by performing the inverse quantization and inverse orthogonal transformation of the differential information received from the differential information decoder 801 and provides the generated decoded differential signal to the adder 804.
Adder 804 generates a decoded image by adding the predicted image and the decoded differential signal together, stores the generated decoded image in the decoded image memory 805, and provides the generated decoded image.
The encoding process and the decoding process of the differential coefficients according to a modality
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0034.tif" />
of the present invention are respectively performed by the differential information encoder 507 of the motion picture encoding device illustrated in Figure 5 and the differential information decoder 801 of the motion picture decoding device illustrated in Figure
8. Hereinafter, the encoding process and the decoding process of the differential information according to one embodiment will be described in detail.
Lock code
According to the embodiment, as illustrated in Figure 14, the screen is hierarchically divided into rectangular blocks, and the blocks are processed according to a predetermined processing sequence. Each block that is divided will be referred to as a coding block. A block 1817 illustrated in Figure 14 is a maximum unit of division according to the embodiment and will be referred to as a maximum encoding block. Furthermore, a block 1816 illustrated in the Figure is a minimum unit of division according to the embodiment and will be referred to as a minimum coding block. Hereinafter, the minimum coding block will be described as a
4X4 pixels and the maximum encoding block will be described as a 16 X 16 pixel block.
Prediction Block
Among the coding blocks, a unit in which an intra-prediction is performed will be referred to as a
ΙΜΡΙ
INSTTTtJTO MEXICANO ΓΗ THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0035.tif" />
prediction. The prediction block has several upum-sg sizes later shown to be larger than or equal to the minimum code block and smaller or equal to the maximum code block. In Figure 14, blocks 1802, 1803, and 1804 are 16 X 16 blocks, blocks 1805, 1810, 1811, and 1801 are 8 X 8 blocks, and blocks 1806, 1807, 1808, and 1809 are blocks 4 X 4. Blocks 1812, 1813, 1814, and 1815 are blocks that have not been processed, and the encoding block sizes thereof are not determined. In the encoding sequence, an optimal prediction block size is determined, and the prediction block blocks are encoded. In the decoding sequence, the size of the prediction block is derived from the bit stream. Hereinafter, the description will be presented assuming that the prediction block is the processing unit.
Differential Coefficient Processing Unit
Although the unit in which the quantization and orthogonal transformation are performed is the same as the unit of the prediction block, in the encoding process and the decoding process, scanning is performed with the differential coefficient region separated by a plurality of sub-blocks. The sub-block size is a 4 X 4 size. Figure 12 illustrates a 16 x 16 size differential coefficient region. Here, reference numbers 401 to 416 represent sub-blocks. However, the unit in which the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0036.tif" />
quantization and orthogonal transformation<sup>1</sup> are performed. · 'can · be determined independently of the unit of the predictor block.
First example
Coding Sequence
A first example of the method for encoding differential information according to an embodiment of the present invention will now be described. FIG. 15 is a block diagram illustrating the detailed configuration of the differential information encoder 507, which is illustrated in FIG. 5, according to the first example. The differential information encoder 507 according to the first example includes: an arithmetic encoder 701; a differential coefficient regulator 702; an encoding controller 703; a context memory 704; and a 705 scan controller. In addition, the encoding controller 703 includes: a significant coefficient information encoding controller 706; a coding controller for the value of the differential coefficient 707; and a significant sub-block encoding controller information 708.
Hereinafter, the coding sequence of the differential coefficients will be described with reference to the flow diagrams illustrated in Figures 16, 17, 18, and 19.
Scan controller 705 determines a sub-block to be processed (S601). When the scanning of the
IMPI
MEXICAN INSTITUTE OF THE «ΟΠΕΡΑ D INDUSTMAL
<img file="MX339686B_D0037.tif" />
all sub-blocks, the decoding process of the differential coefficients ends. Reference number 902 depicted in Figure 7 illustrates the scanning sequence of the sub-blocks. In this sequence, scanning is started from a sub-block arranged on the lower right side of the differential coefficient region, scanning is performed according to a rule from the lower right side to the upper left side and the right side upper to upper left side, and scanning is completed in a sub-block arranged on the upper left side. As described above, the context is updated according to the encoding process. Taking this scanning sequence, a low region component in which a differential coefficient can easily be presented is scanned after a high region component, and consequently, there is an advantage in the process of improving the estimated precision of the probability of occurrence of a differential coefficient of the low region component. Reference number 901 illustrated in Figure 7 is a diagram illustrating the scanning sequence of the sub-blocks using arrows. In the case where the scanning sequence illustrated in Figure 7 is applied, the scanning of the spatially placed sub-blocks respectively on the right side and the bottom side of the sub-block to be processed is in the complete state. The encoding process of the sub-block to be processed is performed (S602).
IMPI
MEXICAN INSTITUTE BE THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0038.tif" />
Sub Block Coding Sequence '(SSfl2)
The information encoding controller of significant sub-block 708 derives a sub-block to be processed from the differential coefficient regulator 702. All the differential coefficients of the sub-block are scanned, and, in a case where all the values of the differential coefficient are 0, the information of the significant sub-block is set to 0. Otherwise (in a case where there is at least one differential coefficient value other than O), the significant sub-block information is set to 1 (S701).
The significant sub-block information encoding controller 708 refers to the differential coefficients that are neighboring the sub-block to be processed and are included in the sub-block that has been decoded from the differential coefficient regulator 702 and determines a ctxldx context index used to decode the significant sub-block information. Then the significant sub-block information encoding driver 708 reads a context that corresponds to the context index ctxldx from the context memory
704. Then, the significant sub-block information and context are transmitted to the arithmetic encoder 701. Then, the arithmetic encoder 701 encodes the significant sub-block information using the context (S702).
The significant sub-block information encoding controller 708 determines the value of the information of
IMPI «yill MEXICAN INDUSTRIAL PROPERTY UTO significant sub-block (S703). When significant sub-block is 0, the value of the differential coefficient of the sub-block ends, and the process goes to step
S601.
When the significant sub-block information is 1, the encoding process of all the significant differential coefficient information of the sub-block to be processed is performed (S704). The coding sequence of the significant differential coefficient information will be described in detail later. After the encoding of all the sub-block significant differential coefficient information is complete, the process proceeds to encode the differential coefficient values of step S704.
The differential coefficient value encoding controller 707 performs the encoding process of all the differential coefficient values of the sub-block to be processed (S705). The coding sequence of the sub-block differential coefficient values will be described in detail later. After completing the encoding of all the differential coefficient values, the process continues to step S601.
Sequence of the Information Coding Process
Significant Differential Coefficient (S704)
The significant coefficient information encoding controller 706 calculates a sum of the coefficients
<img file="MX339686B_D0039.tif" />
ΙΜΡΙ
MEXICAN INSTITUTE M INDUSTRIAL PROPERTY
<img file="MX339686B_D0040.tif" />
differentials, which have different values of <sup>11</sup>0<sup>11</sup>, I see the sub-block to be processed, in other words, a neighbor significant coefficient sum countCoeff (S801). In this sequence, the differential coefficients belonging to the sub-blocks spatially arranged respectively on the right side and the bottom side of the sub-block to be processed and are neighboring the sub-block to be processed are defined as coefficients neighboring spreads.
Figure 10 illustrates the positions of the neighboring differential coefficients. Reference number 301 represents a sub-block to be processed, and reference number 3 02 represents neighboring differential coefficients. A neighbor differential coefficient representing the outside of the differential coefficient region is excluded from the calculation of the sum of the significant neighbor coefficient countCoeff. A differential coefficient 3 03 that belongs to both the sub-blocks arranged on the right-hand side and the left-hand side of the sub-block to be processed can be configured to be included in the neighboring differential coefficients or can be configured not to be included there. In the configuration in which the differential coefficient 303 is included in the neighboring differential coefficients, the number of neighboring differential coefficients increases, and the probability of occurrence of the significant differential coefficient information can be calculated with high precision. the configuration in which the coefficient
IMPI Mexican msrmiTo OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0041.tif" />
Differential 303 is not included in the neighboring differential coefficients, the computation amount and the circuit scale can be decreased by reducing the addition process from the sum of the neighboring significant coefficient countCoeff and reducing the process of determining the limits of the differential coefficient region .
The significant coefficient information encoding controller 706 determines the differential coefficients that are the processing targets (S802). The sequence of scanning the differential coefficients with the sub-block, similar to the sequence of scanning the sub-blocks in the region of the differential coefficient, follows the rule represented in Figure 7. When the scanning of all the significant differential coefficients of the sub-block is completed, the encoding process of the significant differential coefficients is completed, and the process proceeds to the encoding sequence (S704) of the differential coefficient values.
The significant coefficient information encoding driver 706 determines whether or not the sum of the neighbor significant coefficient countCoeff is 0 (S803).
In a case where the sum of the neighbor significant coefficient countCoeff is 0, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S804). Here, it is represented so that a
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0042.tif" />
The position of the horizontal differential coefficient is posX, a position of the vertical differential coefficient is posY, and the position of the differential of the processing target is pos = posX + posY. In a case where pos <= 2, a ctxldx context index used to encode the significant coefficient information is set to 1 (S805). Otherwise (pos> 2), the ctxldx context index is set to 0 (S806).
The definition of the ctxldx context index of a case where countCoeff = 0 is indicated by the reference number 601 in Figure 11.
O When the sum of the neighbor significant coefficient countCoeff is not 0, it is determined whether or not the sum of the neighbor significant coefficient countCoeff is less than or equal to 1 (S807). In a case where the sum of the neighbor significant coefficient countCoeff is less than or equal to 1, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S408). In a case where the position of the differential coefficient of the processing target pos <= 3, the context index ctxldx used to decode the significant coefficient information is set to 1 (S809). Otherwise (pos> 3), the ctxldx context index is set to 0 (S810). The definition of the ctxldx context index of a case where countCoeff = 1 is indicated by reference number 602 in Figure 11.
When the neighbor significant coefficient sum
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0043.tif" />
countCoeff is not less than or equal to 1, doteagminated or if the neighboring significant coefficient increment countCoeff is or is not less than 2 (S811). In a case where the sum of the neighbor significant coefficient countCoeff is less than or not equal to 2, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S812). In a case where the position of the differential coefficient of the processing target pos <= 2, the context index ctxldx used to decode the significant coefficient information is set to 2 (S813). Otherwise (pos> 2), the ctxldx context index is set to 1 (S814). The definition of the context index ctxldx of a case where the sum of the neighbor significant coefficient countCoeff = 2 is indicated by the reference number 603 in Figure 11.
When the sum of the neighbor significant coefficient countCoeff is not less than or equal to 2, the context index ctxldx used to decode the significant coefficient information is set to 2 (S815). The definition of the context index ctxldx of a case where the sum of the neighbor significant coefficient countCoeff> 2 is indicated by the reference number 605 in Figure 11.
The significant coefficient information encoding controller 706 derives the differential coefficient of the processing target position from a differential coefficient regulator 702. In a case where the value of the
IMPI
INSTITUTO MEXICANO DI LA FROFIEDAD INDUSTRIAL
<img file="MX339686B_D0044.tif" />
differential coefficient is not 0, the information ^ ri'dé'óóéf lt'itííitH<sup>1</sup> significant differential is set to 1. Otherwise (in a case where the value of the differential coefficient is 0), the significant differential coefficient information is set to 0 (S816).
After a context that corresponds to the given context index ctxldx is read from the context memory
704, the significant coefficient information encoding controller 706 transmits the significant differential coefficient information and context to the arithmetic decoder 701. The arithmetic encoder 701 encodes the significant differential coefficient information using the context (S817).
Process that Codifies the Value of the Differential Coefficient (S705)
The differential coefficient value encoding controller 707 determines a differential coefficient which is the processing target (S901). It is assumed that the scanning sequence of the differential coefficients arranged in a sub-block, similar to the scanning sequence of the significant differential coefficients, follows the rule illustrated in Figure 7. When the scanning of all the sub-block differential coefficients is completed, the process of encoding the differential coefficient values is completed, and the process continues to sequence (S601) for
IMPI
MEXICAN INSTITUTE OE INDUSTRIAL PROPERTY
<img file="MX339686B_D0045.tif" />
determine the next sub-block. .......
The differential coefficient value encoding controller 707 determines whether or not the differential coefficient value of the differential coefficient position of the processing target is 0 (S902). In a case where the value of the differential coefficient of the position of the differential coefficient of the processing target is 0, the encoding of the value of the differential coefficient of the position of the differential coefficient of the processing target is completed, and the process continues to step S901 .
In a case where the value of the differential coefficient of the position of the differential coefficient of the processing target is not 0, the absolute value of the coded differential coefficient of the position of the differential coefficient of the processing target and the sign (S903 and S904) is calculated. When this sequence is performed, the value of the differential coefficient is determined to be not 0. Consequently, the absolute value of the coded differential coefficient is set as a derived value by decreasing one of the absolute value of the differential coefficient. Furthermore, in a case where the differential coefficient is positive, the sign is set to 0. On the other hand, in a case where the differential coefficient is negative, the sign is set to 1.
After the context is read from context memory
704, the coefficient value encoding controller
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0046.tif" />
Differential 707 transmits an absolute value of'LOtl'l'fl cardon and context to arithmetic encoder 701. The arithmetic encoder
701 encodes the absolute encoding value using the context (S905).
After the context is read from context memory
704, the differential coefficient value encoding controller 707 transmits a signal and the context to the arithmetic encoder 701. The arithmetic encoder 701 encodes the absolute encoding value using the context (S905).
Decoding Sequence
A method for decoding differential coefficients will be described in accordance with a first example of the present invention. Figure 8 is a block diagram illustrating the detailed configuration of the differential information decoder 801, which is illustrated in Figure 6, according to the first example. The differential information decoder 801 according to the first example includes: an arithmetic decoder 1001; a differential coefficient regulator 1002;
a decoding controller 1003; a context memory
1004; and a scanning controller 1005. In addition, the decoding controller 1003 includes: a decoding controller of the information of the significant coefficient 1006; a decoding controller of the differential coefficient value 1007; and a decoding controller information of significant sub-block 1008.
IMPI Mexican Institute «£ LA MORI fr» AI? INDUSTRIAL
<img file="MX339686B_D0047.tif" />
Because the decoding process. The differential information encoder performed by the differential information decoder 801 illustrated in Figure 8 corresponds to the differential information encoding process performed by the differential information encoder 507 illustrated in Figure 5, the configurations of the differential coefficient regulator 1002, context memory 1004, and the scan driver
1005 of the differential information encoder illustrated in
FIG. 8 respectively have functions corresponding to the settings of the differential coefficient regulator 702, the context memory 704, and the scan controller 705 illustrated in FIG. 15.
Hereinafter, the decoding sequence of differential information will be described with reference to the flowcharts illustrated in Figures 1, 2, 4, and 13.
Scan driver 1005 determines a sub-block to be processed (S101). When scanning of all sub-blocks is complete, the decoding process of the differential coefficients ends. Reference number 902 depicted in Figure 7 illustrates the scanning sequence of the sub-blocks. In this sequence, scanning is started from a sub-block arranged on the lower right side of the differential coefficient region, scanning is performed according to a rule from the lower right side to the upper left side and the upper right side to the side. upper left, and you
IMPI
MEXICAN INSTITUTE IX IA MOMPDaP INDI ISTRIAl
<img file="MX339686B_D0048.tif" />
completes the scan in a sub-block arranged éft 'he lcLilu upper left. Reference number 901 depicted in Figure 7 illustrates the scanning sequence of the sub-blocks using arrows. In a case where the scanning sequence illustrated in Figure 7 is applied, the scanning of the spatially positioned sub-blocks respectively on the right side and the bottom side of the sub-block to be processed is in the completed state. The decoding process of the sub-block to be processed is performed (S102).
Sub-block decoding (S102)]
The significant sub-block information decoding controller 1008 refers to the differential coefficients that are neighboring with the sub-block to be processed and are included in the sub-block that has been decoded from the differential coefficient regulator 1002, determines a context used to decode the significant sub-block information, and reads the determined context from context memory 1004. The decoding controller information of the significant sub-block 1008 transmits a decoding command together with the context of the arithmetic decoder 1001. The arithmetic decoder 1001 performs the process of decoding a bitstream stream using the context, thereby decoding the significant sub-block information (S201).
The information decoding controller of
J.
IMPI iwrmrro mexicana OE LA PROPIEDAD INDUSTRIAL
<img file="MX339686B_D0049.tif" />
significant sub-block 1008 determines the value of the significant sub-block inf omnwtriüTT (S202). When the significant sub-block information is 0, all the differential coefficient values of the processing target sub-block stored in the differential coefficient slider 1002 are set to 0 (S209), and the decoding process of the values ends. differential coefficient of the sub-block.
When the significant sub-block information is 1, the decoding process of all the significant differential coefficient information of the sub-block to be processed is performed (S203). The decoding sequence of the significant differential coefficient information of a sub-block will be described in detail later. After completing the decoding of all the significant differential coefficient information of the sub-block, the process continues to the decoding of the differential coefficient values of step S204.
Subsequently, the decoding process of all the differential coefficient values of the sub-block to be processed is performed (S204). The decoding sequence of the sub-block differential coefficient values will be described in detail later. After completing the decoding of all the sub-block differential coefficient values, the process continues to step S101.
Sequence of the Information Decoding Process
IMPI
INSTITUTO MEXICANO OE LA PROPIEDAD industrial
<img file="MX339686B_D0050.tif" />
of Significant Differential Coefficient (S2TO ')' <sup>1</sup> —
The decoding controller of the significant coefficient information 1006 calculates the sum countCoeff of the number of neighboring significant differential coefficients of the position of the differential coefficient of the processing target (S401). In this sequence, the differential coefficients belonging to the spatially arranged sub-blocks respectively the right side and the bottom side of the sub-block to be processed and are neighboring the sub-block to be processed are defined as differential coefficients neighbors.
Figure 10 illustrates the positions of the neighboring differential coefficients. Reference number 3 01 represents a sub-block to be processed, and reference number 302 represents neighboring differential coefficients. A neighbor differential coefficient representing the outside of the differential coefficient region is excluded from the calculation of the sum of the neighbor significant coefficient countCoeff. A differential coefficient 303 that belongs to both sub-blocks arranged on the right side and the lower side of the sub-block to be processed can be configured to be included in the neighboring differential coefficients or can be configured not to be included there. In the configuration where the differential coefficient 303 is included in the neighboring differential coefficients, the number of coefficients increases
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0051.tif" />
neighboring differentials, and the probability of occurtia'U.tí 'lff significant differential coefficient information can be calculated with high precision. On the other hand, in the configuration in which the differential coefficient 303 is not included in the neighboring differential coefficients, the computation amount and the circuit scale can be decreased by reducing the addition process related to the sum of the neighbor significant coefficient countCoeff and reducing the process of determining the limits of the region of the differential coefficient.
The decoding controller of the significant coefficient information 1006 determines the differential coefficients that are the processing targets (S402). The sequence of scanning the differential coefficients in the sub-block, similar to the sequence of scanning the sub-blocks in the region of the differential coefficient, follows the rule represented in Figure 7. When the scanning of all the sinificant differential coefficients of the sub-block is completed, the decoding process of the significant differential coefficients is completed, and the process continues to the decoding sequence (S204) of the differential coefficient values.
The significant coefficient information decoding driver 1006 determines whether or not the sum of the neighbor significant coefficient countCoeff is 0 (S403). In a case where the sum of the neighbor significant coefficient
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL MONEDAD
<img file="MX339686B_D0052.tif" />
countCoeff is 0, position is determined<sup>1</sup> 'CttíT COSTTCTSHt'S ”differential of the processing target in the sub-block to be processed (S404). Here, it is represented in such a way that a horizontal position of differential coefficient is posX, a vertical position of differential coefficient is posY, and the position of the differential of the processing target is pos = posX + posY. In a case where pos <= 2, a ctxldx context index used to decode the significant coefficient information is set to 1 (S405). Otherwise (pos> 2), the ctxldx context index is set to 0 (S406).
The definition of the ctxldx context index of a case where countCoeff = 0 is indicated by the reference number 601 in the
Figure 11. After reading the determined context from context memory 1004, a decoding command is transmitted to arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S416).
When the sum of the neighbor significant coefficient countCoeff is not 0, it is determined whether or not the sum of the neighbor significant coefficient countCoeff is less than or equal to 1 (S407). In a case where the sum of the neighbor significant coefficient countCoeff is less than or equal to 1, the position of the differential coefficient of the processing target in the
ΙΜΡΙ
Mexican Institute of Industrial Property
<img file="MX339686B_D0053.tif" />
sub-block to be processed is to determine ^ e4 ^^) - r-Bft- * Ha-eajBQ-. where the position of the differential coefficient of the processing target pos <= 3, the context index ctxldx used to decode the significant coefficient information is set to 1 (S409). Otherwise (pos> 3), the ctxldx context index is set to 0 (S410). The ctxldx context index of a case where countCoeff = 1 is indicated by reference number 602 in Figure 11. After reading the determined context from context memory 1004, a decoding command is transmitted to arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S416).
When the sum of the neighbor significant coefficient countCoeff is not less than or equal to 1, it is determined whether or not the sum of the neighbor significant coefficient countCoeff is less than equal to 2 (S411). In a case where the sum of the neighbor significant coefficient countCoeff is less than or equal to 2, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S412). In a case where the position of the differential coefficient of the processing target pos <= 2, the context index ctxldx used to decode the significant coefficient information is set to 2 (S413). Otherwise (pos> 2),
T PI • * · .. ·! , MEXICAN<sup>1</sup> u- ErtOFIEDAD • * DU $ TrtlAL
<img file="MX339686B_D0054.tif" />
the ctxldx context index is set to 1 (S414). The dtí'f luition of the context index ctxldx of a case where the sum of the neighbor significant coefficient countCoeff = 2 is indicated by the reference number 603 in Figure 11. After reading the determined context from context memory 1004, a decoding command is transmitted to the arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S416).
When the sum of the neighbor significant coefficient countCoeff is not less than or equal to 2, the context index ctxldx used to decode the significant coefficient information is set to 2 (S415). The definition of the context index ctxldx of a case where the sum of the neighbor significant coefficient countCoeff> 2 is indicated by the reference number 605 in Figure 11. After reading the determined context from context memory 1004, a decoding command is transmitted to arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs the decoding process of a bit stream using the context, thereby decoding the significant differential coefficient information (S416).
When the sum of the neighbor significant coefficient countCoeff is large, there is a high possibility that all the
ΜΡΙ
MEXICAN INSTITUTE Π '. THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0055.tif" />
information of significant coefficient in the ~ güTj-bluque '~ qug · ai · is going to process is 1. Consequently, in the sequence described above, in a case where the sum of the neighboring significant coefficient countCoeff is greater than or equal to 3, the context index ctxldx is set to 2 regardless of the position value of the differential coefficient of the processing target pos. Furthermore, the determination criterion can be subdivided for the sum of the neighbor significant coefficient countCoeff. For example, in a case where the countCoeff of the neighbor significant coefficient is greater than or equal to 3, when the sum of the neighbor significant coefficient countCoeff is 3, the definition of the context index indicated by reference number 604 illustrated in Figure 11 is configured to be taken, and, when the sum of the neighbor significant coefficient countCoeff is greater than or equal to 4, the definition of the context index that is indicated by the reference number 605 illustrated in Figure 11 is configured to be taken. In a case where configuration is taken, the correlation usage efficiency of neighboring information is provided, and consequently, the coding efficiency can be improved.
In this sequence, for the calculation of the context index ctxldx used for the significant differential coefficient information, reference is made to a sum of the amount of significant coefficient information of the decoded neighboring sub-block and the position of the differential coefficient of the
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX339686B_D0056.tif" />
processing target in the sub-block. 13n<sup>,</sup>”<sup>,</sup>create / will describe the reason for taking the configuration.
In general, the orthogonal transformation coefficients of an image can be easily concentrated on the low region component, and there is a good chance that the significant coefficient information is 1. Furthermore, because it is difficult for the high region component of the orthogonal transformation coefficient to receive a visual influence, the high region component is quantified in an approximate way in many cases, and consequently, there is a great possibility that the value of the coefficient of the high region component is 0, and the information of significant coefficient of the component of the high region is 0. the characteristic is not limited to the entire region of the differential coefficient but is the same for each sub-block, and it can be considered that, for a component present in on the low region side of the sub-block, a probability that the significant coefficient information is 1 is greater than for a component present on the high region side of the same sub-block. Setting the ctxldx context index value of the significant differential coefficient information presented in the low region in the sub-block to be greater than the ctxldx context index value of the significant differential coefficient information present in the high region entails to improving the accuracy of the calculation of the probability of occurrence of the coefficient information
ΙΜΡΪ
INSTITUTO MSXlCANO DE LA rxoPIEUAD INDUSTRIAL
<img file="MX339686B_D0057.tif" />
significant. In addition, the sum of the signifigate-wo-veino coefficient tends to be small in the high region where the probability that the significant differential coefficient is 0 is high, and the sum of the neighboring significant coefficient tends to increase in the low region by which is high the probability that the significant differential coefficient is 1. Thus, using the sum of the neighboring significant coefficient as an index representing the degree of inclusion of the significant differential coefficient information in the sub-block to be processed improves the precision of the calculation of the probability of occurrence of the information. of significant coefficient.
In this sequence, by calculating the sum of the neighbor significant differential coefficient for the sub-block once, the context index of all coefficient positions in the sub-block can be calculated. Thus, compared to the method in which the sum of the neighbor significant differential coefficient is calculated at each position of the coefficient, the amount of neighbor significant differential coefficient calculation can be reduced. Furthermore, in a configuration where the decoding result of the above significant differential coefficient in the scan sequence is used for the calculation of the context index, it is necessary to sequentially process the calculation of the context index in the sub-block and decoding the significant differential coefficient. In this example, while the sum of the differential coefficient
IMPI
MEXICAN INSTITUTE OE INDUSTRIAL PROPERTY
<img file="MX339686B_D0058.tif" />
neighbor significant and the position of the processing target coefficient are referred to the calculation of the context indices, the differential coefficient belonging to the sub-block of the processing target is not achieved for the sum of the neighbor significant differential coefficient, and consequently, there is no dependency in the sub-block for the calculation of the context indices. Because the context index for all significant differential coefficients can be calculated from the start of the sub-block, the calculation of the context index can be performed in parallel with the decoding process of the significant differential coefficient information. In this way, a processing delay related to the decoding of the significant coefficient information having a high frequency of occurrence in the bit stream can be decreased.
Context calculation can be performed by referring to the significant sub-block information instead of the neighbor significant coefficient. Also, compared to a configuration where the sum of the neighbor significant coefficient is obtained, the computation amount and the circuit scale can be reduced. Furthermore, the position of the sub-block can be reflected in the context calculation. As previously described, the low region component has a characteristic that has the probability that the occurrence of the significant coefficient is greater than that of the high region.
IMPI '«ιτιτυτυ Mexican Dt LA PROf IF.» AD INDUSTRIAL
<img file="MX339686B_D0059.tif" />
Reflecting the position of the sub-block in the raloiJn do rnThpytn. Context calculation can be performed which has higher precision. Figure 20 illustrates an example where the region of the differential coefficient is classified into two areas including a low region area and a high region area. In Figure 20, the areas indicated by reference numbers 1101, 1102, 1103, 1104, 1105, and 1109 are low region components, and the areas indicated by reference numbers 1106, 1107, 1108, 1110, lili, 1112, 1113, 1114, 1115, and 1116 are highland areas. After calculating the ctxldx context index in the sequence described above for the high region areas, default offsets corresponding to the sub-block positions can be configured to be added to the previously described ctxldx context index for the region areas low, or a conditional branch can be configured according to the position of the sub-block to be added during the calculation of the ctxldx context index previously described. Furthermore, after calculating the ctxldx context index in the sequence described above for low region areas, for the high region area, there is generally a high possibility that the significant differential coefficient is 0, and the number of Neighboring significant differential coefficients can easily include an error in the probability calculation, and consequently, A configuration can be used in which the context ctxldx = 0 is constantly set.
I k. <
'5 VX
<img file="MX339686B_D0060.tif" />
Mexican Ot Ι.Λ -ήοριεολρ UUSTKIAL
<img file="MX339686B_D0061.tif" />
In addition, the context index can be heated usaiid® lu>
sum of the absolute values of the neighboring coefficients instead of the sum of the neighboring significant differential coefficient. In general, the absolute value of the differential coefficient of the low region components is large, and consequently, setting a context in which the probability of occurrence of the information of significant differential coefficient increases in a case where the sum of the values absolute of neighboring differential coefficients is large, coding efficiency can be improved.
Furthermore, by adding the prediction mode used when calculating the differential coefficients for determining the condition previously formed during the context index calculation sequence of the significant differential coefficients, the precision of the context calculation can be improved. The reason for this is that, generally, compared to an intra-prediction in which only a decoded area of a decoding target image is set as the reference target, an inter-prediction capable of referring to a plurality of images Decoded features that the prediction accuracy is high and a differential cannot be easily presented.
Coefficient Value Decoding Process
Differential (S204)
The information decoding controller of
IMPI
MEXICAN INSTITUTE. K THE INDUSTRIAL FROFIEDAD
<img file="MX339686B_D0062.tif" />
significant coefficient 1006 determines differential coefficients that are the processing targets (S501). The sequence of scanning the differential coefficients in the sub-block, similarly to the sequence of scanning the significant differential coefficients, follows the rule represented in Figure 7. When the scanning of all the differential coefficients of the sub-block is completed, the decoding process of the differential coefficients is completed, and the process continues to the sequence (S101) for determining the next sub-block.
The decoding controller of the significant coefficient information 1006 determines whether or not the value of the differential coefficient of the differential coefficient position of the processing target is 0 (S502). In a case where the value of the differential coefficient of the position of the differential coefficient of the processing target is 0, the decoding of the value of the differential coefficient of the position of the differential coefficient of the processing target is completed, and the process continues to step S501 .
In a case where the value of the differential coefficient of the position of the differential coefficient of the processing target is 1, the absolute value of the differential coefficient of the position of the differential coefficient of the processing target is decoded (S503). In a case where this sequence is performed, it is determined that the value of the
ΪΜΡΙ ~~ 'NST1TUTO MFJICAN ·'
Dt LA FRQPIEDAP INDUSTRIAL
<img file="MX339686B_D0063.tif" />
Differential coefficient is not 0, and, as a bit stream, a codeword that corresponds to a derived value is decoded by decreasing one of the absolute value of the differential coefficient. Consequently, as an absolute value of the differential coefficient, a derived value is set by adding 1 to the value that is derived by performing the entropy decoding of a codeword.
Subsequently, the sign of the differential coefficient of the position of the differential coefficient of the processing target is decoded (S504). A value of the differential coefficient is determined based on the absolute value of the differential coefficient and the sign of the differential coefficient.
In this example, although the context index used for decoding the significant differential coefficient information is calculated based on the significant differential coefficient information of the decoded sub-block, a similar sequence can be applied to the calculation of the context index of the value of the differential coefficient. Similar to the significant differential coefficient information, the value of the differential coefficient has a correlation with the values of the neighboring coefficient and has a concentration in the low region component. Thus, setting a context index that represents a high probability of occurrence of a large differential coefficient value when the sum of the neighboring significant differential coefficient or the sum of the values
MPI '»~ O MEXICANO
THE INDUSTRIAL TIP
<img file="MX339686B_D0064.tif" />
Absolutes of Venine Differential Coefficients ph large v by setting a context index representing a high probability of occurrence of a small differential coefficient value when the sum of the neighboring significant differential coefficient or the sum of the absolute values of the neighboring differential coefficients is small , the differential coefficient values can be decoded efficiently.
According to the image encoding device and the image decoding device of the first example described above, the following operations and advantages are obtained.
(1) The context index the differential coefficient of the processing target can be calculated based on the coefficients that belong to a decoded sub-block that is neighbor to the sub-block, to which the differential coefficient of the processing target belongs. Setting a context that calculates the probability of occurrence of the information of significant differential coefficient of 1 to be high when the sum of the neighboring significant differential coefficient is high and calculates the probability of occurrence of the information of significant differential coefficient of 0 to be high when the sum of the neighboring significant differential coefficient is small, An appropriate probability model can be set based on the neighboring correlation of the significant differential coefficient information. Consequently, you can
<img file="MX339686B_D0065.tif" />
<sup>64</sup> IMPI
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL efficiently encode the information of significant differential coefficient.
(2) The context index is calculated based on the position of the differential coefficient of the processing target in the sub-block. A context is set, which calculates the differential coefficient arranged in the low region in the sub-block so that it has a probability of occurrence of the significant differential coefficient of 1 so that it is greater than the differential coefficient arranged in the high region in the sub-block. -block. In this way, a probability model that is based on the characteristics of the significant differential coefficient information in the frequency domain can be set, and the significant differential coefficient information can be encoded efficiently.
(3) The calculation of the sum of the neighbor significant differential coefficient and the position of the differential coefficient of the processing target in the sub-block do not depend on a decoding result of the significant differential coefficient information in the sub-block. Accordingly, a configuration can be employed in which the computation of the context index in the sub-block and the decoding of the significant differential coefficient information are processed in a parallel manner and therefore a processing delay is reduced. related to the decoding process related to the decoding process of the coefficient information
IMPI
Mexican INSTITUTE! 7t 1A INDUSTRIAL PROPERTY significant differential. Accordingly, the differential coefficients decrease a significant differential coefficient information processing delay that has a high occupancy rate in the bitstream and has a large number of processes, and therefore, a decoding device that is appropriate for real-time processing. Furthermore, also in the encoding device, a significant differential coefficient information encoding processing delay can be similarly decreased.
(4) The sum of the significant differential coefficient related to the context index of the significant differential coefficient information does not depend on the position of the differential coefficient of the processing target, and accordingly, the sum of the significant differential coefficient can be calculated once for the sub-block. Accordingly, compared to a setting in which each sum of the neighboring significant differential coefficient is calculated according to the position of the differential coefficient of the processing target, the amount d of the calculation related to the context index calculation can be decreased.
Second Example
A second example of the differential information encoding method according to an embodiment of the present invention will now be described. An encoder
<img file="MX339686B_D0066.tif" />
ΐΜΡΙ
WTUTO MEXICANO or LA MORI UTA O IW & UJTRIAL
<img file="MX339686B_D0067.tif" />
Differential information 507 according to the similar to the differential information encoder 507 according to the first example illustrated in Figure 15, includes: an arithmetic encoder 701; a differential coefficient regulator 702; an encoding controller 703; a context memory 704; and a scan controller 705. In addition, the encoding controller 7 03 includes: a significant coefficient information encoding controller 706;
a coding controller for the differential coefficient value 707; and a significant sub-block information encoding controller 708.
The coding sequence of the differential information according to this example is the same as that of the first example except for the sequence (S704 illustrated in Figure 17) of the coding process for the information of significant differential coefficient, and thus, onwards, the sequence of the encoding process of the significant differential coefficient information according to this example will be described with reference to the flow chart illustrated in Figure 21.
Sequence of the Information Coding Process
Significant Differential Coefficient (S704)
The encoding controller of the significant coefficient information 706 derives the significant sub-block information from the decoded sub-blocks which are
TMPI '' TUTO MEXICANO 'F. INRUSTPIAL PROPERTY
<img file="MX339686B_D0068.tif" />
respectively neighbors with the right side and the ^ nforíor of a sub-block to be processed. It is set in such a way that the significant sub-block information of the neighboring sub-block to the right side is sigGroupRight, and the significant sub-block information of the neighboring sub-block to the lower side is sigGroupBottom (SI001).
The significant coefficient information encoding controller 706 determines differential coefficients that are the processing targets (S1002). The sequence of scanning the differential coefficients in the sub-block, similar to the sequence of scanning the sub-blocks in the region of the differential coefficient, follows the rule represented in Figure 7. When the scanning of all the significant differential coefficients of the sub-block is completed, the encoding process of the significant differential coefficients is completed, and the process continues to the encoding sequence (S704) of the differential coefficient values.
The encoding controller of the significant coefficient information 706 evaluates the significant sub-block information sigGroupRight and the significant sub-block information sigGroupBottom (S1003).
In a case where both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are 0, the position is determined <sup>γ</sup>ΜΡΙ 'or Mexican
ΓΗ INDUSTRIAL PROPERTY
<img file="MX339686B_D0069.tif" />
of the differential coefficient of the processing target in the sub-block to be processed (S1004). Here, it is represented in such a way that a horizontal differential coefficient position is posX, a vertical differential coefficient position is posY, and the position of the differential of the processing target is pos = posX + posY. In a case where pos <= 2, a ctxldx context index used to encode the significant coefficient information is set to 1 (S1005). Otherwise (pos> 2), the ctxldx context index is set to 0 (S1006). The definition of the ctxldx context index of a case where both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are 0 is indicated by reference number 1201 in Figure 23.
In a case where both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are not 0, it is determined whether the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0 (S1007). In a case where the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0, the position of the differential coefficient of the processing target with the sub-block to be processed is determined (S1008) . In a case where the vertical position of the differential coefficient posY <= 1, the index
IMPI
MEXICAN INSTITUTE • í THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0070.tif" />
context ctxldx used to decode the significant coefficient information is set to 1 (S1009). Otherwise (posY> 2), the ctxldx context index is set to 0 (S1010).
The definition of the ctxldx context index for a case where the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0 is indicated by reference number 1202 in Figure 23.
When the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are not respectively 1 and 0, it is determined whether the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are respectively 0 and 1 (S1011). In a case where the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are respectively 0 and 1, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1012 ). In a case where the horizontal position of the differential coefficient posX <= 1, the context index ctxldx used to decode the significant coefficient information is set to 1 (S1013). Otherwise (posX> 2), the ctxldx context index is set to 0 (S1014). The definition of the ctxldx context index of a case where the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 1 is indicated by the reference number
IMPI j STITUTO mlxican ·
OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0071.tif" />
1203 in Figure 23. In other words, the sequence of setting the ctxldx context index of a case where the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 1 is a process in which the process in X direction and process in Y direction of a case where sigGroupRight significant sub-block information is 1 and sigGroupBottom significant sub-block information is 0 are exchanged. For this reason, the process can be configured to be common, can be reduced in hardware circuit scale or software encoding amount.
When the significant sub-block information sigGroupRight and the significant sub-block information sigGroupBottom are not respectively 0 and 1, in other words, when the significant sub-block information sigGroupRight and the significant sub-block information sigGroupBottom are
<td>respectively</td><td> 1 and</td><td> 1,</td><td colspan="2">the</td><td>position</td><td>of the</td>
<td colspan="2">differential coefficient</td><td>of the</td><td>aim of</td><td colspan="2">processing in</td><td>the</td>
<td>sub-block that</td><td>going to</td><td colspan="2">process (S1015).</td><td>In a</td><td>case where</td><td>the</td>
<td>position of</td><td colspan="2">coefficient</td><td>differential</td><td>of the</td><td>objective</td><td>of</td>
pos <= 4 processing, the ctxldx context index used to decode the significant coefficient information is set to 2 (S1016). Otherwise (pos> 5), the ctxldx context index is set to 1 (S1017). The definition of the ctxldx context index of a case where the significant sub-block information
TMPI τ; ητυτο; Mexican
Oh THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0072.tif" />
sigGroupRight is 0 and the sub-block information ^ sj ^ aw ^ jj2a £ ± 5 £ Q _____. sigGroupBottom is 1 indicated by reference number 1204 in Figure 23.
The encoding controller of the significant coefficient information 706 derives the differential coefficient of the position of the processing objective of the differential coefficient regulator 702. In a case where the differential coefficient value is not 0, the significant differential coefficient information is set in 1 . Otherwise (in a case where the differential coefficient value is 0), the significant differential coefficient information is set to (S1018).
After a context that corresponds to the given context index ctxldx is read from the context memory
704, the significant coefficient information encoding controller 706 transmits the significant differential coefficient information and context to the arithmetic encoder 701. The arithmetic encoder 701 encodes the significant differential coefficient information using the context (S1019).
Decoding Sequence
A method for decoding differential coefficients will be described in accordance with the second example of the embodiment of the present invention. The decoder of differential information 801 according to the second example, so
IMPI w »5rmrro Mexican Ot ΙΛ mOffgfMij IfOXWTUlAt
<img file="MX339686B_D0073.tif" />
similar to the information decoder d'lf'eÍ'Eümi'ial 001'da.
According to the first example illustrated in Figure 8, it includes: an arithmetic decoder 1001; a differential coefficient regulator 1002; a decoding controller 1003; a context memory 1004; and a 1005 scan controller. In addition, the decoding controller 1003 includes: a significant coefficient information decoding controller 1006; a decoding controller for the value of the differential coefficient 1007; and a controller for decoding the significant sub-block information
1008.
A differential information decoding process performed using the differential information decoder
801 illustrated in Figure 8 corresponds to the differential information encoding process performed by the differential information encoder 507 illustrated in
Figure 5. Thus, the differential coefficient regulator settings 1002, context memory 1004, and the scan driver 1005 of the differential information encoder illustrated in Figure 8 respectively have functions corresponding to the differential coefficient 702, context memory 704, and scan controller 705 illustrated in Figure 15.
Because the decoding sequence of the differential information according to this example is the same
ΙΜΡΙ [Mexican Nrrnvro
INDUSTRIAL PROPERTY
<img file="MX339686B_D0074.tif" />
than the first example except the sequence (¿03 ifustládo in Figure 2) of the process of encoding the information of significant differential coefficient, hereinafter, the sequence of the decoding process of the information of significant differential coefficient according to this Example will be described with reference to the flow chart illustrated in Figure 22.
Sequence of the Decoding Process of the Significant Differential Coefficient Information (S203)
The decoding controller of the significant coefficient information 1006 derives the significant sub-block information from the decoded sub-blocks that are neighbors with the right side and the bottom side of the sub-block to be processed. The significant sub-block information of the neighboring sub-block to the right side will be indicated by sigGroupRight, and the significant sub-block information of the neighboring sub-block to the lower side will be indicated by sigGroupBottom (S1101).
The decoding controller of the significant coefficient information 1006 determines differential coefficients which are the processing targets (S1102). The sequence of scanning the differential coefficients in the sub-block, similar to the sequence of scanning the sub-blocks in the region of the differential coefficient, follows the rule shown in Figure 7. When scanning is completed
ΙΜΡΙ
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0075.tif" />
of all the significant differential coefficients' <3S1 “sub-block, the decoding process of the significant differential coefficients is completed, and the process continues to the decoding sequence (S204) of the differential coefficient values.
The decoding controller of the significant coefficient information 1006 evaluates the significant sub-block information sigGroupRight and the significant sub-block information sigGroupBottom (S1103). In a case where the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 0, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1104) . Here, it is represented such that a horizontal position of the differential coefficient position is posX, a vertical position of the differential coefficient is posY, and the position of the differential differential of the processing target is pos = posX + posY. In a case where pos <= 2, a ctxldx context index used to decode the significant coefficient information is set to 1 (S1105). Otherwise (pos> 2), the ctxldx context index is set to 0 (S1106). The definition of the ctxldx context index of a case where the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 0 is indicated by reference number 12 01 in Figure
IMPI
MEXICAN INSTITUTE OF FROFIEDAD
INDUSTRIAL
<img file="MX339686B_D0076.tif" />
2. 3. After the determined context is called CT5 Tél llieillUl Context Id · 1004, a decoding command is transmitted to the arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S1116).
In a case where the sigGroupRight significant sub-block information and sigGroupBottom significant sub-block information are not 0, it is determined whether the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0 ( S1107). In a case where the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1108). In a case where the vertical position of the differential coefficient posY <= 1, the context index ctxldx used to decode the significant coefficient information is set to 1 (S1109). Otherwise (posY> 2), the ctxldx context index is set to 0 (S1110). The definition of the ctxldx context index of a case where the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0 is indicated by the reference number 1202 in Figure 23. Then
IMPI Mexican INSTITUTE GIVE INDUSTRIAL PROPERTY
<img file="MX339686B_D0077.tif" />
that the given context is read from the context memory
1004, a decoding command is transmitted to the arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S1116).
When the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are not respectively 1 and 0, it is determined whether the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are respectively 0 and 1 (Sllll). In a case where the sigGroupRight significant sub-block information and sigGroupBottom significant sub-block information are respectively 0 and 1, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1112 ). In a case where the horizontal position of the differential coefficient posX <= 1, the context index ctxldx used to decode the significant coefficient information is set to 1 (S1113). Otherwise (posX> 2), the ctxldx context index is set to 0 (S1114). The definition of the ctxldx context index of a case where the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 1 is indicated by the reference number 1203 in Figure 23. After the given context It is read
IMPI
Γ-MEXICAN INDUSTRIAL PROPERTY LINK from context memory 1004, a command code is transmitted to arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S1116).
When the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are respectively not 0 and 1, in other words, when both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are 1 , the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1117). In a case where the position of the differential coefficient of the processing target pos <= 4, the context index ctxldx used to decode the significant coefficient information is set to 2 (S1118). Otherwise (pos> 5), the ctxldx context index is set to 1 (S1114). The definition of the ctxldx context index of a case where both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are 1 is indicated by reference number 1204 in Figure 23. After the given context is read from context memory 1004, a decoding command is transmitted to arithmetic decoder 1001
<img file="MX339686B_D0078.tif" />
<img file="MX339686B_D0079.tif" />
IMPI INÍTITiVTO MEXICANO ^ rF iA PROPERTY
IN »USTR1AL
<img file="MX339686B_D0080.tif" />
along with the context. The arithmetic decoder 1QM ^ '' 'is a process of decoding a bit stream using the context, thus decoding the significant differential coefficient information (S1116).
In this sequence, for the calculation of the context index ctxldx for the significant differential coefficient information, reference is made to the significant sub-block information of the decoded neighboring sub-blocks and the position of the differential coefficient of the processing target in the sub-block, and the significant sub-block information on the right side and the significant sub-block information on the bottom side are determined individually. Hereinafter, the reason for using the configuration will be described.
In general, the orthogonal transformation coefficients of an image can be easily concentrated on the low region component, and there is a high possibility that the significant coefficient information is 1. Furthermore, because it is difficult for the high region component of the orthogonal transformation coefficient to receive a visual influence, the high region component is quantized in an approximate way in many cases, and consequently, there is a high possibility that the value the coefficient of the high region component is 0, and the significant coefficient information of the high region component is 0. The characteristic is not limited to the entire region of the differential coefficient but is the
IMPI
MBXiCANO INSTITUTE OR € LA FROPIEDAO
INDUSTRIAL
<img file="MX339686B_D0081.tif" />
same for each sub-block, and we can consider fH 'para'Tin component present in the low region side of the sub-block, a probability that the information of significant coefficient is 1 is greater than that for a component present in the side of the upper region of the same sub-block. Setting the ctxldx context index value of the significant differential coefficient information present in the low region in the sub-block to be greater than the ctxldx context index value of the significant differential coefficient information present in the high region entails to the improvement of the precision of the calculation of the probability of occurrence of the information of significant coefficient. Furthermore, the decoded neighbor significant sub-block information tends to be small in the high region where the probability that the significant differential coefficient is 0 is high, and the decoded neighbor significant sub-block information tends to increase in the region low where the probability that the significant differential coefficient is 1 is high. Thus, using decoded neighbor significant sub-block information as an index representing the degree of inclusion of the significant differential coefficient information in the sub-block to be processed improves the calculation precision of the probability of occurrence of the significant coefficient information.
In the process to compute the context of this example, in a case where the significant sub-block information of the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0082.tif" />
right side sigGroupRight is 1 and the information do ciub bluqu? bottom-side significant sigGroupBottom is 0 and in a case where the right-side sigGroupRight significant sub-block information is 0 and the bottom-side sigGroupBottom significant sub-block information is 1, mutually different contexts can be set, which is different from the first example. In a case where the sigGroupRight right-hand side significant sub-block information is 1 and the sigGroupBottom bottom-side significant sub-block information is 0, a differential coefficient is not present on the underside of the sub-block to be process, and consequently, there is a high possibility that a significant differential coefficient is not present in the high region component of the vertical direction in the sub-block to be processed. On the other hand, in a case where the significant sub-block information on the right side sigGroupRight is 0 and the significant sub-block information on the bottom side sigGroupBottom is 1, a significant differential coefficient is not present on the right side of the sub-block. block to be processed, and accordingly, there is a high possibility that a significant differential coefficient is not present in the high region component of the horizontal direction in the sub-block to be processed. Therefore, by employing the configuration of this example in which a context index is appropriately selected according to the probabilities of occurrence of
IMPI
MEXICAN INSTITUTE Οβ THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0083.tif" />
the significant differential coefficients in. laa'dii. ^ ccioncs vertical and horizontal, the precision of calculation of the probabilities of occurrence of significant differential coefficients can be improved.
Also, in this example, from the point of view of a decrease in the amount of processing, although the sub-block that is neighbor with the right side of the sub-block to be decoded and the sub-block that is neighbor with their underside being referred to as decoded neighboring sub-blocks, the decoded neighboring sub-blocks according to the present invention are not limited thereto. Particularly, the sub-block that is neighboring with the lower right side of the sub-block to be decoded is close to the sub-block to be decoded and has a high correlation with the sub-block to be decoded. Consequently, by adding the significant sub-block information sigGroupBottomRight of the sub-block that is next to the lower right side to the determination objective for the calculation of the context index ctxldx, the precision of the probability of occurrence of significant differential coefficients can be improved . However, compared to the sub-blocks that are neighboring with the right side of the sub-block to be decoded and the sub-block that is neighboring with its lower side, the sub-block that is neighboring with the lower right side the sub-block to be decoded is placed away from the sub-block to be decoded and has a low correlation
IMPI <ST'TUTO MEXICANO OE LA PROPIEDAD INDUSTRIAL
<img file="MX339686B_D0084.tif" />
with the sub-block to be decoded. In ^ Goaafifiiiencicben. the setting at which the context index of the significant differential coefficient is calculated based on the sigGroupRight right-side significant sub-block information, the sigGroupBottom bottom-side significant sub-block information, and the significant sub-block information sigGroupBottomRight, it is preferable to set the degree of reflection of the significant differential coefficient of the significant sub-block information sigGroupBottomRight in the context index so that it is less than that of the significant sub-block information sigGroupBottom and the significant sub-block information sigGroupBottomRight. As a method to fix the degree of reflection of the significant differential coefficient of the sigGroupBottomRight significant sub-block information in the context index that is going to be low, for example, in a case where both the significant sub-block information of the side lower sigGroupBottom as the sigGroupBottomRight significant sub-block information are 0, the probability of occurrence of the significant differential coefficient is set to be less regardless of the value of the sigGroupBottomRight significant sub-block information.
In this example, while the significant sub-block information on the right side sigGroupRight, the significant sub-block information on the bottom side sigGroupBottom, and the position of the coefficient of the processing target are
IMPI
MEXICAN INSTITUTE OF THE INDUSTRIAL POMOMAO
<img file="MX339686B_D0085.tif" />
referred, the differential coefficient that belongs to the sub-block of the processing objective is not achieved for the significant sub-block information on the right side sigGroupRight and significant sub-block information on the lower side sigGroupBottom, and consequently, there is no dependency on the sub-block for calculating the context indices. Because the context index for all significant differential coefficients can be calculated from the start of the sub-block, the calculation of the context index can be performed in parallel with the decoding process of the significant differential coefficient information. In this way, a processing delay related to the decoding of the significant coefficient information having a high frequency of occurrence in the bit stream can be decreased.
In this example, although the context index used to decode the significant differential coefficient information is calculated based on the significant differential coefficient information of the decoded sub-block, a similar sequence can be applied to the calculation of the context index of the value of the differential coefficient. Similar to the significant differential coefficient information, the value of the differential coefficient is correlated with the values of the neighboring coefficient and has a concentration in the low region component. Thus, setting a context index that
IMPI
MEXICAN INSTITUTE OE THE PROPERTY
INDUSTRIAL
<img file="MX339686B_D0086.tif" />
represents a high probability of occurrence of mn ττ-ιΐ nr g-ronHE »
I of differential coefficient when the sum of the neighboring significant differential coefficient or the sum of the absolute values of the neighboring differential coefficients is large and set a context index representing a high probability of occurrence of a small differential coefficient value when the sum of the neighbor significant differential coefficient or the sum of the absolute values of the neighboring differential coefficients is small, differential coefficient values can be encoded efficiently.
In accordance with the image encoding device and the image decoding device of the second example described above, the following operations and advantages were obtained in addition to the operations and advantages (1) to (4) of the first example described above.
(5) The context index is calculated based on a combination of the significant sub-block information on the right side and the significant sub-block information on the bottom side. The probability of occurrence of the significant differential coefficient of the vertical high region component of the sub-block to be processed is calculated to be low when a significant differential coefficient is not present on the underside of the sub-block to be processed. , and the probability of occurrence of the significant differential coefficient of the horizontal high region component of the
IMPI
MEXICAN INSTITUTE • AND INDUSTRIAL PROPERTY
<img file="MX339686B_D0087.tif" />
sub-block to be processed is calculated so that it is under cnanHn a significant differential coefficient is not present on the right side of the sub-block to be processed, therefore an appropriate probability model of the information can be fixed. of significant differential coefficient, and the information of significant differential coefficient can be encoded efficiently.
Third Example
A third example of the method for encoding differential information in accordance with an embodiment of the present invention will now be described. A differential information encoder 507 according to the third example, similarly to differential information encoder 507 according to the first example illustrated in Figure 15, includes: arithmetic encoder 701; a differential coefficient regulator 702; an encoding controller 703; a context memory 704; and a 705 scan controller. Furthermore, the encoding controller 703 includes: a encoding controller for the significant coefficient information 706; a differential coefficient value encoding controller 707; and to encoding driver information for significant sub-block 708.
The coding sequence of the differential information according to this example is the same as that of the first example except for the sequence (S704 illustrated in Figure 17) of the
IMPI
MfcXICANt INSTITUTE OF INDUSTRIAL EROEIEDAD
<img file="MX339686B_D0088.tif" />
encoding process of significant differential information, and hence, henceforth, the sequence of encoding process of significant differential coefficient information according to this example will be described with reference to the flow chart illustrated in Figure 24.
Sequence of the Significant Differential Coefficient Information Coding Process (S704)
The significant coefficient information encoding driver 706 calculates a sigCoeffIndex neighbor significant index based on the significant sub-block information of the decoded sub-blocks neighboring the right side and the bottom side of the sub-block to be processed. It is set in such a way that the significant sub-block information of the neighboring sub-block to the right side is sigGroupRight, the significant sub-block information of the neighboring sub-block to the bottom side is sigGroupBottom, and the neighbor significant index sigCoeffIndex = sigGroupRight + 2 x sigGroupBottom (S1201).
The significant coefficient information encoding controller 706 determines the differential coefficients that are the processing targets (S1202). The scanning sequence of the differential coefficients in the sub-block, similarly to the scanning sequence of the sub-blocks in the differential coefficient region, follows the
IMPI
<img file="MX339686B_D0089.tif" />
<img file="MX339686B_D0090.tif" />
rule represented in Figure 7. When all the significant differential coefficients of the sub-block were heard bobbing, the process of encoding the significant differential coefficients is completed, and the process continues to the coding sequence (S704) of the values of the differential coefficient.
The significant coefficient information encoding driver 706 evaluates the sigCoeffIndex neighbor significant index (S1203).
In a case where the sigCoeffIndex neighbor significant index is 0, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1204). In a case where the sigCoeffIndex neighbor significant index is 0, this represents that the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 0. Here, it is represented such that a horizontal position of the differential coefficient is posX, a vertical position of the differential coefficient is posY, and the position of the differential coefficient of the processing target is pos = posX + posY. In a case where pos <= 2, the ctxldx context index used to decode the significant coefficient information is set to 1 (S1205). Otherwise (pos> 2), the ctxldx context index is set to 0 (S1206). The definition of the ctxldx context index of a case where the neighbor significant index
IMPI
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX339686B_D0091.tif" />
sigCoeffIndex is 0 indicated by reference number 1201 in Figure 23.
On the other hand, in a case where the sigCoeffIndex neighbor significant index is not 0, it is determined if the sigCoeffIndex neighbor significant index is 1 (S1207). In a case where the neighbor significant index is 1, it represents the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0. In a case where the sigCoeffIndex neighbor significant index is 1, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S12 08). In a case where the vertical position of the differential coefficient posY <= 1, the context index ctxldx used to decode the significant coefficient information is set to 1 (S1209) Otherwise (posY> 2), the context index ctxldx is fixed at 0 (S1210). The definition of the ctxldx context index for a case where the sigCoeff Index neighbor significant index is 1 is indicated by the reference number 1202 in Figure 23.
On the other hand, in a case where the sigCoeffIndex neighbor significant index is not 1, it is determined if the sigCoeffIndex neighbor significant index is 2 (S1211). In a case where the sigCoeffIndex neighbor significant index is 2, it represents the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 1. In a case where the significant index
IMPI
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX339686B_D0092.tif" />
neighbor sigCoeffIndex is 2, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1212). In a case where the horizontal position of the differential coefficient posX <= 1, the context index ctxldx used to decode the significant coefficient information is set to 1 (S1213). Otherwise (posX> 2), the ctxldx context index is set to 0 (S1214). The definition of the ctxldx context index of a case where the sigCoeffIndex neighbor significant index is 2 is indicated by the reference number 1203 in Figure 23. In other words, the sequence of setting the ctxldx context index of a case where the index Significant neighbor sigCoeff Index is 2 is a process in which the process in the X direction and the process in the Y direction are exchanged in a case where the sigCoeffIndex neighbor significant index is 1. For this reason, the process can be configured to be common, and the hardware circuit scale or encoding amount can be reduced.
Also, in a case where the sigCoeffIndex neighbor significant index is not 2, in other words, in a case where the sigCoeffIndex neighbor significant index is 3, the position of the differential of the processing target in the sub-block to be determined is determined to process (S1215). In a case where the sigCoeff Index neighbor significant index is 3, it represents both the significant sigGroupRight sub-block information and the significant sub-block information
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL sigGroupBottom are 1. In a case where the processing target differential coefficient pus <= 4, the context index ctxldx used to decode the significant coefficient information is set to 2 (S1216). Otherwise (pos> 5), the ctxldx context index is set to 1 (S1217). The definition of the context index ctxldx of a case where the neighbor significant index is 3 is indicated by the reference number 1204 in Figure 23.
The significant coefficient information encoding controller 706 derives the differential coefficient from the position of the processing target of the differential coefficient regulator 702. In a case where the value of the differential coefficient is not 0, the significant differential coefficient information is set to 1. Otherwise (in a case where the value of the differential coefficient is 0), the significant differential coefficient information is set to (S1218).
After a context that corresponds to the given context index ctxldx is read from the context memory
704, the significant coefficient information encoding controller 706 transmits significant differential coefficient information and context to the arithmetic encoder
701. Arithmetic conditioner 701 encodes significant differential coefficient information using context (S1219).
IMPI
MEXICAN INSTITUTE OF PROPERTY
HOUSTRIAL
<img file="MX339686B_D0093.tif" />
Decoding Sequence
A method for decoding differential coefficients will be described in accordance with the third example of the embodiment of the present invention. Differential information decoder 801 according to the third example, similarly to differential information decoder 801 according to the first example illustrated in Figure 8, includes: an arithmetic decoder 1001; a differential coefficient regulator 1002; a decoding controller 1003; a context memory 1004; and a 1005 scan controller.
In addition, the bypass decoding controller 1003: a significant coefficient information decoding controller 1006; a decoding controller for the value of the differential coefficient 1007; and a significant sub-block information decoding controller 1008.
A differential information decoding process performed by the differential information decoder 801 illustrated in Figure 8 corresponds to the differential information encoding process performed by the differential information encoder 507 illustrated in Figure 5. Thus, the settings of the differential coefficient regulator 1002, the context memory 1004, and the scan controller
1005 of the differential information encoder illustrated in Figure 8 respectively have functions corresponding to the configurations of the differential coefficient regulator 702,
IMPI
INSTITUTO MEXICANO OE LA PROPIEDAD industrial
<img file="MX339686B_D0094.tif" />
the context memory 704, and the dropout controller 705. illustrated in Figure 15.
Because the decoding sequence of the differential information according to this example is the same as that of the first example except for the sequence (S203 illustrated in Figure 2) of the significant differential coefficient information encoding process, hereinafter , the sequence of the decoding process of the significant differential coefficient information according to this example will be described with reference to the flow chart illustrated in
Figure 25.
Sequence of the Decoding Process of the Significant Differential Coefficient Information (S203)
The significant coefficient information decoding driver 1006 calculates the sigCoeffIndex neighbor significant index based on the significant sub-block information of the neighboring decoded sub-blocks on the right and bottom side of the sub-block to be processed. It is set in such a way that the significant sub-block information of the neighbor sub-block to the right side is sigGroupRight, the significant sub-block information of the neighbor sub-block to the bottom side is sigGroupBottom, and the neighbor significant index sigCoeffIndex = sigGroupRight + 2 X sigGroupBottom (S1301).
The information decoding controller of
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0095.tif" />
significant coefficient 1006 determines the differential ratios that are the processing targets (S1302). The sequence of scanning the differential coefficients in the sub-block, similar to the sequence of scanning the sub-blocks in the region of the differential coefficient, follows the rule represented in Figure 7. When the scanning of all the significant differential coefficients of the sub-block is completed, the decoding process of the significant differential coefficients is completed, and the process continues to the decoding sequence (S204) of the differential coefficient values.
The significant coefficient information decoding driver 1006 evaluates the neighbor significant index sigCoeffIndex (S1303).
In a case where the sigCoeffIndex neighbor significant index is 0, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1304). In a case where the sigCoeffIndex neighbor significant index is 0, it represents that both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are 0. Here, it is represented such that a horizontal position of the differential coefficient is posX, a vertical position of the differential coefficient is posY, and the position of the differential coefficient of the processing target is pos = posX + posY.
ΜΡΙ '' Ο Ό MEXICAN r '.A CURRENCY *
INDUSTRIAL
<img file="MX339686B_D0096.tif" />
In a case where pos <= 2, the context index ntxTdx.iiated to decode the significant coefficient information is set to 1 (S1305). Otherwise (pos> 2), the ctxldx context index is set to 0 (S1306). The definition of the ctxldx context index of a case where the sigCoeffIndex neighbor significant index is 0 is indicated by the reference number 1201 in Figure 2 3. After the determined context is read from context memory 1004, a decoding command is transmitted to arithmetic decoder 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S1316).
On the other hand, in a case where the sigCoeffIndex neighbor significant index is not 0, it is determined if the sigCoeffIndex neighbor significant index is 1 (S1307). In a case where the sigCoeffIndex neighbor significant index is 1, it represents the sigGroupRight significant sub-block information is 1 and the sigGroupBottom significant sub-block information is 0. In a case where the sigCoeffIndex neighbor significant index is 1, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1308). In a case where the vertical position of the differential coefficient posY <= 1, the context index ctxldx used to decode the information from
IMPI 'MEXICAN INSTITUTE OF INDUSTRIAL FROFIEDAD
<img file="MX339686B_D0097.tif" />
significant coefficient is fixed at 1 (S1309). nontraT-in (posY> 2), the ctxldx context index is set to 0 (S1310). The definition of the context of a case where the neighbor significant index sigCoeffIndex is 1 is indicated by the reference number 1202 in Figure 23. After the determined context is read from context memory 1004, a decoding command is transmitted to the decoder arithmetic 1001 along with the context. The arithmetic decoder 1001 performs a process of decoding a bitstream stream using the context, thereby decoding the significant differential coefficient information (S1316).
On the other hand, in a case where the sigCoeffIndex neighbor significant index is not 1, it is determined if the sigCoeffIndex neighbor significant index is 2 (S1311). In a case where the sigCoeffIndex neighbor significant index is 2, it represents the sigGroupRight significant sub-block information is 0 and the sigGroupBottom significant sub-block information is 1. In a case where the sigCoeffIndex neighbor significant index is 2, the position of the differential coefficient of the processing target in the sub-block to be processed is determined (S1312). In a case where the horizontal position of the differential coefficient posX <= 1, the context index ctxldx used to decode the significant coefficient information is set to 1 (S1313). Otherwise (posX> 2), the ctxldx context index is set to 0
<img file="MX339686B_D0098.tif" />
<img file="MX339686B_D0099.tif" />
(S1314). The definition of the context index c LXI llx efe<sup>1</sup> Uíl ^ Cátru where the sigCoeffIndex neighbor significant index is 2 is indicated by the reference number 1203 in Figure 23.
<td>After the</td><td>given context is read</td><td>of</td><td>the memory</td><td>of</td>
<td>context 1004,</td><td>a decoding command</td><td>is</td><td>transmitted</td><td>to the</td>
<td>decoder</td><td>arithmetic 1001 along with</td><td>the</td><td>context.</td><td>The</td>
<td>decoder</td><td>arithmetic 1001 performs</td><td>a</td><td>process</td><td>of</td>
decoding a bitstream using the context, thereby decoding the significant differential coefficient information (S1316).
Also, in a case where the sigCoeff Index neighbor significant index is not 2, in other words, in a case where the sigCoeffIndex neighbor significant index is 3, the position of the differential coefficient of the processing target in the sub-block to be determined is determined. going to process (S1317). In a case where the sigCoeff Index neighbor significant index is 3, it represents that both the sigGroupRight significant sub-block information and the sigGroupBottom significant sub-block information are 1. In a case where the position of the differential coefficient of the processing target pos <= 4, the ctxldx context index used to decode the significant coefficient information is set to 2 (S1318). Otherwise (pos> 5), the ctxldx context index is set to 1 (S1314). The definition of the context index ctxldx of a case where the neighbor significant index sigCoeffIndex is 3 is indicated by the reference number 1204 an, 1st Figure 23
IMPI
INSTITUT · MEXICANO Of THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0100.tif" />
<td>After the</td><td>given context is read</td><td>of</td><td>the memory</td><td>of</td>
<td>context 1004,</td><td>a decoding command</td><td>is</td><td>transmitted</td><td>to the</td>
<td>decoder</td><td>arithmetic 1001 along with</td><td>the</td><td>context.</td><td>The</td>
<td>decoder</td><td>arithmetic 1001 performs</td><td>a</td><td>process</td><td>of</td>
decoding a bitstream using the context, thereby decoding the significant differential coefficient information (S1316).
In this example, in the sequence to compute the context index ctxldx of the significant differential coefficient information, instead of referring directly to the sigGroupRight significant sub-block information of the right-hand neighbor sub-block and the sub-block information. significant sigGroupBottom block of the neighboring sub-block to the bottom side, After the sigCoeffIndex neighbor significant index is calculated based on the sigGroupRight and sigGroupBottom significant sub-block information, the ctxldx context index is calculated by referencing the sigCoeffIndex neighbor significant index, which is different from the first example. Consequently, the number of times to perform the context index related determination process can be reduced based on the neighbor significant index sigCoeffIndex.
According to the image encoding device and image decoding device of the third example described above, the following operations and advantages are
IMPI
MEXICAN INSTITUTE OE LA MOHEDA »INDUSTRIAL
<img file="MX339686B_D0101.tif" />
In addition to the operations, they obtain operations and sell it; raa (1) to · (4) of the first example and the operations and advantages (5) of the second example previously described.
(6) After the sigCoeffIndex neighbor significant index is calculated based on the sigGroupRight significant sub-block information of the right-hand neighbor sub-block and the sigGroupBottom significant sub-block information of the lower side neighbor sub-block, the context index is calculated based on the neighbor significant index sigCoeff Index. Compared to a method in which the context index is calculated based on the sigGroupRight significant sub-block information of the neighbor sub-block on the right side and the significant sigGroupBottom sub-block information of the neighbor sub-block on the right side , you can reduce the number of times to perform the determination process related to the calculation of context indices.
A bitstream of an image that is produced by the image encoding device in accordance with the embodiment described above has a specific data format so that it can be decoded according to an encoding method used in the embodiment, and the image decoding device corresponding to the image coding device can decode the bit stream of the specific data format.
In a case where a wired or wireless network is used
IMPI
MEXICAN INSTITUTE Say industrial PROPERTY
<img file="MX339686B_D0102.tif" />
To exchange a stream of fefiLs between the image encoding device and the image decoding device, the bitstream can be converted into a data format that is appropriate for the one-way transmission form. communication and can be transmitted. In this case, an image transmission device is available, which converts a bit stream leaving the image encoding device into encoding data of a data format that is appropriate for the form of transmission in the communication path and transmits the converted encoding data to the network, and there is an image receiving device, which receives the encoding data from the network, restores the bitstream of the encoding data, and supplies the restored bitstream to the image decoding device.
The image transmission device includes: a memory that regulates an output bitstream for the image encoding device; a packet processing unit that packages the bit stream; and a transmitter that transmits the packaged encoding data over a network. The image receiving device includes: a receiving unit that receives the packaged encoding data over a network; a memory that regulates the encoding data received; and a unit of
100
IMPI
INSTITUTO MEXICANO ot LA RRONEOAP INDUSTRIAL
<img file="MX339686B_D0103.tif" />
packet processing that builds a stream of 'ΡΙΐίΤδ' of 'bits by performing a process of packaging the encoding data and supplying the built-in bitstream to the image decoding device.
The process related to encoding and decoding described above can be performed not only by a transmit / store / receive device using hardware but also by firmware stored in a read-only memory (ROM), a flash memory, or the like or software from a computer or the like. The firmware or software program may be provided by recording to a recording medium that is readable by a computer or the like, may be provided from a server over a wired or wireless network, or may be provided by broadcasting the ground wave data or digital satellite broadcasting.
As mentioned above, the present invention has been described based on the embodiments. However, the embodiments are merely examples, and it is understood by one skilled in the art that various modifications may be made to each constituent element thereof or a combination of each process sequence, and the modified examples further belong to the scope of the present invention. .
[Item 1]
An image encoding device that divides
101
IMPI
Mexican Institute of Industrial Property
<img file="MX339686B_D0104.tif" />
Differential information between an image that tJü'un ubj-otivo gives encoding and an image that is a prediction image in a plurality of sub-blocks and encode the divided sub-blocks in a predetermined sequence, the image encoding device comprises:
a significant sub-block information encoder that encodes significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
a significant differential coefficient information encoder that encodes significant differential coefficient information representing whether the value of the differential coefficient is zero or not;
a differential coefficient value encoder that encodes the value of the differential coefficient; and a context wrapper that derives an index based on the significant sub-block information of an encoded sub-block that is adjacent to the sub-block that is a horizontal direction encoding target and the significant sub-block information of a coded sub-block that is adjacent in the vertical direction and derives a context used to encode the significant differential coefficient information from the differential coefficient that is a target of encoding based on the index and position of the differential coefficient that is the encoding target in the sub-block
102
IMPI
Mexican Institute of Industrial Property
<img file="MX339686B_D0105.tif" />
which is the coding target.
[Item 2]
The image coding device according to claim 1, wherein the context wrapper derives the mutually different indices in case where a significant sub-block information of the coded sub-block that is adjacent in the horizontal direction is 1 and the significant sub-block information of the coded secondary block that is adjacent to the vertical direction is 0 and in a case where the significant sub-block information of the coded sub-block that is adjacent to the horizontal direction is 0 and the information of significant sub-block of the coded sub-block that is adjacent in the vertical direction is 1. [Item 3]
The image coding device according to claim 1, wherein the context wrapper derives the mutually different indices in a case where the significant sub-block information of the coded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the coded sub-block that is adjacent to the vertical direction is 0 and in a case where the significant sub-block information of the coded sub-block that is adjacent to the horizontal direction is 1 and the information of significant sub-block of the coded sub-block that is adjacent in the vertical direction is 1.
103
<img file="MX339686B_D0106.tif" />
INeWrOJOMSMlfcA .. Industrial Industrial RRORIEiJA [Item 4] —The image encoding device according to claim 1, wherein the context wrapper derives mutually different indices in a case where the significant sub-block information of the encoded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the coded sub-block that is adjacent to the vertical direction is 0, in a case where the significant sub-block information of the coded sub-block that is adjacent in the horizontal direction is 1 and the significant sub-block information of the coded sub-block that is adjacent in the vertical direction is 0, in a case where the significant sub-block information of the coded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the coded sub-block that is adjacent in the vertical direction is 1, and in a case where the significant sub-block information of the coded sub-block that is adjacent in the horizontal direction is 1 and the significant sub-block information of the coded sub-block that is adjacent in the vertical direction is 1.
[Item 5]
The image encoding device according to any one of items 1 to 4, wherein the context wrapper, in a case where significant sub-block information
104
ΜΡΙ
TITUTO MEXICANO ȣ THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0107.tif" />
of the coded sub-block that is adjacent eTí Id 'horizontal · direction is 1 and the significant sub-block information of the coded secondary block that is neighboring in the vertical direction is 0, derives the context based on the position of the differential coefficient, which is the coding target, in the vertical direction in the sub-block that is the coding target.
[Item 6]
The image encoding device according to any one of items 1 to 5, wherein the context wrapper, in a case where the significant sub-block information of the encoded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the encoded secondary block that is adjacent in the vertical direction is 1, derives the context based on the position of the differential coefficient, which is the encoding target, in the horizontal direction in the sub-block that is the encoding target.
[Item 7]
The image encoding device according to any one of items 1 to 6, wherein the context wrapper, in a case where both of the significant sub-block information of the encoded sub-block is adjacent in the horizontal direction and the significant sub-block information of the encoded child block that is adjacent in the address
<img file="MX339686B_D0108.tif" />
s
105
<img file="MX339686B_D0109.tif" />
vertical are 1, sets the context cbnü3 “TUl valui<sup>1</sup> predetermined regardless of the position of the differential coefficient that is the encoding target in the sub-block that is the encoding target.
[Item 8]
The image encoding device according to any one of items 1 to 7, wherein the context wrapper, in a case where both, the significant sub-block information of the encoded sub-block that is adjacent in the horizontal direction and the significant sub-block information of the coded sub-block that is adjacent in the vertical direction is 0, derives the context based on an equation that adds the positions of the differential coefficient, which is the coding target, in the horizontal and vertical directions in the sub-block that is the coding target.
[Item 9]
The image encoding device according to any one of items 1 to 8, wherein the context wrapper derives the index based on a computation equation that adds a significant sub-block information value of the encoded sub-block that is adjacent in the horizontal direction to a value derived by duplication of the significant sub-block information from the encoded sub-block that is adjacent in the vertical direction.
106
IMPI
MEXICAN INSTITUTE OE INDUSTRIAL PROPERTY
<img file="MX339686B_D0110.tif" />
[Item 10]
An image coding method in which the differential information between an image that is a coding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are coded into one By default sequence, the image encoding method comprises:
encode significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
encode significant differential coefficient information representing whether the value of the differential coefficient is zero or not;
encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is adjacent to the sub-block which is a horizontal direction encoding target and the significant sub-block information of a sub-block encoded that is adjacent in the vertical direction and that derives a context used to encode the significant differential coefficient information from the differential coefficient that is an index-based encoding target and the position of the differential coefficient that is the coding target in the sub-block that is the coding target.
107
IMPI
MUtICANO INSTITUTE Of. THE PROPERTY
INDUSTRIAL
<img file="MX339686B_D0111.tif" />
[Item 11] i
An image encoding program in which the differential information between an image that is an encoding target and an image that is a prediction target is divided into a plurality of sub-blocks and the divided sub-blocks are encoded in a sequence By default, the image encoding program causes a computer to perform:
encoding of significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
encode meaningful differential coefficient information that represents whether the value of the differential coefficient is zero or not;
encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is adjacent to the sub-block that is a horizontal direction encoding target and the significant sub-block information of a sub-block encoding that is adjacent in the vertical direction and deriving a context used to encode the significant differential coefficient information from the differential coefficient that is the objective of index-based encoding and the position of the differential coefficient that is the coding target in the sub-block that is the coding target.
108
IMPI • mstituto mexicanc
OE INDUSTRIAL PROPERTY
<img file="MX339686B_D0112.tif" />
[Item 12]
A transmission device comprising:
a packet processing unit that obtains encoding data by packetizing a bit stream that is encoded by using an image encoding method in which differential information between an image that is an encoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence; and a transmitter that transmits the packaged encoding data, wherein the image encoding method comprises: encoding significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
encode significant differential coefficient information representing whether the value of the differential coefficient is zero or not;
encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is adjacent to the sub-block that is a horizontal direction encoding target and the significant sub-block information of a sub-block coded that is adjacent to the vertical direction
109
<img file="MX339686B_D0113.tif" />
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY and deriving a context used to encode F'l'S TlifUl lilac búnde significant differential coefficient of the differential coefficient that is a coding target based on the index and position of the differential coefficient that is the coding target in the sub-block that is the encoding target.
[Item 13]
A transmission method, comprising:
obtain encoding data by making packets of an ios bitstream that is encoded by an image encoding method in which the differential information between an image that is an encoding target and an image that is a prediction target is divided in a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence; and transmitting the packaged encoding data, wherein the image encoding method comprises: encoding significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
encode significant differential coefficient information representing whether the value of the differential coefficient is zero or not;
encode the value of the differential coefficient; and derive an index based on the significant sub-block information of an encoded sub-block that is adjacent to the
110
IMPI
INSTITUTO MEXICANO DI La PHOPIEHAI)
INDUSTRIAL
<img file="MX339686B_D0114.tif" />
sub-block which is a target of rnitifiraniiSn ρπ the horizontal direction and significant sub-block information of an encoded sub-block that is adjacent in the vertical direction and derive a context used to encode the significant differential coefficient information of the differential coefficient which is a coding target based on the index and the position of the differential coefficient which is the coding target in the sub-block which is the target of coding.
[Item 14]
A streaming program that causes a computer to:
obtain encoding data by packing a bitstream that is encoded by the use of an image encoding method in which the differential information between an image that is an encoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence; and transmit the packaged encoding data; wherein the image encoding method comprises: encoding significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
encode meaningful differential coefficient information that represents whether the value of the coefficient
111
IMPI
IC'υΤΟ MEXICAN INDUSTRIAL PROPERTY
<img file="MX339686B_D0115.tif" />
differential is zero or not;
encode the value of the differential coefficient; and deriving an index based on the significant sub-block information of an encoded sub-block that is adjacent to the sub-block that is a horizontal direction encoding target and the significant sub-block information of a sub-block encoded that is adjacent in the vertical direction and derive a context used to encode the differential differential coefficient information that is a target of index-based encoding and the position of the differential coefficient that is the coding target in the sub-block that is the coding target.
[Item 15]
An image decoding device that decodes a bit stream in which the differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the sub- divided blocks are encoded in a predetermined sequence, the image decoding device comprises:
decoding of significant sub-block information that decodes significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
a differential coefficient information decoder
112
ΙΜΡΙ
MEXICAN INSTITUTE PE INDUSTRIAL PROPERTY
<img file="MX339686B_D0116.tif" />
significant that decodes significant differential coefficient information that represents whether the value of the differential coefficient is zero or not;
a differential coefficient value decoder that decodes the differential coefficient value; and a context wrapper that derives an index based on the significant sub-block information of a decoded sub-block that is adjacent to the sub-block that is a decoding target in the horizontal direction and the significant sub-block information of a decoded sub-block that is adjacent in the vertical direction and derives a context used to decode the significant differential coefficient information from the differential coefficient which is a decoding target based on the index and position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
[Ineiso 16]
The image decoding device according to claim 15, wherein the context wrapper derives the mutually different indices in a case where the significant sub-block information of the decoded sub-block that is adjacent to the horizontal direction is 1 and the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction is 0 and
113
IMPI
INSTITUTO MEXICANO DE LA PRCPIEI.au industrial
<img file="MX339686B_D0117.tif" />
in a case where the sub-block information 'SlgiilfitaLi' is from the decoded sub-block that is adjacent to the horizontal direction is 0 and the significant sub-block information from the decoded sub-block that is adjacent to the vertical direction is 1.
[Item 17]
The image decoding device according to claim 15, wherein the context wrapper derives the mutually different indices in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction is 0 and in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 1 and the information of significant sub-block of the decoded sub-block that is adjacent in the vertical direction is 1.
[Item 18]
The image decoding device according to claim 15, wherein the context wrapper derives the mutually different indices in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the sub-block
114
IMPI
INSTITUT · MEXICANO • t LA MONEDAD INDUSTRIAL
<img file="MX339686B_D0118.tif" />
decoded that is adjacent in the direction VéVtl'dSl '55'Ό; ·' in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 1 and the sub-block information significant of the decoded sub-block that is adjacent to the vertical direction is 0, in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the decoded sub-block that is adjacent to the vertical direction is 1 and in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 1 and the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction is 1.
[Item 19]
The image decoding device according to any one of items 15 to 18, wherein the context wrapper, in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 1 and the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction is 0, derives the context based on the position of the differential coefficient, which is the decoding target, in the vertical direction in the sub-block that is the decoding target.
115
IMPI
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX339686B_D0119.tif" />
[Item 2 0] '——
The image decoding device according to any one of items 15 to 19, wherein the context wrapper, in a case where the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction is 0 and the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction is 1, derives the context based on the position of the differential coefficient, which is the decoding target, in the horizontal direction in the sub-block that is the decoding target.
[Item 21]
The image decoding device according to any one of items 15 to 20, wherein the context wrapper, in a case where both, the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction and the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction is 1, sets the context as a default value regardless of the position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
[Inci so 22]
The image decoding device according to any one of items 15 to 21, wherein the context wrapper,
116
ΙΜΡΙ
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0120.tif" />
in a case where both the significant sub-block information of the decoded sub-block that is adjacent in the horizontal direction as well as the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction are 0, derived the context based on an equation that adds the positions of the differential coefficient, which is the decoding objective, in the horizontal and vertical directions in the sub-block that is the decoding target.
[Item 23]
The image decoding device according to any one of items 15 to 22, wherein the context wrapper derives the index based on a computation equation that adds a significant sub-block information value of the decoded sub-block that is adjacent in the horizontal direction to a derived value by duplicating the significant sub-block information of the decoded sub-block that is adjacent in the vertical direction.
[Item 24]
An image decoding method that decodes a bit stream in which differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the sub- divided blocks are encoded in a predetermined sequence, the image decoding method
117
IMPI
MEXICAN INSTITUTE OF LA MIOME DAD
INDUSTRIAL
<img file="MX339686B_D0121.tif" />
It comprises: ~ decoding significant sub-block information that represents whether all the values of the differential coefficients that belong to the sub-block are zero or not;
decode meaningful differential coefficient information that represents whether the value of the differential coefficient is zero or not;
decode the value of the differential coefficient; and deriving an index based on the significant sub-block information of a decoded sub-block that is adjacent to the sub-block that is a decoding target in the horizontal direction and significant sub-block information of a decoded sub-block which is adjacent in the vertical direction and which derives a context used to decode the significant differential coefficient information from the differential coefficient which is a decoding target based on the index and the position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
[Item 25]
An image decoding program that decodes a bit stream in which the differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the sub- divided blocks are coded into a
118
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0122.tif" />
By default, the image decoding program causes a computer to perform:
decoding of significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not;
decode meaningful differential coefficient information that represents whether the value of the differential coefficient is zero or not;
decode the value of the differential coefficient; and deriving an index based on the significant sub-block information of a decoded sub-block that is adjacent to the sub-block that is a decoding target in the horizontal direction and the significant sub-block information of a sub-block neighboring decoding in the vertical direction and deriving a context used to decode the significant differential coefficient information from the differential coefficient which is the index based decoding target and the position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
[Item 26]
A receiving device that receives a bit stream in which a moving image is encoded and decoding the received bit stream, the receiving device comprises:
119
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0123.tif" />
a receiving unit that receives datudits obtained by packing a bit stream in which the differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence;
a restore unit that restores the bit stream by performing packet processing of the received packaged encoding data;
a significant sub-block information decoder that decodes significant sub-block information representing whether all the values of the differential coefficients belonging to the sub-block are zero or not, from the restored bit stream;
a significant differential coefficient information decoder decoding significant differential coefficient information representing whether or not the value of the differential coefficient is from the restored bit stream;
a differential coefficient value decoder that decodes the differential coefficient value from the restored bit stream; and a context wrapper that derives an index based on the significant sub-block information of a decoded sub-block that is adjacent to the target sub-block
120
IMPI
MEXICAN INSTITUTE Say THE INDUSTRIAL PROPERTY
<img file="MX339686B_D0124.tif" />
of decoding in the horizontal direction and the significant sub-block dS information of a decoded sub-block that is adjacent in the vertical direction and deriving a context used to decode the significant differential coefficient information from the differential coefficient that is a decoding target based on the index and position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
[Item 27]
A receiving method, for receiving a bit stream in which a moving picture is encoded and decoding the received bit stream, the receiving method comprises:
receiving encoding data obtained by packing a bitstream in which the differential information between an image that is a decoding target and an image that is a prediction target is divided into a plurality of sub-blocks, and the sub-blocks split are encoded in a predetermined sequence, restoring the bitstream by performing packet processing of the received packaged encoding data;
decode significant sub-block information representing whether all values of the differential coefficients belonging to the sub-block are zero or not from the restored bit stream;
121
IMPI
MEXICAN INSTITUTE OE INDUSTRIAL PROPERTY
<img file="MX339686B_D0125.tif" />
decode meaningful differential coefficient information representing whether or not the value of the differential coefficient is from the restored bit stream;
decode the value of the differential coefficient from the restored bit stream; and deriving an index based on the significant sub-block information of a decoded sub-block that is adjacent to the sub-block that is a decoding target in the horizontal direction and the significant sub-block information of a sub-block decoded that is adjacent in the vertical direction and derive a context used to decode the significant differential coefficient information from the differential coefficient that is the decoding target based on the index and the position of the differential coefficient that is the decoding target in the sub-block that is the decoding target.
[Item 28]
A receiving program, for receiving a bit stream in which a moving image is encoded and decoding the received bit stream, the receiving program causes a computer to perform:
receiving encoding data obtained by packing a bitstream in which the differential information between an image that is a decoding target and an image that is
122
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0126.tif" />
is a prediction target divided into ηη «<sup>,,,</sup>ρίτιτ'Αΐ · 'ϊιΐΛύ of sub-blocks, and the divided sub-blocks are encoded in a predetermined sequence;
restore the bitstream by performing packet processing of the received packaged encoding data;
decode significant sub-block information representing whether all values of the differential coefficients belonging to the sub-block are zero or not from the restored bit stream;
decode meaningful differential coefficient information representing whether or not the value of the differential coefficient is from the restored bit stream;
decode the value of the differential coefficient from the restored bit stream; and deriving an index based on the significant sub-block information of a decoded sub-block that is adjacent to the sub-block that is a decoding target in the horizontal direction and the significant sub-block information of a sub-block decoded that is adjacent in the vertical direction and derive a context used to decode the significant differential coefficient information from the differential coefficient that is a decoding target based on the index and the position of the differential coefficient which is the decoding target in the sub-block which is the target of
123
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX339686B_D0127.tif" />
decoding. ..........
REFERENCE NUMBERS
501 Subtractor, 502 Orthogonal Transformer / Quantizer, 503 Inverse Quantizer / Inverse Transformer, 504 Adder, 505 Decoded Image Memory, 506 Predictor, 507 Differential Information Encoder, 508 Prediction Information Encoder, 509 Arithmetic Encoder, 702 differential coefficient regulator, 703 encoding controller, 704 context memory, 705 scanning controller, 706 significant coefficient information encoding controller, 707 differential coefficient value encoding controller, 708 significant sub-block information encoding controller, 801 differential information decoder, 802 inverse quantizer / inverse transformer, 803 prediction information decoder , 804 adder, 805 decoded image memory, 806 predictor, 1001 arithmetic decoder, 1002 differential coefficient regulator, 1003 decoding controller,
1004 context memory, 1005 scan driver, 1006 significant coefficient information decoding driver, 1007 differential coefficient value decoding driver, and 1008 significant sub-block information decoding driver.
INDUSTRIAL APPLICABILITY
The present invention can be used for a technology
124
IMPI
MSXICAN INSTITUTE OF THE INDUSTRIAL NOMSDAO
<img file="MX339686B_D0128.tif" />
image encoding / decoding. '<sup>1</sup> *
It is noted that in relation to this date, the best method known by the applicant to put the aforementioned invention into practice, is the one that is clear from the present description of the invention.
125
1ΡΙ '> MEXICAN <sup>J</sup>A »Foot» AD NDUSTRIAL
<img file="MX339686B_D0129.tif" />
Contents173
154 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117 Sheet 118 Sheet 119 Sheet 120 Sheet 121 Sheet 122 Sheet 123 Sheet 124 Sheet 125 Sheet 126 Sheet 127 Sheet 128 Sheet 129 Sheet 130 Sheet 131 Sheet 132 Sheet 133 Sheet 134 Sheet 135 Sheet 136 Sheet 137 Sheet 138 Sheet 139 Sheet 140 Sheet 141 Sheet 142 Sheet 143 Sheet 144 Sheet 145 Sheet 146 Sheet 147 Sheet 148 Sheet 149 Sheet 150 Sheet 151 Sheet 152 Sheet 153 Sheet 154
136 members in 23 offices
Priority claims14
| Document | Office | Kind | Date |
|---|---|---|---|
| 2012092077 | Japan | – | |
| 2012092078 | Japan | – | |
| 2012092077 | Japan | A | |
| 2012092077 | Japan | A | |
| 2012092078 | Japan | A | |
| 2012092078 | Japan | A | |
| 2013002514 | Japan | W | |
| 2013002514 | Japan | W | |
| 2012092077 | – | – | – |
| 2012092078 | – | – | – |
| JP20120092077 | – | – | – |
| JP20120092078 | – | – | – |
| PCTJP2013002514 | – | – | – |
| WO2013JP02514 | – | – | – |
Members136
| Document | Office | Kind | |
|---|---|---|---|
| CA2869637A1 | Canada | A1 | |
| CA2960604A1 | Canada | A1 | |
| CA3114391A1 | Canada | A1 | |
| CA3191369A1 | Canada | A1 | |
| CA3191379A1 | Canada | A1 | |
| WO2013153824A1 | World Intellectual Property Organization (WIPO) | A1 | |
| JP2013223029A | Japan | A | |
| JP2013223030A | Japan | A | |
| TW201401883A | Taiwan Province of China | A | |
| AU2013247974A1 | Australia | A1 | |
| SG11201405947YA | Singapore | A | |
| PH12014502137A1 | Philippines | A1 | |
| PH12014502137B1 | Philippines | B1 | |
| CN104247419A | China | A | |
| US2015010077A1 | United States of America | A1 | |
| AU2013247974A2 | Australia | A2 | |
| CL2014002748A1 | Chile | A1 | |
| EP2838260A1 | European Patent Office (EPO) | A1 | |
| PE20150373A1 | Peru | A1 | |
| JP5696683B2 | Japan | B2 | |
| JP5696684B2 | Japan | B2 | |
| MX2014012155A | Mexico | A | |
| SG10201505293UA | Singapore | A | |
| EP2838260A4 | European Patent Office (EPO) | A4 | |
| CN105187830A | China | A | |
| CN105187843A | China | A | |
| CN105245906A | China | A | |
| CN105245907A | China | A | |
| AU2013247974B2 | Australia | B2 | |
| MX339686BThis record | Mexico | B | |
| RU2014145618A | Russian Federation | A | |
| AU2016210589A1 | Australia | A1 | |
| TWI566581B | Taiwan Province of China | B | |
| TW201705763A | Taiwan Province of China | A | |
| CN105187830B | China | B | |
| MX346521B | Mexico | B | |
| CN105245906B | China | B | |
| CN105245907B | China | B | |
| US9615109B2 | United States of America | B2 | |
| CA2869637C | Canada | C | |
| US2017163991A1 | United States of America | A1 | |
| CN104247419B | China | B | |
| TWI592010B | Taiwan Province of China | B | |
| US9706211B2 | United States of America | B2 | |
| MY162891A | Malaysia | A | |
| MY162892A | Malaysia | A | |
| CN107087202A | China | A | |
| AU2016210589B2 | Australia | B2 | |
| TW201733354A | Taiwan Province of China | A | |
| US2017272762A1 | United States of America | A1 | |
| US2017272763A1 | United States of America | A1 | |
| US2017272764A1 | United States of America | A1 | |
| RU2633175C2 | Russian Federation | C2 | |
| AU2017245338A1 | Australia | A1 | |
| US9872029B2 | United States of America | B2 | |
| US9872030B2 | United States of America | B2 | |
| US9872031B2 | United States of America | B2 | |
| PH12017500788A1 | Philippines | A1 | |
| PH12017500788B1 | Philippines | B1 | |
| PH12017500789A1 | Philippines | A1 | |
| PH12017500789B1 | Philippines | B1 | |
| PH12017500790A1 | Philippines | A1 | |
| PH12017500790B1 | Philippines | B1 | |
| PH12017500791A1 | Philippines | A1 | |
| PH12017500791B1 | Philippines | B1 | |
| TWI613908B | Taiwan Province of China | B | |
| TW201811039A | Taiwan Province of China | A | |
| RU2633175C9 | Russian Federation | C9 | |
| CN105187843B | China | B | |
| MY166213A | Malaysia | A | |
| SG10201806313VA | Singapore | A | |
| RU2668399C1 | Russian Federation | C1 | |
| AU2017245338B2 | Australia | B2 | |
| TWI642296B | Taiwan Province of China | B | |
| AU2019200733A1 | Australia | A1 | |
| TW201909634A | Taiwan Province of China | A | |
| MX363851B | Mexico | B | |
| EP2838260B1 | European Patent Office (EPO) | B1 | |
| RU2689808C1 | Russian Federation | C1 | |
| RU2668399C9 | Russian Federation | C9 | |
| TWI666917B | Taiwan Province of China | B | |
| DK2838260T3 | Denmark | T3 | |
| TR2019008450T4 | Türkiye | T4 | |
| TR201908450T4 | Türkiye | T4 | |
| EP3515077A1 | European Patent Office (EPO) | A1 | |
| EP3515078A1 | European Patent Office (EPO) | A1 | |
| EP3515079A1 | European Patent Office (EPO) | A1 | |
| EP3515080A1 | European Patent Office (EPO) | A1 | |
| MX2019003952A | Mexico | A | |
| SI2838260T1 | Slovenia | T1 | |
| PE20191435A1 | Peru | A1 | |
| HUE044347T2 | Hungary | T2 | |
| PL2838260T3 | Poland | T3 | |
| RU2689808C9 | Russian Federation | C9 | |
| RU2705650C1 | Russian Federation | C1 | |
| ES2733057T3 | Spain | T3 | |
| BR112014023933B1 | Brazil | B1 | |
| AU2019200733B2 | Australia | B2 | |
| RU2713848C1 | Russian Federation | C1 | |
| CN107087202B | China | B |
1 legal event, as the office reported them to INPADOC
Events
| Event | Code | |
|---|---|---|
| Grant or registrationFG | FG |
Numbers
- Publication
- 339686
- Publication, DOCDB
- 339686
- Publication, EPODOC
- MX339686
- Application
- 2014012155
- Application, DOCDB
- 2014012155
- Application, EPODOC
- MX20140012155
Titles
- Spanish
- DISPOSITIVO DE CODIFICACION DE IMAGEN, METODO DE CODIFICACION DE IMAGEN, Y PROGRAMA DE CODIFICACION DE IMAGEN Y DISPOSITIVO DE DECODIFICACION DE IMAGEN, METODO DE DECODIFICACION DE IMAGEN Y PROGRAMA DE DECODIFICACION DE IMAGEN.
Classification
- CPC, 10
- H04N19/176
- H04N19/70
- H04N19/13
- H04N19/18
- H04N19/137
- H04N19/593
- H04N19/44
- H04N19/46
- H04N19/91
- G06T9/40
- IPC, 4
- H04N19 593
- H04N19 159
- H04N19 44
- H04N19 50