MX336094B

Image decoding device, image encoding device, and method thereof.

Abstract

In the present invention, a reversible decoding unit (52) extracts, from stream information, difference information indicating the difference with respect to a predicted quantization parameter selected from selection candidates, the selection candidates being quantization parameters of a decoded block spatially or temporally adjacent to a block to be decoded. A quantization parameter calculation unit (59) calculates a quantization parameter of the block to be decoded from the difference information and the predicted quantization parameter. As a result, it is possible to correctly decode an image by calculating a quantization parameter equivalent to the quantization parameter used during image encoding.

MX336094B, drawing sheet 1 — Sheet 1 of 193

Term

6.8 yearsleft in the term

Expires 17 July 2033.

10 claims: 4 independent, 6 dependent

1
CLAIMS REIVINDICACIONES 1. Un método de comprende:one. One method of comprises: codificación de imágenes^ image encoding ^ Industrie establecer, cuando un bloque adyacente a la izquierda de un bloque actual y un bloque adyacente por encima de bloque actual son referenciables, un parámetro de predicción de cuantificación derivado de un valor medio de un parámetro de cuantificación de bloque adyacente a la izquierda Industrie set, when a block adjacent to the left of a current block and an adjacent block above the current block are referable, a quantization prediction parameter derived from a mean value of a quantum parameter of block adjacent to the left el parámetro de predicción de cuantificación derivado de un parámetro de cuantificación de una unidad de procesamiento no adyacente al bloque actual;the quantization prediction parameter derived from a quantization parameter of a processing unit not adjacent to the current block;generar una información de diferencia que indica una diferencia entre el parámetro de cuantificación de predicción establecido y un parámetro de cuantificación del bloque actual;y generar información de flujo incluyendo datos de cuantificación codificados, codificados utilizando el parámetro de cuantificación del bloque actual y la información de diferencia. generating a difference information indicating a difference between the set prediction quantization parameter and a quantization parameter of the current block;and generating flow information including encoded quantization data, encoded using the current block quantization parameter and difference information.
2
The image encoding method of the 2. El método de codificación de imágenes de la 137 vindication 137 reivindicación 1, izquierda y el referenciables, un en donde cuando el bloque adyacente a l^ntfftUtO Mexicano nodeltfPftP,edad Industrial un bloque bloque adyacente anterior parámetro de cuantificación de anterior se deriva para establecer el parámetro de predicción de cuantificación. 1, left and the referable, a where when the block adjacent to the Mexican ^ ntfftUtO notdeltfPftP,age Industrial a block block adjacent previous quantization parameter from previous is derived to set the quantization prediction parameter.
3
3. El método de codificación de imágenes de la reivindicación The image encoding method of the claim 1, en donde el bloque es una unidad de codificación, y la unidad de codificación tiene una estructura jerárquica definida por una profundidad jerárquica. 1, where the block is a coding unit, and the coding unit has a hierarchical structure defined by a hierarchical depth.
6
An information processing apparatus, comprising:6. Un aparato de procesamiento de información, que comprende: a circuit configured to set, when an adjacent block to the left of a current block and an adjacent block above the current block are un circuito configurado para establecer, cuando un bloque adyacente a la izquierda de un bloque actual y un bloque adyacente por encima del bloque actual son 138 derived from a mean value of a parameter of of the adjacent block to the left and a 138 derivado de un valor medio de un parámetro de de del bloque adyacente a la izquierda y una Institute quantifies ^ ááSeanc d® the Property parameter quantification of the adjacent block above;Instituto cuantifica^ááSeanc d® la Propiedad parámetro cuantificación del bloque adyacente arriba;establecer, cuando el bloque adyacente a la izquierda y el bloque adyacente arriba no son referenciables, el parámetro de predicción de cuantificación derivado de un parámetro de cuantificación de una unidad de procesamiento no adyacente al bloque actual;setting, when the block on the left and the block on the top are not referenceable, the quantization prediction parameter derived from a quantization parameter of a processing unit not adjacent to the current block;generar una información de diferencia que indica una diferencia entre el parámetro de cuantificación de predicción establecido y un parámetro de cuantificación del bloque actual;y generar información de flujo incluyendo datos de cuantificación codificados, codificados utilizando el parámetro de cuantificación del bloque actual y la información de diferencia. generating a difference information indicating a difference between the set prediction quantization parameter and a quantization parameter of the current block;and generating flow information including encoded quantization data, encoded using the current block quantization parameter and difference information.

Independent claims4

1,047 paragraphs in 12 sections, as filed

(54) Title: IMAGE DECODING DEVICE, IMAGE CODING DEVICE, AND THEIR METHOD.

(54) Title: IMAGE DECODING DEVICE, IMAGE ENCODING DEVICE, AND METHOD THEREOF.

(57) Summary

In the present invention, a reversible decoding unit (52) extracts, from the flow information, the difference information indicating the difference from a predicted quantization parameter selected from the selection candidates, the candidates selection being quantization parameters of a spatially or temporarily decoded block adjacent to a block to be decoded. A quantization parameter calculation unit 59 calculates a quantization parameter of the block to be decoded from the difference information and the predicted quantization parameter. As a consequence, it is possible to correctly decode an image by calculating a quantization parameter equivalent to the quantization parameter used during image encoding.

(57) Abstract

Institute

Mexican Property

Industrial ___SE___

MCRCTíWÍA fX KOSOMÍA

IVI P

I

PATENT TITLE NO. 336094

<td>Headlines):</td><td>SONY CORPORATION</td>

<td>Home:</td><td>1-7-1 Konan, Minato-ku, Tokyo, JAPAN</td>

<td>Denomination:</td><td>IMAGE DECODING DEVICE, IMAGE CODING DEVICE, AND THEIR METHOD.</td>

<td>Classification:</td><td>lnt.CI.8: H04N19 / 50</td>

Internal filing date

Agency: Twenty years :miss Vene usient 12 of ustrial.

Law of

III and 7® bis 2 of the> and the

Federation (DOF) 06/27/1991,: Industrial Property Law (DOF 12/14/19:

luien subscribes to the present title * * ce based on Industrial suitability (Official Journal of MMMMMMMMRoi / 2006, from January 2012 to Patent Number: 327499

PRIORITY

Date:

January July July

2011-011861 2011-153183 a reference patent s <ítorgacor undamento ^ ne conformance with artl ilo 23 of I

Milestone from the date of the performance of the rights.

V, 6® fraction I patent

994, 10/25/1996, 12/26/1997, 11 15/1999, * --------- - iction V

-------------------—-----—--- -------—---——.................

subsection a), 4th and 12th sections I and III of the Regulation of the Mexican Institute of Industrial Property (DOF 12/14/1999, amended on 07/01/2002, 07/15/2004, 07/28/2004 and 09/07/2007); Articles 1, 3, 4®, 5 'section V subsection a), 16 sections I and III and 30 of the Organic Statute of the Mexican Institute of Industrial Property (DOF 12/27/1999, amended on 10/10/2002, 07/29/2004, 08/04/2004 and 09/13/2007); 1, 3, and 5, subsection a) of the Agreement that delegates powers to the Deputy Directors General, Coordinator, Divisional Directors, Holders of the Regional Offices, Divisional Deputy Directors, Departmental Coordinators and other subordinates of the Mexican Institute of Industrial Property. (DOF 12/15/1999, amended on 02/04/2000, 07/29/2004, 08/04/2004 and 09/13/2007),

Issue Date: January 8, 2016

Arenal No. 550. Floor 1, Oo !. Pueblo Santa María Tepepan,

Xochimilco Delegation,

CP 16020, Mexico .. DF

Tea!. (55) 53 34 07 00 www.impi qob.mx

IMAGE DECODING DEVICE, DEVICE \

CODING OF IMAGES, AND THEIR METHOD

TECHNICAL FIELD

The present technology relates to an image decoding device, an image coding device, and a method thereof. More particularly, the encoding efficiency of the quantization parameters is improved.

BACKGROUND OF THE TECHNIQUE

In recent years, the use of devices that handle image information such as digital has become widespread in order to carry out highly effective information transmission and storage at that time, for example, compatible with formats such as MPEG or similar to compress the image by orthogonal transformation such as discrete cosine transformation or the like and motion compensation, both in broadcasting and in general homes.

In particular, MPEG2 (ISO / IEC 13818-2) is defined as a general-purpose image encoding format, and has now been widely used by a wide range of applications for professional use and for consumer use. Using the MPEG2 compression format, a code quantity (bit rate) of 4 to 8 is assigned

Mbps in the case of a scan image, enter the resolution so it has a standard 720 x 480 pixels, for example. r,'«» C can high compression and a bus be achieved ^^^ dd • ftaustria?

image quality. Also, an amount of code (bit rate) of 18 to 22 Mbps is assigned in the case of a high resolution interlaced scan image that has

1920 x

1088 pixels, so high compression and good image quality can be achieved.

In addition, standardization has been carried out as the Enhanced Compression Video Coding Joint Model, which achieves greater coding efficiency although a greater amount of computation is required for its coding and decoding, and has become an international Standard. called H.264 and MPEG-4 Part 10 (hereafter written as H.264 / AVC (Advanced Video Coding)).

With this MPEG and H.264 / AVC, when quantifying

<td>macroblocks,</td><td>the</td><td>size</td><td>of</td><td>the</td><td colspan="2">quantification stages</td><td>I know</td>

<td>You can change</td><td>of</td><td>mode</td><td>than</td><td>the</td><td>speed of</td><td>compression</td><td>be</td>

<td colspan="2">constant. further</td><td>, with</td><td>the</td><td>MPEG</td><td>, are used</td><td>parameters</td><td>of</td>

Quantization proportional to the quantization steps, and with H.264 / AVC, quantization parameters are used where the parameter value increases by 6 when the quantization step is doubled. In MPEG and H.264 / AVC, the quantization parameters are encoded (see LDP 1).

List of Mentions

Patent Literature ¡fíSfíh: '·,' tefíCCJr-LDP 1: Publication of Patent Application JapowifiPíOpj @ $.: . Examined No. 2006-094081.

BRIEF DESCRIPTION OF THE INVENTION

Technical problem

Now, with the encoding processing of the quantization parameters, in the case that the decoding order is in the frame scan order as illustrated in Figure 1, for example, a SliceQPY quantization parameter with an initial value it is used for the main macroblock of the slice. Subsequently, the processing is performed in the decoding order indicated by the arrows, and the quantization parameters of this macroblock are updated by the difference value in the quantization parameters as regards the macroblock on the left side (mb_qp_delta ). Consequently, there are cases where, when the decoding order transitions from the block on the right edge to the block on the left edge, the difference value becomes large because the image is different, and the encoding efficiency becomes poor. . Furthermore, the coding efficiency becomes poor in case the difference value as regards the macroblock on the left side is also large.

Instituto λ · *** í [ij

Additionally, with compression technology

HEVC (Video Image Coding, Standardization for High Efficiency) is being studied which achieves IfítíBstrlQl coding efficiency even higher than the format

H.264 / AVC.

With this HEVC, the basic units called encoding extension units (CU: Coding Unit) which are of the macroblock concept. In the case that each block illustrated in Figure 2 is an encoding unit, the decoding order is the order of the blocks with numbers that increment sequentially from 0. In the case where the decoding order is not the frame scan order in this way, moving from block 7 to block 8, for example, or from block 15 to block 16, can conceivably lead to a higher difference value due to that the spatial distance is great.

Consequently, it is an object of the present technology to improve the coding efficiency of the quantization parameters.

Solution to the problem

A first aspect of this technology is an image decoding device, which includes:

a unit for acquiring parameters of spatially or information configured to take the quantizations of blocks temporarily adjacent to a decode, such as selection candidates, block decodes to be and extract, to

from the flow information, the difference that «ristítuto parameter quantification prediction from the selection candidates; and a quantization parameter calculation unit configured to calculate, from the prediction quantization parameter and the difference information, a quantization parameter of the block to be decoded.

With this technology, the difference information indicating the difference in terms of a prediction quantization parameter selected from selection candidates, what are the quantization parameters of spatially decoded blocks temporarily adjacent to a block to be decoded, it is extracted from the flow information.

Furthermore, with the image decoding device, blocks where the quantization parameters are at least redundant or blocks where inverse quantization is not performed using the quantization parameters are excluded from the ^ 20 quantization parameters of spatially decoded blocks or temporarily adjacent to the block to be decoded, and the selection candidates are taken. For setting the prediction quantization parameter, a quantization parameter is selected in an order 25 indicated by the identification information included in the

alternatively, with the adjacent information blocks in a predetermined order, the Mexican determination of selection candidates is made in a previously established order, and the prediction quantification parameter is established based on the result of the determination. Alternatively, one or the other of the processing is selected to set the prediction quantization parameter an quantization parameter in an order indicated by the identification information included in the stream information, and the processing of determining the selection candidates in an order established in advance and establish the prediction quantization parameter, based on the result of the determination included in the flow information.

Additionally, with the image decoding device, a quantization parameter of the block to be

of an initial value in a slice is taken as the prediction quantization parameter. In addition, it is also done to include a quantification parameter updated to the latest in the selection candidates.

A second aspect of this technology is an image decoding method,

J institute decodes <^ §XICQno aeta Block property to the quantization parameters of blocks spatially or temporarily adjacent to a decode, as selection candidates, and extract, from the flow information, the difference information that indicates the difference regarding a parameter of prediction quantification selected from selection candidates; and a process of calculating, from the prediction quantization parameter and the difference information, a quantization parameter of the block to be decoded.

A third aspect of the present technology is an image coding device, which includes: a control unit configured to establish a quantization parameter as regards a block to be encoded; an information generation unit configured to take the quantization parameters of spatially or temporarily coded blocks adjacent to

a block to be encoded, as selection candidates, select from the selection candidates a prediction quantization parameter according to the established quantization parameter, and generate difference information indicating the difference between the prediction quantization parameter and established quantification parameters; and a coding unit

With this technology, at least the blocks where the quantization parameters are redundant or the blocks where quantization is not performed using the quantization parameters are excluded from the quantization parameters of blocks spatially or temporarily adjacent to the block to be encoded, and selection candidates are taken. In addition, a quantification parameter updated to the last or similar is also included in the selection candidates. A quantization parameter of which the difference in terms of the quantization parameter established from these selection candidates is the smallest, is selected as the prediction quantization parameter, and the identifying information is generated to select the parameter quantification prediction from the 4 * 0 selection candidates. For example, the identification information is the order of the blocks corresponding to the selected quantization parameter, with the adjacent coded blocks in a predetermined order. Also, the default array is an array order where priority is given to 25 one of an encoded block adjacent to the left side, a

adjacent coded block above, and a coded block

Temporarily adjacent institute. Furthermore, the order of the arrangement of adjacent coded blocks can be switched. Additionally, lofrj $ ugtríCf · quantization parameters of temporarily adjacent coded blocks can be reordered according to the parameter values, in the order of the selected quantization parameters that are taken as the identification information. In addition, the determination of the selection candidates can be performed in a pre-established order, with the prediction quantization parameter being selected based on the result of the determination. Additionally, with the image coding device, the difference information is generated indicating the difference between the prediction quantization parameter and the established quantization parameter. Furthermore, in the case that there is no selection candidate, the difference information is generated indicating the difference between a quantization parameter of an initial value in a slice, and the established quantization parameters ^ 20. Furthermore, a selection can be made between the processing of setting a quantization parameter of which the difference in regard to the set quantization parameter is as small as the prediction quantization parameter, and the processing of performing the determination of the selection candidates in a

order established in advance and select stop prediction quantification based on the determination result, and the information of

Institute

Mancan ©

indicates the selected processing. The difference information generated, the identification information, and the determination information are included in the flow information generated by performing the encoding processing of the block to be encoded using the established quantization parameter.

A fourth aspect of this technology is an image encoding method, which includes: a process of setting a quantization parameter in terms of a block to be encoded; a process of taking the quantization parameters of spatially or temporarily coded blocks adjacent to a block to be encoded, as selection candidates, selecting from the selection candidates a prediction quantization parameter according to the established quantization parameter, and generating the difference information indicating ^ 20 the difference between the prediction quantization parameter and the established quantization parameters; and a process of including the difference information in the flow information generated by performing the encoding processing of the block to be encoded, using the established quantization parameter.

Advantageous Effects of the Invention

According to this technology, quantification of blocks temporarily adjacent to a as selection candidates, prediction selection is selected in accordance with coded block to be _ „ TO .Institute the parameters. - de Ια Spatial property| n§us) l) 0 |! encoded are taken and a parameter of from the quantization candidate quantization parameter set for the block to be encoded.

The indicates the difference between the prediction quantization parameter and the quantization parameters established with respect to the block to be encoded is generated. Consequently, the difference in the quantization parameters can be prevented from becoming a large value, and the coding efficiency of the quantization parameters can be improved.

Furthermore, in a case of decoding the stream information where the difference information is included, a quantum parameter ifi prediction ion is selected from the quantization parameters of spatially or temporarily decoded blocks adjacent to a block to be decoded , and a quantization parameter of the block to be decoded is calculated prediction quantization parameter and the difference. Consequently, even in the case information that the flow information is generated with coding efficiency

of improved quantification parameters, the parameters ^ j ^. ^. ..,,Ί , Felssno quantification can be restored based on prediction quantification and difference information w of decoding this stream information, and the decoding processing can be done correctly.

BRIEF DESCRIPTION OF THE DRAWINGS [Figure 1] Figure 1 is a diagram illustrating a case where the decoding order is the scan order per frame.

[Figure 2] Figure 2 is a diagram illustrating a case where the decoding order is not the frame scan order.

[Figure 3] Figure 3 is a diagram illustrating a configuration of an image coding device.

[Figure 4] Figure 4 is a diagram illustrating a configuration of an information generating unit.

[Figure 5] Figure 5 is a diagram illustrating exemplary hierarchical structure of a coding unit.

^ 0 [Figure 6] Figure 6 is a flow chart illustrating the operations of an image coding device.

[Figure 7] Figure 7 is a flowchart illustrating prediction processing.

[Figure 8] Figure 8 is a flow chart that

illustrates prediction processing [Figure 9] Figure 9 is an illustrates intra prediction processing.

institute flow chart

Inter. MlWcri [Figure 10]

Figure 10 is a diagram to describe the operations of an information generation unit.

[Figure 11] Figure 11 is a diagram illustrating exemplary operations of an information generation unit.

[Figure 12] Figure 12 is a flowchart illustrating the processing relating to the quantization parameters in the encoding.

[Figure 13] Figure 13 is a diagram illustratively illustrating a set of sequence parameters.

[Figure 14] Figure 14 is a flowchart illustrating frame coding processing.

<td>[Figure</td><td> 15]</td><td>The figure</td><td>15 is a diagram that</td><td>illustrates</td>

<td>eg emplarmente</td><td>a</td><td>set of</td><td>frame parameters.</td><td></td>

<td>[Figure</td><td> 16]</td><td>The figure</td><td>16 is a diagram that</td><td>illustrates</td>

<td>eg emplarmente</td><td>a</td><td colspan="2">slice heading.</td><td></td>

<td>[Figure</td><td> 17]</td><td>The figure</td><td colspan="2">17 is a flow chart that</td>

illustrates the encoding processing of the slice.

[Figure 18] Figure 18 is a diagram illustrating the configuration of an image decoding device.

[Figure 19] Figure 19 is a diagram illustrating the configuration of the quantum parameter calculation unit if i falls i on.

Institute

Macano ti® Property [Figure 20] Figure 20 is a flow chart thatEU illustrates the operations of an image decoding device.

[Figure

21] The Figure is a flowchart illustrating prediction image generation processing.

[Figure illustrates the

22] Figure quantization processing in [Figure 23] describe other decoding of is a reference decoding.

Figure 23 is imaging operations.

[Figure 24] Figure 24 is an example of operation in a case of a flowchart to the flowchart parameters for a device diagram illustrating implicitly predicting of the quantization parameters.

[Figure 25]

Figure 25 is an example of a case flow chart of implicitly predicting quantization parameters.

[Figure 26]

Figure 26 illustrates another example of operation in a case of implicitly predicting the quantization parameters.

eg use a program.

[Figure

28]

Figure 28 is a flow chart for [Figure

27]

Figure 27 is a diagram illustrating

describe other operations of an image decoding device.

[Figure 29] Figure 29 is a diagram illustrating a schematic configuration of a computer device.

[Figure 30] Figure 30 is a diagram illustrating a schematic configuration of a television receiver.

[Figure 31] Figure 31 is a diagram illustrating a schematic configuration of a cell phone.

[Figure 32] Figure 32 is a diagram illustrating a schematic configuration of a record / playback device.

[Figure 33] Figure 33 is a diagram illustrating a schematic configuration of an imaging apparatus.

DESCRIPTION OF THE MODALITIES

Hereinafter, the embodiments of the present invention will be described. Note that the description will proceed in the following order.

one. Configuration of the Image Coding Device

2. Operation of the Image Coding Device

3. Operation of Generation of Identification Information and Difference Information based on the Quantification Parameters

Four. Configuration of the Image Decoding Device

5. Operation of the Image Decoding Device

Others

Images and

of of

Case of

Institute

Operations of the Coding Device d ^ ® $ Cdno a® fe Ffepi®ctacf of the Image Decoding Device Industrie ··

Software Processing

Application to Electronic Equipment

Configuration of the Image Coding Device

Figure image encoding illustrates a configuration of an imaging device. He includes a

Analog / Digital (A / D conversion unit 11 device unit 10), encoding conversion a screen rearrange buffer or buffer 12, a subtraction unit 13, an orthogonal transformation unit 14, a quantization unit 15, a 16 loss unit, a storage buffer 17, speed control. Additionally, the encoding and an image encoding device unit 18 without including an inverse quantization unit 21, an inverse orthogonal transformation unit, an addition unit, an unlock filter 24, a frame memory 26, a selector 26, an intra prediction unit 31, a motion prediction / compensation unit 32, and an optimization / prediction image selection unit 33.

The A / D conversion unit 11 performs the conversion of analog image signals to digital image data and 25 outputs these to buffer rearrangement 12.

Institute

The screen rearrangement buffer 12 performs the rearrangement ^^^ gd ks Property of the tables in terms of the image data | n £ | usfr | a | provided as output from A / D conversion unit 11. The screen rearrangement buffer 12 performs the rearrangement of the frames according to a GOP (Frame Group) structure regarding encoding processing, and outputs the image data after the rearrangement to the subtraction unit 13, the unit.

18 speed control unit, intra prediction unit 31, and motion prediction / compensation unit 32.

The image data provided as output from the screen rearrangement buffer 12 and the predicted image data selected in the prediction / optimal mode image selection unit 33 described below are supplied to the subtraction unit 13. The subtraction unit 13 calculates the prediction error data which is a difference between the image data provided as output from the screen rearrangement buffer 12 and the ^ 20 prediction image data supplied from the unit 33 of optimal mode / prediction image selection, and outputs these to the orthogonal transformation unit 14.

The orthogonal transformation unit 14 performs the orthogonal transformation processing such as the transformation

Discrete of the similar, in discrete of the cosine (DCT:

Institute

Cosine), the Karhunen-Lqéve Macano transformation <fo the Error Property <felUStrta!

as regards the prediction data provided as the subtraction output. Unit 14 provides as output transformation obtained orthogonal transformation to the data from the transformation of the unit 15 of

Data from the unit coefficient 13 orthogonal coefficient of quantization processing.

The transformation provided as output from the orthogonal transformation unit 14 and the quantization parameter (quantization scale) of an information generation unit 19 described below are supplied to the quantization unit. The quantization unit 15 performs the quantization of the transformation coefficient data and outputs the quantized data to the lossless encoding unit 16 and the reverse quantization unit 21. Furthermore, the quantization unit 15 changes the bit rate of the quantized data ^ 20 based on the quantization parameters set in the speed control unit 18.

The quantized data provided as output from the quantization unit 15, the identification information and the difference information from the information generation unit 19 25 described below, the intra prediction mode information, and the vector information unit prediction ^^ O ^ information of the mode of prediction of difference motion and similal ^^ j

of the motion prediction / compensation unit 32, are supplied to the lossless encoding unit 16.

Furthermore, the information indicating whether the optimal mode is the intra prediction or the Inter se prediction of the optimal image selection unit 33. Note that the information from the supply from prediction / prediction mode mode includes the prediction mode and the block size information from the prediction unit according to whether it is intra prediction

The encoding unit 16 encoding processing without refers to the like encoding, for quantized data, motion, etc., or the inter prediction.

lossless loss in for example variable length, encoding generate flow information as output this case that the loss over encoding mode performs what is being used arithmetic, or and provides storage buffer 17.

optimal is the intra prediction, without losses it performs the information of the

In addition, in unit 16 the prediction-free coding supplied from intra-prediction unit 31.

Furthermore, in the event that the optimal mode is inter prediction, the lossless encoding unit 16 performs lossless encoding on the information of the mode of

motion difference yinstltUfO from unit n Industrial movement. Additionally, the prediction and similar vectors supplied to prediction / offset of

lossless encoding unit 16 performs lossless encoding of information relating to quantization parameters, such as difference information for example. Lossless encoding unit 16 includes the information after lossless encoding in the stream information.

The storage buffer 17 stores an encoded stream from the lossless encoding unit 16.

In addition, the storage buffer 17 provides the stored encoded stream as an output with a transmission rate in accordance with the transmission path.

The speed control unit 18 monitors an available capacity of the storage buffer 17, and sets the quantization parameters such that, in the case of low available capacity, the bit rate of the 20 quantized data drops, and in the case that there is sufficient capacity, the bit rate of the quantized data is increased. In addition, the speed control unit 18 detects the complexity of the image, such as the activity which is the information indicating the variance of the 25 pixel values, for example, using the image data.

supplied from M®x! oano screen rearrangement buffer 12

Speed control unit 18 parameters ^ * - * * _ η i Ί ... industry!

quantization such that raw quantization is performed for image portions where the variance value of the pixels is low and fine quantization is performed for other portions, for example, based on the results of detecting image complexity . The speed control unit 18 provides as output the quantization parameters that have been established for the information generation unit 19.

The information generation unit 19 provides as output the quantization parameters supplied from the speed control unit 18 to the quantization unit 15. The information generation unit 19 also takes the quantization parameters of blocks spatially or temporarily adjacent to a block to be encoded as selection candidates. The information generation unit 19 selects a quantization parameter from the selection candidates of ^ 20 in accordance with the quantization parameter established in the speed control unit 18, and takes it as a prediction quantization parameter. Additionally, the information generation unit 19 generates the identification information corresponding to the selected quantization parameters, that is, the identification information quantification selection, prediction difference

: '.AÁ £ Ϊ &.

ii · S tf parameterá *0* Has institute prediction from the candidates and not the Musida Property?

to select between the difference information that indicates the quantification parameters and the established quantification parameters.

Figure 4 illustrates a configuration of the information generation unit. Information unit 19 has quantification

The generating unit 19 of a memory unit 191 and a computing unit 192 the difference parameters.

Information generation provides as output to the quantization unit 15 the quantization parameters supplied from the speed control unit 18. In addition, the information generation unit 19 supplies the quantization parameters 15 supplied from the speed control unit 18 to the quantization parameter memory unit 191 and the difference computation unit 192.

The quantization parameter memory unit 191 stores the supplied quantization parameters ^ 20. The difference computing unit 192 reads, from the quantization parameters of the encoded blocks stored in the quantization parameter memory unit 191, the quantization parameters of encoded blocks at the spatial or temporal periphery of the block to be coded, as selection candidates. Also, at least the blocks where the parameters are redundant, and the blocks where no quantization using the quant parameters.

institute performs d® h Pfopi®dad quant ification HChiSM · '

<td>just like</td><td>b1oque s where</td><td>the</td><td>data</td><td>of the</td><td colspan="2">coefficient</td><td>of</td><td>the</td>

<td>5 transformation</td><td colspan="3">to be quantified</td><td>in</td><td>the</td><td>Unit</td><td> 15</td><td>of</td>

<td>quantification</td><td>it's all 0</td><td>by</td><td colspan="2">example,</td><td>I know</td><td>exclude</td><td>of</td><td>the</td>

selection candidates. In addition, the difference computation unit 192 excludes from the selection candidates the blocks (hereafter referred to as jump blocks) with respect to which determination has been made to perform the jump processing based on the unit information. Motion prediction / compensation 32 described below and optimal mode / prediction image selection unit 33.

The difference computation unit 192 selects a quantization parameter from the quantization parameters, in accordance with the quantization parameter of the block to be encoded, i.e. the quantization parameter supplied from the unit ^ 20 18 speed control, as a prediction quantization parameter. The difference computation unit 192 additionally generates the difference information

<td>which indicates</td><td>the difference between</td><td>the</td><td>information</td><td>of</td>

<td>ID</td><td>to select</td><td>the</td><td>parameters</td><td>of</td>

<td>25 quantification</td><td>prediction from</td><td>of</td><td>The candidates</td><td>of</td>

selection and an encoded parameter, and provides lossless encoding.

As output this to the unit d 16 efe Τα Property

Industrie '!'

Returning to Figure 3, the inverse quantization unit 21 performs the inverse quantization processing of the quantized data supplied from the quantization unit 15. The inverse quantization unit 21 outputs the transformation coefficient data obtained by performing the inverse quantization processing to the inverse orthogonal transformation unit 22.

The inverse orthogonal transformation unit 22 performs the inverse transformation processing of the transformation coefficient data supplied from the inverse quantization unit 21, and outputs the data obtained to the addition unit 23.

The addition unit 23 adds the data supplied from the inverse orthogonal transformation unit 22 and the predicted image data supplied from the ^ 20 optimal mode / prediction image selection unit 33 to generate decoded image data , and provides output to the unlock filter 24 and frame memory 26. Note that the decoded image data is used as image data of the reference image.

The unlocking filter 24 performs the processing of

Filtered to decrease the distortion of the block that moment of the image coding. The 24 MfedSOTO filter gives ία Unlock Property performs filtering processing to remove ^ fftgygjtfg'j the block distortion of the decoded image data supplied from the add unit 23, and outputs the decoded image data after the filtering processing in frame memory 26.

The frame memory 26 retains the decoded image data after filtering processing supplied from the unlock filter 24. The decoded image retained in frame memory 26 is supplied to the motion prediction / compensation unit 32 as reference image data.

The intra prediction unit 31 performs the prediction in the intra prediction processing of all intra candidate prediction modes, using the input image data of the image to be encoded, supplied from the screen rearrangement buffer 12 and the reference image data supplied from the addition unit 23, and determines an intra-optimal prediction mode. Intra prediction unit 31 calculates a cost function value for each intra prediction mode for example, and takes the intra prediction mode where the coding efficiency is best, based on the calculated cost function value, as prediction mode intra prediction provides prediction generated in the intra optimal.

As output the im & i ^ É3Gno data d © la Pr © pl © dad prediction mode intra optáBdyfW *?

and the value of the cost function of the intra-optimal prediction mode, to the unit of prediction image selection / optimal mode. Additionally, the intra prediction unit 31 outputs the prediction mode information indicating the intra prediction mode to the lossless encoding unit 16.

The motion compensation / prediction unit 32 performs the prediction in all inter-candidate prediction modes, using the input image data of the image to be encoded, supplied from the screen rearrangement buffer 12, and the reference image 15 supplied from frame memory 26, and decides the inter-optimal prediction mode. The motion prediction / compensation unit 32 calculates a value of the cost function in each inter prediction mode for example, and takes the inter prediction mode where the coding efficiency is best, based on the value of the function cost calculation, as the inter-optimal prediction mode. The motion prediction / compensation unit 32 outputs the prediction image data generated in the inter-optimal prediction mode and the cost function value of the inter-prediction mode as output.

optimal, to the 33rd image selection unit of Substitute

Mexican prediction / optimal mode. Additionally, the motion prediction / compensation unit outputs the prediction mode information regarding the inter-optimal prediction mode to the lossless encoding unit 16 and the information generating unit 19.

Optimal mode / prediction image selection unit 33 compares the cost function value supplied from intra prediction unit 31 to the cost function value supplied from motion prediction / compensation unit 32 , and select the one of which the cost function value is less than the other as the optimal mode where the coding efficiency will be better. Furthermore, the optimal mode / prediction image selection unit 33 provides the optimally generated prediction image data to the subtraction unit and addition unit 23 as output. Additionally, the optimal mode / prediction image selection unit 33 provides as an output the information indicating whether the optimal mode 20 is the intra prediction mode or the inter prediction mode to the lossless encoding unit 16 and to unit 19 generation of information. Note that the optimal mode / prediction image selection unit performs the switching of the intra prediction or the Inter prediction in 25 slice increments.

2. Coding Device Operation

With the encoding device the encoding processing is done with macroblock extended beyond that with the format

H.264 / AVC, for example. Figure 5 exemplary illustrates the hierarchical structure of the encoding units. Note that Figure 5 illustrates a case where the maximum size is 128 pixels x 128 pixels, and the hierarchical depth (Depth) is 5. For example, in the case that the 10 hierarchical depth is 0, a 2N x 2N block (N = 64 pixels) is the CUO unit of encoding. Furthermore, when the division indication = 1, the encoding CUO unit is divided into four independent N x N blocks, with the N x N blocks being blocks of a lower hierarchical level. That is, 15 the hierarchical depth is 1, and the 2N x 2N blocks (N = 32 pixels) are the CU1 encoding unit. In the same way, when the division indication = 1, it is divided into four independent blocks. Additionally, when depth is 4 which is the deepest hierarchical level ^ 20, the blocks 2N x 2N (N = 4 pixels) are the unit

CU4 encoding, and 8 pixels x 8 pixels is the smallest size for CU encoding units. Furthermore, with

HEVC, the prediction unit (PU: Unit of

Prediction) which is a basic unit for the division of the encoding and prediction units, and the transformation unit (TU: basic unit for the

Transformation Unit) which is transformation and quantification ^ J® nduslrfci?

Next, the operations of the image encoding device will be described with reference to the flow chart in Figure 6. In step ST11, the A / D conversion unit performs A / D conversion on the

<td>signs</td><td>of</td><td>input image.</td><td></td><td></td><td></td>

<td>In</td><td>the</td><td>step ST12, the buffer</td><td> 12</td><td>rearrangement</td><td>of screen</td>

<td>makes</td><td>the</td><td>image rearrangement.</td><td>The</td><td>buffer 12 from</td><td>rearrangement of</td>

Screen stores the image data supplied from A / D conversion unit 11 and rearranges an order to display the frames in an order for encoding.

In step ST13, the subtraction unit 13 generates the prediction error data. The subtraction unit 13 calculates the difference between the image data of the rearranged images in step ST12 and the selected prediction image data in the image selection unit 33.

<td>image</td><td>of</td><td>prediction / optimal mode</td><td colspan="2">To generate</td><td>the</td><td>data</td><td>of</td>

<td>20 error</td><td>of</td><td>prediction. The amount</td><td>of data</td><td>of</td><td>the</td><td>data</td><td>of</td>

<td>error</td><td>of</td><td>prediction is less than</td><td>that</td><td>of</td><td>the</td><td>data</td><td>of</td>

original image. Accordingly, the amount of data can be compressed compared to a case where the image is encoded as is.

In step ST14, the transformation unit 14

orthogonal performs the processing of

orthogonal. The unit 14 of orthogonal transformation on the prediction error data supplied from the subtraction unit 13. Specifically, the orthogonal transformation such as the discrete cosine transformation, the transformation

Karhunen-Loéve, and the like are performed for the prediction error data to provide the coefficient of transformation data as output.

In step ST15, the quantization unit 15 performs the quantization processing. The quantization unit 15 quantizes the data of the transformation coefficient. Speed control is performed at the time of quantization, as illustrated in the further processing described in step ST25.

Inverse quantization unit 21 performs inverse quantization processing in step ST16. The inverse quantization unit 21 performs the inverse quantization on the transformation coefficient data 20 quantized by the quantization unit 15 with properties corresponding to the properties of the quantization unit 15.

In step ST17, the inverse orthogonal transformation unit 22 performs inverse orthogonal transformation processing 25. Unit 22 orthogonal transformation

inverse performs the inverse orthogonal transformation on 1 data of the coefficient of the transformation undergone:

inverse quantization by unit 21 inverse quantization with properties corresponding to the properties of unit 14 orthogonal transformation.

In step ST18, the addition unit 23 generates the reference image data. The addition unit adds the prediction image data supplied from the optimal mode / prediction image selection unit 33 and the data after the inverse orthogonal transformation of the corresponding position for this prediction image to generate decoded data (Data of

In step ST19, the filter 24 filter processing. The reference image filter).

Unlock performs the unlock filters the decoded image data provided as output from the add unit 23 and removes distortion from the block.

In step ST20, frame memory 26 stores the reference image data. The frame memory 26 20 stores the decoded image data after filtering processing (reference image data).

In step ST21, the intra prediction unit 31 and the motion prediction / compensation unit 32 each perform the prediction processing. That is, the intra prediction unit 25 31 performs the prediction processing

intra of the intra prediction mode, and the LS unit, motion prediction / compensation performs the | fl®j process (5can0 of the Prediction property / motion compensation mode [ffeusfrlai Inter prediction. Prediction processing is described below with reference to Figure 7, where each prediction processing is performed with all candidate prediction modes, and the cost function values with all candidate prediction modes are each calculated through this processing. Additionally, based on the calculated cost function values, the intra-optimal prediction mode and the inter-optimal prediction mode are selected, and the prediction image and the prediction mode information and the cost function generated in the prediction mode selected are supplied to the optimal mode / prediction image selection unit 33 of 15.

In step ST22, the optimal mode / prediction image selection unit 33 selects the prediction image data. Optimal mode / prediction image selection unit 33 decides in the optimal mode which coding efficiency is best, based on each cost function value provided as output from intra prediction unit 31 and the motion prediction / compensation unit 32. That is, the optimal mode / prediction image selection unit 33 decides the coding unit where the coding efficiency is

best of each of the hierarchical levels illustrated in the Mexican Institute Figure 5 for example, the block size of the uniMraG & DpJ @ £ jQ ^ Industry prediction in this coding unit, and which of the intra prediction and the Inter prediction to perform.

Additionally, the optimal mode / prediction image selection unit 33 provides the optimum mode prediction image data output to the subtraction unit 13 and the addition unit 23. This prediction image data is used for the computation of steps 10 ST13 and ST18, as described above.

In step ST23, the lossless encoding unit 16 performs the lossless encoding processing. Lossless encoding unit 16 performs lossless encoding on quantization data 15 provided as output from quantization unit 15. That is, lossless encoding such as variable length encoding or arithmetic encoding is performed as far as the quantization data is concerned for data compression to be performed.

Furthermore, the lossless encoding unit 16 performs lossless encoding of the prediction mode information and the like corresponding to the prediction image data selected in step ST22, and lossless encoded data such as the information mode information. 25 prediction and the like are included in the flow information

generated by performing the quantification.

In step ST24, the storage processing stores as output from lossless encoding of the iriSfífufo fel PfDpdOtíac 'Industry' storage buffer 17 performs storage. The buffer 17 of the stream information provided from the lossless encoding unit 16. The stream information stored in this decoding storage buffer 17

In the stage it is read appropriately and about the trajectory of

ST25, the unit performs speed control, controls the flow in the speed operation buffer.

the case is transmitted to the transmission side.

speed control

The control unit 18 stores the storage information, the quantization rate of the quantization unit so that the overflow does not occur or in the storage buffer 17.

the underflow

Then the prediction processing in step ST21 diagram

In performing the prediction of the data in Figure 6 flow will be described in Figure 7.

step ST31, intraprocessing performs unit 31 of with reference to intra prediction of intra prediction. Unit 31 of the prediction unit intra prediction envelope to be encoded, in all of the image of the decoded image referred in the intra candidate prediction modes. Note that, for intra predictions, they are decoded before being submitted using

filter unlock by filter 24 of instituto procesamientcM®iÉS <3no cte the Property unlock. DebiftldUíhtal this intra prediction processing, intra prediction is performed in all intra candidate prediction modes, and a cost function value is calculated for all intra candidate prediction modes. An intra prediction mode of which the coding efficiency is best is then selected from all intra prediction modes, based on the calculated cost function values.

In step ST32, the motion prediction / compensation unit 32 performs the prediction processing inter. Motion prediction / compensation unit 32 performs Inter prediction processing of all Inter candidate prediction modes using decoded image data after unlock filter processing stored in frame memory 26. Due to this inter-prediction processing, the prediction processing is performed in all inter-candidate prediction modes, and the cost function values are calculated for the inter-candidate prediction modes. An inter prediction mode of which the coding efficiency is the best is then selected from all the inter prediction modes, based on the calculated 25 cost function values.

The intra prediction processing in step]] Figure 7 will be described with reference to the diagram in Figure 8. <1® lG PrOplGdGd

Industrial

In step ST41, the intra prediction unit 31 performs the intra prediction of each prediction mode. Intra prediction unit 31 generates the prediction image data in each intra prediction mode, using the decoded image data before and after blocking filter processing.

In step ST42, the intra prediction unit 31 calculates the values of the cost function in each prediction mode. The calculation of the values of the cost function is performed, as stipulated in the JM (Joint Model) which is the reference software in the H.264 / AVC format, based on any technique of the High Complexity mode or the Low Complexity mode.

That is, in High Complexity mode, even lossless encoding processing is tentatively performed for all candidate prediction modes, and the cost function value represented by the following Expression (1) it is calculated for each prediction mode.

Cost (ε Ω Mode) = D + λ · R ... (1)

Ω represents a complete set of candidate prediction modes for encoding the image of this unit

prediction. D (distortion) between input in the case represents the difference energy of the decoded image and an encoding has been performed in one of the prediction mode.

including the information coefficient of the Lagrange multiplier mode

Quantification QP.

Complexity, up to losses, candidate prediction of the values of the

Expression (1) prediction.

For another generation of is the amount of code generated from the orthogonal transformation, the prediction, and so on, and given as a function of the

That is, in Mode λ is a parameter of High the coding processing without tentatively for all modes as the processing of step ST42, cost function represented by the above are calculated for each part mode, header images that in from the prediction mode and

Under Complexity, the bit generation includes the difference motion vectors and the prediction mode information and so on, performs for all candidate prediction modes, and computes the cost function values represented by itself by the following

Expression (2).

Cost (Mode e

Ω) + QP2 Quant (QP)

Header

Bit. .. (2)

Ω represents the complete set of candidate prediction modes for encoding the image of this prediction unit. D (distortion) between input in the case represents the energy of a decoded image that the encoding has

ristítufo and an image o® fci Property been performed tedustrtal the prediction mode. Bit_header is a bit of the header for prediction mode, and QP2Cuant is a function that is given as a function of the quantization QP parameter. That is, in Low Complexity Mode, the cost function value represented by Expression (2) above is calculated for each prediction mode, using the generation of the prediction image and the header bits such as the motion vectors and prediction mode information and so on, such as the processing of step ST42.

In step ST43, the intra prediction unit 31 decides the intra optimal prediction mode. Intra prediction unit 31 selects an intra prediction mode of which the value of the cost function is the smallest based on the values of the cost function calculated in step ST42,

that is decided for the intra optimal prediction mode.

Next, the inter prediction processing of step ST32 in Figure 7 will be described with reference to the flowchart in Figure 9.

In step ST51, the motion prediction / compensation unit 32 performs motion detection processing. The prediction / compensation unit 32 of

Motion detects ST52 stages.

At step ST52, motion and forward vectors

Mexican Property motion prediction / compensation | f | gi | JJtrfal unit 32 performs motion compensation processing. Motion compensation / prediction unit 32 performs motion compensation using the reference image data based on the motion vectors detected in step ST51, and generates the prediction image data.

In step ST53, the motion prediction / compensation unit 32 performs the calculation of the cost function values. The motion prediction / compensation unit 32 calculates the cost function values as described above, using the input image data of the prediction image to be encoded, and the prediction image data generated in the step ST52 and so on, and advance to step ST54.

The motion prediction / compensation unit 32 decides an inter-optimal prediction mode. The motion prediction / compensation unit 32 performs the processing of steps ST51 to ST53 for each inter prediction mode. Motion prediction / compensation unit 32 distinguishes the reference index where the calculated cost function value for each prediction mode is the smallest value, the block size of the coding unit,

and the block size of the prediction unit eflp · coding unit, and decodes the optimal inter. Note that with cost function is value of the prediction function Inter in the most cost mode the decision of the small, also

PredictionBfexIo ^ nCí Industrial Property mode where the is used in the case of a jump mode.

In addition, in the case that the prediction mode has been selected as the prediction mode performed the inter optimal optimum in the prediction image selection unit 33 / optimal mode, the motion compensation / prediction unit 32 generates the data of prediction image such that the prediction image data of the inter-optimal prediction mode can be supplied to the subtraction unit 13 and the addition unit 23.

3. Information Generation Operation

Difference Information

Quantification

In the above-described processing, the identification-based image encoding parameters image encoding device 10 sets the quantization parameters so that proper quantization is performed for each block of the image.

In addition, the image coding device 10 generates the identification information and the difference information and includes these in the flow information, to improve the

encoding efficiency of quantiijijf parameters:

ST15.

Institute used in the quantification processing in l <a <3e Industrial Property la

Next, the description will be made regarding generation of the identification information and the difference information.

The speed control unit establishes the quantization parameters using the code quantity control format stipulated with

TM5 in MPEG2, for example.

With the code quantity control format stipulated with

TM5 in MPEG2, stage 1 to stage 3 processing is illustrated.

In step 1, the amount of code to be allocated each frame within a GOP (Group of Frames) is distributed to the still frames, the frames for allocation, not encoded, including based on an amount R of allocation bits. This distribution is repeated in the order of frames encoded within the GOP. At this time, the code quantity assignment for each frame is made using the following two assumptions.

The first assumption is that the product of the average quantized scale code and the amount of code generated, used when encoding each frame, will be constant for each frame type, unless the display changes.

encode each frame, institute

ΠΊ Ί ϊ ΜΟΧίΟΟΠ

Consequently, after parameters Xx, XP, and XB (As they represent the complexity of Complexity G the screen is updated Industrial by Expressions (3) to (5).

quantification scale code

The relationship between it and the amount of code can be estimated by these parameters.

generated

<td></td><td>Here, Sx,</td><td colspan="2">Sp, and SB, are the bits of</td><td>code</td><td>generated</td><td>to the</td>

<td colspan="2">moment of</td><td>coding</td><td>of the frame,</td><td>and Qi,</td><td>Qp z Y Qb i</td><td>are</td>

<td>the</td><td>code of</td><td>the scale of</td><td>quantification</td><td>means, medium</td><td>at the moment</td><td>of</td>

frame encoding. In addition, the initial values are the values illustrated by the following Expressions (6), (8), using speed_bit [bits / sec] which is the quantity

160

Xp =

Xb = will be for

160

The one with the objective code.

speed_bit / 115 speed_bit / 115 speed_bit / 115

... (6). .. (7). .. (8) second assumption is that the constantly optimized when the image quality scale code the global proportions

KP and KB quantization of the P and B frames, with the code of the quantization scale of the photogrammalI as a reference, are as stipulated in Expression (9).

ΚΡ = 1.0; Κβ = 1.4 ... (9) • 0; ΚΒ = 1.4 ... (9) iFiSWutO

That is, the code of the quantization scale □ _ _ _ „. Industrial B frames are constantly set to 1.4 times the quantization scale code for I and P frames. This assumes that by making the B frames quantized somewhat thicker than compared to the I and P frames, and thus adding the amount of code held with the B frames to the I and P frames, the image quality of the I and P frames, and the image quality of the B frames that refer to them will also be improved.

According to the two previous assumptions, the assigned amounts of code (Ti, TP, TB) for each image in the GOP are the values indicated in Expressions (10), (11), and (12). Note that images__ rate indicates the number of images displayed per second in this sequence.

[Mathematics 1]

Tj = niax

V · XjKp * XjKg max

Not nowP, NB, coded inside coded inside are the GOP number. That is, of the GOP in relation

of the images ^ @ Já <5Ono gives the Property to the images tffiftfttrlG!

which must be carried out the different types of images the allocation and those of the estimation is made in relation to how many times will be the amount of generated code of the images for the allocation of the amount of generated code, under the optimization conditions of the quality of the images, described above. Next, the number of images to be encoded is calculated by the value of the quantity of code to which the estimated quantity of the generated code is equivalent, which generates all the non-encoded images. For example, ΝρΧρ / ΧΣΧρ, which is the second term of the denominator of the first argument in the expression that refers to Tlz expresses the number of images I to which the non-encoded images are equivalent NP within the GOP. Also, this is obtained by multiplying NP by a fraction SP/ SX of the generated quantity of code of the images I for the generated quantity of code of the images P, and is expressed by XIz XP, and XB as described above.

The number of bits in terms of images for allocation is obtained by dividing the amount of allocation code R, in terms of uncoded images, by the number of images. Note that a lower limit is

set for that value, however, taken in iHSltiutO F feüeano consideration the amount of high code for £ tolePi'®pS®d (3d Industrial heading and so on.

Based on the assigned amount of code thus obtained, the amount of R code to be assigned to the non-encoded images within the GOP, is updated by means of expression (13) each time each image is encoded following steps 1 and 2 .

R = R - Yes, p,B .. · (13)

Also, at the time of encoding the first image of the GOP, R is updated by means of the following Expression (14).

R = bítios_tasax N imágeiies.tasa

-R ... (14) where N is the number of images within the GOP. Also, the initial value of R at the beginning of the sequence is 0.

Next, the description will be given in relation to stage 2. In stage 2, the quantification scale code is obtained to actually equalize the quantities of the allocation code (Ti, TP, TB) for each image obtained in stage 1, for the current code amount. The quantification scale code is obtained by feedback control in increments of macroblocks for each type of images, based on the capacity of three

types of virtual buffers established independently.

First, before

macroblock, the occupation quantities of the virtual buffers are obtained, by means of expressions (15) to (17).

[Mathematics 3]

do1, dop, and d0B are the initial occupancy amounts of the virtual buffers, Bj is the number of bits generated from the image header to the jth macroblock, and MBcnt is the number of macroblocks within an individual image.

The occupancy amounts of the virtual buffers at the time of encoding completion for each image (dMBcnt1, dMBcntp, dMBcntB) are used as the initial values of the amount of occupation of the virtual buffers for the following image (do1, doP, doB) for the same type of images, respectively.

Next, the Qj quantification scale code for the j'th macroblock is calculated, using the

Expression (18) [Mathematics 4]

dyX31

T

... (18)

Industrial Property Institute r is a parameter that controls the response speed of a feedback group, called a reaction parameter, and is obtained by means of expression (19).

[Mathematics 5] ~ bitios_tasa r = 2x —-------... (19) imagenes_tasa

Note that the initial value of the virtual buffer at the beginning of the sequence is obtained by means of the

Expression (20).

[Mathematics 6] d}) = 10x 14 = 8.44 = 8.4

... (20)

Next, stage 3 will be described. Activity is obtained from Expressions (21) to (23) using the pixel values of the luminance signal of the original image, for example, using the pixel values of a total of eight 8X8 blocks in DCT frame mode and four 8X8 blocks in DCT field encoding mode.

[Mathematics 7] acti = 1+ min (var sblk) ... (21) 'sblk = I3 institute

Mexican Industrial Property var sblk = __

Σ <pkp)

K »l • '· (2 2)

• · · (23)

The Var_sblk in Expression (21) is the sum of the squares of the difference between the image data of each pixel and the average value of the same, so that the more complex the images of these 8x8 blocks are. , the greater the value. Pr in Expressions (22) and (23) represents the values of the pixels within the block, of the luminance signals of the original image. The reason that the value (min) is assumed in Expression (22) is to make the quantization finer in the event that there is still a partially smoother portion within the 16x16 macroblock. Furthermore, a normalized activity Nactj where its value is within the range of 0.5 to 2, is obtained by means of Expression (24) [Mathematics 8]

2xact¡ 4-prom_act

----- T ----------- ... (24) actj 42xprom_act

Nactj =

Avg act is the average value of the activity has image encoded immediately before. The code of the • escalft? ® ^ ®® '*0 ΟΘ The quantization property mquantj, which takes into account the visual properties, is obtained by means of Expression (25) based on the code of the reference quantization scale Qj.

[Mathematics 9]

Mquantj = QjXNactj · · · (25)

The rate control unit 18 transits the quantization scale code, calculated as described above, as a quantization parameter. Also, a quantization parameter is generated for the macroblock located at the section boundary in the same way as with the macroblocks located at positions other than the section boundary, with the same technique. Note that the quantification parameters are not restricted to cases where they are decided based on activity, as described above, and can be decided such that the value of the cost function is smaller.

Note that, with the description of the rate control method stipulated with TM5 in MPEG2, described above, a case where the processing is carried out in increments of macroblocks is described. Accordingly, by performing similar processing in block increments relative to which quantization parameters can be changed, the quantization parameters

which quantification parameters can be changed.

established for each of the related blocks. _. ... . . . <fe ta Propteded

Industry /

Next, the description will be made regarding information generation operations used to improve the coding efficiency of the quantization parameters. The information generating unit 19 takes the spatially or temporally encoded quantization parameters adjacent to the block to be encoded as selection candidates. The information generation unit 19 also selects a quantization parameter from the selection candidates in accordance with a quantization parameter established in relation to the block to be encoded, and takes this as a prediction quantization parameter. The information generating unit 19 additionally generates the identification information for selecting a prediction quantization parameter from the selection candidates, and the difference information indicating the difference between the prediction quantization parameter and a quantization parameter set for the block to be encoded.

Figure 10 is a diagram to describe the operations of the information generation unit, illustrating a frame to be encoded, and an encoded frame that is temporarily closer in the order of

deployment. We will say that the block parameter to be encoded in frame a for example, QP_0. Furthermore, we will say that

Institute to be coded ed ^ OXlCano delaProperty The parameters dtedustriol quantification of the block adjacent to the left are, for example, QP_A. In the same way, we will say that the quantization parameter of the adjacent blocks above, to the upper right, lower are, to the upper left, and to the left, eg, QP_B, QP_C, QP_D, and QP_E.

Furthermore, we will say that the quantization parameters of the temporarily adjacent block are QP_T. Note that when encoding the block to be encoded in the frame to be encoded, the quantization parameters QP_A to QP_E and QP_T are stored in the memory unit 191 of the quantization parameters. Furthermore, we will say that each block is the smallest increment block referring to which the quantization parameters can be changed.

The difference computation unit 192 takes the quantization parameters of the coded block adjacent to the block to be coded as selection candidates, selects from the selection candidates the quantization parameter from which the difference in terms of the parameter of The quantization established for the block to be encoded is the smallest, and it takes this as a prediction quantization parameter. The difference computing unit 192 generates the identification information to select the prediction parameter from

selection candidates, and indicates the difference between the different information

quantification parameter ¿fcldUStriCíl prediction and the quantification parameter of the block to be encoded.

Figure 11 is a diagram illustrating an example of operation of the information generation unit. Note that the cases where no quantization parameter is established for a block due to being a jump block or without residual information are indicated by a

With the block to be encoded as the BKO block, the quantization parameters of the encoded blocks are QP_A = 32, QP_B = 40, QP_C = 40, QP_D = 35, QP_E = / and QP_T = 31. Here, unit 19 of Information generation excludes the blocks where no quantization parameter is set for a block due to being a jump block or a block with no residual information, and blocks where the quantization parameters are redundant, from the candidates. Consequently, the selection candidates are the coded blocks of the quantization parameters QP_A = 32, QP_B = 40, QP_D = 35, and QP_T = 31. In addition, the information generating unit 19 sets in advance, for example, the information of identification, the Nos. of index, for the selection candidates. Identification information can be set for adjacent coded blocks alone

Instrument can set for the quantization parameters of adjacent coded blocks.

In the case of setting the identification information for adjacent coded blocks, the information generating unit 19 sets the index numbers in order of arrangement with the adjacent coded blocks in a predetermined order of arrangement. The default fix order is, for example, a fix order where one of a coded block adjacent to the left side, a coded block adjacent above, and a temporarily coded block are given priority. Furthermore, the information generating unit 19 may be able to switch the order of arrangement. In the case of being able to change the fix order, the information indicating what type of fix order is included in the flow information. In addition, the lossless encoding unit 16 and the information generating unit 19 perform adjustments and lossless encoding of the identification information such that there is less amount of code in encoding the identification information of the block that was given priority.

The difference computation unit 192 selects a candidate from the selection candidates where the difference in terms of the quantization parameter of the block to be encoded is smaller, and uses the

Identification information established selected, therefore generating the info rma ^ PJfl Ciad

Industrial identification to select a prediction quantification parameter from the selection candidates. Furthermore, the difference computing unit 192 generates the difference information indicating the difference between the parameters of

<td>quantification</td><td>of</td><td>prediction</td><td>What are they</td><td>the parameter</td><td>of</td>

<td>quantification</td><td>of the</td><td colspan="2">selected candidate,</td><td>and the parameter</td><td>of</td>

<td>quantification</td><td>of the</td><td>block to be</td><td>encoded.</td><td>For example in</td><td>the</td>

In case of prioritizing the coded block adjacent to the left side in Figure 11, the information generating unit 19 sets 0 (index No.): QP_A block, 1: QP_B block, 2: QP_B block, and 3 : QP_T block. Furthermore, if we say that the quantization parameter of the block to be encoded is 33, for example, the difference computation unit 192 sets the No. of the block index where the difference regarding the quantization parameter of the block to be encoded is the smallest, to the identification information 0 (Index No.). Furthermore, the difference computation unit 192 generates the difference information 1 (= 33-32) indicating the difference between the prediction quantization parameter and the quantization parameter of the block to be encoded.

By establishing the identification information for the blocks to be encoded in this way, you can

improve the encoding efficiency of the quantification parameters. For example, if the block on the left side ^^; g $ i ^ p) © álsd indusW receives priority and the order of the block is the quantization parameters QP_A, QP_B, QP_C, QP_D, QP_E, QP_T, the amount of data It will be small with images, where there are more blocks to be encoded, which are similar to the image of the block on the left side. Also, if the block above receives priority and the block order is the quantization parameters QP_B, QP_A, QP_C, QP_D, QP_E, QP_T, the amount of data will be small with images, where there are more blocks to be encoded, which are similar to the block image above. Additionally, if the temporarily adjacent block receives priority and the block order is the quantization parameters QP_T, QP_A, QP_B, QP_C, QP_D, QP_E, the amount of data will be small with images, where there are more blocks to be encoded, which are similar to the temporarily adjacent image, i.e. quieter subjects.

In a case of setting the identification information regarding the quantization parameters of adjacent coded blocks, the information generating unit 19 sets the index Nos. With the adjacent coded blocks in a predetermined order of arrangement. For example, the information generating unit 19 sets the Index Nos. In order of the parameters of

quantification with small parameter values. It is decijr ·, in Instituto r Mexicano the case of Figure 11, the unit 19 of generacidÍBtaftOpledacI IndutMol information establishes the index Nos. Such as 0 (Index No.): 32 (quantification parameter), 1:40, 2 : 35,

3:31.

The difference computation unit 192 selects a candidate from the selection candidates where the difference in terms of the quantization parameter of the block to be encoded is smallest, and uses the identification information established for the selected candidate, thereby generating the identification information to select a prediction quantization parameter from the selection candidates. Furthermore, the difference counting unit 192 generates the difference information indicating the difference between the prediction quantization parameter and the quantization parameter of the block to be encoded. For example, if we say that the quantization parameter of the block to be encoded is 33, the difference computation unit 192 generates the difference information 1 (= 33-32) as the identification information.

Furthermore, in the case that there are no selection candidates, the difference computation unit 192 generates the difference information indicating the difference between the SliceQPY parameter of quantizing the initial value in the slice and the quantizing parameter set.

Figure 12 is a flowchart that processing referring to the parameters of quantifi ^ aci ^^^^^ encoding. In step ST61, the image encoding device 10 generates the information to obtain a minimum unit size of the quantization parameters (MinQpUnitSize). The minimum unit size of the quantization parameters is the smallest size where the quantization parameters can be adaptively switched.

The image encoding device 10 uses, as the information to obtain the minimum unit size of the quantization parameters (MinQpUnitSize), the difference in terms of a minimum size of the transformation unit (MinTransformationUnitSize), for example .

The minimum unit size of the quantization parameters (MinQpUnitSize) is determined by Expression (26).

MinQpUnitSize = 1 << (Iog2_min_transformation_unit_size_less2 + log2_min_qp_unit_size_scroll + 2) ... (26)

Note that Iog2_min_transformation_unit_size_less2 is a parameter to decide the minimum size of the transformation unit (MinTransformationUnitSize).

The minimum size of (MinTransformationUnitSize) (27).

Industry?

Min Transformation Unit Size

1 << (Iog2_min_transformation_unit_size_less2 +2). . . (27)

The difference between the minimum unit size of the quantization parameter CMinQpunitSize) and the size --- minimum of the transformation unit (MinTransformationUnitSize) is, as can be clearly understood from Expressions (26) and (27), equivalent to log2_min_qp_unit_size_scroll_ . Note that the quantization parameters are used in increments of transformation units (TU). That is, a quantization parameter is unchanged within a transformation unit.

In addition, the minimum unit size of the quantization parameter (MinQpUnitSize) can be decided according to the size of the encoding unit.

In this case, the image encoding unit 10 uses, for example, the information stipulating the minimum size of the unit.

Coding CU (log2_min_coding_block_size_less3), and the maximum unit size

Coding CU (log2_dif_max_min_coding_block_size).

Note that the maximum size of the encoding CU unit

log2MaxCUTsize log2MaxCUTsize = is as illustrated in Expression (28). I instituted ©

Mexican log2_min_coding_block_size_merdfttol? ROpi ty Industrial + log2_dif_max_min_coding_block_size ... (28)

The logarithmic value of the minimum unit size of the quantization parameter (log2MinQpUnitSize) is decided by Expression (29).

log2MinQpUnitSize log2_min_coding_block_size_less 3 + 3 +

1og2_di f_max_min_coding_b1oque_t size log2_min_qp_unit_size_scroll ... (29)

Consequently, setting log2_min_qp_unit_size_offset in order to be larger makes the minimum unit size of the quantization parameter smaller. For example, in a case where the smallest size of an encoding CU unit is 8 x 8 and the largest size is 64 x 64, setting log2_min_qp_unit_size_offset_to 1 causes the minimum unit size of the quantization parameter to be.

In addition, setting log2_min_qp_unit_size_offset to 2 makes the minimum unit size of the quantize parameter 16 x 16.

In step ST62, the image encoding device 10 performs the processing of including the generated information in the stream information. Device 10

image encoding log2_min_qp_unit_t offset_size, from Id Prep'sdsd log2_min_qp_unit_size_offset which is a parameter ^ fttjgsfttal to decide the minimum size of the transformation unit (MinTransformationUnitSize), in the flow information, and advance to step ST63. In addition, in the case of deciding the minimum unit size of the quantization parameter according to the size of the coding unit, log2_min_coding_block_size_less3, log2_dif_max_min_coding ___block_size, are included in the flow information. Image encoding device 10 includes, for example, information generated in a sequence parameter set (SPS: sequence parameter set) defined as a syntax for RBSP (raw byte sequence useful data). Note that Figure 13 illustrates an exemplary set of sequence parameters.

In step ST63, the image encoding device 10 determines whether or not there is a frame to be encoded. In the event that a frame to be encoded exists, the image encoding device 10 advances to step ST64 and performs the frame encoding processing illustrated in Figure 14, and if it does not exist, the encoding processing terminates.

In encoding processing

InOuto Figure 14, at step ST71 the encoding device 10 ic ^ ciórffi @% lcgfio CtetaPrtjpJodad images determines whether or not there is a slice to encode.

In the event that there is a slice to be encoded, the image encoding device advances to step ST72, and if it does not exist, the frame encoding processing ends.

In step ST72, the image encoding device 10 decides the quantization parameters of the slice to be encoded. The image encoding device 10 decides the quantization parameter of the initial value in the size in order to be a target code quantity, and proceeds to step ST73.

In step ST73, the image encoding device 10 computes slice_qp_delta. The SliceQPY parameter of quantizing the initial value in the slice has the relationship illustrated in Expression (30), with initial_frame_qp_less26 being set beforehand by the user or the like. Consequently, the image encoding device 10 calculates slice_qp_delta in order to be the quantization parameter decided in step ST72, and advances to step ST74.

SliceQPY = 26 + initial_frame_qp_less26 + slice_qp_delta ... (30)

At step ST74, the encoding device 10

images includes slice_qp_delta initial_frame_qp_less26 in the flow information

Industrial image encoding device 10 includes the calculated slice_qp_of1ta in the header slice eg of the stream information.

In addition, the image encoding device 10 includes the initial_qp_less26_frame that has been set, in the frame parameter set, for example, of the

V flow information. Thus including the delta_qp_slot and qp_less26_initialframe in the stream information, the image decoding device that performs the decoding of the stream information can calculate the SliceQPY parameter of quantizing the initial value in the slice by computing the Expression (30 ). Note that Figure 15 exemplary illustrates a set of sequence parameters, and Figure 16 a slice heading.

In step ST75, the image encoding device 10 performs encoding processing of the slice. Figure 17 is a flowchart illustrating the encoding processing of the slice.

In step ST81 of Figure 17, the image encoding device 10 determines whether or not there is an encoding unit CU to be encoded. In the case that a coding unit, referring to which has not yet been performed

encoding processing, exists in the slice to be Institute

Mexican encoded, the 10th encoding device im^ Rflgffih? Pleq | ad Industrial advances to stage ST82. Furthermore, in the event that the encoding processing of all the encoding units in the slice has been completed, the image encoding device 10 terminates the encoding processing of the slice.

In step ST82, the image encoding device 10 determines whether or not a transformation unit TU exists in the encoding unit CU to be encoded. In the case that there is a transformation unit, the image coding device 10 advances to step ST83, and in the case that there is no transformation unit, it advances to step ST87. For example, in the case that all the coefficients to be quantized using a quantization parameter are 0, or in the case of a jump block, the flow advances to step ST87.

In step ST83, the image encoding device 10 decides the quantization parameter of the encoding unit CU to be encoded. The speed control unit 18 of the image coding device 10 decides the quantization parameter in accordance with the image complexity of the coding unit as described above, or such that the value of the cost function is small, and advance to step ST84.

At step ST84,

device

Images sets the identification information for selection candidates.

The 19th generation unit

Information from the image encoding device 10 takes the quantization parameters of spatially or temporally encoded encodings peripheral to the encoding unit to be encoded, as selection candidates. Furthermore, in the case that no quantization parameter is set for the block due to being a jump block or having no residual information, or in the case that a quantization parameter is equal to another candidate, the information generation unit 19 excludes these from selection candidates. The image encoding device 10 sets the identification information, for example, the index (ref_qp_block_index) for the selection candidates, and proceeds to step ST85.

In step ST85, the image encoding device 10 generates the identification information and the difference information. The information generating unit 19 of the image encoding device 10 selects from the selection candidates a candidate where the difference in terms of the quantization parameter of the encoding unit to be encoded is smallest, and takes this as a prediction quantization parameter. The 19th generation unit

information generates the identification information using the Mexican Institute the index (ref_qp_block_index) of the candidate age seven

Industrial as the identification information to select the prediction quantification parameter from the selection candidates. Furthermore, the information generating unit 19 takes the difference (qb_qp_delta) between the prediction quantization parameter and the quantization parameter of the encoding unit to be encoded, such as the difference information, and proceeds to step ST86. Now, with the prediction quantization parameter indicated by the index (ref_qp_block_index) of the candidate determined as ref_qp (ref_qp_block_index), the quantization parameter of the encoding unit to be encoded (ActualQP) displays the relationship indicated in Expression (31) .

ActualQP = qb_qp_delta + ref_qp (ref_qp_block_index) ... (31)

In step ST86, the image encoding device 10 includes the identification information and the difference information in the stream information. The lossless encoding unit 16 of the image encoding device 10 performs lossless encoding of the identifying information and difference information generated in the information generating unit 19, includes it in the stream information, and advances to step ST87.

At step ST87, the Mexican Image Institute coding device 10 uses the quantization parameter decided ^ j ^^ ji ^ Qpi dad, Industrial to perform the quantization of the encoding unit with quantization unit 15, and returns to step ST81.

In this way, the image encoding device 10 selects, from the quantization parameters of spatially encoded blocks temporarily adjacent to a block to be encoded, a candidate where the difference in terms of the quantization parameter of the block to being coded is the smallest, as a prediction quantization parameter. Furthermore, the image coding device 10 generates the identification information corresponding to the

Additionally, the selected quantization parameter.

image encoding device 10 generates the difference information indicating the difference between the prediction quantization parameter and the quantization parameter of the block to be encoded. The image encoding device 10 includes the identifying information and the difference information generated in the stream information. In this way, because a candidate where the difference is the smallest is selected as the prediction quantization parameter, the difference between the prediction quantization parameter and the quantization parameter can be prevented.

the block to be encoded becomes a large value. .Mexican Institute Consequently, the coding device 10 <Propl®dGC Industrie? Imaging can improve the encoding efficiency of the quantization parameters.

Four. Configuration of the Image Decoding Device

Next, an image decoding device will be described that performs the decoding processing of the stream information provided as output from the image coding device. The encoded stream generated by encoding an input image is supplied to the image decoding device by means of a predetermined transmission path, recording medium, or the like, and is decoded.

Figure 18 shows a configuration for an image decoding device that performs decoding processing of the stream information. The image decoding device 50 includes a storage buffer 51, a lossless decoding unit 52, a reverse quantization unit 53, a reverse orthogonal transformation unit 54, an addition unit 55, an unlock filter 56, a screen rearrangement buffer 57, and a digital / analog conversion unit 58 (D / A conversion unit). Furthermore, the image decoding device 50 includes a quantization parameter calculation unit 59, a

frame memory 61, an intra prediction unit 71,

M '„,w / u motion compensation unit 72, and a selector 7 | q

Storage buffer 51 stores information a InstiiUiC

Mexfcant stream that has been transmitted. The lossless decoding unit 52 decodes the stream information supplied from the storage buffer 51 using a format corresponding to the encoding format of the lossless encoding unit 16 in Figure 3.

Lossless decoding unit 52 operates as an information retrieval unit and obtains various types of information from the stream information. For example, lossless decoding unit 52 provides the prediction mode information obtained by decoding the flow information to unit 71 as output.

<td>intra prediction</td><td>already</td><td>unit</td><td> 72</td><td>of</td><td>compensation</td><td>of</td>

<td>movement. Further,</td><td>the</td><td>unit 52</td><td>of</td><td colspan="2">decoding</td><td>without</td>

<td>losses provides</td><td>how</td><td colspan="3">exit vectors</td><td>of movement</td><td>of</td>

difference, threshold values, or threshold value generation information, obtained by decoding the flow information, to the motion compensation unit 72. Furthermore, the lossless decoding unit 52 provides as output the information related to the quantization parameters obtained by decoding the flow information, eg difference information and the like, to the quantization parameter calculation unit 59.

Further,

provides as output the quantization data obtained by decoding the flow information to the inverse quantization unit.

The inverse quantization unit 53 performs the inverse quantization on the decoded quantization data in the lossless decoding unit 52 in the format corresponding to the quantization format of the quantization unit 15 in Figure 3. The inverse orthogonal transformation unit 54 performs the inverse orthogonal transformation on the output of the inverse quantization unit 53 in the format corresponding to the orthogonal transformation format of the orthogonal transformation unit 14 in Figure 3 and provides output to unit 55 of addition.

The addition unit 55 adds the data after the inverse orthogonal transformation to the prediction image data supplied from the selector 73, to generate the decoded image data, and outputs the unlock filter 56 and the intra prediction unit 71 .

The unlocking filter 56 performs the filtering processing as regards the decoded image data supplied from the addition unit 55, removes the distortion from the block and subsequently supplies to and stores in memory

provides output to screen re-buffer 57. Mexican Property

The screen rearrange buffer 57 performs the rearreglBdUSfria!

of the images. That is, the order of the rearranged frame in the order for encoding via the screen rearrangement buffer 12 of Figure 3 is rearranged to the original order for display and is provided as output to D / A conversion unit 58.

The D / A conversion unit 58 performs the D / A conversion on the image data supplied from the screen rearrangement buffer 57, in order to display the image by providing output to a display not shown.

The quantization parameter calculation unit 59 restores the quantization parameters based on the information supplied from the lossless decoding unit 52, and provides output to the reverse quantization unit 53. Figure 19 illustrates the configuration of the quantization parameter calculation unit, having a computation unit 591 and a memory unit 592 of the quantization parameters.

The computing unit 591 uses the information supplied from the lossless decoding unit 52 and the quantization parameters stored in the quantization parameter memory unit 592 to restore the quantization parameter used in the

quantification in the coding to which the

Insfitufo

Mexican block to be decoded, and provides output to the unit® ^ Industrial Property of inverse quantization. The computing unit 591 also stores the quantization parameter of the block to be decoded in the memory unit 592 of the quantization parameters.

The computing unit 591 uses, for example, the qp_less26_initial_frame extracted from the parameter set, and the delta_qp_delta extracted from the slice header, to compute the Expression (30), calculates the QPY Slice parameters, and provides output to the inverse quantization unit 53.

The computing unit 591 also uses the identification information and the difference information supplied from the lossless decoding unit 52 and the quantization parameters of the decoded blocks stored in the memory unit 592 of the quantization parameters, and calculates the quantization parameter of the block to be decoded. The computing unit 591 outputs the calculated quantization parameter to the inverse quantizing unit 53. In this case, the computing unit 591 reads, from the quantization parameters of the decoded blocks stored in the memory unit 592 of the quantization parameters,

decode the block quantization parameters spatially or temporarily peripheral to the decode.

Unit 591 computation

Block as ^ SXiCdno Institute of Property establishes lobldUStrlal selection candidates in the same manner as with unity

192 computation computation excludes quantification of the difference. For example, minus the blocks where the redundants or the blocks perform the inverse quantization using the quantizations, and take as a unit 591 parameters where no parameters are selected candidates.

Additionally, the computing unit 591 establishes the identification information, that is, the index (ref_qp_block_index) equal difference in unit quantization

591 to the unit 192 of computation of which of each one refers to the parameters of the candidates.

That is, the computation sets the index (index_qp_block_ref) with adjacent decoded blocks in a predetermined array order. The counting unit 591 computes the Expression (31) using the corresponding quantization parameter ref_qp (ref_qp_block_index) supplied at a loss, prediction differentiates the identification information ie from the unit 52 of and the difference supplied to decoding lossless parameter indicated starting from by decoding quantizing la (qb_qp_de1ta). The of information 52 unit 591 of of of

Institute

Mexican computation provides the calculated quantization parameter (ActualQP) as output to the quantization unit 53

Industry * as the quantization parameter to be decoded.

Furthermore, in the case that there is no selection candidate, the computation unit 591 outputs the quantization parameter of the initial value in the slice to the inverse quantization unit 53.

Furthermore, in the case that the information specifying the order of arrangement of the blocks has been extracted from the information of the flow, the computing unit 591 establishes the index (ref_qp_block_index) with the decoded blocks in the specified order of arrangement. Consequently, even if the arrangement order is changed in the image encoding device 10, the quantization parameters used in the image encoding device 10 can be restored.

Returning to Figure 18, the frame memory 61 retains the decoded image data after the filtering processing supplied from the unlock filter 24.

The intra prediction unit 71 generates the prediction image data based on the prediction mode information supplied from the lossless decoding unit 52 and the decoded image data supplied from the 55 unit.

Institute image

Mexican Property

Industrial reads the addition data, and outputs the generated prediction data to selector 73.

The reference image motion compensation unit 72 from the frame memory 61 based on the prediction mode and motion vector information supplied from the lossless decoding unit 52 and performs motion compensation , to generate the prediction image data. The motion compensation unit 72 outputs the predicted image data generated to selector 73. Furthermore, the motion compensation unit 72 generates the prediction image data while the filter properties are switched in accordance with the magnitude of the motion vectors.

The selector 73 selects the intra prediction unit 71 in the case of the intra prediction and the motion compensation unit 72 in the case of the inter prediction, based on the prediction mode information provided from the 52 unit. lossless decoding. The selector 73 provides as output the prediction image data generated in the intra selected prediction unit 71 or the motion compensation unit 72 to the addition unit 55.

The selector 73 selects the intra prediction unit 71 in the case of the intra prediction and the 72 unit of

motion compensation based on information from unit 52 in the case of inter prediction, lossless decoding prediction mode. Selector EiiCdllSMCfi outputs the prediction image data generated in the intra-selected prediction unit 71 or the motion compensation unit to the addition unit 55.

5. Operation of the Image Decoding Device

Next, the operation of the image decoding device 50 will be described with reference to the flowchart in Figure 20.

In step ST91, the storage buffer 51 stores the flow information that has been supplied to it. In step ST92, lossless decoding unit 52 performs lossless decoding processing. Lossless decoding unit 52 decodes the stream information supplied from the storage buffer 51. That is, the quantization data of each frame encoded by the lossless encoding unit 16 in Figure 3 is obtained. In addition, the lossless decoding unit 52 performs lossless encoding of the prediction mode information included in the flow information, and in the case that the prediction mode information obtained is information regarding the intra prediction mode, it outputs the prediction mode information to

In addition, in the event that the information is

Prediction mode information from Property Qn © to Inter prediction mode, lossless decoding unit 52 provides the prediction mode information to the motion compensation unit 72 as output. Additionally, lossless decoding unit 52 outputs the difference motion vectors, threshold values, or threshold generation information, obtained by decoding the flow information, to the motion compensation unit 72.

In step ST93, the reverse quantization unit 53 performs the reverse quantization processing. The inverse quantization unit 53 performs the inverse quantization on the quantization data decoded by the inverse decoding unit 52 with properties corresponding to the properties of the quantization unit 15 in Figure 3.

In step ST94, the inverse orthogonal transformation unit 54 performs inverse orthogonal transformation processing. The inverse orthogonal transformation unit 54 performs the inverse orthogonal transformation on the transformation coefficient data subjected to inverse quantization by the inverse quantization unit 53 with properties corresponding to the properties of

unit 14 orthogonal transformation of

In step ST95, the decoded image data unit 55. Unit

Addition Institute generates the Addition Propisclad data obtained by performing the inverse orthogonal transformation processing to the predicted image data selected in the ST99 step described below, and generates the decoded image data. In this way, the original image is decoded.

In step ST96, the unlocking filter 56 performs the filtering processing. The unlocking filter 56 performs filtering processing of the decoded image data provided as output from the addition unit 55, and removes the distortion of the block included in the decoded image.

In step ST97, the frame memory 61 performs storage processing of the decoded image data. Note that the decoded image data stored in frame memory 61 and the decoded image data provided as output from the addition unit 55 are used as the reference image data to generate the prediction image data.

In step ST98, the intra prediction unit 71 and the motion compensation unit 72 perform the prediction processing. Intra prediction unit 71 and motion compensation unit 72 each perform

prediction processing corresponding to

Institute prediction mode information supplied from the Mexican «fofa Property unit 52 lossless decoding. Industrial

That is, when the intra prediction prediction mode information is supplied from the lossless decoding unit 52, the intra prediction unit 71 performs the intra prediction processing based on the prediction mode information and generates the prediction image data. Furthermore, in the event that the prediction mode information of the Inter prediction is supplied from the lossless decoding unit 52, the motion compensation unit 72 performs the motion compensation based on the mode information

<td>prediction and generates</td><td>the</td><td>Data of</td><td colspan="3">prediction image.</td><td></td>

<td>At step ST99,</td><td>the</td><td>selector</td><td> 73</td><td>Choose</td><td>the data</td><td>of</td>

<td>prediction image.</td><td>The</td><td>selector</td><td> 73</td><td>Choose</td><td>the picture</td><td>of</td>

prediction supplied from the intra prediction unit 71 and the prediction image data supplied from the motion compensation unit 72 and supplies the selected prediction image data to the addition unit 55 in order to add to the output of the inverse orthogonal transformation unit 54 in step ST95, as described above.

At step ST100, the screen rearrange buffer 57 performs the image rearrange. That is, in buffer 57 of

Figure 3 is rearranged to the original order for deployment.

for the screen

In step ST101, the D / A conversion unit 58 performs the D / A conversion on the image data in the screen rearrange buffer 57. This image is provided as output to the display not shown and the image is displayed.

Next, the prediction image generation processing in step ST98 in Figure 20 will be described with reference to the flowchart in Figure 21.

In step ST111, the lossless decoding unit 52 determines whether or not the current block has been intracoded. In the event that the prediction mode information obtained by performing t he lo ssle ss decoding is the intra prediction mode information, the lossless decoding unit 52 supplies the prediction mode information to the intra prediction unit 71 and advances to the step ST112. Furthermore, in the event that the prediction mode information is not the integer prediction mode information, the lossless decoding unit 52 supplies the prediction mode information to the motion compensation unit 72, and advances to the step ST113.

In step ST112, the intra prediction unit 71 performs the intra prediction processing. Unit 71 of

intra using lo ^ nsWfufo of the process ^ aij ^ ® ^ prediction intra filter data performs the decoded prediction before unlocking and the prediction mode information i οη ^ ΜαΙ supplied from the addition unit 55, and generates the data image prediction.

In step ST113, the motion compensation unit 72 performs the interim prediction image generation processing. The motion compensation unit 72 reads the referenc e image data from the frame memory and generates the prediction image data, based on the information supplied from the lossless decoding unit 52 such as the information prediction mode and so on.

Figure 22 is a flowchart illustrating the processing relating to the quantization parameters in decoding. In step ST121, the image decoding device 50 extracts the information to obtain the minimum unit size of the quantization parameter. The image decoding device extracts the information to obtain the minimum unit size of the quantization parameter, for example, log2_min_qp_unit_size_offset from the flow information, and advances to the step

ST122.

Images calculates the minimum unit size of the parameter

In step ST122, the decoding unit 50 of

; l

L quantification. The Image Decoding Unit 50 Institute

.... ·. Mexictmc uses ^ Kopi doc parameter computes the Expression log2_min_qp_unit_size_scroll, log2_min_transformation_unit_size_less2 minimum size of the unit of (26) the one that decides the transformation (MinTransformationUnitSizeQuantity), and calculates the minimum unit size of theQuantityQuantity parameter. In addition, the image decoding unit 50 can calculate the minimum unit size of the quantization parameter (MinQpUnitSize) by computing the Expression (29).

In step ST123, the image decoding unit 50 determines whether or not there is a frame to be decoded there · In the event that there is a frame to decode there, the image decoding unit 50 advances to step ST124, and in the If there is no box to decode there, the processing ends.

In step ST124, the image decoding unit 50 determines whether or not there is a slice to be decoded there.

In the event that there is a slice to be decoded, the image decoding unit 50 advances to step ST125, and in the event that there is no slice to decode there, it returns to step ST123.

In step ST125, the image decoding unit 50 extracts the information to obtain the initial value quantization parameter in lossless decoding image decoding.

unity, institute 50 Sfexlcano by extracts, initial_frame_qp_less26 from a frame parameter set (PPS: frame parameter set). Also, slice_qp_delta is extracted from the slice header, and proceeds to step ST126.

In step ST126, the image decoding unit 50 calculates the quantization parameter of the initial value in the slice. The quantization parameter calculation unit 59 of the image decoding unit 50 computes the Expression (30) using initial_frame_qp_less26 and slice_qp_delta, calculates the SliceQPY parameter of quantization, and proceeds to step ST127.

In step ST127, the image decoding unit 50 determines whether or not there is an encoding unit CU to be decoded there. In the event that there is an encoding unit to be decoded, the image decoding unit 50 advances to step ST128, and in the event that there is no encoding unit, it returns to step ST124.

In step ST128, the image decoding unit 50 sets the identification information for the selection candidates. The quantization parameter calculation unit 59 of the decoding unit 50

L2, images sets the identification information for the institutes

Mexican selection candidates in the same way as with the t £ ¡dtafropl © clacl

Industrial information generation of the image coding device 10. That is, the quantization parameter calculation unit 59 takes the quantization parameters of spatially or temporally decoded encodings peripheral to the encoding unit to be decoded, as selection candidates. Furthermore, in the case that no quantization parameter is set for the block due to being a jump block or having no residual information, or in the case that a quantization parameter is equal to another candidate, these are excluded from the candidates of selection. The quantization parameter calculation unit 59 sets the identification information equal to the image coding device 10, for example, the index (index_qp_block_ref), for the candidate quantization parameters, and proceeds to step ST129.

In step ST129, the image decoding unit 50 obtains the identification information and the difference information.

The lossless decoding unit 52 of the image decoding unit 50 extracts the identification information and the difference information included in the flow information in the image coding device 10, i.e. the index (ref_qp_block_index) and the difference

The lossless decoding unit 52 identifying information and the information extracted to the unit 59 for calculating the

institute supplies the Mexican Property Law of Differejn {jusfrfa| quantization parameter and advance to step ST130.

In step ST130, the image decoding unit 50 uses the identification information and the difference information to calculate the quantization parameters. The quantization parameter calculation unit 59 of the image decoding unit 50 computes the Expression (31) using the quantization parameter ref_qp (ref_qp_block_index) corresponding to the index (ref_qp_block_index) which is the identification information, and (qb_qp_delta ) which is the difference information. That is, by adding the difference to the prediction quantization parameter, the quantization parameter of the encoding unit to be decoded is calculated. The quantization parameter calculation unit 59 provides the quantization parameter of the encoding unit to be decoded (ActualQP) as output to the reverse quantization unit 53, and returns to step ST124.

In this way, using the identification information and the difference information included in the flow information, the quantification parameters

related to the block> to be even if the block parameters are not included in the decode they can be res

Institute quantification of each lcMoxIcono Property flow information. That is, even if the encoding efficiency of the quantization parameters has been improved by using the identification information and the difference information in the image encoding device 10, the quantization parameters relating to each of the blocks can be restored and the decoding processing can be successfully performed to generate a decoded image in the image decoding unit 50.

6. Other Operations of the Image Coding Device and the Image Decoding Device

With the above-described operations of the image encoding device and the image decoding device, the quantization parameters of blocks spatially or temporarily encoded adjacent to the block to be encoded are taken as selection candidates. Furthermore, a quantization parameter selected from the selection candidates according to a quantization parameter established as regards the block to be encoded is taken as a prediction quantization parameter. Additionally, the coding efficiency of the quantization parameters is improved by including, in the flow information, the

quantification information selection, and identification for prediction information

from the dM0XÍCCSno candidates of the Difference Property indicating 14ndU5frlCri difference between the prediction quantization parameter and the quantization parameter set for the block to be encoded.

However, the selection candidates are not restricted to the quantization parameters of blocks spatially or temporarily coded adjacent to the block to be encoded, and the last updated quantization parameter may be included in the selection candidates. As described below, even a block where spatially or temporally adjacent blocks do not involve inverse quantization, a quantization parameter of a block at a position close to the block to be encoded can be set as a prediction quantization parameter. Additionally, the quantization parameters may be implicitly or explicitly predicted quantization parameters of the selection candidates, and the difference information indicating the difference between the predicted quantization parameters and the quantization parameter of the block to be encoded can be generated.

Next, a description will be made regarding a case of deciding the minimum unit size of the

quantification (MinQpUnitSize) according to the size of the coding unit, and select

implicitly or explicitly a prediction JndUStflal quantization parameter from the selection candidate quantization parameters, as another operation of the image encoding device and the image decoding device. Note that the description will now be made regarding the differing portions of the image encoding device and the image decoding device described above.

In the case of implicitly or explicitly selecting a prediction quantization parameter from the quantification parameters of the selection candidates, the image encoding device includes distinguishing information qp_explicit_indication indicating whether to decide explicitly or implicitly on the quantization parameters. Furthermore, an arrangement can be made with the image encoding device and the image decoding device where it is decoded beforehand whether to implicitly decide or explicitly decide the quantization parameters.

Implicitly deciding the quantization parameters means that a prediction quantization parameter equal to the image encoding device can be selected in the image decoding device,

the parameters without supplying identification information to select the Mexican Institute for Prediction Quantification from RXftopleddd Industrial selection from the image candidate encoding device to the image decoding device. Specifically, there is a method of selecting a quantization parameter from selection candidates based on a previously decided order of priority and deciding on the prediction quantization parameter, a method of taking a stochastic value from the quantization parameters of selection candidates as a predictive quantification parameter, a method of weighting the quantification parameters of the selection candidates according to the distance from the current block, and taking a stochastic value of the weighted quantization parameters as a prediction quantization parameter, or the like.

Deciding explicitly on the quantization parameters means that a prediction quantization parameter equal to the image encoding device can be selected on the image decoding device, supplying identification information to select the prediction quantization parameters from the candidate candidates. selection from the image encoding device to the image decoding device. Specifically, there is a method of calculating the

index information that specifies a selection in the encoding device include this in the stream information, propiedadα image property and use the candidate selection quantization parameter indicated in the index information as the prediction quantization parameter in the device of image decoding, a method where the index information is not included in blocks referring to which the quantification is not performed, and so on.

Figure 23 is a flowchart to describe another operation of the image encoding device, illustrating the encoding processing of the slice. In step ST141, the image coding device 10 determines whether or not there is a coding unit CU to be coded. In the event that a coding unit that has not undergone coding processing exists in a slice to be codified, the image coding device advances to step ST142. In the event that the encoding processing has been completed for all the encoding units in the slice, the image encoding device 10 terminates the encoding processing of the slice.

In step ST142, the image encoding device 10 divides the encoding unit CU. The image encoding device divides the encoding unit CU as illustrated in Figure 5, decides

The unit's coding institute costs is small, and proceeds to where the value of the function to Property step ST143. Furthermore, in order InÜUSfílCri to allow the determination of the size of the coding unit where the value of the cost function is small, the image coding device 10 includes in the flow information, for example, Coding tree syntax, a division_coding_unit_indication equivalent to the division indication in Figure 5.

In step ST143, the image encoding device 10 determines whether or not the reverse quantization is involved with the encoding unit to be encoded. In the case that the encoding unit CU to be encoded is a block of a mode that does not require reverse quantization using the quantization parameters to perform decoding, for example, the jump mode or I_PCM mode block, or direct mode ( CBP (Coded Block Pattern) = 0), the image coding device 10 returns to step ST141, and in the case of a block where inverse quantization is performed, it advances to step ST144.

In step ST144, the image encoding device 10 determines whether or not the size of the encoding unit CU is log2MinQpUnitSize or larger. In the event that the size of the encoding CU unit is

log2MinQpUnit Size or larger, the device

Intuitive image encoding advances to step ST145. In addition Jftaxlcano to the encoding CU Property not sdfldUStriaJ the unit log2MinQpUnitSize or larger, the image encoding device 10 advances to step ST152.

In step ST145, the image encoding device 10 decides a quantization parameter QP for encoding unit CU to be encoded. The speed control unit 18 la of the image coding device 10 decides the quantization parameter according to the complexity of the image of the coding unit as described above, or such that the value of the cost function is small , and advance to step ST146.

In step ST146, the image encoding device 10 determines whether or not the distinguishing information qp_explicit_indication allowing identification of whether the quantization parameters are to be implicitly or explicitly predicted is 1. In the event that the distinguishing information qp_explicit_indication is "1, and the quantization parameters are to be explicitly predicted, the image encoding device 10 advances to step ST147. Furthermore, in the case that the distinguishing information qp_explicit_indication is 0 and the quantization parameters are to be implicitly predicted, the image encoding device 10 advances to the

step ST149. He compares the information value of coding device 10 of the cost function in that of images WufO

Mexican case d $ da Industrial Property distinction qp_explicit_indication is set to 1 and the value of the cost function in the case that the information of distinction qp_explicit_indication is set to 0, for example. The image encoding device 10 sets the value of the distinguishing information qp_explicit_indication such that the encoding efficiency is higher based on the comparison results. Furthermore, in the case that the distinguishing information qp_explicit_indication can be set by the user, the image encoding device 10 sets the distinguishing information qp_explicit_indication in accordance with the user's instructions.

In step ST147, the image encoding device 10 generates the identification information. The image coding device 10 selects a candidate from the selection candidates such that the difference in terms of the quantization parameter of the coding unit to be coded is smaller in the information generating unit 19 as described above, and takes this as a prediction quantization parameter. The image coding device 10 takes, for example, the block quantization parameters

spatially or temporally encoded adjacent to the block jstltutO to be encoded to the last, and the procedures parameter

Mexican quantification act

Industrial processing established in the main block of the slice, as selection candidates. The image coding device 10 selects a candidate from the selection candidates where the difference as regards the quantization parameter of the encoding unit to be encoded is smallest, and takes this as a quantization parameter of prediction. Additionally, the information generating unit 19 takes the index (ref_qp_block_index) of the selected candidate to be the identification information for selecting a prediction quantization parameter from the selection candidates, and advances to step ST148.

In step ST148, the image encoding device 10 includes the identification information in the stream information. The image encoding device 10 includes the identification information generated in step ST147, and advances to step ST150.

In step ST149, the image encoding device 10 implicitly decides a prediction quantization dQP parameter. That is, the image coding device 10 predicts a quantization parameter with a method equal to unit 50 of

decoding to predict the quantization ϊ

images. Regarding ... a Mexican method of quantification parameter, the

Prediction induftrif * 'are decoded based on a priority order decided in advance, for example. Furthermore, a stochastic value of multiple candidate quantization parameters can be taken as a prediction quantization parameter. Additionally, a method of weighting the quantification parameters of the selection candidates according to the distance from the current block, and taking a stochastic value of the weighted quantization parameters as a prediction quantization parameter, or the like, can be used. The image encoding device 10 calculates the prediction quantization parameter and proceeds to step ST150.

In step ST150, the image encoding device 10 generates the difference information. The image encoding device 10 calculates the difference between the prediction quantization parameter indicated by the identifying information generated in step ST147 and the decided quantization parameter in step ST145, or the difference between the decided prediction quantization parameter in step ST149 and the quantization parameter decided in step ST145. The image encoding device 10 generates the difference information indicating the calculated difference and proceeds to step ST151.

In the stage images includes ^ of distinction in

ST151, 'the encoding device 10 of | y | gxjgQ ^ Q the difference information and the inf

Industry!

the image encoding includes the difference information generated in step ST151 and the distinction information qp_explicit_indication used in step ST146 in the flow information. The image encoding device 10 includes the distinguishing information in one of, for example, the sequence parameter set, the frame parameter set, the slice header, or the like, and proceeds to step ST152.

In step ST152, the image encoding device 10 performs the quantization of the encoding unit CU. The image coding device 10 performs the quantization of the coding unit using the decided quantization parameter, and returns to step ST141.

Figure 24 is an example of operation in a case of implicitly predicting the quantization parameters, and Figure 25 illustrates an example of the flowchart in a case of explicitly predicting the quantization parameters. Note that a case of three selection candidates is illustrated to facilitate the description.

As illustrated in (A) in Figure 24, the parameter of

quantification of the block to be coded in the table to be Iflgtüutí r · 'Mexicana QP_0. In addition, the (JjffcfPrOpladG industry encoding QP_A quantization is, for example, candidates are the left adjacent encoded block parameter, the adjacent encoded block QP_B quantization parameter, and the QP_LS quantization parameter of a decoded encoding unit.

In Figure 25, at step ST161, the image encoding device 10 determines whether or not the quantization parameters QP_A QP_B can be referred to. In the case that the adjacent code block to the left and the adjacent code block above are not blocks in a way that does not require reverse quantization using the quantization parameters to perform decoding, for example, the jump mode block or I_PCM mode , or direct mode (CBP (Coded Block Pattern) = 0), the image coding device 10 determines that the reference can be made and proceeds to step ST162. Furthermore, in the event that at least one of the quantization parameter QP_A and the quantization parameter QP_B is a mode that does not require reverse quantization, it proceeds to step ST163.

In step ST162, the image coding device 10 takes the average value of the quantization parameters QP_A QP_B to be the prediction quantization parameter dQP. That is, as illustrated in (B)

In Figure 24, in the case that the parameters institute quantification QP A QP B can be referred, the valW ^spout of the average industrial property of the quantification parameters QP_A QP (QP_A + QP_B +

1) / 2 is taken as the prediction quantization dQP parameter.

At the stage

ST163, the image encoding device 10 determines whether or not the quantization parameter

QP_A can be referred. In the case that the adjacent code block to the left is not a mode where there is no need to perform the reverse quantization, the image coding device 10 determines that it can be referred, and proceeds to step ST164. Furthermore, in the case that the adjacent code block to the left is a mode where there is no need to perform the reverse quantization, the image coding device 10 determines that it cannot be referred, and proceeds to step ST165.

In step ST164, the image encoding device 10 takes the quantization parameter QP_A as the prediction quantization parameter dQP. That is, in the case that the quantization parameter QP_A can be referred and the quantization parameter QP_B cannot be referred, as illustrated in (C) in Figure 24, the quantization parameter QP_A is taken as the parameter dQP prediction quantification. Note that in Figure 24 and Figure 26 below, the blocks in a way that

it does not need quantification they cannot be referred, it is, _ .. Inverse institute, that is, the blocks indicate by shading, d © the Property

Industrial

In step ST165, the image encoding device 10 determines whether or not the 'quantization parameter QP_B can be referred to. In the case that the adjacent coded block above is not a mode where there is no need to perform reverse quantization, the image coding device 10 determines that it can be referred, and proceeds to step ST166. Furthermore, in the case that the adjacent coded block above is a mode where there is no need to perform reverse quantization, the image coding device 10 determines that it cannot be referred, and proceeds to step ST167.

In step ST166, the image encoding device 10 takes the quantization parameter QP_B as the prediction quantization parameter dQP. That is, in the case that the quantization parameter QP_B can be referred and the quantization parameter QP_A cannot be referred, as illustrated in (D) in Figure 24, the quantization parameter QP_B is taken as the parameter dQP prediction quantification.

In step ST167, the image encoding device 10 takes the quantization parameter QP_LS as the prediction quantization dQP parameter. As illustrated in (E) in Figure 24, in the case that the coded block

^^ splendor ~ IndusHr '.

adjacent to the left and the adyp.fr encoded block above are a mode where there is no need to perform

Mexican inverse quantification, the quantification parameter is taken as the dQP parameter of prediction quantization.

Figure 26 illustrates another example of a case operation implicitly predicting the quantization parameters. For example, as illustrated in (E) in Figure 24, in the case that the adjacent code block to the left and the adjacent code block above are a mode where there is no need to perform inverse quantization, the default quantization parameter It can be generated by increasing the number of selection candidates. For example, as illustrated in (A) in Figure 26, the quantization parameter QP_C of the upper right adjacent code block, the quantization parameter QP_D of the upper left adjacent code block, and the quantization parameter QP_E of the coded block adjacent to bottom left, added to selection candidates.

In the case that the quantization parameters QP_C, QP_D, and QP_E can be referred to as illustrated in (B) in Figure 26, the image coding device 10 takes the average value (QP_C + QP_D + 1) / 2 of the quantization parameters QP_C and QP_D, or the median, as the prediction quantization dQP parameter.

100

In the event that the quantification parameters.

HISTORY

Figure 26, the device average value (QP_C +

QP_D + 1) / of the quantization parameters QP_C and

QP_D as the prediction quantization dQP parameter.

In the event that the parameters of

QP_E can be referred to as QP_D quantification and illustrated in (D) in

Figure 26, the image coding device 10 takes the average value (QP_D + QP_E +1) / 2 of the quantization parameters HQP_D and QP_E as the dQP parameter of prediction quantization.

In the case that the quantization parameters QP_C and QP_E can be referred to as illustrated in (E) in Figure 26, the image coding device 10 takes the average value (QP_C + QP_E +1) / 2 of the parameters of QP_C and QP_E quantization as the prediction quantization dQP parameter.

In the event that the quantization parameters QP_C, QP_D, and QP_E cannot be referred to as illustrated in (F) in Figure 26, the image encoding device 10 takes the quantization parameter QP_LS as the dQP parameter of quantization of prediction. Note that Figure 27 illustrates a program for performing operations from (B) to (D) in Figure 24 and (B) to (F) in Figure 26.

101 that the number to be referred to Figure 26, referred to is this paratrode '^^

Mexican TOC2fe Impiety parameter d J ^ dustricíl use as

In addition, in the case of quantification that can be illustrated in (G) to (I) in quantification, the prediction quantization parameter dQP can be.

In this way, the image encoding device 10 takes the quantization parameters such as blocks spatially or temporarily coded adjacent to a block to be encoded as selection candidates, and selects a prediction quantization parameter from the candidates for selection in accordance with an established quantification parameter. Furthermore, the image coding device 10 generates the identification information to select a prediction quantization parameter from the selection candidates. Additionally, the image encoding device 10 generates the difference information indicating the difference between the prediction quantization parameter and the quantization parameter set for the block to be encoded. The image encoding device 10 includes the identifying information and the difference information generated in the stream information. By performing such processing, the difference between the quantization parameter of the block to be encoded and the prediction quantization parameter can be prevented from becoming a

102 big value. Consequently, Institute device 10

Mexican imaging can improve the efficiency of industrial coding encoding quantification parameters.

Furthermore, in the case of implicitly prediction quantization parameters, a prediction quantization parameter equal to the image encoding device can be used in the image decoding device 50, not including identifying information to select the quantization parameters of prediction from the selection candidates in the flow information.

Additionally, by including the distinguishing information in the flow information, the explicit prediction of the prediction quantization parameters and the implicit prediction of the prediction quantization parameters can be adaptively switched.

Figure 28 is a flow chart for describing other operations of the image decoding device. In step ST127 in Figure 22, in the event that a determination is made that there is a coding unit to be decoded, the image decoding unit 50 performs the processing from step ST171, and performs the decoding of the coding unit .

In step ST171, the image decoding unit 50 extracts the information. Decoding unit 50

103

of images extracts the information from the information,,. ,,,,.,. ._,,. Í, ^ Mexican stream for use in decoding the unit. .

coding. For example, the Syntax J ^ USfrlCS 'information is extracted from the encoding tree that allows the determination of the size of the encoding unit, the log2_min_qp_unit_size_size_size information that allows the determination of the minimum unit size of the quantization parameter, the distinction information qp_explicit_indication , and so on, and advance to step ST172.

In step ST172, the image decoding unit 50 splits the encoding unit CU. The image decoding unit 50 divides the encoding unit CU based on division_coding_indication_indication_and others included in the stream information, and proceeds to step ST173.

In step ST173, the image decoding unit 50 determines whether or not the encoding unit CU to be decoded involves inverse quantization. In the event that the encoding unit CU to be encoded is a mode where reverse quantization is performed using the quantization parameters, the image decoding unit 50 advances to step ST174, and in the case of a block where it is not Reverse quantization using the quantization parameters is required, decoding processing ends.

104

In step ST174, unit 50 of CU unit fttftituto

Senior Mexican. In ($ & Ια «ΡΚφΙ« Κ ^ 1ΰ Industrial or

encoding is log2MinQpUnitSize

<td>that the size of</td><td>unit</td><td>CU</td><td>of</td><td>coding</td><td>is</td>

<td>log2MinQpUnitSize</td><td>or older,</td><td>F</td><td>the</td><td>unit 50</td><td>of</td>

<td colspan="2">image decoding advances to</td><td>the</td><td>stage</td><td>ST175. Further,</td><td>in</td>

<td>the case that size</td><td>of the unit</td><td>CU</td><td colspan="2">coding no</td><td>is</td>

<td>log2MinQpUnitSize</td><td>or older,</td><td>F</td><td>the</td><td>unit 50</td><td>of</td>

decoding images advances to the stage

ST180.

In step ST175, the image decoding unit 50 determines whether or not the distinguishing information qexplicitindication is 1. In the event that the distinguishing information qp_explicit_indication included in the stream information is 1, and the quantization parameters are to be predicted explicitly, the image decoding unit 50 advances to step ST176. Furthermore, in the case that the distinguishing information qp_explicit_indication is 0 and the quantization parameters are to be implicitly predicted, the image decoding unit 50 advances to step ST178.

In step ST176, the image decoding unit 50 extracts the index (index_qp_block_ref) from the stream information and proceeds to step ST177.

In step ST177, the image decoding unit 50 decides the quantization parameter dQP of

105 [t prediction. The unit 50 selects the decoding index parameter (ref_qp_block_index) quantization with from quantization of the image base encoding device 10 candidates in

Institute andffl®xlcano gives the Property the selection parameters, images, delndUStiÍG 'equal to decides the selected quantization parameter to be the prediction quantization dQP parameter, and advances to step ST179.

In step ST178, the image decoding unit 50 implicitly decides the prediction quantization dQP parameter. The image decoding unit 50 predicts the quantization parameter with a method equal to the image coding device 10. As for a method of predicting the quantization parameter, a quantization parameter can be decided based on a previously decided order of priority, for example. Furthermore, a stochastic value of the quantification parameters of the selection candidates can be taken as a prediction quantization parameter. Additionally, a method of weighting the quantification parameters of the selection candidates according to the distance from the current block, and taking a stochastic value of the weighted quantization parameters as a prediction quantization parameter, or the like, can be used. Image decoding unit 50 predicts

106 the quantization parameter and advance to step ST179j Q

At the stage

ST179, the unit 50 images calculates the parameter

QP of,,, .... , Decoding Institute <^ex | cano quantification

Industry 'unit

Current encoding CU.

The image decoding unit 50 obtains the difference information qb_qp_delta from the flow information, adds this difference information to the dQP parameter of

<td>quantification</td><td>of</td><td>prediction,</td><td colspan="2">calculate the parameter</td><td>of</td>

<td>quantification</td><td>of</td><td>unit</td><td>coding</td><td>to</td><td>to be</td>

<td>decoded, and</td><td colspan="2">advance to the stage</td><td>ST180.</td><td></td><td></td>

In step ST180, the image decoding unit 50 performs the reverse quantization of the encoding unit. The image decoding unit 50 performs the reverse quantization of the encoding unit using the decoded quantization parameter.

Consequently, the image decoding unit 50 can perform image decoding using quantization parameters equal to the quantization parameters used by the image encoding device.

7. Software Processing Case

The series of processing described above can be performed using hardware, software, or a combined configuration of both. In the case where software processing is performed, a program in which

107

records a processing sequence

Institute memory within hardware embedded in the computer, and the Property's MeXlCGhC runs. Alternatively, a program can be installed in Industry 'a general-purpose computer through which various types of processing can be performed.

Figure 29 is a diagram illustrating a schematic configuration of a computing device that executes the above-described series of processing using a program. A CPU 801 of the computer device 80 performs various types of processing according to a program stored in ROM 802 or registered in a registration unit 808.

Programs run by CPU 801, data, and so on, are stored in RAM 803 as appropriate. CPU 801, ROM 802, and RAM 803 are mutually connected by means of a bus bar 804.

An input / output interface 805 is also connected to the CPU 801 via the busbar 804. An input unit 806 such as a touchpad, keyboard, mouse, microphone, or the like, and an output unit 807 made of a display or the like, are also connected to CPU 801. CPU 801 performs various types of processing in accordance with commands entered from input unit 806. The CPU 801 then outputs the processing results to the output unit 807.

108

input / output is constituted for example, a disk Mexican Institute CPU 801 executes, and όιν ^ φρ ^^^ Industrie communication communicates with hard, and registers programs that the data types. A unit 809 of external devices by means of wired or wireless communication means such as networks such as the Internet or local area networks, or digital broadcasting or the like. Furthermore, the computer device 80 can acquire programs by means of the communication unit 809 and register in the ROM 802 or the registration unit 808.

In the event that removable media 85 such as a magnetic disk, an optical disk, a magneto-optical disk, or semiconductor memory or the like are mounted to the logical unit 810, they are powered, and the programs, data, and the like are obtained , registered there. The programs and data obtained are transferred to ROM 802 or RAM 803 or registration unit 808 as necessary.

The CPU 801 reads and executes a program by performing the above-described series of processing, and performs encoding processing of the image signals recorded in the registration unit 808 or the removable media 85 or the imaging signals supplied by means of communication unit 809, or stream information decoding processing.

109

8. Device Application Case

Furthermore, in the above, the one used as the format of

Electronic format H.264 / AVC is JgStSÍUtO

Mexican encoding / formatJaPl®pl®Ctad

Industrial decoding, but the present technology can also be applied to the image encoding device / image decoding device that uses one encoding format / decoding format that performs other motion prediction / compensation processing.

Furthermore, the present technology can be applied to the image coding device and to the image decoding device used when receiving the stream information obtained by performing the coding processing, as with MPEG, H.26x or the like, by means of network media such as satellite broadcasting, cable TV, the Internet, cell phone, or the like, or at the time of processing on a storage medium such as an optical disk or a magnetic disk, and flash memory.

Next, the description will be made regarding an electronic device to which the image encoding device 10 and the image decoding device 50 described above have been applied.

Figure 30 exemplary illustrates a schematic configuration of a television set to which the present technology has been applied. Television apparatus 90 has a

110 antenna 901, a tuner decoder 904, a video unit, a 906 unit of

Institute

905 signal processing ^ jgg ^ Q

Maustriai property deployment, one unit

audio, a 908 speaker, and an external interface unit 909. In addition, the television set has a control unit 910, a control unit

911 user interface or the like.

Tuner 902 performs demodulation by choosing a desired channel from the broadcast wave signals received at antenna 901, and outputs the flow obtained to demultiplexer 903.

The demultiplexer 903 extracts the packet of a video and audio of a program to be viewed from a stream and outputs the data of the extracted packets to the decoder 904. In addition, the demultiplexer 903 supplies the data packets such as EPG (Electronic Program Guide) to the 910 control unit. Note that in case the scrambling has been performed, the scrambling is done in a demultiplexer or the like.

Decoder 904 performs the packet decoding process, and outputs the video data generated by being subjected to the decoding processing to the video signal processing unit 905 and the audio data to the signal processing unit 907. audio.

111

Processing unit 905

performs video processing according to the settings ^ ft ^ C ^0 Give it User property and noise reduction, on videiOdUStrlnl data

The video signal processing unit 905 generates the video data for displaying programs in the display unit 906 and the image data according to the processing based on the applications supplied through the network. In addition, the video signal processing unit 905 generates video data for displaying menu screens or the like such as for item selection, and superimposes these on the program video data. The video signal processing unit 905 generates drive signals based on the video data thus generated and drives the display unit 906.

The display unit 906 drives a display device (eg, a liquid crystal display device or the like) based on the drive signal from the video signal processing unit 905 in order to display the program video.

The audio signal processing unit 907 subjects the audio data to predetermined processing such as noise reduction and performs the audio output by performing D / A conversion processing and amplification processing of the audio data after processing and supplying speaker 908.

112

The external interface unit 909 connected to external equipment or a network, and receiving data such as data

performs the transmission of the video or data property ^ (justrla 'audio.

The user interface unit 911 connects to the control unit 910. The user interface unit 911 is configured from an operation switch or a remote control signal receiver or the like, and supplies the operation signals according to user operation to the control unit 910.

The control unit 910 is configured using a CPU (Central Processing Unit), memory or the like. The memory stores the programs to be executed by the CPU, and various data necessary for the CPU to carry out the processing, the EPG data, the data obtained through the network, and the like. The program stored in memory is read by the CPU at a predetermined time such as when the television set 90 is turned on and is executed. The CPU controls each part so that the television apparatus 90 operates in accordance with the user's operations by executing a program.

<td>Notice</td><td>than</td><td>with</td><td>the apparatus</td><td> 90</td><td colspan="2">of TV,</td><td>I know</td>

<td>provides</td><td>a</td><td colspan="2">busbar</td><td> 912</td><td>for</td><td>connect</td><td>a</td>

<td>tuner</td><td> 902,</td><td>a</td><td>desmult iplexor</td><td> 903,</td><td>a</td><td>unit 905</td><td>of</td>

video signal processing, a 907 unit of

113 audio signal processing, an external unit 909 and a control unit 910.

With the television set thus configured

Mexican d @ the Property that of the image decoding device (image decoding method) of the present application is provided to the 904 decoder. Accordingly, even if the processing is performed in the image encoding processing on the broadcasting station side to reduce the amount of code required to transmit the quantization parameters, the television device can correctly restore the quantization parameters and generate a decoded image.

Figure 31 illustrates exemplary a schematic configuration of the cell phone to which the present technology has been applied. The cell phone 92 has a unit

922 , an audio encoder-decoder 923, a camera unit 926, an image processing unit 927, a multiplexing separation unit 928, a record reproduction unit 929, a display unit 930, and a recording unit 931. control. These are connected to each other through a busbar 933.

Furthermore, an antenna 921 is connected to the communication unit 922, and a speaker 924 and a microphone 925 are connected to the audio encoder-decoder 923. Also, a unit

114

932 unit connects to control unit 931 .. | β as the transmission and reception of

Instigated

The cellular telephone 92 performs various operations such as: transmission and reception of image and e-mail data, image taking, data recording, and so on, in various modes such as the audio calling mode. or the data communication mode.

In an audio calling mode, the audio signals generated at the microphone 925 are converted to audio data and data compression is performed on the audio encoder 923 encoder and supplied to the communication unit 922. Communication unit 922 performs demodulation processing of the audio data and frequency conversion processing of the audio data to generate transmission signals. In addition, the unit

922 The communication signal supplies the transmission signals to the antenna 921 in order to be transmitted to a base station not shown. In addition, the communication unit 922 performs amplification, frequency conversion processing, and demodulation processing of the receive signals received at antenna 921, and supplies the obtained audio data to audio encoder-decoder 923. Audio encoder-decoder 923 performs data decompression of audio data and conversion to analog audio signals and provides output to the

115

I '

speaker 924.

In addition, in carrying out the

Institute the mode of data communication, in the cdlfoxfcano delaPropioaaS email, the unicfadiKfyfa | Transmission of

931 The control unit receives text data entered by the operation unit 932 operation and displays the input text to the display unit 930.

In addition, the unit

931 The control unit generates email data based on the user's instructions on the operating unit 932 and supplies the communication unit 922.

The communication unit 922 performs modulation processing, frequency conversion processing, etc., of the email data, and transmits the transmitted signals obtained from antenna 921. In addition, the unit

922 Communication performs the frequency conversion, and receive processing received with the 921 antenna, and restores the email data. This email data is supplied to the display unit 930 for displaying the email content.

Note that the cell phone 92 can store the received email data on the storage medium in the record / playback unit 929. The storage medium is any storage medium that is readable / writable. For example, the means of

116 storage is a semiconductor memory such as RAM or Institute

Mexican such caite Impropiedad. . . Industry?

optical disk, built-in flash memory, removable media hard disk, a magnetic disk, an MO disk, a memory

USB, a memory card, or the like.

In the event that the image data is transmitted in a data communication mode, the image data generated in the camera unit 926 is supplied to the image processing unit 927. The image processing unit 927 performs encoding processing of the image data and generates the stream information.

The separation-multiplexing unit 928 multiplexes the flow information generated in the image processing unit 927 and the audio data supplied from the audio encoder-decoder 923 in a predetermined format and supplies the communication unit 922. Communication unit 922 performs demodulation processing, frequency conversion processing, and the like of multiplexed data, and transmits the transmitted signals obtained from antenna 921. In addition, communication unit 922 performs amplification, processing frequency conversion, demodulation processing, or the like, of the received signals received at antenna 921, and restores the multiplexed data. This multiplexed data is supplied to the split-multiplex unit 928. Unit 928 of

117 separation-multiplexing performs the separation of

multiplexed, and supplies processing unit 927 '43 J η 4ΖΊ η IriStlhj'te the flow information to _ «theta Property of images and the data from audiOj-j, .- * ^, to the audio encoder-decoder 923.

The image processing unit 927 performs decoding processing of the encoded data, and generates the image data. This image data is supplied to the display unit 930 to display the received image. Audio encoder-b-decoder 923 converts audio data into analog audio signals and supplies speaker 924 to provide the received audio as output.

With the cell phone device thus configured, the image processing unit 927 has the functions of the present application. Consequently, data can be reduced by performing encoding processing and image transmission, for example. Furthermore, in the decoding processing of the received image, the quantization parameters can be restored and a decoded image can be generated.

Figure 32 illustrates exemplary a schematic configuration of the recording playback device to which the present technology has been applied. The recording / playback device 94 records, for example, the audio data and the video data of the received broadcast program to a means of recording a user's instructions to a user.

register, and provides them in a time agree <jjgi |to ) i ^ledssd Furthermore, an arrangement can be made ^ ® ^ ® 'such that the recording / playback device 94 can acquire, for example, the audio and video data from other devices, in order to record to a recording medium. registry.

Furthermore, an arrangement can be made such that the recording / playback device 94 can perform, by decoding the audio data and the recorded video data on a recording medium, providing as output the image display and the audio output on devices. monitor.

The record / playback device 94 has a tuner 941, an external interface unit 942, an encoder 943, a unit 944 HDD (Hard Disk Drive), a unit 945 disk, a selector 946, a decoder

947, a 948 OSD (On Screen Display) unit, a 949 control unit, and a 950 user interface unit.

Tuner 941 selects a station on a desired channel from the broadcast signals received on an antenna not shown. Tuner 941 outputs the coded stream obtained by demodulating the receive signals of the desired channel to selector 946.

The external interface unit 942 is configured at

119

Üll

IEEE1394, an external interface interface is less than any of a network interface interface, a USB interface, flash, and so on. The interface unit 942 to be connected to an external device, network, memory card, or the like, and performs the reception of data such as video data and audio data to be recorded.

Encoder 943 performs encoding processing in a case where video and audio data supplied from external interface unit 942 is not encoded in a predetermined format and outputs the stream information to selector 946.

The 944 HDD records the content data such as video or audio, various programs, other data, or the like, on a built-in hard drive, and also reads these at playback from the hard drive.

The disk unit 945 records or reproduces the signals to a mounted optical disk. An optical disc is, for example, a DVD disc (DVD-Video, DVDRAM, DVD-R, DVD-RW, DVD + R, DVD + RW or the like) or a Bluray disc or the like.

The selector 946 selects, at the time of video and audio recording, either the tuner 941 stream or the 943 encoder, and supplies either the 944 HDD and the 945 disk drive. Also, selector 946

120 supplied at the time of reproduction

institute flow provided as output from disk unit 945 to decoder 947.

unit 944 HDDMgxICOTIO of ία Industrial Property

Decoder 947 performs the stream decoding process. Decoder 947 supplies the generated video data to the 948 OSD by performing decoding processing. Furthermore, the decoder 947 provides as output the audio data generated by performing the decoding processing.

The 948 OSD generates the video data to display menu screens or the like such as for item selection and superimposes these on the video data provided as output from the 947 decoder, and provides output.

The user interface unit 950 connects to the control unit 949. The user interface unit 950 is configured from an operation switch or a remote control signal receiver or the like and supplies the operation signals in accordance with the user's operations to the control unit 949.

Control unit 949 is configured using a CPU or memory. Memory stores a program run by the CPU and various necessary data when the CPU performs the processing. The program stored in memory is read and executed at a predetermined time such as at the time of

121 start of record / playback device 94,

CPU. The CPU controls each part so that the 9 ^ ΛθΧΐοαη ° d device of the Recording / Playback Project operates in accordance with the Industrie operation?

of the user, by executing a program.

With the recording / reproducing device thus configured, the functions of the present application are provided to encoder 943. Accordingly, the amount of data can be reduced by performing encoding processing and recording of images, for example. Furthermore, in the decoding processing of the recorded image, the quantization parameters can be restored and a decoded image can be generated.

Figure 33 illustrates exemplary a schematic configuration of an imaging apparatus to which the present invention has been applied. The imaging apparatus 96 forms images of a subject in order to display the image of the subject in a display unit, and to record this on a recording medium as image data.

The imaging apparatus 96 has an optical block 961, an imaging unit 962, a camera signal processing unit 963, an image data processing unit 964, a display unit 965, a unit 966 external interface, a memory 967 unit, a media 968 unit, a 969 OSD unit, and a control 970 unit. Also, a 971 interface unit

122 The user interface connects to the 970 control unit.

964 image data processing unit and external interface unit, 967 memory unit, ^ gggMaxIcano Property Unit 968 Industrial media unit,

969 OSD, and the 970 control unit and so on are connected via a 972 busbar.

Optical Block 961 is configured with a focusing lens, a diaphragm mechanism, and so on. Optical block 961 forms images of an optical image of a subject on an imaging surface of the imaging unit 962. The imaging unit 962 is configured using a CMOS or CCD image detector, and the optical image is generated by photoelectric conversion and supplied to the camera signal processing unit 963.

The camera signal processing unit 963 performs various kinds of camera processing such as KNEE correction and gamma correction, color correction and the like, to the electrical signals supplied from the imaging unit 962. The unit 963 supplies the image data after processing the camera signals to the image data processing unit 964.

The image data processing unit 964 performs the encoding processing of the image data

123 supplied from processing unit 963 of jfoyytr.o'nrí · tfelaPRspíedcro5 camera signals. The image data processing unit 964 supplies the stream information generated by performing encoding processing to the external interface unit 966 and the media unit 968. In addition, the image data processing unit 964 performs decoding processing of the stream information supplied from the external interface unit 966 and the media unit 968. The image data processing unit 964 supplies the generated image data to the display unit 965 by performing the decoding processing. In addition, the image data processing unit 964 performs the processing to supply the image data supplied from the camera signal processing unit 963 to the display unit 965, and the processing to overlay the data for display. acquired from 969 OSD unit on image data and supply to 965 display unit.

The 969 OSD unit generates the data for display such as a menu screen or icon made of signs, text, or shapes, and provides output to the image data processing unit 964.

For example, the external interface unit 966 is configured as USB input and output terminals, and in case of image printing, connects to a

124 printer. further

966 interface

removable media such as a magnetic disc, an optical disc, or the like are mounted as appropriate, and a program read from them is installed as needed. Furthermore, the external interface unit 966 has a network interface connected to a predetermined network such as a LAN or the Internet. For example, in accordance with the instructions of the user interface unit 971, the control unit 970 reads the flow information from the memory unit 967 in order to be supplied to the other devices connected via a network from the 966 external interface unit. In addition, the control unit 970 acquires the flow information and image data supplied from other devices via a network, via the external interface unit 966, in order to supply these to the data processing unit 964 of image.

For example, for a recording medium powered by the media unit 968, any removable media that is readable and writable can be used, such as a magnetic disk, MO disk, optical disk, and semiconductor memory. . In addition, with a recording medium, the removable media type is also optional, and can be a tape device, it can be a disk, or it can be a memory card. By routine, this can be an IC card

125 (

it is not contact or similar.

Institute

In addition, an arrangement can be made where the 968 'tola Pzopsedad registry unit is integrated and eg Industry!

media and the media are configured from a non-portable storage medium such as a built-in hard drive or

SSD (State Drive

Solid) or the like.

The control unit 970 is configured using a CPU memory, and so on. The memory stores programs to be stored by the

CPU, and various types of data necessary for the

CPU perform processing. The programs stored in the memory are read at the predetermined time, such as when the CPU 96 is started, they are executed. The

CPU controls each part so that the operations of the imaging device correspond to the operations of the user, by running the program.

With the imaging device thus configured, the processing unit 964 is provided with the functions of the present image data request. Accordingly, when encoding and recording the formed image to the memory unit 967 or a recording medium, the amount of data to be recorded can be reduced. In addition, in the decoding processing of the registered image, the quantization parameters can be restored and

126

can generate a decoded image.

Furthermore, as the present technology is not to be interspersed with the described modalities. The modalities are exemplary disclosed, and it is clearly understood that modifications and substitutions of the modalities can be accomplished by one skilled in the art without departing from the essence of the present technology. That is, the Claims must be taken into consideration to determine the essence of the present technology.

Furthermore, the image decoding device and the image coding device according to the present technology can assume the following configurations.

(1) An image decoding device, including:

an information acquisition unit configured to take the quantization parameters of spatially or temporally decoded blocks adjacent to a block to be decoded, as selection candidates, and extract, from the flow information, the difference information indicating the difference in terms of a prediction quantification parameter selected from the selection candidates; and a quantization parameter calculation unit configured to calculate, from the parameter of

127 prediction quantization and information differ a quantization parameter of the block to be decoded. MSXlCtShO d Industrial Image Decoding Property (2) The device according to (1), where the quantization parameter calculation unit establishes for the prediction quantization parameter a quantization parameter in an order indicated by the information ID included in the stream information, with adjacent decoded blocks in a predetermined order.

(3) The image decoding device according to (1), wherein the quantization parameter calculation unit performs the determination of the selection candidates in a pre-established order, and sets the prediction quantization parameter with based on the result of the determination.

(4) The image decoding device according to (1), wherein the quantization parameter calculation unit selects, based on the determination information included in the flow information, to perform one or the other of the set processing for the prediction quantization parameter a quantization parameter in an order indicated by the identification information included in the flow information, and the processing of determining the selection candidates in a pre-established order and setting the quantification parameter of

128 prediction based on the result of the determination.

(5)

The decoding device according to any one of (1) to (4), where calculation of the quantization parameter takes the images

Mexican la unidl? P'0l «'P| edOR£ i Industrial selection candidates, adjacent having at least excluded quantification blocks are redundant or blocks where the decoded blocks are parameters where inverse quantification is not performed using the quantization parameters.

(6) The image decoding device according to any one of (1) to (5), wherein, in the case that there is no selection candidate, the quantization parameter calculation unit takes a quantization parameter from a initial value in a slice as the prediction quantization parameter.

(7) The image decoding device according to any one of (1) to (6), wherein the quantization parameter calculation unit includes a quantization parameter updated to the last in the selection candidates.

(8) The image decoding device according to any one of (1) to (7), wherein the quantization parameter calculation unit calculates a quantization parameter of the block to be decoded by adding the difference to the difference information indicates to

129 prediction quantization parameter.

(9) A coding device comprises:

IndusWr.

a control unit configured to establish a quantization parameter as it relates to a block to be encoded;

an information generation unit configured to take the quantization parameters of blocks spatially or temporarily adjacent to a block to be encoded, as selection candidates, select from the selection candidates a prediction quantization parameter according to the parameter established quantification, and generating the difference information indicating the difference between the prediction quantization parameter and the established quantization parameters; and an encoding unit configured to include the difference information in the flow information generated by performing the encoding processing of the block to be encoded, using the established quantization parameter.

(10) The image coding device according to (9), wherein the information generation unit selects a quantization parameter of which the difference in terms of the established quantization parameter is the smallest, such as the

130 quantization parameter of (11) The device according to (10), where prediction, unit coding of

Institute

Mgxlcanc ^ opledad generation JgdUStria.

information generates the identifying information indicating the order of the blocks as regards the selected quantization parameter, with the adjacent encoded blocks in a predetermined order; and wherein the encoding unit includes the identifying information in the stream information.

(12) The image encoding device according to (11), wherein the information generating unit takes an order of arrangement where priority is given to one of an encoded block adjacent to the left side, an encoded block adjacent to the top, and a temporarily adjacent coded block.

(13) The image encoding device according to either (11) or (12), wherein the information generation unit can switch the order of arrangement of adjacent encoded blocks.

(14) The image coding device according to (9), wherein the information generation unit performs the determination of the selection candidates in a pre-established order, and selects the prediction quantization parameter based on the result of the determination.

131

(15) The agreement with information is an image coding device of the Instituto,, Mexicano (9), where the unit of gene rae i oiy ^ ^ Industrial Property! capable of selecting between the processing of selecting a quantization parameter of which the difference as regards the set quantization parameter is the smallest as the prediction quantization parameter, and processing performing the determination of the selection candidates in a pre-established order and selecting the prediction quantization parameter based on the result of the determination, and generating the determination information indicating the selected processing; and wherein the encoding unit includes the determination information in the flow information.

(16)

The image encoding device according to any one of (9) to (15) where the information generation unit takes the selection candidates, having excluded from the adjacent encoded blocks at least the blocks where the quantization parameters are redundant or blocks where quantification is not performed using the quantization parameters.

(17) The image coding device according to any one of (9) to (16), wherein, in the event that there is no selection candidate, the information generation unit generates the difference information indicating the

132 difference between a quantization parameter of a ΙιΜβΗοί ^ βΝΡΓ |

Initial institute in a slice, and the quantification parameters | fl @ x | 0anQ of the Property established. Industrial (18) The image coding device according to any one of (9) to (17), wherein the information generation unit includes a quantization parameter updated to the latest in the selection candidates.

Industrial Applicability

With the image decoding device, the image coding device, and the method thereof, according to this technology, the quantization parameters of spatially or temporarily coded blocks adjacent to a block to be encoded are taken as candidates for selection, and a prediction quantification parameter is selected from the selection candidates according to the established quantization parameter. The difference information is generated that indicates the difference between the prediction quantization parameter and the quantization parameters established as regards the block to be encoded.

Consequently, the difference in the quantization parameters can be prevented from becoming a large value, and the coding efficiency of the quantization parameters can be improved. Furthermore, in a case of decoding the

133

of the flow where the Institute information is included

Industry 'from the difference information quantization parameters selects spatially or temporarily decoded blocks adjacent to a block to be decoded, and a quantization parameter of the block to be decoded is calculated from the prediction quantization parameter and the information Of diference. Consequently, even in the event that the flow information is generated with improved encoding efficiency of the quantization parameters, in the case of decoding this flow information the quantization parameters can be restored based on the prediction quantization parameter and difference information, and decoding processing can be done correctly. Consequently, this is suitable for the equipment that transmits / receives the flow information obtained by performing the encoding in block increments, by means of network means such as satellite broadcasting, cable TV, the Internet, cell phones, and the like, and the equipment and the like that process it in a storage medium such as optical discs, magnetic discs, flash memory, and others.

List of Reference Symbols image coding device A / D conversion unit

134

12, 57 screen rearrangement buffer subtraction unit orthogonal transformation unit quantization unit lossless encoding unit

17, 51 storage buffer speed control unit information generation unit

Mexican Institute of Industrial Property

<td> 21,</td><td> 53</td><td>Unit</td><td>of</td><td>quantification</td><td>inverse</td>

<td> 22,</td><td> 54</td><td>Unit</td><td>of</td><td>transformation</td><td>reverse orthogonal</td>

<td> 23,</td><td> 55</td><td>Unit</td><td>of</td><td>addition</td><td></td>

<td> 24,</td><td> 56</td><td>filter</td><td>of</td><td>unlocking</td><td></td>

26, 61 frame memory

31, 71 intra prediction unit prediction unit / motion compensation prediction image selection unit / optimal mode image decoding device lossless decoding unit D / A conversion unit quantization parameter calculation unit

62, 73 selector motion compensation unit computer device television set cell phone

135 the recording / reproducing device quantization parameters

<td> 96 .</td><td>apparatus</td><td>of</td><td colspan="2">training i</td>

<td> 191</td><td>Unit</td><td>of</td><td>memory</td><td>of</td>

<td> 192</td><td>Unit</td><td>of</td><td>calculation</td><td>of</td>

<td> 591</td><td>Unit</td><td>of</td><td>calculation</td><td></td>

<td> 592</td><td>Unit</td><td>of</td><td>memory</td><td>of</td>

difference pictures

Institute r Mexican Industrial Property quantification parameters

136

59 members in 16 offices

This recordMember, by publication datePriority claim6 more offices are in the list below

Priority claims10

Priority claims
Document	Office	Kind	Date
2011011861	Japan	–	2011-01-24
2011011861	Japan	A	2011-01-24
2011011861	Japan	A	2011-01-24
2011153183	Japan	–	2011-07-11
2011153183	Japan	A	2011-07-11
2011153183	Japan	A	2011-07-11
2011011861	–	–	–
2011153183	–	–	–
JP20110011861	–	–	–
JP20110153183	–	–	–

Members59

Family members, oldest first
Document	Office	Kind
CA2823024A1	Canada	A1	2012-08-02
WO2012102088A1	World Intellectual Property Organization (WIPO)	A1	2012-08-02
JP2012170042A	Japan	A	2012-09-06
TW201242377A	Taiwan Province of China	A	2012-10-16
AU2012210001A1	Australia	A1	2013-07-04
CO6731124A2	Colombia	A2	2013-08-15
SG191994A1	Singapore	A1	2013-08-30
MX2013008289A	Mexico	A	2013-09-13
CN103329536A	China	A	2013-09-25
ZA201304818B	South Africa	B	2013-09-25
EP2645717A1	European Patent Office (EPO)	A1	2013-10-02
US2013266233A1	United States of America	A1	2013-10-10
US2013301710A1	United States of America	A1	2013-11-14
KR20140029381A	Republic of Korea	A	2014-03-10
US8787453B2	United States of America	B2	2014-07-22
SG10201406196PA	Singapore	A	2014-12-30
RU2013132921A	Russian Federation	A	2015-01-27
TWI495350B	Taiwan Province of China	B	2015-08-01
MX336094BThis record	Mexico	B	2016-01-08
AU2012210001B2	Australia	B2	2016-07-21
EP2645717A4	European Patent Office (EPO)	A4	2016-07-27
AU2016234951A1	Australia	A1	2016-10-13
MY158425A	Malaysia	A	2016-10-14
JP6056122B2	Japan	B2	2017-01-11
US9560348B2	United States of America	B2	2017-01-31
CN103329536B	China	B	2017-02-15
RU2615675C2	Russian Federation	C2	2017-04-06
JP2017079485A	Japan	A	2017-04-27
CN106878738A	China	A	2017-06-20
CN107087190A	China	A	2017-08-22
CN107087191A	China	A	2017-08-22
CA2823024C	Canada	C	2018-01-02
AU2016234951B2	Australia	B2	2018-01-04
US2018063530A1	United States of America	A1	2018-03-01
AU2018201382A1	Australia	A1	2018-03-15
KR101858289B1	Republic of Korea	B1	2018-05-15
KR20180053425A	Republic of Korea	A	2018-05-21
AU2018201382B2	Australia	B2	2018-11-08
JP2018191334A	Japan	A	2018-11-29
AU2019200515A1	Australia	A1	2019-02-14
KR101965119B1	Republic of Korea	B1	2019-04-02
EP3512198A1	European Patent Office (EPO)	A1	2019-07-17
US10419761B2	United States of America	B2	2019-09-17
US2019327471A1	United States of America	A1	2019-10-24
CN106878738B	China	B	2019-11-08
CN110602497A	China	A	2019-12-20
CN107087191B	China	B	2020-01-07
AU2019200515B2	Australia	B2	2020-02-06
CN110839154A	China	A	2020-02-25
RU2719453C1	Russian Federation	C1	2020-04-17
CN107087190B	China	B	2020-04-21
AU2020203010A1	Australia	A1	2020-05-28
BR112013018305A2	Brazil	A2	2020-07-28
US2020336743A1	United States of America	A1	2020-10-22
AU2020203010B2	Australia	B2	2021-01-28
AU2021201931A1	Australia	A1	2021-04-29
RU2020108486A	Russian Federation	A	2021-08-27
RU2020108522A	Russian Federation	A	2021-08-27
CN110602497B	China	B	2021-11-30

Image decoding device, image encoding device, and method thereof.

Abstract

Term

IVI P

I

PATENT TITLE NO. 336094

PRIORITY

CODING OF IMAGES, AND THEIR METHOD

TECHNICAL FIELD

BACKGROUND OF THE TECHNIQUE

BRIEF DESCRIPTION OF THE INVENTION

DESCRIPTION OF THE MODALITIES

T

HISTORY

I '

Priority claims10

Members59

Numbers

Titles2

Classification