Untitled record

Full description

The secret of the invention

The present invention deals with moving image encoding methods for encoding an input image on a phase-by-stage basis using inter-picture prediction with reference to the coded picture(s), as well as methods for decoding a moving image.

Based on decoding bitstream picture decoding methods 5

Merhama Merhama using image prediction.

In animation encoding, a general amount of information is compressed by using the spatial orientation and temporal orientation of the animation. Here, in general, one method that uses increment in a spatial direction is a frequency domain transformation, and one that uses increment

10 In a time direction it is inter-picture prediction coding (referred to as “inter prediction”). In inter-picture prediction coding, when an existing picture is encoded, a previous or subsequent encoded picture of the current picture is used in order Display as a reference picture. After that, a motion estimation is performed in the current image corresponding to the reference image to estimate the motion vector. After that, a difference between the data is obtained

15 Image created by motion compensation based on the estimated motion vector and image data of the current image in order to remove duplicates in a time direction. Here, in motion estimation, a difference value is calculated between the current stage in the image of a state and a stage in the reference image, and a stage containing the smallest difference value in the reference image is determined as a reference stage. Next, the motion vector is estimated by using the current lag and the reference lag.

٤٢٤٤

-٣-

In the motion picture coding scheme known as H.264 which has already been calibrated, to compress an amount of information, three image types are used: I-image, P-image, and B-image. I-image is an image in which inter prediction coding is not performed. In other words, inter-prediction encryption (here referred to as “inter prediction”) is performed in it.

5 A P-image is an image in which inter-predictive encoding is performed with reference to an encoded image located before or after the current image in the order of presentation. Image B is an image where inter-expectation encoding is performed with reference to two encoded images that lie before or after the current image in the order of presentation.

A reference picture list is created to specify a reference picture

<p dir="rtl">10 picture in inter prediction coding. A reference picture list is a list in which an encrypted reference picture is assigned that will be referenced in an inter-prediction with a corresponding value(s) to a reference picture index. For example, given that picture B can be encoded with reference to two pictures, the picture B contains two reference image lists (L1, L0).</p>

<p dir="rtl">15 Figure 1a is a diagram to illustrate the assignment of reference image indexes to each reference image. Figures 1b and 1c show an example of a pair of reference picture lists for a B picture. In Figure 1a, for example By default, reference picture 2, reference picture 1, reference picture 0, and the current picture to be encoded are supposed to be arranged in the display order</p>

<p dir="rtl">20 0 (L0) is an example of a reference image list in prediction direction</p>

bi-directional for first prediction directionn

prediction. As shown in Figure 1b, the reference image index 0 is assigned a value of “0” for reference image 0 arranged in display order 2, and reference image index 0 is assigned a value of “1” for reference image 1 arranged in display order 1, and value "2"

25 For reference image directory 0 For reference image 2 reference picture arranged in display order0.

٤٢٤٤

-٤-

Briefly, a larger value is assigned to the reference picture index for an image that is temporally close to the current image in the display order. On the other side, the reference image list

reference picture is an example of a reference picture list (L1) 1 reference picture list second prediction 1 prediction direction in the prediction direction list

<p dir="rtl">5 direction) for bi-directional prediction. in the reference image list</p>

<p dir="rtl">Reference picture 1 index (L1), reference picture 1 index is assigned to reference picture 1 arranged in display order 1, reference picture index 1 is assigned a value of “1” For reference picture 0 arranged in display order 2, reference picture index 1 is assigned a value of “1”. “2” for reference image guide 1 for reference image 2 arranged in display order</p>

10 0.

As shown above, for each reference image, it is possible to assign different reference picture indexes to the respective projection directions (reference images 0 and 1 in Figure 1a), or assign the same reference picture index to both projection directions (reference image 2 reference picture in Figure 1a).

15 Furthermore, in the scheme of the moving picture coding method known as H.264 (see unpatented art 1), as an inter prediction coding mode for each current phase in picture B, there is a motion vector estimation mode To encode (a) a difference value between image data of a prediction and image data of a current block, and (b) a motion vector used to generate block data.

20 prediction image data. In motion vector estimation mode, either bi-directional or one-directional prediction is selected. In bi-directional prediction, a prediction image is generated with reference to two encoded images that lie before or after the current image. On the other hand, in one-directional prediction one-directional prediction, a prediction image is created with

25 Referring to an encoded image located before or after the current image.

٤٢٤٤

-٥-

Furthermore, in the moving image coding scheme known as 264.H, in image coding B, it is possible to specify the coding mode as the motion vector mode of the time expector

motion when deriving motion vectors temporal prediction motion vector mode

vectors. 5 The inter prediction coding method in the motion vector mode of the time predictor is described with reference to Figure (2). Figure (2) is an illustrative diagram showing the motion vectors in the motion vector mode of the time predictor, and illustrates the case where phase “A” is encoded. " in image B2 in motion vector mode for the time forecast. Motion vector vb vector is used in this case. Motion vector vb is used to encode phase "B" in image P3 which is a reference picture located after image B2.

<p dir="rtl">10 Stage B (hereinafter referred to as a “co-located block”), in image P3, is in a location identical to the location of stage A. The motion vector vb is the motion vector used to encode stage B, It refers to image P1 by using a motion vector parallel to the motion vector vb, stage “A” obtains reference phases from image P1, which is a forward reference picture, and from image P3.</p>

<p dir="rtl">15 Which is a hidden reference image. Thus, bi-directional prediction is made to encode phase A. In the context of customization, the motion vectors used to encode stage “A” are the motion vector va1 for the PI image and the motion vector va2 for the image.</p>

P3

Citation List: The art of patenting:

<p dir="rtl">20 264.NPL-1: ITU-T Recommendation H, “Advanced Video Coding for Audio Services</p>

General Visual, March 2010.

٤٢٤٤

-٦-

General description of the invention

Technical problem: However, in a conventional way, there is a case, in the encoding of a current phase, where specifying either bi-directional prediction or one-way

5 directional to decreased coding efficiency.

An unrestricted and representative embodiment of the present invention provides a method for encoding a moving picture

moving picture decoding method and coding method

Be able to improve coding efficiency.

Problem Solution: In general terms, the techniques disclosed herein demonstrate how to encode an image

<p dir="rtl">10 animation to encode a current phase by copying at least one reference picture index value and at least one motion vector, where at least one reference picture index value identifies a reference picture that was used to encode a phase different from The current stage, and the method of encoding the moving image, including: determining a set of first candidate stages</p>

<p dir="rtl">15 candidate blocks where the first reference picture index value and the movement are copied from it; Create a second candidate block that uses bi-directional prediction by combining the reference picture index values and motion vectors that were used for at least one part of the first candidate blocks; And determine the mercy of the departed pain</p>

<p dir="rtl">20 The first candidate block and the second candidate block, where the reference picture index value and the traffic vector are copied to encode the current candidate block. Copy the value of the reference image directory and the motion stream from the specified stage and encode the current stage using the reference image directory value that was copied and the motion vector that was copied.</p>

٤٢٤٤

-٧-

It is therefore possible to encode the current image using motion vector(s) and reference picture(s) that are suitable for the current stage. As a result, the coding efficiency can be improved.

For example, creating a stage could include a second candidate

<p dir="rtl">5 block: Determines whether any of the first candidate blocks include one or more reference picture index values and one or more motion vectors; And create a second candidate block, when at least one of the first candidate blocks does not include any reference image index value and any motion vector.</p>

<p dir="rtl">10 For example, the moving picture coding method may further include: determining whether the current phase to be encoded using at least one reference picture index value and at least one motion vector copied from one of the first candidate phases or the second ; Set a flag indicating the result of a determinant; Adding the flag to the bitstream flag, including the current relay.</p>

<p dir="rtl">15 For example, the moving picture coding method may further include: specifying a phase directory value corresponding to the specified stage whereby the reference image directory value and the motion vector are copied for the purpose of encoding the current stage from a candidate list where the first candidate stage and the first candidate stage are assigned The second with the values of the special mercy guide; Add the value of the specified stage index to the bit stream, including the current stage.</p>

<p dir="rtl">20 For example, establishing the second candidate stage could include: determining whether two of the first candidate stages have reference picture index values indicating different prediction directions, and are encoded by a bi-directional prediction; The second candidate stage is created when two stages include the first candidate stage</p>

٤٢٤٤

-٨-

The first candidate blocks different prediction directions or is encoded with bidirectional prediction -bi

directional prediction

For example, creating a second candidate block can also include: Determining whether one of the first candidate blocks has been completed.

<p dir="rtl">5 It is predicted in the first prediction direction or is encoded by the two-way prediction and the other stage of the first candidate is predicted in the second prediction direction or is encoded by the two-way prediction; When it is determined that one of the first candidate phases is predicted in the first prediction direction or is encoded by bi-directional prediction and the other phase</p>

<p dir="rtl">10 The first filter was predicted in the second prediction direction or was encoded by two-way prediction, and the second filter stage was created by (1) specifying a directory value</p>

The motion vector is set as a reference picture index value

used in one of the first candidate stages as the index value of a reference image and the motion vector that was used in the first prediction direction of the second candidate stage, and (2)

15 Determine the index value of a reference picture index value and the motion vector that is used in the direction of the second prediction for the other phase of the first candidate phase as the index value of the reference picture and motion vector that were used in the direction of the second prediction for the second candidate phase.

For example, creating the second candidate stage could also include: determining whether

20 one of the first candidate phases was predicted in the direction of a first prediction or encoded by a two-way prediction and the other of the first candidate phases was predicted in the direction of a second prediction or was encoded by a two-way prediction; When it is not determined that one of the first candidate phases is predicted in the direction of the first prediction or is encoded by the bi-directional prediction

prediction and other stages of the first candidate stages

25 Predicted in the second prediction direction or encoded by the prediction

٤٢٤٤

-٩-

bilateral

bi-directional prediction, and create the second candidate block by (1) specifying the reference picture index value and the motion vector that were used in the first prediction direction

5 For the other stage of the first candidate block, as the value of the index of a reference image and the motion vector that was used in the direction of the first prediction for the second candidate block, and (2) determining the value of the index of a reference image and motion vector that was used in the direction of the second prediction. direction of one of the first candidate phases as the phase guide value. A reference image and motion vector were used in the second prediction direction.

10 For the second candidate's mercy.

In another aspect, the techniques disclosed herein illustrate a moving picture decoding method for decoding a current phase by copying the evidence value of at least one reference picture and at least one motion vector, where the evidence value of at least one reference picture to specify an image Reference picture was used in decoding Merhamat

<p dir="rtl">15 Different from the current stage, the moving picture decoding method includes: defining a set of first candidate stages from which the first reference picture index value and the movement source are copied;</p>

Create a second candidate block using two-way prediction -bi

reference picture by integrating directional prediction values

<p dir="rtl">20 index and motion vectors that were used for at least one part of the first candidate stages; Determine one of the first candidate stages and the second candidate stage, where the reference picture index value and the motion vector are copied to decode the current stage. Copy the value of the reference image directory and the motion vector from the specified stage and decode the current stage using the reference image directory value that was copied and the motion vector that was copied.</p>

<p dir="rtl">25 Therefore, it is possible to decode a coded bitstream using vectors.</p>

٤٢٤٤

-١٠-

The most appropriate motion vector(s) and the most appropriate reference image(s).

For example, creating a second candidate block could include: determining if any of the first candidate blocks include 5, one reference picture index value, and one motion vector; And create the second candidate stage, when one of the first candidate blocks does not include at least any index value of a reference image and any movement trend.

For example, the moving picture decoding method may also include: Obtaining a label, from a bitstream containing 10 of the current stage, where the label indicates whether the current stage is to be decoded by using a value Reference image guide and motion scene copied from one of the first or second candidate stages; And decode the current relay according to its parameter.

For example, a moving picture decoding method may also include: obtaining a phase index value from a bit stream containing the phase

<p dir="rtl">15 current; By using the obtained phase index value, a phase is selected in which the index value of at least one reference image and at least one motion vector is copied to decode the current phase, from a candidate list where the first candidate blocks and the second candidate phase are allocated second candidate block with my parameter directory values.</p>

<p dir="rtl">20 For example, establishing the second candidate stage could include: determining whether two of the first candidate stages have reference picture index values indicating different prediction directions, and are encoded by a bi-directional prediction; The second candidate stage is created when two of the first candidate stages contain different prediction directions or are encoded by bi-directional prediction.</p>

٤٢٤٤

-١١-

For example, creating a second candidate block could also include: determining whether any of the first candidate blocks are predicted in a first prediction direction or are encoded by a bi-directional prediction Two of the first candidate stages were expected in a trend

<p dir="rtl">5 second prediction direction or encoded by a two-way prediction; When it is determined that one of the first candidate blocks is predicted in the first prediction direction or is encoded by bidirectional prediction,</p>

The other phase of the first candidate phase was predicted in the direction of the second prediction or was encoded by the two-way prediction, thus creating the second candidate phase by (1) setting the value of

The motion vector is set to reference picture index value 10 as a reference image guide

used in the direction of the first prediction for one of the first candidate stages as the reference picture index value and the motion vector that was used in the first prediction direction for the second candidate stage, and (2) determining the value of the reference picture index and the motion vector that was used in the direction of The second prediction for the other stage from the nominated stage

<p dir="rtl">15 The first stage index value is a reference image and a movement vector that was used in the direction of the second prediction for the second candidate stage.</p>

It should be noted that the present invention can be implemented not only as the preceding moving picture coding method and moving picture decoding method, but also as follows: a moving picture coding device

<p dir="rtl">20 moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus, each of which includes processing units that perform the distinct steps mentioned in the moving picture coding method and the moving picture decoding method. ; A program that makes the computer perform steps, and the like. The present invention may be implemented</p>

25 Also as follows: computer-readable recording tag

٤٢٤٤

-١٢-

medium, such as the memory of a read-only CD-ROM (), where the previous program is recorded; information, data, signals that refer to the program; and the like. The program, information, data, or signals may be distributed via a transport medium such as Internet.

Beneficial effects of the invention According to the present invention, a merge block filter is calculated

5 A new candidate for bi-directional prediction of merge filters for the purpose of improving coding efficiency.

Brief explanation of the drawings

Figure (1) is a diagram to illustrate the assignment of reference picture indexes to each of the reference images.

10 Figure (2) is a schematic diagram showing motion vectors in the temporal motion prediction vector mode.

Figure (3) is a diagram that shows the relationship between: the current phase to be encoded; the adjacent phases; and the motion vectors of the adjacent phases.

Figure (4) is a step-by-step diagram showing the installation of a moving image encoder

Moving picture using the picture coding apparatus 15

coding method according to an embodiment of the present invention.

Figure (5) is a flowchart of a summary processing flow of a moving picture coding method according to an embodiment of the present invention.

Figure (6) is a flowchart of a detailed processing flow for calculating a common merge stage

combined merge block 20

Figure (7) is a flowchart of a detailed processing flow for comparing prediction errors.

٤٢٤٤

-١٣-

Figure (8) is a step-by-step diagram showing the installation of a moving image decoder

moving picture using the picture decoding apparatus

decoding method according to an embodiment of the present invention.

Figure (9) is a flow chart of a summary of the processing flow of the moving image decoding method

5 According to an embodiment of the present invention.

Figure (10) shows the overall configuration of a content provisioning system to implement content distribution services.

Figure (11) shows a total configuration of a digital broadcasting system.

Figure (12) shows a stage diagram showing an example of a TV configuration.

Figure (13) shows a step-by-step diagram that shows an example of configuring an information copying/recording unit that reads information.

10 You write it on a recording medium that is an optical disk.

Figure (14) shows an example of configuring a recording medium that is an optical disc.

Figure (15a) shows an example of a cell phone;

Figure (15b) is a phase diagram showing an example of a cell phone configuration.

Figure (16) shows schematically how each stream is multiplexed into multiple data;

15 Figure (17) shows how a video stream is stored in a PES packet stream in more detail;

Figure (18) shows a data structure for PMT;

Figure (19) shows the internal structure of multiplexed data information.

Figure (20) shows the internal structure of stream attribute information.

Figure (21) shows the steps for specifying video data.

٤٢٤٤

-١٤-

Figure (22) shows an example of an integrated circuit configuration to implement the moving image encryption method

Moving picture decoding and picture coding method

method according to each embodiment;

Figure (23) shows a configuration for a switch between driving frequencies.

5 Figure (24) shows the steps for selecting video data and switching between driving frequencies.

Figure (25) shows an example of a lookup table where video data criteria are linked

standards at driving frequencies;

Figure (26a) is a diagram showing an example of a configuration for sharing a signal processing unit combination; and

10 Figure (26b) is a diagram showing another example of a configuration for sharing a structure of a signal processing unit.

Detailed description:

In the motion picture coding scheme, a coding mode called merging mode is tested

As an inter-prediction for each stage, it must be encoded in the form of Problem 1b as follows:

15 It is shown in the following table

Reference picture list zero for table 1b:

<tr><td><p dir="rtl">Virus reference image 0</p></td><td><p dir="rtl">Display order</p></td></tr><tr><td><p>0</p></td><td><p>2</p></td></tr><tr><td><p>1</p></td><td><p>1</p></td></tr>

٤٢٤٤

-١٥-

<tr><td><p>2</p></td><td><p>0</p></td></tr>

Or reference picture 1, as shown in the table in Figure 1c:

Reference picture list 1 reference picture list for schedule 1c:

<tr><td><p dir="rtl">Virus reference image 1</p></td><td><p dir="rtl">Display order</p></td></tr><tr><td><p>0</p></td><td><p>1</p></td></tr><tr><td><p>1</p></td><td><p>2</p></td></tr><tr><td><p>2</p></td><td><p>0</p></td></tr>

In this merge mode, the motion vector and guide value of the reference image are copied

5 reference picture index value (hereinafter referred to as “reference picture index values”) of the stage adjacent to the current stage to be encoded for the purpose of encrypting the current stage. Here by adding the index value and the instance of the adjacent stage from which the copy is being performed to the As a result, the motion vectors and the index value of the reference image used in the coding can be determined in coding. A detailed example is described

10 With reference to the corresponding shapes.

Figure (3a) is a diagram that shows the relationship between: the current phase to be encoded, the neighboring phases, and the motion vectors of the neighboring phases.

Table (3b) is a table that shows an example of a merge block candidate list, where each value of the merge directory is assigned to a motion stream and an image directory.

15 The reference picture index is to be used in merge mode, as shown in the following table:

٤٢٤٤

-١٦-

<tr><td><p dir="rtl">Virus Merge Merge</p></td><td><p>merge block candidate</p></td></tr><tr><td><p>0</p></td><td><p dir="rtl">Adjacent lag A (expectation direction 0, RefL0_A, MvL0_A)()</p></td></tr><tr><td><p>1</p></td><td><p dir="rtl">Adjacent lag B (Forecast Direction 1, RefL1_B, MvL0_A)()</p></td></tr><tr><td><p>2</p></td><td><p dir="rtl">Co-located merge stage (two-way forecast direction, MvL0_Col,</p><p>))RefL0_Col</p></td></tr><tr><td><p>3</p></td><td><p dir="rtl">Not available (because the adjacent phase C is internally expected)</p></td></tr><tr><td><p>4</p></td><td><p dir="rtl">Adjacent lag D (expectation direction 0, RefL0_D, MvL0_D)()</p></td></tr>

In Table 3A, a stage coded in the remainder of the current stage is indicated by an adjacent stage (A), and

A stage coded immediately above the current stage is indicated by an adjacent stage (B), a stage coded immediately above the right of the current stage is indicated by an adjacent stage (C), and a stage coded to the left immediately below the current stage is indicated by an adjacent stage (D). Furthermore,

5 In Table 3a, the adjacent phase (a) is encoded by a one-directional prediction using the 0 prediction direction (first prediction directionn). The adjacent phase (a) includes the motion vector MvL0_A for the zero prediction direction. For a reference picture referenced by the RefL0_A index value in the reference picture index for the expected direction

<p dir="rtl">10 zero.</p>

Here, the motion vector MvL0 is a motion vector pointing to a reference image

0 reference picture list is defined by reference picture list

<p dir="rtl">(L0), MvL1 is a motion vector pointing to a reference image specified by Reference Image List 1 (L1).</p>

٤٢٤٤

-١٧-

The neighborhood phase (b) is encoded by a one-directional prediction using second prediction direction. The neighborhood phase (b) includes the MvL1_B motion vector of direction 1 of a reference picture indicated by RefL1_B index value in reference picture index 5 reference picture index prediction direction 1

The adjacent phase (c) is encoded with an inter prediction. The adjacent phase (d) is encoded with a one-directional prediction using prediction direction 0. The adjacent phase (d) includes a motion vector MvL0_D motion vector with direction zero of a reference image made Indicated by the RefL0_D index value in the reference picture index 10, the expected direction is zero.

In the case shown in Figure 3a, as a motion vector and a reference picture index value for the current stage, a motion vector and a reference picture index value are specified.

highest coding that provides blind coding efficiency levels reference picture index value

efficiency, for example, from (a) motion vectors and reference 15 image guide values for adjacent phases (a), (b), (c) and (d), and (b) motion vector and reference image guide value reference picture index value of a co-located block that was obtained in temporal motion prediction vector mode. Next, a merging block pointing to the selected adjacent block or a co-located block is added to the bit stream Motion 20 vectors. For example, if the adjacent phase (A) is selected, the current phase is encoded

By using the motion vector MvL0_A and the reference picture index value ReL0_A index value, the prediction direction is zero, and a value of “0” is added to the merge block index, which indicates that the adjacent phase (A) is used as shown in Figure (3b). to the bitstream, so that the amount of information 25 for motion vectors and reference picture index values can be reduced.

٤٢٤٤

-١٨-

However, in the merge mode shown above, if the merge block candidate does not include any motion vector and reference picture index value because the merge is encoded by an inter prediction (such as an adjacent The stage cannot be used as a stage filter

<p dir="rtl">5 merge block candidate. In the former case, the number of available merge candidates is also reduced, the selection range for the motion vector and reference picture index value that provide the highest coding efficiency is reduced, and finally, the coding efficiency is reduced.</p>

To address the previous problem, an unrestricted and declarative model provides an image coding 10 method and an image decoding method capable of improving the efficiency of

Improve coding efficiency without reducing the number of merge candidates available in merge mode.

The following describes embodiments according to the present invention with reference to figures and drawings. It should be noted that all embodiments described below are particular examples of the present invention. Numerical values are considered,

<p dir="rtl">15 The shapes, materials, essential elements, locations of arrangement, connection configuration of essential elements, steps, arrangement of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present invention.</p>

The present invention has only the inherent protective elements. Therefore, among the basic elements in the following embodiments, basic elements are described that are not described in the straight-line protection elements

<p dir="rtl">20 illustrates the more general concept of the present invention as elements forming more desirable configurations, even though these essential elements are not necessarily required to achieve the object of the present invention.</p>

(Form 1)

٤٢٤٤

-١٩-

Figure (4) is a step-by-step diagram showing the installation of a moving image encoder

moving picture using the picture coding apparatus

coding method according to Model 1.

As shown in Figure 4, the moving picture coding device 5 100 coding apparatus includes an orthogonal transformation unit 101,

102 quantization unit, inverse 103 quantization unit, inverse orthogonal 104 transformation unit, 105 block memory, frame 106 memory, 107 intra prediction unit, and inter prediction unit. 10 108 prediction unit, and an inter prediction control unit, 109 inter prediction control unit

And the picture type determination unit 110 picture type determination unit, merge block candidate calculation unit 111 merge block candidate calculation unit, colPic memory 112, variable length coding unit 113 variable length coding unit, subtractor 114, accumulator 115 adder, and switch unit 116 unit. unit.

15 The orthogonal transformation unit 101 transforms the prediction error data, which is the difference between the prediction data that was generated as shown below, and concatenates an input image from an image domain to a frequency domain. The quantization unit 102 segments the forecast error data that has been transformed in the frequency domain. The quantization unit is the inverse quantization unit

20 103 by segmenting the prediction error data that has been segmented using the quantization module

102 unit. unit. The inverse orthogonal transformation unit 104 converts inversely segmented prediction error data from frequency domain to image domain. The adder 115 assembler adds the prediction data to the prediction error data that has been reverse-hashed to create unencrypted data. Preserve the memory of mercy

25 105 block memory block memory in unencrypted form on a phase by phase basis.

٤٢٤٤

-٢٠-

Frame memory 106 holds the unencrypted image on a picture-by-picture basis. The 110 picture type determination unit determines any image type from Image I, Image B, or Image P. Each image is encoded in the input image sequence and generates image type information. The intra prediction module

5 107 unit encodes a current sequence to be encoded by an internal expectation using the image

The unencrypted information is stored step by step in block memory 105 in order to generate the prediction image. The inter prediction unit 108 encodes the current phase with the inter prediction by using the unencrypted image stored on the basis of an image image in the frame memory 106 frame memory and a motion vector derived in estimation.

10 Movement in order to create the forecast image. The subtractor 114 subtracts prediction data generated by the intra prediction unit 206 or inter prediction unit 207 from the input image sequence in order to calculate prediction error data.

111 merge block candidate calculation unit Defines the calculation unit for the merge candidate

15 Merge block candidates (first candidate blocks) for merge mode by using (a) motion vectors and reference picture index values that were used to encode adjacent blocks and (b) colPic information such as The motion vector and the co-located block instance are stored in 112 colPic memory.

20 With the current mercy. Here, candidates for the merge phase are candidates for the phase where at least one motion vector and at least one reference picture index value are directly used for the current phase.

111 Create a merge block candidate calculation unit Calculate the merge candidate calculation unit

combined merge block (second candidate block).

25 candidate block) using the method shown below. It should be noted that the merge stage

٤٢٤٤

-٢١-

The common is not a phase that actually contains pixel values, but a virtual phase that contains motion vectors and index values of a reference image. Furthermore, the merge block candidate calculation unit assigns each of the specified merge stages with a value corresponding to the merge block index. Next, the merge block candidate calculation unit provides

5 merge block filter 111 calculation unit merge block candidates and merge block index values (hereinafter referred to as “merge block index values”) to the inter prediction control unit 109. It should be noted that in the current model 1 The motion vectors and guide values of the reference image used to migrate adjacent to the current image are supposed to be stored in the filter calculation module.

10 Merge block 111 merge block candidate calculation unit.

The inter prediction control unit 109 performs inter prediction coding in a prediction mode that has the smallest prediction errors between (a) a prediction mode for an inter prediction image generated using a motion vector derived by the motion estimation mode and (b) Establishing a prediction for an image that has been created

15 Using a derived motion matrix in merge mode. Furthermore, the inter prediction control unit 109 provides the variable length coding unit 113 length coding unit with (a) a merge flag indicating whether the prediction mode is merge mode, and (b) a merge phase index value Matches the specified merge phase if merge mode is selected as the forecast mode, and (c) forecast error information.

20 Therefore, the inter prediction control unit 109 transfers colPic information, including the motion vector, etc., for the current loop to the colPic memory 112.

The 113 variable length coding unit performs variable length coding on quantization error data, merge flag, merge block index value, and image type information in order to create a bitstream.

٤٢٤٤

-٢٢-

Figure (5) is a flow chart of a summary of the processing flow of the moving picture coding method according to the current model.

111 merge block candidate calculation unit Defines the calculation unit for the merge candidate

Merge block candidates from neighboring blocks and a co-located block

5 co-located block of a current phase to be encoded (step 11). For example, in the case shown in Figure 3a, the merge phase filter calculation unit 111 identifies adjacent phases (a), (b), and (c), and (d), a co-located combined merge block as merge phase candidates. Here, a co-located merge phase includes at least one motion vector and the like which are calculated in time prediction mode from a single motion vector.

10 At least for a co-located stage. Next, the merge filter calculation unit 111 assigns each of the merge block indexes with a matching value for the merge block index as shown in Figure 3b. In general, because the merge block index value is smaller, the amount of necessary information is reduced. On the other hand, because the value of the merge stage index is larger, the amount of necessary information is increased and thus the value of the merge phase index corresponding to the stage candidate is reduced

<p dir="rtl">15 High potential integration includes a more accurate motion vector and a more accurate reference picture index value, the coding efficiency is increased. For example, a meter count could be considered where each merge candidate is designated as a merge block, and a smaller merge block index value is assigned to the block containing the larger numbers. Here, if the merge block candidate is the target</p>

<p dir="rtl">20 It retains information such as the motion vector. For example, if the merge phase filter is a phase encoded by an internal expectation or if the merge phase filter is located outside the image facility or slice facility, it is assumed that this phase cannot be used. As a merger candidate. In the current model, if a stage cannot be used as a merge stage candidate, the stage is indicated as an unavailable stage, and if a stage can be used as a merge stage candidate, it is indicated as a stage unavailable.</p>

<p dir="rtl">25 Referring to the mercy as an available mercy. In the case shown in Figure (3a), the relay is closed</p>

٤٢٤٤

-٢٣-

The neighbor (c) is a block encoded by an internal expectation, so the neighbor (c) is considered unavailable as a merge block candidate.

Using the merge filters defined in Section 11, the module calculates the merge filter

111 Create a combined merge block candidate calculation unit

5 combined merge block using the method as shown below in order to update the merge block candidate list (Step 12).

For example, the merge block candidate list shown in Table (6) is created according to the following table:

<tr><td></td><td><p dir="rtl">Virus Merge Merge</p></td></tr><tr><td><p>) RefL0-A, MvL0-A adjacent lag a) Expectation direction is zero</p></td><td><p dir="rtl">zero</p></td></tr><tr><td><p>) RefL1-A, MvL0- B adjacent lag b) Zero expectation direction</p></td><td><p>1</p></td></tr><tr><td><p dir="rtl">The merger phase is co-located and the forecast direction is two-way</p><p>RefL1-Col,MvL1-Col , RefL0-Col,MvL0-Col</p></td><td><p>2</p></td></tr><tr><td><p>RefL1-A, MvL1- B, joint merging phase, two-way prediction</p><p>RefL0-A, MvL0-A</p></td><td><p>3</p></td></tr><tr><td><p>RefL0-D, MvL0-D adjacent lag d) Expectation direction</p></td><td><p>4</p></td></tr>

10 From the merge block candidate list shown in Figure 3b. In the merge block candidate list shown in Figure 3b, the shared merge stage created by the method described below is used instead of an unavailable filter containing the value “ 3" for the merge block index. by using combined

٤٢٤٤

-٢٤-

merge block was recently created Instead of the unavailable filter, it is possible to improve coding efficiency without changing the maximum value of the number of merge candidates

block candidates

Next, the inter prediction control unit 109 compares (a) the prediction error

5 For the inter prediction image that was created by using the motion matrix

Derived by motion estimation with (b) the prediction error of the generated prediction image

By filter

Merge sequence using the method described below in order to determine an expectation mode for encoding the current sequence. Here, if the prediction mode is specified as merge mode, the controller

Interprediction 109 inter prediction control unit Specifies a value for the merge directory that indicates

10 Which merge stage filter is used? Next, if the prediction mode is merge mode, the inter prediction control unit 109 sets the merge flag to 1, otherwise it sets the merge flag to 0 (step 13). prediction control unit whether the merge flag is 1, in other words, whether the prediction mode is merge mode (step 14). Result

15 Therefore, if the expectation mode is merge mode (yes in step 14), the interprediction controller 109 supplies the variable length coding unit 113 with the merge flag and the merge block index value to be used by the merger to The merge flag and the index value are added to the bitstream (step Q15). On the other hand, if the expectation mode is not merge mode (not in step Q14), then

20 Inter prediction control unit 109 Inter prediction control unit 113 The variable length coding unit is provided with the merge tag and motion estimation stream position information so that the merge tag and information are added to the bit stream (step Q16).

It should be noted that in the current model, as shown in Figure (3b), regarding the values of the merge block index, the value corresponding to the neighboring stage (A) is “0”, and

25 The corresponding value for the adjacent phase (B) is “1”, and the corresponding value for the co-located merging phase is

٤٢٤٤

-٢٥-

"2", the corresponding value of the adjacent phase (c) is "3", and the corresponding value of the adjacent phase (d) is "4". However, the method of assigning the index values of the merge phase is not limited to the example only. For example, from It is also possible to assign the larger value to an unavailable candidate such as a merge block candidate. It should also be noted that merge block candidates are not limited to

5 Adjacent stages (a), (b), (c), and (d). For example, an adjacent stage may be specified or

They are located just above the bottom left of stage (D) as a merge stage candidate. It should also be noted that it is not necessary to use all adjacent stages, but only adjacent stages (A) and (B) may be used as merge stage candidates. It should be noted Also, it is not always necessary to use a co-location merge.

10 It should also be noted that in the current model in Section 15 in Figure (5) it is explained that the inter prediction control unit 109 provides a value for the merge process guide.

113 variable length coding unit merge block index

In order for the merge block index value to be added to the bitstream, but it is also possible not to add the merge block index value if the number of merge candidates is 1.

15 Therefore, it is possible to reduce the amount of information in the merge directory.

It should also be noted that in the present embodiment in step Q12 of Figure 5, a combined merge block is used instead of a non-available filter that includes a value of “3” for the merge block directory. However, the present invention is not limited to Above, the shared merge block may be added to the merge block candidate list as well.

20 Thus it is possible to increase the scope of selection for merger candidates. Here, it is also possible to treat the unavailable filter as a filter containing the motion vector 0 and the reference image guide

0 picture index

Table (7) is an example of an encryption table that is used to perform variable length encryption on the values of the merge block index, as shown in the following table:

٤٢٤٤

-٢٦-

<tr><td><p dir="rtl">Virus Merge Merge</p></td><td><p dir="rtl">Custom bit sequence</p></td></tr><tr><td><p>0</p></td><td><p>0</p></td></tr><tr><td><p>1</p></td><td><p>10</p></td></tr><tr><td><p>2</p></td><td><p>110</p></td></tr><tr><td><p>3</p></td><td><p>1110</p></td></tr><tr><td><p>4</p></td><td><p>1111</p></td></tr>

In the example shown in Figure 7, a code with a shorter code length is assigned to a smaller value for the merge block index. Thus, if the merge block index value corresponding to a merge block candidate with the potential for high prediction accuracy is minimized, it is possible to improve Coding efficiency 5 improve coding efficiency.

It should be noted that it is clarified in the current model that variable length encoding is performed on the merge phase index values as shown in Figure (7), but the merge phase index values may be encoded using a fixed code length. Thus, it is possible to reduce the load on Coding coding processing processing or decoding.

10 Figure (8) is a detailed flow chart for step Q12 in Figure (5). Below is a description of the method for creating a combined merge block from the merge candidates specified in step Q11 with reference to Figure (8).

111 merge block candidate calculation unit The merge block candidate calculation unit calculates the merge candidate

The value of index 1 (idx1) is initialized to “0” (step 21). Next, the phase filter calculation module

To (idx2) 2 111 Initialize the merge block candidate calculation unit 15 directory value

“0” (Step 22). The merge filter calculation unit 111 determines whether idx1 and idx2 are

٤٢٤٤

-٢٧-

contains different values, and the merge block candidate list includes any unavailable candidate (step 23). As a result, if there is no unavailable candidate (yes in step 24), the merge candidate calculation unit 111 determines what If the merge block filter [idx1] is assigned with the merge block index value

5 idx1 is available, and the merge stage filter [idx2] that was assigned with the merge stage directory value idx2 is available (step Q24). As a result, if the merge stage filter [idx1] is available, the merge stage filter [idx2] is also available (yes in step Q24). The merge block candidate calculation unit 111 determines whether the merge candidate [idx1] and the merge candidate [idx2] are predicted in different prediction directions or both the merge candidate is encoded.

10 Merge block candidate [idx1] and merge block candidate [idx2] are predicted by bi-directional prediction (step 25). As a result, if merge block candidate [idx1] and merge block candidate [idx2] are predicted in different prediction directions or If both the merge block candidate [idx1] and the merge block candidate [idx2] are encoded by a two-way prediction (yes in step 25), the merge candidate calculation unit 111 determines what

15 If the merge block candidate idx1[merge block candidate[] is predicted in the direction of the prediction

Or it was encoded (first prediction directionn 0) (prediction direction).

By bi-directional prediction, the merge block candidate [idx2] is predicted in direction 1 (second prediction direction) or encoded by bi-directional prediction

20 prediction (step 26). As a result, if the merge block candidate [idx1] is predicted in prediction direction 0 or encoded by the 2-way prediction, and the merge block candidate [idx2] is predicted in prediction direction 1 or encoded by the 2-way prediction bi-directional prediction (yes in step 26), in other words, if filtered

The motion vector [idx1] includes the merge block candidate in the merge phase

25 The prediction direction is zero and the merge block filter [idx2] includes a motion vector of at least 1, the merge block calculation unit

٤٢٤٤

-٢٨-

111 The candidate calculation unit determines the motion vector and the reference picture index value, the zero expectation direction of the merge stage filter [idx1], and the zero expectation direction of the joint merge phase (step 27). In addition, the candidate calculation unit 111 determines the motion vector and the image index value Reference reference picture

5 index value [idx2] Merge block candidate direction 1 [idx2] Prediction 1 for the combined merge candidate in order to create the combined merge phase for the bi-directional predictor (step 28). On the other hand, if the merge block candidate prediction is not specified [idx1] is in prediction direction 0 or encoded by bi-directional prediction, and the merge filter [idx2] is predicted in direction 1 or encoded by bi-directional prediction.

10 direction (in step 26), the merging filter calculation unit 111 determines the motion vector and the reference picture index value of the direction

[idx2[ merge block candidate Zero for the merge candidate prediction direction

The zero expected direction of the combined phase (step 29). In addition, the merge phase filter calculation unit 111 determines the motion vector and the reference image index value

15 picture index value Forecast Direction 1 of the Merge Stage Candidate [idx1] Forecast Direction 1 of the Joint Merge Stage In order to create the Joint Merge Stage for a two-way forecaster (step 30). The Merge Stage 111 filter calculation module adds the created Joint Merge Stage to the Merge Stage candidate list. merge block candidate list as an available candidate instead of an unavailable candidate (step 31). Next, the merge candidate calculation unit 111 adds a value of “1” to

20 The value idx2 (Step 32), determines whether the value idx2 is equal to or greater than the maximum value of the number of merge block candidates (Step 33). As a result, if the value idx2 is not equal to or greater than the maximum value of the number of merge candidates block candidates (in step 33), processing returns to step 23, and then the merge block candidate calculation unit 111 determines again whether

25 If any filter is left unavailable, you create the next combined merge block (steps 23 to 32). On the other hand, if idx2 is equal to or greater than

٤٢٤٤

-٢٩-

maximum number of merge block candidates (yes in step 33), then the merge block candidate calculation unit 111 unit adds the value “1” to idx1 (step 34) and determines whether idx1 is equal to or greater than the maximum number of merge block candidates (step 34). Step Q35). As a result, if idx1 is equal to or greater than the maximum value of the number of merge candidates (Yes

5 In step Q35, in other words, if every set of merge candidates is checked, the processing is complete.

It should be noted that it is explained in the present embodiment that processing is complete when each set of merging stage candidates is screened, but the present invention is not limited to the above. For example, it is possible to complete processing if there is no unavailable filter in a migrated filter list

10 merge block candidate list. As a result, the amount of processing can be reduced.

It should also be noted that it has been clarified in the current model that the steps in the method of creating a combined merge block are performed from the candidates of the merge stage in the order shown in the flowchart of problem (8), but the present invention is not limited to the above, and it may be Change the order of steps.

15 It should also be noted that it is clarified in the current model that, for example, when

reference picture index value and motion vector index value

prediction direction for a reference block The prediction direction is zero for a common merge block, if there is a set of merge block candidates containing a motion vector and an image guide value

20 The reference picture index value, zero direction, is selected, and the zero direction reference image index value associated with a merge block candidate has a merge block index value that is close to "0". However, the present invention is not limited to the foregoing. For example, it is also possible to specify a motion vector and a reference picture index value

٤٢٤٤

-٣٠-

value The prediction direction of zero that relates to a merge stage filter contains a merge stage guide value that is closest to a maximum value.

It should also be noted that in the current model in step Q31 in Figure (8) it was explained that the shared merge block that was created is added to the merge block candidate list.

<p dir="rtl">5 candidate list as an available candidate rather than an unavailable candidate, but the present invention is not limited to the foregoing. For example, it is also possible to determine whether any other merge phase filter maintains the same motion vector and the same reference picture index value. Shared merge phase values are included in the merge phase filter list. If this filter is not present in the list, The shared merge stage is added to the merge stage filter list as an available filter</p>

<p dir="rtl">10 Instead of a filter not available. Therefore, by preventing the same merge block candidate from being added again, it is possible to add effective merge block candidates. As a result, encryption efficiency can be improved. improve coding efficiency</p>

It should also be noted that it is clarified in the current model that the joint merge block that was created is added to the merge block candidate list in the event that it is not

<p dir="rtl">15 There is a filter that is not available in the merge stage filter list, but the present invention is not limited to the above. For example, it is also possible in step Q23 in Figure 8 to determine whether an unavailable filter in the merge phase filter list has not been implemented, but the common merge phase is calculated and recently added to the merge phase filter list. It is therefore possible Increasing the selection range for merge block candidates can improve efficiency</p>

20 Encryption improve coding efficiency.

Figure (9) is a detailed flow chart for step 13 in Figure (5). Below is the description with reference to Figure (9).

The inter prediction control unit 109 sets the value of merge block candidate index to “0”, and the minimum prediction error to

٤٢٤٤

-٣١-

Forecast error (cost) of setting the vector estimate, and the merge flag is set to “0” (step 41). Here, the cost is calculated by the following equation 1 for the RD optimization model.

Cost = R × λ + D (Equation 1)

In Equation 1, D represents a coding distortion that is, for example, the sum of the absolute value of the difference of (a) a 5-pixel value obtained by encoding and decoding a current phase by using a projection image generated by a given motion vector and (b) a pixel value In addition, R represents the encoding amount, which is, for example, the encoding amount necessary to encode the motion vector used to generate the prediction image.

10 Next, the inter prediction control unit 109 determines whether the value of the merge block candidate index is smaller than the number of merge block candidates for the current block and, in other words, whether any block exists with a probability of being a merge candidate (step Q42). As a result, if the merge filter guide value is determined to be smaller than the number of merge stage candidates for the current stage (yes in step Q42), the inter-prediction controller will

merge block 109 Calculates the cost of the merge stage filter prediction control unit 15

candidate with the consolidation candidate index value (step S43). Next, the interforecast controller 109 determines whether the calculated cost of the consolidation candidate is smaller than the minimum forecast error (step S44). As a result, if the calculated cost of the consolidation candidate The merge block candidate is smaller than the minimum prediction error (yes in step 44), after

20 Therefore, the inter prediction control unit 109 updates the minimum prediction error, the merge block index value, and the merge flag value (step 45). Next, the inter prediction control unit 109 adds a value of “1” to The merge block candidate index value (step 45), and the processing is repeated from step 42 to step 46. If the calculated value of the merge block candidate is not smaller than the minimum

25 For the forecast error (not in step Q44), the update process is not performed in step Q45, but rather

٤٢٤٤

-٣٢-

Perform step Q46, and the processing is repeated from step Q42 to Q46. Here, in step 42, if

The value of the merge filter index is not smaller than the number of merge candidates (in step Q42). In other words, if there is no merge filter, the inter prediction control unit 109 sets the last remaining merge flag and the value of

5 Merge block index (Step 47).

According to an embodiment of the present invention, a new fusion stage filter is calculated to make a bi-directional prediction of the fusion candidates in order to improve coding efficiency. In terms of allocation, according to the candidates of the merging stage who were counted from the adjacent stages and the co-located block, (a) wandering

The direction reference picture index value and the motion vector value is 10 movement

The prediction direction is zero and (b) the motion vector and the reference image index value of prediction direction 1 for the purpose of creating a combined merge block of bi-directional prediction, which are then added to the merge block candidate list. Result Therefore, the coding efficiency can be improved furthermore.

15 If there is no unavailable candidate in the merge block candidate list, a combined merge block is created, and the unavailable candidate is replaced by the combined merge block. Therefore, the coding efficiency can be improved without increasing the maximum number of merge candidates.

It should be noted that it is demonstrated in the present embodiment that a merge flag 20 is always added to a bitstream in merge mode, but the present invention does not

It is limited to the above. For example, it is also possible to force the blending mode to be selected according to a shape

Something like this for the current stage. In this case, it is possible to reduce the amount of information by:

Do not add the merge sign to the bitstream motion vectors.

It should be noted that in the present embodiment, in merge mode, at least one motion vector 25 and at least one reference picture index value are copied from the

٤٢٤٤

-٣٣-

adjacent to the current stage, then they are used to encode the current stage, but the present invention is not limited to the above. For example, the following is also possible. In the same way as in merge mode, by using the merge block candidates created as shown in Figure 6, at least one motion vector and one value are copied.

5 At least a reference image guide from a phase adjacent to the current phase is then used to encode the current phase. As a result, if the data of each prediction error for the current stage is 0, the skip flag will be set to 1 and added to the bit stream. On the other hand, if each prediction error data is not 0, the skip flag will be set to 0, and then the skip flag and prediction error data are added to the bitstream (merge skip mode).

10 It should also be noted that in the present embodiment, in merging mode, at least one motion vector and at least one reference image guide value are copied from a phase adjacent to the current phase, and then used to encode the current phase, but the present invention is not limited to My blindness to the above.

For example, it is also possible to encode a motion vector in motion vector estimation mode by using the merge block candidate list that has been created as shown in Figure 6. In the context of customization, it is possible to subtract a motion vector for a merge block candidate designed with the value of the merge block index from the motion vector to estimate the motion vector in order to obtain a difference. Then the difference and the value of the merge candidate index are added block candidate to stream 20-bit motion vectors. For example, the following is also possible. And by using the value

For motion estimation mode RefIdx_ME reference picture index value Reference picture index value

And the reference image index value RefIdx_Merge for the merge block candidate, the measurement is performed for the motion vector MV_Merge of the merge block candidate. Next, the scaledMV_Merge motion vector of the merge stage filter that was scaled is subtracted from the motion vectors in motion estimation mode 25 for a difference-based result. The difference and value are added to the merge stage filter directory value

٤٢٤٤

-٣٤-

of merge block candidate index into bitstream motion vectors. This measurement can be made by using the following equation 2.

scaledMV_Merge＝

MV_Merge×(POC(RefIdx_ME)－curPOC)／(POC(RefIdx_Merge)－curPO

5 (C (Equation 2)

Here, POC(RefIdx_ME) represents a place in the display order of a reference picture referenced by the reference picture index value RefIdx_ME, and POC(RefIdx_Merge) represents a place in the display order of a reference picture referenced by the reference picture index value RefIdx_Merge

10 curPOC represents a place in the display order of an image that must be encoded

(Form 2)

Figure (10) is a step-by-step diagram showing an installation of a moving image decoder

moving picture using the picture decoding apparatus

decoding method according to Embodiment 2 of the present invention.

15 As shown in Figure 10, the motion picture decoding device 200 includes a variable length decoding unit 201 variable length decoding unit, an inverse quantization unit 202, an inverse orthogonal transfer unit 203 transformation unit, and a phased memory 204 block. memory, frame memory 205 memory, intra prediction unit 206, and inter prediction unit

20 207 prediction unit, and an inter inter prediction control unit

208 prediction, merge block candidate 209 calculation unit, 210 colPic memory, 211 adder, and 212 switch unit.

٤٢٤٤

-٣٥-

The variable length decoding unit 201 performs decoding

input bitstream variable length decoding variable length

To obtain information about the image type, merge flag, merge block index, and bitstream for variable length decoding

5 decoding. The inverse quantization module 202 segments the variable length decoding bitstream inversely quantizes. 203 The inverse orthogonal transformation unit transfers an inversely-quantized bitstream from a frequency domain to an image domain for the purpose of generating prediction error image data. retains memory

10 Stage 204 block memory is an image sequence created by adding prediction error image data to the prediction image on a staged basis. Frame memory 205 frame memory maintains the image sequence on an image-by-image basis. The intra prediction unit 206 performs an internal prediction on the sequence of images stored in block memory 204 on a phase by phase basis for the purpose of generating prediction image data for the phase.

15 It must be decrypted. The inter prediction unit 207 performs an inter prediction on the image sequence stored in the frame memory on a phase by phase basis for the purpose of generating prediction image data for the current phase to be decoded.

209 merge block candidate calculation unit Derives the merge block candidate calculation unit

20 Merge block candidates in merge mode by using colPic information such as motion vectors for the adjacent block and co-located block stored in the 210 colPic memory regarding the current block. In addition, the merge block 209 candidate calculation unit assigns each of the derived merge stages with a value corresponding to a directory

25 merge block index. Next, the calculation module provides the merge stage filter 209

٤٢٤٤

-٣٦-

Merge block candidates and merge block index values to the inter prediction control unit 208.

If the merge flag decoded by the 210 variable length decoding unit is equal to "0", in other words, if the expectation mode is not

5 In merge mode, the brown prediction controller 208 creates an inter prediction image using the uncoded information of the motion estimation mode. Moreover, if the merge flag equals "1", in other words, if the prediction mode is merge mode, the inter prediction control 208 unit sets the motion vector and reference picture index value.

10 value to be used in the interprediction from the set of merge block candidates according to the decoded merge block index value in order to generate the inter prediction image. Furthermore, the inter prediction control unit 208 supplies the colPic memory with colPic information including the motion vector and the like for the current phase.

15 The adder 211 adds prediction data generated by the intra prediction unit 206 or inter prediction unit 207 to the prediction error data provided by the inverse transfer unit.

203 orthogonal transformation unit for the purpose of creating a decoded .image sequence

20 Figure (11) is a flow chart of a summary of the processing flow of the moving picture decoding method according to the current model.

The 201 variable length decoding unit decodes a merge flag from a bitstream (step 51). The inter 208 prediction control unit determines whether the merge flag is “1” (step 51).

٤٢٤٤

-٣٧-

As a result, if the merge flag equals “1” (yes in step 52),

209 merge block candidate calculation unit

It determines the merge block candidates from adjacent phases and the phase co-located with the current phase to be decoded (step 33). In the same method as shown in

5 Figure (8), the merge candidate calculation unit 209 creates a combined merge block, and updates the merge block candidate list (step 54). Thus, like coding processing, for example, a candidate list is created The merge list shown in Figure (6) from the merge list filter shown in Figure (3b). Selects the inter prediction control unit

10 208 The merge phase in which at least one motion vector and one value are copied

At least for the reference picture index according to the value of the merge block index decoded by the 201 variable length decoding unit, and create an inter prediction image using the specified merge stage (step 55). On the side The other, in step 52, if

<p dir="rtl">15 If the merge flag is "0", the inter prediction 208 control unit creates an inter prediction image using the motion vector estimation mode information encoded by the 201 variable length decoding unit (step 56). It should be noted that it is not possible to decrypt the value of the merge block index, but to estimate the value of the merge block index.</p>

merge block candidates with "0" if the number of merge block candidates is 20

Which was specified or created in steps Q53 and Q54 is equal to "1".

According to the current model of the present invention, a new integration phase is calculated for a two-way predictor -bi

For the purpose of decoding merge block candidates from directional prediction

Properly decoding bitstream with improved coding efficiency

coding efficiency 25

٤٢٤٤

-٣٨-

In terms of allocation, according to the merge block candidates accounted for by the neighboring stages and the co-located block, (a) is merged

reference picture index value and motion vector index value

The prediction direction is zero and (b) a motion vector and a guide value of a reference image

<p>1 For the purpose of creating prediction direction reference picture index value 5</p>

The combined merge block of bi-directional prediction is then added to the merge block candidate list. As a result, it is possible to decoding bitstream with improved coding efficiency in a convenient way. Moreover, in the absence of a filter

10 Not available in the merge block candidate list, a combined merge block is counted, and the unavailable candidate is replaced with a combined merge block. Therefore, it is possible to decoding bitstream with improved coding efficiency in a suitable way without increasing the maximum number of merge block candidates.

15 (Form 3)

The processing described in each embodiment can be implemented fluidly in a stand-alone computer system by recording in a recording medium a program to implement moving picture coding method and moving picture decoding method configurations. (Figure 20) shown in each of the embodiments. The recording media may be any recording media as long as the program can be recorded e.g

Magnetic disk, optical disk, magnetic optical disk, IC card, and flash memory.

Below, applications of the moving picture encoding method (Image Encoding Method) and the moving picture decoding method (Image Decoding Method) are described in each of the embodiments and systems employing such methods. The system includes a feature including an image encoding and decoding device including a

٤٢٤٤

-٣٩-

Encrypt an image using the image encryption method and decrypt an image using the image decryption method. Other configurations in the system can be changed as needed depending on situations.

Figure (12) shows the overall configuration of the ex100 content provisioning system for implementing content distribution services. The communication services provisioning area is divided into cells of the required size and 5 base stations ex106, ex107, ex108, ex109, and ex110 are placed. The fish stations are fixed.

wireless stations in each of the cells.

The ex100 content providing system connects to devices such as ex111 computer, ex112 personal digital assistant, ex113 camera, ex114 cell phone, ex115 gaming console via ex101 internet, ex102 internet service provider, and telephone network.

10 ex104 as well as ex106 to ex110 base stations respectively.

However, the ex100 content delivery system configuration is not limited to the configuration shown in Figure 12, and a combination where any of the elements are connected is acceptable. In addition, each device may be connected directly to the ex104 telephone network rather than from ex106 to ex110 base stations. In addition, fish stations may be fixed wireless stations

15 The guinea pigs connect to each other through short-distance communication between fish and others.

The EX113 camera, like a digital video camera, can capture video. Like a digital video camera, the RMA EX116 can capture both still images and video. Furthermore, an ex114 cellular phone may be a phone that meets any of the standards such as Global System for Mobile Communications (GSM), multiple access

20 Code Division Multiple Access (CDMA), Wideband-Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and High Speed Packet Access (HSPA). Alternatively, it may be a cellular phone ex114 Personal Handyphone System (PHS).

٤٢٤٤

-٤٠-

In the EX100 content providing system, the EX103 streaming server is connected to the EX113 camera and others via the EX104 telephone network and the EX109 base station, which allows the distribution of images to the live gallery and others. In this distribution, content (for example a video of a live music performance) captured by the user using the ex113 camera is encoded as shown.

5 Above in each of the embodiments (i.e. the camera acts as the image coding apparatus of the present invention), the encoded content is transmitted to the streaming server ex103. On the other hand, the streaming server ex103 performs streaming distribution of the transmitted content data to the processing devices on demand. Common devices include the EX111 computer, the EX112 personal digital assistant, the EX113 camera, the EX114 cellular phone, and the gaming console.

10 ex115 which can decrypt the previously mentioned encrypted data. Each device receives the data

The distributed device decrypts and copies the encrypted data (i.e. the devices operate like the image decoding apparatus of the present invention).

Data captured by the camera EX113 or the streaming server EX103 that transmits the data may be encrypted, or encryption processes may be shared between the camera EX113 and the streaming server.

15 ex103. Similarly, distributed data may be decrypted by public devices or a server

ex103 streaming or decoding operations may be shared between the working devices and the ex103 streaming server. Furthermore, still image and video data captured not only by the EX113 camera but also by the EX116 camera may be transferred to the streaming server EX103 through the EX111 computer. Encryption operations may be performed using an ex116 camera, or...

20 Computer ex111, or streaming server ex103, or sharinga benem.

Moreover, encryption and decryption operations can be performed by the ex500 LSI circuit built into both the ex111 computer and hardware in general. The ex500 LSI circuit may be configured for a single chip or a chipset. Video encoding and decoding software may be embedded in some type of recording medium (such as CD-ROM, floppy disk, hard disk drive) that can

25 It can be read by computer ex111 and others, and encryption and decryption operations can be performed using

٤٢٤٤

-٤١-

Alp programming. Moreover, when the EX114 cellular phone is equipped with a camera, the image data acquired by the camera can be transmitted. Video data is data encoded by the ex500 LSI circuit embedded in the ex114 cellular phone.

Furthermore, the ex103 streaming server may consist of server and computer hardware, and may decentralize, process, record, or distribute data.

As described above, hardware devices may receive encrypted data and copy it into the ex100 content providing system. In other words, public devices can receive and decrypt information transmitted by the user, and then copy the unencrypted data in real time into the content delivery system so that the user without any rights and devices can

10 Certain personal broadcast implementation.

In addition to the ex100 content providing system example, a moving picture coding apparatus may be implemented

moving picture and the image coding apparatus shown (image decoding apparatus) decoding apparatus

15 In each of the embodiments of the EX200 digital broadcasting system shown in Figure 13. More specifically, the EX201 broadcast station transmits multiplexed data obtained by multiplexing audio data and other data to video data via Radio waves to an EX202 broadcast satellite. Video data is data encoded using an image encryption method

20 When multiplexed data is received, the broadcast ex202 satellite transmits radio waves. Next, an ex204 home-use antenna with a satellite broadcast reception function receives

25 The satellite broadcast reception function receives radio waves. after that,

٤٢٤٤

-٤٢-

A device such as a set top box (STB ex217) multiplexed the received data and reproduces the unencrypted data (i.e., the device functions as the image coding apparatus of the present invention).

5 Furthermore, the ex218 reader/recorder (1) reads and decodes multiplexed data

ex215 recording medium decodes multiplexed data

such as Digital Versatile Disc (DVD and BD), or (2) encoding video signals in the ex215 recording medium, and in some cases, writing data obtained by multiplexing an audio signal onto the encoded data. The reader may include/ Recorder 10 ex218 moving picture decoding apparatus or

Moving picture coding apparatus as shown in each embodiment. In this case, the copied video signal is displayed on the screen ex219 and can be reproduced by another device or system using the recording medium ex215 where multiplexed data is recorded. It is also possible to implement

15 moving picture decoding apparatus in the set top box ex217 connected to the cable ex203 for cable television or to the antenna ex204 for satellite and/or terrestrial broadcasting in order for video signals to be displayed on the screen ex219 for television ex300. Motion picture decoding may be implemented in TV EX300 and not coding.

20 Figure (14) shows the EX300 television receiver using the moving picture coding method and the moving picture decoding method in each embodiment. The EX300 television receiver includes: an EX301 tuner that obtains or provides multiplexed data obtained using Multiplexing audio to video data through the antenna ex204 or cable ex203 receiving the broadcast and the demodulator;

25 ex302 modulation/demodulation unit demodulates the imported data

٤٢٤٤

-٤٣-

Multiplex or modify data into multiplexed data to be supplied externally; A multiplexing/demultiplexing unit multiplexing/demultiplexing unit ex303 that demultiplexes embedded multiplexing data into video data and audio data or multiplexes decoded video and audio data

5 By ex306 signal processing unit to data.

The EX300 TV box also includes: EX306 signal processing unit Includes EX304 audio signal processing unit and EX305 video signal processing unit, which decodes audio and video data and encodes audio and video data (which acts as an encryption device). Image image

(image decoding apparatus and image decoding apparatus) 10

straight; The EX309 output unit includes an EX307 headphone that provides the decoded audio signal

The EX308 display unit displays the decoded video signal like a display. In addition, the TV set EX300 includes an interface unit EX317 which includes an operation input unit EX312 operation input unit that receives

15 To operate a user. In addition, the EX300 TV includes an EX310 controller that controls each core component of the EX300 TV and a power supply EX311 circuit unit that delivers power to each of the core components. Except for the ex312 operation input unit, the interface unit may include: an ex313 bridge connected to an external device such as an ex218 reader/recorder; slot port unit

20 ex314 unit to enable the attachment of ex216 recording medium such as an SD card;

and an ex315 driver to connect to an external recording medium such as a hard disk drive; And an ex316 modem to be connected to a telephone network. Here, the recording medium ex216 can record information electronically using a non-volatile/volatile semiconductor memory element for storage. It is connected

٤٢٤٤

-٤٤-

The basic elements of the EX300 are connected to each other through a synchronous bus

bus

First, the configuration will be described in which the EX300 TV decodes multiplexed data obtained externally via the antenna.

5 ex204 etc., then reproduces the unencrypted data. In TV ex300, when a user turns on

Through the ex220 remote controller and others, the multiplexer/decoder

multiplexing/demultiplexing unit multiplexing/demultiplexing unit multiplexing

ex303 Demultiplexes multicast data that has been demodulated by the modulator

Control within the control unit ex302 modulation/demodulation unit modulation

10 ex310 unit including cpu. In addition, the signal processing unit

The EX304 audio signal processing unit decodes the multi-decoded audio data and the EX305 video signal processing unit decodes the multi-decoded video data using the decoding method described in each embodiment of the EX300 TV. The EX309 output unit provides the unencrypted video signal and audio signal to the outside

<p dir="rtl">15 straight. When the EX309 output unit provides a video signal and an audio signal, the signals may be temporarily stored in the EX318 buffers, EX319 buffers, etc. until the signals are reproduced in sync with each other. Furthermore, the ex300 TV may read multicast data not via broadcast etc. but via ex215 and ex216 recording media such as magnetic disc, optical disc, and SD card. Next, a configuration will be described where the ex300 TV encodes</p>

<p dir="rtl">20 audio signal and video signal, then transfers the data out or writes the data to a recording medium. In TV EX300, when the user operates through the remote control unit EX220 and others, the audio signal processing unit ex304 encodes an audio signal, and the video signal processing unit ex305 signal processing unit encodes a video signal within the control unit</p>

<p dir="rtl">25 ex310 using the encryption method described in each of the embodiments. Multicast/decode module</p>

٤٢٤٤

-٤٥-

The EX303 multiplexing/demultiplexing unit multiplexes the video signal and the encoded audio signal, and provides the outgoing signal. When the EX303 multiplexer/demultiplexer multiplexes a video signal and an audio signal, the signals may be temporarily stored in the EX320 buffers, EX321 buffers, etc. until the signals are reproduced in sync with each other. Here, insulators 5 ex318, ex319, ex320 and ex321 may be grouped as shown or may be shared.

At least one isolator in the EX300 TV. Furthermore, data may be stored in a buffer so that system overflow can be avoided between the ex302 modulator and the ex303 multiplexer/demultiplexer, for example.

In addition, the EX300 TV's reception configuration may include an AV input from a microphone or

10 CamArt except configured to acquire audio and video data from a broadcast or recording medium

recording medium, and may encrypt the data obtained. Although the EX300 TV can encrypt, multiplex and provide external data in the description, it can only receive, decode and provide external data and not encrypt, multiplex and provide external data.

15 Furthermore, when the EX218 Reader/Recorder reads or writes multiplexed data from or on a recording medium, the EX300 TV and the EX218 Reader/Recorder may decode or encode the multiplexed data, and the EX300 TV and the EX218 Reader/Recorder may share the decoding. decoding or coding.

As an example, Figure (15) shows a configuration for an information reproduction/recording unit

20 ex400 reproducing/recording unit When data is read or written from or to a disk

Optical. The ex400 information reproduction/recording module includes the basic elements ex401, ex402, ex403, ex404, ex405, ex406, and ex407 described here. The RS EX401 optical head irradiates a laser spot into a recording surface

Which is the ex215 recording surface of recording medium disc for the recording medium

25 Optical to write information, and detects light reflected from the recording surface of the EX215 recording medium

٤٢٤٤

-٤٦-

To read information. The EX402 modulation recording unit electronically drives a semiconductor laser beam embedded in the optical head and modulates the maser light into the recorded data. The ex403 reproduction demodulating unit amplifies the obtained reproduction signal

5 By electronically detecting light reflected from the recording surface using an image detector embedded in the ex401 optical head and demodulating the reproduction signal by separating the signal component recorded on the ex215 recording medium to reproduce the necessary information. The ex404 buffer temporarily stores the information to be recorded on the ex215 recording medium.

10 And the information that was reproduced from the ex215 recording medium. The disk motor ex405 rotates the recording medium ex215 rotates recording medium. Move the console

To track the EX401 optical head the RS optical ex406 servo control unit servo

Preset information while controlling the rotation drive of disk motor ex405 motor in order to track the laser spot. The system controller controls system

15 control unit ex407 Totally in the information reproducing/recording unit. Read and write operations can be carried out by the system control unit ex407 using many of the information stored in the ex404 buffer, and creating new information and adding it when necessary, and by means of the ex402 modulation recording unit, and the reproduction decoding unit.

20 ex403 demodulating unit, and ex406 servo control unit which

It records and reproduces information through the EX401 optical head during operation in a coordinated manner. The system control unit ex407 includes a small data processor, which performs processing by forcing the computer to execute a read-write program.

٤٢٤٤

-٤٧-

Although the EX401 optical head emits an irradiates laser spot in the description, it can perform high-intensity recording using near-field light.

Figure (16) shows the ex215 recording medium, which is the optical disc.

5 On the ex215 recording surface of recording medium, the guide slots are configured in a helical pattern, and the ex230 information path records address information indicating an absolute location on the disk according to the variable shape of the guide slots. Address information includes information locating the ex231 recording relays that form a recording data unit. Reproducing the ex230 information path and reading the address information into a device that records data and reproduces it 10 may lead to the location of recording relays. In addition, it includes a medium

Recording ex215 recording medium data recording space ex233, inner perimeter space ex232, outer perimeter space ex234. The data recording area ex233 area is a space used to record user data. The inner perimeter area is ex232 and the outer perimeter area is ex234 which is inside the data recording space

15 ex233 recording area and outside respectively for private use except for recording data

the user. Information reproducing/recording unit 400 unit reads encoded audio and video data or multiplexed data obtained by multiplexing the encoded audio and video data and writes it to a space

Data recording ex233 data recording area for recording medium

20 ex215.

Although an optical disc with a layer such as DVD and BD is described as an example in the description, an optical disc is not limited to that, and may be an optical disc that has a multilayer structure and can be recorded on a part other than the surface. Furthermore, the optical disc may feature a multi-dimensional recording/reproduction structure such as recording information using

٤٢٤٤

-٤٨-

Illuminating colors with different wavelengths in the same part of an optical disc and recording information that contains many layers from different angles.

Moreover, the EX210 car equipped with the EX205 antenna can receive data from the EX202 satellite and others, and reproduce the video on a display device such as the 5 EX211 car navigation system found in the EX210 car in a digital broadcasting system.

ex200. Here, a configuration in the ex211 car navigation system would be a configuration that, for example, includes a Global Positioning System (GPS) receiver of the configuration shown in Figure 14. The same would be true for the ex111 computer and ex114 cellular phone configuration. And others.

10 Figure (17a) shows the EX114 cellular phone, which uses the moving picture coding method and the moving picture decoding method shown in the models. The cellular EX114 phone includes: an EX350 antenna to transmit radio waves and receive them through the base station. ex110; ex365 camera unit capable of capturing moving and still images; and a display unit

15 ex358 as an LCD screen to display data such as unencrypted video captured by

Ex365 camera unit or receiving it via the EX350 antenna. The cellular phone ex114 also includes: a main body unit including an ex366 operation key unit; And ex357 audio output unit such as headphone etc. output the sound; And an ex356 audio output unit such as a microphone

20 To input sound; an ex367 memory module for storing captured video, still images, recorded audio, encrypted or unencrypted data of the received video, still images, e-mail messages, etc.; The ex364 slot unit is an interface unit for a recording medium that stores data psychologically, like a memory unit.

ex367 memory unit

٤٢٤٤

-٤٩-

Next, an example configuration of a cellular phone ex114 cellular phone will be described with reference to Figure 17b. In the cellular phone ex114 phone, an ex360 main control unit is connected, designed for a total controller in each unit of the main chassis. Including ex358 display unit as well

5 ex366 operation key unit, power supply ex361 circuit unit, ex362 operation input control unit, ex355 video signal processing unit, ex363 camera interface unit, and screen control unit ( liquid crystal display (LCD ex359, ex352 modulation/demodulation unit,

10 ex353 multiplexing/demultiplexing unit, ex354 audio signal processing unit, ex364 slot unit, and ex367 memory unit via ex370 synchronous bus.

If the call termination switch or power switch is operated by a user, the ex361 power supply circuit unit supplies power to my units from the

15 Battery pack to activate cell phone cellular phone ex114.

In an ex114 cellular phone, the audio signal processing unit ex354 converts the audio signals collected by the ex356 audio input unit in voice chat mode into digital audio signals.

20 audio signals are controlled by the ex360 main control unit including the Central Processing Unit (CPU, ROM, and RAM). Next, the ex352 modulation/demodulation unit performs spectrum processing

digital audio: spread spectrum processing

signals, and the ex351 transmitting and receiving unit performs 25 digital-analog conversions and frequency conversion in the data to send the resulting data via the antenna

٤٢٤٤

-٥٠-

ex350 antenna. Also in the ex114 cellular phone, the ex351 transmitting and receiving unit amplifies the data received by the antenna in voice chat mode, and performs frequency conversion and analog-digital conversion on the data. After that, the embedding/de-embedding module performs the embedding/de-embedding module

5 ex352 modulation/demodulation unit performs reverse broad spectrum processing

The data performs inverse spread spectrum processing on data, and the ex354 audio signal processing unit converts it to analog audio signals, etc. via the ex357 audio output unit.

Moreover, when an email message is transferred in data connection mode

10 In communication mode, email text data entered by operating the ex366 operation key unit and otherwise sent to the main Michael is sent to the ex360 main control unit via the operation ex362 input control unit. The ex360 main controller makes the ex352 modulation/demodulation unit perform wide spectrum processing.

15 spread spectrum processing on text data, and the ex351 transmitting and receiving unit performs digital-analog conversion and frequency conversion on the resulting data to send the data to the ex110 base station via the ex350 antenna. When an e-mail transmission is received, processing is performed that is almost the opposite of that of an e-mail transmission on the received data, and the outgoing data is provided to the ex358 display unit.

20 When video, still images, or video and audio are transmitted in data communication mode, the video signal processing unit EX355 compresses and encodes the video signals supplied by the camera unit EX365 using the moving picture coding method described in Each of the embodiments (i.e. acting as the image encoding device of the present invention) then transmits the coded video data to

25 ex353 multiplexing/demultiplexing unit. in contrast,

٤٢٤٤

-٥١-

While the EX365 camera unit captures video, still images, etc., the EX354 audio signal processing unit encodes the audio signals collected by the EX356 audio input unit and sends the encoded audio data to the EX353 multiplexing/decoder. demultiplexing unit.

5 The ex353 multiplexing/demultiplexing unit multiplexes

Multiplexes coded video data supplied coded video data Coded video data

From the ex355 video signal processing unit and encoded audio data available from the ex354 audio signal processing unit using a pre-defined method. After that, the embedding/de-embedding module performs the embedding/de-embedding module

10 modulation/demodulation unit

spread by performing wide spectrum processing ex352 (modulation/demodulation circuit unit

spectrum processing on multiplexed data, and the ex351 transmitting and receiving unit performs digital-analog conversion and frequency conversion on the data to send the outgoing data via the ex350 antenna.

15 When receiving data for a video file linked to a web page etc. in data communication mode or when receiving an email with video/audio attached, to decode the multiplexed data received via the EX350 antenna, the EX353 multiplexing/demultiplexing unit decodes Multiplexing multiplexes data into bitstream video data and bitstream audio data, and provides a signal processing unit

coded video with video data encoded ex355 video signal processing unit 20 video

data and the ex354 audio signal processing unit with audio data encoded via the ex370 synchronous bus. The EX355 video signal processing unit decodes the video signal using a moving picture decoding method identical to the moving picture coding method.

25 method described in each of the embodiments (i.e. acting as an image decoder).

٤٢٤٤

-٥٢-

decoding apparatus of the present invention), then the ex358 display unit, for example, displays the video and still images embedded in the video file associated with the web page via the ex359 LCD control unit. Furthermore, the audio signal processing unit

audio signal decode audio signal ex354 audio signal processing unit

5 decodes, and the ex357 audio output unit outputs sound.

Furthermore, similar to the TV EX300, a terminal such as a cellular telephone

implementation configurations It contains 3 types of implementation configurations ex114 phone

which includes not only (1) a transmitting and receiving terminal including a coding apparatus and a decoding apparatus, but also (2) a transmitting terminal

10 Includes encoder only and (3) receiving terminals including decoder only. Although the EX200 digital broadcasting system receives and transmits multiplexed data obtained by multiplexing audio data to video data in the description, Multiplexing data may be data obtained by multiplexing audio data as well as symbol data associated with video to video data, and may not be

15 Multiplex data but video data psychologically.

As such, the moving picture coding method and moving picture decoding method may be used in each of the embodiments in any of the devices and systems described. Therefore, the characteristics shown in each of the models can be obtained.

20 Furthermore, the present invention is not limited to embodiments, and numerous modifications and variations are possible without departing from the scope of the present invention.

(Form 4)

Video data can be generated by switching as necessary between (1) the moving picture coding method or the moving picture coding device

٤٢٤٤

-٥٣-

The picture coding apparatus shown in each of the embodiments and (2) the method for encoding a motion picture

moving picture or moving picture coding method

coding apparatus in accordance with a different standard such as MPEG-2, MPEG4-AVC, and -VC 1.

5 Here, when a set of video data that matches different standards is generated and then decoded, decoding methods must be selected to match the different standards. However, since it is not possible to detect any standard that matches the video dataset to be decoded, there is a problem that no suitable decoding method has been identified.

To solve the problem, multiplexed data is obtained

10 By multiplexing audio data and changing it to video data, a structure that includes meta information indicating which standard the video data corresponds to. Below will be described the structure of multiplexed data that includes video data generated in the moving picture coding method and by the moving picture coding apparatus described in

15 Both models. Multiplexed data is a digital stream in the MPEG2-Transport Stream format.

Table (18) shows the structure of multiplexed data. As shown in the following table:

Video stream (1011 x 0 = PID, main video)

٤٢٤٤

-٥٤-

Audio streaming (PID = 1100 x 0)

Audio streaming (PID = 1101 x 0)

Streaming graphics display (PID = 1200 x 0)

Streaming graphics display (PID = 1201 x 0)

× 0 = PID (interactive graphics stream) 1400

Video stream (1B01 = 0 = PID, secondary video)

Video stream (1B01 = 0 = PID, secondary video)

Multiplexed data can be obtained by multiplexing at least one of a video stream, an audio stream, a presentation graphics stream (PG), and an interactive graphics stream. The video stream represents the main video and secondary video of a movie, and the audio stream (PG). audio stream (IG audio part

5 The main and secondary audio parts are mixed with the main audio part, and represent the display graphics flow

٤٢٤٤

-٥٥-

Translation of FIM. Here, the primary video is a regular video displayed on a screen, and the secondary video is a video displayed on a smaller window in the main video. Furthermore, an interactive graphics flow represents an interactive screen that is created by arranging GUI components on a screen. The video stream is encoded in the moving picture coding method

5 By means of a moving picture coding apparatus described in each of the embodiments or by a moving picture coding method or by a moving picture coding device in accordance with a traditional standard such as MPEG-2, MPEG4-AVC, and 1-VC. The audio stream is encoded in compliance with a standard such as 3-Dolby-AC, Dolby Digital Plus, and seamless virtualization.

Digital and HD Meridian Lossless Packing (MLP) digital theater system

10 Theater Systems High-Definition (DTS-HD and Linear PCM).

Each stream contained in multiplexed data is identified by a Packet Identifier (PID). For example, a video stream that is used for a movie's video is assigned 0x1011, audio streams are assigned 0x1100 to 0x111F, and audio streams are assigned 0x1200 to 0x121F. Display graphics, 0x1400 is assigned to

15 0x141F for interactive graphics streams, and 0x1B00 to 0x1B1F are assigned to video streams

0x1A00 is assigned to 0x1A1F for audio streams that are used for secondary video that is mixed with the main audio.

Figure 19 shows how data is multiplexed schematically. First, an ex235 video stream consisting of video frames and an ex238 audio stream consisting of audio frames are converted into an initial stream

20 into ex236 Packetized Elementary Stream (PES), ex239 PES packet stream as well as into ex237 TS packets and ex240 TS packets respectively. Similarly, ex241 display graphics stream data and ex244 interactive graphics stream data are converted into ex242 PES packet stream and ex242 packet stream ex245 PES as well as ex243 TS packets and ex246 TS packets respectively are multiplexed into a stream to produce multiple data streams

25 Transmission ex247 multiplexed data.

٤٢٤٤

-٥٦-

Figure (20) shows how a video stream is stored in a PES packet stream in more detail. The first bar in Figure (20) shows the flow of a video frame in a video stream. The second bar shows the PES packet stream. As shown by the arrows denoted by yy1, yy2, yy3, and yy4 In Figure 20, the video stream is divided into images such as I-images, B-images and P-images, each of which is a unit

5 Video viewing, images are stored in the net download for each of the PES packages. Each PES packet includes a PES header, and the PES header stores a gallery timestamp (PTS) indicating when the image was displayed and a decoding timestamp (DTS) indicating when the image was decoded.

Figure (21) shows a format for PES packets to be written to multiplexed data

Multiplexed data at the end. Each TS packet is a packet of fixed length 188

10 Byte, TS address includes 4 bytes containing information such as PID to identify a flow and net load

184 TS bytes to store data. PES packets are split and stored in TS payloads respectively. When using a Blu-ray Disc Read Only memory disc

Memory, TS packets are given an additional 4-byte TP address, thus resulting in packets

192 byte source. Source packets are written to multiplexed data

15 data. data. An additional TP address stores information such as the access timestamp (ATS). Explain

ATS The transfer start time at which each TS packet is transferred to the packet ID filter

(Packet Identifier (PID). The source packets in multiplexed data are arranged as shown below Figure (21). The numbers that increase from the multiplexed data address are called source packet numbers.

numbers (SPNs) 20

Each TS package included in multiplexed data includes not only audio, video, subtitle, etc. streams, but also a program correlation table

Association Table (PAT), Program Map Table (PMT), and Program Clock Reference (PCR). PAT explains what it refers to

25 The PID in the PMT is used in multiplexed data, and the PID is recorded for

٤٢٤٤

-٥٧-

PAT is the same as zero. The PMT stores the PID of the video, audio, subtitle, etc. streams included in the multiplexed data, and attributes the corresponding stream information to the PID. The PMT includes several description words associated with the multiplexed data as well. Description words include information such as copy control information that indicates whether

5 Copying multiplexed data is allowed or not. PCR stores System Time Clock (STC) time information corresponding to the ATS that appears when the PCR packet is transmitted to the set-top box to synchronize the ATS, which is the time pivot of the ATS, with the System Time Clock. STC which is the time axis of PTS and DTS.

10 Figure (22) shows the data structure of the PMT in detail. The PMT address is placed above the PMT. The PMT address describes the length of the data contained in the PMT and others. A set of description words associated with multiplexed data is placed after the PMT address. Information is described such as control information Copying in the description words After the description words, a set of parts of the flow information associated with the flows contained in the multiplexed data is placed.

15 multiplexed data. Each piece of stream information includes stream description words, each of which describes information such as a stream type to specify a compression encoding for a stream, the PID of the stream, and stream attribute information (such as frame rate or aspect ratio). Stream description words are equal in number. For the number of streams in multiplexed data.

When multiplexed data is recorded on a recording medium or other medium, it is recorded with multiplexed data information files.

Each multicast data information file contains multicast data management information as shown in Figure (23). The multicast data information files are identical to the multicast data, and each multicast data information file includes stream attribute information. And an input map.

٤٢٤٤

-٥٨-

As shown in Figure (23), the multiplexed data includes a system rate, a reproduction start time, and a reproduction end time. The system rate refers to the maximum transfer rate at which a target system decoder (described later) transmits the multiplexed data to the PID filter. The ATS intervals included in the multiplexed data are set to no more than

5 A system. Reproduction start time refers to the PTS in a video frame in the multiplexed data address. A single frame interval is added to the PTS in a video frame at the end of the multiplexed data, and the PTS is set to the reproduction end time.

As shown in Figure (24), part of the attribute information is recorded in the stream attribute information for each PID of each stream included in the multiplexed data.

10 multiplexed data. Each piece of attribute information includes different information depending on which corresponding stream is a video stream, an audio stream, a presentation stream, or an interactive graphics stream. Each piece of video stream attribute information contains information including the type of compression codec used to compress the video stream and the resolution, aspect ratio, and frame rate of the portions of image data that are included in the video stream. Holds every part of

15 Video Stream Characteristic Information Information including the type of compression codec used to compress the audio stream, the number of channels included in the audio stream, the language the audio stream supports, and the sample frequency height. Video streaming feature information and audio streaming feature information are used to initialize the decoder before the player plays the information.

In the current model, the multicast data used is a stream type embedded in the PMT.

20 Furthermore, when multiplexed data is recorded on a recording medium, the video stream attribute information contained in the multiplexed data information is used. In addition to customization, it includes the method of encoding the moving image

moving picture or moving picture coding method

The coding apparatus shown in each embodiment is a step or module for assigning unique information, 25 which refers to the video data generated by the moving image coding method.

٤٢٤٤

-٥٩-

Moving picture coding or picture coding method

apparatus in each embodiment, to the type of stream included in the PMT or the information of the video stream attribute. By configuration, video data generated by the moving picture coding method or moving picture coding device described in each embodiment can be distinguished from video data.

5 Video that conforms to another standard.

Moreover, Figure (25) shows the steps of the moving picture decoding method according to the current model. In step exS100, the stream type contained in the PMT or video stream attribute information is obtained from the multiplexed data. Next, In step exS101, it is determined whether the flow type is or

10 Video stream feature information refers to the creation of multiplexed data by a moving picture coding method or a moving picture coding apparatus in each of the embodiments. When it is determined whether the stream type or video stream attribute information indicates that multiplexed data was generated by the moving picture coding method or moving picture coding device in each embodiment, in

15 Step exS102, decoding is performed by the moving picture decoding method in each embodiment. Furthermore, when the stream type or video stream attribute information indicates compatibility with traditional standards such as MPEG-2, MPEG4-VC-1, and AVC, in step exS103, decoding is performed by the moving picture decoding method. method in accordance with traditional standards.

20 As such, assigning a new unique value to the stream type or video stream attribute information allows a determination of whether the moving picture decoding method or moving picture decoding apparatus described in each embodiment can perform coding. Even if the multicast data conforms to a different standard, a suitable decoding method or device can be specified. Therefore, it is possible to decrypt information without any error.

25 In addition, a moving picture encoding method or device can be used

٤٢٤٤

-٦٠-

coding apparatus or moving picture decoding apparatus mentioned in the current embodiment in the devices and systems described above.

(Form 5)

The moving picture coding method, moving picture coding apparatus 5, moving picture decoding method, and moving picture decoding apparatus are each implemented in each embodiment typically as an integrated circuit or Large Scale Integrated (LSI) circuit. As an example of a Large Scale Integrated circuit

10 (LSI) circuit, Figure (26) shows the configuration of a Large Scale Integrated (LSI) circuit, made from a single chip. The ex500 Large Scale Integrated (LSI) circuit includes elements ex501, ex502, ex503, ex504, ex505, ex506, ex507, ex508 and ex509 which will be described below, and the elements are connected to each other by the ex510 bus and the module is activated

15 ex505 power supply circuit unit by supplying power to each element when the power supply circuit unit is turned on

ex505

For example, when encoding is performed, the ex500 LSI circuit receives the AV signal from the ex117 microphone, ex113 camera, etc. via the ex509 AV IO under the control of the ex501 controller.

20 Includes EX502 CPU, EX503 memory controller, EX504 flow controller, and EX512 drive frequency controller. The received AV signal is temporarily stored in ex511 external memory such as SDRAM. Under the control of the EX501 control unit, the stored data is divided into data parts according to the amount and speed of processing transmitted digitally to the EX507 signal processing unit. After that, the signal processing unit signals

25 ex507 processing unit encodes an audio signal and/or a video signal. Here, it is a signal encryption

٤٢٤٤

-٦١-

Video encoding is described in both models. Furthermore, the signal processing unit ex507 multiplexes the coded audio and coded video data, and provides IO to stream the multiplexed data out. The multiplexed data provided is transmitted to the EX107 5 base station or written to the EX215 recording media. When multiplexing data sets, they must be stored

The data is cached in the ex508 buffer until the data sets are synchronized with each other.

Although the ex511 memory is an element outside the ex500 LSI circuit, it may be included in the ex500 LSI circuit. The EX508 insulator is not limited to a single insulator, but may consist of insulators. In addition, the ex500 LSI circuit may consist of a single chip or a group of chips.

10 Moreover, although the EX501 control unit includes EX502 CPU, EX503 memory controller, EX504 flow controller and EX512 drive frequency controller, the configuration of the EX501 control unit is not limited to this. For example, the ex507 signal processing unit may also include a central processing unit. Including another CPU in the EX507 15 signal processing unit may improve processing speed. Furthermore, as another example, an ex502 CPU might run

For example, the ex507 signal processing unit may include an audio signal processing unit. In this case, the ex501 control unit includes the ex507 signal processing unit or the ex502 central processing unit includes part of the ex507 signal processing unit. The name used here is LSI, but it may be called IC, system LSI, very large LSI, or ultra-LSI depending on the degree of integration.

20 Moreover, integration methods are not limited to an LSI circuit and a special circuit or general purpose processor and so may lead to integration as well. A field-programmable logic gate array (FPGA), which can be programmed after manufacturing integrated circuits with a large number of gates, or can be processed, can be used to reconfigure the connection or configure an LSI for the same purpose.

٤٢٤٤

-٦٢-

In the future, through advances in semiconductor technology, an entirely new technology may replace the LSI circuit. Functional stages can be integrated using this technique. There is a possibility of applying the present invention in the field of biotechnology.

(Form 6)

5 When video data generated in a moving picture coding method or by a moving picture coding apparatus described in each of the embodiments is decoded, and correspondingly when video data that conforms to a traditional standard such as 2- MPEG, MPEG4-AVC and 1-VC, the processing amount may increase. Therefore, the ex500 LSI circuit must be set to a higher driving frequency than the unit

10 EX502 CPU is used when decoding video data in accordance with the traditional standard. However, when the driving frequency is adjusted blindly, there is a problem of increased power consumption.

To solve the problem, a moving picture decoding apparatus such as the EX300 TV and the EX500 LSI circuit is configured to determine which standard matches the data.

15 video, and switching between driving frequencies according to the selected parameter. Figure 27 shows the EX800 configuration in the current model. The EX803 drive frequency switch unit sets the drive frequency to a higher drive frequency when video data is generated by the moving picture coding method or moving picture coding apparatus shown. In both models thereafter, togo unit

20 switch unit ex803 driving frequency ex801 decoding processing unit that implements the moving picture decoding method described in each embodiment to decode video data. When the video data conforms to the conventional standard, the EX803 drive frequency switch unit sets a drive frequency to a drive frequency lower than the video data generated by the motion picture coding method or motion picture encoder device shown.

٤٢٤٤

-٦٣-

In both models. Next, the EX803 driving frequency switch unit and EX802 decoding processing unit are installed which conform to the traditional standard for video data decoding.

By way of customization, the switch unit includes the drive frequency controller EX502 CPU and the drive frequency controller EX512 in Figure (26). Here, both the decoder processing unit

5 The ex801 encoder that implements the moving picture decoding method shown in each of the embodiments and the ex802 decoding processing unit that conforms to the conventional standard corresponds to the ex507 signal processing unit in Figure 26. The ex502 CPU specifies which Standard that matches the video data Next, the EX512 drive frequency controller determines a drive frequency based on the signal from the CPU

10 ex502. Moreover, the EX507 signal processing unit decodes

Encodes video data based on the signal from the EX502 CPU. For example, the identification information described in Form (4) may be used to identify video data. The identification information is not limited to the information described in Form (4), but may be any information as long as the information refers to any standard that matches the video data. For example Example, when any is selected

15 Standard that matches video data based on an external signal To determine if the video data of a TV, disc, etc. is being used, the selection may be made based on this external signal.

Moreover, the EX502 CPU selects a driving frequency according to a scan table. For example, the video data standards are related to the driving frequencies shown in Figure (29), as shown in the following table:

20

<tr><td><p dir="rtl">Absolute standard</p></td><td><p dir="rtl">Driving frequency</p></td></tr><tr><td><p>MPEG-4 AVC</p></td><td><p dir="rtl">500 MHz</p></td></tr><tr><td><p>MPEG-2</p></td><td><p dir="rtl">three hundred fifty MHz</p></td></tr>

٤٢٤٤

-٦٤-

<tr><td><p>.</p><p>.</p><p>.</p></td><td><p>.</p><p>.</p><p>.</p></td></tr>

The driving frequency can be determined by storing the scan table in the buffer ex508 and in an external memory of the LSI circuit and referring to the scan table by the CPU ex502.

Figure (28) shows the steps to implement a method in the current model. First, in step exS200, the ex507 signal processing unit obtains meta information from the data

5 Multiplexed data. Then, in step exS201, the central processing unit (CPU) ex502 determines whether the video data is generated by the encoding method and encoding device described in each embodiment according to the identifying information. When the video data is generated by the moving picture coding method and the moving picture coding apparatus shown in 10 each of the embodiments, in step exS202, the exS202 CPU transmits a signal to set the drive frequency to a drive frequency blind to the drive frequency controller ex512. Next, the EX512 drive frequency controller sets the drive frequency to the higher drive frequency. On the other hand, when the identification information indicates that the video data is compatible with conventional standard such as MPEG-2, MPEG4-AVC and 1-VC, in step exS203, ex502 CPU transmits a signal to set the drive frequency

15 Lower driving frequency blindness of EX512 driving frequency controller. Next, the EX512 driving frequency controller sets the driving frequency to a driving frequency lower than the driving frequency in the case where the video data is generated by the motion picture encoding method and the motion picture encoder device shown in the embodiment.

Moreover, besides switching the driving frequencies, the energy saving effect can be improved by changing the circuit used in the ex500 LSI circuit or

20 A device that includes an ex500 Large – Scale Integration (LSI) circuit. For example, when the drive frequency is set to a lower frequency, the circuit good that is

٤٢٤٤

-٦٥-

For use in an ex500 LSI circuit or a device containing an ex500 LSI circuit, the Kirby good is less than the Kirby good in the case where the drive frequency is set to a blind frequency.

Moreover, when the processing amount for decoding is larger, the driving frequency may be set to a higher frequency, and when the processing amount for decoding is smaller, the driving frequency may be set to a higher frequency.

5 Less like the method of adjusting the driving frequency. Therefore, the adjustment method is not limited to the methods described above. For example, where the amount of processing to decode video data consistent with MPEG４-AVC is greater than the amount of processing to decode video data generated by the moving picture coding method and the moving picture coding apparatus described in each of the embodiments 10, the drive frequency may be set in the reverse order from the setting shown above.

Moreover, the method of adjusting the drive frequency is not limited to the method of adjusting the drive frequency at a lower level. For example, when the identification information refers to video data being generated by the motion picture encoding method and the motion picture encoding device described in each embodiment, the circuit chip used may be set to the ex500 LSI circuit or the device incorporating the 15 ex500 LSI circuit at a higher level. . When identifying information indicates that the video data is compatible with

Conventional standard such as MPEG-2, MPEG4-AVC and 1-VC, the driver used in the ex500 LSI circuit or the device containing the ex500 LSI circuit may be set at a lower level. As another example, when the identifying information refers to video data being generated by the motion picture encoding method and the motion picture encoding device described in each embodiment, the ex502 CPU 20 does not need to be turned off. When identifying information indicates a data match

Video With traditional standards such as MPEG-2, MPEG4-AVC and 1-VC, the ex502 CPU may shut down at a certain time because the ex502 CPU has additional processing capacity. Even when the identifying information indicates that the video data was generated by the motion picture encoding method and the motion picture encoding device described in each of the embodiments, in case 25 where the ex502 CPU has additional processing capacity, the

٤٢٤٤

-٦٦-

ex502 cpu at a specific time. In this case, the stop time is set to a lower level than the time in the case where the identification information indicates that the video data is compatible with a conventional standard such as MPEG-2, MPEG4-AVC and 1-VC.

As a result, the energy saving effect can be improved by switching between driving frequencies

5 frequencies in accordance with the standard that corresponds to video data. Moreover, when the ex500 LSI circuit or the device containing the ex500 LSI circuit is powered by a battery, the battery life can be extended using the energy saving effect.

(Form 7)

There are cases where a set of video data that matches different criteria is provided to 10 devices and systems such as a TV and a mobile phone. To enable decoding of a video dataset that meets different standards, the ex507 signal processing unit of the LSI ex500 must meet different standards. However, the problems of increased circuit scaling of the LSI ex500 and increased costs arise with the individual use of ex507 signal processing modules that match their standards.

15 To solve the problem, what can be envisioned is a configuration where the decoder processing unit is shared to implement the moving picture decoding method described in both the embodiments and a decoding processing unit that conforms to a conventional standard such as MPEG-2, MPEG4 AVC, and MPEG-1. Partially VC. An example of the configuration is shown in Figure 30a. For example, the moving picture decoding method includes

20 Described in both embodiments and a moving picture decoding method corresponding to MPEG4-AVC are processing details such as entropy coding, inverse quantum partitioning, deblocking filtering, and equalized motion prediction. Processing details involved include the use of an ex902 decoder processing unit that is compatible with MPEG4-AVC. In contrast, the dedicated EX901 decoding processing unit is used to perform other processing

٤٢٤٤

-٦٧-

Compatible with the present invention. Since the present invention has the advantage of processing the internal expectation in a special way, for example, a custom decoder ex901 processing unit is used to process the internal expectation. On the other hand, the decoder processing unit is shared for one of the methods of entropy encoding, inverse quantum hashing, dephase filtering, motion equation or all methods.

5 Processing. A decoder processing unit may be shared to implement the moving picture decoding method described in each embodiment to jointly process resources, and a dedicated decoder processing unit may be used for MPEG4-compliant processing.

AVC

Furthermore, the ex1000 in Figure 30b shows another example where processing is shared

10 partially. This example uses a configuration that includes a dedicated decoder

The ex1001 decoding processing unit supports processing compatible with the present invention, the ex1002 custom decoding processing unit supports processing compatible with another traditional standard, and the ex1003 decoding processing unit supports processing that is shared between the moving picture decoding method in The current invention

15 The conventional moving picture decoding method. Here, the dedicated decoder processing units ex1001 and ex1002 are not intended for processing of the present invention and conventional standard processing respectively, and may be units that can perform general processing. Moreover, current model configuration can be performed by LSI ex500.

20 As such, circuit scaling for LSI and costs can be reduced by sharing the decoding processing unit's processing resources between the moving picture decoding method of the present invention and the moving picture decoding method in accordance with the conventional standard. .

٤٢٤٤

-٦٨-

Industrial application

The moving image encoding method and moving image decoding method according to the present invention can be applied to any multimedia data and improve the compression rate. For example, it is suitable as a moving image encoding method, a moving image decoding method for accumulation, transmission,

<p dir="rtl">5 communications, and the like using mobile phones, DVDs, personal computers, and the like.</p>

٤٢٤٤

-٦٩-