Apparatus and method for interpolating binary pictures, using context probability table
Claim Score by NHIP
Abstract
A context probable table of context template is employed in order to interpolate binary picture information. The context template for respective pixels making up the binary picture information is made, and probabilities for the interior of an object and the exterior of the object on its context indexes are obtained from the context probable table arranged previously. The probabilities for the interior and exterior of the object are compared with each other and the binary picture information is interpolated with a value having more probability.

Term
Term ended
Expired 9 July 2018, 8.2 years ago.
- Priority
- Filed
- Granted
- Expired
- Today
13 claims: 3 independent, 10 dependent
- 1A method for interpolating an original picture in a frame unit (a binary picture:BAB) by using a context probability table set previously in order to reconstruct the original picture in the frame unit having low resolution as the picture having high resolution through an up-sampling, said method comprising the steps of: dividing said original picture in the frame unit into a plurality of blocks (each having a size of 8×8 pixels);extending each of said plurality of blocks divided to a double size;forming a context template for an interpolating pixel in each of the extended blocks;getting indexes of the context template to obtain a probability value indicating whether or not a pixel value is detected and obtaining the probability value of the interpolating pixel from the context probability table set previously by a use of the indexes of the context template obtained;and deciding the interpolating pixel value (‘0’ or ‘1’) based on the context probability value obtained of the interpolating pixel.
- 8An apparatus having block dividing means, bordering means, and horizontal and vertical interpolation means and for interpolating an original picture in a frame unit (a binary picture:BAB) by using a context probability table set previously in order to reconstruct the original picture in the frame unit having low resolution as the picture having high resolution through an up-sampling, said apparatus comprising: said bordering means being composed of block position detecting means for detecting a position of each of the divided blocks from said block dividing means in the original picture in the frame unit, copy means for receiving the position of the divided block outputted from said block position detection means and bordering the block of a given size on the top, left and upper side and left side of the block to be bordered, and memory for storing the blocks bordered from said copy means and outputting the information on the neighboring blocks of the block to be bordered to said copy means;and said horizontal and vertical interpolation means being composed of context calculating means for receiving the bordered blocks in said bordering means and calculating context indexes for respective pixels of the bordered blocks, probability table referring means for receiving the context indexes from said context calculating means and reading and getting probability values corresponding to the index on/from the context probability table set previously, probability detecting means for detecting whether or not the probability value read and gotten on/from said probability table referring means is more than 0.5, and interior/exterior interpolation means for interpolating a value “0” or “1” for the respective pixels on the bordered block in response to the detection result signal of said probability detecting means.
- 12Broadest claimClaim Score 75, broad(NHIP)An interpolating method for reconstructing a restored picture having high resolution by up- sampling a binary picture having low resolution, said method comprising the steps of:forming context templates for target pixels to be interpolated;obtaining a context index of the context templates and a probability value of the target pixel from context probability table by using the context index of the context templates;deciding a value for the target pixel based on the context probability.
Independent claims3
77 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
00011. Field of the Invention
0002The present invention relates to an interpolation of binary pictures, and more particularly, to an apparatus and method for interpolating binary picture information based on a context probable table, namely, by employing a context probable value of a context based-arithmetic encoding.
00032. Discussion of Related Art
0004There is some difference between an original picture and a picture down-sampled and up-sampled after the down-sampling in case that the binary picture information is down sampled and then up sampled in performing a loss coding for picture information for the sake of a compression of binary picture information. Thus, in a process of the loss coding a picture of down-sampled small size is coded and a decoder decodes the picture of the small size to thereby perform an up-sampling for the picture in an original size. The loss coding is executed like this through the down and up sampling process. In the up-sampling process, a binary picture block of 4×4 or 8×8 having a low resolution is converted into a sampled binary picture block of 16×16 having a high resolution, by applying an interpolation to the up-sampling process.
0005There is presented a linear interpolating method, as a regularity of the existed interpolation process, in the Verification Model (VM) 8.0 described on WG11 under the ISO/IEC. In such linear interpolation method, in case the interior of an object is as ‘1’ and the exterior of the object is as ‘0’, and also in case that A, B, C and D in <figref idref="DRAWINGS">FIG. 1</figref> are as known values, values of P<b>1</b>, P<b>2</b>, P<b>3</b> and P<b>4</b> should be decided. The P<b>1</b>, P<b>2</b>, P<b>3</b> and P<b>4</b> in <figref idref="DRAWINGS">FIG. 1</figref> are pixels to be interpolated.
0006In such process, the values of P<b>1</b>, P<b>2</b>, P<b>3</b> and P<b>4</b> are decided by the following method. <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0007">P<b>1</b>: if (2*A+B+C+D>2) then ‘1’ else ‘0’</li><li id="ul0002-0002" num="0008">P<b>2</b>: if (A+2*+B+C+D>2) then ‘1’ else ‘0’</li><li id="ul0002-0003" num="0009">P<b>3</b>: if (A+b+2*C+D>2) the ‘1’ else ‘0’</li><li id="ul0002-0004" num="0010">P<b>4</b>: if (A+B+C+2*D>2) then ‘1’ else ‘0’</li></ul></li></ul>
0011That is to say, in P<b>1</b>, a value of pixel A most neighboring to P<b>1</b> is multiplied by 2, then added to the rest known pixels, B, C and D, and then if its sum is more than 2, P<b>1</b> becomes as ‘1’, if not, P<b>1</b> is as ‘0’. In P<b>1</b>, P<b>2</b>, P<b>3</b> and P<b>4</b>, a value of pixel B, C or D most neighboring to P<b>2</b>, P<b>3</b> or P<b>4</b> is respectively multiplied by 2, then each of the multiplied values is added to the rest known pixels and then if its sum is more than 2, it becomes as ‘1’, if not, P<b>1</b> is as ‘0’.
0012In such conventional linear interpolation method, among pixels neighboring to an interpolating pixel, the number of pixels such as the interior of an object is compared to the number of pixels such as the exterior of the object, it is decided according to more number in the comparison result whether or not it is the interior of the object or the exterior of the object. In order to use more accurate method, there is provided a method that nearer pixel more influences upon the interpolating pixel according to an additional value based on a distance between the interpolating pixel and referring adjacent pixels.
0013Such linear interpolating method is to interpolate the picture information by considering the number of the interior and exterior pixels of four pixels adjacent to a coding pixel and multiplying its nearest pixel by 2. A correlation in such linear interpolating method is not accurate. Thus, considering that the correlation among pixels of neighboring natural pictures is high, using a statistical method capable of characterizing numerically the correlation among respective pixels is a method for performing more accurate interpolation, in case that a functional relation representing such correlation can not be defined.
0014In the context-based arithmetic encoding, a probability which pixels of a coding binary picture can have a value of ‘0’ or ‘1’, may be gotten by using pixels neighboring to a coding pixel. Namely, in case the coding pixel is ‘0’, a probability that a current pixel may be ‘0’ is experimentally gotten according to a distribution of the neighboring pixels. The arithmetic encoding is performed by employing such probability.
0015In order to get probable value of current pixels through a use of adjacent pixels, it is constructed context templates for deciding what adjacent pixels at which positions are used, to thereby get the probable values for the respective context templates.
0016FIGS. <b>2</b>(a) and <b>2</b>(b) show one embodiment of context templates.
0017Supposing in FIG. <b>2</b>(a) that parts of oblique lines are pixels for unknown values and checkered parts are ‘1’ in its value, values of context indexes Cs may be obtained by the following, e.g., <maths id="MATH-US-00001" num="00001"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>C</mi><mo>=</mo><mi /><mo></mo><mrow><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>6</mn><mo>*</mo><msup><mn>2</mn><mn>6</mn></msup></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>5</mn><mo>*</mo><msup><mn>2</mn><mn>5</mn></msup></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>4</mn><mo>*</mo><msup><mn>2</mn><mn>4</mn></msup></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>3</mn><mo>*</mo><msup><mn>2</mn><mn>3</mn></msup></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>2</mn><mo>*</mo><msup><mn>2</mn><mn>2</mn></msup></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>1</mn><mo>*</mo><msup><mn>2</mn><mn>1</mn></msup></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mn>0</mn><mo>*</mo><msup><mn>2</mn><mn>0</mn></msup></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><mrow><mn>0</mn><mo>*</mo><msup><mn>2</mn><mn>6</mn></msup></mrow><mo>+</mo><mrow><mn>1</mn><mo>*</mo><msup><mn>2</mn><mn>5</mn></msup></mrow><mo>+</mo><mrow><mn>0</mn><mo>*</mo><msup><mn>2</mn><mn>4</mn></msup></mrow><mo>+</mo><mrow><mn>1</mn><mo>*</mo><msup><mn>2</mn><mn>3</mn></msup></mrow><mo>+</mo><mrow><mn>1</mn><mo>*</mo><msup><mn>2</mn><mn>2</mn></msup></mrow><mo>+</mo><mrow><mn>0</mn><mo>*</mo><msup><mn>2</mn><mn>1</mn></msup></mrow><mo>+</mo><mrow><mn>1</mn><mo>*</mo><msup><mn>2</mn><mn>0</mn></msup></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mn>45</mn></mrow></mtd></mtr></mtable></math></maths><img file="USRE40469E_D0001.tif" />
0018The probable values are in general floating values between 0 and 1, but there is much difficulty to process the floating values between 0 and 1 by using only software and hardware. The floating values between 0 and 1 are thus normalized to integer values, then used. Namely, the values between 0 and 1 are normalized to integer values between 1 and 65535. The number of arrayals constituting the probable table is decided by the number of pixels constituting a context template. If the number of pixels constituting the context template is N, the number of probable values is as 2<sup>N</sup>. In horizontal and vertical contexts used for scalable binary picture information, as shown in FIGS. <b>2</b>(a) and <b>2</b>(b), each of templates is constructed by 7 pixels, the number of the probable values thus is 128. Meanwhile, referring to the probable table on the ISO/IEC WG11 VM 8.0, it has the number of 256 for the probable values. Therefore, the first number of 128, context indexes from 0 to 127, is for the probable values of horizontal context template, and the rest number of 128, context indexes from 128 to 255, is for the probable values of vertical context template.
0019Accordingly, as a calculating result by the aforementioned expression, the context index C in FIG. <b>2</b>(a) is 45, it is thus read an index value 45 on the probable table for the calculated context index. Namely, the probable table is constructed such as scalable_shape_intra[256]={65476, 64428, . . . , 2412, 35} on the ISO/IEC WG11 VM 8.0, and in reading the probable values, values between 0 and 127 are used in the horizontal interpolation and then values between 128 and 255 are used in the vertical scanning. In such a case, the scalable_shape_intra[45] may become the probable value for the above-mentioned context. For such a value, when the value is read from the probable table of VM 8.0 presented on ISO/IEC WG11, the value becomes ‘22794’. Since ‘22794’ is the probable value for a probability of the exterior of an object, a probable value for the interior of object becomes ‘65535−22794=42741’.
0020Such probable value is previously decided and commonly stored at coding and decoding apparatuses, and coding data using coded probable value is transmitted to the decoding apparatus. The decoding apparatus decodes the probable value for the received data.
0021As afore-mentioned, in a case of utilizing the context probable table used in the CAE, more accurate interpolation can be achieved than a conventional linear interpolation method. In using the context probable table used in the CAE coding method, when many experimental pictures have the same contexts for respective contexts, the number of cases that its pixels are as the interior and the exterior of an object, is checked in order to get a probability for which each of the contexts is as the interior of the object. In such context probable table, thus, the probable table is made not only including the number of pixels as the interior of object and pixels as the exterior of object, in adjacent pixels, but also including information for positions and a correlation. That is, the method for using such context probable table is to interpolate more accurately than the method for using only the number of pixels as the interior and exterior of the object of neighboring pixels.
SUMMARY OF THE INVENTION
0022Accordingly, the present invention is directed to an apparatus and method for interpolating binary picture information that substantially obviates one or more of the limitations and disadvantages of the related art.
0023An object of the present invention is to provide an apparatus and method for interpolating binary picture information by using a context probable table, which is capable of together considering a distance between pixels, positions of pixels and a sort of neighboring pixels through a use of the context probable table of the CAE.
0024Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure as illustrated in the written description and claims hereof, as well as the appended drawings.
0025To achieve these and other advantages, and in accordance with the purpose of the present invention as embodied and broadly described, binary picture information is divided into blocks of a given size and a bordering on the divided blocks is executed by using its adjacent blocks. In case that a corresponding block belongs to the uppermost or leftmost block of the inputted binary picture information, the uppermost row or the leftmost column of the corresponding block is copied and a bordering on it is performed. A context template is constructed by employing pixels neighboring to coding pixels of a corresponding block. Values of indexes are also gained through a use of the constructed template, and a probability for the indexes is read on a probable table. Probability as the exterior of an object and the interior of object is gained from the read probability, and its two values are compared with each other. If the probability as the interior of object is more than that of the exterior of object, an interpolation is performed with the interior value of object. If the probability as the exterior of object is more than that of the interior of object, an interpolation is performed with the exterior value of object.
0026It is to be understood that both the forgoing general description and the following detailed description are exemplary and explanatory detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
BRIEF DESCRIPTION OF THE ATTACHED DRAWINGS
0027The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
0028In the drawings:
0029<figref idref="DRAWINGS">FIG. 1</figref> shows an explanation diagram providing a linear interpolation process applied in an up-sampling of binary picture information.
0030FIGS. <b>2</b>(a) and <b>2</b>(b) represent one embodiment of a context template applied to the binary picture information.
0031<figref idref="DRAWINGS">FIG. 3</figref> sets forth the construction for one preferred embodiment of an inventive interpolating apparatus.
0032<figref idref="DRAWINGS">FIG. 4</figref> depicts a method for bordering pixels of a neighboring block in order for constructing a context of pixels corresponding to the leftmost column and the uppermost row of a current block.
0033<figref idref="DRAWINGS">FIG. 5</figref> offers a method for bordering a block positioned on the uppermost or leftmost side of a binary picture.
0034<figref idref="DRAWINGS">FIG. 6</figref> illustrates the construction for one embodiment of a bordering sector in accordance with the present invention.
0035<figref idref="DRAWINGS">FIG. 7</figref> presents one embodiment of an inventive horizontal and vertical interpolating sector.
0036FIGS. <b>8</b>(a) and <b>8</b>(b) are explanatory diagrams showing horizontal and vertical interpolation processes.
0037<figref idref="DRAWINGS">FIG. 9</figref> indicates a flow chart providing an interpolating method in the invention.
0038<figref idref="DRAWINGS">FIG. 10</figref> is a flow chart showing an inventive bordering process.
0039<figref idref="DRAWINGS">FIG. 11</figref> presents a flow chart for horizontal and vertical interpolating processes in the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENT
0040Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
0041<figref idref="DRAWINGS">FIG. 3</figref> shows one embodiment with the construction of an inventive interpolating apparatus.
0042A block dividing sector <b>31</b> divides binary picture information into blocks of a given size, e.g., 16×16, 8×8, etc. A bordering sector <b>32</b> executes a bordering on blocks outputted from the block dividing sector <b>31</b>. A horizontal interpolating sector <b>33</b> horizontally interpolates pixels of the blocks outputted from the bordering sector <b>32</b>. A vertical interpolating sector <b>34</b> vertically interpolates pixels of the blocks outputted from the horizontal interpolating sector <b>33</b>.
0043Binary picture information of an object is divided into blocks of a given size in the block dividing sector <b>31</b>. These blocks are bordered with columns and rows of blocks adjacent to its left, upper and upper-left sides in the bordering sector <b>32</b>. In an interpolating process, a context template is constructed with pixels neighboring to an interpolating pixel as shown in FIGS. <b>2</b>(a) and <b>2</b>(b), and its context indexes are calculated. Such context template is presented on the VM of the ISO/IEC WG11.
0044As shown in FIGS. <b>2</b>(a) and <b>2</b>(b), the horizontal and vertical contexts for respective pixels are constructed, and context indexes C are computed. In case pixels adjacent to a current pixel form a context like the above, there may be constructed 2<sup>7 </sup>kinds of contexts according to a distribution of pixel values constituting the context.
0045The 2<sup>7 </sup>kinds of contexts and its probable values constituting respective contexts correspond with each other in one to one by the indexes C gained by the following expression (1). <maths id="MATH-US-00002" num="00002"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>C</mi><mo>=</mo><mrow><munder><mover><mo>∑</mo><mn>6</mn></mover><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow></munder><mo></mo><mrow><msub><mi>C</mi><mi>i</mi></msub><mo>·</mo><msup><mn>2</mn><mi>j</mi></msup></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>1</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="USRE40469E_D0002.tif" />
0046In a process for gaining a probable value, it is progressed that a context is constructed as shown in FIGS. <b>2</b>(a) and <b>2</b>(b), and a value of context index is gotten through the above-mentioned expression (1), and a probable value Pi corresponding to the index is read on a context probable table. Such a probable value is a probability for the interior of an object, and according to a size of the value, ‘0’ indicating the exterior of object or ‘1’ indicating the interior of object is selected.
0047In the context template constructing process as the above, a context template for outermost pixels positioned on the left and upper sides of a current block can not be constructed as shown in FIGS. <b>2</b>(a) and <b>2</b>(b). In other words, when the leftmost column is interpolated in the horizontal interpolating process, there are no pixels corresponding to C<b>0</b>, C<b>3</b> and C<b>5</b> of FIG. <b>2</b>(a), and when the uppermost row is interpolated, there are no pixels corresponding to C<b>0</b>, C<b>1</b> and C<b>2</b> of FIG. <b>2</b>(a). In the vertical interpolating process, also, for the leftmost column there are no pixels corresponding to C<b>0</b>, C<b>3</b> and C<b>4</b> of FIG. <b>2</b>(b), and when the uppermost row is interpolated, there are no pixels corresponding to C<b>0</b>, C<b>1</b> and C<b>2</b> of FIG. <b>2</b>(b).
0048Thus, in order to interpolate pixels corresponding to the leftmost column and uppermost row of a current block, a bordering should be done before the interpolation. As shown in <figref idref="DRAWINGS">FIG. 4</figref>, pixel values of corresponding positions in an adjacent block are brought and the brought pixel values construct such required pixels, and such a process is said as, a bordering.
0049In order to construct a context of pixels corresponding to the leftmost column and uppermost row of a current block, the pixels in the adjacent block are bordered on the current block as shown in FIG. <b>4</b>. Since blocks positioned on the outermost side of an inputted binary picture have not neighboring blocks, its own leftmost column and uppermost row are copied on the right and left sides in executing the bordering.
0050The bordering process is described more in detail as follows.
0051First, in case the current block <b>41</b> is not the uppermost block and the leftmost block of binary picture, namely, in case blocks on its upper and left sides exist, a top border <b>42</b> is made with the lowermost row of a top block <b>45</b> neighboring to the upper side of the current block <b>41</b>, and a left border <b>43</b> is made with the rightmost column of a left block <b>47</b> adjacent to the left of the current block <b>41</b>. A corner border <b>44</b> is constructed with the rightmost-lowermost pixel value near to the top-left side of the current block <b>41</b>.
0052Next, in other case, namely, in case a current block <b>41</b> is the uppermost or leftmost block of the inputted binary picture, referring to <figref idref="DRAWINGS">FIG. 5</figref> there is illustrated a method for bordering a block positioned on the uppermost or leftmost side of the binary picture. If the current block is the uppermost block, a pixel value of a top block can not be used for the bordering as afore-mentioned since a block does not exist on the top side.
0053A top border <b>52</b> is constructed by copying the uppermost row of a current block <b>51</b>, which represents pixels known before an up-sampling and shown in a checkered type on a second row of FIG. <b>5</b>. On the copied top border <b>52</b>, pixels for unknown values <b>521</b>, <b>521</b>, . . . among pixels for known values <b>522</b>, <b>522</b>, . . . are constructed by copying the known pixels <b>522</b>, <b>522</b> . . . positioned on its right or left side.
0054If the current block is the leftmost block of the inputted binary picture, a left border <b>53</b> is constructed by utilizing known pixels before an up-sampling, which are presented as a checkered type in <figref idref="DRAWINGS">FIG. 5</figref>, on the leftmost column of the current block <b>51</b>, which are pixels known before the up-sampling and shown in a checkered type on a second column of FIG. <b>5</b>. Pixels for unknown values <b>531</b>, <b>531</b>, . . . among pixels for known values <b>532</b>, <b>532</b>, . . . are constructed by copying the known values of pixels <b>532</b>, <b>532</b> . . . positioned on its top or lower side. Like this, in case the current block is the leftmost or uppermost side of the inputted binary picture, the corner border may be determined as a value of ‘0’ or ‘1’.
0055Meanwhile, in case pixels on the rightmost column of the current block or on its lowermost side are interpolated, a context template for the rightmost and lowermost pixels of the current block can not be formed as shown in FIGS. <b>2</b>(a) and <b>2</b>(b). Namely, there are no pixels corresponding to C<b>5</b> and C<b>6</b> of FIG. <b>2</b>(a) in case the lowermost row is interpolated in a horizontal interpolating process. In a vertical interpolating process, there are no pixels corresponding to C<b>2</b> and C<b>6</b> of FIG. <b>2</b>(b) in case the rightmost row is interpolated. In this case, but, the bordering is not executed, a voluntary value is determined by a software, to thereby construct a context template, in a context calculating part <b>71</b> mentioned later.
0056<figref idref="DRAWINGS">FIG. 6</figref> provides one embodiment with the construction of an inventive bordering sector.
0057A block position detecting part <b>61</b> receives an address of a current block <b>41</b> from the inputted binary picture and detects a position of the current block <b>41</b>. A copy part <b>62</b> receives the position of current block outputted from the block position detecting part <b>61</b> and borders on the top, top-left and left side of the current block <b>41</b> in a block of a given size. A memory <b>63</b> stores blocks from the copy part <b>62</b> and outputs blocks <b>45</b>, <b>46</b>, <b>47</b> adjacent to the current block <b>41</b> to the copy part <b>62</b>.
0058The block position detecting part <b>61</b> receives addresses of pixels constituting the block inputted to the copy part <b>62</b>, detects a position of the current block and outputs its position signal to the copy part <b>62</b>. The copy part <b>62</b> detects by the inputted position signal whether or not a block position of the currently inputted binary picture belongs to the uppermost or leftmost block.
0059As its detection result, in case it corresponds to the uppermost or leftmost block, the uppermost row or the leftmost column of the current block is copied on its left or top, to thereby perform the bordering. For pixels for unknown values, namely, pixels before an up-sampling, <b>521</b>, <b>521</b>, . . . , <b>531</b>, <b>531</b>, . . . , on the uppermost row or the leftmost column, the bordering is executed by copying pixels positioned on its right and left or its upper and lower sides as aforesaid.
0060If the current block does not correspond to the uppermost or leftmost block, as above-mentioned the top border <b>42</b> is made with the lowermost row of the top block <b>45</b> neighboring to the upper side of the current block <b>41</b>, and the left border <b>43</b> is made with the rightmost column of the left block <b>47</b> adjacent to the left of the current block <b>41</b>. The corner border <b>44</b> is constructed with the rightmost-lowermost pixel value near to the top-left side of the current block <b>41</b>. Under such a bordered state, the horizontal and vertical interpolations are done.
0061<figref idref="DRAWINGS">FIG. 7</figref> sets forth one embodiment of an inventive horizontal or vertical interpolating sector.
0062A shape context calculating part <b>71</b> receives the bordered block from the bordering sector <b>32</b>, constructs a horizontal context shown in FIG. <b>2</b>(a) for each of the pixels, and calculates context indexes. A probable table referring part <b>72</b> receives the context indexes from the context calculating part <b>71</b>, reads probable values Pi corresponding to the indexes on a context probable table stored previously, and inputs the read values. A shape probability detecting part <b>74</b> detects whether or not the object interior probable value Pi read in the probable table referring part <b>72</b> is more than ½ of probable maximum value. An interior/exterior interpolating part <b>75</b> interpolates binary information into the interior or exterior of an object in response to a detection signal outputted from the probability detecting part <b>74</b>.
0063The construction of the horizontal interpolating sector <b>33</b> is equally applied to the vertical interpolating sector <b>34</b>. In the horizontal interpolating sector <b>33</b>, the context calculating part <b>71</b> constructs the horizontal context shown in FIG. <b>2</b>(a) and gets context indexes. In the vertical interpolatng sector <b>34</b>, the context calculating part <b>71</b> constructs the vertical context shown in FIG. <b>2</b>(b) and gets indexes.
0064A block bordered in the housing sector <b>32</b> is inputted to the context calculating part <b>71</b>, and the horizontal context shown in FIG. <b>2</b>(a) is therein constructed for respective pixels constituting the current block, and then context indexes C are calculated.
0065By the way, in case that the context template shown in FIG. <b>2</b>(a) is constructed in order to horizontally interpolate the rightmost column of the current block, an eighth column of the current block <b>51</b> shown in <figref idref="DRAWINGS">FIG. 5</figref>, and in case that the context template shown in FIG. <b>2</b>(a) is constructed in order to horizontally interpolate the lowermost row of the current block, an eighth row of the current block <b>51</b> shown in <figref idref="DRAWINGS">FIG. 5</figref>, there are no pixels corresponding to C<b>5</b> and C<b>6</b>. In the vertical interpolation, also, in case the context template for the rightmost column of the current block <b>51</b> is constructed, there are no pixels corresponding to C<b>2</b> and C<b>6</b> of FIG. <b>2</b>(b).
0066However, the bordering for the rightmost column and the lowermost row of the current block <b>51</b> is not executed in the bordering sector <b>32</b>, thus, the context calculating part <b>71</b> copies neighboring pixels or determines voluntary values through the software, for parts that there do not exist pixels, in constructing the context template shown in FIGS. <b>2</b>(a) and <b>2</b>(b). The context sample template is constructed by such a process in the context calculating part <b>71</b>, to then get context indexes.
0067The probable table referring part <b>72</b> reads and inputs the probable value Pi that the current pixel may be the interior of object, from the portable table stored according to the context indexes. The probability detecting part <b>74</b> compares the object interior probable value Pi read by the probable table referring part <b>72</b> with ½ of the maximum probable value, and outputs a signal for interpolating with the object interior value to the interior/exterior interpolating part <b>75</b> in case that the object interior probable value Pi is more than ½ of the maximum probable value. In case that the objct interior probable value Pi is less than ½ of the maximum probable value, the probability detecting part <b>74</b> outputs a signal for interpolating with the object exterior value to the interior/exterior interpolating part <b>75</b>. The interior/exterior interpolating part <b>75</b> interpolates the binary picture information into the interior or exterior of the object in response to a detection signal for interpolating with the interior or exterior value.
0068FIG. <b>8</b>(a) depicts a block of 8×8 completed in a horizontal interpolating process.
0069Pixels shown in oblique lines in FIG. <b>8</b>(a) are known previously before an interpolation, a context template of FIG. <b>2</b>(a) for pixels shown in checkered design in FIG. <b>8</b>(a) is made to get context indexes, a probable value for an object interior is gotten from a probable table by using the context indexes and interpolated into the interior or exterior of the object. In the horizontal interpolating process, the horizontal context template of FIG. <b>2</b>(a) from a pixel positioned on a second row and first column of the current block <b>51</b> is made, then the interpolation process is done successively in the right direction from that to an eighth row and seventh column of the current block <b>51</b>. Interpolating from a pixel positioned on the top and left side like this has a reason why an order of a coding and decoding on pictures is executed from the left and upper side, thus pixel values of blocks on the upper and left side are known previously.
0070When the pixels of checkered design are gotten in the horizontal interpolating process in FIG. <b>8</b>(a), pixels of checkered design in FIG. <b>8</b>(b), pixels on first, third, fifth and seventh rows, are interpolated in the vertical interpolating process. In the vertical interpolating process, the context template of FIG. <b>2</b>(b) is constructed and the interpolation process is done successively in the right direction, from a pixel positioned on a first row and first column of the current block <b>51</b> to a pixel of the first row and second column, . . . , a pixel of the first row and eighth column, a pixel of a third row and first column, . . . , a pixel of a seventh row and eighth column.
0071Such interpolation in the right direction from the leftmost side of the current block is not only for a reason why the coding and decoding order of pictures is performed from the left and top side but also for a reason why the context template of FIG. <b>2</b>(b) is constructed by using pixels positioned on the left side of the current pixel X.
0072<figref idref="DRAWINGS">FIG. 9</figref> offers a flow chart showing an inventive interpolating method.
0073In a step ST<b>901</b>, binary picture information is divided into blocks of a given size, e.g., 16×16, 8×8, etc., and bordering blocks <b>52</b>, <b>53</b> are bordered on the top and left sides of respective blocks <b>51</b>. In a step ST<b>902</b>, a horizontal interpolation process is performed for pixels constituting the bordered block. In a step ST<b>903</b>, a vertical interpolating process is executed for blocks completed in the horizontal interpolation process. Herewith, it is not always necessary to execute the horizontal interpolation process first surely, and there is not much difference even though the vertical interpolation first and the vertical interpolation next are done.
0074<figref idref="DRAWINGS">FIG. 10</figref> is a flow chart providing a bordering process in accordance with the present invention.
0075In a step ST<b>101</b>, the binary picture information is divided into blocks of a given size, e.g., 8×8, etc. In a step ST<b>102</b>, a current block is extended in a given size. For instance, a block of 8×8 is extended into a block of 16×16, by selecting one pixel among 2×2 for pixels having known its value such as the blocks <b>41</b>, <b>51</b> of <figref idref="DRAWINGS">FIGS. 4 and 5</figref> aforesaid. In a step ST<b>103</b>, it is detected whether or not one block is the uppermost block of the binary picture information. If it is the uppermost block, in a step ST<b>104</b> the uppermost row of the current block is bordered on the top of the current block. If it is not the uppermost block, in a step ST<b>105</b> the lowermost row of a block neighboring to the upper side of the current block is bordered on the top of the current block. In a step ST<b>106</b>, it is detected whether or not the current block is positioned on the leftmost side of the binary picture. In case the current block is positioned on the leftmost side, in a step <b>107</b> the leftmost column of the current block is bordered on the left of the current block. In case the current block is not positioned on the leftmost side, in a step <b>108</b> the rightmost column in the left neighboring block of the current block is bordered on the left of the current block. In a step <b>109</b>, a pixel on the rightmost and lowermost side of a block positioned on the top and left side of the current block is bordered on a corner of the top and left side of the current block.
0076<figref idref="DRAWINGS">FIG. 11</figref> illustrates a flow chart showing horizontal and vertical interpolating processes in the invention.
0077In a step ST<b>111</b>, for respective pixels constituting the block bordered through a bordering process, the context template shown in FIG. <b>2</b>(a) is made and context indexes are calculated. In a case of the vertical interpolation, the context template shown in FIG. <b>2</b>(b) is used. In a step ST<b>112</b>, a probable value within an object, stored in the probable table referring part <b>72</b>, is read and inputs the read values thereto by using the context indexes gotten in the step ST<b>111</b>. In a case of the vertical interpolation, the probable table referring part <b>72</b> is used. In a step ST<b>113</b>, it is detected whether or not the probable value Pi is more than ½ of the maximum probable value. Herewith, a case that the probable value for the object interior, Pi, is more than ½ of the maximum probable value, represents that the probable value for the object interior, Pi, is more than the probable value for the object exterior, Po. If the probable value for the object interior, Pi, is more than ½ of the maximum probable value, in a step ST<b>115</b> a value of the current pixel is determined as ‘1’ and this value is given as a pixel value of the object interior. If the probable value for the object interior, Pi, is less than ½ of the maximum probable value, in a step ST<b>114</b> a value of the current pixel is determined as ‘0’ and this value is given as a pixel value of the object exterior.
0078In a description of the present invention as aforementioned, the invention was applied to a case of dividing picture information into blocks of a given size. Meantime, the present invention can be also performed by extracting a video object plane (VOP) and applying the context index calculation, a computation of a probable value, a comparison of the probable values and exterior/interior interpolation processes thereto, for pixels constituting the VOP. Further, the unit for an interpolation may be a frame unit, a VOP unit, or a macro block (MB) unit.
0079The practical field in employing the present invention has an MPEG-4 scalable binary picture information coding. In order to display a base layer in the MPEG-4 scalable binary picture information coding, an interpolation process for changing the base layer to a picture of a size such as that in an enhancement is done. Since a CAE is utilized in coding the enhancement layer at this time, the probable table for respective contexts are arranged. Accordingly, in case that the same contexts used for the scalable coding in the interpolation process are employed, there is no need to make separately the probable tables since the same probable table can be utilized in the interpolation.
0080As above-mentioned, in accordance with the present invention, for an interpolating pixel a context template is made with its adjacent pixels, its context probable value is obtained, and probable values for the object interior and the object exterior are compared with each other. The binary picture information is then interpolated by a value provided from a case of more probable value as its comparison result, to thereby achieve an accurate interpolation.
0081It will be apparent to those skilled in the art that various modifications and variations can be made in the binary picture information interpolating method and apparatus of the present invention without deviating from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Contents4
13 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| EP0625761A2 | Cites | European Patent Office (EPO) | Applicant |
| US5594813A | Cites | United States of America | Applicant |
| US5699129A | Cites | United States of America | Applicant |
| US5933105A | Cites | United States of America | Applicant |
| US5960117A | Cites | United States of America | Applicant |
| US6002812A | Cites | United States of America | Applicant |
| US6823082B2 | Cites | United States of America | Search report |
| JPH06334844A | Cites | Japan | Applicant |
| JPH0795394A | Cites | Japan | Applicant |
| JPH0993440A | Cites | Japan | Applicant |
| EP625761 | Cites | European Patent Office (EPO) | Third party observation |
| JP6334844 | Cites | Japan | Third party observation |
| JP7095394 | Cites | Japan | Third party observation |
| JP9093440 | Cites | Japan | Third party observation |
| "MPEG-4 Video Verification model Version 7.0" Int'l Organization for Standardization-Organization Internatinale De Normalisatio, vol. N1642, Apr. 1997, pp. 1-271, XP00861690. | Non-patent | – | Applicant |
| Bossen F et al, "A simple and efficent binary coding technique based on bitmap representation", Acoustics, Speech, and Signal Processing, 1997, 1997 IEEE Int'l Conf. on Munich Germany, pp. 3129-3132. | Non-patent | – | Applicant |
| “MPEG-4 Video Verification model Version 7.0” Int'l Organization for Standardization-Organization Internatinale De Normalisatio, vol. N1642, Apr. 1997, pp. 1-271, XP00861690. | Non-patent | – | Third party observation |
| Bossen F et al, “A simple and efficent binary coding technique based on bitmap representation”, Acoustics, Speech, and Signal Processing, 1997, 1997 IEEE Int'l Conf. on Munich Germany, pp. 3129-3132. | Non-patent | – | Third party observation |
8 members in 4 offices
Priority claims11
| Document | Office | Kind | Date |
|---|---|---|---|
| 19970031813 | Republic of Korea | A | |
| 19970031813 | Republic of Korea | A | |
| 9731813 | Republic of Korea | – | |
| 11243498 | United States of America | A | |
| 11243498 | United States of America | A | |
| 94454204 | United States of America | A | |
| 09112434 | – | – | – |
| 9731813 | – | – | – |
| KR19970031813 | – | – | – |
| US19980112434 | – | – | – |
| US20040944542 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| EP0891076A2 | European Patent Office (EPO) | A2 | |
| KR19990013732A | Republic of Korea | A | |
| JPH1196349A | Japan | A | |
| US6453077B1 | United States of America | B1 | |
| JP3349957B2 | Japan | B2 | |
| KR100423719B1 | Republic of Korea | B1 | |
| EP0891076A3 | European Patent Office (EPO) | A3 | |
| USRE40469EThis record | United States of America | E |
38 transactions on the USPTO file
Allowed without a rejection on record.
- Non-final rejections
- 0
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Receipt into PubsR1021 | R1021 | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Oath or Declaration Filed (Including Supplemental)C602 | C602 | |
| Oath or Declaration Filed (Including Supplemental)C602 | C602 | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Cleared by OIPE CSRL194 | L194 | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Notice of Reissue Published in Official GazetteNRE. | NRE. | |
| Application Is Now CompleteCOMP | COMP | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Mail-Petition to Revive Application - GrantedMPREV | MPREV | |
| Cleared by OIPE CSRL194 | L194 | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| The identification of one or more legal entities other than the inventor(s), each such legal entityASGMT | ASGMT | |
| Petition EnteredPET. | PET. | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL | OATHDECL | |
| Cleared by OIPE CSRL194 | L194 | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Preliminary AmendmentA.PE | A.PE | |
| Initial Exam Team nnIEXX | IEXX |
4 recorded assignments at the USPTO, latest first
- Now
Now: Held by
PANTECH INC - 2016-09-12
De-merger
- From
- PANTECH CO LTD
- To
- PANTECH INC
Recorded 2016-09-12, Signed 2015-10-22
- 2016-09-12
Change of name.
- From
- HYUNDAI CURITEL INC
- To
- CURITEL COMMUNICATIONS INC
Recorded 2016-09-12, Signed 2002-04-04
- 2016-09-12
Change of name.
- From
- CURITEL COMMUNICATIONS INC
- To
- PANTECH & CURITEL COMMUNICATIONS INC
Recorded 2016-09-12, Signed 2002-08-02
- 2016-09-12
Merger.
- From
- PANTECH & CURITEL COMMUNICATIONS INC
- To
- PANTECH CO LTD
Recorded 2016-09-12, Signed 2009-12-30
9 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Fee payment procedurePAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Fee paymentFPAY | FPAY | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP |
Numbers
- Publication
- RE040469
- Publication, DOCDB
- RE40469
- Publication, EPODOC
- USRE40469E
- Application
- 10944542
- Application, DOCDB
- 94454204
- Application, EPODOC
- US20040944542
Titles
- English
- Apparatus and method for interpolating binary pictures, using context probability table
Classification
- CPC, 3
- G06T3/4007
- H04N21/23412
- H04N21/2365
- IPC, 7
- G06K9 32
- G06T5 00
- G06F17 17
- G06K9 36
- G06T3 40
- H04N1 393
- H04N1 411
- USPC, 2
- 382300000
- 382247000