Apparatus and method for converting resolution of compressed video
Abstract
An apparatus for converting a resolution of video including a decoding unit configured to convert a first resolution of a video signal to a second resolution according to a predetermined ratio, to scale a motion vector extracted from the video signal based on the predetermined ratio, and to compensate the scaled motion vector. Also included is a coding unit configured to code a signal output from the decoding unit.

Term
Term ended
Projected expiry passed 9 November 2024, 1.9 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
18 claims: 4 independent, 14 dependent
- 1An apparatus for converting a resolution of video, comprising:a decoding unit configured to convert a first resolution of a video signal into a second resolution according to a predetermined ratio, to scale a motion vector extracted from the video signal based on the predetermined ratio, and to compensate the scaled motion vector;and a coding unit configured to code a signal output from the decoding unit.
- 7A method for converting a resolution of video, comprising:converting a first resolution of a video signal into a second resolution according to a predetermined ratio;scaling a motion vector extracted from the video signal based on the predetermined ratio;and compensating the scaled motion vector.
- 11An apparatus for converting a resolution of a video, comprising:a variably length decoder and de-quantizer configured to decode a video signal;a down-sampling filter configured to convert a first resolution of the decoded signal to a second resolution according to a predetermined ratio;a motion vector scaler configured to scale an extracted motion vector based on the predetermined ratio;a motion vector compensating unit configured to compensate the scaled motion vector at a DCT region;a combining unit configured to combine the compensated scaled motion vector and the resolution converted video signal;and a frame memory configured to store the combined signal as a reference frame for compensating a motion vector of a next frame.
- 16A method for converting a resolution of a video, comprising:decoding and dequantizing a video signal;converting a first resolution of the decoded signal to a second resolution according to a predetermined ratio;scaling an extracted motion vector of the video signal based on the predetermined ratio;compensating the scaled motion vector at a DCT region;combining the compensated scaled motion vector and the resolution converted video signal;and storing the combined signal as a reference frame for compensating a motion vector of a next frame.
Independent claims4
45 paragraphs in 6 sections, as filed
BACKGROUND OF THE INVENTION
FIELD OF THE INVENTION
0001The present invention relates to a video processing apparatus, and more particularly to an apparatus and method for converting a resolution of a compressed video and for scaling down a resolution of the video contents.
BACKGROUND OF THE RELATED ART
0002In general, mobile terminals include LCDs with a variety of different resolutions. Thus, video information to be displayed on the LCD must be converted to match the resolution of the LCD being used. Therefore, the resolution of video information often needs to be converted to a new resolution. Further, because the resolution of the displays in mobile terminals is generally less than a resolution of a video to be displayed, the resolution of the video information is down converted using a resolution converter, for example.
0003There are generally two types of resolution converters: one is an open-loop converter and the other is a closed-loop converter.
0004First, an example of an open-loop converter will be described with reference to Figure 1. As shown, the open-loop converter includes a VLD (Variable Length Decoding) unit 11 for decoding a variable length of a video signal; a de-quantizer 12 for de-quantizing an output signal of the VLD unit 11; a down-sampling filter 13 for scaling down a resolution of a signal output from the de-quantizer 12; a quantizer 14 for quantizing an output signal of the down-sampling filter 13; a VLC (Variable Length Coding) unit 15 for coding a variable length of an output signal of the quantizer 14; and a motion vector re-sampler 16 for scaling down a motion vector of the input video signal. Note, a resolution scale-down ratio of the down-sampling filter 13 is the same as a motion vector scale-down ratio of the motion vector re-sampler 16.
0005The open-loop converter has a simple structure because a motion vector is not compensated when de-quantizing and quantizing the video signal. However, when continuously input P-frames are converted into a lower resolution, an error is accumulated and drifted, which degrades the picture quality. Namely, an error in one frame may not significantly affect the picture quality, but when the error is accumulated and drifted to other frames, the picture quality becomes more and more degraded. This type of problem is called an error drift problem.
0006The closed-loop converter is shown in Figure 2 and is used to address the error drift problem of the open-loop converter shown in Figure 1. As shown in Figure 2, the closed-loop converter includes a decoding unit 19 for decoding an input video signal in DCT (Discrete Cosine Transform) units; a down-sampling filter 26 for scaling down a resolution of a signal output from the decoding unit 19; and a coding unit 20 for compensating a video signal output from the down-sampling filter 26 with a final motion vector and coding the compensated video signal.
0007The decoding unit 19 includes a VLD unit 21 for decoding a variable length of the video signal; a de-quantizer 22 for de-quantizing a signal output from the VLD unit 21; a first motion vector compensating unit 23 for compensating a motion vector using a motion vector input through the VLD unit 21; a first frame memory 24 for storing a signal restored as a DCT coefficient value by adding the motion vector compensated by the first motion vector compensating unit 23 and an output signal of the de-quantizer 22; and a motion vector re-sampler 25 for scaling down a motion vector of the video signal input through the VLD unit 21.
0008In addition, the first motion vector compensating unit 23 compensates a motion vector using a signal stored in the first memory 24 as a reference frame. The motion vector re-sampler 25 calculates a final motion vector (<i>V</i><sub><i>n</i></sub>) using a general known method (rather than estimating the motion vector).
0009Next, the operation of the closed-loop converter will be described. When an I-frame is input to the closed-loop converter, the frame is decoded in its variable length through the VLD unit 21 and then restored to DCT coefficients through the de-quantizer 22. The VLD unit 21 also extracts various supplementary information (e.g., header information, motion information, etc.) from the I-frame.
0010A signal corresponding to the restored DCT coefficient is <i>X</i><maths id="math0001" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0001.tif" /></maths>. The <i>X</i><maths id="math0002" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0002.tif" /></maths> signal is input to the down-sampling filter 26 and becomes an <i>X</i><sub><i>n</i></sub> signal with a scaled-down resolution. Further, the <i>X</i><sub><i>n</i></sub> signal is then compressed in the coding unit 20. The <i>X</i><maths id="math0003" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0003.tif" /></maths> signal for the I-frame is also stored in the first frame memory 24, and is used as a reference frame for compensating a motion of a P-frame input after the I-frame.
0011Further, when the P-frame is input to the closed-loop converter, a result value obtained by performing a motion compensation on the P-frame based on the DCT coefficient value of a previous frame stored in the first frame memory 24 and an error signal <i>E</i><maths id="math0004" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0004.tif" /></maths> of the P-frame output through the VLD unit 21 and the de-quantizer 22 are added to restore the DCT coefficient value <i>X</i><maths id="math0005" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0005.tif" /></maths>. The restored DCT coefficient value <i>X</i><maths id="math0006" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0006.tif" /></maths> is then input to the down-sampling filter 26 and becomes the <i>X</i><sub><i>n</i></sub> signal with the scaled-down resolution. The <i>X</i><sub><i>n</i></sub> signal then compressed in the coding unit 20.
0012As mentioned above, the closed-loop converter reduces the error drift by compensating the motion vector. However, the structure of the closed-loop converter is more complex than the open-loop converter.
SUMMARY OF THE INVENTION
0013Accordingly, one object of the invention is to address at least the above problems and/or disadvantages and to provide at least the advantages described hereinafter.
0014Another object of the present invention is to simplify the structure of the complex closed-loop converter while maintaining a superior performance.
0015To achieve at least the above and other objects in whole or in parts, the present invention provides a novel apparatus for converting a resolution of video including a decoding unit configured to convert a first resolution of a video signal to a second resolution according to a predetermined ratio, to scale a motion vector extracted from the video signal based on the predetermined ratio, and to compensate the scaled motion vector. The apparatus also includes a coding unit configured to code a signal output from the decoding unit. The present invention also provides a novel converting method.
0016Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention. The objects and advantages of the invention may be realized and attained as particularly pointed out in the appended claims.
BRIEF DESCRIPTION OF THE DRAWINGS
0017The invention will be described in detail with reference to the following drawings in which like reference numerals refer to like elements wherein: <ul id="ul0001" list-style="none" compact="compact"><li>Figure 1 is a block diagram illustrating a related art open-loop converter;</li><li>Figure 2 is a block diagram illustrating a related art closed-loop converter; and</li><li>Figure 3 is a block diagram illustrating an apparatus for converting a resolution of video according to the present invention.</li></ul>
BEST MODE OF THE INVENTION
0018An apparatus and method for converting a resolution of video according to the present invention will now be described with reference to the accompanying drawings.
0019The apparatus for converting a resolution of video according to the present invention advantageously reduces a complexity of the structure of the related art closed-loop converter and also reduces the amount of calculations required for processing video signals while maintaining or exceeding the performance of the related art closed-loop converter.
0020As discussed above and with reference to Figure 2, the related art closed-loop converter includes the decoding unit 19, the down-sampling filter 26 for scaling down the resolution of the signal <i>X</i><maths id="math0007" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0007.tif" /></maths> output from the decoding unit 19 and the coding unit 20 for coding the signal <i>X</i><sub><i>n</i></sub> output from the down-sampling filter 26.
0021The coding unit 20 in Figure 2 also includes a second motion vector compensating unit 27 for compensating a motion using a motion vector applied after being scaled down at a certain ratio from the motion vector re-sampler 25; a quantizer 28 for quantizing a signal obtained by adding the motion vector compensated in the second motion vector compensating unit 27 and the signal output with its scaled-down resolution from the down-sampling filter 26; a second frame memory 30 for storing a signal obtained by adding a signal, which is obtained by de-quantizing a signal output from the quantizer 28, through the de-quantizer 29 of the coding unit 20 and the motion vector compensated in the second motion vector compensating unit 27; and a VLC 31 for coding a variable length of an output signal of the quantizer 28. Further, the second motion vector compensating unit 27 compensates the reference frame stored in the second frame memory 30 using a final motion vector output from the motion vector re-sampler 25.
0022Further, the signal <i>E</i><maths id="math0008" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">d</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0008.tif" /></maths> input to the quantizer 28 can be expressed by equation (1) shown below:<maths id="math0009" num="(1)"><math display="block"><mrow><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext> = </mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><mtext> - </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext>, </mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP1534015A2_D0009.tif" /></maths> where Mc means a general motion vector compensation by the second motion vector compensating unit 27, and the final motion vector used for the motion vector compensation is <i>V</i><sub><i>n</i></sub>. Note, <i>V</i><sub><i>n</i></sub> is calculated by re-estimating a motion vector <i>V</i><sub><i>n,k</i></sub> of a video signal input to the resolution converter through the motion vector re-sampler 25. In this instance, general known methods may be used as the motion vector re-estimating method.
0023The video signal <i>X</i><sub><i>n</i></sub> output from the down-sampling filter 26 after its resolution is scaled down and motion vector is compensated can be expressed by equation (2) as shown below:<maths id="math0010" num="(2)"><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><mtext> = </mtext><mtext mathvariant="italic">D</mtext><mtext>[</mtext><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">e</mtext></mrow></msubsup><mtext> + </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext>, </mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><msub><mrow><mtext></mtext></mrow><mrow><mtext>,</mtext></mrow></msub><msub><mrow><mtext></mtext></mrow><mrow><mtext mathvariant="italic">k</mtext></mrow></msub><mtext>)]</mtext></mrow></math><img file="EP1534015A2_D0010.tif" /></maths> where <i>E</i><maths id="math0011" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0011.tif" /></maths> is an error signal of the P-frame, 'D' means down-sampling filtering, Mc means motion vector compensation by the first motion vector compensating unit 23 and a motion vector used for the motion vector compensation is <i>V</i><sub><i>n</i></sub><sub>,</sub><sub><i>k</i></sub>. Namely, the video signal <i>X</i><sub><i>n</i></sub> of the current frame is a signal obtained by compensating a motion vector of a video signal <i>X</i><maths id="math0012" num=""><math display="inline"><mrow><mfrac linethickness="0" numalign="left" denomalign="left"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0012.tif" /></maths> of a previous frame, adding it with the error signal <i>E</i><maths id="math0013" num=""><math display="inline"><mrow><mfrac linethickness="0"><mrow><mtext mathvariant="italic">c</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0013.tif" /></maths> and then scaling down its resolution through the down-sampling filter 26.
0024By substituting equation (2) into equation (1), equation (3) shown below can be obtained:<maths id="math0014" num="(3)"><math display="block"><mrow><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext> = </mtext><mtext mathvariant="italic">D</mtext><mtext>[</mtext><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext> + </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext> ,</mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow></msub><mtext>)] - </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext>, </mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP1534015A2_D0014.tif" /></maths>
0025Because 'D' is a linear operator, equation (3) can be expressed as equation (4) shown below:<maths id="math0015" num="(4)"><math display="block"><mrow><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext> = </mtext><mtext mathvariant="italic">D</mtext><mtext>[</mtext><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext>] + </mtext><mtext mathvariant="italic">D</mtext><mtext>[</mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext>,</mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow></msub><mtext>)] - </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext>,</mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP1534015A2_D0015.tif" /></maths>
0026Because 'D' and 'Mc' at the second term of equation (4) are linear operators in which their order can be changed, equation (4) can be expressed by equation (5) shown below:<maths id="math0016" num="(5)"><math display="block"><mrow><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext> = </mtext><mtext mathvariant="italic">D</mtext><mtext>[</mtext><msubsup><mrow><mtext mathvariant="italic">E</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext>] + </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><mtext mathvariant="italic">D</mtext><mtext>[</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">c</mtext></mrow></msubsup><mtext>], </mtext><msubsup><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow><mrow><mtext mathvariant="italic">s</mtext></mrow></msubsup><mtext>) - </mtext><mtext mathvariant="italic">Mc</mtext><mtext>(</mtext><msubsup><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext><mtext>-1</mtext></mrow><mrow><mtext mathvariant="italic">d</mtext></mrow></msubsup><mtext>,</mtext><msub><mrow><mtext mathvariant="italic">V</mtext></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP1534015A2_D0016.tif" /></maths> where <i>V</i><maths id="math0017" num=""><math display="inline"><mrow><mfrac linethickness="0" numalign="left" denomalign="left"><mrow><mtext mathvariant="italic">s</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0017.tif" /></maths> is a value obtained by scaling down the motion vector <i>V</i><sub><i>n,k</i></sub> of the input video signal in accordance with a resolution scale-down ratio of the down-sampling filter 26. Namely, when the resolution of the input video signal is scaled down by 1/2 in its width and length, respectively, <i>V</i><maths id="math0018" num=""><math display="inline"><mrow><mfrac linethickness="0" numalign="left" denomalign="left"><mrow><mtext mathvariant="italic">s</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0018.tif" /></maths> becomes <i>V</i><sub><i>n,k</i></sub>/2.
0027The first and second parts in equation (5) are performed by the decoding unit 19 and the down-sampling filer 26 of the resolution converter, while the third part is performed by the coding unit 20.
0028Comparing equation (4) and equation (5), it can be seen the process performed in the coding unit is the same, and note the process performed by the decoding unit 19 and the down-sampling filter 26 is different at a point when the down-sampling filter is applied.
0029Next, Figure 3 is a block diagram showing an apparatus for converting a resolution of a compressed video according to the present invention. The apparatus of the present invention also solves equation (5), but advantageously has a simplified structure. In more detail, as shown, the apparatus includes a decoding unit 40 for decoding an input video signal to obtain a signal with a scaled-down resolution, combining the resolution scaled-down signal with a signal obtained by compensating a motion vector of the video signal, and outputting the signal. The apparatus also includes the coding unit 20 shown in Figure 2, and accordingly the details of the coding unit will not be reiterated.
0030The decoding unit 40 includes a down-sampling filter 33 for converting a resolution of a video signal which has been decoded into DCT units through a VLD unit 39 and a de-quantizer 32; a motion vector scaler 34 for scaling down the motion vector <i>V</i><sub><i>n</i></sub><sub>,</sub><sub><i>k</i></sub> extracted through the VLD unit 39 in accordance with a resolution scale-down ratio; a first motion vector compensating unit 35 for compensating the motion vector at a DCT region using the scale-downed motion vector <i>V</i><maths id="math0019" num=""><math display="inline"><mrow><mfrac linethickness="0" numalign="left" denomalign="left"><mrow><mtext mathvariant="italic">s</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0019.tif" /></maths>; a combiner 36 for combining the signal compensated through the first motion vector compensating unit 35 and the signal whose resolution has been scaled down through the down-sampling filter 33; and a first frame memory 37 for storing a video signal output from the combiner 36 as a reference frame for compensating a motion vector of the next frame.
0031Further, a motion vector re-sampler 38 provides a final motion vector <i>V</i><sub><i>n</i></sub> to the coding unit 20 from the decoding unit 40. Note, a motion vector <i>V</i><maths id="math0020" num=""><math display="inline"><mrow><mfrac linethickness="0" numalign="left" denomalign="left"><mrow><mtext mathvariant="italic">s</mtext></mrow><mrow><mtext mathvariant="italic">n,k</mtext></mrow></mfrac></mrow></math><img file="EP1534015A2_D0020.tif" /></maths> obtained by scaling down the motion vector <i>V</i><sub><i>n,k</i></sub> extracted through the VLD unit 31 in accordance with the resolution scale-down ratio is also input.
0032Further, each motion vector extracted from an input video signal is input as it is in the related art resolution converter, but in the present invention, each motion vector is input to the motion vector re-sampler 38.
0033Another difference between the related art closed-loop converter shown in Figure 2 and the resolution converter according to the present invention shown in Figure 3 is a position of the down-sampling filter 33. Namely, a point when the resolution conversion filter is applied is different.
0034In the resolution converter according to the present invention, the resolution of the video signal is scaled down before its motion vector is compensated through the first motion vector compensating unit 35. Namely, the resolution of the video signal is converted in advance, and then the motion vector is compensated.
0035An operation of the apparatus for converting a resolution of video in according to the present invention will now be described.
0036An input video signal is restored to a value of a DCT coefficient through the VLD unit 39 and the de-quantizer 32, and then output as a resolution scaled-down signal from the down-sampling filter 33. The motion vector of the input video signal extracted by the VLD unit 31 is scaled down in the same amount as the resolution scale-down ratio of the down-sampling filter 33 through the motion scaler 34, and then input to the first motion vector compensating unit 35 and the motion vector re-sampler 38.
0037The first motion vector compensating unit 35 compensates the motion vector output from the motion scaler 34 using a signal stored in the first frame memory 37, adds it to the resolution scaled-down signal through the down-sampling filter 33, and then transmits the signal to the first frame memory 37 and the coding unit 20. At this time, the resolution scaled-down signal is stored in the first frame memory 37 and is used as a reference signal for compensating a motion vector of a video signal of the next frame.
0038In the apparatus for converting a resolution of video according to the present invention, a resolution of the input video signal is scaled down through the down-sampling filter 33 and then the motion vector is compensated through the first motion vector compensating unit 35, so the size of the video signal stored in the first frame memory 37 is scaled down as much as the resolution scale-down ratio. In addition, the number of times of driving the first motion vector compensating unit 35 in accordance with the resolution scale-down ratio.
0039For example, if the resolution scale-down ratio is 1/2 in width and length, the size of the first frame memory 37 is reduced to 1/4 of the size of the related art frame memory, and the amount of calculation by the first motion vector compensating unit 35 is also reduced to 1/4 the amount of calculation of the related art.
0040As so far described, the apparatus and method for converting a resolution of video according to the present invention have the following advantages.
0041When video contents having a specific resolution are scaled down, a smaller frame memory can be used than the related art resolution conversion apparatus.
0042In addition, a smaller amount of calculations are performed compared to the related art resolution converter, and thus the video contents can be scaled down in resolution at a high speed. The complexity of this apparatus/method according to the present invention are also advantageously simplified.
0043This invention may be conveniently implemented using a conventional general purpose digital computer or microprocessor programmed according to the teachings of the present specification, as well be apparent to those skilled in the computer art. Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art.
0044The invention may also be implemented by the preparation of application specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art. The present invention includes a computer program product which is a storage medium including instructions which can be used to program a computer to perform a process of the invention. The storage medium can include, but is not limited to, any type of disk including floppy disks, optical discs, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, or any type of media suitable for storing electronic instructions.
0045The foregoing embodiments and advantages are merely exemplary and are not to be construed as limiting the present invention. The present teaching can be readily applied to other types of apparatuses. The description of the present invention is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, and variations will be apparent to those skilled in the art.
Contents6
23 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| EP3080992A4 | Cited by | European Patent Office (EPO) | Search report |
| US9185437B2 | Cited by | United States of America | Applicant |
| US12167006B2 | Cited by | United States of America | Applicant |
| WO2014071096A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| WO2021003671A1 | Cited by | World Intellectual Property Organization (WIPO) | Applicant |
| EP3997879A4 | Cited by | European Patent Office (EPO) | Search report |
| EP3080992A1 | Cited by | European Patent Office (EPO) | Search report |
| None | Non-patent | – | Applicant |
8 members in 5 offices; this record represents the family
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 2003083743 | Republic of Korea | – | |
| 20030083743 | Republic of Korea | A |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| EP1534015A2This record | European Patent Office (EPO) | A2 | |
| US2005111546A1 | United States of America | A1 | |
| KR20050049964A | Republic of Korea | A | |
| CN1622634A | China | A | |
| JP2005160083A | Japan | A | |
| CN100380981C | China | C | |
| US7577201B2 | United States of America | B2 | |
| EP1534015A3 | European Patent Office (EPO) | A3 |
12 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Application deemed to be withdrawnWithdrawn18D | 18D | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWNSTAA | STAA | |
| First examination report despatched17Q | 17Q | |
| Designation fees paidAKX | AKX | |
| Request for examination filed17P | 17P | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI |
Numbers
- Publication
- 1534015
- Application
- 40265746
Titles3
- German
- Vorrichtung und Verfahren zur Auflösungsumwandlung von komprimierten Videodaten
- English
- Apparatus and method for converting resolution of compressed video
- French
- Dispositif et méthode pour la conversion de résolution de données vidéo comprimées
Classification
- CPC, 8
- H04N19/59
- H04N19/16
- H04N19/513
- H04N19/61
- H04N19/48
- H04N19/82
- H04N19/40
- H04N19/51
- IPC, 11
- H04N19 44
- H04N7 01
- H04N7 24
- H04N19 50
- H04N19 503
- H04N19 513
- H04N19 59
- H04N19 60
- H04N19 61
- H04N19 625
- H04N19 91
Designated states35
- Contracting states, 29
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Iceland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Poland
- Portugal
and 5 moreShow fewer
- Romania
- Sweden
- Slovenia
- Slovakia
- Türkiye
- Extension states, 6
- Albania
- Croatia
- Lithuania
- Latvia
- North Macedonia
- Yugoslavia, later Serbia and Montenegro (until 2006)