Image decoder
4 claims: 3 independent, 1 dependent
- 1An image decoding apparatus for decoding moving pictures from a digital transport stream (5) being obtained by multiplexing a digital video bit stream being frame-coded or field-coded, and a time stamp signal, said apparatus comprising:de-multiplexing means (6) for extracting the digital video bit stream (7) and the time stamp signal (19) from the digital transport stream (5);first clock reproducing means (20) for reproducing a first clock signal (21) from the time stamp signal (19);decoding means (8) for decoding the digital video bit stream (7) and outputting a first digital video signal (9) having a first frame frequency in synchronization with the first clock signal (21);memory means (13) for storing at least the first digital video signal (9);timing generating means (105) for generating a second clock signal (106) independent of the first clock signal (21);switching means (81) for selecting one clock signal from said first clock signal (21) and said second clock signal (106) and outputting the selected clock signal (82);graphic generating means (10) for generating a graphic signal (11);overlaying means (12) for overlaying the first digital video signal (9,22) and the graphic signal (11) and outputting a first overlaid digital signal (15) in synchronization with the selected clock signal (82);and digital-to-analog converting means (16) for converting the first overlaid digital signal (15) into a first analog signal (17) in synchronization with the selected clock signal (82), characterized in that said switching means (81) selecting the selected clock signal independent of the first clock signal;and said digital-to-analog converting means (16) outputting the first analog signal (17) in a frame rate frequency which is set depending on the clock signal (82) selected by said switching means.
- 3An image decoding apparatus according claim 1 or 2, further comprising:interpolating means (51) for outputting a second digital video signal (52) obtained by increasing a spatial resolution of the first digital video signal (9);wherein said overlaying means (12) overlaying the second digital video signal (52,22) and the graphic signal (11) and outputting the overlaid digital signal (53) in synchronization with the selected clock signal (82).
- 4An image decoding apparatus according claim 1 or 2, further comprising:decimating means (61) for outputting a third digital video signal (62) obtained by decreasing a spatial resolution of the first digital video signal (9);wherein said overlaying means overlaying the third digital video signal (62,22) and the graphic signal (11) and outputting the overlaid digital signal (63) in synchronization with the selected clock signal (82).
Independent claims3
117 paragraphs, as filed
0001The present invention relates to an image decoding apparatus such as a personal computer, for example, that receives digital broadcast signals where image-compressed moving pictures and program information are multiplexed, and decodes selected moving pictures to display them.
0002Apparatuses that capture television broadcasts and display them include an apparatus that digitizes analog television broadcasts and displays moving pictures on a personal computer.
0003FIG. 10 shows an example of the structure of a personal computer for receiving analog broadcasts. Reference numeral 101 represents an input high-frequency signal. Reference numeral 102 represents a tuner. Reference numeral 103 represents A/D converting means. Reference numeral 104 represents a digital video signal which is a digitized video signal. Reference numeral 10 represents graphic generating means. Reference numeral 11 represents a graphic signal. Reference numeral 12 represents overlaying means. Reference numeral 13 represents a memory. Reference numeral 14 represents memory control means. Reference numeral 22 represents a memory data signal. Reference numeral 107 represents a overlaid digital video signal. Reference numeral 16 represents D/A converting means. Reference numeral 108 represents an analog video signal. Reference numeral 18 represents display means such as a CRT display. Reference numeral 105 represents timing generating means. Reference numeral 106 represents a clock for D/A conversion.
0004Here, the graphic signal 11 is a signal for causing graphics such as so-called icons and window frames to be displayed on the display screen of the personal computer.
0005In FIG. 10, the input high-frequency signal 101 is channel-selected by the tuner 102 and is digitized by the A/D converting means 103, the digitized video signal 104 is overlaid on the graphic signal 11 by the overlaying means 12, and the overlaid digital video signal 107 is supplied to the D/A converting means 16 and is output as the analog video signal 108.
0006The timing generating means 105 generates a display reference clock 106, which is supplied to the memory control means 14 so as to be used as a reading reference clock for reading the overlaid digital video signal from the memory and is supplied to the D/A converting means 16 so as to be used as a D/A conversion reference clock.
0007However, in this conventional image display apparatus, the overlaid digital video signal 107 is read out from the memory means 13 based on the display reference clock 106 that is most suitable for display of a personal computer. For this reason, the timing of the reading and the timing of writing of the digital video signal 104 to the memory means 13 are asynchronous to each other, so that a problem arises that in the digital video signal 104, after the D/A conversion, disturbances in displayed images such as tearing artifacts of display frames and missing frames are caused on the display means 18.
0008This problem similarly arises when digitally compressed video signals such as MPEG-compressed video signals are captured by a personal computer in order to support digital broadcasts which will emerge in the future.
0009It is the object of the present invention to provide an enhanced overlaying of a video image sequence and a graphic signal.
0010This is achieved by the features of the independent claim. <ul id="ul0001" list-style="none" compact="compact"><li>FIG. 1 is a block diagram of an image decoding apparatus according to the first embodiment;</li><li>FIG. 2 is a block diagram of an image decoding apparatus according to the second embodiment;</li><li>FIG. 3 is a timing chart in the image decoding apparatus according to the second embodiment;</li><li>FIG. 4 is a block diagram of an image decoding apparatus according to the third embodiment;</li><li>FIG. 5 is a block diagram of an image decoding apparatus according to the fourth embodiment;</li><li>FIG. 6 is a block diagram of an image decoding apparatus according to the fifth embodiment, which is in accordance with the present invention;</li><li>FIG. 7 is a block diagram of an image decoding apparatus as an example of modification of the second embodiment;</li><li>FIG. 8 is a block diagram of an image decoding apparatus as an example of modification of the third embodiment;</li><li>FIG. 9 is a block diagram of an image decoding apparatus as an example of modification of the fourth embodiment; and</li><li>FIG. 10 is a view of the example of the structure of the conventional personal computer for receiving analog broadcasts.</li></ul>
0011Embodiments 1 to 4 are for illustrative purposes only and for a better understanding of the invention.
(First Embodiment)
0012An image decoding apparatus according to the first embodiment is a decoding apparatus in which a digital transport stream is input and decoded that is obtained by multiplexing a digital video bit stream obtained by coding an image by frame coding or field coding, and a time stamp signal. The digital video bit stream and the time stamp signal are extracted from the digital transport stream by de-multiplexing means. The first clock signal is reproduced from the time stamp signal by the first clock reproducing means. Decoding means decodes the digital video bit stream, and outputs the first digital video signal having the first frame frequency and synchronizing with the first clock signal. At least the first digital video signal is written into the memory 13. Overlaying means reads out the first digital video signal read out from memory means, overlays the first digital video signal and a graphic signal generated by graphic generating means, and outputs the first overlaid digital signal synchronizing with the first clock signal. D/A converting means converts the first overlaid digital signal into the first analog signal in synchronization with the first clock signal.
0013Hereinafter, the first embodiment will be described with reference to a drawing.
0014FIG. 1 is a block diagram of an image decoding apparatus according to the first embodiment. The structure of this embodiment will hereinafter be described with reference to this figure.
0015In FIG. 1, the means denoted by reference numerals 10 to 14, 16, 18 and 22 are the same as the means-denoted by the same reference numerals in the conventional example shown in FIG. 10. Therefore, descriptions thereof are omitted.
0016In the figure, reference numeral 1 represents an input high-frequency signal, reference numeral 2 represents a tuner, reference numeral 3 represents a channel-selected digital modulated signal, and reference numeral 4 represents demodulating means for demodulating the modulated signal 3. Reference numeral 5 represents the digital transport stream after demodulation. In this example, the digital transport stream 5 complies with MPEG-2 (ISO/IEC13818-1). Reference numeral 6 represents the de-multiplexing means. Reference numeral 7 represents a digital video bit stream coded in compliance with MPEG-2 (ISO/IEC13818-2). Reference numeral 8 represents the decoding means for decoding the digital video bit stream 7. Reference numeral 9 represents the first digital video signal. Reference numeral 15 represents the first overlaid digital video signal. Reference numeral 17 represents the first analog signal. Reference numeral 19 represents the time stamp signal output from the de-multiplexing means. Reference numeral 20 represents the first clock reproducing means comprising a PLL or the like. Reference numeral 21 represents the first clock signal. Here, the digital video bit stream 7 is one obtained by compressing, in compliance with MPEG-2/H-14, a video signal with 480 active scanning lines (525 lines when blanking is included), 704 active pixels per line (858 pixels per line when blanking is included) and the first frame frequency of 59.94 frames per second.
0017The operation of the image decoding apparatus thus structured will be described below.
0018The input high-frequency signal 1 is channel-selected by the tuner 2. The digital modulated signal 3 of the selected channel is supplied to the demodulating means 4 to be demodulated, so that the digital transport stream 5 is obtained. From the digital transport stream 5, the digital video bit stream 7 and the time stamp signal 19 are separated by the de-multiplexing means 6.
0019The digital video bit stream 7 is decompressed by the decoding means 8 and the first digital video signal 9 is output. The time stamp signal 19 is supplied to the first clock reproducing means 20. As the first clock signal 21, a clock of 27 MHz (accurately, 26.999973 MHz) corresponding to the total number of samples per second is reproduced.
0020The first clock signal 21 is supplied to the decoding means 8 to be used as a sample clock for outputting the first digital video signal 9, and simultaneously therewith, the first clock signal 21 is supplied to the memory control means 14 to be used as a clock for writing and reading the active pixels of the first digital video signal 9 to and from the memory 13 and is supplied to the D/A converting means 16 to be used as a reference clock for D/A conversion. The first clock signal 21 is also supplied to the overlaying means 12 to be used as a reference clock for outputting the first overlaid digital signal 15.
0021The graphic generating means 10 generates graphic data such as icons.
0022In this embodiment, the memory 13 has an input buffer area into which the first digital video signal is written and an output buffer area into which the first overlaid digital signal is written.
0023The memory control means 14 writes the first digital video signal 9 into the input buffer area of the memory 13 by way of the memory data signal 22 with reference to the first clock signal 21.
0024The overlaying means 12 reads out the first digital video signal written in the input buffer area of the memory 13 by the memory data signal 22, overlays it with the graphic signal 11 into the first overlaid digital video signal 15 and writes the signal 15 into the output buffer area of the memory 13.
0025Then, in synchronization with the first clock signal 21, the first overlaid digital signal 15 read out from the output buffer area of the memory 13 by way of the memory data signal 22 (the overlaying means 12) is supplied to the D/A converting means.
0026The D/A converting means is supplied with the first clock signal 21, and in synchronization with the first clock signal 21, the first overlaid digital signal 15 is converted into the analog video signal 17 and displayed on the display means 18.
0027As the method of generating the first overlaid digital signal, the above-described method has been explained in which the first digital video signal 9 is written into the input buffer area of the memory 13 and the first overlaid digital signal 15 is written into the output buffer area of the memory 13 both by way of the memory data signal 22. However, the method is not limited thereto; for example, a method is possible in which only the first digital video signal 9 is written into and read from the input buffer area of the memory 13 (frame memory) by way of the memory data signal 22, and the first digital video signal 9 being read out is overlaid on the graphic signal 11 by the overlaying means 12, temporarily held in a predetermined memory of the overlaying means 12 for timing and then, supplied to the D/A converting means as the first overlaid digital signal 15 in synchronization with the first clock signal 21. In this case, only the input buffer area is necessary for the memory 13.
0028As described above, in the first embodiment, the first digital video signal 9 output from the decoding means 8, the first overlaid digital signal 15 read out from the memory 13 by way of the memory data signal 22, and the D/A converting means 16 are synchronized with one another, so that display can be provided on the display means 18 without any display frame disturbances being caused.
(Second Embodiment)
0029An image decoding apparatus according to the second embodiment is a decoding apparatus in which a digital transport stream is input and decoded that is obtained by multiplexing a digital video bit stream obtained by coding an image by frame coding or field coding, and a time stamp signal. De-multiplexing means extracts the digital video bit stream and the time stamp signal from the digital transport stream. First clock reproducing means reproduces the first clock signal from the time stamp signal. Second clock reproducing means reproduces the second clock signal from the first clock reproducing means. Decoding means decodes the digital video bit stream, and outputs the first digital video signal having the first frame frequency and synchronizing with the first clock signal. At least the first digital video signal is written into the memory 13. Overlaying means overlays a graphic signal generated by graphic generating means and the first digital video signal read out from the memory 13, and outputs the second overlaid digital signal synchronizing with the first clock signal and having the second frame frequency. D/A converting means converts the second overlaid digital signal into the second analog signal in synchronization with the second clock signal.
0030Hereinafter, the second embodiment will be described with reference to drawings.
0031FIG. 2 is a block diagram of the second embodiment. The difference of the second embodiment from the first embodiment is that image signals having a different frame frequency from the frame frequency of the first digital video signal 9 output from the decoding means 8 can be displayed. In this embodiment, the frame frequency of the first digital video signal 9 is 24 Hz and the second frame frequency is 60 Hz. In FIG. 2, the elements 10 to 14, 16, 17 to 18 and 22 are the same as those of the conventional example shown in FIG. 10, and the elements 1 to 9 are the same as those of the first embodiment shown in FIG. 1. Reference numeral 31 represents the second clock reproducing means. Reference numeral 32 represents the second clock signal. Reference numeral 33 represents the second overlaid digital signal. Reference numeral 34 represents the second analog signal.
0032In FIG. 3, reference numeral 35 represents a decoding start signal, reference numeral 36 represents a vertical synchronizing signal, reference numerals 37 and 38 represent pulses of the decoding start signal 35, and reference numerals 39 and 40 represent pulses of the vertical synchronizing signal 36.
0033Here, the digital video bit stream 7 is one obtained by compressing, in compliance with MPEG-2/H-14, a video signal with 720 active scanning lines (750 lines when blanking is included), 1280 active pixels per line (1650 pixels per line when blanking is included) and the first frame frequency of 24 frames per second. The first frame frequency thereof is 24 frames per second.
0034In FIG. 3, while B1 and B2 represent bidirectional predictive images in MPEG-2 coding and P2 represents a forward predictive image in MPEG-2 coding, generality is not deteriorated.
0035The operation of the image decoding apparatus thus structured will be described below.
0036In FIG. 2, the process from the channel selection from the input high-frequency signal 1 to the reproduction of the first digital video signal 9 and the time stamp signal 19 is the same as that of the first embodiment.
0037Since the sample clock of the first digital signal 9 is obtained as 29.7 MHz as the total number of samples per second including blanking, 29.7 MHz is generated as the first clock signal 21 by the first clock reproducing means 20 and is supplied to the decoding means 8 and the memory control means 14.
0038Since the second frame frequency is 2.5 times the first frame frequency, the number of samples per second is 2.5 times. Therefore, the first clock signal 21 is multiplied by 5/2 by the second clock reproducing means 31 to generate 74.25 MHz as the second clock signal 32, which is supplied to the memory control means 14 and the D/A converting means 32.
0039In this embodiment, the memory control means 14 uses the first clock signal 21 as a clock for writing to the memory 13 and uses the second clock signal 32 as a clock for reading from the memory 13.
0040In this embodiment, the memory 13 has an input buffer area into which the first digital video signal is written and an output buffer area into which the second overlaid digital signal 33 is written.
0041The memory control means 14 writes the first digital video signal 9 into the input buffer area of the memory 13 by way of the memory data signal 22 in synchronization with the first clock signal 21.
0042The overlaying means 12 reads out the first_digital video signal written in the input buffer area of the memory 13, overlays the first digital video signal and the graphic signal into the second overlaid digital video signal 33, and writes the signal 33 into the output buffer area of the memory 13.
0043Then, the second overlaid digital signal 33 read out from the output buffer area of the memory 13 at a timing with reference to the second clock signal 32 is supplied to the D/A converting means 16.
0044The D/A converting means 16 is supplied with the second clock signal 32, and in synchronization with the second clock signal 32, the second overlaid digital signal 33 is converted into the analog video signal 17 and displayed on the display means 18.
0045FIG. 3 shows the timing of the display. The first digital signal 9 is input to the overlaying means 12 at the pulse 37 with reference to the first clock signal and is written into the memory 14.
0046As shown in FIG. 3, the first digital video signal 9, that is, B1 is written into the memory 14 once at the timing of the pulse 37 with reference to the first clock signal.
0047The second overlaid digital signal 33 is read out from the memory 14 twice at the pulses 39 and 40, and is output. Likewise, as shown in FIG. 3, the first digital video signal 9, that is, B2 is written into the memory 14 once at the timing of the pulse 38 in synchronization with the first clock signal.
0048The second overlaid digital signal 33 is read out from the memory 14 three times at the pulses 41, 42 and 43, and is output. Consequently, the second overlaid digital signal has, as the second frame frequency, 60 Hz which is 2.5 times the first frame frequency 24 Hz. Further, the second overlaid digital signal 33 is converted from a digital signal to an analog signal by the D/A converting means 16 of FIG. 2 in synchronization with the second clock signal, thereby obtaining the second analog signal 34 of FIG. 2.
0049As the method of generating the second overlaid digital signal, in addition to the above-described method in which the first digital video signal 9 is written into the input buffer area of the memory 13 and the second overlaid digital signal 3 is written into the output buffer area of the memory 13 both by way of the memory data signal 22, a method is possible in which only the first digital video signal 9 is written into and read from the input buffer area of the memory 13 by way of the memory data signal 22, is overlaid on the graphic signal 11 by the overlaying means 12, and is then supplied to the D/A converting means as the second overlaid digital signal 33 in synchronization with the second clock signal 31. In this case, only the input buffer area is necessary for the memory 13.
0050The same applies when the digital bit stream 7 is one obtained by compressing a video signal with 720 active scanning lines (750 lines when blanking is included), 1280 active pixels per line (1650 pixels per line when blanking is included) and the first frame frequency of 60 frames per second in compliance with MPEG-2/H-14, and the frame frequency of the second overlaid digital signal 33 is 120 Hz. In this case, since the display frequency is 120 Hz, flicker can more effectively be reduced.
0051As described above, in the second embodiment, since the second overlaid digital video signal 33 is synchronized with the second clock signal 32 and the D/A conversion by the D/A converting means 16 is performed in synchronization with the second clock signal 32, the second analog video signal having a frame frequency 2.5 times that of the first digital video signal 9 can be displayed on the display means 18 without any display frame disturbances being caused.
(Third Embodiment)
0052An image decoding apparatus according to the third embodiment is a decoding apparatus in which a digital transport stream is input and decoded that is obtained by multiplexing a digital video bit stream obtained by coding an image by frame coding or field coding, and a time stamp signal. De-multiplexing means extracts the digital video bit stream and the time stamp signal from the digital transport stream. First clock reproducing means reproduces the first clock signal from the time stamp signal. Second clock reproducing means reproduces the second clock signal from the first clock reproducing means. Decoding means decodes the digital video bit stream, and outputs the first digital video signal having the first frame frequency and synchronizing with the first clock signal. Interpolating means outputs the second digital video signal obtained by increasing the spatial resolution of the first digital video signal. At least the second digital video signal is written into the memory 13. Overlaying means overlays a graphic signal generated by graphic generating means and the second digital video signal read out from the memory means, and outputs the third overlaid digital signal synchronizing with the second clock signal. D/A converting means converts the third overlaid digital signal into the third analog signal in synchronization with the second clock signal.
0053Hereinafter, the third embodiment will be described with reference to a drawing.
0054FIG. 4 is a block diagram of the third embodiment. The difference of the third embodiment from the second embodiment is that it is made possible to interpolate the first digital video signal 9 to provide high-resolution display.
0055In FIG. 4, the elements 10 to 14, 16 and 17 to 18 are the same as those of the conventional example shown in FIG. 10. The elements 1 to 9 are the same to those of the first embodiment shown in FIG. 1. The elements 31 to 32 are the same as those of the second embodiment shown in FIG. 2.
0056Reference numeral 51 represents the interpolating means. Reference numeral 52 represents the second digital video signal. Reference numeral 53 represents the third overlaid digital signal. Reference numeral 54 represents the third analog signal.
0057Here, the digital bit stream 7 is one obtained by compressing a video signal with 480 active scanning lines, 704 active pixels per line and 59.94 frames per second in compliance with MPEG-2/H-14. Moreover, the second digital video signal 52 has 720 active scanning lines (750 lines when blanking is included), 1280 active pixels per line (1650 pixels per line when blanking is included) and 60 frames per second.
0058The operation of the image decoding apparatus thus structured will be described below.
0059The first digital video signal 9 output from the decoding means 8 is supplied to the interpolating means 51. The interpolating means 51 increases the number of active scanning lines from 480 to 720 by a vertical filter comprising a transversal filter, and increases the number of active pixels from 704 per line to 1280 per line in a horizontal direction by a horizontal filter also comprising a transversal filter. The resultant signal is output as the second digital video signal 52.
0060The second clock reproducing means 31 generates the second clock signal 32 depending on the contents of the interpolation by the interpolating means 51. The second clock signal 32 is generated by gradually doubling the first clock signal 21 by a PLL. That is, in this embodiment, although the frame frequency is not increased unlike in the second embodiment, since the number of pixels of the frame image of the digital video signal after interpolation is larger than that before interpolation because of the increase in spatial resolution, it is necessary that the clock for reading have a higher frequency than the reference clock before interpolation, and the frequency depends on the contents of the interpolation. Specifically, the frequency of the second clock signal 32 is obtained in the following manner:
0061That is, the ratio of the number of pixels per second, including blanking, of the second digital video signal 25 to that of the first digital video signal 9 is obtained by the following expression (Expression 1) as: <maths id="math0001" num="(Expression 1)"><math display="block"><mfenced><mn>750</mn><mo>/</mo><mn>525</mn></mfenced><mo>×</mo><mfenced><mn>1650</mn><mo>/</mo><mn>858</mn></mfenced><mo>×</mo><mfenced><mn>60</mn><mo>/</mo><mn>59.94</mn></mfenced><mo>=</mo><mn>2.75.</mn></math><img file="EP0979005B1_D0001.tif" /></maths> Therefore, the frequency of the second clock signal 32 is 74.25 MHz which is obtained by multiplying 27 MHz by 2.75.
0062In this embodiment, since the second digital video signal 52 is generated by increasing the spatial resolution of the first digital video signal 9 by the interpolating means 51 as described above, the timing of writing and reading to and from the memory 13 synchronizes with the second clock signal 32.
0063In this embodiment, the memory 13 has an input buffer area into which the second digital video signal 52 is written and an output buffer area into which the third overlaid digital signal 53 is written.
0064The memory control means 14 writes the second digital video signal 52 into the input buffer area of the memory 13 by way of the memory data signal 22 with reference to the second clock signal 32.
0065The overlaying means 12 reads out, by the second clock signal 32, the second digital video signal 52 written in the memory 13 by the memory data signal 22, overlays the signal 52 and the graphic signal 11 into the third overlaid digital video signal 53, and writes the signal 53 into the output buffer area of the memory 13.
0066Then, in synchronization with the second clock signal 32, the third overlaid digital signal 53 is output from the memory 13 by way of the memory data signal 22, and is supplied to the D/A converting means.
0067The third overlaid digital signal 53 is converted into the third analog signal 54 by the D/A converting means 16 in synchronization with the second clock signal 32.
0068As the method of generating the third overlaid digital signal, in addition to the above-described method in which the second digital video signal 52 is written into the input buffer area of the memory 13 and the third overlaid digital signal 53 is written into the output buffer area of the memory 13 both by way of the memory data signal 22, a method is possible in which only the second digital video signal 52 is written into and read from the input buffer area of the memory 13 by way of the memory data signal 22 and the second digital signal 52 being read out is overlaid on the graphic signal 11 by the overlaying means 12 and is then supplied to the D/A converting means as the third overlaid digital signal 53 in synchronizaiton with the second clock signal 32. In this case, only the input buffer area is necessary for the memory 13.
0069As described above, in the third embodiment, since the third overlaid digital video signal 53 synchronizes with the second clock signal 32 and the D/A conversion is performed in synchronization with the second clock signal 32, the third analog video signal obtained by increasing the spatial resolution of the first digital video signal 9 can be displayed on the display means 18 without any display frame disturbances being caused.
(Fourth Embodiment)
0070An image decoding apparatus according to the fourth embodiment is a decoding apparatus in which a digital transport stream is input and decoded that is obtained by multiplexing a digital video bit stream obtained by coding an image by frame coding or field coding, and a time stamp signal. De-multiplexing means extracts the digital video bit stream and the time stamp signal from the digital transport stream. First clock reproducing means reproduces the first clock signal from the time stamp signal. Second clock reproducing means reproduces the second clock signal from the first clock reproducing means. Decoding means decodes the digital video bit stream, and outputs the first digital video signal having the first frame frequency and synchronizing with the first clock signal. Decimating means outputs the third digital video signal obtained by decreasing the spatial resolution of the first digital video signal. At least the third digital video signal is written into the memory 13. Overlaying means overlays a graphic signal generated by graphic generating means and the third digital video signal read out from the memory, and outputs the fourth overlaid digital signal synchronizing with the second clock signal. D/A converting means converts the fourth overlaid digital signal into the fourth analog signal in synchronization with the second clock signal.
0071Hereinafter, the fourth embodiment will be described with reference to a drawing.
0072FIG. 5 is a block diagram of the fourth embodiment. The difference of the fourth embodiment from the second embodiment is that the first digital signal 9 can be displayed being thinned out.
0073In FIG. 4, the elements 10 to 14 , 16 and 17 to 18 are the same as those of the conventional example shown in FIG. 10, the elements 1 to 9 are the same as those of the first embodiment shown in FIG. 1, and the elements 31 to 32 are the same as those of the second embodiment shown in FIG. 2.
0074Reference numeral 61 represents the interpolating means. Reference numeral 62 represents the third digital video signal. Reference numeral 63 represents the fourth overlaid digital signal. Reference numeral 64 represents the fourth analog signal.
0075Here, the digital bit stream 7 is one obtained by compressing, in compliance with MPEG-2/H-14, a video signal with 720 active scanning lines (750 lines when blanking is included), 1280 active pixels per line (1650 pixels per line when blanking is included) and 60 frames per second. The second digital video signal 52 has 480 active scanning lines (525 lines when blanking is included), 704 active pixels per line (858 pixels per line when blanking is included) and 59.94 frames per second.
0076The operation of the image decoding apparatus thus structured will be described below.
0077The first digital video signal output from the decoding means 8 is supplied to the decimating means 61. The decimating means 61 decreases the number of active scanning lines from 720 to 480 by a vertical filter comprising a transversal filter, and decreases the number of active pixels from 1280 per line to 720 per line in a horizontal direction by a horizontal filter also comprising a transversal filter. The resultant signal is output as the second digital video signal 52.
0078The second clock reproducing means 31 generates the second clock signal 32 depending on the contents of the decimating by the decimating means 61. The second clock signal 32 is generated by frequency-dividing the first clock signal 21. That is, in this embodiment, although the frame frequency is not increased unlike in the second embodiment, since the number of pixels of the frame image of the digital video signal after decimation is smaller than that before decimation because of the decrease in spatial resolution, it is necessary that the clock for reading have a lower frequency than the reference clock before decimation , and the frequency depends on the contents of the decimation . Specifically, the frequency of the second clock signal 32 is obtained in the following manner:
0079That is, the ratio of the number of pixels per second, including blanking, of the third digital video signal 62 to that of the first digital video signal 9 is obtained by the following expression (Expression 2) as: <maths id="math0002" num="(Expression 2)"><math display="block"><mfenced><mn>525</mn><mo>/</mo><mn>750</mn></mfenced><mo>×</mo><mfenced><mn>858</mn><mo>/</mo><mn>1650</mn></mfenced><mo>×</mo><mfenced><mn>59.94</mn><mo>/</mo><mn>60</mn></mfenced><mo>=</mo><mn>1</mn><mo>/</mo><mn>2.75.</mn></math><img file="EP0979005B1_D0002.tif" /></maths> Therefore, the frequency of the second clock signal 32 is 27 MHz which is obtained by multiplying 74.25 MHz by 1/27.
0080In this embodiment, since the third digital video signal 62 is generated by decreasing the spatial resolution of the first digital video signal 9 by the decimating means 61 as described above, the timing of writing and reading to and from the memory 13 synchronizes with the second clock signal 32.
0081In this embodiment, the memory 13 has an input buffer area into which the third digital video signal 62 is written and an output buffer area into which the fourth overlaid digital signal 63 is written.
0082The memory control means 14 writes the third digital video signal 62 into the input buffer area of the memory 13 by way of the memory data signal 22 with reference to the first clock signal 21.
0083The overlaying means 12 reads out the third digital video signal 62 written in the memory 13 by the memory data signal 22, overlays the signal 62 and the graphic signal 11, and writes it into the output buffer area of the memory 13 as the fourth overlaid digital signal 63. Then, in synchronization with the second clock signal 21, the fourth overlaid digital signal 63 is output from the memory 13 by way of the memory data 22 and supplied to the D/A converting means.
0084The fourth overlaid digital signal 63 is converted into the fourth analog signal 64 by the D/A converting means 16 in synchronization with the second clock signal 32.
0085As the method of generating the fourth overlaid digital signal, in addition to the above-described method in which the third digital video signal 62 is written into the input buffer area of the memory 13 and the fourth overlaid digital signal 63 is written into the output buffer area of the memory 13 both by way of the memory data signal 22, a method is possible in which only the third digital video signal 63 is written into and read from the input buffer area of the memory 13 by way of the memory data signal 22, and after the third digital video signal 63 being read out and the graphic signal 11 are overlaid by the overlaying means 12, then, the fourth overlaid digital signal 63 is supplied to the D/A converting means in synchronization with the second clock signal 31. In this case, only the input buffer area is necessary for the memory 13.
0086As described above, in the fourth embodiment, since the fourth overlaid digital video signal 63 is synchronized with the second clock signal 32 and the D/A conversion is performed in synchronization with the second clock signal 32, the fourth analog video signal 64 obtained by decreasing the spatial resolution of the first digital video signal 9 can be displayed on the display means 18 without any display frame disturbances being caused.
(Fifth Embodiment)
0087An image decoding apparatus according to a fifth embodiment, which is in accordance with the present invention, is a decoding apparatus in which a digital transport stream is input and decoded that is obtained by multiplexing a digital video bit stream obtained by coding an image by frame coding or field coding, and a time stamp signal. De-multiplexing means extracts the digital video bit stream and the time stamp signal from the digital transport stream. First clock reproducing means reproduces the first clock signal from the time stamp signal. Decoding means decodes the digital video bit stream, and outputs the first digital video signal having the first frame frequency and synchronizing with the first clock signal. Overlaying means overlays a graphic signal generated by graphic generating means and the first digital video signal, and outputs the first overlaid digital signal synchronizing with the first clock signal. Switching means switches between the first clock signal and the third clock signal independent of the first clock signal, and supplies the fourth clock signal. D/A converting means converts the fourth overlaid digital signal into the first analog signal in synchronization with the fourth clock signal.
0088Hereinafter, the fifth embodiment, in accordance with the present invention, will be described with reference to a drawing.
0089FIG. 6 is a block diagram of the image decoding apparatus according to the fifth embodiment.
0090In FIG. 6, the elements 10 to 14, 16, 18, 22, 105 and 106 are the same as those of the conventional example shown in FIG. 10. The clock 106 for D/A conversion is referred to as the third clock signal in this embodiment. The elements 1 to 9 and 15 to 21 are the same as those of the first embodiment shown in FIG. 1.
0091Reference numeral 81 represents the switching means. Reference numeral 82 represents a clock signal chosen by the switching means 81 between the first clock signal 21 and the third clock signal 106 (hereinafter, this clock signal will be referred to as the fourth clock signal).
0092Here, the digital video bit stream is one obtained by compressing a video signal with 480 active scanning lines, 704 active pixels per line and the first frame frequency of 59.94 frames per second in compliance with MPEG-2/H-14.
0093The operation of the image decoding apparatus thus structured will be described.
0094The input high-frequency signal 1 is channel-selected by the tuner 2. The digital modulated signal 3 of the selected channel is supplied to the demodulating means 4 to be demodulated, so that the digital transport stream 5 is obtained. From the digital transport stream 5, the digital video bit stream 7 and the time stamp signal 19 are separated by the de-multiplexing means 6.
0095The digital video bit stream 7 is decompressed by the decoding means 8 and the first digital video signal 9 is output. The time stamp signal 19 is supplied to the first clock reproducing means 20, and as the first clock signal 21, a clock of 27 MHz is reproduced.
0096In this embodiment, the memory 13 has an input buffer area into which the first digital video signal 9 is written and an output buffer area into which the first overlaid digital signal 15 is written.
0097The first clock signal 21 is supplied to the decoding means 8 to be used as a sample clock for outputting the first digital video signal 9, and simultaneously therewith, the first clock signal 21 is supplied to the memory control means 14 to be used for writing the first digital video signal 9 into the input buffer area of the memory 13 by way of the memory data signal 22. The overlaying means 12 reads out the first digital video signal 9 written in the input buffer area of the memory 13, overlays the signal 9 and the graphic signal, and writes it into the output buffer area of the memory 13 as the first overlaid digital signal 15.
0098The switching means 81 switches between the first clock signal 21 and the third clock signal 106 to generate the fourth clock signal 82.
0099The first overlaid digital signal 15 read out from the memory 13 in synchronization with the fourth clock signal 82 supplied to the memory control means 14 is supplied to the D/A converting means 16.
0100The fourth clock signal 82 is supplied to the D/A converting means 16 to be used as a reference clock for D/A conversion, and is converted into the analog video signal 17 at the timing of the fourth clock signal 82 to be displayed on the display means 18.
0101As the method of generating the first overlaid digital signal 15, in addition to the above-described method in which the first digital video signal 9 is written into the input buffer area of the memory 13 and the first overlaid digital signal 15 is written into the output buffer area of the memory 13 both by way of the memory data signal 22, a method is possible in which only the first digital video signal 9 is written into and read from the input buffer area of the memory 13 by way of the memory data signal 22, is overlaid on the graphic signal 11 by the overlaying means 12, and then, the first overlaid digital signal 15 is supplied to the D/A converting means in synchronization with the four clock signal 82. In this case, only the input buffer area is necessary for the memory 13.
0102As described above, in the fifth embodiment, since the first digital video signal 9 output from the decoding means 8, the first overlaid digital signal 15 read out from the memory 13 by way of the memory data signal 22 and the D/A converting means 16 are synchronized with one another, display can be provided on the display means 18 without any display frame disturbances being caused. Moreover, since the number of display frames can independently be set by performing D/A conversion asynchronous to the overlaid digital signal, remarkable convenience is provided for the user. Specifically, for example, when jitter of a graphic image displayed on the display means 18 is annoying, the third clock signal 106 is chosen by the switching means 81.
(Sixth Embodiment)
0103An image decoding apparatus according to a sixth embodiment, which is also in accordance with the present invention, is a decoding apparatus in which a digital transport stream is input and decoded that is obtained by multiplexing a digital video bit stream obtained by coding an image by frame coding or field coding, and a time stamp signal. De-multiplexing means extracts the digital video bit stream and the time stamp signal from the digital transport stream. First clock reproducing means reproduces the first clock signal from the time stamp signal. Second clock reproducing means reproduces the second clock signal from the first clock reproducing means. Decoding means decodes the digital video bit stream, and outputs the first digital video signal having the first frame frequency and synchronizing with the first clock signal. At least the first digital video signal is written into the memory 13. Overlaying means overlays a graphic signal generated by graphic generating means and the first digital video signal read out from the memory 13, and outputs the second overlaid digital signal synchronizing with the first clock signal and having the second frame frequency. Switching means switches to one clock signal (this will be referred to as the fourth clock signal) of the second clock signal and the third clock signal independent of the second clock signal, and outputs the clock signal. D/A converting means converts the second overlaid digital signal into the second analog signal in synchronization with the fourth clock signal.
0104Hereinafter, the sixth embodiment will be described with reference to a drawing.
0105FIG. 7 is a block diagram of the image decoding apparatus according to the sixth embodiment.
0106In FIG. 7, the elements 10 to 14, 16, 18, 22, 105 and 106 are the same as those of the conventional example of FIG. 10, the elements 1 to 9 and 15 to 21 are the same as the first embodiment shown in FIG. 1. The elements 31 to 34 are the same as those of the second embodiment. The elements 81 to 82 are the same as those of the fifth embodiment.
0107The sixth embodiment basically operates in a similar manner to the second embodiment, but is different therefrom in that the switching means 81 is provided. That is, the switching means 81 switches between the second clock signal 32 and the third clock signal 106 to generate the fourth clock signal 82.
0108The second overlaid digital signal 33 read out from the memory 13 in synchronization with the fourth clock signal 82 supplied to the memory control means 14 is supplied to the D/A converting means 16.
0109The fourth clock signal 82 is supplied to the D/A converting means 16 to be used as a reference clock for D/A conversion, and is converted into the second analog video signal 34 at the timing of the fourth clock signal 82 to be displayed on the display means 18.
0110As described above, in the sixth embodiment, since the second overlaid digital video signal 33 is synchronized with the second clock signal 32 and the D/A conversion by the D/A converting means 16 is performed in synchronization with the second clock signal 32., the second analog video signal 34 having a frame frequency 2.5 times that of the first digital video signal 9 can be displayed on the display means 18 without any display frame disturbances being caused. Moreover, since the number of display frames can independently be set by performing D/A conversion asynchronous to the second clock signal, remarkable convenience is provided for the user.
0111In the third and the fourth embodiments, like in the above-described sixth embodiment, the switching means 81 may be provided in a stage succeeding the second clock generating means 31 so that one of the second clock signal 32 and the third clock signal 106 can be chosen. This structure enables the frame frequency of the image displayed on the display means 18 to be freely switched. Structural views in which the switching means 81 is added to the structures of the third and the fourth embodiments as mentioned above are shown in FIGS. 8 and 9.
12 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| EP0735776A | Cites | European Patent Office (EPO) |
| EP0798932A | Cites | European Patent Office (EPO) |
| WO9750242A | Cites | World Intellectual Property Organization (WIPO) |
| JP1060155A | Cites | Japan |
| JP1089683A | Cites | Japan |
| JP10304270A | Cites | Japan |
| JP62281571A | Cites | Japan |
| HIROSHI FUJIWARA, "Point Zukaishiki Saishin MPEG Kyoukasho", 1st Edition, TOKYO, ASCII CORP., 1995, pages 235-238. | Non-patent | – |
| THE INSTITUTE OF IMAGE INFORMATION AND TELEVISION ENGINEERS, "Sougou Multimedia Sensho MPEG", 1st Edition, TOKYO, OHMUSHA, LTD., 1996, pages 54-55. | Non-patent | – |
8 members in 6 offices; this record represents the family
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 3837398 | Japan | – | |
| 3837398 | Japan | A | |
| 9900532 | Japan | W |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| WO9943154A1 | World Intellectual Property Organization (WIPO) | A1 | |
| JPH11341495A | Japan | A | |
| EP0979005A1 | European Patent Office (EPO) | A1 | |
| TW385617B | Taiwan Province of China | B | |
| US6486922B1 | United States of America | B1 | |
| EP0979005A4 | European Patent Office (EPO) | A4 | |
| EP0979005B1This record | European Patent Office (EPO) | B1 | |
| DE69937661D1 | Germany | D1 |
22 legal events, as 2 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Corresponds to:REF | REF | EP | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 0979005
- Application
- 999019631
Titles3
- German
- BILDDEKODIERER
- English
- IMAGE DECODER
- French
- DECODEUR D'IMAGE
Classification
- CPC, 8
- H04N21/4143
- H04N5/04
- H04N5/445
- H04N5/44504
- H04N21/440254
- H04N21/8146
- H04N21/426
- H04N21/43074
- IPC, 6
- H04N5 445
- H04N7 24
- H04N7 62
- H04N5 08
- H04N5 04
- H04N5 44
Designated states2
- Contracting states, 2
- Germany
- United Kingdom
