Apparatus and method for reproduction, reproducing program and recording medium

The present invention relates to a playback device, a playback method, a playback program, and a recording medium that enable picture-in-picture to be realized for a program recorded on a large-capacity recording medium such as a Blu-ray Disc.

In recent years, the Blu-ray Disc standard has been proposed as a standard for disc-type recording media that can be recorded and can be removed from a recording / playback device. In the Blu-ray Disc standard, a disc with a diameter of 12 cm and a cover layer of 0.1 mm is used as the recording medium, and a blue-violet laser with a wavelength of 405 nm and an objective lens with a numerical aperture of 0.85 are used as the optical system to record a maximum of 27 GB (gigabytes). Achieves capacity. This makes it possible to record Japanese BS digital high-definition broadcasting for two hours or more without degrading the image quality.

As the source (supply source) of the AV (Audio / Video) signal recorded on this recordable optical disc, a conventional analog signal by analog television broadcasting, for example, and a digital television such as BS digital broadcasting are used. It is assumed to be a digital signal from broadcasting. In the Blu-ray Disc standard, a standard that defines a method for recording AV signals from these broadcasts has already been created.

On the other hand, as a derivative standard of the current Blu-ray Disc, there is a movement to develop a playback-only recording medium in which movies and music are pre-recorded. DVDs (Digital Versatile Discs) have already become widespread as disc-shaped recording media for recording movies and music, but the playback-only optical discs based on this Blu-ray Disc standard are Blu-ray Discs. Taking advantage of its large capacity and high-speed transfer speed, it is superior to existing DVDs in that it can record high-definition video for 2 hours or more with high image quality. In the following, the playback-only recording medium of the Blu-ray Disc derivative standard will be referred to as BD-ROM (Blu-ray Disc-Read Only Memory) to distinguish it from recordable Blu-ray Discs.

On the other hand, in the current Blu-ray Disc standard, a method of displaying a list of video contents recorded on an optical disc on the screen, displaying a cursor on the list, and allowing the user to select the video content to be played. Functions related to the user interface such as are not defined. These functions are realized by the main body of the recording / playback device that records / reproduces a Blu-ray Disc. Therefore, even when the same recording medium is played back, the layout of the content list screen differs depending on the recording / playing device used for the playback, and the user interface also differs, which is not always easy for the user to use. As a play-only disc, it is necessary to display a menu screen or the like as intended by the disc (content) creator regardless of the playback device, and to realize a user interface as intended.

Further, the multi-story function in which the selection screen is displayed during the playback of the video content and the story branches according to the user's selection is also generally called an interactive function. In order to realize this interactive function, it is necessary for the disc creator to create a scenario in which the playback order and branching are defined, describe the scenario using a program language, a script language, etc., and record it on the disc. On the playback device side, by reading and executing the program, it is possible to reproduce the video content according to the creator's intention and to present the selection screen for branching.

In this way, in the current Blu-ray Disc standard (Blu-ray Disc Rewritable Format Ver1.0), how to configure the menu screen and branch selection screen, and the user in order to realize the user interface as intended by the creator. The method of describing the processing for input is not defined. Therefore, at present, it is difficult to realize playback according to the scenario intended by the creator using Blu-ray Disc in a compatible manner regardless of the manufacturer or model of the playback device. ..

In addition, a mechanism for displaying subtitles is indispensable for a playback-only disc containing a movie. However, this subtitle display is not defined in the current Blu-ray Disc standard.

On the other hand, conventionally, for example, in the DVD (Digital Versatile Disc) standard, the above-mentioned interactive functions have already been realized. For example, while playing a video with a DVD video, it is possible to call the menu screen using a remote control commander, for example, select a button located on the menu screen, and change the playback scene. there were. In addition, a mechanism for displaying subtitles was also stipulated. Regarding the subtitle display, for example, it was possible to switch between the Japanese subtitles and the English subtitles prepared in advance.

In the case of a DVD, the menu screen is composed of fixed sub-picture data, and when the menu screen is called, the sub-picture data is combined with the moving image data and displayed. Patent Document 1 describes a configuration in which sub-picture data is combined with moving image data and recorded on a recordable DVD.<patcit num="1"><text>Japanese Unexamined Patent Publication No. 10-308924</text></patcit>

Also in the above-mentioned BD-ROM, a plane for displaying moving images, sub-pictures (subtitles) and menus is provided, and images of these three planes are combined into one image and output to display subtitles and interactively. It has been proposed to be able to realize a simple display.

According to this, each plane is arranged in the order of a moving image plane for displaying a moving image, a subtitle plane for displaying subtitles, and a graphics plane for displaying menu screens and buttons from the back. Then, the subtitle plane is combined with the moving image plane, and the graphics plane is combined with the combined image. For the subtitle plane and the graphics plane, the opacity can be set for each pixel at the time of compositing, and for the pixel with the opacity set to 0, the pixel at the corresponding position of the plane behind the plane of the pixel is transparent. Is displayed.

<p> By the way, in a playback-only BD-ROM, a so-called picture-in-picture function is required to display another video image in a small area in the video image.</p><p> With the picture-in-picture function, for example, in a multi-angle video consisting of a plurality of different videos having the same time series during playback, the main angle is displayed on the main screen and the second angle is displayed on the main screen. It is possible to display in parallel on the child screen, which is a small area in the middle.</p><p> In order to realize picture-in-picture, it is necessary to provide a method of treating two video signals in parallel and synthesizing the images of these video signals and displaying them on one screen.</p><p> Further, in the case of picture-in-picture, it is often the case that an image of the size of the main screen is reduced to create an image to be displayed on the sub screen, and the image is combined with the main screen and displayed. Therefore, it is necessary to provide a method of supplying a reduced image to the moving image plane and synthesizing it.</p><p> Further, as a background for displaying the reduced moving image data, it is required to enable display called wallpaper by repeating images of a specific pattern or the like.</p><p> Therefore, an object of the present invention is to provide a reproduction device, a reproduction method, a reproduction program, and a recording medium capable of realizing a picture-in-picture function in a BD-ROM.</p><p> Another object of the present invention is to provide a playback device, a playback method, a playback program, and a recording medium capable of displaying a wallpaper displayed on the background of moving image data on a BD-ROM.</p>

<p> In order to solve the above-mentioned problems, the present invention provides a first storage means for storing first moving image data reproduced from a recording medium in a reproduction device for reproducing content data recorded on a disk-shaped recording medium. , A second storage means for storing the second moving image data reproduced from the recording medium, and a selection means for selecting the output of the first storage means and the second storage means in a predetermined area unit. It is a reproduction device characterized in that a display signal is generated based on the output of the means.</p><p> Further, according to the present invention, in a reproduction method for reproducing content data recorded on a disk-shaped recording medium, a step of storing the first moving image data reproduced from the recording medium in a first storage means and reproduction from the recording medium. It has a step of storing the second moving image data in the second storage means and a step of selecting the output of the first storage means and the second storage means in a predetermined area unit, and is a selection step. This is a reproduction method characterized in that a display signal is generated based on the output of.</p><p> Further, the present invention relates to a reproduction program for causing a computer device to execute a reproduction method for reproducing content data recorded on a disk-shaped recording medium, wherein the reproduction method is a first moving image data reproduced from the recording medium. The step of storing in the storage means, the step of storing the second moving image data reproduced from the recording medium in the second storage means, and the output of the first storage means and the second storage means are selected in predetermined area units. It is a reproduction program characterized in that it has a selection step to be performed and a display signal is generated based on the output of the selection step.</p><p> Further, the present invention relates to a recording medium in which a computer device in which a playback program is recorded that causes a computer device to execute a playback method for playing back content data recorded on a disk-shaped recording medium, in which the playback method is performed from the recording medium. A step of storing the reproduced first moving image data in the first storage means, a step of storing the second moving image data reproduced from the recording medium in the second storage means, the first storage means, and the first. The recording medium is characterized in that it has a selection step of selecting the output of the storage means of 2 in units of a predetermined area, and a display signal is generated based on the output of the selection step.</p><p> As described above, the present invention has a first storage means in which the first moving image data reproduced from the recording medium is stored, and a second storage in which the second moving image data reproduced from the recording medium is stored. Since the output of the means is selected in units of a predetermined area to generate a display signal, the first moving image data and the second moving image data can be exclusively combined and displayed.</p>

<p> According to the present invention, two moving image data reproduced from a recording medium are each stored in a memory, and the two moving image data stored in the memory are selected for each predetermined area, output, and displayed. Therefore, when one of the two video data is reduced video data, the unreduced video data and the reduced video data can be exclusively displayed on one screen, whereby picture-in-picture can be displayed. There is an effect that the function can be realized.</p><p> Further, by using the wallpaper image data instead of the unreduced moving image data, there is an effect that the wallpaper image can be displayed on the background of the reduced moving image data.</p><p> Further, since the selection of the two moving image data stored in the memory is performed in units of predetermined areas, there is an effect that the display can follow the change in the size of the reduced moving image data.</p><p> Further, in the first embodiment of the present invention, a second video plane is further provided for the plane configuration of the HD movie mode of the BD-ROM, and the output of the video plane and the second video plane is selected in units of predetermined areas. And output. Therefore, for example, by storing the reduced video data in the second video plane and selecting the output of the video plane and the second video plane according to the display position of the reduced video data, there is an effect that the picture-in-picture function can be realized. ..</p><p> Further, at this time, by storing the wallpaper image data in the video plane, there is an effect that the wallpaper image can be displayed on the background of the reduced moving image data.</p><p> Further, since the output of the video plane and the output of the second video plane are selected in units of predetermined areas, there is an effect that the display can follow the change in the size of the reduced video data stored in the second video plane, for example. ..</p><p> Further, in the second embodiment of the present invention, the plane configuration of the HD movie mode of the BD-ROM is left as it is, two frame buffers are provided in front of the video plane, and the output of the two frame buffers is set in a predetermined area unit. It is selected and output with, and supplied to the video plane. Therefore, for example, the moving image data read from one frame buffer is reduced to obtain reduced moving image data, and the reduced image data and the output of the other frame buffer are selected according to the display position of the reduced moving image data. This has the effect of realizing a picture-in-picture using a single video plane.</p><p> Further, since the output of the two frame buffers is selected in units of predetermined areas, there is an effect that the display can follow the change in the size of the reduced moving image data read from one frame buffer and reduced.</p><p> Furthermore, in the second embodiment of the present invention, the output of the video plane in which the moving image data incorporating the reduced moving image data is stored and the output of the presentation graphics plane in which the subtitle data is stored are combined. , Combines the output of the interactive graphics plane that stores image data such as GUI parts with the combined output. When synthesizing the output of the interactive graphics plane with the result of synthesizing the video plane and the presentation graphics plane, the area corresponding to the display position of the reduced image data on the video plane in the interactive graphics plane is set as the transparent area, and the other areas are set. By displaying the wallpaper image, there is an effect that the wallpaper image can be displayed on the background of the reduced video data without adding a plane to the plane configuration of the HD movie mode of BD-ROM.</p><p> In addition, when synthesizing the output of the interactive graphics plane with the result of synthesizing the video plane and the presentation graphics plane, the area corresponding to the display position of the reduced image data on the video plane in the interactive graphics plane is set as the transparent area. By arranging image data such as GUI parts in a predetermined manner on the interactive graphics plane and displaying the wallpaper image in an area other than the transparent area and the parts image data area, for the plane configuration of HD movie mode of BD-ROM. Even without adding a plane, there is an effect that it is possible to display as if a wallpaper image is displayed in the background of GUI component image data and reduced video data.</p>

Hereinafter, embodiments of the present invention will be described. First, in order to facilitate understanding, prior to the description of the embodiment of the present invention, a schematic configuration for displaying image data and a BD-ROM HD (High Definition) movie mode standard have been proposed. The method of synthesizing the moving image plane, the subtitle plane, and the graphics plane is explained. The HD movie mode of BD-ROM has been proposed to provide the same interactive function as DVD video in BD-ROM.

FIG. 1 schematically shows a typical configuration example for displaying image data. In addition, in FIG. 1, only the configuration necessary for the explanation is extracted and shown. The CPU (Central Processing Unit) 301 and the graphics unit 303 are connected to the bus 300. DRAM (Dynamic Random Access Memory) 302 is connected to CPU301 as a work memory. VRAM (Video RAM) 304 is connected to the graphics unit 303. The output of the graphics unit 303 is supplied to the display 310.

The CPU 301 uses the DRAM 302 as a frame buffer to perform predetermined processing such as reduction processing on the image data. The processed image data is read from the DRAM 302 by the CPU 301 and supplied to the graphics unit 303 via the bus 300.

The graphics unit 303 has a graphics control chip that sets the horizontal and vertical scanning frequencies to be sent to the display 310 to determine the display resolution and executes drawing commands from the CPU 301. The image data supplied to the graphics unit 303 is written to the VRAM 304. The image data written in the VRAM 304 is read out by the graphics unit 303 corresponding to predetermined horizontal and vertical scanning frequencies, and is supplied to the display 310 as a digital video signal. That is, VRAM304 corresponds to a plane, and the stored contents of VRAM304 are directly reflected on the display of the display 310.

Next, the plane configuration in the HD movie mode of the BD-ROM and the method of synthesizing each plane will be described. In the following, the moving image plane, the subtitle plane, and the graphics plane described in the background technology will be referred to as a video plane, a presentation graphics plane, and an interactive graphics plane, respectively.

FIG. 2 shows an example configuration of a video plane 10, a presentation graphics plane 11, and an interactive graphics plane 12. The video plane 10 is displayed at the rearmost side (bottom), and the image (mainly video data) specified in the playlist is handled. The presentation graphics plane 11 is displayed on the video plane 10 and handles subtitle data displayed during video playback. The interactive graphics plane 12 is displayed in the foreground and handles graphics data such as parts used for GUI (Graphical User Interface), for example, character data for displaying a menu screen and bitmap data representing buttons. On one display screen, these three planes are combined and displayed.

The video plane 10, the presentation graphics plane 11, and the interactive graphics plane 12 can be displayed independently, and have, for example, the resolution and displayable colors as shown in FIG. Video plane 10 is a system with a resolution of 1920 pixels x 1080 lines and a data length of 16 bits converted per pixel, with a luminance signal Y, color difference signal Cb, and Cr of 4: 2: 2 (hereinafter, YCbCr (hereinafter, YCbCr). 4: 2: 2)). In YCbCr (4: 2: 2), the luminance signal Y is 8 bits for each pixel, the color difference signals Cb and Cr are 8 bits each, and the color difference signals Cb and Cr are 2 horizontal pixels to form one color data. It is a color system that looks great.

The presentation graphics plane 11 has 1920 pixels x 1080 lines and the sampling depth of each pixel is 8 bits, and the color system is an 8-bit color map address using a palette of 256 colors.

The interactive graphics plane 12 has a resolution of 1920 pixels x 1080 lines and a sampling depth of 8 bits for each pixel, and the color system is an 8-bit color map address using a palette of 256 colors.

In addition to the above, the video plane 10 can have a resolution of 1280 pixels × 720 lines, 720 pixels × 480 lines, and 720 pixels × 576 lines. In that case, the presentation graphics plane 11 and the interactive graphics plane 12 have the same resolution as the video plane 10.

Further, in the above description, the color systems of the presentation graphics plane 11 and the interactive graphics plane 12 are set to 8-bit color map addresses using a palette of 256 colors, but this is not limited to this example. Regarding the number of colors, the number of colors in the palette may be increased by changing the sampling depth. For example, if the sampling depth is 12 bits, the number of colors that can be used in the palette can be 4096 colors. In addition, YCbCr (4: 4: 4) and RGB (4: 4: 4), in which the sampling depth is set to 24 bits and each pixel has color information without having a palette, are also possible with the same mechanism. is there.

The interactive graphics plane 12 and the presentation graphics plane 11 are capable of 256 levels of alpha blending, and the opacity can be set in 256 levels when combining with other planes. The opacity can be set for each pixel. In the following, it is assumed that the opacity α is represented in the range of (0 α 1), is completely transparent when the opacity α = 0, and is completely opaque when the opacity α = 1.

The presentation graphics plane 11 handles, for example, image data in PNG (Portable Network Graphics) format. In addition, the interactive graphics plane 12 can also handle image data in PNG format. In the PNG format, the sampling depth of one pixel is 1 bit to 16 bits, and when the sampling depth is 8 bits or 16 bits, the alpha channel, that is, the opacity information of each pixel component (referred to as alpha data). ) Can be added. If the sampling depth is 8 bits, you can specify the opacity in 256 steps. Alpha blending is performed using the opacity information from this alpha channel. In addition, a palette image of up to 256 colors can be used, and the index number indicates which element (index) of the palette prepared in advance.

The image data handled by the presentation graphics plane 11 and the interactive graphics plane 12 is not limited to the PNG format. Image data that has been compressed and coded by another compression coding method such as the JPEG method, run-length compressed image data, and bitmap data that has not been compressed and encoded may be handled.

FIG. 4 shows an example configuration in which three planes are combined according to FIGS. 2 and 3 described above. The video data of the video plane 10 is supplied to the 422/444 conversion circuit 20. The video data is input to the multiplier 21 after the color system is converted from YCbCr (4: 2: 2) to YCbCr (4: 4: 4) by the 422/444 conversion circuit 20. A resolution conversion circuit may be inserted between the 422/444 conversion circuit 20 and the multiplier 21 to convert the resolution of the moving image data.

The image data of the presentation graphics plane 11 is input to the palette 22 and output as RGB (4: 4: 4) image data. When the opacity by alpha blending is specified for this image data, the specified opacity α1 (0 α1 1) is output from the palette 22.

FIG. 5 shows an example of the input / output data of the palette 22. Palette 22 stores, for example, palette information corresponding to a PNG format file as a table. The index number of the palette 22 is referred to by using the input 8-bit pixel data as an address. Based on this index number, RGB (4: 4: 4) data consisting of 8-bit data is output. At the same time, the palette 22 extracts the alpha channel data representing the opacity.

FIG. 6 shows an example pallet table stored in the pallet 22. For each of the 256 color index values [0x00] to [0xFF] ([0x] indicates hexadecimal notation), the values R, G, and B of the three primary colors represented by 8 bits, respectively, Opacity α is assigned. Palette 22 refers to the palette table based on the input PNG format image data, and R, G, and B color data (RGB data) consisting of 8-bit data corresponding to the index value specified by the image data. ) And the opacity α are output for each pixel. A similar pallet table is also stored in the pallet 26, which will be described later.

The RGB data output from the palette 22 is supplied to the RGB / YCbCr conversion circuit 30, and each data length is converted into 8-bit luminance signal Y and color signals Cb and Cr data (hereinafter collectively referred to as YCbCr data). Call). This is because it is necessary to perform the subsequent interplane synthesis in a common data format, and it is unified to YCbCr data, which is the data format of video data.

The YCbCr data and the opacity data α1 output from the RGB / YCbCr conversion circuit 30 are input to the multiplier 23, respectively. A resolution conversion circuit may be inserted between the RGB / YCbCr conversion circuit 30 and the multiplier 23 to convert the resolution of the YCbCr data. In the multiplier 23, the opacity data α1 is multiplied by the input YCbCr data. The multiplication result is input to one input end of the adder 24. In the multiplier 23, each of the luminance signal Y, the color difference signal Cb, and Cr in the YCbCr data is multiplied by the opacity data α1. Further, the complement (1-α1) of the opacity data α1 is supplied to the multiplier 21.

In the multiplier 21, the complement (1-α1) of the opacity data α1 is multiplied by the moving image data input from the 422/444 conversion circuit 20. The multiplication result is input to the other input end of the adder 24. In the adder 24, the multiplication results of the multipliers 21 and 23 are added. As a result, the video plane 10 and the presentation graphics plane 11 are combined. The addition result of the adder 24 is input to the multiplier 25.

Similar to the presentation graphics plane 11, the image data of the interactive graphics plane 12 is also output as RGB (4: 4: 4) data by the palette 26 and input to the RGB / YCbCr conversion circuit 27. When the color system of the image data of the graphics plane 12 is RGB (4: 4: 4), the color system is converted to YCbCr (4: 4: 4) and output from the RGB / YCbCr conversion circuit 27. The YCbCr data output from the RGB / YCbCr conversion circuit 27 is input to the multiplier 28. A resolution conversion circuit may be inserted between the RGB / YCbCr conversion circuit 27 and the multiplier 28 to convert the resolution of the YCbCr data.

When the opacity by alpha blending is specified for the index value on the palette 26, the specified opacity α2 (0 α2 1) is output from the pallet 26. The opacity data α2 is supplied to the multiplier 28. In the multiplier 28, the YCbCr data input from the RGB / YCbCr conversion circuit 27 is multiplied by the opacity data α2 for each of the luminance signal Y, the color difference signal Cb, and Cr. The multiplication result by the multiplier 28 is input to one input end of the adder 29. Further, the complement (1-α2) of the opacity data α2 is supplied to the multiplier 25.

In the multiplier 25, the complement (1-α2) of the opacity data α2 is multiplied by the addition result of the adder 24. The multiplication result of the multiplier 25 is input to the other input end of the adder 29 and is added to the multiplication result by the multiplier 28 described above. As a result, the interactive graphics plane 12 is further synthesized with respect to the composite result of the video plane 10 and the presentation graphics plane 11.

In the presentation graphics plane 11 and the interactive graphics plane 12, for example, by setting the opacity α = 0 of the area where there is no image to be displayed, the plane displayed below the plane can be transparently displayed, for example. The moving image data displayed on the video plane 10 can be displayed as the background of the presentation graphics plane 11 and the interactive graphics plane 12.

The palette 22 and the RGB / YCbCr conversion circuit 30 may be combined into one as the palette 22', and the YCbCr data may be output directly from the palette 22'.

The configuration shown in FIG. 4 can be realized by both hardware and software.

With the above configuration, it is possible to display the menu screen and buttons required for the playback-only standard. By selecting a button on the menu screen, the playlist associated with that button can be played. In addition, the function of superimposing subtitles on a moving image, which is required for playback-only standards, is realized.

In the above-mentioned plane composition configuration, since there is only one video plane 10, two video data such as a picture-in-picture are handled in parallel, and two screens with two video signals are combined and simultaneously. It is not supposed to be displayed, and it is difficult to realize this with the configuration as it is.

Next, the first and second embodiments of the embodiment of the present invention will be described. An ultimate object of the present invention is to extend the HD movie mode of the BD-ROM described above to provide a format suitable for higher-performance graphics drawing and realization of interactivity with the user.

A standard that extends the HD movie mode of BD-ROM is called a full profile. The full profile aims to further enhance the functionality of BD-ROM and realize more complicated interactivity and support for network communication.

Furupu b a need in the file, of the features that are not implemented in the HD movie mode of the BD-ROM, relates plane configuration, the following three can be mentioned. (1) Picture-in-picture function. (2) Reduce the video data and display it at any position in the display area. (3) Display the wallpaper for the part (background) other than the reduced video data displayed in the reduced display of (2).

Note that "wallpaper" refers to displaying an image on the background of an object displayed on the display so as to fill the displayable area of the display, for example, and a relatively small image is repeatedly displayed in a tile shape. Often composed. Of course, the present invention is not limited to this, and only one image of a size corresponding to the displayable area can be displayed as a wallpaper, or a single color or a gradation can be displayed as a wallpaper. Further, the wallpaper does not necessarily have to fill the displayable area.

Here, the picture-in-picture of (1) will be described with reference to FIG. Picture-in-picture is a function of displaying other images in parallel by providing a small display area in the reproduced image screen while the image is being reproduced. At this time, the other image is often displayed so as to overlap the large displayed image. The large video screen is called the main screen, and the small area screen that is superimposed on the main screen is called the sub screen. In FIG. 7A, the child screen 251 is displayed in the parent screen 250. In addition, in FIG. 7, the white frame around the child screen 251 is for making the figure easier to see, and whether or not to actually display the frame and what kind of frame should be used when displaying the frame are determined. , Optional.

The child screen 251 is displayed so as to be placed on the parent screen 250, and the parent screen 250 is not visible in the area of the child screen 251. At this time, even if the child screen 251 is not subjected to the alpha blending process, there is no problem in terms of the picture-in-picture function. Further, in the picture-in-picture function, the display contents of the master screen 250 and the child screen 251 are required to be switched with each other as shown in FIGS. 7A and 7B, respectively. Further, it is more convenient for the user to be able to change the position and size of the child screen 251, which is more preferable.

First, the first embodiment of the present invention will be described. In the first embodiment of the present invention, the BD described with reference to FIG. 2 in order to realize the picture-in-picture of (1), the reduced image display of (2), and the wallpaper image display of (3) described above. -Add one more plane to the plane configuration in HD movie mode of ROM. Hereinafter, the plane to be added is referred to as a second video plane. The second video plane is located further back than the video plane. That is, in the first embodiment of this embodiment, the planes are arranged in the order of the second video plane, the video plane, the presentation graphics plane, and the interactive graphics plane from the back. A video plane and a second video plane are used to realize the display of the master screen 250 and the child screen 251.

FIG. 8 shows an example configuration for synthesizing a second video plane 50, a video plane 10, a presentation graphics plane 11, and an interactive graphics plane 12. In FIG. 8, the same reference numerals are given to the parts common to those in FIG. 4 described above, and detailed description thereof will be omitted.

As described above, since alpha composition is not required between the master screen 250 and the child screen 251, it suffices for the parent screen 250 and the child screen 251 to display any one of the pixels. Therefore, between the video plane 10 displaying the master screen 250 and the child screen 251 and the second video plane 50, it is sufficient that which plane is displayed can be switched on a pixel-by-pixel basis.

Therefore, as shown in FIG. 8, a switch 51 for switching the output of the video plane 10 and the second video plane 50 is provided. This switch 51 is controlled so that the input terminals 51A and 51B can be switched on a pixel-by-pixel basis. For example, the switching timing of the switch 51 is controlled by the timing signal of the graphic unit 303 in FIG. 1 described above. The timing signal can be controlled by the CPU 301. The CPU 301 can also be used for timing control. The output of switch 51 is supplied to the 422/444 conversion circuit 20.

When the picture-in-picture function is executed, the moving image data for displaying the child screen 251 is reduced in advance and then stored in the video plane 10 or the second video plane 50. When exchanging the contents of the main screen 250 and the contents of the child screen 251, the contents of the video plane 10 and the second video plane 50 are once cleared, and new video data is redrawn.

The resolution and the number of colors that can be displayed on the second video plane 50 should be the same as those on the video plane 10. Not limited to this, when the function of picture-in-picture is limited, for example, when the second video plane 50 is used only for the display of the child screen 251 the resolution of the second video plane 50 is the child screen. It suffices to meet the resolution of 251.

According to the first embodiment of the present invention, the wallpaper display can be realized by using the second video plane 50. FIG. 9 shows an example in which the display of the wallpaper image 200 is realized by using the second video plane 50. In the example of FIG. 9, the moving image 201 and the GUI parts 202A and 202B are displayed with the wallpaper image 200 as the background.

The wallpaper image 200 must satisfy at least the following three conditions. (1) It is displayed at the back of the display of each plane. (2) According to the size change of the moving image 201 displayed on the video plane 10, the background is completely filled and displayed. (3) It is displayed as the background of the GUI parts displayed on the interactive graphics plane 12.

By displaying the wallpaper image 200 using the second video plane 50, these three conditions can be satisfied.

As described with reference to FIG. 8, the presentation graphics plane 11 is composited with the video plane 10 or the second video plane 50, and the interactive graphics plane 12 is further composited with the composite image. Therefore, by setting a predetermined opacity for the presentation graphics plane 11 and the interactive graphics plane 12, it is possible to hide or make the display of the plane arranged behind the plane in FIG. 8 transparent. As a result, the wallpaper image 200 can be displayed on the background of the parts 202A and 202B displayed on the interactive graphics plane 12. In other words, the wallpaper image 200 can be displayed in the back with respect to the presentation graphics plane 11 and the interactive graphics plane 12.

Since the video plane 10 and the second video plane 50 are switched on a pixel-by-pixel basis by the switch 51, the display area of the video plane 10 and the display area of the second video plane 50 have an exclusive relationship. Therefore, it is possible to display the wallpaper image 200 on the second video plane 50 without a gap according to the change in the size of the moving image 201 displayed on the video plane 10. Further, this makes it possible to make the moving image 201 on the video plane 10 appear to be displayed with the wallpaper image 200 displayed on the second video plane 50 as the background. Therefore, the wallpaper image 200 on the second video plane 50 can be displayed at the back of the plane as a whole.

In the above description, the switch 50 is switched in pixel units, but this is not limited to one pixel unit, and the switch 50 may be switched in multiple pixel units such as 2 pixel units and 4 pixel units. ..

Next, a second embodiment of the present invention will be described. In the second embodiment of this embodiment, the display of a picture-in-picture or a background wallpaper image is realized without adding a new plane to the configuration of FIG. 4 described above.

First, a method of realizing the display of the wallpaper image will be described. In the second embodiment of this embodiment, the plane configuration is the video plane 10, the presentation graphics plane 11, and the interactive graphics plane 12 from the back, as in the case of the HD movie mode of the BD-ROM described with reference to FIG. The configuration for synthesizing each plane shall be the same as in FIG. 4.

This will be described with reference to FIG. In the example of FIG. 10, a plurality of button images on the interactive graphics plane 12, that is, parts 211A, 211B, 211C, and 211D used for the GUI are displayed against the background of the wallpaper image 210, and the moving image on the video plane 10 is displayed. Is displayed in the area 212, and for example, subtitle data on the presentation graphics plane 11 is displayed in the area 213. Further, the wallpaper image 210 is displayed in the parts other than the parts 211A, 211B, 211C and 211D, the area 212, and the area 213.

To achieve such a display, in the foreground interactive graphics plane 12, the opacity α2 of areas 212 and 213 is set to 0 so that the two planes behind the interactive graphics plane 12 are completely visible. In the regions other than the regions 212 and 213, the wallpaper image 210 is displayed and the parts 211A, 211B, 211C and 211D are displayed, respectively, with the opacity α2 being set to 1, for example. The wallpaper image 210 is drawn in the areas 212 and 213 and the areas excluding the parts 211A, 211B, 211C and 211D.

In the presentation graphics plane 11, the opacity α1 of the area 212 is set to 0 so that the video plane 10 behind the presentation graphics plane 11 is completely visible. For regions other than region 212, the opacity α1 is set to 1, for example. Not limited to this, in the presentation graphics plane 11, the opacity α1 of the area 213 where the subtitle data is displayed may be set to 1, and the opacity α1 of the other areas may be set to 0.

In the video plane 10, as shown in FIG. 11, the reduced image data 216 whose size of the moving image is reduced so as to fit in the area 212 is created, and the reduced image data 216 is displayed at the position of the area 212. Arrange as follows. By doing so, it is possible to realize the display of the wallpaper image 210 without adding a new plane to the configurations shown in FIGS. 2 and 4.

It should be noted that the algorithm and program for obtaining the area for drawing the wallpaper image 210 are often provided as a library of a programming language, and usually, the creator does not need to be particularly aware of it.

Further, in the second embodiment of this embodiment, as described above, when drawing the wallpaper image 210, it is necessary to obtain the areas 212 and 213 and the areas excluding the parts 211A, 211B, 211C and 211D. , When drawing the wallpaper image 210, a large amount of calculation processing is required. Therefore, especially when there are GUI parts that move or deform on the interactive graphics plane 12 with the passage of time, the operation speed may decrease due to the increase in the amount of calculation. When using such a GUI component, it is preferable to take this point into consideration.

Next, a method of realizing a picture-in-picture according to the second embodiment of this embodiment will be described. FIG. 12 schematically shows an example configuration for realizing a picture-in-picture using one video plane 10. As shown in FIG. 12, in the second embodiment of this embodiment, two frame buffers 221A and 221B are provided between the image output unit 220 and the video plane 10.

The output of the frame buffer 221A is supplied to the input end 223A of the switch 223 via the down converter 222A. The output of the frame buffer 221B is supplied to the input end 223B of the switch 223 via the down converter 222B. The switch 233 is designed so that the input terminals 223A and 223B can be switched on a pixel-by-pixel basis. The output of switch 223 is supplied to the video plane 10.

Note that the frame buffers 221A and 221B are not plain memory (for example, VRAM304) that holds image data that has a one-to-one correspondence with the image displayed on the display, but a part of the main memory of the CPU or the latter stage of the video decoder. It is a frame buffer provided in. In FIG. 1 described above, it corresponds to, for example, DRAM 302.

The image output unit 220 is capable of processing two different video streams (referred to as video stream A and video stream B), and the video stream A and the video stream B output from the image data output unit 220 are frames. It is supplied to buffers 221A and 221B, respectively. In the following, it is assumed that the video stream A is displayed as the main screen and the video stream B is displayed as the child screen 230 of the video stream A.

The image data read from the frame buffer 221B is supplied to the down converter 222B and its size is changed. The down converter 222B reduces the size of image data by, for example, performing pixel thinning processing or interpolation processing. The reduced image data reduced in size by the down converter 222B is supplied to the input terminal 223B of the switch 223.

On the other hand, the image data read from the frame buffer 221A passes through the down converter 222A and is supplied to the input terminal 223A of the switch 223. The down converter 222A also reduces the size of the input image data, like the down converter 222B.

In the switch 223, for example, with respect to the video plane 10, the image data is transferred in pixel units from the upper end of the display area to the lower end of the display area while scanning line by line from left to right. The input terminals 223A and 223B are switched by predetermined timing control. In the case of the example of FIG. 12, when writing the pixel at the position where the child screen 230 is to be displayed, the input end 223B is selected by the switch 223, so that a part of the video plane 10 is read from the frame buffer 221B. The output video data is drawn as a child screen 230.

An example of the switching timing of the switch 223 will be described with reference to FIG. In FIG. 13, the resolution of the screen (1 frame) is simplified to 20 pixels × 10 lines as shown in FIG. 13B in order to avoid congestion. Consider an example in which the child screen 230 is displayed at the position shown in FIG. 13A. FIG. 13C shows the switching timing of an example of the switch 223 at this time. In FIG. 13C, the buffer A side shows the frame buffer 221A, that is, the input end 223A side, and the buffer B side shows the frame buffer 221B, that is, the input end 223B side. In this way, in the line where the child screen 230 is not applied, the input end 223A side is selected, and in the line where the child screen 230 is applied, the input end 223A is selected at the timing of the pixels in the line where the child screen 230 is not applied, and the child screen is selected. The input end 223B side is selected at the timing of the pixel on which 230 is applied. By controlling the switching timing of the switch 223 in pixel units in this way, it is possible to display the master screen and the child screen 230 in parallel using one video plane 10.

The switching timing control of this switch can also be applied to the sub-screen display control by the video plane 10 and the second video plane 50 in the first embodiment of the present invention described above.

Further, although the shape of the child screen 230 is rectangular here, the shape of the child screen 230 can be any shape other than the rectangle according to the switching control of the switch 223 in pixel units as described above.

The process of exchanging the display contents of the child screen 230 and the display contents of the parent screen will be roughly described. In this case, the image data read from the frame buffer 221B passes through the down converter 222B and is supplied to the input terminal 223B of the switch 223. On the other hand, the image data read from the frame buffer 221A is reduced by the down converter 222A and supplied to the input terminal 223A of the switch 223. As an example is shown in FIG. 13D, when an instruction to replace the contents of the child screen 230 with the contents of the master screen is given at the timing T, the selection direction by the switch 223 is the input end 223A and the input end 223B at the timing T. Can be replaced with.

When the switching control of the switch 223 is performed as shown in FIG. 13D, the contents of the child screen 230 and the contents of the main screen are exchanged from the pixel corresponding to the timing T onward. The switching timing is not limited to this, for example, when there is an instruction to switch the child screen and the main screen at timing T, the end of the frame or the beginning of the next frame, or between the end of the frame and the beginning of the next frame. , You may wait for the selection timing of switch 223 to be replaced. In this case, the contents of the child screen 230 and the contents of the main screen are exchanged from the next frame in which the instruction to replace the child screen and the main screen is given.

In the above description, the content of the child screen 230 and the content of the parent screen are exchanged by the switching control of the switch 223, but this is not limited to this example. For example, one of the frame buffers 221A and 221B may be dedicated to the child screen 230, and the output destination from the image output unit 220 may be switched between the frame buffers 221A and 221B. In this case, it is not necessary to switch the selection timing of the switch 223 when switching between the master screen and the child screen.

Further, in the above description, the switching timing of the switch 223 is controlled in pixel units, but this is not limited to one pixel unit, but the switch 223 is switched in multiple pixel units such as two pixel units and four pixel units. May be good.

Further, in the above description, the image data is transferred from the frame buffers 221A and 221B to the video plane 10 by scanning line by line, but this is not limited to this example. For example, it is also possible to read image data from the frame buffers 221A and 221B in block units consisting of a predetermined area and transfer the image data to the video plane 10. In this case, the switching timing of the switch 223 is also controlled in block units.

As in the first embodiment of the present invention, increasing the number of planes requires a dedicated plane memory (such as VRAM304) and hardware to access the plane memory. Therefore, it can be said that the method of increasing the plane is suitable for a system in which the processing speed of the CPU is not high, but the limitation is loose in terms of hardware expandability. For example, a BD-ROM playback-only machine corresponds to this.

On the other hand, in the case of a system that has a very high CPU processing speed and is equipped with an LSI (Large-Scale Integration) that exclusively draws high-speed graphics, the hardware (especially the hardware related to graphics drawing) Hardware) tends to be customized, and it is difficult to expand the hardware. For such a system, rather than increasing the planes, as in the second embodiment of the present invention, after calculating the position, size, and compositing order of each part used in the GUI, all in one plane. It can be said that the method of drawing in is suitable. For example, this corresponds to the case where a BD-ROM is played on a general-purpose computer device or the like.

Next, the player decoder 100 applicable to the first embodiment and the second embodiment described above will be described. FIG. 14 is a functional block diagram showing a configuration of an example of a player decoder 100 applicable to the first embodiment of the present invention. The player decoder 100 can be applied to the second embodiment of the present invention with substantially the same configuration. The configuration when the player decoder 100 is applied to the second embodiment will be described as appropriate.

This player decoder 100 interprets data played from a disc loaded in a drive device (not shown), outputs an AV (Audio / Video) stream, and enables the user to interactively operate the output AV stream. To do.

The overall operation of the player decoder 100 is controlled by a CPU (not shown). For example, the stream and data flow in each part of the player decoder 100 are monitored and controlled by the CPU.

When a disc is loaded into a drive device (not shown), in the HD movie mode of BD-ROM, first, the file (for example, the file name is "scenario.hdmv") that specifies the playback order of the playlist, the menu, and so on. A file that points to the first playlist in the list of playlists that make up the title (for example, the file name is "entrylist.data") is played, and based on the description of this file "scenario.hdmv" and the file "entrylist.data". , Other necessary files are read and the content recorded on the disc is played.

For example, based on the description of the file "scenario.hdmv" and the file "entrylist.data", the video data to be displayed on the video plane 10 or the second video plane 50, the presentation graphics plane 11, the interactive graphics plane 12, the second video Image data, playlist files, etc. for display on the plane 50 are read from the disc. In the full profile, the file containing the program is read and executed.

In the following, among these data read from the disc, streams such as moving image data, sub-pictures (subtitle data), and audio data that need to be continuously processed are referred to as real-time streams. In addition, non-real-time data such as scenario files, playlist files, script files and program files, and some moving images, still images and sound data that do not require continuous processing are referred to as store objects. Store objects are stored and expanded in memory and processed as needed.

The player decoder 100 has two input channels (1) and (2), and a store object is input to the input terminal 101 of the input channel (1). A real-time stream is input to the input end 202 of the input channel (2). It is also possible to input a store object at the input end 202. In the first and second embodiments of this embodiment, the real-time stream and some store objects input to the input end 202 are, for example, MPEG2 TS (Moving Pictures Experts Group 2 Transport Stream).

The real-time stream input to the input terminal 202 is not limited to MPEG2 TS. If it is transmitted in packet units and video data, audio data, still image data, etc. can be multiplexed, a stream in another format may be input. At this time, the PID filter 110 described later is used as a demultiplexer suitable for the stream format to separate video data, audio data, still image data, and the like.

Further, for example, in the drive device, the rotation speed of the disk is set to a high speed such as double speed, the read transfer rate from the disk is increased, and the operation is performed in a time division manner. System reading is feasible.

First, the system of the input channel (1) will be described. The store object input to the input terminal 101 is input to the switch circuit 102. When a program code such as an ECMA (European Computer Manufacturers Association) script, HTML (Hyper Text Markup Language) file (or XHTML file), or Java file is input as a store object, the output terminal 102A is selected in the switch circuit 102 and input. The program code is stored in the code buffer 104.

On the other hand, when image data is input as a store object, the output terminal 102B is selected in the switch circuit 102, and the input image data is input to the switch circuit 103. If the real-time stream input to input terminal 202 does not contain image data for display on presentation graphics plane 11 or interactive graphics plane 12, switch circuit 103 selects input terminal 103A and switch circuit 102. The image data input from is stored in the content buffer 105.

Similarly, if the real-time stream input to the input terminal 202 contains image data to be displayed on the presentation graphics plane 11 or the interactive graphics plane 12, the input terminal 103B is selected in the switch circuit 103. , The image data is stored in the content buffer 105. The store objects stored in the code buffer 104 and the content buffer 105 are read out as needed and supplied to the multimedia engine 106.

The image data of the store objects stored in the content buffer 105 is also supplied to the graphics decoder A116 and the graphics decoder B117 via the switch circuits 107 and 108, respectively.

The multimedia engine 106 includes an XML parser 106A, a program / script interpreter 106B and a graphics renderer 106C. The multimedia engine 106 also has a sound player 106D, which enables handling of audio data. The multimedia engine 106 may be configured by independent hardware, or may be realized by processing of a CPU (not shown above) based on a predetermined program.

The XML parser 106A has a function to analyze XML (Extensible Markup Language) documents, and can also analyze HTML documents and XHTML documents. HTML documents and XHTML documents interpreted by the XML parser 106A are converted into a format that can be executed by the player decoder 100. The program / script interpreter 106B analyzes Java (registered trademark) programs, ECMA scripts, etc., and converts them into a format that can be executed by this player decoder 100. The graphics renderer 106C also decodes the image data into a format that can be expanded into the subtitle plane 11 and the graphics plane 12.

In the multimedia engine 106, the buffer 109 is used as a work memory to process the XML parser 106A, the program / script interpreter 106B, and the graphics renderer 106C. For example, the XML parser 106A and the program / script interpreter 106B use the code buffer 109A of the buffer 109. Further, the graphics renderer 106C uses the graphics buffer 109D among the buffers 109. In addition to the above-mentioned code buffer 109A and graphics buffer 109D, the buffer 109 has a hierarchical tree structure obtained by analyzing HTML documents with the font buffer 109B and the XML parser 106A that store font data used for displaying character strings. It includes a tree buffer 109C for holding in, a sound buffer 109E for storing audio data used in the sound player 106D, and the like.

In the multimedia engine 106, for example, the ECMA script stored in the code buffer 104 is read, and based on the description of the read ECMA script, other ECMA scripts or HTML documents (or HTML documents) (or HTML documents) from the code buffer 104 are used as needed. Reads XHTML document), reads image data from the content buffer 105, and so on. The data stored in the code buffer 104 and the content buffer 105 can be held in the code buffer 104 and the content buffer 105 until the data is no longer needed. Therefore, the data stored in the code buffer 104 and the content buffer 105 can be read and used as many times as necessary.

In addition to the above, the multimedia engine 106 performs demultiplexing processing of a plurality of types of input data, a Java VM (Java virtual machine) function, and the like. Further, the multimedia engine 106 receives the input from the user by the remote control commander, the pointing device, or the like, and processes it in a predetermined manner. The user input is also supplied to the graphics decoder A116, the graphics decoder B117, the audio decoder 118, the MPEG video decoder 120, and the system decoder 121, which will be described later.

The image data processed by the graphics renderer 106C is supplied to the graphics plane A132 and the graphics plane B133 via the switch circuits 130 and 131, respectively. In this example, the image data supplied to the graphics plane A132 and the graphics plane B133 includes PNG format, run length format, JPEG format, etc., but is not particularly specified. The timing at which image data is supplied to each of these planes 132 and 133 is controlled by the multimedia engine 106.

Here, the graphics plane A132 and the graphics plane B133 correspond to the presentation graphics plane 11 and the interactive graphics plane 12 described above, respectively. The video plane 134 corresponds to the video plane 10 described above. The second video plane 160 corresponds to the second video plane 50 described above. The graphics plane A132, the graphics plane B133, the video plane 134, and the second video plane 160 are, for example, frame memories, and the VRAM 304 described with reference to FIG. 1 can be used.

The multimedia engine 106 further supplies a control signal for instructing the presentation processor 155, which will be described later, to switch between the video plane 134, the second video plane 160, the graphics plane A132 and the graphics plane B133, alpha synthesis, and the like. Similarly, the multimedia engine 106 supplies a control signal for controlling the audio stream output to the presentation processor 157, which will be described later.

Next, the system of the input channel (2) will be described. The real-time stream input by MPEG2 TS to the input terminal 202 is supplied to the PID filter 110, the PID (Packet Identification) stored in the MPEG2 TS transport packet is extracted, and the stream stored in the transport packet is extracted. The attribute is detected. In the PID filter 110, the input real-time stream is distributed to the corresponding system for each transport packet based on this stream attribute.

If the transport packet is a packet that stores image data belonging to the store object based on the PID, the transport packet is temporarily stored in the buffer TBn111A, read out at a predetermined timing, and input end. 103B is input to the selected switch circuit 103 and stored in the content buffer 105 via the switch circuit 103.

In the PID filter 110, if the transport packet is a packet in which subtitle data is stored based on the PID, the transport packet is temporarily stored in the buffer TBn111B and the buffer Bn112B and read at a predetermined timing. The input terminal 107B is input to the selected switch circuit 107, and is supplied to the graphics decoder A116 via the switch circuit 107.

The graphics decoder A116 removes the header information of the supplied transport packet, and decodes the subtitle data stored in the transport packet to use it as image data for displaying the subtitles and the like. This image data is input to the input terminal 130B of the switch circuit 130 at a predetermined timing, and is developed on the graphics plane A132 via the switch circuit 130. It can also be deployed on the graphics plane B133 via the switch circuit 131.

In the PID filter 110, if the transport packet is a packet in which graphics data is stored based on the PID, the transport packet is temporarily stored in the buffer TBn111C and the buffer Bn112C and read out at a predetermined timing. The input terminal 108B is input to the selected switch circuit 108, and is supplied to the graphics decoder B117 via the switch circuit 108.

The graphics decoder B117 removes the header information of the supplied transport packet, and decodes the graphics data stored in the transport packet to obtain the graphics data. This image data is input to the input terminal 131B of the switch circuit 131 at a predetermined timing, and is developed on the graphics plane B133 via the switch circuit 131. It can also be deployed on the graphics plane A132 via the switch circuit 130.

There is no functional difference between the graphics decoder A116 and the graphics decoder B117. In other words, it means that there are two graphics decoders that operate independently on the model. That is, it is assumed that the subtitle data and the graphics data can be decoded independently. In the implementation, there is also a method of using one high-speed graphics decoder in time division and assuming that there are virtually two graphics decoders.

In the PID filter 110, if the transport packet is a packet in which audio data is stored based on the PID, the transport packet is temporarily stored in the buffer TBn111D and the buffer Bn112D and read at a predetermined timing. It is supplied to the audio decoder 118. The audio data stored in this transport packet is, for example, compressed and coded by a method compliant with MPEG.

The audio decoder 118 also includes, for example, a linear PCM (Pulse Code Modulation) audio decoder 119. The audio decoder 118 removes the header information of the input transport stream and decodes the compressed encoded audio data stored in the transport packet into linear PCM audio data.

The linear PCM audio data output from the audio decoder 118 is input to the presentation processor 157 for audio, and a predetermined acoustic effect or the like is added under the control of the multimedia engine 106, and the data is derived to the output terminal 158.

In the PID filter 110, if the transport packet is a packet in which moving image data is stored based on the PID, the transport packet is temporarily stored in the buffer TBn111E, the buffer MBn113, and the buffer EBn114, and is temporarily stored at a predetermined timing. It is read by and supplied to the MPEG video decoder 120. The moving image data stored in this transport packet is compressed and coded by the MPEG2 method.

The MPEG video decoder 120 removes the header information of the supplied transport packet, and decodes the moving image data compressed and encoded by the MPEG2 method stored in the transport packet into the moving image data of the base band.

The moving image data output from the MPEG decoder 120 is input to the input terminal 124A of the switch circuit 124. In the switch circuit 124, the moving image data from the MPEG video decoder 120 and the moving image data output from the multimedia engine 106 are selected. The moving image data selected at a predetermined timing is input to the switch 123. The video plane to be expanded is selected by the switch 123, and the video data is expanded to the video plane 134 or the second video plane 160.

In the first and second embodiments of the present invention, the picture-in-picture function can be realized. In order to implement the picture-in-picture function, it is necessary to supply two moving image data. For example, an MPEG2 TS containing two moving image data is supplied from the input terminal 202, and is supplied to the MPEG video decoder 120 via the PID filter 110, the buffer TBn111E, the buffer MBn113, and the buffer EBn114. The MPEG video decoder 120 decodes two video data and outputs each of them.

The two video data output from the MPEG video decoder 120 may be supplied directly to the switch 124, or as shown by the dotted blocks in FIG. 14, the MPEG video decoder 120 and the switch 124 A frame buffer 400 having a capacity capable of storing at least two frames of moving image data may be provided in between, and the two moving image data output from the MPEG video decoder 120 may be temporarily stored in the frame buffer 400. By providing the frame buffer 400, the two moving image data can be output independently for each frame, for example, and the load on the switch 123 can be reduced.

The supply of two video data is not limited to this example. For example, one video data is supplied from the input terminal 202 as a real-time stream, and the other video data is supplied from the input terminal 101 as a store object. You may do so. Further, the two types of images used in the picture-in-picture do not have to be both moving image data, and one of them may be still image data. It is conceivable that both of them are still image data.

In the player decoder 100 to which the first embodiment of the present invention is applied, when the moving image data of either the video plane 134 or the second video plane 160 is used as a child screen by the picture-in-picture function, it is used as a child screen. The moving image data to be used may be reduced in advance and expanded on the corresponding video plane 134 or the second video plane 160. The reduction image can be created by adding the function to the MPEG video decoder 120. Of course, a reduced image creating unit for creating a reduced image may be separately provided between the MPEG video decoder 120 and the video plane 134 and the second video plane 160.

Further, when the player decoder 100 is applied to the second embodiment of the present invention, the second video plane 160 and the switch circuit 123 are omitted, and between the MPEG video decoder 120 and the switch circuit 124, for example. A frame buffer 400 is provided, as shown by the dotted block in FIG. The frame buffer 400 has a capacity capable of storing at least two frames of moving image data.

Explaining the processing of an example in the second embodiment of the present invention with reference to FIG. 12 described above, frame buffers 221A and 221B are formed in different regions in the frame buffer 400, respectively (here, respectively). Frame memory area 221A, frame memory area 221B). Of course, frame buffers 400A and 400B (not shown) corresponding to the frame buffers 221A and 221B may be provided.

On the other hand, the two moving image data output from the MPEG video decoder 120 are supplied to the frame buffer 400 and stored in the frame memory areas 221A and 221B formed in the frame buffer 400, respectively.

Assuming that the moving image data stored in the frame memory area 221B is used as a child screen, the moving image data stored in the frame memory area 221B is reduced by the down converter 222B (not shown). This reduction processing can be performed, for example, by thinning out the pixels in a predetermined manner when reading the moving image data from the frame memory area 221B. Then, with respect to the frame buffer 400, the reading control of the moving image data stored in the frame memory areas 221A and 221B is performed in pixel units based on the switching control performed by the switch 223 described above, and the data is read from the frame buffer 400. The video data is supplied to the video plane 134. By doing so, in the player decoder 100, the picture-in-picture function using one video plane 134 according to the second embodiment is realized.

In the PID filter 110, if the transport packet is a packet in which system information is stored based on the PID, the transport packet is supplied to the system decoder 121 via buffers TBn111F and Bsys115. The system decoder 121 removes the head information of the supplied transport packet and retrieves the stored system information. System information is passed to, for example, a CPU (not shown).

The image data on the graphics plane A132 is supplied to the palette 150 corresponding to the above-mentioned palette 22, the palette consisting of 256 colors is referenced by an index, RGB data is output, and the opacity data α1 is omitted. Is issued. The RGB data is converted into YCbCr data by the RGB / YCbCr conversion circuit 151 corresponding to the RGB / YCbCr conversion circuit 29 described above, and the YCbCr data and the opacity data α1 are supplied to the presentation processor 155.

The image data on the graphics plane B133 is supplied to the palette 152 corresponding to the above-mentioned palette 26, the palette consisting of 256 colors is referenced by an index, RGB data is output, and the opacity data α2 is omitted. It will be issued. The RGB data is converted into YCbCr data by the RGB / YCbCr conversion circuit 153 corresponding to the RGB / YCbCr conversion circuit 27 described above, and the YCbCr data and the opacity data α2 are supplied to the presentation processor 155.

The output of the video plane 134 is supplied to the presentation processor 155 via the up / down converter 154. Similarly, the output of the second video plane 160 is supplied to the presentation processor 155 via the up / down converter 161.

The up / down converter 154 is a circuit for converting the resolution of an image, for example, converting a high-resolution HD (High Definition) image to an SD (Standard Definition) image having a normal resolution.

The presentation processor 155 uses the opacity α1 based on the image data of the presentation graphics plane 11 (graphics plane A132) and the opacity α2 based on the interactive graphics plane 12 (graphics plane B133) described with reference to FIG. 4 or 8. Performs the alpha blending process that was used. Further, when the player decoder 100 is applied to the first embodiment of the present invention, when the picture-in-picture function or the wallpaper display function is used, the output of the video plane 10 and the second video plane 50 is used. The pixel-by-pixel switching process is also performed by the presentation processor 155.

That is, in the presentation processor 155, the image data of the video plane 134 and the second video plane 160 are switched by the switch 51 (not shown) to form one image data, and the image data is converted into the image data of the graphics plane A132. The image data of the graphics plane A132 is combined based on the set opacity α1. Further, the image data of the graphics plane B133 is combined with the image data obtained by combining the video plane and the graphics plane A132 based on the opacity α2 set in the image data of the graphics plane B133. The image data of the graphics plane B133, the image data (subtitle data) of the graphics plane A132, and the image data obtained by combining the image data of the video plane 134 and the second video plane 160 are derived to the output terminal 156.

The presentation processor 155 can also perform effect processing on image data in real time.

In the above description, each part of the player decoder 100 is described as being composed of hardware, but this is not limited to this example. For example, the player decoder 100 can be realized as a process on software. In this case, the player decoder 100 can be operated on the computer device. Further, the player decoder 100 can be realized in a configuration in which hardware and software are mixed. For example, it is conceivable that the audio decoder 118 and the MPEG video decoder 120 are configured by hardware, and the others are configured by software.

A program for configuring the player decoder 100 with software only or a mixture of hardware and software and executing it on a computer device is provided by being recorded on a recording medium such as a CD-ROM (Compact Disc-Read Only Memory). To. By loading this CD-ROM into the CD-ROM drive of the computer device and installing the program recorded on the CD-ROM in the computer device in advance, the above processing can be executed on the computer device. Can be done. Since the configuration of the computer device is extremely well known, the description thereof will be omitted.

<figref num="1">It is a block diagram schematically showing a typical configuration example for displaying image data.</figref><figref num="2">It is a schematic diagram which shows the structure of an example of a video plane, a presentation graphics plane, and an interactive graphics plane.</figref><figref num="3">It is a figure for demonstrating the resolution and the displayable color of each plane.</figref><figref num="4">It is a functional block diagram which shows the structure of an example which synthesizes three planes.</figref><figref num="5">It is a schematic diagram which shows an example of the input / output data of a pallet.</figref><figref num="6">It is a schematic diagram which shows an example pallet table stored in a pallet.</figref><figref num="7">It is a figure for demonstrating the picture-in-picture.</figref><figref num="8">It is a functional block diagram which shows the structure of an example for synthesizing the 2nd video plane, the video plane, the presentation graphics plane and the interactive graphics plane.</figref><figref num="9">It is a schematic diagram which shows the example which realized the display of the wallpaper image using the 2nd video plane.</figref><figref num="10">It is a figure for demonstrating the realization method of the display of the wallpaper image by the 2nd Embodiment of this invention.</figref><figref num="11">It is a figure for demonstrating the realization method of the display of the wallpaper image by the 2nd Embodiment of this invention.</figref><figref num="12">It is a functional block diagram which shows schematic structure of an example for realizing a picture-in-picture using one video plane.</figref><figref num="13">It is a figure for demonstrating the switching timing of a switch.</figref><figref num="14">It is a functional block diagram which shows the structure of an example of a player decoder applicable to 1st Embodiment of this invention.</figref>

Code description

10 Video Plane 11 Presentation Graphics Plane 12 Interactive Graphics Plane 21,23,25,28 Multiplier 24,29 Adder 50 Second Video Plane 51 Switch 100 Player Decoder 106 Multimedia Engine 116 Graphics Decoder A117 Graphics Decoder B120 MPEG Video Decoder 132 Graphics plane A133 Graphics plane B134 Video plane 160 Second video plane 200 Wallpaper image 201 Video 202A, 202B Parts 210 Wallpaper image 211A, 211B, 211C, 211D Parts 220 Image output section 221A, 221B Frame buffer 222A, 222B Down converter 223 Switch 230 Child screen 301 CPU302 DRAM303 Graphics section 304 VRAM