Combining 3d image and graphical data

The invention relates to a method of combining three-dimensional [3D] image data and auxiliary graphic data. values ​​depth render depth to depth 3D depth 3D depth 3D depth 3D depth 3D depth 3D depth 3D depth 3D depth.

[0002] The invention further relates to a 3D source device, and a 3D display device and a computer program product.

Invention The invention The 3D The 3D The 3D The 3D image data, as such video aux aux with aux with aux with. 3D image data, as display display aux display aux aux aux aux aux.

BACKGROUND OF THE INVENTION [0004] Apparatus for acquiring 2D video data is known, for example, video players such as DVD players or decoders that provide digital video signals. The source device is designed to be coupled to a display device, such as television or monitor. The image is connected to the source device via a suitable interface, preferably a high-speed digital interface such as HDMI. Improved 3D devices are now being proposed for acquiring 3D image data (3D). Similarly, devices for displaying 3D image data are proposed.

[0005] For 3D content such as 3D, printed text, logo subtitles, game results, logos, game results.

[0006] WO2008 / 11522 examples a system for combining text with a three-dimensional content. The layout introduces text at the same level as the highest depth in 3D content. One of the examples of 3D content is a two-dimensional image. In this case, the depth of the inserted depth. Another example of 3D content is a lot of two-dimensional images. In this case, the value of the depth of the inserted map. Another example of 3D content is the image of the left eye. In this case, the text in the stereoscopic image. Yet another example of 3D content is the right eye. This In case stere stere stere stere stere stere stere stere stere. This In case stere stere stere. This In stere stere stere stere. As a result, the layout does not work with 3D content, does not lead to spectator fatigue. the text in the picture is the most important thing in stereoscopic images. As a result, the layout creates text combined with 3D content, the text does not block the effect in specters fatigue. the text in the picture is the most important thing in stereoscopic images. As a result, the layout does not work with 3D content, does not lead to spectator fatigue.

SUMMARY OF THE INVENTION [0007] WO2008 / 115222. The problem is that it's very close to the viewer. We have found that in practice, viewers do not value the closeness of subtitles. In some current 3D displays, the image is displayed in front of the viewer. For any stereo display, close objects cause greater eye strain.

[0008] WO2008 / 044191 describing the creation of a graphic image. The document focuses on generating graphic objects, eg 3D subtitles. Graphic objects can be cropped and placed on a graphic plane that is superimposed on the associated video image.

[0009] WO2008 / 038205 examples of the creation of a 3D display menu in a layout that imparts 3D graphics data on a 3D video image. 3D graphic elements, eg, 3D subtitles, are applied in the depth direction. Graphic elements are positioned on the graphic plane, which has a different image.

[0010] US2007 / 0022435 disclosure of a digital broadcasting receiver. In the digital transceiver, the image is not intended to be superimpose. Therefore, the image processor determines, and if so, it scales the digital transmission data and displays the data on the other side of the screen.

[0011] WO2006 / 136989 languages ​​an image display device. In the receiver, the video data plane and the overlay plane are connected by shifting the planes so that they do not overlap. The offset value is determined manually or automatically.

The object of the invention is to provide a system for combining auxiliary graphic data.

For this purpose, according to the first aspect of the invention, and the method of combining the three-dimensional image.

[0014] A 3D source device for combining three-dimensional image.

[0015] A 3D display device for combining three-dimensional image data.

[0016] An information medium, including three-dimensional image data.

[0017] It should be noted that there is a three-dimensional image of the black bar. Accordingly, said scaling and / or offset information. Conservation, the scaling and / or offsets.

According According to According im 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D According 3D According 3D According 3D According 3D According 3D According 3D According 3D According. set depth values.

According to the first paragraph, it provides a 3D image processing for the first time, imaging data and setting aux display display display 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D iliary aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux aux auxon on on on on on on on on on depending. on the depth pattern.

View of a 3D rendering device for the detecting, the 3D display of the image, as a 3D image. Dependent figures in the 3D rendering of an image of the surrounding area data and secondary graphic data based on the image of interest, which is arranged to determine the depth of the data,and so on the auxiliary depth of the heart. Options on the depth pattern.

[0021] The viewer will be the viewer of the viewer. Detecting depths in the left / right 3D image or depth from the depth of data format like Left + Right + Stream depth. The depth pattern is determined for the detected area of ​​interest. The system speaks to the depth of the system, as is the depth of the system. In the display auxiliary graphical data area, that 3D image data does not occupy an auxiliary graphical data, ie, do not contain any data. It should be noted that in other areas of 3D images, further to have the position, ie, closer to the user. Preferably, the viewer will not experience the change of interest. so objects may have an extended position, ie closer to the user. Preferably, the viewer will not be disturbed in the view of the alternatives. so objects may have an extended position, ie closer to the user. Preferably, the viewer will not experience the change of interest.

[0022] The invention is also based on the subsequent diagnosis. The prior art document in the position of the image. The inventors have not been put in a dry position. The fatigue and is perceived as unpleasant. The current layout provides a backcourt, but is appreciated by viewers. Usually, the secondary graphic information is in the front of the screen. In general, image quality and sharpness are an optimum on the surface of the screen.

[0023] In an embodiment of the region, the detection of the object of interest. The object of interest is the spectator's attention. The effect is the depth of the image. Preferably, the viewer does not have to change the visual acuity. Optionally, the mentioned image of at least one of:

- detection of image elements that are in the center of attention;

- detecting, for image elements, the amount of additional data;

- detecting, for image elements, depth, luminance and color in relation to the background;

- detecting predetermined image elements such as human faces;

- detecting, for image elements, position at least one of the display area.

In an embodiment of the region, for the purpose of selecting the region. The effect of the region is in the region of the region. It should be noted that in the other area of ​​the display, the object may have a longer position than the secondary graphic data. , Location are Preferably, surface location are Preferably are Preferably are Preferably are are are are.

[0025] In particular, in a further embodiment of the system, the selection of the target area comprises the spatial filtering function. on the target region. The effect is that it needs to be separated from the target area.

[0026] In particular, in a different embodiment of the region, the greater the depth of the system; selecting a period in time for displaying auxiliary data, so that in the target region, there are no more than the auxiliary depth values; selecting, as the target region, and the view area in which the image is displayed. The effect is on the real image.

[0027] In an embodiment of the system, determining the depth and depth of the filtering system. The effect is that time filtering smoothes the depth differences of movable elements or (not) appearing in 3D image data. Prefer, the auxiliary depth is adjusted in time in a controlled manner. Optionally, said specific depth of the pattern.

[0028] Further preferred embodiments of the method, the 3D device and the signal.

[0029] A further object of the present invention is a method for combining three-dimensional [3D] image data and auxiliary graphic data, the method of obtaining scilling information and / or a shift of information for use with three-dimensional [3D] image data, scaling and / or shifting three-dimensional [3D] image data for the scaling and / or offset information, efficiently combining scaled and / or shifted three-dimensional [3D] part of the auxiliary graphic is a 3D data image that is not occupied by scaled and / or shifted three-dimensional [3D] image data device according to claim 10,a 3D display device according to claim 12 and a digital information carrier.

BRIEF DESCRIPTION OF THE DRAWINGS These and other aspects of the invention are described in the table below.

Fig. 1 shows a system for displaying three-dimensional (3D) image data,

Fig. 2 shows an example of 3D image data,

Fig. 3 shows auxiliary graphic data placed in the sub-depth,

Fig. 4 shows auxiliary graphical data in the target region

Fig. 5 shows the division of the display area,

Fig. 6 shows an example of scaled imaging data,

Fig. 7 shows an example of scaled imaging data within black limits,

Fig. 8 shows the caption of subtitles and graphics on the video,

Fig. 9 shows video scaling to create a field for inscriptions and floating windows, and

Fig. 10 shows combined scaling and video shifting to accommodate subtitles.

[0031] In the Figures, the elements have the same reference numbers.

DETAILED DESCRIPTION OF EMBODIMENTS [0032] Figure 1 shows a system for displaying three-dimensional (3D) image data, such as video, graphics, or other visual information. The source device 3D is coupled to a 3D display device 13 for transmitting a 3D display signal 56. The source 3D device has an input unit 51 for receiving image information. For example, the input unit device may include an optical disk unit 54, such as a DVD or BluRay. Alternatively, the input unit has to be a network 55, eg a network or transmission network, a device called a decoder.

[0033] The 3D source device comprises an image unit 52 for a display unit. The processing unit 52 for display on the display device. . Elements for user control,

[0034] The source device has an image processing unit for the 3D image. Auxiliary graphic data can be combined with the 3D image, dry as subtitles, sender logos, menus or message layout, error codes, flashing messages, stock symbols, etc. In the following text, the subtitles will be used for an image. The 3D image processing facilities 11.52 are arranged for the following functions. First, the limit values ​​found in 3D image data are detected. On the basis of the depth values. The 3D display signal 56 is an image of the 3D display. Then, 3D image data and auxiliary graphic data are based on the auxiliary depth values. 3D image processing means are arranged to detect depth values ​​as follows. The area of ​​interest in the view of the future. What is the viewer's part of the view? Concentrated. 3D image processing means are arranged to detect depth values ​​as follows. The area of ​​interest in the view of the future. What is the viewer's part of the view? Concentrated. 3D image processing means are arranged to detect depth values ​​as follows. The area of ​​interest in the view of the future. What is the viewer's part of the view? Concentrated.

[0035] Next, to the region of interest, i. For example, the maximum and minimum values ​​can be an average. Also the depth of the pattern can be determined. Further details will be explained below. Based on the depth of the area, the value of the above-mentioned the secondary display area. For further examples of spatial and temporal filtering of data.

[0036] The 3D display device 13 is for displaying 3D graphic data. The device has an input device unit for the display device 56 for a display device . , color or depth. The image is based on a 3D image data. The image is displayed in 3D image data. The device has a 3D display 17 receiving display control signals for displaying processed image data, eg a dual or a lenticular LCD. The display device 13 can be any type of stereoscopic display,

[0037] Alternatively, processing for positioning. The image of the image of the device, 1986. display. 3D image processing media, 19, 18 are in the 3D image processing media 11.52 in the source device. In a further embodiment, the source device and the display device.

[0038] Figure 1 further shows a recording medium. The recording medium has a disk shape and has a central hole. The path is a series of different paths in the information layer. The recording medium can be optically readable, it is called CD, DVD or BD (Blue-ray Disc). The information is represented in the information layer by optically detectable markers along the path, eg, grooves and fields. The path structure also includes position information, eg, headers and addresses. The recording medium 54 carries the history of digitally coded image data,

[0039] The following provides an overview of three-dimensional displays and human perception of depth. 3D displays differ from 2D displays in the sense that they provide a more expressive depth perception. This is why the 2D displays can only display one-dimensional depth of hints and traffic-based hints.

[0040] Monocular (or static) depth guidance may be taken from a static image using one eye. Painters often use unilateral hints to create a sense of depth in their paintings. These tips include relative size, perspective, gradient texture and lighting / shading. The monocular hints of the viewers' eyes. The eyes have muscles to rotate them, as well as to stretch the lens of the eye. The stretching and loosening of the eye lens is called lodging and takes place while focusing on the image. The amount of stretching or loosening of the lens is an indication of how much the object is. Eye rotationso that both eyes focus on the same object, which is called convergence. finally,

[0041] A binaural discrepancy is a hint of the different eyes. One-dimensional depth tips can be used in any type of 2D visual display. To reproduce the binocular discrepancy, the display requires the display. Displays that can reproduce binocular divergence are special displays that we will call 3D or stereoscopic displays. 3D displays are capable of displaying images. Hence, 3D displays provide a different image for the left and right eyes.

[0042] 3D displays that have been used for a long time. Most of them are based on the left and right eyes. Now, with the development of display technology. These performs are called autostereoscopic displays.

[0043] The first approach is based on LCD displays that allow the user to view stereo video without glasses. They are based on one techniques, and lenticular screen and barrier displays. In the case of lenticular displays, the LCD is covered with a sheet of lenticular lenses. These lenses diffract light from the display. This allows you to display two different images, one for the left - and one for the right eye.

[0044] An alternative to the lenticular screen is LCD and LCD backlight. The barrier of the eye, the view of the eye. The barrier is also present and the human viewer, so that the human eye viewer is alternating between the left and right eye. The problem with barrier shows the very narrow viewing angle. This is a lenticular screen that has 9 views and many viewports, for example.

[0045] A still high glass reflex (EG, 120 Hz). A high view of the room. The viewer in glasses sees stereo video at 60 Hz. The use of snapshots allows you to achieve high quality video and a high level of depth.

[0046] Autostereoscopic displays and a method of using glasses with associated accommodation mismatch convergence. The view of using these devices. There are other types of displays, such as holographic displays - and volumetric displays, where this problem does not exist. It should be noted that the presentation has a depth range.

[0047] Imaging data for 3D displays are available as electronic, usually digital data. The present invention refers to the digital field. Imaging data after moving from the source may already contain 3D information, eg, using a dual camera, or the intended preprocessing system may be involved to (re) create 3D information from 2D imaging. Image data can be static like slides, or can contain moving video like movies. Image image image generated usually generated usually graph, be generated usually generated graph graph. For example, user control information such as menus, navigation items, annotations can be added to other image data.

[0048] There are many different types of images, known as a 3D image format. Some channels are based on the use of 2D channel also to transfer stereo information. For example, left and right views can be interlaced or placed side by side, and above and below. These methods sacrifice over the transfer of stereo information. Another option is to sacrifice the color, the approach is called the anaglyph stereo. Anaglyphic stereo uses spectral multiplexing, which is based on displaying two separate images. Using eyeglasses with colored filters, see the color of the eye. For example, the right eye, only the green eye.

[0049] Another 3D format is based on a 2D image and an additional depth of the 2D image. The format called image + depth differs in a so-called "depth" map or discrepancy. This is a grayscale image for a pixel in the depth of the image. 2D image. The display device uses a discrepancy, the depth or parallax map to compute additional views based on a 2D input image. This can be done in a different way, in the simplest form.<a href="http://iphome.hhi.de/fehn/Publications/fehn_EI2004.pdf">http://iphome.hhi.de/fehn/Publications/fehn_EI2004.pdf</a>).

[0050] Figure 2 shows an example of 3D image data. The left part of the image is a 2D image, the usual image. The depth of the image can be added to a 2D image. On the depth of the map, the gray scale. White indicates near viewer. The 3D display can calculate the required images for the pixel transformations. Occlusion can be solved using techniques for estimating or filling holes.

[0051] Stereo in addition to video playback. Blu-ray player, to a stereo display. In 2D, only a 2D video stream is sent (decoded image data). In the case of stereo video, the second stream containing the second image (for stereo) or the depth of the map must be sent so. This can double the required bit rate in the electrical interface. Another approach is to sacrifice resolution and format of a 2D image.

[0052] Figure 2 shows an example of 2D data and a depth map. The depth display parameters to be interpreted by the display. Examples of additional video information are described in ISO 23002-3 "Representation of auxiliary video and supplemental information" (eg, see ISO / IEC JTC1 / SC29 / WG11 N8259 July 2007). Depending on the type of auxiliary stream, 4 or two parameters. The 3D video transmission format.

[0053] In an embodiment, said detecting of the region of interest. Then the depth of the object. Should It can It can It problems It problems It It It It It It It. When the subject is at the bottom of the screen, the autostereoscopic display shows the highest resolution. The resolution will be displayed on the front or back of the display surface. In the case of the stereoscopic glass-based displays, the depth of the screen may also be the best in the eye convergence point. Nevertheless, the depth of the screen does not seem to be the best place. This means that it may be uncomfortable for the viewer to alternate the view of the screen, but the subtitles do. As a result, the depth of the subtitles is the same. For example, a learned actor who is an element of interest.

[0054] Figure 3 shows the auxiliary graphic data located on the secondary depth. The left part of the figure shows the 3D display 30 of the front view. 34. In the Figure, the subtitles 31 are located in the border area. that probably focuses the viewer's attention.

[0055] The area of ​​interest. A range of analytic functions may be used in any suitable combination. For imaging functions of the imaging functions. Elements of the image that are in focus, they are out of focus. Detection of objects' focus places and other image parameters. For image elements, the amount of additional data. If the 3D video format contains dry data, the actual presence of the object. For image elements, the depth of the guidance, the luminance and color in relation to the background. Such depth of attention is the user's focus on the object.

Specific objects and other elements of the image can be recognized, such as human faces, cars, rugby or soccer ball, etc. Also for the image elements, position indications such as the center of the display. and / or having a predetermined size in relation to the display area.

[0056] Figure 4 shows an auxiliary graphical data. The display and subtitles essentially correspond to Figure 3. However, the indicia 31 is now located in the same display area 35, which also displays image data. In the exemplary embodiment, the subtitles are arranged in the display area. The position of the region. 41. Thus, the detection of the next graphic art. The depth of the region. The auxiliary depth value can be set.

[0057] In an embodiment, a depth and / or parallax of the subtitles. The producer of the film and the work of the artist, create the details of the work, setting the auxiliary depth values.

[0058] It should be noted that it is dynamically involved in the frame of the graphic arts, as in WO2008 / 115222, it leads to frequent jumps in the depth of the frames. Placing the overlay on a very large scale. Both approaches lead to eye strain. Currently, the determination of the area of ​​interest.

[0059] In an embodiment, the selection of the target region takes place in the following way. The display area is divided into many regions. Depth pattern detection is based on the spatial filtering function. On the target region.

[0060] Figure 5 shows a divided display area. Is 46 figure 46 45 divided into maximum 45 46 45 divided The is 46 45 divided divided is 46. For example, the text of the subtitles 47 is much larger (ie, closer to the recipient).

[0061] In the first place, it is necessary to make the most of it. separate regions of the image. In the proposed method, the depth is calculated in many regions (tiles) of the image. Only the depth of the tiles.

[0062] In one embodiment, the invention is used to impose subtitles on 3D content. The main content appears as stereo images (left / right); subtitles also appear as images. The embodiment may also render subtitles from the corresponding description.

[0063] In an embodiment, the following steps are used:

- For all left and right images.

- In the region of interest, the minimum discrepancy is calculated and stored for each pair of images. The discrepancy is in the view of the smallest perceived distance from the viewer.

- Filtering is applied to the list of minimum discrepancies.

- Positive depth values ​​are set to 0, which is the view of the screen plane. Another value can be selected on a different plane by default.

- Subtitles are mixed at the left and right sides, which is equal to the filtered discrepancy.

- If subtitles are pre-rendered, regular rendering is used with different transparency factors.

- If the subtitles exist in a text format, they are rendered with sub-pixel precision.

- A small offset (usually one pixel) can be used to create a small range of the bridge between the object and the subtitles.

[0064] It should be noted that the above is a larger range than the auxiliary depth values. Moreover, said selection may also include the selection of the auxiliary values. For example, subtitle rendering can be delayed or shifted so that the object farther from the front disappears.

[0065] In an embodiment, determining the depth of the clock. For example, for a period of time, in the neighborhood of the subtitles. The period of subtitles is displayed in the display signal.

[0066] In particular, determining a depth of action. It can be implemented in the following way.

- Shot limits are calculated from left or right images. Images of shots are found by the histogram of the image colors.

The minimum discrepancy list is detected for shots according to the cutbacks previously detected.

For each shot, the minimum discrepancy list is then filtered with the corresponding time window function (see example below). The window is a function with a zero value outside a certain range. For example, a function that is in a range of rectangular window. The image (data) signal is multiplied by the window.

Filtering each shot. Hence, the depth of the cut, the cut is not allowed. As an alternative, also placing the view of the frames of shots.

[0067] For selecting a window function, the embodiment of the window function, but other window functions, eg a rectangular window function, are also suitable. Hann, named after the Austrian meteorologist Julius von Hann, is a function of the probability mass defined by

<img file="PL2399398T3_D0001.tif" />

[0068] The window is centered on the current position. This is the effect of smoothing the value, which avoids the change in the content of the 3D content. Future values, not available, for broadcasting programs in real time. Alternatively, a small rendering latency.

[0069] It should be noted that the target region (TR) has to include the envelope of the subtitle text. For a comfortable visual appearance, the TR should be much larger. If the subtitles are placed at the bottom of the image, the vertex extends to a predetermined height, eg, one-quarter of the height of the image. In the horizontal, it is in the middle of the image minus 20%. This TR ensures that it is matched to the depth of the objects. Extending the region to the center of the image.

[0070] In an embodiment, image data has been scaled to within a limited area of ​​the display area. For example (1: 1.85) the content of the film was scaled to the 16: 9 screen. For the content of the movie 1: 2.35, it would not be needed for the subtitles, because the black bar is available at the bottom. Then (scaled) all content is moved up and placed in line with the top of the screen. Aux This creates This aux This aux This aux This aux This aux This aux This aux This.

[0071] Figure 6 shows an example of scaled imaging data. In the display area 65, the left edge 62 is shown on the entire image 60. by the number of pixels for the display size 1920 * 1080.

[0072] For HD video, the optimal subtitle font size is 42 lines. The content of movie 1: 1.85 shown on the 16: 9 display leaves the field on 17 lines. Scaling 1: 1.85 85 lines with a few black lines between them, about 90 lines. Typically, this will not be visible to the user, especially if the border is textured. In addition, most of them can support independent scaling factors. Alternatively, the scaling of the creation of a slightly lower mono resolution.

[0073] It should be noted that 3D video, another boundary problem is the border effect. The boundary effect does not appear in the frame of the display. The border effect causes a conflict. The solution for the border is a very good view of the border (using 2 small vertical strips) that can be dynamically adjusted. the cut object. In the case of the subtitles, the depth of the border can also be dynamically adjusted based on the depth / discrepancy of the content.

[0074] In Figure 6, said scaling of the image boundaries 61.63 to accommodate the boundary effect. Scaling offers a field of 2 small vertical borders with approximately 85 rows, which can be used to dynamically change the border.

[0075] Since the field has been created for the subtitles, it is possible to dynamically adjust the depth of the content. However, this is more difficult than the case of left and right borders. The horizontal offset on the bottom of the bar. Work on the number of textures. However, the movement of a constant signal (black bar) has no effect. There is a problem of violating the black bar. However, when this is a black, but somehow textured (eg, has the appearance of wood as in Figure 6), it is also possible to adjust the depth of the object to be cut.

[0076] Another benefit of artificial (off-screen) boundaries is also available for viewing.

[0077] Figure 7 shows an example of scaled imaging data at black limits. In the display area 65, the left border 72. The lower limit 71 is available for subtitles. In the Figure, the size of the display is 1920 * 1080. For a different display size, such as 1280 * 720, similar solutions can be made.

[0078] Figure 8 shows the caption of subtitles and graphics on the video. The 82 views, the Presentation Surface, and the second 82. The view of the surface, and the second one. layer 83, Interactive Surface of the secondary graphical data. Secondary depth values ​​for graphic elements are determined as described above.

[0079] The right-hand side of Figure 8 shows a similar two-dimensional (2D) + depth of the video output. Views 86 views 86 86 86 86, the Presentation Surface, and the second layer; each of these layers has a corresponding depth map. Auxiliary depth values ​​for graphic elements.

[0080] It should be noted that the model in Figure 8 may be implemented in a Blu-ray Disc (BD) format. 6 and 7, and the position and size of the subtitle region. . The BD format supports many planes that allow the content of the video. Implementation is as follows.

[0081] In the first step, the video is scaled to produce a field for subtitles, eg at least two subtitle lines. The scaling factor may be under the control of the content author. Therefore, BD should be extended to allow independent video scaling factors. At least the 7/8 scale factor should be supported.

[0082] In a second step, the texture is loaded into the memory buffer. This texture serves to fill the side borders. Figure 6 (not required for black borders in Figure 7).

[0083] In the third step, during the reproduction, the discrepancy of the cut and the image of the object. For a 2D + video image, the depth of the borders is adjusted to the depth of any cut objects. In addition to the 2D + depth image, the view of the background.

[0084] For the implementation of 1680x945, this is a 16/8 for video at 1920x1080. The plane of the plane. The graphic below. The graphics for the sliding window, as shown below.

[0085] Figure 9 shows video scaling to create a field for subtitles and floating windows. The 3D image data 90, is the main film, is input into a scaling unit 92. The graphic presentation plane as described above. The scaled video is combined in an additive 93 to provide a 3D image data. By processing, the view of the image is displayed.

[0086] Figure 10 shows another example of scaling and shifting (1030) of the original video stream (1000) in the upper left corner, with subtitles on a matte black background (1010) in the bottom left corner, which are then using a mixer (1020) in connected output signal (1040).

[0087] When the main movie is sent to the player through a physical medium, such as a Blu-ray Disc (BD), must be delivered on a carrier.

[0088] As indicated above and below, the scaling factor for both xix scaling and offset, both in the x and the y direction.

[0089], Preferably, displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed displayed This table is similar to the Map Table Program defined in ISO13818-1 "Information Technology-Generic Coding of Moving Pictures and Associated Audio Information -Part 1: Systems."

[0090] In the BD format, a similar table is called STN_table. Entries for each stream can be added to PG / Graphical Display or text stream stream, see, for example, http://www.bluraydisc.com/AssetsZDownloadablefile/2b_bdrom_audiovisualapplication_0305-1295515269.pdf, for more information about the Blu-ray format.

[0091] Alternatively, the scaling information and / or the list of locations:

- In the PlayList extension data, where. PlayList is a disk database that contains all the information necessary. Preferably, the scaling factor and / or the offset information are stored together with the discrepancy subtitle information. Alternatively, the scaling factor and / or offset information is stored in the Playlist ExtensionData () containing the above-mentioned displacement and scaling factor.

- In the graphical stream of the overlay (eg, Graphic presentation of subtitles and / or text-string stream).

[0092] More alternatively, the translation and / or scaling information can be determined by the BD-Java or Movie Object. that saves the numbers in the Player Status Register (PSR); decoding the player and the view engine.

[0093] There are many ways to represent the translation and the size of the active video and the size and / or location of the or / positions of the graphic overlay. The individual representations of the displacement and / or scaling coefficient creating content. In addition, different representations may be selected for the location of the subtitles and the black bar (aligned or aligned downwards).

[0094] Furthermore, since some asian movies require subtitles that are vertically oriented, it is necessary that black bars on the page (72, 73) could also be formed or expanded. Above above above be offset vertical offset shift The shift The shift The shift The shift.

[0095] To ensure that it is available in the local media, preferably separately for each graphic stream of the overlay on the disc. An example in which scaling and shifting may be forbidden to the hearing impaired, where the text balloon "Slam!" Only responds to the situation.

[0096] It should be noted that the invention is implemented using software and / or software using programmable components. Method The Although The Although The Although The The The The The The The The The The The The The The The. environment, such as a 3D computer multimedia center connected to a wireless 3D display device.

[0097] The word "comprising" does not exclude the presence of the word "comprising"; Many so-called "devices" or "units" may be represented by the processor. may perform the function, possibly in collaboration with hardware components. Furthermore, the invention is a limited feature, and a combination of features listed above.