Rendering of text-based subtitle data including user selectable style information

ES 2 397 699 T3

DESCRIPTION

Apparatus and method of playing a storage medium that stores text-based subtitle data that includes style information.

Technical field

The present invention relates to the reproduction of a storage medium, and more particularly, to a storage medium, on which text-based subtitle data including style information is recorded, and to an apparatus and a method of reproduction of the storage medium.

Background of the technique

In general, storage media, such as digital versatile displays (DVD), store audio-visual (AV) data, including video data and audio data. The video data and audio data stored in the AV data are compressed in accordance with a standard such as the Motion Picture Experts Group (MPEG) standards. AV data optionally includes subtitle data. Hereinafter, AV data is referred to as moving picture data.

Conventional storage media, such as DVDs, use bitmap-based sub-picture data as subtitle data to provide a subtitle for a moving picture. The sub-picture data has been compressed together with a video stream, an audio stream, and the like, in accordance with a standard, such as MPEG2 or the like. When subtitle data is provided using conventional bitmap-based subpicture data, the subtitle data is precisely synchronized with video stream data.

The Microsoft Corporation document: "Understanding SAMI 1.0"; XP007902747;

URL: http: //msdn2.microsoft.com/en-us/library/ms971327 (d = printer) .aspx, discloses a synchronized accessible media sharing technology.

Presentation of the invention

Technical problem

However, using bitmap-based sub-picture data causes the following problems. First, because a caption is provided using a bitmap-based image, the output style of a mirrored caption cannot be changed when rendering an image corresponding to the caption. Second, because the subtitle data is multiplexed with a video stream, an audio stream, and the like, it is difficult to add new subtitle data to the multiplex subtitle data or correct existing subtitle data. Third, the number of subtitle data that can be added is limited to avoid deteriorating the quality of an image.

Technical solution

One aspect of the present invention provides a storage medium on which text-based subtitle data including style information is recorded, and a storage medium reproduction apparatus and method.

Advantageous effects

A storage medium according to an embodiment of the present invention includes separately recorded text-based subtitle data relative to moving image data. The text-based subtitle data includes a plurality of style information so that a style in which a subtitle is output can be arbitrarily changed. Thus, a moving picture subtitle can be output in various styles without deterioration of the image quality of a video stream, and the elaboration and editing of subtitle data is easy. Also, the style in which a subtitle is output can be arbitrarily changed by a user.

Additionally, although the present invention is described in terms of a caption used with moving image data, it is understood that aspects thereof could be used with still image data and / or with audio data. Furthermore, although the invention is described in terms of style sheets, it is understood that aspects of it can be applied to any set of information associated with an electronic document and that describes a grouping of data, a definition of the appearance of a document in terms of elements such as typeface, size, and color for headings and body text, how sections should be arranged in terms of space, line spacing, margin widths, spacing between headings, and others.

ES 2 397 699 T3

In addition, on a storage medium according to an aspect of the present invention in which text-based subtitle data including style information is recorded, and on a device and a reproduction method of the storage medium, there can be output to a subtitle using style information selected by a user. Also, the style in which a subtitle is being output can be changed. In other words, text-based caption data according to a feature of the present invention can be easily formed and edited, and can be output in various styles. Additionally, a user can select various caption output styles using a plurality of style information included in the text-based caption data.

Description of the drawings

The foregoing and / or other features and advantages of the present invention will become more clearly apparent and will be more readily appreciated by describing in detail exemplary embodiments thereof, with reference to the accompanying drawings, in which:

FIG. 1 is a block diagram showing types of data recorded on a storage medium according to an embodiment of the present invention;

FIG. 2 is a table defining elements and attributes that are used in a Marking document as an example of text-based caption data shown in FIG. 1;

FIG. 3 illustrates an example of text-based caption data written in a Markup language defined in FIG. 2;

FIG. 4 is a conceptual block diagram of a playback apparatus supporting text-based subtitle data, in accordance with an embodiment of the present invention;

FIG. 5 illustrates some of the player status registers (PSR) which are system registers that record style information included in text-based subtitle data shown in FIG. 1;

FIG. 6 illustrates some of the general purpose registers (GPR) which are system registers that record the style information included in the text-based caption data shown in FIG. 1;

FIG. 7 illustrates an algorithm for selecting appropriate style information in response to a user command in accordance with one aspect of the invention;

FIG. 8 illustrates an example of an application programming interface (API) used to change style information shown in FIG. 1;

FIG. 9 illustrates an example of a Java application written using the API defined in FIG. 8;

FIG. 10 is a flow chart illustrating a method of outputting a subtitle using text-based subtitle data shown in FIG. 1; and FIG. 11 is a flowchart illustrating a method of changing an output style of a subtitle using style information included in the text-based subtitle data of FIG. 1.

Optimal mode

According to one aspect of the present invention there is provided an apparatus arranged to transfer data according to claim 1.

According to one aspect of the present invention, there is provided a method of reproducing a storage medium according to claim 2.

Additional aspects and / or advantages of the invention will be set forth in part in the description that follows, and will be apparent in part from the description, or may become known by practicing the invention.

Mode for putting the invention into practice

Reference will now be made in detail to the embodiments of the present invention, the examples of which are illustrated in the accompanying drawings, in all of which the like reference numerals refer to the same elements. The embodiments are described below in order to explain the present invention with reference to the figures.

ES 2 397 699 T3

FIG. 1 is a block diagram showing types of data recorded on a storage medium according to an embodiment of the present invention. Referring to FIG. 1, the storage medium includes main data 100, full data 110, system data 120, and text-based subtitle data 130.

The main data 100 is data for reproducing a moving picture and includes moving picture information 102, which has been compressed, and navigation information 101, which is used to control the reproduction of the moving picture information 102. The moving picture information 102 includes one or more fragment (clip) A / V stream files encoded in accordance with a standard, such as MPEG. Each of the chunks is a drive to which data is written. The moving picture information 102 includes a clip information file that includes encoding attributes of the clip A / V stream file, entry point information thereof, and the like. The moving picture information 102 further includes a playlist composed of a plurality of playback items, wherein the playback item is a unit in which data is reproduced. Each of the playback elements indicates an in time position and an out time position on the clip information file. The moving picture information 102 is reproduced with reference to the navigation information 101 of the storage medium, and a user views a moving picture, such as a high-quality movie or the like reproduced from the moving picture information. 102. However, it is understood that the A / V data can be organized in another way and that the data does not need to be compressed and / or that the data can be compressed in accordance with other regulations.

The full data 110 is data to provide an additional function other than the reproduction of a moving image and includes program data 111, to provide interaction with a user, and / or browser data 112, to reproduce information regarding the image. moving from a Marking document. If the additional function is not required, the complete data 110 may not be included.

According to aspects of the invention, the program data 111 is used to provide a game function using a motion picture, a display function of a director's comment while playing a part of a motion picture, a display function of additional information while a part of a movie clip is playing, a chat execution function while a movie clip is playing, or the like. The program data 111 can support JAVA environments as well as other interactive environments.

Browser data 112 is a command to reproduce information regarding a moving image from a Marking document. The command can be expressed in a Markup language and / or an execution script language (for example, the ECMA script language). The information regarding the moving picture reproduced from the Marking document is reproduced together with the moving picture. For example, from a storage medium that stores the film, recent news about film actors stored on a web page, an archive, or the like, news about the opening of events related to a film, an updated subtitle of the movie, and the like, and they can be broadcast together with the movie, and / or can be retrieved via a network or other storage medium to which the playback apparatus is connected. The complete data 110 may further include other data to provide another function in place of the motion picture reproduction function.

The system data 120 is data used to control the playback of the main data 100 and / or the full data 110 and includes start information 121 and title information 122. The start information 121 indicates a position of an object to be reproduced in first when the storage medium is reproduced by a reproducing apparatus. Title information 122 includes cue point information indicating a position of each object to be reproduced.

The text-based caption data 130 is recorded separately from the main data 100, the full data 110, and the system data 120, and has a text-based data structure so that it can be changed, added, or correct the style in which an elaborate subtitle is output. For example, the text-based caption data 130 can be expressed in the text-based markup language. Caption data 130 includes script information 131 and style information 132.

The script information 131 indicates a text to be displayed as a subtitle of a moving image. The style information 132 indicates information about a style in which the subtitle is output. The information is used while the script information 131 is being restored to be displayed on a display device. The subtitle data 130 can be recorded on a local storage media independent of the storage medium.

FIG. 2 is a table defining elements and attributes that are used in a Marking document to set an example of the text-based caption data 130 of FIG. 1. Referring to FIG. 2, the markup document includes script information 203 and style information 202 as described in a subtitle element 201. Hereinafter, a markup document for constructing caption data is referred to as a text caption document.

ES 2 397 699 T3

Elements and attributes used in a text caption document will be described in detail below. The subtitle element 201 indicates a top-level element of the text subtitle document. Every text caption document begins with the caption element. The subtitle element includes the following attributes: a "subtitle_id" ("subtitle_id") attribute indicating a subtitle identifier (ID) to differentiate each subtitle data element from other subtitle data elements; an attribute "lang" ("idio") indicating a character code of a language of a subtitle displayed on a screen using subtitle data; and a title attribute that indicates a title of a movie clip that uses the caption data.

A style set element includes style information to be used in subtitle data replacement and includes at least one style sheet element in accordance with one aspect of the invention. The style sheet element indicates a unit in which the style of caption data is managed and changed. The stylesheet element includes at least one style element. If there are a plurality of style sheet items, each of the style sheet items includes an identical number of style items, each being used to render caption data. If style elements are used for a storage media manufacturer to reconstruct identical subtitle data but contained in different stylesheet elements, the style elements have the same style_id (style_id) value.

Each style sheet element includes the following attributes. First, a “stylesheet_id” (“stylesheet_id”) attribute indicates a stylesheet ID to differentiate stylesheet elements from each other. Since the stylesheet_id (stylesheet id) attribute is registered in a record of a playback apparatus, which will be described later, and is used as the current value of the styles information, the stylesheet_id (stylesheet id) attribute preferably has a binary value.

Second, a "default" attribute designates a style sheet to be applied initially when outputting caption data on a display screen. Only one style sheet element has a default value of “yes”, and the remaining style sheet elements have a default value of “no”.

Third, a desc attribute indicates descriptions of a style that is selected by the style sheet element.

In accordance with one aspect of the invention, a style element stores style information to be used when replacing caption data and includes the following attributes. First, a style_id (style_id) attribute indicates a style class value to differentiate between style elements included in a stylesheet element. Second, a font attribute indicates a font to use in a text used as script information by a dialog element. Third, a color attribute indicates a color of the text used as script information by the dialog element. Fourth, a bgcolor (colorfd) attribute indicates a background color of the text used as script information by the dialog element. Fifth, a size attribute indicates a size of each character in the text used as script information by the dialog element. Sixth, a position attribute indicates a reference position in which characters of the text used as script information by the dialog element are output. Seventh, an align attribute indicates an alignment of the text used as script information by the dialog element. Eighth, a region attribute indicates a region on a screen in which text will be output using the dialog element. Ninth, a lineheight attribute indicates a line spacing of the text that will be output on the screen using the dialog element.

A script element stores information about a caption text and includes at least one dialog element in accordance with one aspect of the invention.

Each of the dialog items stores information about a subtitle text to be displayed on the display screen and includes the following attributes. First, a begin attribute indicates information about an instant, in which the subtitle text begins to be displayed. Second, an end attribute indicates information about a time when the subtitle text is no longer displayed. Third, an attribute ref_style_id (style_id_ref) indicates a class value of a specific style element to designate a style to apply to information about the caption text displayed on the display screen using the dialog element.

FIG. 3 illustrates an example of a file for text-based caption data 130 written in a markup language defined in FIG. 2. Referring to FIG. 3, a text caption document starts with a 300 caption element. The caption element 300 includes a single style set element 310, which includes style information to be used in restoring script information, and a single script element 320, which includes script information for a movie clip. Caption element 300 corresponds to text-based caption data 130 of FIG. 1, style set item 310 corresponds to style information 132 of FIG. 1, and the script element 320 corresponds to the script information 131 of FIG. 1.

Style set element 310 includes first and second style sheet elements 311 and 312. As described above, each of style sheet elements 311 and 312 indicates the unit in which

ES 2 397 699 T3 you can manage and change a style. Stylesheet elements 311 and 312 each include the stylesheet_id (stylesheet_id) attribute, which indicates an attribute value of the playback apparatus record, to reflect current style information.

The first style sheet element 311 that has a stylesheet_id attribute of 0 is set to display a default value of "yes". Therefore, as long as no style change commands are generated by a user, the first style sheet item 311 basically applies to the information about the caption text. The first element of stylesheet 311 indicates a normal-size font that uses the desc attribute.

The second element in stylesheet 312 that has a stylesheet_id (stylesheet_id) attribute of 1 indicates a large font that uses the desc attribute. Thus, when a user changes a caption style, the font size can be changed.

Style sheet items 311 and 312 each include an identical number of style items. Each of the style elements has, as its attribute value, style information actually applied to a caption text.

Style elements 311a, 311b, 312a, and 312b are used to indicate a plurality of style information that a manufacturer wishes to apply to caption text. As shown in FIG. 3, the first style sheet element 311 includes the two style elements 311a and 311b, which have, respectively, style_id (style_id) attributes of x and y. When style element 311a that has a style_id (style_id) attribute of x is compared to style element 311b that has a style_id (style_id) attribute of y, they have different style information. In particular, the difference in font size is important.

For example, a manufacturer can apply style information indicated by style element 311a to some of the caption text information, such as a subtitle title, and style information indicated by style element 311b to text information. caption corresponding to a dialogue.

Although not necessary, it is preferable that the storage medium according to an embodiment of the present invention is an optical disk which is removable from a reproducing apparatus and capable of reading data using an optical device of the reproducing apparatus. Examples of the storage medium include, but are not limited to, CD-ROM, DVD, Bluray, and Advanced Optical Discs, optical discs to be developed, and the like.

It will now be described in detail, with reference to FIGS. 1 and 4, a reproduction apparatus for reproducing the aforementioned storage medium, according to an embodiment of the present invention. FIG. 4 is a conceptual block diagram of a playback apparatus 410 that supports text-based caption data, in accordance with an exemplary embodiment of the present invention. Referring to FIG. 4, the playback apparatus 410 includes a main data processor 411, a full data processor 412, a text caption processor 413, a moving image data processor 414, a mixer 415, and a system register 416. . Although the apparatus is described in terms of a reproduction apparatus, it is understood that it may further have a recording capability and may be a stand-alone device or be incorporated into a general or specific purpose computer.

Main data processor 411 controls playback of moving image data (ie, moving image information 102) using navigation information 101 of FIG. 1. The main data processor 411 is also referred to as the navigation engine. Full data processor 412 processes application data that provides interaction with a user, such as program data 111 (for example, a Java program or the like) and / or browser data 112 (for example, a document of marked or similar). The full data processor 412 may include a program engine and a browser engine separate from the program engine, or the engines may be combined.

The text caption processor 413 verifies a construction of the text-based caption data 130, including the script information 131 and the style information 132, and processes the text-based caption data 130.

The moving image data processor 414 decodes the moving image data and outputs a decoding result on a screen of an output device 420. The moving image data processor 414 is also referred to as presentation engine.

The mixer 415 mixes images that are output by the full data processor 412 and the moving image data processor 414, and outputs a mixing result to the display of the output device 420.

System Register 416 includes Player Status Registers (PSR), which store various types of

ES 2 397 699 T3 status information about the playback apparatus, and general purpose registers (GPR), which are used by the playback apparatus to temporarily record data.

Specifically, the main data processor 411 stores information necessary for playback in the system register 416 in accordance with a navigation command to reproduce a motion picture (such as a movie), and transmits a playback command to the video processor. motion picture data 414. In response to the playback command, the motion picture data processor 414 decodes the motion picture data using the information necessary for playback recorded in the system register 416. During playback of a motion picture, when a When the user receives a subtitle output command, the main data processor 411 transmits the subtitle output command to the text subtitle processor 413.

In response to the subtitle output command, the text caption processor 413 loads text caption data into a memory (not shown) and checks whether a phrase structure of the text caption data matches a phrase structure. default. If the phrase structure of the text caption data matches the default phrase structure, the text caption processor 413 parses the script information and style information and renders the information about the caption text using the information. of styles defined by the first element of stylesheet 311 that has the attribute value default (by default) = yes (yes) of FIG. 3. A restitution result is transferred to the moving picture data processor 414 and output to the output device 420.

During motion picture playback, when a command 401 is received from the user to change a subtitle output style, the main data processor 411 transmits the user command 401 to change the subtitle output style to the subtitle processor. text 413. The text caption processor 413 changes the style information used upon replacement of the caption text information (for example, through a change from one style sheet to another) and registers the changed style information again. in system registry 416.

When the full data processor 412 plays a movie, the full data processor 412 records information necessary to play an application included in the full data 110, into the system register 416, and controls the playback of the moving image using an interface. Predefined Application Programming API (API) for Motion Picture Data Processor 414. The moving image data processor 414 reproduces moving image data in reference to the information necessary for playback, recorded in the system register 416, in the same way as in a main mode (which indicates a playback mode motion picture using main data and is referred to as movie code).

During playback of the motion picture, when the subtitle output command is received from the user, the full data processor 412 transmits the subtitle output command to the text subtitle processor 413. In response to the output command For subtitles, the text subtitle processor 413 outputs a subtitle using the text-based subtitle data 130 in the same manner as in the main mode.

During motion picture playback, when the user command 401 to change the caption output style is received, the full data processor 412 transmits the user command 401 to the text caption processor 413 via an API default change of style for the text caption processor 413. In response to the user's command 401, the text caption processor 413 changes the output style of the caption in the same way as in the main mode.

FIG. 5 illustrates some of the player status registers (PSR) which are system registers that record the style information 132 included in the text-based subtitle data 130 of FIG. 1. Referring to FIG. 5, PSRs indicate records that record various types of status information on a playback apparatus according to the present invention. PSR # 1 indicates the number of an audio stream selected to play a current movie clip, PSR # 2 indicates the number of a subtitle stream selected to play the current movie clip, and the PSR # 17 indicates a language code of the subtitle stream selected to play the current movie clip.

PSR # 19 is used to indicate a selected style sheet ID in the restitution of script information when a caption is output using text caption data. PSR # 19 is simply one embodiment, so it can be substituted for any of the 32-bit PSR # 1 through 63 from the embodiment shown, or it can be any appropriate register indicator with other sizes.

PSR # 19 can be changed by user actuation to be described later, a Java API, or the like. When a content of PSR # 19 is changed during playback of motion picture data that includes text-based subtitle data, a subtitle output style applied to the script information is also changed.

ES 2 397 699 T3

The style information described above, applied to current script information, is stored in PSR, as shown in FIG. 5. Alternatively, the above-described style information may be stored in general purpose registers (GPR) to be described later, or in an internal buffer (not shown) of the text caption processor 413 in accordance with aspects of the invention. .

An example of a user actuation (hereinafter referred to as UOP) for a style change will now be described. The Text_subtitle_style_Change (stylesheet_id) (Text_Subtitle_Style_Change (stylesheet_id)) function, which is a UOP, sets an ID of a stylesheet applied to the text caption data and changes PSR # 19. The Stylesheet_id (stylesheet_id), which is an argument of the function Text_subtitle_style_Change (stylesheet_id) (Text_Subtitle_Style_Change (stylesheet_id)), can have any value between 0 and 231, since the number of styles applicable to a text subtitle is theoretically infinite , although a PSR according to the example shown has a data size of 32 bits. An example of a new navigation command might be the SetSS (for stylesheet_id) (SetSS (for stylesheet_id)) function. The SetSS (for stylesheet_id) (SetSS (for stylesheet_id)) function changes a value from PSR # 19, which indicates a stylesheet ID to use in restoring text caption data, to a value of designated argument. Also, in cases where a PSR has another storage size, it is understood that the stylesheet_id (stylesheet_id) can have other values.

FIG. 6 illustrates some of the GPRs that are system registers that record the style information 132 included in the text-based caption data 130 of FIG. 1. The ID information about a style sheet element defined in a style set element is recorded in the GPRs as shown in FIG. 6. Alternatively, the ID information about the style sheet item may be stored in the internal buffer of the text caption processor 413 or in the PSRs of FIG. 5.

Referring to FIG. 6, address # 100 records 102 as the starting address of ID information about a style sheet item, and address # 101 records 2 as the number of style sheet items used in a style sheet document. text captions. Address 102 records an ID of a style sheet item indicating a normal size of a font, and address 103 records an ID of a style sheet item that indicates a large size of a font. In other words, the text caption document described in FIG. 6 has two style sheet items that indicate a normal font size and a large font size, respectively.

Next, using FIG. 7, a method in which the aforementioned reproducing apparatus reproduces moving picture data using subtitle style information selected by a user from the aforementioned storage medium will be described. FIG. 7 illustrates an algorithm for selecting style information 132 in accordance with a user's command. When a command to change a subtitle output style is received from a user during motion picture playback, the playback apparatus may change text subtitle data so that the style information selected by a user it can be applied using a function, such as the Subtitle_Stylesheet_Change (arg) (Subtitle_StyleSheet_Change (arg)) function, which will be described later.

Referring to FIG. 7, the argument Next_Style (case A) (Style_Next (case A)) or Prev_Style (case B) (Style_Prev (case B)) can be used as an argument in the function Subtitle_Stylesheet_Change (arg) (Change_StyleSheet_Subtitles (arg)). Alternatively, a specific attribute value stylesheet_ID (stylesheet_ID) can be specified as an argument, as in case C. Case C can be expressed in a function similar to the function corresponding to the aforementioned UOP.

In case A where the Next_Style is used as an argument to the Subtitle_Stylesheet_Change (arg) function (Subtitle_Stylesheet_Change (arg)), the playback widget increments a value of the stylesheet_ID (stylesheet ID) stored in PSR # 19 , the GPRs, or the internal buffer of the text-based caption processor 413, and applies a following style displaying the incremented ID value. If the value of the stylesheet_ID (stylesheet ID) of a currently used style is the largest, as in case 701, a style is used that has the smallest value of stylesheet_ID (stylesheet ID). In case 702, a style is used that returns a stylesheet_ID (stylesheet ID) obtained by incrementing a current stylesheet_ID (stylesheet ID) by 1.

Cases 703 and 704 represent style change methods applied in case B in which Prev_Style (Style_Prev) is used as an argument to the Subtitle_Stylesheet_Change (arg) (Subtitle_Styles_Sheet_change (arg)) function. Case 705 represents a method of storing a designated value of stylesheet_ID (stylesheet_ID) in PSR # 19, GPRs, or text-based caption processor internal buffer 413.

FIG. 8 illustrates an example of an API used to change style information 132 in accordance with one aspect of the invention. Referring to FIG. 8, as a group of commands that can be used when writing an application included in the complete data 110, a packet BDROM can be used. The Package BDROM includes a media package for controlling the playback of a moving image according to an application.

ES 2 397 699 T3

The media package includes a subtitle package to control a text-based or bitmap-based subtitle of a moving image. A TextSubtitle interface is defined as part of the subtitle package for the text-based subtitle. The TextSubtitle interface can include the following APIs. The term "status" denotes a parameter that indicates a caption output on / off status. "GetAttributeO" ("getAttribute ()") gets information about an attribute from a text caption file that is currently in use. “GetLangCode ()” (“getIdCode ()”) gets a language code from the text subtitle file. “GetTitleName ()” (“getTitleName ()”) gets a name from a moving picture data title. "GetSubtitleID ()" ("getIDSubtitle ()") gets an ID of the current text subtitle file. "GetCurrentTextStylesheet ID ()" ("getCurrentTextSheetID ()") gets a stylesheet_ID (stylesheetID) that is currently being used. "SetTextStylesheet ID (unsigned int ID)" ("setIDStylesTextID (unsigned int ID)") receives as an argument an ID of a stylesheet to be used in the replacement of a subtitle text and sets PSR # 19 so that be a stylesheet corresponding to the received ID argument. "NextTextStylesheet ()" ("nextStyleSheetText ()") indicates a style sheet successive to a current style sheet in an array of stylesheets and sets a style sheet to use in the subtitle text replacement. "PrevTextStylesheet ()" ("prevHojaestilosTexto ()") indicates a style sheet prior to the current style sheet in the style sheet array and sets the style sheet to be used in the subtitle text replacement. "GetDefaultTextStylesheet ID ()" ("getDefaultTextStylesheetID ()") gets a default style sheet from the style sheet array. "GetCurrentPresentationTime ()" ("getCurrentPresentationTime ()") gets a presentation time that indicates the time a subtitle is output from current, text-based subtitle data. "SetPresentationTime (Time t)" sets a presentation time corresponding to a current playback time using t-time information provided as an argument. "GetCurrentTextSubtitle ()" ("getCurrentTextSubtitle ()") gets an ID of the text subtitle file that is currently being used for a current subtitle output. "SetTextSubtitle (String filename or unsigned int ID)" ("setSubtitleText (String filename or unsigned int ID)") receives a file that will be used when outputting a subtitle as an argument and sets the received file so that it is an ID of a received filename or received text subtitle file. "Start ()" ("start ()") begins to output the text subtitle. “Stop ()” stops the output of the text subtitle. However, it is understood that other APIs can be used or developed, and that it is not necessary to use each of the APIs shown in FIG. 8 in all aspects of the invention.

FIG. 9 illustrates an example of a Java application written using the API defined in FIG. 8. Referring to FIG. 9, the PlayXlet application inherits an Xlet application function, which is a basic unit of the Java application and is included in the complete data 110 executed by the playback apparatus, and implements the ControllerListener interface to process a command received from a user while playing a movie clip.

When you start an application implemented by extending an Xlet function, the init () (init ()) part of the application is executed first to initialize the application. The start () part of the application is then executed. As shown in FIG. 9, when the PlayXlet application is executed, it is initialized by a first operation of the init () part (init ()) (see line 4). Next, codes of the PlayXlet application will be described in detail.

In line 1, the media package described in FIG. 8 to monitor moving image data. On line 2, a PlayXlet application object is declared. The PlayXlet application inherits the Xlet application role and implements the ControllerListener interface. On line 3, a Player object is declared, which is a moving image data control object used in the PlayXlet application. On lines 4-15, when the PlayXlet application is initially launched, it is initialized. On line 5, a layout of the PlayXlet application is set. In line 6, a file of the moving image data to be used by the PlayXlet application is named. On lines 7 through 13, an exception is cached that can be thrown while you are initializing the Player object. In line 8, a path is designated for motion picture data resources to be used by the PlayXlet application. On line 9, a playback control object is produced and assigned to the Player object for the motion picture data resources corresponding to the designated path. On line 10, the Listener Event used by the Player object to receive an order from a user and process the order is recorded. On line 11, a “subtitle” object is produced for the Player object. On line 12, a text-based subtitle is designated to be used by the object "subtitle" ("subtitle"). On lines 13 and 14, the exception that may be thrown while the Player object is being initialized is processed. On line 14, an error message is output when the exception is raised. On lines 16 and 17, the start () part is executed after the Player object is initialized. On line 17, playback of the motion picture data controlled by the Player object begins. On lines 18 to 30, a control command received from the user is processed.

On lines 19 through 24, in a SubtitleToggleEvent event type, when a current subtitle is being output, the subtitle output stops. On the other hand, when no subtitle is being output, an instant of time in which the subtitle is to be output is synchronized with an instant of

ES 2 397 699 T3 time at which a current moving picture is to be played, and then the subtitle output is started.

On lines 25 and 26, in an event type of nextSubtitleStylesheetEvent (NextSubtitleStyleSheet event), a stylesheet to be used when outputting a subtitle is changed to a successive stylesheet of a stylesheet that is currently being used. If the currently used style sheet is the last in a style sheet array, the style sheet to use when outputting the subtitle is changed to a first style sheet in the style sheet array.

In lines 27 and 28, in a type of event of prevSubtitleStylesheetEvent (eventPrevSubtitleStyleSheet), the style sheet to use when outputting the subtitle is changed to a stylesheet prior to the stylesheet that is currently being used . If the currently used style sheet is the first in the style sheet array, the style sheet to use when outputting the subtitle is changed to the last style sheet in the style sheet array.

On lines 29 and 30, in an event type of setSubtitleStylesheetEvent (SetSubtitleStyleSheet event), the style sheet to use when outputting the subtitle is changed to a stylesheet designated by an argument value included in a subtitle object. event "e".

In an operation of the Java application described above, when the PlayXlet application of FIG. 9, Playback of designated motion picture data starts. Once a subtitle output command is received from a user during motion picture playback, a subtitle output begins. When another subtitle output command is received, subtitle output stops.

When a nextSubtitleStylesheetEvent command (NextSubtitleSheetSheetEvent) is received from a user while the subtitle is being output, a subtitle output style is changed using style information that has a stylesheet_ID (stylesheet_id) attribute whose value is 1 greater than a value of a stylesheet_ID (stylesheet_ID) attribute of currently used stylesheet information. When a prevSubtitleStylesheetEvent (eventPrevSubtitlesSheetSheet) is received from the user while the subtitle is being output, the output style of the subtitle is changed using style information that has a stylesheet_ID (stylesheet_ID) attribute whose value is 1 less than the value of the stylesheet_ID (stylesheet ID) attribute of the currently used style information.

When a setSubtitleStylesheet command is received to set a current style sheet to be a specific style sheet, using the application of FIG. 9, a subtitle output style change menu provided by a playback, or the like, the current style sheet is changed to the specific style sheet using a user-entered stylesheet_ID.

FIG. 10 is a flow chart illustrating a method of outputting a caption using the text-based caption data 130. Referring to FIG. 10, when a subtitle output start command is received from a user, a style sheet element that has a default attribute "yes" is set as style information to use in the information replacement on a caption text, in step 1010. Thereafter, in step 1020, a time instant when a current moving picture is reproduced is synchronized with a time instant when a subtitle is output by setting a display time. In step 1030, it is checked whether a current subtitle output state is a state in which a subtitle is output or a state in which a subtitle is not output.

If the current subtitle output state is the state where the subtitle is output, the subtitle output is performed, in operation 1040. If the current subtitle output state is the state where the subtitle is not output outputs the subtitle, it ends with the output of subtitles.

If the subtitle is output in step 1040 and it is determined in step 1050 that there are remaining subtitle elements to output continuously, the steps 1030 and 1040 are repeated. On the other hand, if in step 1050 it is determined that there are no subtitle elements left to output continuously, it is concluded with the output of the subtitles.

A user style sheet change command is applied to operations ranging from operation 1030, in which an exit status of the current subtitle is checked, to operation 1050, in which it is checked for completion the subtitle output.

FIG. 11 is a flow chart illustrating a method of changing a subtitle output style using style information 132 included in text-based subtitle data 130 in accordance with one aspect of the invention. Referring to FIG. 11, in step 1110, a command is received from a user to change an output style of a subtitle. In step 1120, it is determined whether an event corresponding to the received command is of a subtitle switch event type or a subtitle style sheet change event type.

ES 2 397 699 T3

If the event corresponding to the received command is of the subtitle switching event type, in step 1130 it is determined whether a current subtitle output state is a state in which a subtitle is output or a state in which no subtitle is output. a subtitle is output. If the current subtitle output state is the state in which the subtitle is output, the state of the subtitle is changed to a state in which the subtitle is not output, in step 1140. If the current subtitle output state is the state in which the subtitle state is changed to the state in which the subtitle is not output, the subtitle is output, in step 1150.

On the other hand, if the event corresponding to the received order is of the subtitles style sheet change event type, it is determined whether the event corresponding to the received order is a setStylesheet event (setStylesheet), a nextStylesheet event (nextStylesheet), or a prevStylesheet event (prevStylesheet), in operation 1160. The setStylesheet event designates a caption output style using a stylesheet_id (stylesheet_id) attribute of a user-selected stylesheet. The nextStylesheet event designates a caption output style that uses a successive style sheet from a style sheet that is currently being used according to a sequence of style sheets. The prevStylesheet (prev Stylesheet) event designates a caption output style that uses a style sheet prior to the style sheet that is currently being used according to the style sheet sequence. As described above with reference to FIG. 7, the setStylesheet event (set stylesheet), the nextStylesheet event (next stylesheet), and the prevStylesheet event (prev stylesheet) are executed respectively in operations 1170, 1180, and 1190, so that a style of a subtitle displayed on a screen is changed according to the designated order.

A storage medium according to an embodiment of the present invention includes text-based subtitle data recorded separately from moving image data. The text-based subtitle data includes a plurality of style information so that a style in which a subtitle is output can be arbitrarily changed. Thus, a moving picture subtitle can be output in various styles without deterioration of the picture quality of a video stream, and the manufacture and editing of subtitle data is easy. Also, a user can arbitrarily change the style in which a subtitle is output.

Additionally, although aspects of the present invention have been described in terms of a caption used with moving image data, it is understood that they could be used with still image data and / or audio data. Furthermore, although aspects of the invention have been described in terms of style sheets, it is understood that they can be applied to any set of information associated with an electronic document and which describes a grouping of data, a definition of the appearance of a document in terms of elements such as font, size, and color for headings and body text, how the sections should be arranged in terms of space, line spacing, margin widths, spacing between headings, and others.

In addition, on a storage medium according to an aspect of the present invention in which text-based subtitle data including style information is recorded, and on a device and a reproduction method of the storage medium, there can be output to a subtitle using style information selected by a user. Also, the style in which a subtitle is being output can be changed. In other words, text-based caption data according to a feature of the present invention can be easily formed and edited, and can be output in various styles. Additionally, a user can select various caption output styles using a plurality of style information included in the text-based caption data.

Although not necessary, aspects of the invention may also be embodied in the form of computer-readable codes on at least one computer-readable recording medium. Computer-readable recording medium is any data storage device that can store data which can later be read by a general or specific-purpose computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random access memory (RAM), CDROM, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission via Internet). The computer-readable recording medium can also be distributed through network coupled computer systems so that the computer-readable code is stored and executed in a distributed manner.

Although some embodiments of the present invention have been shown and described particularly with reference to exemplary embodiments thereof, those of ordinary skill in the art will understand that various changes in shape and detail can be made therein without deviating. with respect to the scope of the present invention as defined by the following claims.

Industrial applicability

One aspect of the present invention provides a storage medium on which text-based subtitle data including style information is recorded, and a storage medium reproduction apparatus and method.