Editing device, reproducing device and storage medium

Editing device, playback device and recording medium

Technical field

The present invention relates to an editing device, a reproducing device and a recording medium that can reproduce special effects by making full use of the functions of the reproducing device.

Background technique

When creating image content, special effects are used in order to provide multiple information, change the screen transition, or protect privacy on the screen. There are two editing methods for applying this special effect. One is to record the image signal after the special effect is applied on the recording medium. The other is to directly record the original image signal while recording the processing sequence of the special effect. During playback, The special effect is reproduced by processing the original image signal according to the processing sequence of the special effect. The latter is particularly called non-destructive editing, and can be edited using application software such as Quicktime (digital multimedia technology, hereinafter referred to as "QT"). QT is a software that manages various data along the time axis. It is an OS extension function that can replay animation, sound or text synchronously without using special hardware.

In the QT file, the basic data unit is called an atom, and each atom contains the data and the size and type of the data. In addition. In QT, the smallest unit of data is treated as a sample, and the collection of samples is defined as a block. A resource atom is a part that stores necessary information in order to refer to necessary information or actual data when reproducing the file. The data atom is the part that stores real data such as video or audio. QT has been published, for example, in "INSIDEMACINTOSH (Mackintosh Computer Internal): QuickTime: (Digital Multimedia Technology) (Japanese Version) (Addison-Wesley (Edison-Wesley))" and the like.

In non-destructive editing using QT, not only the special effects of images, but also the superimposition of text or graphics can also be described in the form of QT files. That is, the type of special effect, start time, end time, and the ID of the image to which the special effect is added are recorded on the recording medium in the form of a QT file. During playback, the specified type of special effect is applied to the specified image at the specified time. The effect is then displayed on the display device, whereby the image accompanied by the special effect can be replayed, which is the same as the special effect added by the editor during editing.

There are actually many types of special effects and text fonts. Therefore, there is a problem that the types of special effects installed on playback devices of different models are different. That is, when the recording medium is played back on a certain model, it is possible to play back images with special effects or text fonts that are the same as the special effects intended by the editor, but when playing back on other models, it cannot be played back. Replay the image as the editor intended. Furthermore, there is a problem that special effects or text fonts that cannot be recognized by the model cannot be applied during playback.

Especially in recent years, image content is provided by a variety of recording media such as LD, image CD and DVD disc media or memory cards, and can also be provided through the network, so special effects or text fonts vary depending on the model. The problem of not being able to replay is very important.

In order to solve this problem, we have considered standardizing special effects or text fonts and making some of them necessary items. However, it can be expected that in this method, even if there is a high-function playback device that contains special effects or text fonts other than necessary items, the image content edited with the necessary items becomes ordinary image content. As a result, there is no Take advantage of its high functionality.

On the other hand, it has also been considered that the editor assumes several models and then edits suitable for each model. However, at this time, there is a problem that multiple types of edited image content appear depending on the model of the image despite the same image type, and the distribution or distribution cost is high. Or, it can be expected that there will be a problem that only image content edited for models with a large market will be distributed, and other image content will not circulate.

Summary of the invention

Therefore, an object of the present invention is to provide an editing device, a playback device, and a recording medium that can reproduce special effects by making full use of the functions of the playback device.

The first aspect of the present invention is an editing device having original image data and editing data, and the editing data is used to perform editing operations on the desired part of the original image data according to the desired editing type to generate edited images. The image data editing code is characterized by including: a data input device for importing original image data; a data editing device for editing the required part of the original image data according to the required editing type to produce the editing The image data; primary conversion table storage device for storing at least the primary conversion table that associates the above-mentioned desired editing type with the standard editing type predetermined as a standard; primary conversion table appending device for storing The primary conversion table is added to the edited image data; and a data output device is used to output the edited image data together with the primary conversion table.

In such an editing device, since the edited image data has a primary conversion table that converts the editing code into a standard editing category as a unified specification, it is possible to edit the original image data using various editing categories without having to Consider the type of editing installed in the playback device that plays back the edited image data.

In addition, it is not necessary to create edited image data corresponding to the model of the playback device. Therefore, the distribution and distribution costs of edited image data can be reduced.

The second aspect of the present invention is a reproducing apparatus that reads each data from a recording medium on which original image data, edited data, and a primary conversion table are recorded, and edits the data to reproduce the image data. To edit the edit code for the desired part of the original image data according to the desired edit type, the primary conversion table at least makes the desired edit type correspond to the standard edit type specified in advance as a standard, and the playback device The composition includes: a primary conversion table storage device for storing the above-mentioned primary conversion table; a secondary conversion table storage device for storing a secondary conversion table corresponding to the type of the standard edit and some of the installed installation edit types; When the edit type of the edit code is not installed, by referring to the primary conversion table of the above-mentioned primary conversion table storage device, the edit type of the edit code is converted to the standard edit corresponding to the edit type of the edit code as the primary conversion edit type Type primary conversion device; when the primary conversion edit type converted by the above primary conversion device is not installed, refer to the secondary conversion table of the secondary conversion table storage device to make the primary conversion edit type as the secondary conversion The edit type is converted into a secondary conversion device that corresponds to the type of installed edit corresponding to the type of primary conversion edit, using the edit type of the above-mentioned edit code corresponding to the type of installed edit, the type of primary conversion edit, and the above-mentioned secondary conversion edit One of the editing types among the types edits the original image data before replaying.

The third aspect of the present invention is: in the playback device of the second aspect of the present invention, the above-mentioned secondary conversion table broadens the concept of the above-mentioned standard editing type and accordingly classifies them into a hierarchical structure. In the secondary conversion table, when performing the second conversion of the above-mentioned primary conversion edit type, if there is no installation edit type corresponding to the above-mentioned secondary conversion table, use the primary conversion edit type of the upper layer of the above-mentioned primary conversion edit type to perform 2 Times transformation.

In such a reproducing device, even if the reproducing device does not implement the editing type that the editor originally intended, it can be converted to the standard editing type using the primary conversion table. Furthermore, even if the type of standard editing after the first conversion is not installed in the playback device, the second conversion table can be used to convert it twice to the type of installed installed editing. Therefore, not to mention all the editing types, even the standard editing types, and the playback device do not need to be installed, and the installed editing types can be flexibly determined arbitrarily.

The fourth aspect of the present invention is a recording medium that records original image data, editing data, and a primary conversion table. The editing data is a collection of data used to edit a desired part of the original image data according to a desired editing type. The editing code, and the primary conversion table is such that at least the desired editing type corresponds to a standard editing type defined in advance as a standard.

Brief Description of the Drawings Fig. 1 is a block diagram showing the structure of an editing device of this embodiment.

Fig. 2 is a diagram showing an example of a standard erasing operation.

Fig. 3 is a diagram showing an example of a primary conversion table in the first embodiment.

Fig. 4 is a diagram showing the structure of an image reproducing unit according to the first embodiment.

Fig. 5 is a flowchart showing the operation of the editing device of the first embodiment.

Fig. 6 is a flowchart showing an image data input program of the first embodiment.

Fig. 7 is a flowchart showing a procedure for creating and editing a primary conversion table in the first embodiment.

Fig. 8 is a flowchart showing the animation editing program of the first embodiment.

Fig. 9 is a flowchart showing a procedure for adding a primary conversion table in the first embodiment.

Fig. 10 is a flowchart showing a data output program of the first embodiment.

Fig. 11 is a diagram showing a configuration example of input data.

Fig. 12 is a block diagram showing the structure of the reproducing apparatus according to the first embodiment.

Fig. 13 is a flowchart showing the operation of the reproducing apparatus according to the first embodiment.

Fig. 14 is a diagram showing an example of a secondary conversion table in the first embodiment.

FIG. 15 is a diagram showing an example of image data having a plurality of primary conversion tables.

Fig. 16 is a block diagram showing the structure of a data conversion device.

Fig. 17 is a diagram showing an example of special effects classified by level according to the second embodiment.

Fig. 18 is a diagram showing an example of a primary conversion table with a hierarchical structure in the second embodiment.

Fig. 19 is a diagram showing an example of a secondary conversion table with a hierarchical structure in the second embodiment.

Fig. 19 is a diagram showing an example of a secondary conversion table with a hierarchical structure in the second embodiment.

Fig. 20 is a flowchart showing the operation of the secondary conversion unit in the second embodiment.

Specific Embodiments of the Invention Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, the same reference numerals are attached to the same constituent elements in the respective drawings, and the description thereof is omitted.

(First Embodiment) Fig. 1 is a block diagram showing the structure of an editing device of this embodiment.

In FIG. 1, the editing device is composed of a data input unit 11, an input data storage unit 12, an image playback unit 13, a playback condition setting unit 14, a data editing unit 15, an edited data storage unit 16, and a switching device unit. 17. The operation unit 18, the primary conversion table addition processing unit 19, the data output unit 20, the primary conversion table editing unit 21, the primary conversion table storage unit 22, and the primary conversion table display unit 23.

The operation unit 18 is a part where the user inputs a desired operation, and is, for example, a user interface such as a mouse or a keyboard. The operation unit 18 is connected to the data input unit 11, the image playback unit 13, the playback condition setting unit 14, the data editing unit 15, the switching device unit 17, the primary conversion table addition processing unit 19, the data output unit 20, and the primary The conversion table editing unit 21 is connected.

The switching device unit 17 is a device that switches the units to be operated by the operation unit 18 and is connected to the image reproduction unit 13, the data editing unit 15, the primary conversion table addition processing unit 19, and the primary conversion table editing unit 21.

The data input unit 11 is a part that inputs data from the outside, and is connected to the input data storage unit 12 and the primary conversion table storage unit 22.

The input data storage unit 12 is a device that stores input data, such as RAM (Random Access Memory), and has at least a capacity necessary for editing. For example, in order to give a special effect of superimposing two images, it has at least the capacity to store the image data of the two images separately. The input data storage unit 12 is connected to the data editing unit 15, the edited data storage unit 16 and the image playback unit 13.

The data editing unit 15 performs various editing such as special effects on the image data of the input data storage unit 12 or the image data of the edited data storage unit 16. The data editing unit 15 is connected to the editing data storage unit 16.

The edit data storage unit 16 is a storage device that stores edit results, and is, for example, a RAM. The edited data storage unit 16 is connected to the primary conversion table addition processing unit 19, the image reproducing unit 13, and the data output unit 20.

The primary conversion table editing unit 21 accesses the data stored in the primary conversion table storage unit 22, creates a primary conversion table based on the operation of the operation unit 18, and changes its content. The primary conversion table editing unit 21 is connected to the primary conversion table storage unit 22.

The primary conversion table storage unit 22 is a device that stores the primary conversion table, and is, for example, a RAM. The primary conversion table storage unit 22 is connected to the primary conversion table addition processing unit 19 and the primary conversion table display unit 23.

Here, the primary conversion table will be described.

Fig. 2 is a diagram showing an example of a standard erasing operation.

Fig. 3 is a diagram showing an example of a primary conversion table in the first embodiment.

The so-called standard special effects refer to the special effects specified by the editor in various editing devices that apply special effects and various playback devices that reproduce image data that apply special effects as special effects that can distinguish what kind of special effects they are. Special effects after standardization. Therefore, the editing device does not necessarily perform the special effects as the special effects designated by the editor. In this case, as will be described later, the editing device only needs to execute a special effect in place of the special effect designated by the editor according to the primary conversion table.

On the other hand, the playback device does not necessarily perform the special effects in the same way as the special effects designated by the editor. In this case, as will be described later, the playback device only needs to execute a special effect in place of the special effect designated by the editor in accordance with the conversion table. Instead, it is performed based on the primary conversion table and the secondary conversion table.

Figure 2 shows the wipe-related part of such standard special effects. The structure of Fig. 2 includes categories, transformation type (Transition Type), transformation subtype (Transition Subtype), and Wipe code (Wipe code) from the left. Type, transformation type, and transformation sub-type are classified according to the standard erasure. Among them, category is an upper-level concept, transformation type is a middle-level concept, and transformation sub-type is a lower-level concept. The erasure code is an identification symbol corresponding to the transformation subtype.

In the first embodiment, standard erasure is from left to right (LeftToRight), top to bottom (TopToBottom), top left (TopLeft), top right (TopRight), bottom left (BottomLeft), bottom right (BottomRight), Rectangle and diamond.

Assign erasure codes to each standard erasure, from left to right is 1, from top to bottom is 2, left top is 3, right top is 4, left bottom is 5, right bottom is 6, rectangle is 101, diamond is 102 . The erasure code is added to the image data as data specifying special effects in non-destructive editing. In addition, the type of standard erasure is Transition, the transition type from left to right and top to bottom is BarWipe, and the top left, top right, bottom left, and bottom right are block erasing (BoxWipe). ), rectangles and diamonds are IfisWipe.

Furthermore, Figure 2 is the erasure mode specified by SMPTE (Society of Animation and Television Engineering) 258M-1993. The symbol name of each erasure mode is the symbol name used by SMIL (Synchronous Multimedia Integration Language) 2.0, and the erasure code is the code of SMPTE 258-1993.

The primary conversion table is the special effect applied to a certain image (original special effect) and the special effect that is selected from the special effects designated as the standard when the special effect is not installed on the device that reproduces the image (replacement special effect). Effect) corresponding table. The primary conversion table can be created by the editor who edits the image data and added to the image data as described later, or it can be installed in the editing device as a table of prescribed values, and then added to the image data by the editing device .

For example, in Figure 3, if the original special effect is the top-to-bottom strip erase as in Figure 2, then the top-to-bottom strip erase is selected as the alternative special effect. If it is the top left block erase, select the top left block erase Except as a substitute special effect, if it is the right top block erase, select the right top block erase as the substitute special effect, if it is the top center (TopCenter) block erase, select the left top block erase as the substitute special effect, if it is the middle bottom (BottomCenter) block erase, select the right bottom block erase as an alternative special effect, if it is an Up (Up) triangle erase (TriangleWipe), select a rectangular Elis erase as an alternative special effect, if it is a right triangle To erase, select the diamond-shaped Ellis erase as the alternative special effect, if it is the left triangle erase, select the diamond-shaped Ellis erase as the alternative special effect, if its the Down triangle erase, select The diamond-shaped Ellis erases as an alternative special effect.

Returning to FIG. 1, the primary conversion table addition processing unit 19 reads the edited data from the edited data storage unit 16, adds the primary conversion table to it, and stores it in the edited data storage unit 16.

The reproduction condition setting unit 14 sets the validity or invalidity of each special effect that can be processed by the image reproduction unit 13. By switching the valid and invalid of the special effect, the editing result can be confirmed. The reproduction condition setting unit 14 is connected to the image reproduction unit 13 and the data output unit 20.

The data output unit 20 is a part that records the edited image data on an external recording medium. Moreover, when the edited image data is in the form of an external reference, the original image data of the external reference and the special effect instruction data are concatenated as one piece of data.

Next, the image reproducing unit 13 will be described.

Fig. 4 is a diagram showing the structure of an image reproducing unit according to the first embodiment.

In FIG. 4, the structure of the image playback unit 13 includes an input data interface 31, an input data analysis unit 32, a primary conversion table storage unit 33, a special effect instruction storage unit 35, a primary conversion unit 36, and an image data decoding unit. 38. The first image memory 39, the second image memory 40, the special effect processing unit 41, the image output unit 42, and the playback condition storage unit 44.

The input data interface unit 31 is a device that reads recorded data from a recording medium such as a CD-ROM or DVD and outputs it to the data analysis unit 32. For example, it is a CD-ROM drive or a DVD drive.

The input data analysis unit 32 is a circuit that discriminates input data based on the content of the data, and is connected to the primary conversion table storage unit 33, the special effect instruction storage unit 35, and the image data decoding unit 38, respectively.

The primary conversion table storage unit 33 is a read-only memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory), and is connected to the primary conversion unit 36.

The special effect instruction storage unit 35 is a storage device that stores data, such as a RAM, and is connected to the primary conversion unit 36 and the special effect processing unit 41.

The image data decoding unit 38 is a circuit that decodes input image data, and is connected to the first image memory 39 and the second image memory 40.

The first image memory 39 and the second image memory 40 are memories that are connected to the special effect processing unit 41 and respectively store images processed by the special effect processing unit 41 (images to be synthesized).

On the other hand, the primary conversion unit 36 analyzes the special effect instruction data based on the installation status of the special effects in the playback device and the primary conversion table. The primary conversion unit 36 is connected to the special effect processing unit 41.

The special effect processing unit 41 applies a special effect to the image data in accordance with the special effect instruction data, and outputs it to the image output unit 42.

The image output unit 42 converts the image data to which the special effect is applied into a signal suitable for the display device and outputs it.

Next, the editing operation of the first embodiment will be explained.

Fig. 5 is a flowchart showing the operation of the editing device of the first embodiment.

In FIG. 5, the editor selects an editing operation through the operating unit 18 of the editing device (S11).

When the selected operation is image data input, the editing device executes the image data input program, and then returns to S11 (S12), and when the selected operation is not image data input, executes S13.

In S13, when the selected operation is one-time conversion table editing, the editing device executes one-time conversion table creation and editing program, and then returns to S11 (S22), and when the selected operation is not one-time conversion table editing, S14 is executed.

In S14, when the selected operation is animation editing, the editing device executes animation editing, and then returns to S11 (S23), and when the selected operation is not animation editing, executes S15.

In S15, when the selected operation is a single conversion table addition, the editing device executes the conversion table creation and addition procedure once, and then returns to S11 (S24). When the selected operation is not a single conversion table addition, S16 is executed.

In S16, when the selected operation is to change the setting, the editing device changes the setting of the playback device, and then returns to S11 (S25), and when the selected operation is not to change the setting, executes S17.

In S17, when the selected operation is playback, the editing device executes designation and playback of image data, and then returns to S11 (S26). When the selected operation is not playback, S18 is executed.

In S18, when the selected operation is image data output, the editing device executes the data output program, and then returns to S11 (S27), and when the selected operation is not image data output, executes S19.

In S19, when the selected operation is the end of the operation, the editing device ends the execution of the work program, and when the selected operation is not the end of the operation, it returns to S11.

Next, each subroutine will be explained.

Fig. 6 is a flowchart of the image data input program of the first embodiment.

In FIG. 6, when the editor designates image data to be edited via the operation unit 18 (S101), the data input unit 11 reads the designated image data (S102).

Next, the data input unit 11 recognizes the format of the image data. When the type of format is a non-destructive editing format, such as a QT file, the data input unit 11 performs the processing of S104, and when it is not in this format, it outputs an error code and returns to the main program (S110).

Next, in S104, the data input unit 11 determines whether there is image data that has been read. If there is image data that has been read, it executes S105, and if there is no image data that has been read, it returns to the main routine (S111).

Next, in S105, the data input unit 11 determines the content of the image data for each predetermined portion of the read image data. If the result of the judgment is not the primary conversion, the data input unit 11 executes S106, and if it is the primary conversion table, it stores the part of the image data in the primary conversion table storage unit 22 and then returns to S104 (S112).

Next, in S106, the data input unit 11 determines the content of the next part of the read image data. Moreover, when the result of the judgment is not a special effect instruction, the data input unit 11 executes S107. If it is a special effect instruction, the image data of this part is stored in the primary conversion table storage unit 22 as a list of data, so that the special effect is combined with The corresponding relationship of the animation data to which the special effect is applied is clear at a glance, and then returns to S104 (S113).

Next, in S107, the data input unit 11 determines whether it is a format or code that can be processed by the editing device. Furthermore, when the result of the judgment is not a format or code that can be processed, S108 is executed, and if processing is possible, the part of the animation data is stored in the input data storage unit 12 and then returned to S104 (S114).

In S108, the data input unit 11 converts the format or code of the animation data into a format that can be processed by the editing device, then stores the converted animation data in the input data storage unit 12, and then returns to S104 (S114).

Next, the preparation and editing subroutines of the primary conversion table will be explained.

Fig. 7 is a flowchart of a procedure for creating and editing a primary conversion table in the first embodiment.

In FIG. 7, when the primary conversion table is stored in the primary conversion table storage unit 22, the primary conversion table editing unit 21 reads the primary conversion table (S121).

Next, the primary conversion table editing unit 21 determines whether the primary conversion table storage unit 22 has list data indicating special effect instructions (S122). When there is the list data, the primary conversion table editing unit 21 executes S123 after displaying the list data on the primary conversion table display unit 23, and executes S123 if there is no list data.

Next, when the editor instructs the operation of the primary conversion table, the primary conversion table editing unit 21 receives the instruction via the operation unit 18 (S123).

Next, the primary conversion table editing unit 21 determines the content of the instruction (S124). When the judgment result is that the primary conversion table is newly created, the primary conversion table editing unit 21 secures the storage area of the primary conversion table storage unit 22 and then returns to S123 (S132). On the other hand, unless it is newly created, the primary conversion table editing unit 21 executes S125.

Next, in S125, the primary conversion table editing unit 21 determines whether the instruction content is an addition of an item. When the result of the judgment is the addition of the primary conversion table record (addition of the corresponding row indicating the special effect and its alternative effect), the primary conversion table editing unit 21 requires the input of the content of the additional item (S133), and the primary conversion table The table adds the item input via the operation unit 18 and returns to S123 (S134). On the other hand, if it is not an item addition, S126 is executed.

Next, in S126, it is judged whether the instruction content is erasure of the item. When the result of the judgment is that the record of the primary conversion table is erased (the corresponding row indicating the special effect and its substitution effect is erased), the primary conversion table editing unit 21 requires the input of the erase item content (S135), and it starts from 1 The secondary conversion table erases the item input via the operation unit 18 and then returns to S123 (S136). On the other hand, if the item is not erased, S127 is executed.

Next, in S127, it is determined whether the instruction content has been changed. When the judgment result is a change in the record content of the primary conversion table (change the correspondence between the special effect and its substitution effect), the primary conversion table editing unit 21 first requires input of the changed item (S137), and secondly requires the input of the content of the changed item (S138). Then, after changing the items of the primary conversion table based on the items and contents input via the operation unit 18, the process returns to S123 (S139). On the other hand, if it is not a project change, S128 is executed.

Next, in S128, it is judged whether the instructed content has ended the editing operation. When the judgment result is that the editing operation has ended, the primary conversion table editing unit 21 returns to the main routine (S129), and if it is not ended, returns to S123.

Next, the animation editing program will be explained.

Fig. 8 is a flowchart of the animation editing program of the first embodiment.

In FIG. 8, when the editor selects an editing operation, the data editing unit 15 requests editing of the content (S141).

Next, the data editing unit 15 determines whether a special effect is added to the edited content (S142). When it is determined that the special effect is not added, the data editing unit 15 executes S143. On the other hand, if a special effect is to be added, the editor is required to select a special effect to be applied (S151). Next, the data editing unit 15 requests the editor to select animation data to which the special effect should be applied (S152). Next, when there are parameters to be set for the special effect to be applied, the data editing unit 15 requests the parameters from the editor (S153). The parameters are, for example, the color, shape, and direction of the special effect. Next, the data editing unit 15 requests the editor for the start time for applying the special effect (S154). Next, the data editing unit 15 requests the editor for the end time for applying the special effect (S155). Next, the data editing unit 15 performs the processing of S159, that is, creates editing data based on each input data. Then, the data editing unit 15 returns to the processing of S141.

On the other hand, in S143, the data editing unit 15 determines whether the edited content is a cut of the image. When the result of the judgment is not the cut of the image, the data editing unit 15 executes S144, and if it is the cut of the image, after performing the cut and copy processing of the image, executes S159 (S157).

Next, in S144, the data editing unit 15 determines whether the edited content is an image paste. When it is determined that the result is not the pasting of the image, the data editing unit 15 executes S145, and if it is the cut of the image, after the pasting process of the image is executed, S159 is executed (S157).

Next, in S145, the data editing unit 15 determines whether the edited content is the rearrangement of the images. When the result of the judgment is not the rearrangement of the images, the data editing unit 15 executes S146. If it is the rearrangement of the images, the rearrangement of the images is being performed. After the processing, S159 (S158) is executed.

Next, in S146, the data editing unit 15 determines whether the instructed content is the end of the animation editing operation. When the result of the determination is that the additional operation ends, the data editing unit 15 returns to the main routine (S147), and if not, returns to S141.

Next, the procedure for adding the primary conversion table will be described.

Fig. 9 is a flowchart of the primary conversion table addition procedure in the first embodiment.

In FIG. 9, the primary conversion table addition processing unit 19 reads the primary conversion table from the primary conversion table storage unit 22 (S161).

Next, the primary conversion table addition processing unit 19 checks whether the read primary conversion table is complete (S162). When incomplete, the primary conversion table addition processing unit 19 outputs an error (S168), and returns to the processing of S167, that is, returns to the main routine. On the other hand, if it is complete, the process of S163 is performed.

Here, the incomplete primary conversion table includes, for example, a normalized special effect in which a special effect has not been assigned to substitute even though the image data is edited using a certain special effect.

Next, the primary conversion table addition processing unit 19 converts the primary conversion table into the same data format as the animation data. For example, when the animation data is in the QT format, a data atom is created from the actual data of the primary conversion table, and a resource atom that manages the data atom is created.

Next, the primary conversion table addition processing unit 19 reads the edited animation data from the edited data storage unit 16 (S164).

Next, the primary conversion table addition processing unit 19 requests the editor to specify the range of animation data for validating the primary conversion table via the operation unit 18 (S165).

The effective range applicable to the primary conversion table is specified, for example, when QT is used, it is specified by providing information to the edit list atom and the time-to-sample atom.

Next, the primary conversion table addition processing unit 19 adds a primary conversion table with a corresponding data format to the animation data, stores it in the edited data storage unit 16 (S166), and returns to the main routine (S167).

Next, the data output procedure will be explained.

Fig. 10 is a flowchart of the data output program of the first embodiment.

In FIG. 10, the data output unit 20 reads in image data from the edited data storage unit 16 (S171).

Next, the data output unit 20 determines whether or not a primary conversion table is added to the image data. When the primary conversion table is added, S173 is executed. If the primary conversion table is not added, the primary conversion table is required to be added (S179), and the process of S178 is returned, that is, the main routine is returned.

In S173, the data output unit 20 requests the editor to designate an output destination of the image data, as the output destination, for example, there is a disk medium or a file on a hard disk.

Next, the data output unit 20 determines whether or not the image data is in an external reference format (S174). When it becomes the external reference format, the data output unit 20 performs the processing of S175, and if it is not the external reference format but the format contained in itself, it directly outputs the data (S177).

In S175, the data output unit 20 determines whether the editor has permitted the conversion of the image data. If the result of the judgment is approved, the data output unit 20 converts the image data and outputs it (S176, S177), and if it is not approved, outputs the data directly (S177).

Here, the conversion of image data is, for example, converted from an external reference format to a format contained within itself.

Then, the data output unit 20 returns the processing to the main routine (S178).

In this way, the image data to which a special effect is applied by the editing device is structured as shown in FIG. 11 in the case of the QT file format, for example.

Fig. 11 is a diagram showing a configuration example of image data.

In FIG. 11, the image data is in the file format of QT, and its structure includes a data atom 152 for storing real data and a resource atom 151 for managing the data atom 152.

The data atom 152 is in the QT format, and its structure includes real data of primary conversion table data 166, video data 167, audio data 168, and special effect data 169.

The resource atom 151 is in the QT format, and its structure includes each track atom (track atom (primary conversion table) 161, track atom (video) 162, and track atom (audio) that cooperate with the real data of the data atom to manage each real data. 163 and orbital atoms (special effects) 164). In addition, in order to distinguish the type of data managed by each atom, each orbit atom has, for example, a flag. For example, when the flag is 1, it means that the data is a primary conversion table; when the flag is 2, it means that the data is image data 122; when the flag is 3, it means that the data is special effect instruction data 123.

Moreover, the image data is either transmitted on a transmission line or recorded on a recording medium, and then provided to the playback device.

Next, the playback device will be explained.

Fig. 12 is a block diagram showing the structure of the reproducing apparatus of this embodiment.

In FIG. 12, the structure of the playback device includes an input data interface 101, an input data analysis unit 102, a primary conversion table storage unit 103, a secondary conversion table storage unit 104, a special effect instruction storage unit 105, and a primary conversion unit 106 , The secondary conversion unit 107, the image data decoding unit 108, the first image memory 109, the second image memory 110, the special effect processing unit 111, the image output unit 112, and the control circuit 113. Each part is composed of electronic circuits.

The input data interface 101 is a device that reads out data recorded on a recording medium such as a CD-ROM or a DVD and outputs it to the data analysis unit 102. For example, it is a CD-ROM drive or a DVD drive.

The input data analysis unit 102 is a circuit that discriminates input data based on the content of the data, and is connected to the primary conversion unit 103, the special effect instruction storage unit 105, and the image data decoding unit 108, respectively.

The primary conversion table storage unit 103 is an erasable read-only memory such as an EEPROM, and is connected to the primary conversion unit 106.

The special effect instruction storage unit 105 is a storage device that stores data, such as a RAM, and is connected to the primary conversion unit 106 and the special effect processing unit 111.

The image data decoding unit 108 is a circuit that decodes input image data, and is connected to the first image memory 109 and the second image memory 110.

The first image memory 109 and the second image memory 110 are memories that are connected to the special effect processing unit 111 and respectively store images processed by the special effect processing unit 111 (images to be synthesized).

On the other hand, the primary conversion unit 106 analyzes the special effect instruction data based on the installation status of the special effects in the playback device and the primary conversion table. The primary conversion unit 106 is connected to the secondary conversion unit 107 and the special effect processing unit 111.

The secondary conversion table storage unit 104 is an erasable read-only memory such as an EEPROM, and is connected to the secondary conversion unit 107.

The secondary conversion unit 107 analyzes the output of the primary conversion unit 106 based on the installation status of the special effects in the playback device and the secondary conversion table. The secondary conversion unit 107 is connected to the special effect processing unit 111.

The special effect processing unit 111 applies a special effect to the image data according to the special effect instruction data, and outputs it to the image output unit 112.

The image output unit 112 converts the image data to which the special effect is applied into a signal suitable for the display device and outputs it.

Furthermore, these input data interface 101, input data analysis unit 102, primary conversion table storage unit 103, secondary conversion table storage unit 104, special effect instruction storage unit 105, primary conversion unit 106, secondary conversion unit 107, image The data decoding unit 108, the first image memory 109, the second image memory 110, the special effect processing unit 111, and the image output unit 112 control their operations by the control circuit 113.

Next, the operation of the playback device will be described.

Fig. 13 is a flowchart showing the operation of the reproducing device.

In FIG. 13, the control circuit 113 reads in image data via the input interface 101 (S201).

Next, the control circuit 113 analyzes the image data using the input data analysis unit 102 (S202).

For example, when the input data analysis unit 102 determines that the above-mentioned flag Madaha flag is 1, it outputs the data to the primary conversion table storage unit 103 (S203). Then, the primary conversion table storage unit 103 stores the data (S204).

In addition, when the flag is 2, the input data analysis unit 102 outputs the data to the image data decoding unit 108 (S205). The image data decoding unit 108 decodes the data (S206).

Furthermore, when the flag is 3, the input data analysis unit 102 outputs the data to the special effect instruction storage unit 105 (S207). The special effect instruction storage unit 105 stores the data.

Next, the control circuit 113 uses the primary conversion unit 106 to analyze the special effect instruction data. The primary conversion unit 106 judges whether the special effect to be applied is installed in the playback device (S208). If the result of the judgment is that it has been installed, a special effect is selected (S212). On the other hand, if it has not been installed, the primary conversion unit 106 refers to the primary conversion table of the primary conversion table storage unit 103 to convert the original special effect into the corresponding substitute special effect (primary conversion special effect) (S209).

Next, the control circuit 113 uses the primary conversion unit 106 to analyze the primary conversion special effect. Change the special effect once. The primary conversion unit 106 determines whether the primary conversion special effect to be applied is installed in the playback device (S210). If the result of the judgment is that it has been installed, a special effect is selected (S212). On the other hand, if it has not been installed, the primary conversion unit 106 outputs the primary conversion special effect to the secondary conversion unit 107.

Next, the secondary conversion unit 107 refers to the secondary conversion table of the secondary conversion table storage unit 104 to convert the primary conversion special effect into the corresponding mounted special effect (secondary conversion special effect) (S211), and executes S212.

Here, the secondary conversion table will be described.

Fig. 14 is a diagram showing an example of a secondary conversion table in the first embodiment.

The secondary conversion table is the special effect applied to a certain image (original special effect) and the special effect used as a substitute for the special effect when the device that reproduces the image is not installed, that is, the special effect installed by the replay device (installed Special effects) correspondence table. The secondary conversion table is the standard equipment of the playback device as a prescribed value table.

For example, in the playback device of the first embodiment, as a special effect of the installation, there are strip erase from top to bottom, top left block erase, top right block erase, and rectangular Elis eraser as a special effect of the installation. except.

At this time, in Fig. 14, referring to Fig. 2, when the original special effect is strip erasing from left to right, because it has not been installed, the strip erasing from top to bottom is used as the installed special effect instead. The special effect is when the strip from the top to the bottom is erased, because it has been installed, the strip from the top to the bottom is selected as the installed special effect. When the original special effect is the block erase from the top left, it is installed, so choose the left The top block erase is a special effect installed. When the original special effect is the right top block erase, because it has been installed, the right top block erase is selected as the installed special effect. When the original special effect is the left bottom block erase , Because it has not been installed, use the top left block erase as the installed special effect instead. When the original special effect is the bottom right block erase, because it has not been installed, use the top right block erase as the installed special effect instead , When the original special effect is Rectangular Ellis Wipe, because it has been installed, choose Rectangular Ellis Wipe as the installed special effect. When the original special effect is Diamond Ellis Wipe, because it has not been installed, rectangular Ellis is used. Reese erasing is used as a special effect to replace it. Of course, the second conversion is performed after the first conversion, so the original special effect in the second conversion table is the standard special effect.

Next, the control circuit 113 judges whether the image data and the special effect instruction data (original special effect, 1st conversion special effect, or 2nd conversion special effect) to be processed at the same time are ready (S213).

When the judgment result is that the image data and the special effect instruction data are not aligned, S201 to S213 are repeated until they are all aligned. If the data is all in place, the special effect processing unit 111 applies a special effect to the image data, and then outputs it to the image output unit 112. The image output unit 112 adapts to a display device (not shown) to output an image signal, the image to which the special effect is applied is reproduced on the display device, and the process returns to S201 (S214).

In this way, in the first embodiment, no matter what special effect the editor uses, it is converted into a standard special effect using the primary conversion table, so that the playback device can recognize the special effect the editor wants. In addition, the reproducing apparatus of the first embodiment uses the secondary conversion table to convert into the installed special effect, so it is possible to reproduce the image while executing at least the special effect installed in the reproducing apparatus.

In addition, in the above description, the primary conversion table is one primary conversion table for a series of image data, but it is also possible to switch each predetermined section of the image data by having multiple primary conversion tables. .

FIG. 15 is a diagram showing an example of image data having a plurality of primary conversion tables.

In FIG. 15, the time axis, image data, special effect designation data, and primary conversion table data are shown from the top. In this way, there is a series of image data with the progress of time, and special effects-1, special effects-2, special effects-3, special effects-4, and special effects-5 are respectively designated for the spare part of the image data. In addition, the first primary conversion table (Tb1-1) is designated to be used in the range of special effect-1 to special effect-3, and the second primary conversion table (Tb1-2) is designated to be used in special effect-4 And special effects are used within the range of -5. In the case of a QT file format, for example, the designation can be performed by describing each effective range of the primary conversion table as an edit list atom and a sample to time atom.

At this time, for Special Effect-1 to Special Effect-3, the first primary conversion table (Tb1-1) is used, and for Special Effect-4 and Special Effect-5, the second primary conversion table (Tb1- 2).

In this way, by preparing multiple primary conversion tables for a series of image data, different alternative special effects can be given to the same original special effect, and suitable special effects can be used according to the content of the image.

Next, the data conversion device will be described as a modification of the editing device.

Above, an editing device that can perform editing operations such as applying special effects and attaching a primary conversion table is described, but this data conversion device only attaches a primary conversion table to image data in a form that can perform non-destructive editing for applying special effects.ofOn the device. On the device.

Fig. 16 is a block diagram showing the structure of a data conversion device.

In FIG. 16, the structure of the data conversion device includes a data input unit 11, an input data storage unit 12, an operation unit 18, a primary conversion table addition processing unit 19, a data output unit 20, and a primary conversion table editing unit 21, 1 The secondary conversion table storage unit 22 and the primary conversion table display unit 23.

The operation unit 18 is connected to the data input unit 11, the primary conversion table addition processing unit 19, and the primary conversion table editing unit 21, respectively. The data input unit 11 is connected to the input data storage unit 12 and the primary conversion table storage unit 22. The input data storage unit 12 is connected to the primary conversion table addition processing unit 19. The primary conversion table editing unit 21 is connected to the primary conversion table storage unit 22. The primary conversion table storage unit 22 is connected to the primary conversion table addition processing unit 19 and the primary conversion table display unit 23, respectively. The primary conversion table addition processing unit 19 is connected to the data output unit 20. Here, the operation of each part is the same as the operation of each part in the editing device described using FIG. 1, so the description thereof will be omitted.

(Second Embodiment) The first embodiment uses the primary conversion table and the secondary conversion table to convert the original special effect into the primary conversion special effect and then into the secondary conversion special effect in a fixed one-to-one correspondence. 2 The implementation form is an implementation form in which special effects are divided into layers according to their types, and the original special effects are flexibly transformed into a primary transformation special effect and then into a secondary transformation special effect according to the actual installation state.

Since the editing device of the second embodiment is the same as that of the first embodiment, its description is omitted.

In addition, the reproducing apparatus of the second embodiment is the same as that of the first embodiment except that the operations of the primary conversion unit 106 and the secondary conversion unit 107 are different, so that the description thereof will be omitted.

Fig. 17 is a diagram showing an example of special effects classified by level according to the second embodiment.

Fig. 18 is a diagram showing an example of a primary conversion table with a hierarchical structure in the second embodiment.

Fig. 19 is a diagram showing an example of a secondary conversion table with a hierarchical structure in the second embodiment.

In FIG. 17, in this example, as the uppermost concept level, special effects can be classified into filtering (Filter) and transformation (Transition). The next level of transformation can be classified into erasure and smooth transition (Cross Fade) and so on. The next level of erasure can be classified into Edge Wipe and Iris Wipe. In addition, the next level such as smooth transition is omitted in FIG. 17. The next level of edge erasing can be classified into strip erasing and block erasing. The next level of bar erasing can be classified into left to right and top to bottom. The next level of block erasure can be classified into top left, top right, bottom left, and bottom right. The next level of Iris erasure can be classified into Iris erasure and so on. The next level of Iris erasure can be classified into rectangles and diamonds.

On the other hand, the next level of filtering can be classified into color changes and image quality changes. The color change of the next level can be classified into gray scale and so on. The next level of image quality transformation can be classified into sharpness and so on. Also, the next level of grayscale and sharpness is omitted in Figure 17. Among such special effects classified in a hierarchical structure, the substitution special effect of the primary conversion table can be designated as a certain layer (Type) or the next layer (Subtype) of the layer.

In Figure 18, for example, when the editor specifies the strip erase from the top to the bottom as the original special effect, because the strip erase is the next layer from the top to the bottom, as an alternative special effect, you can specify the upper strip erase (Type=BarWipe) and the bottom layer from top to bottom (Subtype=TopToBottom). In addition, for example, when the editor specifies the top left of the block erase as the original special effect, because the top left is the next layer of the block erase, as an alternative special effect, you can specify the upper block erase (Type=BoxWipe) And the top left of the lower layer (Subtype=TopLeft). In addition, for example, when the editor specifies the BoxWipe TopCenter as the original special effect, the top center is not the standard special effect but is the next layer of the block erase, so as an alternative special effect, you can specify The block erase (Type=BoxWipe) of the upper layer and the top left of the lower layer (Subtype=TopLeft). In addition, for example, when the editor designates the left part of the rectangular wipe as the original special effect, as an alternative special effect, the Iris Wipe (Type=IrisWipe) of the upper layer special effect can be designated, and the lower layer (Subtype=-) is omitted. You can use any of the lower special effects belonging to the upper layer instead. In this way, you can specify only the upper layer special effects and omit the lower layer special effects.

Moreover, when the original special effect is represented by a hierarchical structure and there is no actual special effect corresponding to the original special effect, the secondary conversion table traces the upper special effect of the original special effect until there is a corresponding installed special effect. Therefore, the installed special effect corresponding to the original special effect at the top of the secondary conversion table must be allocated.

In the playback device of the second embodiment, as a special effect of the implementation, under erasing, strip erasing from left to right, block erasing at the top left, block erasing at the top right, and smooth conversion are installed.

At this time, in Figure 19, referring to Figure 17, when the original special effect is a transformation, as the installed special effect, the designated strip is erased from left to right, when the original special effect is strip erase from left to right , Because it has been installed, it will be erased from left to right as the installation special effect selection bar. When the original special effect is block erasure, because it has not been installed, it is replaced by the block erasure at the top left as the installation special effect. When the original special effect is the top left of the block erase, because it has been installed, the block erase at the top left is selected as the installed special effect. When the original special effect is the top right of the block erase, it is installed because it is installed. For the installed special effect, select the block erase at the top right. When the original special effect is Iris erase, it has not been installed, so it is replaced by smooth transition as the installed special effect. When the original special effect is Iris erase rectangle , Because it has not been installed yet, it is replaced by NoEffect as the installed special effect.

In addition, when the original special effect is smooth conversion, because it has been installed, select smooth conversion as the installed special effect. When the original special effect is grayscale of color conversion, because it has been installed, select color conversion as the installed special effect When the original special effect is the sharpness of the image quality transformation, it has not been installed, so it is replaced by no special effect as the installed special effect.

On the other hand, when the original special effects are edge erasing, strip erasing, top to bottom strip erasing, bottom left block erasing, bottom right block erasing, diamond Ellis erasing, color transformation and image quality When changing, no special effects are specified. By using the original special effects in the secondary conversion table as a component layer structure, as will be described later, it can be replaced by the actual special effects of the upper layer.

The layered structure of the original special effects in the secondary conversion table is the uppermost special effect, and the lower layer has transformation and filtering. The next layer of transformation is erasure and smooth transformation. The next layer of erasure is edge erasure and Iris erasure. The next layer of edge erase is strip erase and block erase. Moreover, the next layer of strip erase has left to right and top to bottom, and the next layer of block erase has left top, right top, left bottom, and right bottom. On the other hand, the next layer Iris erased is Iris erase, and the lower layer has rectangles and diamonds.

Moreover, the next layer of filtering has color transformation and image quality transformation, the next layer of color transformation has grayscale, and the next layer of image quality transformation has sharpness. That is, the input side of the secondary conversion table shown in FIG. 19 is the same as the hierarchical structure of the standard special effects shown in FIG. 17.

Next, the operation of the reproducing apparatus of the second embodiment will be described. Since the operation except for S211 shown in FIG. 13 is the same as that of the first embodiment, the description thereof will be omitted. Next, the operation of the secondary conversion unit 107 in the second embodiment corresponding to S211 will be described.

Fig. 20 is a flowchart showing the operation of the secondary conversion unit in the second embodiment.

In FIG. 20, the secondary conversion unit 107 retrieves the primary conversion special effect output from the primary conversion unit 106 from the secondary conversion table (FIG. 19) stored in the secondary conversion table storage unit 104 (S301).

Next, the secondary conversion unit 107 refers to the implemented special effect corresponding to the primary conversion special effect (S302).

Next, as a result of the reference, the secondary conversion unit 107 judges whether or not an implementation special effect is designated (S303).

When the result of the judgment is "-", that is, when the special effect to be implemented is not specified, the secondary conversion unit 107 selects the layer above the primary conversion special effect and uses it as a new primary conversion special effect (S305).

On the other hand, when the judgment result is that the installed special effect is specified, the secondary conversion unit 107 selects the corresponding installed special effect as the secondary conversion special effect (S304), and then performs the processing after S212 shown in FIG. 13 .

More specifically, the operation of the secondary conversion unit 107 will be described.

For example, when the original special effect is Iris Erase, because the smooth transition is designated as the corresponding installation special effect, Iris Erase is directly transformed into smooth conversion twice.

In addition, for example, when the original special effect is erased from the top to the bottom bar, since the corresponding installed special effect is'-' and is not installed, the reference is to the upper bar that is erased from the top to the bottom bar. Erase the corresponding real-installed special effects. As a result of the reference, since the mounting special effect corresponding to the strip erasing is also'-' and not installed, the mounting special effect corresponding to the edge erasing of the upper layer of the strip erasing is further referred to. As a result of the reference, since the mounting special effect corresponding to the edge erasing is also "-" and is not installed, the mounting special effect corresponding to the erasing of the upper layer of the edge erasing is further referred to. As a result of the reference, since the mounted special effect corresponding to erasure is also "-" and is not installed, it is further referred to the mounted special effect corresponding to the conversion of the upper layer of erasure. As a result of the reference, since the left-to-right stripe erasing is designated as the mounted special effect corresponding to the conversion, the left-to-right stripe erasing is converted twice to the left-to-right stripe erasing.

In this way, in the reproducing apparatus of the second embodiment, the editor uses the primary conversion table and the secondary conversion table to convert the special effects originally intended when necessary. Therefore, the image can be reproduced with the special effects implemented in the reproducing apparatus. data. Furthermore, in the playback device of the second embodiment, since the primary conversion table and the secondary conversion table use a hierarchical structure in which special effects are classified into layers, it is not necessary to assign standard special effects to all original special effects. Furthermore, there is no need to assign standard special effects instead of special effects. Therefore, editors can flexibly assign standard special effects, and designers of playback devices, etc. can flexibly assign alternative special effects.

In addition, in the first and second embodiments, the erasure example was given as the special effect, but it is not limited to this, and any special effect can be applied.

In addition, in the first and second embodiments, special effects have been described, but the present invention can also be applied to fonts. That is, the standard font is defined, and the primary conversion table that converts a certain original font into the standard font and the secondary conversion table that replaces the standard font with the font installed on the playback device is used regardless of the originally designated font. Regardless of the type and size, the playback device can replay and display text data.

As described above, in the present invention, the edited image data has a primary conversion table that converts the edited code into a standard editing type standardized as a general specification. Therefore, it is not necessary to consider the implementation of a reproducing device that reproduces the edited image data. The type of editing installed, and the use of various editing types to edit the original image data.

In addition, in the present invention, it is not necessary to create edited image data corresponding to the model of the playback device. Therefore, the cost of distribution and circulation of edited image data can be reduced.

Furthermore, in the present invention, even if the editing type intended by the editor is not installed in the playback device, it can be converted to the standard editing type using the primary conversion table.

Furthermore, even if the type of standard editing after the primary conversion is not installed on the playback device, the secondary conversion table can be used to convert it twice to the type of real-installed editing. Therefore, it goes without saying that all editing types are of course, and even the standard editing type playback device does not need to be installed, and the actual editing types can be flexibly determined.