Optical disk reproducing device and method therefor
Abstract
[Task] Provided is a playback device capable of reproducing a partial section with high time accuracy on an optical disk on which original PGC information, user-defined PGC information, and a video object are recorded.
Solution.The playback device includes a reading means for reading the video object unit and PGC information constituting the video object from the optical disc, a decoding means for decoding the read video object unit, and a display means for displaying the picture obtained by the decoding. It is provided with a reading means, a decoding means, and a control means for controlling the display means so as to decode by the boundary of the video object unit and start / end the playback display by the time boundary.

Term
Term ended
Projected expiry passed 17 September 2018, 8 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
9 claims: 3 independent, 6 dependent
- 1【特許請求の範囲】 【請求項1】 光ディスクに記録されたビデオブジェクトを再生する装置であって、 前記光ディスクは、 1つ以上のビデオオブジェクトと1つ以上の当該ビデオオブジェクトの再生順序を示す第1及び第2プログラムチェーン情報とが記録される光ディスクであって、 前記第1プログラムチェーン情報は、前記ビデオオブジェクトの再生対象となる全区間を特定する情報であり、前記ビデオオブジェクトの全区間又は部分区間を第1セルとして特定する第1セル情報を1つ以上含むと共に、1つ以上の当該第1セルの再生順序を示し、 前記第2プログラムチェーン情報は、前記第1プログラムチェーン情報によって特定される全再生区間の中からユーザにより定義された再生区間を特定する情報であり、所定の前記第1セル情報が示す区間に対し、さらに、その全区間又は部分区間を第2セルとして特定する第2セル情報を1つ以上含むと共に、1つ以上の当該第2セルの再生順序を示し、 前記第1セル情報は、ビデオオブジェクトの識別情報、再生時における表示開始時刻及び表示終了時刻によって前記第1セルを特定し、 前記第2セル情報は、ビデオオブジェクトの識別情報、再生時における表示開始時刻及び表示終了時刻によって前記第2セルを特定しており、 前記ビデオオブジェクトは、連続する複数のフィールドに表示する複数のピクチャを含む独立再生可能な圧縮された単位データである複数のビデオオブジェクトユニットが再生順序に従って並べられたものであり、 前記再生装置は、 前記光ディスクから前記ビデオオブジェクトユニット及び前記プログラムチェーン情報を読み出す読み出し手段と、 読み出されたビデオオブジェクトユニットをデコードするデコード手段と、 デコードによって得られたピクチャを表示する表示手段と、 前記読み出し手段、前記デコード手段及び前記表示手段を制御する制御手段とを備え、 前記制御手段は、 前記第1及び第2プログラムチェーン情報の中から1つのプログラムチェーン情報を選択する旨の指示を受け付け、 選択されたプログラムチェーン情報に含まれる第1又は第2セル情報及び当該プログラムチェーン情報が示す再生順序に基づいて、対応する第1セル又は第2セルを含むビデオオブジェクトユニット列を前記光ディスクから順次読み出し、ビデオオブジェクトユニットの単位でデコードするよう前記読み出し手段及び前記デコード手段を制御し、 デコードによって得られたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示開始時刻に対応するフィールドのピクチャから表示を開始するよう前記表示手段を制御することを特徴とする再生装置。
- 2【請求項2】 前記制御手段はさらに、デコードによって得られたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示終了時刻に対応するフィールドのピクチャで表示を終了するよう前記表示手段を制御することを特徴とする請求項1記載の再生装置。
- 3【請求項3】 前記デコード手段は、前記デコードによって得られた全てのピクチャを前記表示手段に出力し、 前記表示手段は、前記デコード手段から出力されてくるピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示開始時刻から表示終了時刻の時間区間に属するフィールドのピクチャを表示出力し、当該区間に属なさないフィールドの表示出力を禁止することを特徴とする請求項2記載の再生装置。
- 4【請求項4】 光ディスクに記録されたビデオブジェクトを再生する光ディスク再生装置における前記ビデオオブジェクトの再生方法であって、 前記光ディスクは、 1つ以上のビデオオブジェクトと1つ以上の当該ビデオオブジェクトの再生順序を示す第1及び第2プログラムチェーン情報とが記録される光ディスクであって、 前記第1プログラムチェーン情報は、前記ビデオオブジェクトの再生対象となる全区間を特定する情報であり、前記ビデオオブジェクトの全区間又は部分区間を第1セルとして特定する第1セル情報を1つ以上含むと共に、1つ以上の当該第1セルの再生順序を示し、 前記第2プログラムチェーン情報は、前記第1プログラムチェーン情報によって特定される全再生区間の中からユーザにより定義された再生区間を特定する情報であり、所定の前記第1セル情報が示す区間に対し、さらに、その全区間又は部分区間を第2セルとして特定する第2セル情報を1つ以上含むと共に、1つ以上の当該第2セルの再生順序を示し、 前記第1セル情報は、ビデオオブジェクトの識別情報、再生時における表示開始時刻及び表示終了時刻によって前記第1セルを特定し、 前記第2セル情報は、ビデオオブジェクトの識別情報、再生時における表示開始時刻及び表示終了時刻によって前記第2セルを特定しており、 前記ビデオオブジェクトは、連続する複数のフィールドに表示する複数のピクチャを含む独立再生可能な圧縮された単位データである複数のビデオオブジェクトユニットが再生順序に従って並べられたものであり、 前記光ディスク再生装置は、 前記光ディスクから前記ビデオオブジェクトユニット及び前記プログラムチェーン情報を読み出す読み出し手段と、 読み出されたビデオオブジェクトユニットをデコードするデコード手段と、 デコードによって得られたピクチャを表示する表示手段とを備え、 前記再生方法は、 前記第1及び第2プログラムチェーン情報の中から1つのプログラムチェーン情報を選択する旨の指示を受け付けるステップと、 選択されたプログラムチェーン情報に含まれる第1又は第2セル情報及び当該プログラムチェーン情報が示す再生順序に基づいて、対応する第1セル又は第2セルを含むビデオオブジェクトユニット列を前記光ディスクから順次読み出し、ビデオオブジェクトユニットの単位でデコードするよう前記読み出し手段及び前記デコード手段を制御するデコード制御ステップと、 デコードによって得られたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示開始時刻に対応するフィールドのピクチャから表示を開始するよう前記表示手段を制御する表示制御ステップとを含むことを特徴とする再生方法。
- 5【請求項5】 前記表示制御ステップでは、デコードによって得られたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示終了時刻に対応するフィールドのピクチャで表示を終了するよう前記表示手段を制御するサブステップを含むことを特徴とする請求項4記載の再生方法。
- 6【請求項6】 前記デコード制御ステップでは、前記デコード手段でのデコードによって得られた全てのピクチャが前記表示手段に出力されるよう前記デコード手段を制御し、 前記表示制御ステップでは、前記デコード手段から前記表示手段に出力されたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示開始時刻から表示終了時刻の時間区間に属するフィールドのピクチャを表示出力し、当該区間に属なさないフィールドの表示出力を禁止するよう前記表示手段を制御することを特徴とする請求項5記載の再生方法。
- 7【請求項7】 光ディスクに記録されたビデオブジェクトを再生する光ディスク再生装置のためのプログラムを記録したコンピュータ読み取り可能な記録媒体であって、 前記光ディスクは、 1つ以上のビデオオブジェクトと1つ以上の当該ビデオオブジェクトの再生順序を示す第1及び第2プログラムチェーン情報とが記録される光ディスクであって、 前記第1プログラムチェーン情報は、前記ビデオオブジェクトの再生対象となる全区間を特定する情報であり、前記ビデオオブジェクトの全区間又は部分区間を第1セルとして特定する第1セル情報を1つ以上含むと共に、1つ以上の当該第1セルの再生順序を示し、 前記第2プログラムチェーン情報は、前記第1プログラムチェーン情報によって特定される全再生区間の中からユーザにより定義された再生区間を特定する情報であり、所定の前記第1セル情報が示す区間に対し、さらに、その全区間又は部分区間を第2セルとして特定する第2セル情報を1つ以上含むと共に、1つ以上の当該第2セルの再生順序を示し、 前記第1セル情報は、ビデオオブジェクトの識別情報、再生時における表示開始時刻及び表示終了時刻によって前記第1セルを特定し、 前記第2セル情報は、ビデオオブジェクトの識別情報、再生時における表示開始時刻及び表示終了時刻によって前記第2セルを特定しており、 前記ビデオオブジェクトは、連続する複数のフィールドに表示する複数のピクチャを含む独立再生可能な圧縮された単位データである複数のビデオオブジェクトユニットが再生順序に従って並べられたものであり、 前記光ディスク再生装置は、 前記光ディスクから前記ビデオオブジェクトユニット及び前記プログラムチェーン情報を読み出す読み出し手段と、 読み出されたビデオオブジェクトユニットをデコードするデコード手段と、 デコードによって得られたピクチャを表示する表示手段とを備え、 前記プログラムは、 前記第1及び第2プログラムチェーン情報の中から1つのプログラムチェーン情報を選択する旨の指示を受け付けるステップと、 選択されたプログラムチェーン情報に含まれる第1又は第2セル情報及び当該プログラムチェーン情報が示す再生順序に基づいて、対応する第1セル又は第2セルを含むビデオオブジェクトユニット列を前記光ディスクから順次読み出し、ビデオオブジェクトユニットの単位でデコードするよう前記読み出し手段及び前記デコード手段を制御するデコード制御ステップと、 デコードによって得られたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示開始時刻に対応するフィールドのピクチャから表示を開始するよう前記表示手段を制御する表示制御ステップとを含むことを特徴とする記録媒体。
- 8【請求項8】 前記表示制御ステップでは、デコードによって得られたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示終了時刻に対応するフィールドのピクチャで表示を終了するよう前記表示手段を制御するサブステップを含むことを特徴とする請求項7記載の記録媒体。
- 9【請求項9】 前記デコード制御ステップでは、前記デコード手段でのデコードによって得られた全てのピクチャが前記表示手段に出力されるよう前記デコード手段を制御し、 前記表示制御ステップでは、前記デコード手段から前記表示手段に出力されたピクチャに対して、対応する前記第1又は第2セル情報に含まれる表示開始時刻から表示終了時刻の時間区間に属するフィールドのピクチャを表示出力し、当該区間に属なさないフィールドの表示出力を禁止するよう前記表示手段を制御することを特徴とする請求項8記載の記録媒体。
Independent claims9
1,114 paragraphs in 2 sections, as filed
Description: TECHNICAL FIELD [Detailed description of the invention]
【0001】
[Technical field to which the invention belongs]
The present invention relates to an optical disc reproduction device, a method thereof, and the like.
【0002】
[Conventional technology]
Video editing technicians who are active in the movie industry, broadcasting industry, etc. make full use of their skillful skills to produce various elaborate video works and send them out to the world. Movie lovers and video camera enthusiasts who are fascinated by these things and have a strong admiration have a desire to challenge video editing at least once, even if they do not reach their skills, and advanced video editing. We hope that consumer equipment for video data editing equipment that can be easily performed will be developed at an early stage.
【0003】
There are various kinds of work generally called video editing, but the consumer equipment of video data editing equipment that will be developed in the future has a function to connect many scenes into one video, so-called scenes. It is considered that the enhancement of the connection function is particularly required. Conventionally, scene connection work using consumer equipment has been performed using a dubbing system in which two VCRs are connected. Hereinafter, in the dubbing system, how the work of connecting arbitrary scenes in the video has been performed will be described. FIG. 96 (a) is a diagram showing a work environment for video editing using a video deck capable of playing / recording an existing video signal. As shown in Fig. 96 (a), the working environment is to play back a magnetic tape cassette 301 on which the video material is recorded, an empty magnetic tape cassette 302 for recording the edited product, and these magnetic tape cassettes. It consists of video decks 303 and 304 for recording. In such a work environment, the operator is trying to connect the scenes shown in FIG. 96 (b). FIG. 96 (b) is a diagram showing the relationship between the edited material and the edited product. As shown in this figure, the operator occupies the scene 505 occupying the time t5 to the time t10, the scene 506 occupying the time t13 to the time t21, and the time t23 to the time t25 in the editing material. We are trying to partially reproduce scene 507 to obtain an edited product consisting of only these.
【0004】
In such a working environment, the operator sets the magnetic tape cassette 301 on which the editing material is recorded on the video deck 303, and sets the magnetic tape cassette 302 on which the editing product is to be recorded on the deck 304. After setting, press the fast-forward key on the operation panel of the deck 303 as shown in the figure to make the deck 303 start up to the beginning of the video scene 505, and then press the play key as shown after that. Have deck 303 play from video scene 505. At the same time, as shown at the same time, the recording key is pressed to cause the deck 304 to start recording the reproduced video. When the video playback is performed to the end of scene 505, the operation of the two decks is stopped. Then, the deck 304 is made to start up to the beginning of the video scene 506, and the playback of the deck 303 and the recording of the deck 304 are started at the same time. After performing the same work for scenes 506 and 507, the tapes on decks 303 and 304 are rewound to complete the editing work.
【0005】
If the above scene connection work can be easily performed at home, the images recorded on a large number of magnetic tape cassettes can be easily organized.
【0006】
[Problems to be Solved by the Invention]
The first problem of the above-mentioned prior art is that it is necessary to record the edited material and the edited product on separate recording media, so it is necessary to provide a video deck for playing / recording two magnetic tape cassettes. It is pointed out that the editing equipment will be large-scale. In this way, video editing can only be performed in a place where two VCRs are connected in advance, so the place where video editing can be performed is restricted.
【0007】
The second problem of the above-mentioned prior art is that when a scene connection is to be started, the start position of the scene to be connected is cueed, and the video as the editing material is reproduced from the start position to the end position of the scene. Since it is necessary to repeat the work as many as the number of scenes to be connected, the more scenes to be connected, the greater the time and effort required for cueing and the time and effort required for playback from the start position to the end position. The fact that a great deal of work time is spent is pointed out.
【0008】
When a professional video editing technician connects scenes, he does not create the final editing product suddenly, but creates a sophisticated video work by reworking the order of connecting the scenes many times. However, in a work environment where a large amount of work time is spent on cueing and playback, it is not possible to rework the order of connecting scenes as expected.
【0009】
However, these problems can occur in a video editing environment using a magnetic tape as a recording medium, and are naturally improved in a video editing environment using a randomly accessible recording medium such as a hard disk or a phase change type optical disc. It seems like that. For example, if the editing material is recorded on an optical disc and the edited product is recorded on the same optical disc, video editing can be performed with one video data editing device using the optical disc as a recording medium, and the editing equipment can be used. It is expected to be a small one. However, when recording the edited material and recording the edited product on the same recording medium, the edited product to be recorded on the recording medium may overwrite the edited material. In this case, even if the operator later notices that the editing has failed, the editing material is overwritten as described above, so that it is virtually impossible to redo the editing.
【0010】
If the edited material is a valuable video recording a commemorative event such as a child's entrance ceremony, athletic meet, family trip, graduation ceremony, etc., such overwriting will cause the precious video to disappear. It would be impossible to even watch it, let alone edit it again. If the capacity of the recording medium is more than twice the length of the video to be edited, it seems that the edited material will not be overwritten. However, even a phase-changing optical disc called the latest recording medium has a capacity of 2.6 GByte on one side, and it cannot be said that a video having a time length of 2 hours or more can be recorded separately as an editing material and an editing product. .. Furthermore, if not only the final product but also the intermediate product of video editing is individually recorded on the recording medium and the optimum one is to be selected from these at a later date, the audiovisual data (video) to be recorded. The recording medium requires three or four times as much capacity as the data obtained by multiplexing data and acoustic data, and it is obvious that the capacity is insufficient for a single recording medium.
【0011】
The third problem of the above-mentioned prior art is that the subsections to be connected cannot be specified with high accuracy. That is, when performing concatenated editing as shown in FIG. 96 (a), since the play button and the record button of the two video decks must be pressed at the same time, the press of one of the play button-record button may be delayed. Or, if one of them is pressed quickly, there is a problem that a part different from the section to be connected and used is recorded as an editing product, or a part to be recorded as a partial section is missing. is there.
【0012】
An object of the present invention is an apparatus and a method for reproducing a video object recorded on an optical disc, which can realize video editing on a single recording medium without overwriting an existing video recorded on the recording medium. It is an object of the present invention to provide a reproduction device and a method thereof that can specify a partial section to be reproduced for which a video display is desired to be viewed with high time accuracy.
【0013】
[Means for solving problems]
In order to achieve the above object, the playback device according to the present invention is a device that reproduces a video object recorded on an optical disc, and the optical disc is composed of one or more video objects and one or more video objects. An optical disc on which first and second program chain information indicating a reproduction order is recorded, and the first program chain information is information for specifying an entire section to be reproduced of the video object, and the video object. The second program chain information includes one or more first cell information that specifies the entire section or a partial section of the first cell as the first cell, and indicates the reproduction order of one or more of the first cells. Information that specifies a playback section defined by the user from all playback sections specified by the chain information, and is a second section of the entire section or a partial section of the section indicated by the predetermined first cell information. It contains one or more second cell information to be specified as a cell, and indicates the playback order of one or more of the second cells. The first cell information includes identification information of a video object, display start time and display at the time of playback. The first cell is specified by the end time, the second cell information specifies the second cell by the identification information of the video object, the display start time and the display end time at the time of playback, and the video object is a video object. A plurality of video object units, which are independently playable compressed unit data including a plurality of pictures to be displayed in a plurality of continuous fields, are arranged according to a playback order, and the playback device is the video from the optical disc. A reading means for reading the object unit and the program chain information, a decoding means for decoding the read video object unit, a display means for displaying a picture obtained by decoding, the reading means, the decoding means, and the display. The control means includes a control means for controlling the means, and the control means receives an instruction to select one program chain information from the first and second program chain information.Based on the first or second cell information included in the selected program chain information and the playback order indicated by the program chain information, the video object unit sequence including the corresponding first cell or second cell is sequentially read from the optical disk. , The reading means and the decoding means are controlled so as to decode in units of video object units, and the picture obtained by decoding corresponds to the display start time included in the corresponding first or second cell information. It is characterized in that the display means is controlled so that the display starts from the picture in the field.
【0014】
Here, the control means further causes the display means to end the display of the picture obtained by decoding with the picture of the field corresponding to the display end time included in the corresponding first or second cell information. May be controlled. Further, the decoding means outputs all the pictures obtained by the decoding to the display means, and the display means corresponds to the first or second picture output from the decoding means. The picture of the field belonging to the time interval from the display start time to the display end time included in the cell information may be displayed and output, and the display output of the field not belonging to the section may be prohibited. That is, the playback device according to the present invention has a reading means for reading the video object unit and PGC information constituting the video object from the optical disc, a decoding means for decoding the read video object unit, and a picture obtained by decoding. It is characterized by including a display means for displaying, a reading means for decoding by the boundary of the video object unit, and a control means for controlling the reading means, the decoding means, and the display means so as to start / end the playback display at the time boundary.
【0015】
Further, in order to achieve the above object, the reproduction method according to the present invention is a reproduction method of the video object in an optical disk reproduction device for reproducing a video object recorded on an optical disk, and the optical disk reproduction device is the optical disk. The reproduction method includes a reading means for reading the video object unit and the program chain information from the video object unit, a decoding means for decoding the read video object unit, and a display means for displaying a picture obtained by the decoding. The step of accepting an instruction to select one program chain information from the first and second program chain information, the first or second cell information included in the selected program chain information, and the program chain information are Decoding control that controls the reading means and the decoding means so that the video object unit sequence including the corresponding first cell or second cell is sequentially read from the optical disk and decoded in units of the video object units based on the indicated playback order. A display control step for controlling the display means to start displaying the picture obtained by the step and the picture in the field corresponding to the display start time included in the corresponding first or second cell information. It is characterized by including and.
【0016】
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of a video data editing device and an optical disk used as a recording medium by the video data editing device will be described. If an attempt is made to explain the physical structure, the logical structure, the hardware configuration, and the functional configuration of the video data editing device in one embodiment, the explanation becomes extremely complicated. Therefore, the above contents are individually described in the four embodiments. It shall be explained.
【0017】
In the first embodiment, the physical structure of the optical disk and the hardware structure of the video data editing device will be described, and seamless connection between video objects will be described as a first basic example of video editing. In the second embodiment, seamless connection between subsections of video objects will be described as a second basic example. In the third embodiment, the functional configuration of the video data editing device will be described, and the procedure of video editing realized on the file system will be described.
【0018】
In the fourth embodiment, the data structure and the processing procedure of the video data editing device when realizing hierarchical video editing consisting of temporary editing and main editing using two types of program chains, user-defined PGC-original PGC. Give an explanation. (1-1) Physical structure of recordable optical disc FIG. 1 is a diagram showing the appearance of a DVD-RAM disc, which is a recordable optical disc. As shown in this figure, the DVD-RAM is loaded into the video data editing device while being housed in the cartridge 75. The cartridge 75 is intended to protect the recording surface of the DVD-RAM, and the DVD-RAM is accessed by opening and closing the shutter 76 when the cartridge 75 is stored.
【0019】
FIG. 2A is a diagram showing a recording area of a DVD-RAM disc, which is a recordable optical disc. As shown in the figure, the DVD-RAM disc has a read-in area on the innermost circumference, a read-out area on the outermost circumference, and a data area in between. In the lead-in area, a reference signal necessary for stabilizing the servo and an identification signal with other media are recorded when the optical pickup is accessed. In the lead-out area, the same reference signal as in the lead-in area is recorded. The data area is divided into sectors (2 kbytes), which is the smallest access unit. FIG. 2B is a diagram showing a cross section and a surface of a DVD-RAM with a sector header. As shown in the figure, one sector is composed of a pit row portion formed on the surface of a reflective film such as a metal thin film and a concave-convex shape portion.
【0020】
The pit row consists of 0.4 μm to 1.87 μm pits engraved to represent the sector address. The concave-convex shape portion is composed of a concave portion (called a groove) and a convex portion (called a land). Lands and grooves have recording marks on their surfaces, which are metal thin films that can undergo phase change. The phase change means that the state of the attached metal thin film changes into a crystalline state and an amorphous state by irradiation with a light beam. Data can be written in the concave-convex shape portion by using the phase change. In the MO disk, only the land part is for recording, while in the DVD-RAM, data can be recorded in the land part and the groove part as well. The realization of data recording in the groove section increases the recording density compared to MO. Error correction information for sectors is provided for each of 16 sectors. In this embodiment, a sector group (16 sectors) to which ECC (Error Correcting Code) is assigned is called an ECC block.
【0021】
Further, in DVD-RAM, a data area is divided into a plurality of zone areas in order to realize rotation control called Z-CLV (Zone-Constant Linear Velocity) at the time of recording / playback. FIG. 3A is a diagram showing a plurality of zone regions provided concentrically on the DVD-RAM. As shown in the figure, the DVD-RAM is divided into 24 zone areas from zone 0 to zone 23. Here, the zone area refers to a group of tracks accessed at the same angular velocity. In this embodiment, the one zone area includes 1888 tracks. The rotation angular velocity of the DVD-RAM is set for each zone area so that the zone on the inner peripheral side becomes faster, and is kept constant while the optical pickup accesses within one zone. This increases the recording density of the DVD-RAM and facilitates rotation control during recording / playback.
【0022】
FIG. 3 (b) is an explanatory diagram in which the lead-in region, the lead-out region, and the zone regions 0 to 23 shown concentrically in FIG. 3 (a) are arranged in the horizontal direction. The lead-in area and the lead-out area have a defect management area (DMA) inside them. The defect management area refers to an area in which position information indicating the position of the sector in which the defect has occurred and alternative position information indicating in which of the above alternative areas the sector that substitutes for the defective sector exists are recorded. ..
【0023】
Each zone area has a user area inside thereof, and also has an alternative area and an unused area at the boundary portion. The user area is an area that can be used by the file system as a recording area. The alternative area is an area that is used as an alternative when a defective sector exists. The unused area is an area that is not used for data recording. The unused area is provided for about 2 tracks. The unused area is provided because the sector address is recorded at the same position of the adjacent track in the zone, but in Z-CLV, the sector address is recorded at the same position on the track adjacent to the zone boundary. This is to prevent erroneous determination of the sector address due to the cause.
【0024】
In this way, there are sectors that are not used for data recording at the zone boundary. Therefore, the DVD-RAM allocates logical sector numbers (LSN: Logical Sector Number) to the physical sectors of the user area in order from the inner circumference so as to continuously indicate only the sectors used for data recording. As shown in Fig. 3 (c), the area for recording user data, which is composed of sectors to which LSN is assigned, is called a volume space.
【0025】
In the volume area, an AV file containing multiple VOBs and an RTRW (Real Time ReWritable) management file that is the management information thereof are recorded. Actually, the AV file and the RTRW management file are recorded on a file system compliant with the ISO / IEC 13346 standard, but the description thereof will be omitted in this embodiment, and the detailed description will be renewed in the third embodiment. Do.
【0026】
(1-2) Data recorded on the volume area FIG. 4A is a diagram showing what kind of data is recorded on the volume area in the DVD-RAM. The video stream and audio stream shown in the fifth row of FIG. 4 (a) are divided into small portions of about 2 Kbytes as shown in the fourth row. The small part obtained by the division is interleaved and multiplexed with VOB # 1 and VOB # 2 in the AV file shown in the third row while being stored in the video pack-audio pack specified in the MPEG standard. The AV file is recorded in a free area in one zone area on the volume area shown in the first stage in a state of being divided into a plurality of extent data as shown in the second stage based on ISO / IEC 13346.
【0027】
On the other hand, the information about VOB # 1 to VOB # 3 is recorded in the RTRW management file as VOB # 1 information, VOB # 2 information, and VOB # 3 information shown in the fifth row. Like the AV file, the RTRW management file that contains these files is also recorded in the free area in the volume area in a state of being divided into multiple extents. Hereinafter, the video stream, the audio stream, and the VOB will be described individually, but before that, the hierarchical structure of the MPEG standard and the DVD-RAM standard that define these data structures will be described.
【0028】
FIG. 4 (b) is a diagram showing a hierarchical structure of data definitions defined by the MPEG standard. The data structure of the MPEG standard consists of an elementary stream layer and a system layer. The elementary stream layer in Fig. 4 (b) defines the video layer that defines the data structure of the video stream, the MPEG-Audio layer that defines the data structure of the MPEG-audio stream, and the data structure of the Dolby-AC3 format audio stream. It has an AC-3 layer and a Linear-PCM layer that defines the data structure of the Linear-PCM format audio stream. The playback start time (Presentation_Start_Time) and playback end time (Presentation_End_Time), which will be described later, are also defined in this elementary stream layer. As shown in the -3 layer and Linear-PCM layer, the data structures of the video stream and audio stream are independent of each other, and the playback start time and playback end time of the video frame and the playback start time of the audio frame And the relationship with the playback end time is also asynchronous.
【0029】
The system layer in Fig. 4 (b) defines packs, packets, DTS, and PTS, which will be described later. In Fig. 4 (b), the system layer is shown in a frame independent of the video layer and audio layer. As mentioned above, the packs, packets, DTS, and PTS described above have an independent relationship with the data structures of the video stream and the audio stream. In contrast to such a layer structure of the MPEG standard, the DVD-RAM standard includes the system layer of the MPEG standard shown in FIG. 4 (b) and the elementary stream layer, and the packs, packets, DTS, and the above-mentioned packs, packets, and DTSs are included. In addition to PTS, the VOB data structure shown in Fig. 4 (a) is defined.
【0030】
(1-2-1) Video stream The data structure of the video stream shown in FIG. 5 (a) is defined by the video layer shown in FIG. 4 (b), and a plurality of picture data corresponding to one frame of the image are arranged. Picture data is NTSC and PAL video signals compressed according to the MPEG standard. Multiple picture data compressed NTSC video signals are displayed in video frames with a frame period of approximately 33 msec (1 / 29.97 sec to be exact), and multiple picture data compressed PAL video signals are displayed. , Displayed in a video frame with a frame period of 40 msec. The top row of FIG. 5 (a) shows an example of a video frame. In this figure, the section specified by a set of "<" and ">" symbols indicates a video frame. In a video frame, the "<" symbol indicates the playback start time (Presentation_Start_Time) of the video frame, and the ">" symbol indicates the video frame playback end time (Presentation_End_Time) (hereinafter, video frames have such a notation). In addition, a plurality of video fields are included in the closed section specified by these symbols.
【0031】
As shown in FIG. 5A, the picture data to be displayed in such a video frame is input to the decoder by the playback start time of the video frame, and is taken out from the buffer by the decoder at the playback start time. I have to. Compression according to the MPEG standard is compression using the spatial frequency characteristics in an image for one frame and the time correlation characteristics with the images to be reproduced in the past and future, and by passing through this compression. , Each picture data is Bidirectionally predictive compressed using the time correlation characteristic with the image to be reproduced in the past and future directions. Predictive (B) picture, Predictive (P) picture compressed using the time correlation characteristic with the image to be reproduced in the past direction, spatial frequency characteristic in one frame of the image without using the time correlation characteristic Intra (converted to one of the I pictures. B, P, I pictures are shown in equal size in this figure, but their data sizes are different. Note that in order to decode P-pictures and B-pictures that are compressed using the time-correlation property, you must refer to the images that should be played back in the past and future directions. For example, decoding B-pictures You have to wait for the referenced future image to finish decoding.
【0032】
Therefore, in the MPEG video stream, the display order of each picture is specified, and the coding order of each picture is specified. The second and third rows in FIG. 5A show the picture data arranged in the display order and the picture data arranged in the coding order. In FIG. 5 (a), it can be seen that the reference destination of the B picture is the I picture to be reproduced in the future. In the display order, this I picture exists after the B picture, but since the B picture is compressed by using the correlation characteristic with this I picture, the decoding of the B picture decodes this I picture. I have to wait. Therefore, in the coding order, the decoding of this I picture is specified before the B picture. Changing the order from the coding order to the display order is called a reorder.
【0033】
As shown in the third row in FIG. 5 (a), each picture data is divided into units of about 2 KByte in a state of being arranged in the coding order, and is stored in the video pack sequence as shown in the bottom row. Also, if only P picture and B picture are used continuously, a problem will occur when decoding from the middle of the stream in special playback etc., so I picture is inserted in the picture data about every 0.5 seconds. The picture data string from this I picture to the beginning of the next I picture is called GOP (Group of Pictures) and is defined in the system layer of the MPEG standard as one compression unit in MPEG. The "|" symbol in the third row of Fig. 5 (a) indicates the boundary of GOP. In GOP, the picture type of the picture data located last in the display order must be P picture, and the picture type of the picture data located first in the coding order must be I picture.
【0034】
(1-2-2) Audio stream The audio stream is one of the data compressed by the Dolby-AC3 system, the MPEG system, and the LPCM system. An audio stream, like a video stream, is played in an audio frame that has a unique frame period. FIG. 5B is a diagram showing the correspondence between the audio frame and the audio data. Specifically, the playback cycle (audio frame) of the audio stream is 32 msec for one Dolby AC3 frame, 24 msec for one MPEG frame, and about 1.67 msec (to be exact, 1/600 sec) for one LPCM frame.
【0035】
The top row of FIG. 5 (b) shows an example of an audio frame. In this figure, the "<" symbol indicates the playback start time of the video frame, and the ">" symbol indicates the playback end time of the audio frame (hereinafter, the audio frame is shown with such a notation). .. As shown in FIG. 5 (b), the audio data to be displayed in such an audio frame is input to the decoder before the playback start time of the audio frame, and is taken out from the buffer by the decoder at the playback start time. Must be.
【0036】
The lower part of FIG. 5B is a diagram showing an example of how the audio data to be reproduced in each audio frame is stored in the audio pack. In this figure, the audio data to be reproduced in the audio frames f81 and f82 are stored in the audio pack A71, and the audio data to be reproduced in the audio frame f84 is stored in the next audio pack A72 and the audio frame f86, The audio data to be played by f87 is stored in the next audio pack A73. Here, the audio data to be reproduced in the audio frame f83 is stored in a state of being divided into an audio pack A71 to be preceded and an audio pack A72 to be succeeded. Similarly, the audio data to be reproduced in the audio frame f85 is also stored in a state of being divided into an audio pack A72 to be preceded and an audio pack A73 to be succeeded. The reason why the audio data to be played in one audio frame is stored in two audio packs in a divided state in this way is that the boundaries of the audio frame and video frame do not match the boundaries of the pack. Means. This boundary mismatch appears because the pack data structure is independent of the video stream and audio stream data structures in the MPEG standard.
【0037】
(1-2-3) VOB data structure VOBs (Video Objects) # 1, # 2, # 3 ... Shown in Fig. 4 (a) are ISO / IEC 13818-1 standard compliant program streams obtained by multiplexing video streams and audio streams. However, the program_end_code is not added to the end of the program.
【0038】
FIG. 6A is a stepwise refinement of the VOB logic format. That is, the logical format located in the upper row in this figure is a refinement of the logical format located in the lower row. The video stream located in the first stage in this figure is divided into a plurality of GOPs shown in FIG. 5 (a) as shown in the second stage. As shown in FIG. 5A, the picture data in GOP units is divided into a plurality of 2KByte units. On the other hand, the audio stream located on the right side of the first stage is divided into a plurality of units in units of about 2 KByte as shown in the third stage, as shown in FIG. 5 (b). The picture data in GOP units divided into 2KByte units is interleaved-multiplexed with the audio stream divided into about 2KByte units to form the pack sequence shown in the fourth row. Such a pack row has multiple VOBUs (Video Objects) shown in the fifth row. Unit) is formed, and it can be seen that the VOB shown in the sixth row has a configuration in which multiple VOBUs are arranged in chronological order. The leader line shown by the broken line in this figure clarifies which part of the logical format in the lower row refines in the logical format in the upper row. With reference to the broken line in the figure based on this notation, the VOBU in the 5th row corresponds to the pack row shown in the 4th row, and further corresponds to the picture data in GOP units shown in the 2nd row. ..
【0039】
As is clear from the correspondence shown by the broken line, VOBU is multiplexed with at least one GOP consisting of picture data whose playback time is about 0.4 seconds to 1.0 seconds, and this picture data. It is a unit that includes audio data, and it can be seen that it is composed by arranging video packs-audio packs in the MPEG standard. In the MPEG standard, the unit called GOP is defined in the system layer, but as shown in the second stage of Fig. 6 (a), only video data is indicated by GOP, and it is multiplexed with this. Audio data and other data (including secondary video data and control data) are not specified by GOP. With the aim of interpolating this, in the DVD-RAM standard, VOBU is provided as a unit corresponding to GOP, and at least one or more GOP consisting of picture data whose playback time is about 0.4 to 1.0 seconds and this picture data. It is possible to collectively refer to the audio data that is multiplexed with.
【0040】
VOBs are partially deleted with VOBU as the smallest unit. For example, it is assumed that a video stream recorded on a DVD-RAM as a VOB contains a video having no recording value such as a commercial. Since the VOBU in the above VOB includes one or more GOPs constituting the commercial and the audio data multiplexed with the picture data, it corresponds to the commercial among the plurality of VOBUs constituting the VOB. If only the part is deleted, it is not necessary to watch the above-mentioned non-recording value video when playing back the VOB. Even if one VOBU is deleted, the VOBU before and after that has a video stream in GOP units, and an I picture is inserted at the beginning of the video stream, so that normal decoding and playback are possible. FIG. 6B is a diagram showing an example of how the VOB is partially deleted. In this figure, VOB consists of VOBU # 1, VOBU # 2, VOBU # 3, VOBU # 4 ... VOBU # 7. When the partial deletion of VOBU # 2, VOBU # 4, and VOBU # 6 is ordered, the area occupied by these VOBUs in the DVD-RAM is released to the free area as shown in the second stage, and the second stage. As shown, VOBU # 1, VOBU # 3, VOBU # 5, and VOBU # 7 will be played in this order.
【0041】
Both the video pack and audio pack included in VOBU have a data length of 2 Kbytes. This size of 2KByte matches the sector size of DVD-RAM. Therefore, video packs-audio packs are recorded in a one-to-one ratio in each sector. An array of video packs-audio packs is equivalent to a sequence of logical sector sequences, and the data stored in these packs is read from DVD-RAM. That is, the video pack-audio pack arrangement means the reading order from the DVD-RAM. Each video pack has a storage capacity of about 2 KByte. For example, the data size of the video stream per VOBU is several hundred KByte, so the above video stream is divided into several hundred video packs and stored. become.
【0042】
(1-2-3-1) Data structure of video pack and audio pack 6 (c) to 6 (e) are diagrams showing the logical formats of the video pack and the audio pack to be stored in the VOBU. Generally, in the MPEG system stream, multiple packets are inserted in one pack, but the DVD-RAM standard basically limits the number of packets that should be inserted in the pack to only one. FIG. 6 (c) is a diagram showing the logical format of the video pack arranged at the beginning of the VOBU. In this figure, the first video pack in the VOBU is a pack header, a system header, a packet header, and a video stream. It can be seen that it is composed of a part of video data.
【0043】
FIG. 6 (d) is a diagram showing the logical format of the video pack arranged at a position other than the beginning in VOBU. In this figure, the video pack arranged at a position other than the beginning in VOBU has a configuration excluding the system header. It can be seen that it is composed of a pack header, a packet header, and video data. FIG. 6 (e) is a diagram showing the logical format of the audio pack. In this figure, the audio pack uses the Linear-PCM method for compressing the pack header, the packet header, and the audio stream included in this pack. It can be seen that it is composed of a sub_stream_id indicating whether it exists or is of the Dolby-AC3 method, and a part of the audio stream compressed by the compression method.
【0044】
(1-2-3-2-1) Buffer control in VOB The video stream and audio stream are stored in the video pack and audio pack as described above. However, in order to play VOBs seamlessly, it is not enough to simply store the video data and audio data in the video pack and audio pack, and consider the placement of the video pack and audio pack to ensure the continuity of buffer control. I have to do it. The buffer referred to here is an input buffer (hereinafter referred to as a video buffer and an audio buffer, hereinafter referred to as a video buffer and an audio buffer; see video buffer 4b and audio buffer 4d in FIG. 19) for temporarily storing a video stream and an audio stream in the stage before the decoder, and buffer control Continuity is to control the input and output to the buffer so that each input buffer does not overflow and underflow. Although a specific explanation will be described later, the pack header shown in FIGS. 6 (d) and 6 (e) shows the time stamp (indicating the data input, output, and display time) specified by the encoder in the MPEG stream. Buffer control is realized by adding it to the packet header. If an underflow or overflow occurs in the video buffer or audio buffer, the playback of the video stream or audio stream is inevitably interrupted. To prevent these, guaranteeing the continuity of buffer control has important implications.
【0045】
Each audio data has a time limit that it must be transferred to the audio buffer and decoded by the playback start time of the audio frame in which it should be played, but the audio stream has a fixed code length and the amount of data. Therefore, by storing the data required for reproduction in each audio frame in the audio pack and transferring it to the audio buffer, the above time limit can be sufficiently met.
【0046】
FIG. 7A is a diagram showing an ideal buffer state of the audio buffer, showing an audio frame and the buffer occupancy in the audio buffer. In this figure, the vertical axis is the buffer occupancy and the horizontal axis is the time axis. This time axis is divided every 32 msec, which matches the time length of the Dolby-AC3 audio frame. By referring to this graph, it can be seen that the buffer occupancy changes in a "saw-like" pattern.
【0047】
The height of the triangles that make up the saw means the amount of data in the audio stream played at each audio frame. The slope of each triangle means the transfer rate of the audio stream. This transfer rate is the same for all audio frames. The triangles in this figure indicate that each audio data is stored in the audio buffer at a constant transfer rate during the display period (32 msec) of the audio frame immediately before the audio frame to be played by itself, and the previous audio frame is stored in the audio buffer. It means that the audio frame is instantly taken out from the audio buffer at the playback end time (which means the decoding time for this audio data). The above-mentioned "saw-like" change means that the above-mentioned processing from accumulation to removal is repeated endlessly.
【0048】
For example, suppose the transfer of an audio stream to the audio buffer begins at time T1. This audio data should be reproduced at time T2, and the accumulated amount of the audio buffer gradually increases from time T1 to time T2 by transferring this audio data. Since the transferred audio data is output at the playback end time of the audio frame, the audio data in the audio buffer is exhausted, and the buffer occupancy of the audio buffer returns to 0. In FIG. 7 (a), the same repetition is performed at time T2-time T3 and time T3-time T4.
【0049】
As previously noted, the buffer state shown in Fig. 7 (a) is an ideal buffer state described on the assumption that the audio data to be played in each audio frame is stored in one audio pack, and is actually a buffer state. In general, as shown in FIG. 5 (b), a plurality of audio data to be reproduced in a plurality of audio frames are stored in one audio pack. FIG. 7B is a diagram showing a more realistic buffer state. The audio pack A31 in this figure stores the audio data A21, A22, A23 to be decoded at the playback end time of the audio frames f21, f22, f23. Of these audio data, it can be seen that the audio data A21 is decoded at the playback end time of the audio frame f21, and then the audio data A22 and A23 are decoded at the playback end time of the audio frames f22 and f23. Of the audio frames stored in the audio pack, the audio data A21 should be decoded earliest, and this audio data should be decoded at the playback end time of the audio frame f21. It should be read from the DVD-RAM during the display period of this audio frame f21.
【0050】
The video stream is encoded with a variable code length, that there is a large difference in the amount of code required for each picture type (I picture, P picture, B picture) due to the adoption of a compression method using time correlation characteristics. Moreover, since the amount of data is large, the transfer of each picture data, especially the data necessary for playing the I picture, must be completed by the playback end time of the video frame immediately before the video frame to be played. It is difficult.
【0051】
FIG. 7 (c) is a diagram showing a video frame and a buffer occupancy in the video buffer. In this figure, the vertical axis is the buffer occupancy and the horizontal axis is the time axis. This time axis is divided every 33 msec, which matches the time length of the NTSC video frame. By referring to this graph, it can be seen that the buffer occupancy changes in a "saw-like" pattern.
【0052】
The height of the triangles that make up the saw means the amount of data in the video stream that is played back in each video frame, and this amount of data varies from video frame to video frame. The reason why the amount of data is different in this way is that the amount of code is dynamically assigned according to the complexity of the image. The slope of each triangle means the transfer rate of the video stream. A rough value for the video stream transfer rate is calculated by subtracting the audio stream output rate from the track buffer output rate. This transfer rate is the same for all frame periods.
【0053】
In the triangle in this figure, each picture data is accumulated in the video buffer at a constant transfer rate (33 msec) during the display period of the video frame immediately before the video frame to be played by itself, and the previous one is accumulated. It means that the video frame is instantly taken out from the video buffer at the playback end time (which means the decoding time for this picture data). The above-mentioned "saw-like" change means that the above-mentioned processing from accumulation to removal is repeated endlessly.
【0054】
If the image to be displayed in a video frame is complex, it is necessary to allocate more code to this image. When such a large amount of code is allocated, the amount of data becomes enormous, so it is necessary to store the data in the video buffer quite early. Generally, the time length from the transfer start time of each picture data to the video buffer to the decoding time of the picture data is called "VBV (Video Buffer Verify) delay". This "VBV delay" tends to be larger as the image has a more complicated pattern and a larger amount of code is assigned.
【0055】
With reference to FIG. 7 (c), it can be seen that the transfer of the picture data decoded at the playback end time T16 of the video frame starts at time T11. On the other hand, at time T12, it can be seen that the transfer of the picture data decoded at time T18 has started. Similarly, at time T14, time T15, and time T17, it can be seen that the transfer of the picture data decoded at time T19, time T20, and time T21 has started.
【0056】
FIG. 7D is an explanatory diagram for explaining the transfer time of each picture data in more detail. Based on FIG. 7 (c), the transfer of the picture data to be decoded at time T24 in FIG. 7 (d) should be played back at the next video frame from the start time T23 of the "VBV delay". It can be said that the time until the image transfer starts is completed within "Tf_Period". The increase in buffer occupancy after this time is due to the transfer of the image to be played in the next video frame.
【0057】
The picture data stored in the video buffer waits for the time T24 when the picture data should be decoded. When the image A is decoded at the decoding time T24, the picture data in the video buffer is exhausted, and the buffer occupancy is reduced. Considering the above, it is sufficient that the transfer of audio data to be played in a certain audio frame starts about one frame before the audio frame to be played, but the transfer in a certain video frame is It must start well before the time it should be decoded. That is, the audio data to be played in a certain audio frame must be input to the audio buffer at approximately the same time as the picture data to be played in a video frame that is considerably ahead of that audio frame. is there. This means that in the MPEG stream in which the video stream and the audio stream are multiplexed, the multiplexing is performed in a state where the picture data precedes the audio data, and the video data and the audio data in the VOBU are the audio data. , The fact that the video data to be played in the future is multiplexed.
【0058】
We have already explained that the arrangement of multiple video packs and audio packs in a VOB means the transfer order of the data stored in these packs. Therefore, in order to read out the audio data to be played back in a certain audio frame and the picture data to be played back in a video frame much later in time than the audio frame at almost the same time, those audio data and pictures are required. The audio pack and video pack that store the data should be placed in the vicinity of the VOB.
【0059】
FIG. 8A shows how to store an audio pack containing audio data to be played in each audio frame and a video pack containing picture data to be played in each video frame. It is a figure which shows. In this figure, the vertically and horizontally long rectangles with "V" and "A" in the center indicate the video pack and audio pack, respectively. FIG. 8B is a diagram showing what the vertical width and the horizontal width of this rectangle mean. The vertical width of the rectangle indicates the bit rate of the pack, and the horizontal width means the transfer time of the pack. Packs indicated by vertical rectangles indicate packs that are input to the buffer at a high bit rate in a relatively short period of time, and packs indicated by a horizontally long rectangle indicate a pack that is buffered at a low bit rate over a relatively long period of time. Indicates the pack to be entered in.
【0060】
In this figure, the picture data V11 decoded at time T11 is transferred within the period k11. Since the audio data A11 is transferred and decoded during this period k11, as shown in the lower part of FIG. 8A, the video pack containing the picture data V11 and the audio pack storing the audio data A11 are located in the vicinity of each other. Placed in.
【0061】
In this figure, the picture data V12 that is decoded at the time T12 is transferred within the period k12. Since the audio data A12 is transferred and decoded during this period k12, the video pack containing the picture data V12 and the audio pack storing the audio data A12 are close to each other as shown at the bottom of FIG. 8 (a). Placed in position.
【0062】
Similarly, the audio data A13, A14, A15 are also arranged in the vicinity of the picture data V13, V14 whose transfer is started at these output times. When it is attempted to store picture data having a large amount of code in the video buffer as in the picture data V16, a plurality of audio data A15, A16, and A17 are multiplexed during the transfer period k16.
【0063】
Figure 9 shows how to store an audio pack that stores multiple audio data that should be played in multiple audio frames and a video pack that stores picture data that should be played in each video frame. It is a figure which shows. In this figure, the audio pack A31 is an audio pack in which the audio data A21, A22, A23 to be reproduced in the audio frames f21, f22, f23 are stored therein. Of the audio data stored in this audio pack, the audio data A21 should be decoded earliest. Since this audio data should be decoded at the playback end time of the audio frame f20, it should be read from the DVD-RAM together with the picture data V11 to be transferred at the same time (period k11) as the audio frame f20. Therefore, as shown in the lowermost part of FIG. 9, the picture data V11 is arranged in the vicinity of the stored video pack.
【0064】
The audio pack A32, which stores the audio data A24, A25, A26 to be played at the playback end time of the audio frames f24, f25, f26, is a picture that is transferred at the same time (period k15) as the audio frame f23. Should be read from DVD-RAM with data V15. Therefore, as shown in the lowermost part of FIG. 9, the picture data V15 is arranged in the vicinity of the stored video pack.
【0065】
The fact that an audio pack can store audio data that should be decoded in multiple audio frames and that the audio pack is placed close to the video pack that makes up the picture data that should be decoded in the future in time. Given that, the audio data-picture data that should be decoded at the same time seems to be stored in audio packs-video packs that are fairly far apart on the VOB. However, this is not the case, and it is unlikely that the audio data to be decoded at the same time will be placed near the video pack that stores the picture data that will be decoded in the future for more than one second. This is because the MPEG standard stipulates an upper limit on the amount of time that data can be stored in the buffer, and there is a restriction that all data must be taken out of the buffer within 1 second after being input to the buffer. is there. This constraint is called the "1 second rule" in the MPEG standard. Because of this "1 second rule", even if the audio data to be decoded at the same time and the picture data are separated, up to 3 VOBUs can be stored from the VOBU that stores the picture data to be decoded at a certain time. Within the range, the audio packs that should be decoded at that same time should be stored.
【0066】
(1-2-3-2-2) Buffer control between VOBs Next, buffer control in the case of continuously playing back two or more VOBs will be described. FIG. 10A is a diagram showing a buffer state at the tip of the video stream. Input of a pack containing picture data is started at FIRST_SCR located in the middle of the video frame f71 in this figure, and only BT2 is stored in the video buffer at the playback end time of the video frame f72. At the playback end time of the video frame f73, only BT3 of the picture data is stored in the video buffer. After that, it is taken out by the video decoder at the playback end time of the video frame f74 (hereinafter referred to as FIRST_DTS). In this way, at the tip of the VOB, there is no preceding video stream, so the buffer state draws only a triangle as shown in Fig. 10 (a). This figure is drawn on the assumption that the video pack is input by FIRST_SCR, but if the pack located at the beginning of the VOB is another pack, FIRST_SCR and the start of increase in the buffer state are It does not match. Also, LAST_SCR is located in the middle of the video frame because it is independent of the pack data structure and the video data data structure.
【0067】
FIG. 10 (b) is a diagram showing the buffer state at the end of the video stream. In this figure, data input to the video buffer is completed at LAST_SCR located in the middle of the video frame f61. After that, the accumulated video data is taken out from the video buffer by the amount of data Δ3 at the playback end time of the video frame f61. After that, it can be seen that only the data amount Δ4 is taken out at the playback end time of the video frame f62, and only the data amount Δ5 is taken out from the video buffer at the playback end time of the video frame f63 (hereinafter referred to as LAST_DTS). At the end of the VOB, the input of the video pack-audio pack is completed by the time indicated by LAST_SCR in the figure, and the accumulated amount of the video buffer gradually decreases in the video frames f61, f62, f63, f64 after this LAST_SCR. I will do it. Therefore, the buffer state at the end of the video stream draws a step as shown in FIG. 10 (b).
【0068】
FIG. 10 (c) is a diagram showing the buffer state between VOBs, the video stream having the buffer state shown in FIG. 10 (b) at the end thereof, and the buffer state shown in FIG. 10 (a) at the tip thereof. Indicates the buffer state when seamlessly connecting to a video stream having. Here, when seamlessly connecting two video streams, there must be FIRST_DTS at the tip of the video stream that should be played after one video frame of LAST_DTS at the end of the video stream that should be played first. I have to. That is, the first decoding of the succeeding video stream must be performed one video frame after the last decoding time of the preceding video stream. When the distance between the LAST_DTS at the end and the FIRST_DTS at the tip is one video frame, the picture data at the end of the leading video stream and the picture at the tip of the trailing video stream are stored in the video buffer as shown in Fig. 10 (c). A state in which data is mixed appears.
【0069】
In FIG. 10 (c), it is assumed that the video frames f71, f72, f73 shown in FIG. 10 (a) and the video frames f61, f62, f63 shown in FIG. 10 (b) match, respectively. .. In this state, at the playback end time of the video frame f71, the picture data BE1 at the end and the data BT1 constituting the picture data at the tip are present in the video buffer, and at the playback end time of the video frame f72, the end is reached. The picture data BE2 of the part and the data BT2 constituting the picture data of the tip part exist in the video buffer. At the playback end time of the video frame f73, the picture data BE3 at the end and the data BT3 constituting the picture data at the tip exist in the video buffer. As the video frame progresses, the picture data at the end of the VOB gradually decreases, while the picture data at the tip of the VOB gradually increases. Since such an increase-decrease appeared at the same time, the buffer state in Fig. 10 (c) is saw-like, which is very similar to the buffer state in the VOB shown in Fig. 7 (c). I understand.
【0070】
It should be noted here that the sum of the data amount BT1 and the data amount BE1 is BT1 + BE1, the sum of the data amount BT2 and the data amount BE2 is BT2 + BE2, and the sum of the data amount BT3 and the data amount BE3 is BT3 + BE3. It is also below the capacity of the video buffer. That is, if the sum BT1 + BE1, sum BT2 + BE2, and sum BT3 + BE3 exceed the upper limit of the video buffer, the video buffer overflows. If the maximum value of the above sum is Bv1 + Bv2, then Bv1 + Bv2 must be below the upper limit of the video buffer.
【0071】
(1-2-3-3) Pack header, system header, packet header The information for buffer control described above is described as a time stamp in the pack header, system header, and packet header shown in FIGS. 6 (f) to 6 (h). 6 (f) to 6 (h) are diagrams showing the logical formats of the pack header, the system header, and the packet header. As shown in Fig. 6 (f), the pack header includes Pack_Start_Code, SCR (System Clock Reference) indicating when the data stored in the pack should be input to the video buffer and audio buffer, and Program_max_rate. The first SCR in the VOB is set in the STC as the initial value of the system time clock (hereinafter referred to as "STC") that is standard equipment in the MPEG standard decoder.
【0072】
The system header shown in FIG. 6 (g) is given only to the video pack located at the beginning of the VOBU, and is the maximum rate information (in the figure) indicating the transfer rate required for the playback device when inputting data. Rate.bound.info) and buffer size information (Buffer.bound.info in the figure) indicating the maximum buffer size required for the playback device when inputting data in VOBU.
【0073】
The packet header includes a DTS (Decoding Time Stamp) indicating the decoding time and, in the case of a video stream, a PTS (Presentation Time Stamp) indicating when to reorder the decoded video stream and output it. PTS and DTS are set based on the playback start time of the video frame and audio frame. In terms of the data structure, PTS and DTS can be set for all packs, but it is rarely given to picture data that should be displayed in all video frames. It is often applied once per GOP, that is, once every 0.5 seconds. On the other hand, SCR is given to all video packs and audio packs.
【0074】
In a video stream, one PTS is often assigned per 1 GOP video frame, but in an audio stream, one PTS is often assigned every one or two audio frames. In the audio stream, DTS is not given because the coding order and the display order cannot be interchanged. If one audio pack completely contains the audio data to be played in two or more audio frames, describe the PTS of the first audio frame.
【0075】
For example, for the audio pack A71 shown in FIG. 5 (b), the playback start time of the audio frame f81 may be described as PTS. On the other hand, for the audio pack A72 that stores the divided audio frame f83, the playback start time of the audio frame f84 must be described instead of describing the playback start time of the audio frame f83 in the PTS. The same applies to the audio pack A73, and the playback start time of the audio frame f86 must be described instead of the playback start time of the audio frame f85 described in the PTS.
【0076】
(1-2-3-4) Timestamp continuity Next, what values are set for the PTS, DTS, and SCR shown in FIGS. 6 (f) to 6 (h) in each video pack and audio pack will be described. FIG. 11 (a) is a graph drawn by plotting the SCR values of the packs contained in the VOB in the order of the pack arrangement. The horizontal axis shows the ranking of each video pack, and the vertical axis shows the value of SCR assigned to each video pack.
【0077】
It can be seen that the initial value of SCR in FIG. 11 (a) is not "0" but a predetermined value of Init1. The reason why the initial value of SCR is not "0" is that the VOB targeted by the video data editing device has often undergone several video edits so far, and its tip has been partially deleted. This is because they are often present. Of course, it is considered that the initial value of SCR of the VOB that has just been encoded is set to 0, but in this embodiment, as shown in FIG. 11 (a), the initial value of SCR of VOB is anything other than 0. It is assumed that the value is set to.
【0078】
With reference to this graph, it can be seen that the video pack located earlier in the VOB has a lower SCR value, and the video pack located later in the VOB has a higher SCR value. This means that the later video packs in the VOB have a larger SCR. In this way, the value of the time stamp of the pack located earlier in the VOB is smaller, and the value of the time stamp of the pack located later in the VOB is larger, which is called "time stamp continuity". This continuity also exists in DTS. Since the PTS assigned to each video pack displays the video pack encoded later in the coding order, the PTS value may be reversed between the previous and next video packs, but in general, Like SCR and DTS, it still has continuity.
【0079】
On the other hand, the SCR of the audio pack has continuity like the video pack. However, continuity in SCR, DTS, and PTS is an essential requirement for VOB to be decoded normally, but what kind of value SCR should be to maintain the continuity will be explained. In FIG. 11 (b), there is a straight line showing the SCR of the section B on the extension of the straight line showing the SCR of the section A. In such a case, it can be said that the time stamps are continuous between the section A and the section B.
【0080】
In FIG. 11 (c), it can be seen that the initial value of the SCR of the interval D is higher than the final value of the straight line indicating the SCR of the interval C. However, even in this case, the value of the time stamp is smaller for the pack located earlier, and the value of the time stamp is larger for the pack located later, so it can be said that the time stamps are continuous between the section C and the section D. .. Of course, if the difference between other im stamps is large, it will be discontinuous. In the MPEG standard, the difference between each time stamp, for example, the difference in SCR must not exceed 0.7 seconds, so if it exceeds this range, it is treated as discontinuous.
【0081】
In FIG. 11 (d), it can be seen that the end value of the SCR of the interval E is higher than the initial value of the straight line indicating the SCR of the interval F. In this case, the continuity that the value of the time stamp is smaller for the pack located earlier and the value of the time stamp is larger for the pack located later in VOB is broken, so that the time stamp is between the section E and the section F. It is discontinuous. As in the interval E-interval F in Fig. 11 (d), before and after the discontinuous boundary of the time stamp is managed as two VOBs.
【0082】
The details of the buffer control between VOBs and the multiplexing method are described in detail in the patents "International Publication No. WO97 / 13367" and "International Publication No. WO97 / 13363". Please refer to these publications for more detailed technical contents. (1-2-4) AV file An AV file is a file that contains one or more VOBs that should be played continuously. If multiple VOBs are stored in this file, these VOBs will be played back in the order in which they are recorded in the file. In the example of Fig. 4, it can be seen that the AV file stores three VOBs, VOB # 1, VOB # 2, VOB # 3, but these VOBs are called VOB # 1, VOB # 2, VOB # 3. It will be played in order. Of the VOBs stored in this way, the buffer state between the video stream located at the end of the VOB to be played first and the video stream located at the tip of the VOB to be played subsequently. Is shown in Fig. 10 (c), and when the maximum value of the buffer storage amount Bv1 + Bv2 exceeds the capacity of the video buffer, or when the last time stamp in the VOB to be played in advance is followed by If there is a discontinuity between the first time stamp of the VOB to be reproduced, the VOB to be reproduced earlier and the subsequent VOB will be reproduced with interruption of reproduction. (1-3) Logical structure of RTRW management file Next, the configuration of the RTRW management file will be described. The RTRW management file is information indicating the attributes of each VOB recorded in the AV file for each VOB.
【0083】
FIG. 12A is a stepwise refinement of the recorded contents of the RTRW management file. That is, the logical format located on the right side in this figure is a refinement of the logical format located on the left side, and the leader line shown by the broken line shows that the logical format on the right side is within the logical format on the left side. It clarifies which part of the throat was refined.
【0084】
If you refer to the VOB logical format in this figure according to this notation, the RTRW management file contains VOB information about VOB # 1, VOB # 2, VOB # 3, ... VOB # 6. It can be seen that the VOB information is composed of VOB general information, stream attribute information, a time map table, and seamless connection information. (1-3-1) VOB General Information "VOB general information" includes VOB-ID uniquely assigned to each VOB recorded in the AV file and VOB playback time information.
【0085】
(1-3-2) Stream attribute information "Stream attribute information" consists of "video attribute information" and "audio attribute information". The "video attribute information" includes video format information in which either MPEG2 or MPEG1 is described, and a display method in which NTSC or PAL / SECAM is described. When the video attribute information is described in the NTSC system, 720 x 480, 352 x 240, etc. can be described as the resolution. Also, 4: 3 or 16: 9 can be described as the aspect ratio. It is possible to describe the presence / absence of copy protection control for analog video signals, and the presence / absence of copy protection to VTR by changing the signal amplitude of the blank section of the video signal and damaging the AGC circuit of VTR.
【0086】
"Audio attribute information" indicates the encoding format indicating MPEG2, Dolby Digital, linear PCM, etc., the sampling frequency at which 48KHz, etc. is set, and the bit rate in the case of a fixed bit rate, and in the case of a variable bit rate, " It has an audio bit rate in which the mark "VBR" is described. The "time map table" describes the size of each VOBU that makes up the VOB and the playback time of those VOBUs. In order to further improve access performance, representative VOBUs are selected at regular intervals, for example, in units of tens of seconds. The address and elapsed time from the beginning of the VOB are recorded.
【0087】
(1-3-3) Seamless connection information "Seamless connection information" is information that allows continuous playback of multiple VOBs recorded in an AV file to be performed seamlessly, such as "seamless flag", "video playback start time VOB_V_S_PTM", "video playback end time VOB_V_E_PTM", and "seamless connection information". It consists of "FIRST_SCR", "LAST_SCR", "Audio gap start time A_STP_PTM", "Audio gap length A_GAP_LEN", and "Audio gap position information A_GAP_LOC".
【0088】
(1-3-3-1) Seamless flag The "seamless flag" is a flag indicating whether or not the VOB corresponding to this seamless connection information is seamlessly performed after the playback of the VOB (front VOB) placed before the main VOB in the AV file is completed. Is. When this flag is set to 01, it indicates that the reproduction of the main VOB (rear VOB) is seamlessly performed, and when it is set to 00, it indicates that the reproduction of the rear VOB is performed non-seamlessly.
【0089】
In order to realize seamless playback of multiple VOBs, the following relationships (1) and (2) must be satisfied between the rear VOB and the front VOB. (1) The video stream display method (NTSC, PAL, etc.) shown in the video attribute information is the same. (2) The encoding method (AC-3, MPEG, LPCM, etc.) of the audio stream shown in the audio attribute information is the same.
【0090】
In the above (1) to (2), seamless playback is not possible because the video stream, audio stream display method, and encoding method are different, and the video decoder and audio decoder have different display methods, encoding methods, and bit rates. This is because the operation is stopped due to the switching. For example, in two audio streams to be played continuously, if one encoding method is AC3 method and the other is MPEG standard, when the stream changes from AC3 to MPEG, the audio decoder is inside it. Since the stream attribute is switched with, decoding stops during this time. The same applies when the attributes of the video stream change.
【0091】
The seamless flag is set to 01 only when all of these relationships (1) and (2) are satisfied, and the seamless flag is set to 00 when none of the relationships (1) and (2) are satisfied. The flag. (1-3-3-2) Video playback start time VOB_V_S_PTM "Video playback start time VOB_V_S_PTM" describes the time when the playback of the first video field of the video stream constituting the VOB starts in the PTM description format.
【0092】
The PTM description format is a format defined to express the time to be described using a time accuracy of 1 / 27,000,000 seconds and a time accuracy of 1 / 90,000 (= 300 / 27,000,000) seconds. Here, the time accuracy of 1 / 90,000 seconds considers the common multiple of the frame frequency of NTSC signal, PAL signal, DolbyAC-3, and MPEG audio, and the time accuracy of 1 / 27,000,000 seconds is 27MHz, which is the frequency of STC. Is taken into consideration.
【0093】
FIG. 12B is a diagram showing a PTM description format. In this figure, the PTM description format is the base part (PTM_base) that represents the quotient when the playback start time is divided by 1 / 90,000 seconds, and the remainder when the playback start time is divided by the base part is 1 / 27,000,000 seconds. It consists of an extension (PTM_extension) expressed in time accuracy. (1-3-3-3) Video playback end time VOB_V_E_PTM "Video playback end time VOB_V_E_PTM" describes the time when the playback of the last video field of the video stream constituting the VOB ends in the PTM description format.
【0094】
(1-3-3-4) Relationship between video playback start time VOB_V_S_PTM and video playback end time VOB_V_E_PTM In the case of seamless playback of two VOBs, the relationship between the VOB_V_S_PTM of the rear VOB and the VOB_V_E_PTM of the front VOB will be explained. Originally, the rear VOB is played after all the video packs contained in the front VOB have been played, so the VOB_V_S_PTM of the rear VOB must be the same as the VOB_V_E_PTM of the front VOB to be time stamped. Continuity occurs and it is not possible to reproduce the front VOB-rear VOB continuously. However, for two VOBs encoded completely separately, the encoder adds a time stamp to each video pack and audio pack at the time of encoding, and the video playback end time of the front VOB VOB_V_E_PTM and the rear VOB It is difficult to request a relationship where the video playback start time is equal to VOB_V_S_PTM.
【0095】
FIG. 13 is a graph showing the buffer occupancy for each front VOB-rear VOB. In these graphs, the vertical axis shows the buffer occupancy of the buffer, and the horizontal axis is the time axis. On this time axis, the times shown in SCR, PTS, video playback end time VOB_V_E_PTM, and video playback start time VOB_V_S_PTM are plotted. In FIG. 11 (b), the picture data to be displayed last in the front VOB waits for the PTS, which is the playback start time, after the input of the video data constituting the picture data to the video buffer is completed by LAST_SCR. The display process is started (this does not apply if the last pack input to the MPEG decoder is another pack such as an audio pack). The time when the display period h1 has elapsed from this PTS is the video playback end time VOB_V_E_PTM. This display period h1 is a period during which drawing from the first field to the last field constituting the image for one screen is completed.
【0096】
In the lower part of FIG. 13, the picture data to be displayed first in the rear VOB is input to the video buffer by FIRST_SCR, and is displayed after waiting for the PTS which is the playback start time. This display time is the video playback start time VOB_V_S_PTM. In this figure, SCR, video playback end time VOB_V_E_PTM, and video playback start time VOB_V_S_PTM are assigned to the video packs of the front VOB and the rear VOB, so the relationship is VOB_V_S_PTM of the rear VOB <VOB_V_E_PTM of the front VOB. You can see that.
【0097】
Now, I will explain the reason why seamless playback is possible even if the relationship is VOB_V_S_PTM of the rear VOB <VOB_V_E_PTM of the front VOB. The DVD-RAM standard defines an extended STD model (hereinafter referred to as "E-STD") as the standard model of the playback device (see Fig. 19). Generally, the MPEG standard decoder has a system time clock STC that measures the reference time, and the video decoder and the audio decoder perform the decoding process and the display process with reference to the reference time measured by this STC. , E-STD has an adder that adds an offset to the reference time output by STC in addition to STC, and selects either the reference time output by STC or the output value of the adder. And can be given to the video decoder and audio decoder. With this configuration, even if the time stamps between VOBs are discontinuous, by giving the output value of the adder to the decoding, it is possible to behave as if the time stamps between VOBs are continuous. , Even if the front VOB VOB_V_E_PTM and the rear VOB VOB_V_S_PTM have a discontinuous relationship as described above, seamless playback is performed.
【0098】
Not only that, the difference between the video playback end time VOB_V_E_PTM of the rear VOB and the video playback start time VOB_V_S_PTM of the front VOB can be used as an offset (generally called "STC offset") to be added to the adder. .. Therefore, the playback device of the E-STD model performs the following calculation using the video playback end time VOB_V_E_PTM and the video playback start time VOB_V_S_PTM, obtains STC_offset, and sets it in the above adder. STC offset = VOB_V_E_PTM on the front VOB-VOB_V_S_PTM on the rear VOB As a matter of fact, the video playback start time VOB_V_S_PTM and end time VOB_V_E_PTM in the seamless connection information are described for the purpose of having the decoder perform the above calculation and set the STC offset in the adder.
【0099】
FIG. 11 (e) is a graph showing the continuity of the time stamps shown in FIG. 11 (a) for two VOBs. The time stamp of the first pack in VOB # 1 has the initial value Init1, and the time stamp of the later pack has a larger value. The time stamp of the first pack in VOB # 2 also has the initial value Init2, and has a time stamp of a value larger than that of the later pack. In this figure, the end value of the time stamp in VOB # 1 exceeds the initial value of the time stamp in VOB # 2, so it can be seen that the time stamps of the two VOBs are discontinuous. Nevertheless, if you want to decode the first pack of VOB # 2 following the last pack of VOB # 1, you can add STC_offset to the time stamp of VOB # 2 to get the continuity in the time stamp of VOB # 2. Move from what is shown by the solid line to what is shown by the broken line. When the time stamp of VOB # 2 moves to the one shown by the broken line, the straight line indicating the increaseability of the time stamp value of VOB # 2 is located on the extension line of the increase straight line of the time stamp value of VOB # 1, and the time stamp continuity. It can be seen that is established.
【0100】
(1-3-3-5) FIRST_SCR For "FIRST_SCR", the SCR attached to the first pack of VOB is entered in the PTM description format. (1-3-3-6) LAST_SCR In "LAST_SCR", the SCR attached to the pack placed last in the VOB is entered in the PTM description format.
【0101】
(1-3-3-7) Relationship between FIRST_SCR and LAST_SCR As mentioned earlier, VOB playback is done by an E-STD type decoder, so the front VOB LAST_SCR and the rear VOB FIRST_SCR do not have to be the front VOB LAST_SCR = the rear VOB FIRST_SCR. You can see that. However, considering using STC_offset, the relation of the following equation must be satisfied. Front VOB LAST_SCR +1 Time required for pack transfer STC_offset + Rear VOB FIRST_SCR Here, the fact that the LAST_SCR of the front VOB and the FIRST_SCR of the rear VOB do not satisfy the above relationship means that the packs constituting the front VOB and the packs constituting the rear VOB are simultaneously transferred to the video buffer and the audio buffer. This means that it violates the MPEG standard and E-STD decoder models that transfer individual packs according to the order of the pack rows. Here, referring to Fig. 10 (c), LAST_SCR of the front VOB and STC_offset + It can be seen that the FIRST_SCR of the rear VOB matches and the above relationship is satisfied.
【0102】
When playing a VOB using an E-STD type decoder, it is important to note the switching time between the reference time output by the STC and the offset reference time output by the adder. Since the VOB time stamp does not contain any information about such switching timing, there is a risk that the timing of switching to the output value of the adder may be missed even with the E-STD.
【0103】
FIRST_SCR and LAST_SCR are effective for notifying the decoder of the switching timing of the output value of the adder, and the decoder compares the reference time output by STC with FIRST_SCR and LAST_SCR while the STC is being counted. I do. If the reference time output by STC matches FIRST_SCR and LAST_SCR, the reference time output by STC is switched to the output value of the adder.
【0104】
Here, there are two types of VOB reproduction: normal reproduction, in which the front VOB is reproduced to the rear VOB, and rewind reproduction, in which the rear VOB is reproduced to the front VOB. It is used to switch the reference time, and FIRST_SCR is used to switch the reference time during rewind playback. During rewind playback, the final VOBU of the rear VOB is decoded to the first VOBU, and after the first video pack of the rear VOB is decoded, the final VOBU of the front VOB is decoded to the first VOBU. .. In other words, during rewind playback, it is necessary to switch the reference time when the first video pack of the rear VOB has been decoded, and in order to inform the E-STD video data editing device of this time, the RTRW management file The FIRST_SCR of each VOB is entered.
【0105】
For more detailed technical contents of the above E-STD and STC_offset, refer to the international publication "International Publication No. WO97 / 13364". (1-3-3-8) Audio gap start time A_STP_PTM "Audio gap start time A_STP_PTM" describes the stop start time in which the operation of the audio decoder should be stopped when there is an audio playback gap in the VOB in the PTM description format. The audio gap start time A_STP_PTM indicates one time per VOB.
【0106】
(1-3-3-9) Audio gap length A_GAP_LEN "Audio gap length A_GAP_LEN" indicates how many hours the audio decoder is stopped from the stop start time specified by the audio gap start time A_STP_PTM. The time length of the audio gap length A_GAP_LEN is limited to less than one audio frame.
【0107】
(1-3-3-10) Necessity of audio gap The reason why the audio gap start time A_STP_PTM and the audio gap length A_GAP_LEN are used to specify the period during which the audio gap occurs will be described. Since the video stream and the audio stream are played back at different cycles, the total playing time of the video stream and the audio stream included in the VOB is different from each other. For example, when the video stream is in NTSC format and the audio stream is in Dolby-AC3 format, the total playback time of the video stream is an integral multiple of 33 msec, and the total playback time of the audio stream is as shown in Fig. 14 (a). It is an integral multiple of 32msec.
【0108】
When two VOBs are played continuously even though the total playback time is different, the playback time of any picture data and the playback time of the audio data are aligned in order to synchronize the playback of the picture data and the playback of the audio data. There is a need. If the alignment is attempted in this way, a time difference in the total playback time appears at the tip or end of the picture data and audio data.
【0109】
FIG. 14B is a diagram showing a state in which a time difference g1 appears at the end of the picture data and the audio data because the playback time of the picture data and the playback time of the audio data are aligned at the tip of the VOB. .. It can be seen that VOB # 1 has a time difference g1 at its end. If you try to connect VOB # 2 to VOB # 1 here, the audio stream of VOB # 2 will be played so as to close the time difference g1, so the audio stream in VOB # 2 will be played at time g0. I will be broken. This is because the audio decoder continuously decodes the audio stream at a fixed cycle by utilizing the fact that the audio stream is played back at a constant frame rate, and plays back after VOB # 1. This is because if the VOB # 2 to be performed has already been read from the DVD-RAM, the decoding of the VOB # 2 will be started as soon as the entire audio stream of the VOB # 1 is decoded.
【0110】
To prevent the playback of the VOB audio stream that is subsequently played back during seamless playback, the audio gap information in the stream is managed by the host side in the playback device, and the host side audio during the audio gap period. You need to stop decoding for the decoder. This playback stop period is the audio gap, and the audio gap start time A_STP_PTM and the audio gap length A_GAP_LEN specify the time zone in which this audio gap appears.
【0111】
Also, in the stream, processing is performed to identify the audio gap. Specifically, by describing the PTS of the audio frame immediately after the audio gap in the packet header of the audio packet, it is possible to specify when the audio gap ends. However, this specific method causes a problem when a plurality of audio data to be reproduced in a plurality of audio frames are stored in the audio packet. This is because when multiple audio data to be played in multiple audio frames are stored, the PTS can be described in the packet only for the first audio frame among those multiple audio frames. That is, you cannot write a PTS for the rest of the audio frames. If the audio data to be played in the audio frames located before and after the audio gap is arranged in the same packet, the PTS of the audio frame immediately after the audio gap cannot be described, so the audio gap cannot be specified and the audio gap is It will disappear. Therefore, the audio frame immediately after the audio gap is processed so as to be placed at the beginning of the next audio pack, and the PTS (audio gap start time A_STP_PTM + audio gap length A_GAP_LEN) of the audio frame immediately after the audio gap is specified in the stream.
【0112】
Further, if necessary, in the audio packet containing the audio data to be reproduced immediately before the audio gap, the Padding-Packet specified in the MPEG standard is inserted immediately after the audio data. FIG. 14 (c) shows the audio data y-2, y-1 to be reproduced in the multiple audio frames y-2, y-1, y located at the end of VOB # 1 shown in FIG. 14 (b). A diagram showing an audio pack G3 containing an audio gap including, y and Padding-Packet, and an audio pack G4 containing a plurality of audio frames u, u + 1, u + 2 located at the tip of VOB # 2. Is.
【0113】
The audio pack G4 described above is a pack containing audio data to be reproduced in an audio frame located immediately after the audio gap, and the audio pack G3 is a pack located immediately before the pack. If the pack contains audio data that should be played in the audio frame immediately following the audio gap, the pack immediately preceding the pack is called the "audio pack containing the audio gap".
【0114】
Here, since the audio pack G3 is located behind the video pack row in the VOB, there is no picture data in the VOB # 1 that should be displayed in the future. However, since it is premised that VOB # 2 follows the playback of VOB # 1, the picture data contained in VOB # 2 is read out in the audio frames y-2, y-1, y. It becomes the picture data to be. If so, the audio pack G3 including the audio gap may be placed in any of the three VOBUs located at the tip of VOB # 2 as long as it does not violate the "1 second rule". FIG. 14 (d) is an explanatory diagram showing that the audio pack G3 including the audio gap is placed in any of VOBU # 1, VOBU # 2, and VOBU # 3 located at the tip of VOB # 2. is there.
【0115】
During the period of the audio gap, the operation of the audio decoder must be temporarily interrupted. This is because the audio decoder tries to perform the decoding process even during the audio gap period, and the host-side control unit that performs central control in the playback device performs the decoder after the reproduction of the picture data-audio data is completed. Instructs the audio pause to temporarily stop the audio decoder (this instruction information is ADPI (Audio Decoder Pause Information) in FIG. 19). In this way, it is possible to stop the operation of the audio decoder during the period of the audio gap. That doesn't mean you can stop the audio output no matter how the audio gap appears.
【0116】
This is because the control unit is often composed of a general-purpose microcomputer and software, and for the convenience of stopping audio decoding, if the audio gap is continuous for a short period of time, the stop instruction by the control unit may not be in time. Because there is. For example, when playing a VOB that is about 1 second long continuously, it is necessary to instruct the audio decoder to stop at intervals of about 1 second, so there is an audio gap in the control unit consisting of a general-purpose microcomputer and software. You may not be able to stop the audio decoder while it continues. Also, in VOB playback, if you try to align the playback time of picture data and the playback time of audio data many times, you need to instruct the audio decoder to stop each time, so it consists of a general-purpose microcomputer and software. The control unit may not be able to stop the audio decoder while the audio gap continues.
【0117】
Therefore, the following restrictions are set so that the audio gap occurs after a certain period of time. First of all, the VOB time length is set to 1.5 seconds or more so that the stop control by the control unit is performed with a margin, and the shortening of the audio gap occurrence is prevented. Second, the playback time of the picture data and the playback time of the audio data are aligned only once per VOB. This creates one audio gap per VOB.
【0118】
Third, limit the time length of the audio gap to less than one audio frame. Finally, place the audio gap start time VOB_A_STP_PTM relative to the rear video playback start time VOB_V_S_PTM and place the audio gap start time (VOB_A_STP_PTM) less than one audio frame before the rear video playback start time (VOB_V_S_PTM). Limit to. That is, it is restricted so as to satisfy the relationship of the following equation. VOB_V_S_PTM --1 Audio frame playback time <A_STP_PTM VOB_V_S_PTM This is because even if an audio gap occurs at such a time, the first video is just displayed in the rear VOB, and even if the audio output is silent, it is unlikely that the operator will feel uncomfortable. Because.
【0119】
By providing the above restrictions, the minimum audio gap generation interval during seamless playback is "1.5 seconds-1 audio frame playback time x 2". If you apply the numerical values concretely, if the audio is Dolby AC3, the playback time of one audio frame is 32 msec, so the interval of occurrence of the audio gap is at least 1436 msec, and the stop control by the control unit is performed with a margin. The possibility is high.
【0120】
(1-3-3-11) Audio gap position information "Audio gap position information A_GAP_LOC" is a 3-bit value indicating which of the three VOBUs located at the tip of the rear VOB the audio pack containing the audio gap was inserted. If this information is 1, it indicates that there is an audio gap in VOBU # 1, and if it is 2, it indicates that there is an audio gap in VOBU # 2. If it is 3, it indicates that there is an audio gap in VOBU # 3.
【0121】
Such a flag is needed to recreate the audio gap if the rear VOB of the two VOBs that should be played seamlessly needs to be partially deleted. Partial deletion of a VOB means deleting a plurality of VOBUs located at the tip or end of the VOB. For example, when editing a video, it is often desired to cut only the opening scene. In this case, "partial deletion of VOB" is to delete the VOBU including the opening scene.
【0122】
When making such partial deletions, it should be noted that the audio pack contains the audio gap moved to the rear VOB. As described above, since the audio gap is determined based on the video playback start time VOB_V_S_PTM of the rear VOB, the audio gap is multiplexed in any of the 3 VOBUs at the beginning of the VOB. Therefore, when some VOBUs, for example, the first VOBU, are deleted, it is not possible to know whether the audio gap has been deleted or disappeared.
【0123】
In addition, the number of audio gaps that may be provided in a VOB is only one for each VOB, and when a new audio gap is generated, the past audio gap becomes unnecessary and must be deleted. The trouble here is that the audio pack G3 including the audio gap, as shown in Fig. 14 (d), can be selected from VOBU # 1 to VOBU # 3 in VOB # 2 as long as it does not violate the 1-second rule. Since it is inserted, the audio pack G3 containing the above audio gap must be taken out from the packs contained in these VOB # 1 to VOB # 3. Even with at most three VOBUs, stream analysis is required to immediately extract only the audio pack G3 containing the audio gap from these. This is because each VOBU contains hundreds of packs, and referencing the inside of the pack also requires a considerable amount of processing.
【0124】
The audio gap position information A_GAP_LOC indicates which of the three VOBUs located at the tip of the rear VOB the audio pack containing the audio gap was inserted with a 3-bit flag, so search for the audio gap. The target VOBU can be specified to any one, and the audio pack G3 including the audio gap can be easily taken out.
【0125】
Figures 15 (a) to 15 (d) show the video data editing device when the VOBU located at the tip of VOB # 2 is deleted from the VOB # 1-VOB # 2 that should be played seamlessly. Is an explanatory diagram showing a procedure for recreating an audio gap. In FIG. 15 (a), it can be seen that "VOBU # 98", "VOBU # 99", and "VOBU # 100" are arranged at the end of VOB # 1. In addition, it can be seen that "VOBU # 1", "VOBU # 2", and "VOBU # 3" are arranged at the tip of VOB # 2. It is assumed that the video data editing device is instructed to partially delete VOBU # 1 to VOBU # 2 in VOB # 2.
【0126】
The audio gap position information A_GAP_LOC is referenced to identify the VOBU where the audio pack G3 containing the audio gap is located. Assuming that the audio gap position information A_GAP_LOC is set as shown in Fig. 15 (b), it can be seen that the audio pack G3 including the audio gap is placed in VOBU # 3 of VOB # 2.
【0127】
If you know that the audio pack G3 including the audio gap is placed in VOBU # 3, you can see whether the audio gap is multiplexed within the partial deletion range. In this example, the audio Since the gap is not included, modify A_GAP_LOC as shown in Fig. 15 (d) by the number of deleted VOBUs. (1-4) System configuration of video data editing device The video data editing device in this embodiment also has a function as a DVD-RAM playback device-recording device. FIG. 16 shows a configuration example of a system using the video data editing device according to the present embodiment. The video data editing device (hereinafter referred to as DVD recorder 70) in this system includes a remote controller 71, a television receiver 72 connected to the DVD recorder 70, and an antenna 73. This DVD recorder 70 is assumed to be used as an alternative device with an editing function for a video tape recorder that is widely used as a recorder for television broadcasting, and this system is a video data editing device for such purposes. Shows the case where is used in the home. The DVD-RAM is used as a recording medium for the DVD recorder 70 to record a television broadcast.
【0128】
When the DVD recorder 70 is loaded with the DVD-RAM, the video signal or NTSC signal received through the antenna 73 is compressed and recorded as a VOB on the DVD-RAM, and is included in the VOB recorded on the DVD-RAM. The video stream or audio stream is expanded and the video signal or NTSC signal or audio signal is output to the television receiver 72.
【0129】
(1-4-1) Hardware configuration of DVD recorder 70 FIG. 17 is a block diagram showing a hardware configuration of the DVD recorder 70. This DVD recorder 70 has a control unit 1, an MPEG encoder 2, a disk access unit 3, a decoder 4, a video signal processing unit 5, a remote controller 71, a bus 7, a remote controller signal receiver 8, and a receiver 9.
【0130】
The solid line arrow in the figure is the physical connection line implemented as the board wiring in the video data editing device, and the broken line in the figure is the connection line indicated by the solid line arrow at the time of video editing. It is a logical connection line that shows how input and output are performed. The numerical values of (1), (2), (3), (4), and (5) attached to the broken line indicate which of the VOBU and the picture data and audio data that compose it are on the above physical connection line when the VOBU is re-encoded. It shows how to transmit.
【0131】
The control unit 1 is a host-side control unit having a CPU 1a, a processor bus 1b, a bus interface 1c, a main memory 1d, and a ROM 1e. By executing a program stored in the ROM 1e, VOB recording, playback, editing, etc. I do. When the MPEG encoder 2 receives the NTSC signal through the antenna 73, or when the video signal output by the home video camera is input from the video input terminal provided on the back of the DVD recorder 70. , The VOB is obtained by encoding these NTSC signals and the video signal, and the VOB which is the encoding result is output to the disk access unit 3 through the bus 7. In particular, as a process related to video editing, the MPEG encoder 2 inputs the decoding result by the decoder 4 output from the connection line c1 via the bus 7 as shown by the broken line (4), and encodes this decoding result to VOB. Is obtained, and the VOB, which is the encoding result, is output to the disk access unit 3 through the bus 7 as shown by the broken line (5).
【0132】
The disk access unit 3 has a track buffer 3a, an ECC processing unit 3b, and a drive mechanism 3c for the DVD-RAM, and accesses the DVD-RAM under the control of the control unit 1. More specifically, when the control unit 1 instructs the recording to DVD-RAM and the VOBs encoded from the MPEG encoder 2 are sequentially output as shown by the broken line (5), the disk access unit 3 outputs them. VOB is stored in the track buffer 3a, ECC processing is once performed by the ECC processing unit 3b, and then the drive mechanism 3c is controlled so as to sequentially record to DVD-RAM. On the other hand, when the control unit 1 instructs to read from the DVD-RAM, the drive mechanism 3c is controlled so that the VOBs are sequentially read from the DVD-RAM, and the read VOBs are subjected to ECC processing by the ECC processing unit 3b. After that, it is stored in the track buffer 3a.
【0133】
Here, the drive mechanism 3c includes a base for setting the DVD-RAM, a spindle motor that clamps the set DVD-RAM and drives it to rotate, an optical pickup that reads the signal recorded in the DVD-RAM, and an optical pickup. The DVD-RAM can be read and written by these controls, but the details of the control are not the main focus of the present invention and can be realized by a known technique. The description is omitted.
【0134】
When the VOB read from the DVD-RAM by the disk access unit 3 is output as shown by the broken arrow (1), the decoder 4 decodes the output VOB to generate digital uncompressed video data. , The audio signal is obtained, and the digital uncompressed video data is output to the video signal processing unit 5, and the audio signal is output to the television receiver 72. Further, at the time of video editing, the decoder 4 outputs the decoding results of the video stream and the audio stream to the bus 7 via the connecting lines c2 and c3 in FIG. 17 as shown by the broken line arrows (2) and (3). The decoding result output to the bus 7 is output to the MPEG encoder 2 via the connecting line c1 as shown by the dashed arrow (4).
【0135】
The video signal processing unit 5 converts the video data from the decoder 4 into a video signal for the television receiver 72, and if the graphics data is output from the outside, synthesizes the graphics data into the converted video signal. Signal processing is performed. The remote control signal receiving unit 8 receives the remote control signal, notifies the control unit 1 of the key code included in the signal, and causes the control unit 1 to perform control according to the operation of the remote control 71.
【0136】
(1-4-1-1) Internal configuration of MPEG encoder 2 FIG. 18 is a block diagram showing the configuration of the MPEG encoder 2. As shown in the figure, the MPEG encoder 2 includes a video encoder 2a, a video buffer 2b that stores the output of the video encoder, an audio encoder 2c, an audio buffer 2d that stores the output of the audio encoder, and an encoding in the video buffer 2b. A system encoder 2e that multiplexes the encoded video stream and the encoded audio stream in the audio buffer 2d, an STC (system time clock) unit 2f that generates the synchronous clock of the encoder 2, and an encoder that controls and manages these. It consists of a control unit 2g.
【0137】
(1-4-1-2) Internal configuration of decoder 4 FIG. 19 is a block diagram showing the configuration of the decoder 4. As shown in the figure, the decoder 4 includes a demultiplexer 4a, a video buffer 4b, a video decoder 4c, an audio buffer 4d, an audio decoder 4e, a re-order buffer 4f, STC4g, an adder 4h, a switch SW1, a switch SW2, and a switch SW3. , Switch SW4, and decoder control unit 4k.
【0138】
The demultiplexer 4a refers to the header of the packet read from the VOB to determine whether each pack is a video pack or an audio pack. If the judgment result is a video pack, the video data in the pack is output to the video buffer 4b, and if the judgment result is an audio pack, the audio data in the pack is output to the audio buffer 4d.
【0139】
The video buffer 4b is a buffer for accumulating the video data output by the demultiplexer 4a. In the video buffer 4b, each picture data is stored until it is taken out of the buffer at the decoding time. The video decoder 4c takes out the picture data stored in the video buffer 4b from the video buffer 4b at each decoding time and decodes it instantly.
【0140】
The audio buffer 4d is a buffer for accumulating the audio data output by the demultiplexer 4a. The audio decoder 4e sequentially decodes the audio data in units of audio frames stored in the audio decoder 4e. When the output of ADPI (Audio Decoder Pause Information) emitted by the control unit 1 is received, the audio decoder 4e stops the decoding process of the audio frame data. ADPI is emitted from the control unit 1 when the current time reaches the audio gap start time A_STP_PTM shown in the seamless connection information.
【0141】
The re-order buffer 4f is a buffer for storing the decoding results when the picture data decoded by the video decoder 4c is an I picture or a P picture. The reason for storing the decoding results of I-pictures and P-pictures in this way is to switch the encoding order and the display order, and all the decoding results that should be displayed before the decoding results stored in the re-order buffer 4f. After the B picture is decoded by the video decoder 4c, the re-order buffer 4f outputs the decoding result of the I picture and P picture stored up to that point as a video signal or an NTSC signal.
【0142】
The STC (system time clock) unit 4g generates a synchronous clock indicating the reference time in the decoder 4. The adder 4h outputs the value obtained by adding STC_Offset to the reference time indicated by the synchronous clock as the reference time with offset. This STC_offset is calculated and set by the control unit 1 taking the difference between the video playback start time VOB_V_S_PTM and the video playback end time VOB_V_E_PTM shown in the seamless connection information.
【0143】
The switch SW1 supplies the reference time measured by STC4g or the offset reference time output by the adder 4h to the demultiplexer 4a. The switch SW2 supplies the reference time measured by STC4g or the offset reference time output by the adder 4h to the audio decoder 4e. The supplied reference time or offset reference time is used for collation with the decoding time and playback start time of each audio frame.
【0144】
The switch SW3 supplies the reference time measured by STC4g or the offset reference time output by the adder 4h to the video decoder 4c. The supplied reference time or offset reference time is used for collation with the decoding time of each picture data. The switch SW4 supplies the reference time measured by STC4g or the offset reference time output by the adder 4h to the reorder buffer 4f. The supplied reference time or offset reference time is used for collation with the reproduction start time of each picture data.
【0145】
The decoder control unit 4k receives a decoding processing request in an integral multiple unit of VOBU, that is, an integer multiple unit of GOP from the control unit 1, and causes the demultiplexer 4a to the re-order buffer 4f to perform the decoding processing. Also, if the playback output of the decoding result is valid / invalid, the video decoder 4c and audio decoder 4e are output to the outside if the playback output is valid, and if the playback output is invalid, the video decoder 4c and audio decoder are output. 4 Prohibit the output of the decoding result of e to the outside. The enable / disable instruction can be made in a unit smaller than the video frame, that is, in the video field. Information that specifies the effective section of the playback output for each video field is called effective playback section information.
【0146】
(1-4-1-2-1) Switching timing of switch SW1 to switch SW4 FIG. 20 is a timing chart showing the switching timing of switches SW1 to SW4. This timing chart shows at what timing switch SW1 to switch SW4 are switched when VOB # 1-VOB # 2 is played back continuously. The upper part of this figure shows the pack rows that make up VOB # 1-VOB # 2, and the middle part shows the video frame. The lower row shows the audio frame.
【0147】
The switching timing of the switch SW1 is when the pack sequence transferred to the decoder 4 changes from that of VOB # 1 to that of VOB # 2. This time is shown in LAST_SCR of the seamless connection information for VOB # 1. The switching timing of the switch SW2 is the time when all the audio data of the VOB stored in the audio buffer 4d, that is, the VOB # 1 is decoded before the switching of the switch SW1.
【0148】
The switching timing of the switch SW3 is the time when all the VOB stored in the video buffer 4b, that is, the video data of the VOB # 1 is decoded before the switching time (T1) of the switch SW1. The switching timing of the switch SW4 is the time when the last video frame is displayed in the display order of VOB # 1.
【0149】
The program stored in ROM1e includes a module that processes the two VOBs recorded on DVD-RAM so that they can be played seamlessly. (1-4-1-2-2) Processing procedure for seamless machining on VOB 21 and 22 are flowcharts showing a processing procedure of a processing module for processing so that two VOBs in an AV file are seamlessly connected. FIGS. 23 (a) and 23 (b) are explanatory views showing how the buffer state is analyzed based on each video pack. In FIGS. 24 (a) and 25, the audio frames x, x + 1, y-1, y, u, u + 1, u + 2 used in FIG. 22 correspond to any audio frame in the audio stream. It is a figure which shows.
【0150】
Next, the re-encoding of VOB will be described. In step S102 of FIG. 21, the control unit 1 obtains STC_OFFSET by calculating VOB_V_E_PTM of the front VOB-VOB_V_S_PTM of the rear VOB. In step S103, the control unit 1 analyzes the change in the buffer occupancy from FIRST_SCR of the front VOB to the decoding end time of all data. 23 (a) and 23 (b) are explanatory views showing the analysis process of the buffer occupancy in step S103. If the front VOB contains video packs # 1 and video packs # 2, as shown in Figure 23 (a), then the SCRs # 1, # 2 and DTS # 1 included in these video packs Is plotted on the time axis. Next, the data size of the data contained in video pack # 1 and video pack # 2 is detected. From SCR # 1, the slope of the bit rate information in the pack header is plotted by the data size of video pack # 1. Next, plot only the data size of video pack # 2 from SCR # 2 in the same way. Next, plot the picture data P1 decoded by DTS # 1 so as to reduce the size by the data size. At this time, the size of the picture data P1 is obtained by analyzing the video stream.
【0151】
By plotting the data size of the video pack and picture data in this way, the buffer state of the video buffer 4b from the head SCR to DTS can be graphed. If the same procedure is repeated for all the video data and audio data contained in the VOB, a graph showing the buffer state as shown in FIG. 23 (b) can be obtained.
【0152】
In step S104, the control unit 1 analyzes the change in the video buffer occupancy from FIRST_SCR of the rear VOB to the decoding end time LAST_DTS of all data by performing the same analysis as in step S103 for the rear VOB. In step S105, the control unit 1 analyzes the change in the video buffer occupancy from FIRST_SCR + STC_offset of the rear VOB to LAST_DTS of the front VOB. During the time period from FIRST_SCR + STC_offset of the rear VOB to LAST_DTS of the front VOB, the first picture data of the rear VOB is transferred to the video buffer 4b even though the last picture data of the front VOB is stored in the video buffer 4b. It is a time zone.
【0153】
When the video data of the front VOB-rear VOB is mixed in the buffer, the buffer state is as shown in FIG. 10 (c). In the period from FIRST_SCR + STC_offset to LAST_DTS in Fig. 10 (c), both front VOB and rear VOB video data are stored in the video buffer 4b, which is the largest video buffer. Calculate the accumulated amount Bv1 + Bv2 of 4b.
【0154】
In step S106, the control unit 1 controls the disk access unit 3 to read three VOBUs located at the end of the front VOB. Subsequently, in step S107, the control unit 1 controls the disk access unit 3 so as to read out the three VOBUs located at the tip of the rear VOB. FIG. 23 (c) is a diagram showing a reading range to be read from the front VOB in step S106. In FIG. 23 (c), when the front VOB contains VOBU # 98 to # 105 and the last VOBU is # 105, the VOBU containing the picture data V_END to be decoded last is VOBU # 103 to #. 105 will be read. FIG. 23 (d) is a diagram showing a reading range to be read from the rear VOB in step S107. In FIG. 23 (d), when the rear VOB contains VOBU # 1 to # 8, and the first VOBU is # 1, the VOBU containing the picture data V_TOP to be decoded first is VOBU # 1 to # 3. Will be read.
【0155】
Here, according to the 1-second rule, audio data and picture data that should be played within 1 second may be stored separated by up to 3 VOBUs, so as described above, the starting point of VOB, By reading out the three VOBUs including the end point, in step S106, all the pictures that should be played from 1 second before the playback end time of the picture data V_end located at the end of the front VOB to the playback end time. The data and audio data were read together. Further, in step S107, all the picture data and audio data to be reproduced within 1 second after the reproduction start time are collectively read from the reproduction start time of the picture data V_top located at the tip of the rear VOB. It was. In this float, reading was performed in units of 3 VOBUs, but the number of VOBUs may be any number. Further, instead of reading in units of VOBU, only all of the picture data and audio data included in VOBU that should be reproduced in one second may be read. Further, video data and audio data to be played in a period longer than 1 second may be read out.
【0156】
After reading, in step S108, the control unit 1 controls the demultiplexer 4a so as to separate the VOBU at the tip and the end into a video stream and an audio stream, and decodes these streams to the video decoder 4c and the audio decoder 4e. Let me do it. During normal playback, the decoding results of the video decoder 4c and audio decoder 4e are output as video and audio, but during re-encoding, the control unit 1 uses the video stream to input these decoding results to the MPEG encoder 2. The decoding result of the audio stream is output to bus 7 as shown by the broken arrows (2) and (3) in FIG. The decoding result of the video stream transferred to the bus 7 and the decoding result of the audio stream are taken into the sequential MPEG encoder 2 as shown by the dashed arrow (4).
【0157】
After that, the control unit 1 calculates the code amount for re-encoding the MPEG encoder 2 that has taken in the decoding result of the video stream and the decoding result of the audio stream. First, in step S109, the control unit 1 determines whether the buffer accumulation amount at each decoding timing exceeds the upper limit value of the buffer during the period in which the front VOB and the rear VOB are mixed in the buffer. In the present embodiment, it is determined whether or not Bv1 + Bv2 calculated in step S105 exceeds the upper limit of the buffer. If the upper limit is not exceeded, the process proceeds to step S112, but if it is exceeded, the control unit 1 decodes the code amount based on the over amount A, that is, the code amount obtained by subtracting the over amount A. Assign to VOBU column. Reducing the amount of code will reduce the image quality of the video stream in the read VOBU column, but the image quality will be improved because the video buffer 4b must be avoided to overflow in order to seamlessly connect the two VOBs. They are choosing the method of lowering it. In step S111, the video decoder 4c is controlled so that the decoding results of the video decoder 4c and the audio decoder 4e are re-encoded based on the code amount assigned in step S110.
【0158】
Here, the pixel value of the video data is once converted into digital data of the YUV coordinate system by decoding by the MPEG encoder 2. The digital data of the YUV coordinate system is digital data having signals (luminance signal (Y), color difference signal (U, V)) for specifying a color in a color TV, and the video decoder 4c re-uses such digital data. Encode into multiple picture data. As the code amount allocation technology, the one described in MPEG2 DIS (Draft International Standard) Test Model 3 is used. Re-encoding with the code amount constrained is realized by processing such as replacing the quantization coefficient. The code amount obtained by subtracting the over amount A may be assigned only to the rear VOB, or may be assigned only to the front VOB.
【0159】
In step S112, the control unit 1 calculates the decoding result of the audio data obtained by separating the front VOB corresponding to the audio frame x including FIRST_SCR + STC_offset of the rear VOB. In FIG. 24 (a), the upper graph shows the buffer state by the video data of the front VOB and the rear VOB, and the lower graph of FIG. 24 (a) shows the audio obtained by separating the front VOB. The audio frame of the data and the audio frame of the audio data obtained by separating the rear VOB are arranged one above the other. The lower audio frame sequence clarifies the correspondence between the time axis of the upper graph and each audio frame. Here, if a perpendicular line is drawn from FIRST_SCR + STC_offset in the upper graph, this perpendicular line intersects one audio frame in the audio frame sequence of the front VOB. This intersecting audio frame is the audio frame x, and the immediately following audio frame x + 1 is the last audio data contained in the front VOB. The data of the audio frames x and x + 1 are included in the plurality of audio data to be reproduced in the time zone in which the display period of the final picture data V_END at the end of the front VOB plus 1.0 seconds before and after is added. It is included in the three VOBUs read in step S105.
【0160】
Figure 24 (b) shows the case where FIRST_SCR + STC_offset coincides with the audio frame boundary of the front VOB. If they match in this way, the audio frame immediately before it is defined as the audio frame x. In step S113, the control unit 1 calculates the audio frame y + 1 including the VOB_V_S_PTM + STC_Offset of the rear VOB. When a perpendicular line is drawn from the video playback start time VOB_V_S_PTM in the upper graph in FIG. 24 (a), this perpendicular line intersects one audio frame in the audio frame sequence of the rear VOB. This intersecting audio frame is the audio frame y + 1, and the audio frame y immediately before this is a valid audio frame that is used even after editing among the original audio data included in the front VOB.
【0161】
FIG. 24 (c) is a diagram showing a case where the video playback start time VOB_V_S_PTM + STC_offset coincides with the audio frame boundary of the front VOB. If they match in this way, the audio frame immediately before the time video playback start time VOB_V_S_PTM + STC_offset is set as the audio frame y. In step S114, the audio data from the audio frame x + 2 to the audio frame y is cut out from the front audio data. In FIG. 24 (a), the audio frames after the audio frame y + 1 are shown by a broken line, which means that the portion shown by the broken line is not multiplexed into the VOB. Since the audio frame moved to the rear VOB is given a time stamp in the front VOB, the process of reassigning the time stamp to the rear VOB is performed.
【0162】
In step S115, the audio frame u, which is the next audio frame of the audio frame including the audio frame y and the boundary of the audio frame y + 1, is detected from the audio frame sequence of the rear VOB. If a perpendicular line is drawn from the boundary between the audio frame y and the audio frame y + 1, it intersects with any one of the audio frames in the audio frame sequence of the rear audio data. The audio frame next to this intersected audio frame is the audio frame u.
【0163】
FIG. 24 (d) shows the case where the playback end time of the audio frame y and the audio frame boundary of the rear VOB match. If they match in this way, the audio frame immediately before this time is defined as the audio frame u. In step S116, an audio pack G4 containing an audio data string headed with audio data to be played in the audio frame u is generated from the audio stream of the rear VOB. In FIG. 24 (a), the audio frame before the audio frame u is shown by a broken line, which means that the portion of the rear audio data shown by the broken line is not multiplexed with the VOB.
【0164】
It can be seen from the above steps S114 to S116 that the first audio frame of the front audio data to the audio frame x + 1 are multiplexed into the front VOB. It can be seen that the audio frame x + 2 to the audio frame y of the front audio data and the audio frame u to the last audio frame of the rear audio data are multiplexed in the rear VOB. Due to such multiplexing, the audio frame at the end of the rear audio data is read from the DVD-RAM at the same time as the picture data to be reproduced in the future in terms of time.
【0165】
At this time, if the audio data of the front VOB does not exist up to the audio frame y, that is, if it is short, silent audio frame data is interpolated only for the missing audio frame. Similarly, if the audio data of the rear VOB does not exist from the audio frame u, that is, if it is short, only the missing audio frames are interpolated with silent audio frame data.
【0166】
Here, when trying to multiplex the audio frame x + 2 to the audio frame y of the front audio data and the audio frame u to the last audio frame of the rear audio data to the rear VOB, the problem is. , AV synchronization. As shown in FIGS. 24 (a) to 24 (d), a playback gap is generated between the audio frame y and the audio frame u, and if this playback gap is ignored and multiplexing is performed, the audio frame u will be generated. There will be a synchronization gap such as faster display with respect to the video display.
【0167】
In order to prevent such an increase in deviation, a time stamp indicating the audio frame u may be added to the audio packet. Therefore, in step S117, a Padding-Packet or stuffing byte is inserted after the data of the audio frame y in the pack so that the audio frame u is not stored in the pack containing the audio frame y, and the audio frame u is the next pack. Start from the beginning of.
【0168】
In step S118, among the audio data extracted from the VOBU located at the end of the front VOB, the audio data up to the audio frame x + 1 and the re-encoded video data are multiplexed to obtain the front VOB. Create a VOBU column located at the end. In step S119, the data after the audio frame x + 2 and the video data extracted from the VOBU located at the tip of the rear VOB are multiplexed to create a VOBU to be placed at the tip of the rear VOB.
【0169】
Specifically, an audio pack G3 containing an audio data string from the first audio frame x + 2 to an audio frame y and a padding-Packet, and an audio pack containing an audio data string after the audio frame u of the rear audio data. Control the system encoder 2e to multiplex the G4 and re-encoded video data and create a VOBU that should be placed at the tip of the rear VOB. Due to such multiplexing, the audio frame at the end of the front audio data is read from the DVD-RAM at the same time as the picture data to be reproduced in the future in terms of time.
【0170】
FIG. 25 shows how an audio pack containing multiple audio data to be played in a plurality of audio frames and a video pack containing picture data to be played in each video frame are multiplexed. It is a figure which shows. In FIG. 25, it can be said that the transfer of the picture data V_TOP to be decoded at the beginning of the rear VOB is completed within the time "Tf_Period". The pack column arranged directly below the time "Tf_Period" constitutes the picture data V_TOP.
【0171】
In this figure, the audio pack G3 including the audio gap is an audio pack in which the audio data x + 2, y-1, y to be reproduced in the audio frames x + 2, y-1, y are stored therein. .. Of the audio data stored in this audio pack, the earliest audio data that should be decoded is audio data x + 2. Since this audio data should be decoded at the playback end time of the audio frame x + 1, the DVD-RAM together with the picture data V_TOP in which the pack sequence is transferred at the same time (Tf_period) as this audio frame x + 1. Should be read. Therefore, as shown at the bottom of FIG. 9, it is inserted between the video pack row P51 storing the picture data V_TOP and the video pack row P52.
【0172】
The audio pack G4, which stores the audio data u, u + 1, u + 2 to be played in the audio frame u, u + 1, u + 2, is the audio data u as the audio data to be decoded earliest. Since this audio data should be decoded at the playback start time of the audio frame u, it is read from the DVD-RAM together with the picture data V_NXT in which the pack sequence is transferred at the same time as this audio frame u. Should be. Therefore, as shown at the bottom of FIG. 25, it is inserted between the video pack P52 storing the picture data V_TOP and the video pack P53 storing the picture data V_NXT.
【0173】
As described above, the audio pack G3 including the audio gap is inserted between the video pack row P51 and the video pack row P52, and the audio pack G4 is inserted between the video pack row P53 and the pack P54. By doing so, multiplexing is completed. Subsequently, in step S120, the control unit 1 fills in the FIRST_SCR, LAST_SCR, seamless flag, VOB_V_E_PTM, and VOB_V_S_PTM of the front VOB and the rear VOB in the seamless connection information of the front VOB. In the following steps S121 and S122, the audio gap start time A_STP_PTM, the audio gap length A_GAP_LEN, and the audio gap position information A_GAP_LOC are described in the seamless connection information in order to record all the information related to the audio gap in the seamless connection information.
【0174】
After the above processing, seamless connection information is written to the DVD-RAM at the end of the front VOB and the tip of the rear VOB. Here, SCR is given to the video data obtained by re-encoding, the video pack storing the audio data, and the audio pack in ascending order. When assigning in ascending order, the SCR value before re-encoding given to the pack located at the beginning in the re-encoding range is used as the initial value of SCR.
【0175】
The SCR indicates the time when each video pack and audio pack should be input to the video buffer 4b-audio buffer 4c, so if the number of data changes before and after re-encoding, the SCR must be updated again. Even so, normal decoding is possible, for example, as long as the re-encoded tip SCR in the rear VOB is below the SCR of the rest of the video pack outside the re-encode range.
【0176】
PTS and DTS are given based on video frames and audio frames, and do not change significantly after re-encoding. Therefore, the continuity between the DTS-PTS outside the re-encoding range and the DTS-PTS within the re-encoding range is maintained. Next, a case where discontinuity of time stamps occurs will be described. In order to play two VOBs seamlessly, it is necessary to avoid the occurrence of time stamp discontinuity. Therefore, the presence or absence of SCR duplication is determined in step S123. If there is no duplication, the processing of this float chart is terminated, but if there is duplication, the overage amount A is calculated based on the number of packs to which the duplicate SCR is given in step S124. The process proceeds to step S110 so that the code amount based on the over amount A is determined and the encoding is performed again.
【0177】
The six VOBUs newly multiplexed by this float are output to the disk access section 3 as shown by the dashed arrow (5), and the disk access section 3 outputs these VOBU columns to the DVD-RAM. Write. In addition, in the flow chart of FIGS. 21 to 22, the seamless connection between two VOBs has been described, but the seamless connection may be performed for the partial section included in one VOB. For example, when some VOBU # 2, # 4, # 6, # 8 are partially deleted as shown in Fig. 6 (b), the VOBU column located in front of the deletion range and the back of the deletion range The seamless connection shown in FIGS. 21 and 22 may be made with the located VOBU row.
【0178】
The reproduction procedure in the case of continuously reproducing two VOBs processed for seamless connection by the above procedure will be described. When the operator instructs to play two or more VOBs recorded in the AV file continuously, the control unit 1 is shown in the seamless connection information about the VOB on the rear side of the two VOBs. Refer to the seamless flag. When the seamless flag is set, the time obtained by subtracting the video playback start time VOB_V_S_PTM of the subsequent VOB from the video playback end time VOB_V_E_PTM of the preceding VOB is set as STC_offset, and the adder is added to the reference time clocked by STC4g. Control 4h. After that, the buffer input time FIRST_SCR of the preceding VOB shown in the seamless connection information is collated with the reference time measured by STC4g. When this reference time reaches this FIRST_SCR, switch SW1 is controlled so that the output is switched from the reference time measured by STC4g to the offset reference time to which the offset is added by the adder 4h. After that, SW2 to SW4 are switched as shown in the timing chart of FIG.
【0179】
As described above, according to the present embodiment, by reading only the terminal portion-tip portion of the VOB and re-encoding it, it is possible to process so that the reproduction of a plurality of VOBs is seamlessly performed. Since the target of re-encoding is only the VOBU located at the end-tip of the VOB, the re-encoding of the VOB can be completed in a very short time. In the present embodiment, seamless connection information is managed for each VOB, but the information required for seamless connection between VOBs may be collected in one place. For example, the video playback end time VOB_V_E_PTM and the video playback start time VOB_V_S_PTM required to obtain the STC_offset are described separately for the two VOB information, but they may be described as the seamless connection information of the subsequent VOB. In this case, it is desirable to provide an information element called the playback end time (PREV_VOB_V_E_PTM) of the previous VOB in the VOB information.
【0180】
Similarly, it is desirable that LAST_SCR also has an information element called the previous VOB end SCR (PREV_VOB_LAST_SCR) as seamless connection information of the subsequent VOB. Further, in the present embodiment, the DVD recorder 70 is configured on the premise that it is substituted for the conventional stationary home VTR, but when the DVD-RAM is also used as a recording medium of a computer, the following The configuration may be as follows. That is, the disk access unit 3 is connected to the computer bus as a DVD-RAM drive device via a SCSI, IDE, or IEEE1394 compliant interface. In addition, the components other than the disk access unit 3 in the figure are realized by executing the OS and application programs on the hardware of the computer.
【0181】
This DVD recorder 70 has a control unit 1, an MPEG encoder 2, a disk access unit 3, a decoder 4, a video signal processing unit 5, a remote controller 71, a bus 7, a remote controller signal receiver 8, and a receiver 9. Further, in the present embodiment, although the video stream and the audio stream are multiplexed in the VOB, the sub-video data in which the subtitle characters are run-length compressed may be multiplexed. Further, the video stream constituting the still image data may be multiplexed.
【0182】
In addition, in the present embodiment, the VOB is decoded by the decoder 4 and then re-encoded by the MPEG encoder 2, but the disk access unit 3 directly outputs the VOB to the MPEG encoder 2 without decoding. May be re-encoded. In addition, in the present embodiment, all units are described by video frames and audio frames, but a video stream using a 3: 2 pull-down used when compressing a video of 24 frames / second like a film material. In this case, 1.5 frames = 1 picture may be set instead of 1 frame = 1 picture. The present invention does not substantially rely on 3: 2 pull-down, and in this case is not limited to the frames described above.
【0183】
Finally, the procedure (Figs. 21 to 22) of the processing module software explained with reference to the flowchart in the first embodiment is realized by a machine language program, recorded on a recording medium, and targeted for distribution and sale. You may. Such recording media include IC cards, optical discs, floppy disks, and the like, and the machine language programs recorded on these media can be used by being installed in a general-purpose computer. This general-purpose computer sequentially executes the installed machine language program to realize the function of the video data editing device shown in the present embodiment.
【0184】
(Second Embodiment) Whereas the first embodiment presupposes seamless connection processing between VOBs, the second embodiment is an embodiment relating to seamless connection of a plurality of subsections included in VOBs. Regarding how to specify this subsection, in the second embodiment, it is assumed that the subsection is specified by using the time information representing the video field. The video field referred to here is a unit finer than a video frame, and the time information can be expressed using the PTS of the video pack.
【0185】
The subsection specified by using the time information about the video field is called a cell, and the information for designating the subsection is called cell information. The cell information is recorded in the RTRW management file as an information element of PGC information. The data structure of cell information and PGC information and the procedure for creating the data structure will be described in detail in the fourth embodiment. FIG. 26 is a diagram showing an example of a partial section specified by a video field serving as a start point and an end point. The set of time information C_V_S_PTM and C_V_E_PTM in FIG. 26 identifies the video fields that serve as the start point and end point.
【0186】
C_V_S_PTM in FIG. 26 is the playback start time of the video field in which the P picture in VOBU # 100 constituting the VOB should be played, and C_V_E_PTM is the playback start time of the B picture 1 in VOBU # 105 constituting the same VOB. It specifies the playback end time of the video field to be. C_V_S_PTM and C_V_E_PTM specify the partial section from P picture to B picture 1 in FIG. 26 as a cell.
【0187】
(2-1) Reconstruction of GOP structure When seamlessly connecting the VOB subsections specified by the time information, two processes that were not necessary in the first embodiment are required. The first of these is the process of reconstructing the GOP structure in order to convert the subsection specified by the time information into an independent VOB. The second process is a process that predicts an increase in buffer occupancy due to the reconstruction of the GOP structure.
【0188】
Here, the reconstruction of the GOP structure means a process of reconstructing the GOP structure so that the sub-intervals specified by the cells have a proper display order and coding order. More specifically, when a subsection to be concatenated is specified by cell information, an editing boundary may be defined in the middle of VOBU as shown in FIG. 28 (a). If the editing boundary is set at such a position, the two cells to be concatenated cannot have a proper display order and coding order.
【0189】
In order to justify the display order and coding order, when reconstructing the GOP structure, processing is performed according to the following three rules shown in FIG. 28 (b). The process according to the first rule is a process of re-encoding this picture data into a P picture (or I picture) when the last picture data is a B picture in the display order of the front cell. Further, the future P picture referred to by the B picture exists before the B picture in the coding order, but is not displayed, so it is deleted from the VOB.
【0190】
The process according to the second rule is a process of re-encoding this picture data into an I picture when the first picture data is a P picture in the coding order of the front cell. The processing according to the third rule is that if the plurality of picture data located at the beginning are B picture groups in the display order of the front cell, this picture data is regarded as an image to be reproduced in the past direction. Picture data that does not depend on the correlation characteristics of (this means picture data that depends on the correlation characteristics with the image to be reproduced in the future direction. Hereinafter, picture data of this picture type is referred to as Forward-B picture). It is a process to fix.
【0191】
(2-2) Prediction processing of increase in buffer occupancy The process of predicting the amount of increase in the buffer occupancy is a process of predicting the size of the changed picture data when the picture type is changed based on the above three rules. When the above reconstruction process is performed on the front cell, the picture data located at the end is changed from the B picture to the P picture or the I picture in the display order of the front cell, so that the size becomes larger. ..
【0192】
When the above reconstruction process is performed on the rear cell, the picture type of the picture data located first in the coding order of the rear cell is changed from P picture to I picture, and the video data located first in the display order is changed. As the picture type changes to Forward-B picture, its size becomes larger. Now, how to predict the increase in size due to the change of the picture type will be described. FIGS. 29 (a) and 29 (b) are explanatory diagrams for explaining how to predict an increase in buffer occupancy due to a change in the picture type in the front cell.
【0193】
In FIG. 29 (a), it is assumed that up to B picture B3 of VOB belongs to the front cell. According to the above rule, this B picture B3 must be changed to P picture P1. Here, when the B picture B3 has an information component depending on the P picture P2 to be reproduced in the future, when the picture type is changed, the information component of the P picture P2 is the changed P. It should be captured in picture P2.
【0194】
Considering this, the size of P picture P1 to be obtained by changing the picture type can be predicted based on the sum of the size of B picture B3 and the size of P picture P2 (note that this is the case). This prediction method is just an example, and it goes without saying that other prediction methods may be used). If the code amount at the time of re-encoding is determined based on the buffer occupancy predicted in this way, the optimum code amount can be assigned to the front cell and the rear cell.
【0195】
30 (a) and 30 (b) are explanatory diagrams for explaining how to predict an increase in buffer occupancy due to a change in the picture type in the rear cell. In FIGS. 30 (a) and 30 (b), it is assumed that the B picture B3 of the VOB belongs to the rear cell. Since the beginning of the cell is determined based on the display time, the B picture B3 is the picture data located at the beginning of the display order of the rear cell. Therefore, according to the above rule, B picture B3 must be changed to Forward-B picture B1. Here, when the B picture B3 has an information component depending on the P picture P2 to be reproduced in the past, the information component of the P picture P2 is taken into the Forward-B picture B1 when the picture type is changed. It should be.
【0196】
Considering this, the size of Forward-B picture B1 to be obtained by changing the picture type can be predicted based on the sum of the size of B picture B3 and the size of P picture P2. For the rear VOB, the picture type of the picture data at the beginning of the coding order must also be changed. By referring to the display order of the rear VOB, it can be seen that the P picture P3 exists as the picture data to be displayed immediately after the B picture B3. This P picture P3 is stored in the reorder buffer 4f until the decoding of the B picture B3 is completed, and is displayed after waiting for the decoding of the B picture B3. Due to the reorder via the re-order buffer 4f as described above, the P picture P3 is displayed after the B picture B3, but the coding order should be preceded by the P picture P3. According to the above rule, the P picture P3 detected as the first picture data in the coding order in this way must be changed to the I picture. Here, when the P picture P3 has an information component depending on the I picture to be reproduced in the past, the information component of this I picture is taken into the P picture P3 when the picture type is changed. It should be.
【0197】
Considering this, the size of I picture I to be obtained by changing the picture type can be predicted based on the value obtained by adding the size of P picture P3 and the size of the I picture located immediately before. If the code amount at the time of re-encoding is determined based on the buffer occupancy predicted in this way, the optimum code amount can be assigned to the front cell and the rear cell.
【0198】
(2-3) Processing procedure for seamlessly connecting subsections FIG. 31, FIG. 32, and FIG. 33 are flowcharts showing a processing procedure for processing so that the reproduction of the two cells is seamlessly performed. In addition, this float has many steps described by replacing the term "VOB" with "cell" in the procedures shown in FIGS. 21 and 22. Reference numerals similar to those in the first embodiment are attached to these steps to simplify the description.
【0199】
FIG. 34 is a diagram showing which audio frame of the audio stream the audio frame x, the audio frame x + 1, and the audio frame y used in FIG. 31 correspond to. In step S102, the control unit 1 determines the time information for specifying the end portion of the partial section to be reproduced in advance (hereinafter referred to as the front section) and the partial section to be reproduced subsequently (hereinafter referred to as the rear section). STC_offset is obtained by subtracting C_V_S_PTM in the rear cell from C_V_E_PTM in the front cell based on the time information that identifies the tip.
【0200】
In step S103, the control unit 1 analyzes the change in the buffer occupancy from FIRST_SCR in the front cell to the decoding end time LAST_DTS of all the data in the front cell. In step S104, the control unit 1 analyzes the change in the buffer occupancy from FIRST_SCR in the rear cell to the decoding end time LAST_DTS of all the data in the rear cell by performing the same analysis in step S103 on the rear cell.
【0201】
In step S130, the control unit 1 predicts the increase amount α of the buffer occupancy due to the change of the picture type of the rear cell according to the procedure shown in FIG. In step S131, the increase β of the buffer occupancy due to the picture type change of the front cell is predicted according to the procedure shown in FIG. In step S132, the increments α and β are added to the buffer occupancy of the front cell and the rear cell.
【0202】
In step S105, the control unit 1 analyzes the change in the video buffer occupancy from FIRST_SCR + STC_offset in the rear cell to LAST_DTS in the front cell. As shown in FIG. 10 (c) of the first embodiment, the maximum storage amount Bv1 + Bv2 of the video buffer 4b is obtained in the state where the video data of both the front cell and the rear cell are stored in the video buffer 4b.
【0203】
In step S106, the control unit 1 controls the disk access unit 3 to read three VOBUs that are considered to contain picture data located at the end of the front cell. Subsequently, in step S107, the disk access unit 3 is controlled so as to read out three VOBUs that are considered to include the picture data located at the tip of the rear cell.
【0204】
FIG. 27 (a) is a diagram showing a reading range to be read from the front cell in step S106. It is assumed that VOB contains VOBU # 98 to # 107 in FIG. 27 (a), of which VOBU # 99 to # 105 are designated as front cells. If the last picture data to be displayed in the front cell is the picture data Bend, this picture data Bend is included in VOBU # 103 to # 105 according to the 1-second rule, so the last picture to be displayed. VOBU # 103 to # 105 will be read as VOBU columns containing data.
【0205】
It is assumed that VOB contains VOBU # 498 to # 507 in FIG. 27 (b), of which VOBU # 500 to # 506 are designated as rear cells. If the picture data to be displayed first in the rear cell is the picture data Ptop, since this picture data Ptop is included in VOBU # 500 to # 502, the VOBU column containing the picture data to be displayed first. As a result, VOBU # 500 to # 502 will be read. Since these VOBUs include all picture data that have a dependency on the picture data Ptop and the picture data Bend, in addition to the audio data that should be played at the same time as the picture data Ptop and the picture data Bend, the picture type is changed. All the picture data necessary for this is read out.
【0206】
In this float, reading was performed in units of 3 VOBUs, but the number of VOBUs may be any number. Instead of reading in VOBU units, only all of the picture data and audio data included in VOBU that should be played back in one second may be read. Further, video data and audio data to be played in a period longer than 1 second may be read out.
【0207】
After reading, in step S108, the control unit 1 controls the demultiplexer 4a so as to separate the VOBUs located at the front end and the end into video data and audio data. In step S109, it is determined whether the buffer accumulation amount at each decoding timing exceeds the upper limit value of the buffer during the period in which the front cell and the rear cell are mixed in the buffer. Specifically, it is determined whether the value of Bv1 + Bv2 calculated in step S105 exceeds the upper limit value of the buffer. If it does not exceed, the process proceeds to step S133, but if it exceeds, the code amount based on the over amount A is assigned to the front cell and the rear cell in step S110. Note that you may re-encode only one of the front and rear cells, not both. In step S111, the video data obtained from the two cells is re-encoded with the front video data based on the code amount assigned in step S110.
【0208】
Obtain the newly assigned FIRST_SCR for the re-encoded rear video data in step S133. It goes without saying that STC_offset + FIRST_SCR is located in the past direction in FIG. 34 because the picture type of the first picture data in the display order of the rear VOB and the first picture data in the coding order have been changed to larger picture data. Nor.
【0209】
In step S112, among the audio data obtained by separating the front cell, the audio data corresponding to the audio frame x including FIRST_SCR + STC_offset newly assigned to the rear video data is calculated. In FIG. 34, the upper graph shows the buffer state by the video data of the front cell and the rear cell, and in the lower part of FIG. 34, the audio frame of the audio data obtained by separating the front cell is arranged. Has been done. The lower audio frame sequence clarifies the correspondence between the time axis of the upper graph and each audio frame. Here, the buffer occupancy of the newly obtained rear cell by re-encoding is increased by α1 (α1 means that the increase amount α is different from the increase amount α predicted in step S132). Due to the quantity α1, the FIRST_SCR newly added to the rear video data will indicate the past more.
【0210】
Even if you refer to the upper graph, you can see that the new FIRST_SCR + STC_offset is located in the past by the time Tα1. If you draw a perpendicular from this new FIRST_SCR + STC_offset, this perpendicular intersects one of the audio frames in the front cell's audio frame sequence. This intersecting audio frame is the audio frame x, and the immediately following audio frame x + 1 is the last audio data contained in the front cell.
【0211】
Since the STC_offset + new FIRST_SCR of the rear video data is located in the past direction, the audio frame in the past direction corresponds to the audio frame x. Since the audio frame in the past direction corresponds to the audio frame x, the front audio data to be read together with the video data becomes larger than that of the first embodiment at the start of reading the video data in the rear cell.
【0212】
After that, the system encoder 2e is made to perform the multiplexing as shown in FIG. 25 by performing the processes of steps S113 to S119. Subsequently, in step S120, FIRST_SCR, LAST_SCR, seamless flag, VOB_V_E_PTM, VOB_V_S_PTM of the front cell and the rear cell are entered in the seamless connection information of the front cell, and then the processes of steps S121 to S122 are performed. Of the 6 VOBU data obtained by re-encoding, the 3 VOBU (preceding VOBU) placed in advance is originally for the front section, so it is added to the rear of the front section. Since the 3VOBU (subsequent VOBU) placed after the re-encoded data is originally for the rear section, it is added before the rear section. One of the front section and the rear section to which the re-encoded data is added is assigned and managed with the same identifier as the VOB of the division source, but the other is assigned an identifier different from the VOB of the division source. Be managed. In other words, after the division, the front section and the rear section are managed as separate VOBs. This is because the boundary between the front section and the rear section is likely to be a discontinuous boundary of the time stamp.
【0213】
Subsequently, as in the first embodiment, the continuity of the SCR is determined in step S123. If there is continuity, the processing of this float chart is terminated, but if there is no continuity, the overage amount A is calculated based on the number of packs to which the duplicate SCR is given in step S124. , The code amount based on the over amount A is determined, and the process proceeds to step S109 so that the encoding is performed again.
【0214】
When the cell is re-encoded through the above procedure, these subsections specified by the cell information become independent VOBs. Then, in the RTRW management file, VOB information about the newly generated VOB is required. How to define VOB information for a subsection will be described below.
【0215】
The "video stream attribute information" includes compression mode information, TV system information, aspect ratio information, and resolution information, but the information set for the VOB of the cutout source of the partial section may be used as it is. The "audio stream attribute information" includes the coding mode, the presence / absence of dynamic range control, the sampling frequency, the number of channels, etc., but the information set for the VOB of the cutout source of the partial section may be used as it is. ..
【0216】
The "time map table" consists of the size of each VOB that makes up the VOB and the display time of those VOBs. These cut out a part of the information set for the VOB that is the source of the partial section. Then, only the re-encoded VOBU is modified in size and display time. Next, the "seamless connection information" generated in step S133 will be described. The seamless connection information consists of "seamless flag", "video playback start time VOB_V_S_PTM", "video playback end time VOB_V_E_PTM", "FIRST_SCR", "LAST_SCR", "audio gap start time A_STP_PTM", and "audio gap length A_GAP_LEN". , I will describe this information individually.
【0217】
The "seamless flag" is used between the front section and the rear section. (1) The video stream display method (NTSC, PAL, etc.) shown in the video attribute information is the same. (2) The encoding method (AC-3, MPEG, LPCM, etc.) of the audio stream shown in the audio attribute information is the same.
【0218】
Set to 01 only when all the relationships (1) and (2) are satisfied, and set to 00 when even one of the relationships (1) and (2) is not satisfied. "Video playback start time VOB_V_S_PTM" is updated to the playback start time after re-encoding. "Video playback end time VOB_V_E_PTM" is updated to the playback end time after re-encoding.
【0219】
"FIRST_SCR" is updated to the SCR of the first pack after re-encoding. "LAST_SCR" is updated to the SCR of the final pack after re-encoding. Audio gap start time A_STP_PTM sets the playback end time of the last audio frame y played by the plurality of audio data transferred to the rear cell in FIG. 34.
【0220】
Audio gap length A_GAP_LEN sets the time length from the playback end time of the last audio frame y played by the plurality of audio data transferred to the rear cell in FIG. 34 to the playback start time of the audio frame u. VOB information is generated as described above, and the RTRW management file including this is recorded on DVD-RAM. As a result, the two subsections specified in the cell information are recorded on the DVD-RAM as two VOBs that are played seamlessly.
【0221】
As described above, according to the present embodiment, by reading out only the end portion-tip portion of the cell and performing re-encoding, it is possible to process the VOB so that the partial sections are seamlessly reproduced. Since the target of re-encoding is only the VOBU located at the end-tip of the cell, the cell re-encoding can be completed in a very short time.
【0222】
In the present embodiment, the partial section is specified by the time accuracy of the video field, but it may be specified by the time accuracy of the video frame. In addition, the procedure of the processing module software (Figs. 31 to 33) explained with reference to the flowchart in the second embodiment is realized by a machine language program, and this is recorded on a recording medium for distribution and sale. You may. Such recording media include IC cards, optical discs, floppy disks, and the like, and the machine language programs recorded on these media can be used by being installed in a general-purpose computer. This general-purpose computer sequentially executes the installed machine language program to realize the function of the video data editing device shown in the present embodiment.
【0223】
(Third Embodiment) The third embodiment is an embodiment for managing an AV file on a file system and realizing video editing with a higher degree of freedom. (3-1) Deletion configuration on DVD-RAM The RTRW management file and AV file shown in the first embodiment are arranged in the directory shown in FIG. 35 in the file system specified in ISO / IEC 13346. FIG. 35 is a diagram showing a directory structure in which the RTRW management file and AV file shown in the first embodiment are arranged. In FIG. 35, the elliptical figure represents a directory and the rectangle represents a file. The root directory has one directory called RTRW and two files File1.DAT and File2.DAT, and the RTRW directory has three files Movie1.VOB, Movie2.VOB and RTRWM.IFO. ..
【0224】
(3-1-1) File system management information in the directory In the directory structure shown in FIG. 35, what kind of management information is used to manage the RTRW management file and the AV file will be described. FIG. 36 is a diagram showing management information for the file system in the directory shown in FIG. 35. In the figure, the volume space shown in FIG. 3 (d), the sectors, and the recorded contents of the sectors are shown hierarchically. The arrows ~ in the figure indicate the order in which the recording positions of the file "Movie1.VOB" are specified according to the management information in the figure.
【0225】
The first layer of the figure shows the volume space shown in FIG. 3 (d). The second layer shows file set descriptors, termination descriptors, file entries, directories, etc. among the management information. This information complies with the file system specified in ISO / IEC 13346. The file system specified in ISO / IEC 13346 realizes hierarchical directory management.
【0226】
The management information in FIG. 36 is illustrated along this directory structure. However, the recording area of each file shows only the AV file Movie1.VOB. The file set descriptor (LBN80) in the second layer indicates the LBN of the sector in which the file entry of the root directory is recorded. The termination descriptor (LBN81) indicates the termination of the fileset descriptor.
【0227】
File entries (LBN82, 584, 3585, etc.) are recorded for each file (including directories) and indicate the recording location of the file or directory. The file entry for a file and the file entry for a directory are defined in the same format so that a hierarchical directory structure can be freely constructed.
【0228】
A directory (LBN83, 584, 3585, etc.) indicates the recording location of the file entry for each file contained in the directory and for each directory. The third layer illustrates three file entries and two directories. File entries and directories are tracked by the file system and have a data structure that allows you to locate a particular file, no matter how hierarchical the directory structure is.
【0229】
Each file entry contains an allocation descriptor that indicates the recording location of the file or directory. If the data contained in the file is divided into a plurality of extents, the file entry will have a plurality of allocation descriptors for each esttent data. Here, the extent is a partial section of data recorded in a file and should be stored in a continuous area. For example, if the size of the VOB to be recorded in the AV file is large and there is no continuous area to store it, the AV file cannot be recorded in DVD-RAM. However, when multiple small continuous areas are scattered in the partition space, if the VOB to be recorded in the AV file is divided into multiple parts, each subsection obtained by the division is divided into the scattered continuous areas. Can be recorded. By dividing in this way, the probability that the VOB can be recorded as an AV file increases even when the number and length of continuous areas in the partition space are restricted. In order to improve the recording rate in DVD-RAM, the VOB to be recorded in the AV file is divided into a plurality of parts, and each extent obtained by the division is recorded in a scattered continuous area.
【0230】
Although it should be clarified so that there is no doubt in interpretation, the continuous area means an area consisting of logically or physically continuous ECC blocks. For example, each file entry in LBN82, 584 in Figure 36 contains one allocation descriptor, which means that the file is not split into multiple extents (consisting of one extent). In contrast, the LBN3585 file entry contains two allocation descriptors, which means that the data to be stored in the file consists of two extents.
【0231】
Each directory contains a file identification descriptor indicating the recording position of the file entry for each file and directory contained in the directory. According to such file entries and directories, for example, as shown by the arrow in the figure, the recording position of the "root / video / Movie1.VOB" file is the file set descriptor file entry (root) directory ( It is tracked in the order of root) file entry (RTRW) directory (RTRW) file entry (Movie1.VOB) file (extensions # 1 and # 2 of Movie1.VOB).
【0232】
Figure 37 shows a rewrite of the link relationship between the file entry and the directory on this route along the directory structure. In the figure, the root directory contains each file identification descriptor for the parent directory (the root parent is the root itself), the RTRW directory, the File1.DAT file, and the File2.DAT file. The RTRW directory also includes file identification descriptors for the parent directory (root) directory, Movie1.VOB file, Movie2.VOB file, and RTRWM.IFO file. Also in the figure, the recording position of the Movie1.VOB file is specified by following ~ above. (3-1-2) File entry data structure FIG. 38 (a) is a diagram showing a more detailed data structure of the file entry. As shown in the figure, the file entry has a descriptor tag, an ICB tag, an allocation descriptor length, extended attributes, and an allocation descriptor. In the figure, BP represents a bit position and RBP represents a relative bit position.
【0233】
The descriptor tag is a tag indicating that it is a file entry. There are various types of tags in DVD-DAM, such as a file entry descriptor and a space bitmap descriptor. In the case of a file entry, 261 indicating the file entry is described as a descriptor tag. The ICB tag indicates attribute information about the file entry itself.
【0234】
Extended attributes are information for indicating attributes that are higher than the contents specified in the attribute information field in the file entry. The allocation descriptor field records the same number of allocation descriptors as the extents that make up the file. The allocation descriptor indicates the logical block number (LBN) indicating the recording position of the extent of the file or directory. The data structure of the allocation descriptor is shown in Figure 38 (b). In FIG. 38 (b), the allocation descriptor includes data indicating the extent length and a logical block number indicating the recording position of the extent. However, the upper two bits of the data indicating the extent length indicate the recording status of the extent recording area as shown in FIG. 38 (c). (3-1-3) Data structure of file identification descriptor for directories and files Figures 39 (a) and 39 (b) show the detailed data structure of the file identification descriptors for directories and files contained in the directories, respectively. These two types of file identification descriptors are in the same format, with management information, identification information, the length of the directory name, and the address indicating which logical block number the file entry of the directory or file is recorded in. , Extension information and directory name. This identifies the directory name or the address of the file entry corresponding to the file name.
【0235】
(3-1-4) Minimum size of AV block When dividing a VOB to be recorded in an AV file into multiple extents, the data length must exceed the AV block. Here, the AV block means the minimum length that guarantees that the track buffer 3a does not underflow when reading the VOB from the DVD-RAM.
【0236】
To guarantee continuous playback, the minimum size of the AV block is determined in relation to the track buffer in the playback device. Here, what kind of theory is used to determine the lower limit of the AV block will be described. (3-1-5) Minimum size of AV block area First, the rationale for determining the minimum size for guaranteeing continuous reproduction in (1) above will be described.
【0237】
FIG. 40 is a diagram modeling a state in which AV data read from a DVD-RAM is buffered in a track buffer in a playback device that reproduces a video object. This model defines the minimum specifications that should be provided as a playback device, and continuous playback can be guaranteed as long as this specification is satisfied. In the upper part of FIG. 40, the AV data read from the DVD-RAM is subjected to ECC processing, temporarily stored in the track buffer (FIFO memory), and further output from the track buffer to the decoder. The transfer rate of the track buffer input (reading rate from the optical disk) is Vr, and the transfer rate of the track buffer output (decoder input rate) is Vo (however, Vr> Vo). In this model, Vr = 11Mbps.
【0238】
The lower part of FIG. 40 is a graph showing the change in the amount of data in the track buffer in this model. The vertical axis is the amount of data in the track buffer, and the horizontal axis is time. In the figure, it is assumed that the AV block #j in which the defective sector does not exist and the AV block #k in which the defective sector exists are read in sequence. The period T1 on the time axis is the time required to read all the AV data from the beginning to the end of the AV block #j that does not include the defective sector. During this period, the amount of data in the buffer increases at a rate of (Vr-Vo).
【0239】
The period T2 (hereinafter referred to as the jump period) is the time required for the light pickup from the AV block #j to the AV block #k to jump. The jump time includes the seek time of the optical pickup and the time required for the optical disc rotation to stabilize. This time is the time to jump from the innermost circumference to the outermost circumference at the maximum, which is about 1500 mS in this model. During this period, the amount of data in the buffer decreases at the Vo rate.
【0240】
The periods T3 to T5 are the times required to read all the AV data from the beginning to the end of the AV block #k including the defective sector. Of these, the period T4 is the time to skip the Ecc block in which the defective sector exists and skip to the next Ecc block. This skip means that if there is even one defective sector in the Ecc block, the Ecc block (16 sectors) is skipped and the next continuous Ecc block is jumped. In other words, an Ecc block that has defective sectors in the AV block does not logically replace only the defective sectors with alternative sectors (alternative Ecc blocks), and the Ecc blocks (all 16 sectors) are simply not used. (The above ECC block skip method). This time T4 is the rotation waiting time when the disk makes one rotation at the maximum, and is about 105 mS in this model. In the period T3 and T5, the amount of data in the buffer increases at the rate of (Vr-Vo), but in the period T4, it decreases at the rate of Vo.
【0241】
The size of the AV block is expressed as N_ecc * 16 * 8 * 2048 bits, where N_ecc is the total number of Ecc blocks contained in the AV block. The lower limit of N_ecc for guaranteeing continuous playback can be derived as follows. In period T2, only AV data is read from the track buffer. If the buffer capacity becomes 0 within this period, underflow will occur in the decoder. In this case, continuous playback of AV data cannot be guaranteed. Therefore, in order to guarantee continuous reproduction (to prevent underflow), the following equation must be satisfied. {Formula 1} (Accumulation amount B)> = (Consumption amount R) The buffer storage amount B is the amount of data stored in the buffer at the end of the period T1. Consumption R is the total amount of data read within period T2. > = Means greater than or equal to.
【0242】
The accumulated amount B can be expressed by the following equation. {Formula 2} (Accumulation amount B) = (Period T1) * (Vr-Vo) = (Read time of one AV block) * (Vr-Vo) = (AV block size L / Vr) * (Vr-Vo) = (N_ecc * 16 * 8 * 2048 / Vr) * (Vr-Vo) = (N_ecc * 16 * 8 * 2048) * (1-Vo / Vr) The consumption amount R can be expressed by the following equation. {Formula 3} (Consumption R) = T2 * Vo Replacing both sides of the above (Formula 1) with (Formula 2) (Formula 3) gives the following formula. {Formula 4} (N_ecc * 16 * 8 * 2048) * (1-Vo / Vr)> = T2 * Vo From this equation, the number of Ecc blocks N_ecc for guaranteeing continuous playback must satisfy the following equation. {Formula 5} N_ecc> = Vo * Tj / ((16 * 8 * 2048) * (1 --Vo / Vr)) In this equation, Tj is the jump time described above, with a maximum of 1.5 seconds. Vr is a fixed value (about 11 Mbps in the playback device model in the upper part of Fig. 40). Vo is also expressed by Equation 6 considering that the video object has a variable bit rate. That is, Vo is calculated by Equation 6 not as the maximum value of the physical transfer rate of the track buffer output, but as the input rate of the actual decoder of the AV data of the variable bit rate. However, for the AV block length, the number of packs in the AV block consisting of N_ecc Ecc blocks is N_pack. {Formula 6} Vo = AV block length (bit) * (1 / AV block playback time (sec)) = (N_pack * 2048 * 8) * (27M / (SCR_first_next --SCR_first_current)) Here, SCR_first_next is the SCR of the first pack of the next AV block, and SCR_first_current is the SCR of the first pack of the AV block. The SCR indicates the time when the pack should be output from the track buffer to the decoder, in units of (1 / 27M) sec.
【0243】
As shown in (Formula 5) and (Formula 6) above, the minimum size of the AV block can be theoretically calculated according to the bit rate of the AV data actually recorded. Further, the above equation 5 is valid when there are no defective sectors in the optical disc, but when there are defective sectors, the number of Ecc blocks N_ecc for guaranteeing continuous reproduction will be described.
【0244】
It is assumed that there are dN_ecc ECC blocks having defective sectors in the AV block area. AV data is not recorded in these dN_ecc ECC blocks due to the above ECC block skip. The loss time Ts due to skipping dN_ecc ECC blocks is expressed as T4 * dN_ecc (T4 is the ECC block skip time in the model in Figure 40).
【0245】
Taking these factors into equation 5, in order to guarantee continuous reproduction even when defective sectors exist, the continuous area of the number of ECC blocks N_ecc satisfying the following equation may be set as the AV block area. {Formula 7} N_ecc> = dN_ecc + Vo * (Tj + Ts) / ((16 * 8 * 2048) * (1 --Vo / Vr)) As described above, the AV block area may have a size that satisfies Equation 5 when there are no defective sectors and Equation 7 when there are defective sectors.
【0246】
However, when one continuous AV data consists of multiple AV blocks, not all AV blocks need to satisfy Formula 5 or Formula 7, and the leading and trailing AV blocks are Formula 5 or Formula 7. Does not have to be satisfied. This is because the last AV block has no subsequent AV data, and the first AV block starts supplying data to the decoder by delaying the decoding start timing, that is, when the data is accumulated in the track buffer. This is because continuous playback can be guaranteed between the first AV block and the next AV block. (3-2) Functional block of DVD recorder 70 FIG. 41 is a functional block diagram showing the configuration of the DVD recorder 70 by function. Each function in the figure is realized by controlling the hardware shown in FIG. 17 by the CPU 1a in the control unit 1 executing the program of the ROM 1e.
【0247】
In FIG. 41, the DVD player includes a disc recording unit 100, a disc reading unit 101, a common file system unit 10, an AV file system unit 11, a recording / editing / playback control unit 12, an AV data recording unit 13, and an AV data playback unit 14. It is composed of AV data editing unit 15. (3-2-1) Disc recording unit 100-Disc reading unit 101 When the logical sector number to start recording and the data to be recorded are input from the common file system unit 10 and the AV file system unit 11, the disk recording unit 100 moves the optical pickup to the logical sector number. , The logical data is recorded on the disk in units of ECC blocks (16 sectors) in the logical sector indicated by the optical pickup. If the data to be recorded in the logical data is less than 16 sectors, the size of the ECC block is changed once, ECC processing is performed, and then the ECC block is recorded.
【0248】
When the logical sector number and the number of sectors for which data should be read are input from the common file system unit 10 and the AV file system unit 11, the disk reading unit 101 moves the optical pickup to the logical sector number and performs the optical pickup. Data is read from the logical sector specified in step 1 in units of ECC blocks. As for the read data, only the necessary sector data is transferred to the common file system unit 10 through ECC processing. As with the disk recording unit, the overhead is reduced by reading in 16-sector units for each ECC block when reading the VOB. (3-2-2) Common file system section 10 The common file system unit 10 records standard functions for accessing ISO / IEC 13346 compliant data formats: recording / editing / playback control unit 12, recording / editing / playback control unit 12, AV data recording unit 13, and AV data playback unit. 14, Provided to AV data editorial department 15. The standard function provided by the common file system unit 10 means controlling the disk recording unit 100 and the disk reading unit 101 so as to read / write DVD-RAM in directory units and file units. A typical standard function provided by the common file system unit 10 is a function of recording a file entry in the disk recording unit 100 and outputting a file identification descriptor to the recording / editing / playback control unit 12 and the like (1). ), A function to release the recording area occupied by one file on the disk to free area (2), and control the disk reading unit 101 to read the file identification descriptor of the specified file from the DVD-RAM. Function (3), function to control the disk recording unit 100 to record the data existing in the memory on the disk as a non-AV file (4), to read the extensions that make up the file recorded on the disk There are types such as a function of controlling the disk reading unit 101 (5) and a function of controlling the disk reading unit 101 so as to move the optical pickup to a desired position on the extension that constitutes the file (6).
【0249】
In order to receive the provision of these functions (1) to (6), the recording / editing / playback control unit 12 to the AV data editing unit 15 specify a file to record data or a file to read data as a parameter. The command (hereinafter referred to as the command for the common file system) may be issued to the common file system unit 10. There are various types of commands for the common file system, such as "(1) CREATE", "(2) DELETE", "(3) OPEN / CLOSE", "(4) WRITE", "READ", and "SEEK". It is assigned to each of the above functions (1) to (6). The assignment of the above standard functions and commands in this embodiment is set as follows. That is, in order to receive the provision of the function (1), the recording / editing / playback control unit 12 to the AV data editing unit 15 may issue a CREATE command to the common file system unit 10. In order to receive the function (2), the recording / editing / playback control unit 12 to the AV data editing unit 15 may issue a DELETE command to the common file system unit 10, and the functions (3) (4) ( 5) To receive the provision of (6), issue the OPEN / CLOSE command, WRITE command, READ command, and SEEK command, respectively.
【0250】
(3-2-3) AV file system section 11 The AV file system unit 11 is a function that cannot be provided by the common file system unit 10, and records / edits / plays back the extended functions required only for recording the AV file and editing the AV file. Provided to Part 15. Typical of these extended functions are the function to write VOB encoded by MPEG encoder 2 to DVD-RAM as an AV file (7), and the AV data recorded in the AV file, which is specified in advance. A function to cut out the range to another file (8), a function to release a predetermined range to a free area among the AV data recorded in the AV file (9), and two already managed on the DVD-RAM. There is a function (10) to concatenate the AV file of the above and the AV data placed in the memory.
【0251】
In order to receive the provisions from these functions (7) to (10), the recording / editing / playback control unit 12 to the AV data editing unit 15 select a file for recording data or a file for concatenating or cutting out data. The command specified as a parameter (hereinafter referred to as the command for the AV file system) may be issued to the AV file system unit 11. There are types of commands for AV file systems, "(7) AV-WRITE", "(8) SPLIT", "(9) SHORTEN", and "(10) MERGE", and these commands have the above functions ( It is assigned to each of 7) to (10). The assignment between the above-mentioned extended function and the command in this embodiment is set as follows. That is, in order to receive the provision of the function (7), the recording / editing / playback control unit 12 to the AV data editing unit 15 may issue an AV-WRITE command, and in order to receive the provision of the function (8), the recording -Editing / playback control unit 12 to AV data editing unit 15 may issue SPLIT commands. To receive the functions (9) and (10), issue the SHORTEN command and MERGE command. In function (10), the extent of the concatenated file is concatenated so that it is equal to or longer than the AV block length. (3-2-4) Recording / editing / playback control unit 12 The recording / editing / playback control unit 12 issues a OPEN command in which each directory name is specified as a parameter to the common file system unit 10 to issue a plurality of file identification descriptors already recorded in the DVD-RAM to the common file system. Part 10 is made to read, analyze the directory structure in DVD-RAM from these file identification descriptors, and receive the designation of the directory and the file to be operated in this directory structure from the operator. When the operation target is specified, the operation content by the operator is specified based on the user operation notified from the remote control signal receiving unit 8, and the operation content processing is performed for the directory and file specified as the operation target. Instruct the data recording unit 13, the AV data playback unit 14, and the AV data editing unit 15 to perform the operation.
【0252】
When specifying the operation target, the recording / editing / playback control unit 12 outputs graphics data depicting the directory structure, the total number of AV files, the data size of the free area on this disk, etc. to the video signal processing unit 5, and outputs this to the video signal processing unit 5. Is converted into a video signal and displayed on the television receiver 72. FIG. 42 is a diagram showing an example of graphics data displayed on the television receiver 72 under the control of the recording / editing / playback control unit 12. When drawing this graphics data, any directory or file is displayed while changing the drawing color as an operation target (a state in which the operator's attention is drawn by changing the drawing color is called a focus state, and the state is called a focus state. The state in which such changes have not been made is called the normal state). When the mark key of the remote controller 71 is pressed, the files and directories set in the focus state are returned to the normal state, and other files and directories in the normal state are changed to the focus state. When any of the files and directories is set to the focus state, the recording / editing / playback control unit 12 waits for the confirmation key on the remote controller 71 to be pressed. The recording / editing / playback control unit 12 recognizes a file or directory in focus when the confirmation key is pressed as an operation target. In this way, the recording / editing / playback control unit 12 can specify the file and directory to be operated.
【0253】
On the other hand, in specifying the operation content, the recording / editing / playback control unit 12 determines what kind of operation content is assigned to the key code notified from the remote control signal receiving unit 8. As shown on the left side of Fig. 41, the keys on the remote controller 71 are marked with character strings such as "play", "rewind", "stop", "fast forward", "record", "mark", "temporary edit", and "main edit". There is. The recording / editing / playback control unit 12 specifies the operation content specified by the operator according to the key code notified from the remote control signal receiving unit 8. (3-2-4-1) Operation details accepted by the recording / editing / playback control unit 12 The above operation contents are classified into the operation contents provided to the operator by the existing consumer AV equipment and the operation contents specially provided for video editing. Specifically, among the above operation contents, "play", "rewind", "stop", "fast forward", and "record" are classified into the former, and "mark", "temporary edit", and "main edit" are classified into the former. It is classified into the latter.
【0254】
"Playback" is an operation that orders the DVD recorder 70 to play back the VOB recorded in the AV file specified as the operation target, and "rewind" is the playback of the currently playing VOB in the past direction. It is an operation that orders the DVD recorder 70 to proceed to. "Stop" is an operation that orders the DVD recorder 70 to stop the playback of the currently playing VOB, and "fast forward" is to proceed the playback of the currently playing VOB in the future direction. This is the operation ordered from the DVD recorder 70.
【0255】
"Recording" is an operation that orders the DVD recorder 70 to create a new AV file in the directory specified as the operation target and write the VOB to be recorded there. These operations are familiar to many operators as functions of existing consumer AV equipment, that is, video tape recorders and CD players. On the other hand, the latter operation content is to allow the operator to perform a video editing operation of cutting out an arbitrary part of a movie film and connecting the cut out parts to obtain an arbitrary combination of films. ..
【0256】
The "mark" is to play the VOB recorded in the AV file specified as the operation target, and mark the time when any image appears among the moving images played by the VOB on the DVD recorder 70. It is an operation to order. If you compare it to video editing on film, the act of identifying the part of the film that will be the cut end corresponds to this "mark" operation.
【0257】
"Temporary editing" is to select multiple sets of arbitrary two as the playback start point and playback end point from the time marked by the mark operation, and give the playback order to those multiple sets. This is an operation that orders the DVD recorder 70 to specify a logical playback route. A cell is a partial section specified by a set of a playback start point and a playback end point selected by the operator in the temporary editing operation, and a playback order is assigned to each cell to set a defined playback route in the program chain. That is.
【0258】
"Main editing" means to cut out the range specified by the cell from the AV files recorded on the DVD-RAM into another file, and concatenate the cut out multiple files according to the playback order shown in the program chain. The process ordered by the DVD recorder 70. This operation corresponds to the act of cutting the cut end determined by the "mark" operation and joining the cut parts together. In this edit, the extent of the concatenated file is concatenated so that it is equal to or longer than the AV block length.
【0259】
The recording / editing / playback control unit 12 manages which of the above operation contents each of the AV data recording unit 13 to the AV data editing unit 15 has the processing capacity, and the operation target and the operation. Along with specifying the content, select the component according to the operation content and output the operation content instruction to the AV data recording unit 13 to the AV data editing unit 15. Hereinafter, it is illustrated what kind of instruction the recording / editing / playback control unit 12 issues to the AV data recording unit 13, the AV data reproduction unit 14, and the AV data editing unit 15 depending on the combination of the operation contents of the operation target.
【0260】
When the directory DVD_Video shown in FIG. 42 is set to the focus state and the record key is pressed, the recording / editing / playback control unit 12 specifies the directory DVD_Video as the operation target and recording as the operation content. Operation details Select the AV data recording unit 13 as a component having the processing capacity of "recording", and instruct to create a new AV file in the operation target directory.
【0261】
When the file AV_FILE # 1 is set to the focus state and the play key is pressed, the recording / editing / playback control unit 12 specifies the file AV_FILE # 1 as the operation target and "playback" as the operation content. Select the AV data playback unit 14 as a component having the processing power of the operation content, and instruct to play the AV file to be operated. When the file AV_FILE # 1 is set to the focus state and the mark key is pressed, the recording / editing / playback control unit 12 specifies the file AV_FILE # 1 as the operation target and specifies the "mark" as the operation content. The AV data editing unit 15 is selected as a component having the processing capacity of the operation content, and the AV file to be operated is instructed to perform marking processing. (3-2-5) AV data recording unit 13 The AV data recording unit 13 controls the MPEG encoder 2 to encode, combines commands for the common file system and commands for the AV file system in a predetermined order, and issues them to the common file system unit 10 and the AV file system unit 11. Then, by having them provide the functions (1) to (10), the recording operation is realized. (3-2-6) AV data playback unit 14 The AV data playback unit 14 controls the decoder 4 to perform decoding, combines commands for the common file system and commands for the AV file system in a predetermined order, and issues them to the common file system unit 10 and the AV file system unit 11. By providing these functions (1) to (10), the operation contents such as "play", "rewind", "fast forward", and "stop" can be realized. (3-2-7) AV Data Editing Department 15 The AV data editing unit 15 controls the MPEG decoder 4 to perform decoding, combines commands for the common file system and commands for the AV file system in a predetermined order, and issues them to the common file system unit 10 and the AV file system unit 11. Then, by providing these functions (1) to (10), the operation contents such as "mark", "temporary editing", and "main editing" are realized.
【0262】
Specifically, when the recording / editing / playback control unit 12 instructs the AV data editing unit 15 to set a mark on the AV file to be operated, the AV data editing unit 15 plays the AV file to be operated to the AV data playback unit 14. And monitor that the mark key is pressed again. When the mark key is pressed during the playback period, information indicating how many seconds after the start of playback of the AV file is pressed is written to the non-AV file as information called a mark point.
【0263】
When the recording / editing / playback control unit 12 instructs the AV data editing unit 15 to perform temporary editing operations, the AV data editing unit 15 generates information that defines a logical playback route in accordance with key operations on the remote control 71. Then, the common file system unit 10 is controlled so that this can be written to DVD-RAM as a non-AV file. When the recording / editing / playback control unit 12 instructs the operation content of this editing, the AV data editing unit 15 cuts out the range specified by the cell from the AV files recorded on the DVD-RAM into another file. Concatenate multiple files that have been cut out in the order of cells.
【0264】
The AV data editing unit 15 performs a concatenation process of a plurality of files so that seamless playback in the file is realized in the concatenated AV file. Here, in-file seamless means that the AV file after concatenation is played back without interruption, and the AV data editing unit 15 selects the extents other than the last extent to be played out among the extents that make up the AV file. , All the extents are concatenated from the viewpoint of making them longer than the AV block length. (3-2-7-1) Processing procedure for temporary editing and main editing by the AV data editing unit 15. FIG. 43 is a flow chart showing the procedure through which the provisional editing and the main editing processes described above are performed. FIG. 44 is an explanatory diagram for supplementarily explaining the processing of the AV data editing unit 15 in the flow chart of FIG. 43. The editing process by the AV data editing unit 15 will be described with reference to this flow chart and the explanatory diagram of FIG.
【0265】
It is assumed that the AV file shown in FIG. 44 (a) has already been recorded on the DVD-RAM, the AV file is designated as the operation target, and the operator presses the play key on the remote controller 71. When this pressing is detected by the recording / editing / playback control unit 12 and a playback operation is instructed, the AV data editing unit 15 causes the AV data playback unit 14 to start playing the AV file in step S1. After the start of playback, it is assumed that the operator presses the mark key again when the playback progresses to the time t1 shown in FIG. 44 (b). Then, the mark point # 1 indicating the relative time code of that time t1 is set in the AV file. Similarly, it is assumed that the operator presses the mark key a total of seven times when the time t2, t3, t4 ... t8 elapses. Then, as shown in Fig. 44 (b), the mark points # 2, # 3, # 4, # 5 ... # 8 indicating the relative time codes of those times t2, t3, t4, t5 ... t8. Is set.
【0266】
After executing step S1, the process proceeds to step S2, and the AV data editing unit 15 causes the operator to specify a set of mark points, and determines a plurality of cells to be played in the AV file according to the specification of the set of mark points. .. In FIG. 44 (c), the operator specifies a set of Mark # 1 and Mark # 2 (1), and similarly, a set of Mark # 3 and Mark # 4 (2), Mark # 5, and Mark # 6. It is assumed that one set (3), Mark # 7, and Mark # 8 set (4) are specified.
【0267】
Then, the AV data editing unit 15 sets a set of these mark points as one cell, and sets four cells, Cell # 1, Cell # 2, Cell # 3, and Cell # 4 (Note that Mark). It is also possible to specify a set of # 2-Mark # 3 and a set of Mark # 4-Mark # 5 as cells, and if specified in this way, a set of Mark # 2-Mark # 3 and Mark Each set of # 4-Mark # 5 is set as one cell.)
【0268】
Subsequently, in step S3, the AV data editing unit 15 creates a program chain by assigning a playback order to each cell. Of the four Cell # 1, Cell # 2, Cell # 3, and Cell # 4 already set in Fig. 44 (d), Cell # 1 is given the first playback order (1st in the figure). , Cell # 2 is given the second playback order (2nd in the figure). Similarly, it is assumed that Cell # 3 and Cell # 4 are given the third and fourth playback orders (3rd and 4th in the figure). Then, the AV data editorial unit 15 interprets a plurality of cells as a program chain according to the playback order set in this way (Note that FIG. 44 shows only the simplest example, cell # 3, cell # 1). , It is also possible to specify the order of cell # 2.).
【0269】
In step S6, the AV data editing unit 15 monitors whether the operator has instructed the program chain to play back, and in step S5, whether the operator has instructed the program chain to perform the main editing. Monitor. When the playback instruction is given, the AV data editing unit 15 instructs the AV data playback unit 14 to play the program chain instructed to play.
【0270】
The instructed AV data playback unit 14 first issues a SEEK command to seek the optical pickup to Mark # 1, which is the playback start point of cell # 1, as shown in FIG. 44 (e). Issue. When the optical pickup moves to Mark # 1 of the AV file by issuing the SEEK command, a "READ" command is issued to the common file system unit 10 so that the range from Mark # 1 to Mark # 2 is read. As a result, the VOBU in cell # 1 is read from the DVD-RAM, the read VOBU is sequentially decoded by the decoder 4, and the image is displayed on the television receiver 72. When VOBU is played up to Mark # 2, the same process is performed for the remaining cells. Then, only the range specified as cells # 1, # 2, # 3, # 4 will be played.
【0271】
Here, it is assumed that the AV file of FIG. 44 (a) is a movie broadcast on television. Also, as shown in Fig. 44 (f), the video content of each time zone of the AV file is the credit scene V1 displaying the character name and director name of the movie during the period from time t0 to time t1, and from time t1. The period up to time t2 is the first showcase scene V2 of the main part of the movie, the period from time t2 to time t3 is the commercial scene V3 inserted because it is a television broadcast, and the period from time t3 to time t4 is The second showcase scene V4 of the main part of the movie, the period from time t5 to time t6 shall be the third showcase scene V5 of the main part of the movie.
【0272】
Mark # 1, Mark # 2, Mark # 3, Mark # 4, Mark # 5, Mark # 6 are set for these times t1, t2, t3, t4, t5, t6, and a set of mark points. Is specified as a cell and the display order as a program chain is set. Therefore, when the reading is performed as shown in FIG. 44 (e), the credit scene V1 is skipped without being reproduced, and the showcase scene V2 is reproduced from the time t1 to the time t2. Subsequently, the commercial scene V3 is skipped without being played, and the showcase scene V4 from time t3 to time t4 is played.
【0273】
Subsequently, the processing when the main editing is instructed by the operator will be described with reference to the explanatory diagrams of FIGS. 45 and 46. 45 and 46 are explanatory views for supplementarily explaining the processing of the AV data editing unit 15 in the float chart of FIG. 43. This explanatory diagram shows which part of the AV file each variable mx and Af used in the flow chart of FIG. 43 indicates. The processing procedure of this editing will be explained with reference to this flow chart.
【0274】
First, in step S8, the AV data editing unit 15 determines two or more ranges to be cut out from the AV file according to the program chain defined by the provisional editing. The "editing source AV file" in FIG. 45 (a) is given the mark points Mark # 1, # 2, # 3, ... # 8. Since the cells set for the AV file are specified by a set of Mark # 1, # 2, # 3 ... # 8, the AV data editing unit 15 starts editing the set of these mark points. Interpret as a point, editing end point. That is, the set of Mark # 1 and # 2 is interpreted as the editing start point In point (1) and the editing end point Out point (1), and the set of Mark # 3 and # 4 is the editing start point In point (2). ), It is interpreted as the editing end point Out point (2). The set of Mark # 5 and # 6 and the set of Mark # 7 and # 8 are the editing start point In point (3), editing end point Out point (3), editing start point In point (4), and editing, respectively. Interpreted as the end point Out point (4).
【0275】
Here, the period from Mark # 1 to Mark # 2 corresponds to the first showcase scene V2 of the main part of the movie from time t1 to time t2 shown in FIG. 44 (f). The period from Mark # 3 to Mark # 4 corresponds to the second showcase scene V4 of the main movie from time t3 to time t4 shown in Fig. 44 (f), and from Mark # 5 to Mark # 6. Since the period corresponds to the third showcase scene V5 of the main movie from time t5 to time t6 shown in Fig. 44 (f), the operator can use the showcase scenes V2, V4, V5 by the subsequent processing of this editing. I'm trying to get an AV file consisting of only.
【0276】
Next, in step S9, the AV data editing unit 15 issues an SPLIT command to the AV file system unit 11 to cut out the determined cutout range into mx AV files (mx is an integer of 2 or more). The AV data editing unit 15 interprets the closed section specified by the set of editing start point-editing end point shown in FIG. 45 (a) as a cutout range, and has four AV data editing units 15 as shown in FIG. 45 (b). Cut out the AV file of.
【0277】
Hereinafter, each of the mx AV files cut out will be referred to as AV files Af1, Af2, Af3, Af4 ... Afm, and in this flowchart, these shall be indicated by the variable "Af". .. In step S10, the variable Af is initialized by setting the variable Af to 1, and in step S11, the VOBU (hereinafter referred to as the terminal part) located at the terminal part of the AV file Af in the program chain and the AV file Af + Issue a READ command for the VOBU (hereinafter referred to as the tip) located at the tip of 1 to the AV file system section 11. After issuance, in step S12, the read end portion and tip portion are re-encoded using the procedure shown in the second embodiment.
【0278】
When re-encoding is performed, the SHORTEN command for the end and tip of the AV files Af and Af + 1 is issued to the file system. In FIG. 45 (c), the end of the AV file Af1 and the tip of the AV file Af2 are read by the "READ" command, and the end and the tip are re-encoded. By this re-encoding, the re-encoded data obtained by re-encoding these sets is stored in the memory of the DVD recorder 70. By issuing the "SHORTEN" command in step S13, the area originally occupied by the tip and end is deleted.
【0279】
If the deletion is performed as described above, it should be noted that the following two cases will occur. In the first case, it is sufficient that both the extent of the AV file Af from which the part to be re-encoded has been removed and the extent of the AV file Af + 1 have a continuous length equal to or longer than the AV block length. This is the case where the continuous length on one side is less than the data size of the AV block. Since the length of the AV block is set to a length that can avoid the occurrence of underflow, if the playback of AV file Af and AV file Af + 1 is instructed while the continuous length is less than the AV block length, the track The buffer underflows.
【0280】
The second case is when the data size of the re-encoded data (in-memory data) is less than the data size of the AV block. That is, if the data size of the data in the memory is large and the data in the memory occupies an area of one AV block or more when recorded on DVD-RAM, it is isolated from the AV file Af and the AV file Af + 1. In-memory data may be recorded at the location. However, if the data size of the in-memory data is less than the data size of the AV block, the in-memory data cannot be recorded in an isolated position separated from the AV file Af and the AV file Af + 1.
【0281】
The reason is that if the in-memory data is recorded in an isolated position, the data size of the in-memory data is small, so that a sufficient amount of storage can be obtained in the track buffer when the in-memory data is read into the track buffer in an attempt to reproduce the data. This is because if it takes a long time to jump from the in-memory data to the AV file Af + 1, the track buffer underflow will occur during the jump.
【0282】
In FIG. 45 (d), the AV files Af1 and Af2 have the tip and the end deleted as shown by the broken lines. At this time, it can be seen that the continuous length of the AV file Af1 is less than the AV block length. Similarly, it can be seen that the data size of the re-encoded in-memory data is less than the data size of the AV block. If this AV file Af1 is left in a short state, underflow may occur when playing this AV file Af1 and jumping to the AV file Af2. In order to avoid the occurrence of underflow, the MERGE command for the AV file Af and the AV file Af + 1 is issued to the file system in step S14. Then, as shown in FIGS. 45 (e) and 46 (a), the AV file Af1 and the re-encoded VOBU are concatenated, and the continuous length of the recording area of all the extents constituting the AV file Af is the AV block length. That is all. After issuing the "MERGE" command, the variable Af is determined to match the number of AV files mx-1 in step S15, and if there is a mismatch, the variable Af is incremented in step S16 to move to step S11. As a result, the steps S11 to S14 are repeated.
【0283】
When the variable Af is incremented to 2, the end of the concatenated AV file Af2 and the tip of the AV file Af3 are read by the "READ" command (see Fig. 46 (b)), and the end and the end. When the tip is re-encoded, the re-encoded data obtained by re-encoding these sets is stored in the memory of the DVD recorder 70. The area originally occupied by the tip and end will be deleted by issuing the "SHORTEN" command in step S13 (see Fig. 46 (c)), but at this time, the AV file Af3 has the AV block length. The continuous length is less than. Since this AV file Af3 may also cause underflow, the AV data editorial unit 15 issues the MERGE command for the AV files Af2 and Af3 to the file system again (see Figures 46 (d) and (e)). ). The above process is repeated until the variable Af becomes mx-1.
【0284】
From the above processing, all extents on the recording area are only the showcase scenes V2, V4, and V5. Further, since all of these extents have a continuous length equal to or longer than the AV block length, it is guaranteed that the video display will not be interrupted during the reproduction. Here, the period from Mark # 1 to Mark # 2 corresponds to the showcase scene V2. Also, the period from Mark # 3 to Mark # 4 corresponds to the second showcase scene V4, and the period from Mark # 5 to Mark # 6 corresponds to the third showcase scene V5. By the process of, the operator obtained an AV file consisting only of the showcase scenes V2, V4, and V5.
【0285】
(3-2-7-1-2) Processing of AV file system unit 11 when issuing SPLIT command The processing of the AV file system unit 11 when providing the extended function by issuing "SPLIT" will be explained in detail. FIG. 48 (a) is a float chart showing the processing procedure of the AV file system unit 11 when the function is provided by issuing the SPLIT command. After that, each of the mx editing start points (In points) and editing end points (Out points) set in one AV file in this float shall be indicated by the variable h. In step S22, 1 is first assigned to the variable h in order to indicate the first In point and Out point.
【0286】
In step S31, the file entry (h) is generated, and in step S32, the AV file system unit 11 adds the file identification descriptor (h) for the file entry (h) to the directory file of the temporary directory. In step S33, the start address s and the number of occupied blocks r of u logical block strings occupying the logical block corresponding to the In point (h) to the logical block corresponding to the Out point (h) are calculated (u). 1). Generate u allocation descriptors in the file entry (h) in step S34. In step S35, the start address s and the number of occupied blocks r of the u logical block strings are registered in each of the u allocation descriptors, and in step S35, it is determined whether the variable h has reached mx-1. If it has not been reached, the variable h is incremented and the process proceeds to step S31. In this way, the steps from step S31 to step S35 are repeated until the variable h becomes mx-1, and the closed intervals specified by the combination of mx-1 In points and Out points are mx-1 independent. Cut out as an AV file. (3-2-7-1-3) Processing of AV file system unit 11 when the SHORTEN command is issued Next, the processing of the AV file system unit 11 when providing the extended function by issuing "SHORTEN" will be described in detail. FIG. 48 (b) is a flowchart showing the processing contents when the SHORTEN command is issued.
【0287】
In step S38, the AV file system unit 11 calculates the start address c and the number of occupied blocks d of the logical block string that occupies the deletion start address to the deletion end address that specifies the deletion range. In step S45, the allocation descriptor of the AV file whose tip or end should be deleted is accessed. In step S46, it is determined whether or not the deletion range is the tip of the extent. If it is the tip portion, step S46 becomes Yes and the process proceeds to step S47, and in step S47, the recording start address p of the extent in the allocation descriptor is updated to the recording start address p + c × d. After the update, in step S48, the number of occupied blocks q in the allocation descriptor is updated to the extent data size q to the data size qc × d. If it is the terminal part, the process directly proceeds to step S48 in step S46, and the number of occupied blocks q in the allocation descriptor is updated to the extent data size q to the data size qc × d.
【0288】
(3-2-7-1-4) Processing of AV file system unit 11 when issuing the MERGE command Next, the processing contents of the AV file system unit 11 when providing the extended function when the "MERGE" command is issued will be described in detail. The following description clarifies the procedure based on the processing in the range indicated by the alternate long and short dash lines y3 and y4 among the processing shown in FIGS. 45 and 46.
【0289】
When executing the MERGE command, the AV file system unit 11 is re-encoded by the two AV files Af, Af + 1 and the DVD recorder 70, which are cut out by the "SPLIT" command and whose ends are deleted by the "SHORTEN" command. Therefore, the re-encoded data (data in memory) placed on the memory in the DVD recorder 70 is seamlessly played on the DVD-RAM in the order of AV file Af, data on memory, and AV file Af + 1. Place in.
【0290】
FIG. 47 (a) is a diagram showing an example of an object to be processed by the AV file system unit 11 when the extended function is provided by issuing the MERGE command. In FIG. 47 (a), the AV file Af and the AV file Af + 1 are AV files cut out by the SPLIT command. Here, it is assumed that the playback route is defined so that the audiovisual data is played back in the order of AV file Af, in-memory data, and AV file Af + 1 by temporary editing. FIG. 47 (a) is a diagram showing an example of a playback route set for the audiovisual data recorded in the AV file Af and the AV file Af + 1. In this figure, the horizontal axis means the time axis, and when the display order is interpreted along this horizontal axis, the playback route in this figure is determined in the order of AV file Af, in-memory data, and AV file Af + 1. You can see that.
【0291】
Of the AV file Af, the range from the beginning to the data size m is recorded in a continuous area in DVD-RAM, and is considered to correspond to the preceding extent. The range from the end of the AV block to the data size n is also recorded in a continuous area in the DVD-RAM and corresponds to the subsequent extent. Here, if the audiovisual data of an arbitrary section is cut out by the "SPLIT" command and the AV file Af and AV file Af + 1 are obtained, the file system manages it as a free area, but the actual logical block. The contents of the original AV file should have been recorded and left unattended. In addition, since it is assumed that the playback route setting by the above operator is set without considering "which AV block on the DVD-RAM the cut out AV file is recorded in" at all. It is not possible to unambiguously specify the positional relationship between the preceding extent and the succeeding extent in DVD-RAM. Even if the playback route is specified in the order of AV file Af and AV file Af + 1, there is a possibility that audiovisual data completely unrelated to the playback route exists between the preceding extent and the succeeding extent. can not deny.
【0292】
Keeping the above in mind, when concatenating the AV files cut out by the "SPLIT" command, the preceding extent and the succeeding extent are not assumed to be recorded at consecutive positions on the DVD-RAM, but are preceded. Extents and subsequent extents should be assumed to be recorded in completely unrelated locations on DVD-RAM.
【0293】
In addition, at least one extent of another file that has nothing to do with the playback route for which AV file Af and AV file Af + 1 are specified exists and is recorded between the recording area of the preceding extent and the succeeding extent. It should be assumed that (in the present embodiment, these leading extents and trailing extents exist in the same zone area). FIG. 47 (b) is a recording image diagram assuming the positional relationship between the preceding extent and the succeeding extent in the DVD-RAM in consideration of the above.
【0294】
Here, since the AV file Af including the preceding extent is cut out by executing the "SPLIT" command, there is a free area behind the preceding extent (in this way, the free space existing behind the preceding extent). The area that exists in the same zone area as the preceding extent is called the Out area). As mentioned above, in this Out area, the audiovisual data recorded in the AV file before cutting out is physically recorded, but since the "SPLIT" command has already been issued, AV It is treated as free space by the file system unit 11.
【0295】
In addition, since the AV block including the succeeding extent is cut out by executing the "SPLIT" command, there is also a free area in front of the succeeding extent (in this way, a free area existing in front of the succeeding extent). The one that exists in the same zone area as the subsequent extent is called the In area). Actually, the audiovisual data recorded in the AV file before cutting out is physically recorded in the In area, but since the "SPLIT" command has already been executed, it is treated as a free area from the outside.
【0296】
In this figure, the preceding extent is recorded before the preceding extent, but this is just an example for convenience of drawing, and the succeeding extent may be recorded before the preceding extent. Extents of other files exist between the recording areas of the preceding extent and the succeeding extent. The In and Out areas are ideal for recording in-memory data as described above, but the continuous length of the In and Out areas is constrained by the existence of a third extent. Is assumed.
【0297】
First, in step S62 in the flow chart of FIG. 49, the AV file system unit 11 calculates the data size of the Out area and calculates the data size of the In area. When the data sizes of the In area and the Out area are obtained as described above, it is determined whether or not underflow occurs in the preceding extent by referring to the data size m of the preceding extent and the data size n of the succeeding extent. To do.
【0298】
(3-2-7-1-4-1) Processing when the preceding extent m is less than the AV block length If the preceding extent m is less than the AV block length and the succeeding extent n is greater than or equal to the AV block length, there is a risk of underflow in the preceding extent m, so the process proceeds to step S70 in FIG. FIG. 50 is a flowchart when the preceding extent is less than the AV block length and the succeeding extent is greater than or equal to the AV block length. FIG. 51, FIG. 52, and FIG. 53 show explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. These figures show the relationship between the extent data sizes m, n and the In area, the Out area data sizes i, j, the in-memory data data size k, and the AV block data size B. It is specified which area is the recording destination and the moving destination of each data when is satisfied.
【0299】
Since the data size of the leading extent is less than the AV block, if the leading extent is left as it is, underflow will occur in the leading extent. Where to determine the recording position of both the preceding extent and the data in the memory is the process to be performed in the float of FIG. In step S70, it is first determined whether the total size of the preceding extent and the in-memory data is equal to or greater than the AV block length. If it is equal to or longer than the AV block length, the process proceeds to step S71, and it is first determined whether the Out area is larger than the in-memory data. If it is large, the in-memory data is written in the Out area and the continuous length of the preceding extent is set to the AV block length or more. FIG. 51 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region, and the Out region on the DVD-RAM when the relationship of i k and m + k> B is established. In this case, if the in-memory data is recorded in the Out area as shown in FIG. 51 (b), the continuous length of the preceding extent can be set to be equal to or longer than the AV block length.
【0300】
On the other hand, if the Out area is smaller than the data in the memory, the movement process is performed. FIG. 52 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region, and the Out region on the DVD-RAM when the relationship of i <k, m + k> B is established. In such a state, as shown in FIG. 52 (b), the preceding extent is first read into the memory and written to the free area existing in the same zone area as the preceding extent to make the preceding extent a free area. Moving. After the move, the in-memory data is written to the end of the moved leading extent as shown in FIG. 52 (c).
【0301】
If the total size of the preceding extent and the data in the memory is less than 1AV block length, step S70 becomes No, and the process proceeds to step S72. In step S72, it is determined whether the total size of the preceding extent, the succeeding extent, and the in-memory data is 2AV block length or more. Here, if the total size is less than 1 AV block, even one AV block cannot be satisfied even if the movement process is performed, and underflow occurs. Also, if the total data size of the leading extent, in-memory data, and trailing extent is less than 2AV block length, the recording time will not be too long even if the leading extent, in-memory data, and trailing extent are written to the logical block at once. .. In the flow chart of FIG. 50, when the total size of the above-mentioned in-memory data, the preceding extent, and the succeeding extent is less than 2AV block length, the process proceeds from step S72 to step S73, and the preceding extent and the succeeding extent are executed. Move both.
【0302】
Figure 53 (a) shows the leading extent, trailing extent, In region, and Out region on the DVD-RAM when the relationship of i <k, m + k <B, B m + n + k <2B is established. It is a figure which shows the arrangement example. In this case, the free space existing in the same zone area as the preceding-successor extent is searched. When the free area is obtained, as shown in FIG. 53 (b), the leading extent is first read into the memory and then written to the free area again to move the leading extent to the free area. After the move, the in-memory data is written to the end of the moved leading extent as shown in Fig. 53 (c). When the in-memory data is written, as shown in FIG. 53 (d), the succeeding extent is first read into the memory and then written immediately after the area occupied by the moved in-memory data to make the succeeding extent a free area. Move to.
【0303】
When the total size of the above-mentioned in-memory data, the preceding extent, and the succeeding extent is 2AV block length or more, the process proceeds from step S72 to step S74. If the total size of the above is 2AV blocks or more, the time required for logical block writing becomes enormous, and the method of simply moving the preceding extent and writing the in-memory data to the moving destination should not be accepted from the viewpoint of access speed. However, it should be noted that the transition from step S72 to step S74 is performed because the relationship is established when the total size of the in-memory data and the preceding extent is less than the AV block length. When the total size of the in-memory data and the preceding extent is less than the AV block length, but the total size of the in-memory data, the preceding extent, and the succeeding extent is 2AV block length or more. The relationship is established that the data size of the subsequent extent is large and the data size of (subsequent extent-AV block) is also considerable. Since the data size of (subsequent extent-AV block) is a considerable amount, even if the amount less than the AV block is supplemented by the succeeding extent when the preceding extent and the data in memory are added, the data size of the succeeding extent Is unlikely to run short.
【0304】
Therefore, if the total size of the in-memory data, the preceding extent, and the succeeding extent is 2AV block length or more, the process proceeds from step S72 to step S74 and the concatenation process is performed according to the procedure shown in FIGS. 54 (a) to 54 (d). I do. FIG. 54 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region and the Out region on the DVD-RAM when the relationship of m + k <B and m + n + k 2B is established. is there. In this case, the search obtains free space that exists in the same zone area as the leading-successive extents. When the free area is obtained, as shown in FIG. 54 (b), the leading extent is first read into the memory and then written to the free area again to move the leading extent to the free area. After the move, the in-memory data is written to the end of the moved leading extent as shown in FIG. 54 (c). When the in-memory data is written, as shown in FIG. 54 (d), the extent having the data size of (subsequent extent-AV block) is moved to the recording destination of the in-memory data.
【0305】
After concatenating the preceding extent, in-memory data, and succeeding extent through the above processing, the file entry of the AV file Af including the preceding extent and the file entry of the AV file Af + 1 including the succeeding extent are integrated, and after concatenating. Get a single file entry and finish the process. (3-2-7-1-4-2) Processing when the subsequent extent n is less than the AV block length If step S63 is No in the flow chart of FIG. 49, the process proceeds to step S64, and it is determined whether the preceding extent m is equal to or greater than the AV block length and the succeeding extent n is less than the AV block length. In this step, it is determined whether or not there is a risk of underflow in the subsequent extent n.
【0306】
FIG. 55 shows a flowchart when the succeeding extent is less than the AV block length and the preceding extent is greater than or equal to the AV block length. Explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. 55 are shown in FIGS. 56, 57, 58, and 59. These figures show the relationship between the extent data sizes m, n and the In area, the Out area data sizes i, j, the in-memory data data size k, and the AV block data size B. It is specified which area is the recording destination and the moving destination of each data when is satisfied.
【0307】
In step S75, it is first determined whether the total size of subsequent extents and in-memory data is greater than or equal to the AV block length. If it is longer than the AV block length, the process proceeds from step S75 to step S76, and first it is determined whether the In area is larger than the data in the memory. FIG. 56 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region, and the Out region on the DVD-RAM when the relationship of j k and n + k> B is established. In this case, if the in-memory data is recorded in the In area as shown in FIG. 56 (b), the continuous length of the subsequent extent can be set to be equal to or longer than the AV block length.
【0308】
On the other hand, if the In area and Out area are smaller than the data in the memory, the movement process is performed. FIG. 57 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region, and the Out region on the DVD-RAM when the relationship of j <k and n + k B is established. In this case, the free space existing in the same zone area as the preceding-successor extent is searched. When the free area is obtained, the in-memory data is written to the free area as shown in FIG. 57 (b). Subsequently, as shown in FIG. 57 (c), the subsequent extent is first read into the memory and written immediately after the recording area of the data in the memory.
【0309】
If the total size of the trailing extent and the in-memory data is less than 1AV block length, the process proceeds from step S75 to step S77, and in step S77, whether the total size of the leading extent, trailing extent, and in-memory data is 2AV block length or more. judge. If it is less than 2AV block length, the process proceeds to step S78. Figure 58 (a) shows an example of the arrangement of the leading extent, trailing extent, In area, and Out area on the DVD-RAM when the relationship of j <k, n + k <B, m + n + k <2B is established. It is a figure which shows. In step S78, the AV file system unit 11 searches for a free area existing in the same zone area as the preceding-successor extent. In such a state, as shown in FIG. 58 (b), the preceding extent is first read into the memory and then written to the free area again to move the preceding extent to the free area. After the move, the in-memory data is written to the end of the moved leading extent as shown in Fig. 58 (c). When the in-memory data is written, as shown in Fig. 58 (d), the succeeding extent is first read into the memory, and the succeeding extent is preceded by writing this immediately after the area occupied by the moved in-memory data. Move to a free area that exists in the same zone area as the subsequent extent.
【0310】
On the other hand, if the block length is 2AV or more, the process proceeds from step S77 to step S79, and the connection process is performed according to the procedure shown in FIGS. 59 (a) to 59 (d). FIG. 59 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In area and the Out area on the DVD-RAM when the relationship of n + k <B and m + n + k 2B is established. is there. In this case, the free space existing in the same zone area as the preceding-successor extent is searched. When the free space is obtained, as shown in FIG. 59 (b), the end portion mend of the extent having the data size of (AV block-(n + k)) is moved to the recording destination of the data in the memory. As shown in Fig. 59 (c), the in-memory data is written to the end of the moved leading extent. When the in-memory data is written, as shown in FIG. 59 (d), the subsequent extent is moved immediately after the recording area of the in-memory data.
【0311】
If step S64 in FIG. 49 is No, the process proceeds to step S65, and the preceding extent m is less than the AV block length and the succeeding extent n is less than the AV block length, that is, the preceding extent m and the succeeding extent n. Determine if there is a risk of underflow on both sides. FIG. 60 is a flowchart showing the processing contents when both the preceding extent and the succeeding extent are less than the AV block length. An explanatory diagram for supplementarily explaining the processing of the AV file system unit 11 in the float chart of FIG. 60 is shown in FIGS. 61, 62, 63, and 64. These figures show the relationship between the extent data sizes m, n and the In area, the Out area data sizes i, j, the in-memory data data size k, and the AV block data size B. It is specified which area is the recording destination and the moving destination of each data when is satisfied.
【0312】
In this float, first, in step S80, it is determined whether or not the total size of the in-memory data, the preceding extent, and the succeeding extent is equal to or larger than the AV block length. If the total size is less than the AV block length, the process proceeds to step S81. In this case, since the AV block cannot be satisfied even if the preceding extent, the in-memory data, and the succeeding extent are added together, it is determined whether the extent follows the succeeding extent. If there is no trailing extent, the trailing extent is effectively the extent that makes up the end of the AV file generated after concatenation, so you can leave it as it is, but if the extent is trailing, the leading extent-in memory. Data-Underflow occurs because subsequent extent pairs cannot fill the AV block. In order to avoid this, if there is an extent that follows the subsequent extent, the concatenation process is performed according to the procedure shown in FIG. FIG. 61 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region, and the Out region on the DVD-RAM when the relationship of m + n + k <B is established. In step S81, the AV file system unit 11 writes in-memory data to the In area as shown in FIG. 61 (b). When the in-memory data is written, as shown in FIG. 62 (c), the succeeding extent is first read into the memory and then written immediately after the area occupied by the moved in-memory data to make the succeeding extent a free area. Move to.
【0313】
Finally, as shown in Fig. 61 (d), data is extracted from the extent that follows the subsequent extent by the data size (AV block- (preceding extent + in-memory data + subsequent extent)), and the extracted data is the preceding extent. Concatenate to in-memory data and subsequent extents. If the total size of the preceding extent, the succeeding extent, and the data in the memory is equal to or larger than the AV block length, the process proceeds to step S82. In step S82, the AV file system unit 11 determines whether the data size of the Out area following the preceding extent is smaller than the total size of the succeeding extent and the data in the memory. If it exceeds, the process proceeds to step S83. FIG. 62 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region and the Out region on the DVD-RAM when the relationship of i n + k, m + n + k B is established. is there. In step S83, the AV file system unit 11 writes in-memory data to the In area as shown in FIG. 62 (b). When the in-memory data is written, as shown in FIG. 62 (c), the succeeding extent is first read into the memory, and the preceding extent is written as a free area immediately after the area occupied by the moved in-memory data. Move to.
【0314】
If the Out area is smaller, the process proceeds from step S82 to step S84, and in step S84, it is determined whether the data size of the In area preceding the subsequent extent is smaller than the total size of the preceding extent and the in-memory data. If it exceeds, the process proceeds to step S85. FIG. 63 (a) is a diagram showing an arrangement example of the preceding extent, the succeeding extent, the In region, and the Out region on the DVD-RAM when the relationship of i <n + k, m + n + k B is established. is there. In step S85, the AV file system unit 11 writes in-memory data to the Out area as shown in FIG. 63 (b). When the in-memory data is written, as shown in FIG. 63 (c), the preceding extent is first read into the memory, and the preceding extent is written in the In area immediately before the area occupied by the moved in-memory data. Move to.
【0315】
If step S84 is No, the process proceeds to step S86. Fig. 64 (a) shows the leading extent, trailing extent, In area, and Out area on the DVD-RAM when the relationship of i <n + k, j <m + k, m + n + k B is established. It is a figure which shows the arrangement example. In step S86, it is determined whether or not the total size of the preceding extent, the succeeding extent, and the data in the memory exceeds the 2AV block length. If not, the AV file system unit 11 searches for a free area existing in the same zone area as the preceding extent. When the free area is obtained, as shown in FIG. 64 (b), the leading extent is first read into the memory and then written to the free area again to move the leading extent to the free area. After the move, the in-memory data is written to the end of the moved leading extent as shown in Fig. 64 (c). When the in-memory data is written, as shown in FIG. 64 (d), the succeeding extent is first read into the memory and then written immediately after the area occupied by the moved in-memory data to make the succeeding extent a free area. Move to.
【0316】
When the total size of the preceding extent, the succeeding extent, and the data in the memory is 2AV blocks, it is determined which of the Out area and the In area has the larger data size. If the data size of the Out area is large, the data in the memory is recorded in the Out area until the AV block length is reached. After that, the rest of the data in the memory is recorded in the free area, and the subsequent extent is moved to the recording destination.
【0317】
When the data size of the In area is large, the AV file system unit 11 moves the preceding extent to the free area, and among the in-memory data, the data from the beginning of the in-memory data (in-memory data-In area) Is recorded in the destination of the preceding extent. After that, the remaining part of the data in the memory is recorded in the In area. Through the above movement processing, the total movement amount can be suppressed to 2AV block length or less in step S86.
【0318】
After concatenating the preceding extent, in-memory data, and succeeding extent through the above processing, the file entry of the AV file Af including the preceding extent and the file entry of the AV file Af + 1 including the succeeding extent are integrated, and after concatenating. Get a single file entry and finish the process. (3-2-7-1-4-3) Processing when both leading and trailing extents are longer than the AV block length If step S65 in FIG. 49 is determined to be No, the AV file system unit 11 determines in step S66 whether the data in the memory is less than the AV block length. If it is equal to or longer than the AV block length in step S67, the data in the memory is recorded in the free area and the process is completed.
【0319】
When step S66 is No, the AV file system unit 11 has the preceding extent m equal to or greater than the AV block length, the subsequent extent n equal to or greater than the AV block length, and the data sizes of the in-memory data k are In area i and Out. Determine if it is less than the total length with the region j. FIG. 65 shows a float when the preceding extent and the succeeding extent have a length equal to or longer than the AV block length.
【0320】
Further, FIG. 66 is an explanatory diagram for supplementarily explaining the processing of the AV file system unit 11 in the float chart of FIG. 65. (A) of the explanatory diagram shows an example of the recorded contents in which both the succeeding extent and the preceding extent have an AV block length or more. In addition, (b) to (d) show how in-memory data and extents are recorded in the In area, the Out area, and other free areas when each step in FIG. 65 is executed. ..
【0321】
In this case, there is no risk of underflow occurring in the preceding extent and the succeeding extent. If you want, if you can record in-memory data in either or both of the Out area located behind the AV file Af and the In area located in front of the AV file Af + 1, free the leading extent and trailing extent. Data in memory can be recorded without moving to the area.
【0322】
In the float chart of FIG. 65, in step S87, it is determined whether or not the data size of the Out area exceeds the data size of the data in the memory. If it exceeds, in step S88, the data in the memo is recorded in the Out area as shown in FIG. 66 (b), and the process ends. If it is less than that, the process proceeds to step S89, and it is determined whether or not the data size of the In region exceeds the data size of the data in the memory. If it exceeds, in step S90, the data in the memo is recorded in the In region as shown in FIG. 66 (c), and the process ends. If the in-memory data cannot be recorded in only one of the In area and the Out area, the process proceeds from step S89 to step S91, and in step S91, two free in-memory data are provided as shown in FIG. 66 (d). Divide into areas and record each of the divisions in the In area and the Out area respectively.
【0323】
After concatenating the preceding extent, in-memory data, and succeeding extent through the above processing, the file entry of the AV file Af including the preceding extent and the file entry of the AV file Af + 1 including the succeeding extent are integrated, and after concatenating. Get a single file entry and finish the process. (3-2-7-1-4-4) Processing when both leading and trailing extents are longer than the AV block length In step S69 of FIG. 49, the leading extent m is longer than the AV block length and the trailing extent n is AV. It is determined whether the block length or more and the data size of the in-memory data k is larger than the total length of the In area i and the Out area j.
【0324】
FIG. 67 is a flowchart showing processing when the data sizes of both the preceding extent and the succeeding extent are equal to or larger than the AV block and the total size of the In area and the Out area is smaller than the size of the data in the memory. Further, FIG. 68 is an explanatory diagram for supplementarily explaining the processing of the AV file system unit 11 in the float chart of FIG. 67. In (a) of this explanatory diagram, an example of recorded contents in which both the succeeding extent and the preceding extent have an AV block length or more is shown in the upper part. In addition, (b) to (d) show how in-memory data and extents are recorded in the In area, the Out area, and other free areas when each step in FIG. 67 is executed. ..
【0325】
In this case, underflow does not occur in the preceding extent and the succeeding extent, but the continuous length of the recording area of the data in the memory must be longer than the AV block length. In step S92, it is determined whether the total data size of the preceding extent and the in-memory data is 2 AV blocks or more.
【0326】
If the total size is 2 AV block length or more, move from step S92 to step S93, read the data of size (AV block length-data size k of in-memory data) from the end of the preceding extent, and move it to the free area. At the same time, the data in the memory is recorded in the movement destination. With this recording, the free space is filled with in-memory data and extents, as shown in FIG. 68 (b).
【0327】
If the total size of the in-memory data and the leading extent is less than the 2AV block length, the transition from step S92 to step S94 will occur. In step S94, it is determined whether the total data size of the subsequent extent and the in-memory data is 2 AV blocks or more. Making such a determination is the same as in step S92, in order to avoid a huge amount of time required for logical block writing, and assuming that data of a considerable data size is moved from the preceding extent. However, it is highly possible that the data size of the remaining extents can be kept longer than 1AV block length.
【0328】
From this point of view, if the total size is 2AV block length or more, the process proceeds to step S95, and the size (AV block length-data size k of the data in memory) is read from the tip of the subsequent extent, and this is preceded. -Move to a free area that exists in the same zone area as the subsequent extent, and record the data in memory at the move destination. With this recording, the free space is filled with in-memory data and extents, as shown in FIG. 68 (c).
【0329】
If the total size of the in-memory data and subsequent extents is less than 2AV block length and the total size of in-memory data and preceding extents is less than 2AV block length, the total write amount of the logical block is 2AV blocks. Since it is less than the above, the speed is not affected even if the movement process is positively performed. Therefore, if the total size of the in-memory data and the subsequent extent is less than 2AV block length, and the total size of the in-memory data and the subsequent extent is less than 2AV block length, the process proceeds to step S96 and precedes. The larger data size of the extent and the subsequent extent is determined. Preceding and subsequent extents as long as the criteria that the total size of the in-memory data and the succeeding extent is less than 2AV block length and the total size of the in-memory data and the succeeding extent are less than 2AV block length are met. Any of the above may be moved, but in the present embodiment, since the movement amount is to be reduced more enthusiastically, a process of determining a data having a small data size is performed. If the leading extent is smaller, the leading extent is first moved in step S97, and then the in-memory data is written to the moving destination. With this recording, the free area of 2AV block length is filled with in-memory data and extents, as shown in FIG. 68 (d).
【0330】
If the subsequent extent is smaller, the in-memory data is first written in step S98, and the subsequent extent is moved to the writing destination. As a result of this recording, the free area of 2AV block length is filled with in-memory data and extents as shown in FIG. 68 (e). After concatenating the preceding extent, in-memory data, and succeeding extent through the above processing, the file entry of the AV file Af including the preceding extent and the file entry of the AV file Af + 1 including the succeeding extent are integrated, and after concatenating. Get a single file entry and finish the process. The flow chart shows the "MERGE" processing in various cases, but in each case, the data size to be moved can be kept to 2AV block length or less at the worst. However, it is not that there are completely exceptions in which the total amount of data written exceeds 2AV blocks, and when the following two exceptions occur, the total amount of data written exceeds 2AV blocks.
【0331】
The first exception is that if two consecutive empty AV block areas are needed, there will only be one isolated AV block, and one AV block of data will be created to create two consecutive free AV blocks. This is the case when it occurs to move. The second exception is the case where new data movement occurs in step S81 of FIG. 60 when the data is taken out from the succeeding extent in the succeeding extent and the remaining portion is less than the AV block length. In this case, the amount of data to be moved as a whole will exceed 2 AV blocks.
【0332】
Up to this point, only the process of concatenating two AV files and in-memory data has been explained, but one AV file and in-memory data can be concatenated when the MERGE command is executed. In this case, the process is equivalent to adding data to the last extent of the AV file, so it is not necessary to satisfy the condition that the extent after concatenation is longer than the AV block length. Therefore, as a process, the data in the memo is recorded in the Out area following the last extent, and if all the data in the memory cannot be recorded in the Out area, an empty AV block is allocated and remains there. The data in the memory may be recorded.
【0333】
Further, although the description has been made on the premise of seamless playback in files in the concatenation process, the concatenation process on the premise of seamless playback between files may be performed. Seamless playback between files refers to playback in which the video display is not interrupted even when the playback of one AV file is branched to the playback of another AV file. When assuming seamless playback between files, it is necessary to make the continuous length of all extents equal to or longer than the AV block length when concatenating the two AV files and the data in the memory shown above, and perform more thorough concatenation processing. There is a need. This is a long sentence, but the explanation of the connection process by the AV file system unit 11 is finished. (3-2-7-1-5) Update of VOB information and PGC information This section describes how to update VOB information (time map table, seamless connection information) and PGC information (cell information) during SPLIT command and MERGE command execution processing.
【0334】
First, the update of the above information accompanying the SPLIT command execution process will be described. Of the multiple AV files obtained by the SPLIT command execution process, one AV file is given the same AV_File_ID as the AV file that recorded the VOB of the cutout source. A new identifier must be assigned to each AV_File_ID of the other AV files.
【0335】
Since the VOB previously recorded in the AV file has lost several subsections due to the SPLIT command execution process, it is necessary to delete the mark that specified this lost subsection. Similarly, cell information with such a mark as the start point and end point must be deleted from the RTRW management file. It is necessary to delete the mark point, specify the video display start frame of the AV file as C_V_S_PTM, and newly generate the cell information specified as the video display end frame of the AV file as C_V_E_PTM and add it to the RTRW management file.
【0336】
VOB information including seamless connection information and time map table is divided into multiple parts as VOB is divided. That is, if mx VOBs are obtained by the above division, it is divided into mx time map tables and seamless connection information. The VOB video display start time VOB_V_S_PTM and video display end time VOB_V_E_PTM generated by the SPLIT command execution process are updated based on the C_V_S_PTM and C_V_E_PTM that indicated the start and end points of the cell information, and the LAST_SCR in the seamless connection information. , FIRST_SCR is also updated.
【0337】
How to update the above information during the MERGE command execution process will be described. Here, even if multiple AV files become one AV file by executing the MERGE command, each VOB contained in those multiple AV files is composed of frame data that does not correlate with each other. Therefore, there is a discontinuity in the time stamp between the two AV files. In order to manage multiple VOBs originally recorded in different AV files as different VOBs, assign different VOB IDs to these multiple VOBs.
【0338】
Other than these processes, it is the same as that of the second embodiment. On the other hand, the number of frames included in the re-encoded preceding VOBU is added to C_V_E_PTM in the cell information for which the cutout range is specified. C_V_S_PTM in the cell information that specifies the cutout range of the subsequent AV file is deleted by the number of frames included in the re-encoded subsequent VOBU.
【0339】
(3-2-3) Fragmentation elimination unit 16 The fragmentation elimination unit 16 is connected to a fixed magnetic disk device, and among the extents that have already been recorded on the DVD-RAM and have been subjected to the connection processing, etc., those having free areas before and after the recording area are read out and booked. Write to a fixed magnetic disk device and create backup data in the disk device. After writing all the extents to the fixed magnetic disk device, the backup data is read again, and the extents are written so as to fill the free space existing before and after the recorded extents. Here, the extent having free space before and after the recording area is generated because the "SPLIT" command and the "SHORTEN" command are sequentially executed by the AV file system unit 11, and the execution of the "MERGE" command. It is assumed that it is left unattended because it was neither the recording destination of the data in the memory nor the movement destination of other extents at times.
【0340】
FIG. 69 is an explanatory diagram for supplementarily explaining the processing contents by the fragmentation elimination unit 16. In this figure, extent # x is shown in the figure as an extent having free areas i and j before and after the recording area. As shown in FIG. 69 (a), the defragmentation unit 16 detects such an extent, reads it out to the DVD recorder 70, and writes it to the fixed magnetic disk device.
【0341】
By such writing, backup data is created in the disk device as shown in FIG. 69 (b). After that, as shown in FIG. 69 (c), the backup data is read from the fixed magnetic disk device, and the extents are written so as to fill the free space j existing before and after the recorded extents. Since the free space is packed, the data size of the free space located behind extent # x is i + j, and its continuous length can be increased. If such processing is also performed for the extent #y that follows the free area, the size of the free area can be further increased.
【0342】
Since the recording by the defragmentation unit 16 is performed after the backup data of the extent already recorded in the DVD-RAM is once created in the fixed magnetic disk device, the DVD recorder 70 is in the middle of the writing period to the DVD-RAM. Even if the power is cut off, it is possible to retry the writing of the extent that was interrupted in the middle when the power is turned on next time. Since the backup data is created in the disk device in this way and then the extents are packed, the extents are not lost even if the power of the DVD recorder 70 is turned off during writing.
【0343】
As described above, according to the present embodiment, even if the operator performs arbitrary editing on a plurality of AV files and a plurality of fragmentary AV files having a short continuous length are generated, the DVD recorder 70 has such a continuous sequence. By concatenating short AV files to generate an AV file with a length longer than the AV block, fragmentation of the AV file can be eliminated and the audiovisual data recorded in the AV file can be played continuously. Can be made.
【0344】
Also, in the concatenation process, it is determined whether the total amount of data to be written is 2AV block length or more, and if the total amount of write data size is 2AV block length or more, the movement amount of the recorded AV file should be reduced. Since the amount of movement is limited, it is guaranteed that the total amount of write data size will be less than 2AV block length, which can complete the elimination of fragmentation in a short period of time.
【0345】
Furthermore, even if the operator makes arbitrary edits to a plurality of AV files and it becomes necessary to record re-encoding with a short continuous length, the DVD recorder 70 will generate such re-encoded data with a short continuous length. Since the recording position is selected and recorded so that it is connected to the audiovisual data to be reproduced before and after that, it is possible to prevent the re-encoded data from being recorded in fragments, and the video recorded in the AV file. It is possible to continuously reproduce the acoustic data.
【0346】
It should be noted that the movement of data is not limited to the case where continuous data less than a predetermined fixed amount is generated, but when the two audiovisual data are connected and the two audiovisual data are too far apart on the disk. , Data may be moved. This is because the data created by connecting physically separated audiovisual data is arranged so that continuous reproduction can be guaranteed when the data is reproduced normally. However, when fast-forwarding special playback is performed, if the data to be played back is too far away, the playback will be jerky.
【0347】
In order to make this smooth, when connecting two audiovisual data, one of the data is continuous data that is several times the size of a predetermined fixed amount, and the two audiovisual data are roughly evenly spaced. If there is free space in the AV block, move the data there. As a result, it is possible to smoothly perform special reproduction while guaranteeing normal reproduction.
【0348】
Further, the time code may be extracted from the cell information mark, the information such as the address may be extracted from the time map table, managed in the table, displayed on the initial state screen or the like, and used as selection assistance information for the user. Further, a reduced image of each mark may be created, these may be recorded in a separate file, each mark may have pointer information for these reduced images, and may be used as auxiliary information when displaying cell information in the initial state or the like. ..
【0349】
In addition, although moving image data and audio data are handled in this embodiment, they are not essentially limited, and run-length compressed sub-video data such as subtitles used in DVD-ROM and stillness are used. Image data may be handled. Finally, the procedure of the AV file system described with reference to the flowchart in the third embodiment (FIGS. 48 (a), 48 (b), 49 to 50, 55, 60, 65, 67). ) Etc. may be realized by a machine language program, and this may be recorded on a recording medium and made a target for distribution and sale. Such recording media include IC cards, optical discs, floppy disks, and the like, and the machine language programs recorded on these media can be used by being installed in a general-purpose computer. This general-purpose computer sequentially executes the installed machine language program to realize the function of the video data editing device shown in the present embodiment.
【0350】
(Fourth Embodiment) The fourth embodiment is an embodiment in which hierarchical video editing consisting of provisional editing and main editing is realized by using two types of program chains, user-defined PGC-original PGC. User-defined PGC-A new table has been added to the RTRW management file shown in the first embodiment to define the original PGC. (4-1) RTRW management file The configuration of the RTRW management file in the fourth embodiment will be described. In the fourth embodiment, the RTRW management file is recorded in the same directory (RTRW directory) as the AV file, and contains the contents shown in FIG. 70 (a).
【0351】
FIG. 70 (a) is a diagram in which the recorded contents of the RTRW management file in the fourth embodiment are stepwise refined. That is, the logical format located on the right side in this figure is a refinement of the logical format located on the left side, and the leader line shown by the broken line shows that the logical format on the right side is within the logical format on the left side. It clarifies which part of the throat was refined.
【0352】
With reference to the VOB logical format in this figure according to such notation, the RTRW management file contains the original PGC information table, the user-defined PGC information table, and the title search pointer in addition to the VOB information shown in the first embodiment. It can be seen that and is recorded. (4-1-2) Contents of original PGC information The "original PGC information table" consists of a plurality of original PGC information.
【0353】
The original PGC information is information that specifies each of a plurality of VOBs recorded in an AV file existing in the RTRW directory, or a partial section in each VOB according to the arrangement order. The original PGC information is associated with each of the VOBs recorded in the AV file existing in the RTRW directory, and when the AV file is recorded in the RTRW directory, the original PGC information at that time is the video data. Generated by the editing device and recorded in the RTRW management file.
【0354】
The data format of the original PGC information is shown in Fig. 70 (b). The original PGC information is composed of a plurality of cell information, and the cell information is a cell ID (CELL # 1, # 2, # 3, # 4 ... in the figure, which is an identifier uniquely assigned to each cell information. -), AV file ID (AVF_ID in the figure), VOB_ID, C_V_S_PTM, and C_V_E_PTM. The AV file ID is a field for entering the cell information and the identifier of the corresponding AV file.
【0355】
VOB_ID is a field for entering the VOB identifier included in the AV file. When multiple VOBs are included in the AV file corresponding to the cell information, it has the role of clearly indicating which of the multiple VOBs the cell information corresponds to. "Cell start time C_V_S_PTM (abbreviated as C_V_S_PTM in the figure)" is information indicating the start point of the subsection specified by the cell information, and is attached to the start time of the video field located at the start point. It has an entry field for entering the completed PTS in the PTM description format.
【0356】
"Cell end time C_V_E_PTM (abbreviated as C_V_E_PTM in the figure)" is information indicating the end point of the subsection specified by the cell information, and the end time of the video field located at the end point is PTM. It has an entry field for entry in the description format. The time information in "cell start time C_V_S_PTM" and "cell end time C_V_E_PTM" means the start point of the encoding operation by the video encoder, the end point of the encoding operation, the mark point inserted by the operator, and the like.
【0357】
Further, the "cell end time C_V_E_PTM" of each cell information of the original PGC information matches the "cell start time C_V_S_PTM" of the cell information arranged in the next order in the original PGC information. Since the "cell end time C_V_E_PTM" and "cell start time C_V_S_PTM" of each cell information have such a matching relationship, in the original PGC, all the parts in the VOB are not dropped. The subsection of is specified. In addition, the original PGC cannot specify subsections in an order in which the order in VOB and the front and back are interchanged.
【0358】
(4-1-3) Contents of user-defined PGC information The "user-defined PGC information table" consists of a plurality of user-defined PGC information. The data format of user-defined PGC information is shown in Fig. 70 (c). Like the original PGC information, the user-defined PGC information is composed of a plurality of cell information, and the cell information is composed of an AV file ID, VOB_ID, C_V_S_PTM, and C_V_E_PTM.
【0359】
The user-defined PGC information is composed of a plurality of cell information like the original PGC information, but the cell information is different from the original PGC information in what kind of cell information and from what viewpoint it is arranged. The original PGC information instructs the video object's subsections to be played sequentially according to their arrangement order, whereas the user-defined PGC information indicates that the video object's subsections are not constrained by the arrangement order. You can instruct it to play.
【0360】
Here, the partial section specified by the cell in the user-defined PGC is the partial section itself (all sections) specified by the cell information in the original PGC information, or the part specified by the cell information in the original PGC information. It is further inside (partial section) than the section. In addition, the subsection specified in one cell information may be duplicated in another cell information. That is, there may be overlap between cells. Further, the sub-section specified by a certain cell information and the sub-section specified by another cell information may be separated from each other. That is, there may be a gap between the cells. In the user-defined PGC information, not all subsections in the VOB need to be specified, and some subsections in the VOB may not be specified.
【0361】
In the original PGC, the reproduction order was significantly restricted, whereas in the user-defined PGC, such a restriction is not imposed, and the reproduction order of cells can be freely defined. Specifically, it may be in the reverse order of the order in the VOB. In addition, it may be specified across the subsections of VOBs recorded in different AV files. Since the original PGC specifies the subsections in one AV file and VOB according to the order in the AV file and VOB, the order of each subsection in the AV file and VOB that is the specification source is respected. However, the user-defined PGC is not constrained by the order of each subsection in the VOB, and the operator specifies which subsection is desired to be viewed in what order, that is, the subsection is specified according to the user's viewing intention. be able to. Therefore, it can be seen that the user-defined PGC is suitable for the purpose of preserving the decision order when tentatively deciding in what order the plurality of subsections included in the VOB are to be connected during video editing work.
【0362】
Also, the original PGC is associated with the AV file and the VOB in the AV file, and the cell in the original PGC specified only a subsection of that VOB, but the user-defined PGC is associated with a specific VOB. There is no constraint that it cannot be done, and the cell information included in the user-defined PGC information may specify different VOB subsections.
【0363】
Further, the original PGC is generated at the time of recording the AV file, but the user-defined PGC may be generated at any time after the time when the AV file is recorded. (4-1-4) PGC information-VOB information-AV file integrity The interrelationship between the AV file, VOB, time map table, and PGC information described above will be described. FIG. 71 shows the interrelationships between the AV file, VOB, VOB information, original PGC information, and user-defined PGC information, and among these, the ones that are integrated are arranged in the frame of the thick line (in addition, the figure). In 71, PGC information is abbreviated as PGC information).
【0364】
In FIG. 71, the original PGC information # 1 consisting of AV file # 1, VOB information # 1, cell information # 1-cell information # 2-cell information # 3, including VOB # 1, is arranged in the same thick line frame. The original PGC information # 2, which consists of AV file # 2, VOB information # 2, cell information # 1-cell information # 2-cell information # 3, including VOB # 2, is arranged in the same thick line frame. You can see that.
【0365】
The set of AV file (VOB) -VOB information-original PGC information surrounded by these thick lines is called the original PGC in the DVD-RAM standard. The DVD-RAM standard compliant video data editing device recognizes this unit called the original PGC as a management unit called the video title. In the example of FIG. 71, a set of AV file # 1, VOB information # 1, and original PGC information # 1 arranged in the same thick line frame is named original PGC # 1, and is in the same thick line frame. The set of AV file # 2, VOB information # 2, and original PGC information # 2 distributed in is named the original PGC # 2.
【0366】
When recording the original PGC, the encoded VOB must be recorded on DVD-RAM, VOB information must be generated, and the original PGC information about the VOB must be generated. Recording of the original PGC is considered to be completed only by recording the AV file-VOB information table-original PGC information on DVD-RAM. Conversely, simply recording an encoded VOB as an AV file on a DVD-RAM does not mean that the recording of the original PGC is complete.
【0367】
The same applies when erasing, and the original PGC is integrated. In other words, when any one of the AV file, VOB information, and original PGC information is deleted, the one that constitutes the original PGC together with it is deleted at the same time. Then, in what unit the original PGC is reproduced, the reproduction of the original PGC is performed by specifying the original PGC information by the operator. Conversely, the AV file and VOB are not directly specified by the operator and are not ordered to be played.
【0368】
The original PGC can be partially reproduced, but the partial reproduction of the original PGC is performed by specifying the cells included in the original PGC by the operator, and is less than the cells. For example, VOBU is not directly specified and partial playback is not ordered. The unity in the original PGC information is as described above. Next, the unit in which the user-defined PGC information is managed as a video title will be described. In Fig. 71, the original PGC has the original PGC information-VOB information table-AV file in the same thick line frame, whereas cell information # 1, cell information # 2, cell information # 3, and cell information. It can be seen that the user-defined PGC information # 3 in the figure consisting of # 4 is independently surrounded by a thick line frame. This indicates that in the DVD-RAM standard, user-defined PGC information is managed independently as a title, not as actual AV data.
【0369】
Therefore, it can be said that the generation of the user-defined PGC is completed only by the video data editing device defining the user-defined PGC information in the RTRW management file. That is, in the user-defined PGC, the relationship "creation of the user-defined PGC equals the definition of the user-defined PGC information" is established. The same applies at the time of deletion, and as long as the user-defined PGC information is deleted from the RTRW management file, it is considered that the user-defined PGC composed of the user-defined PGC does not exist.
【0370】
The playback unit of the user-defined PGC is the same as that of the original PGC. Playback of the user-defined PGC is performed by designating the user-defined PGC by the operator. The user-defined PGC can also be partially regenerated. Partial playback of the user-defined PGC is performed by specifying the cells contained in the user-defined PGC by the operator.
【0371】
It is clear that the original PGC-user-defined PGC is different as described above, but from the operator's point of view, the original PGC-user-defined PGC specifies PGC information and cell information for overall playback. -Since partial playback is performed, you do not have to be aware of the difference between the two. Therefore, without discriminating the difference between the original PGC and the user-defined PGC, these are uniformly managed in units of video titles.
【0372】
Next, how the original PGC and the user-defined PGC are reproduced will be described. The dashed arrow in FIG. 71 represents the relationship between the data on the referenced side and the data on the reference side. Arrows y2, y4, y6, y8 specify the reference relationship between each VOBU in the VOB and the timecode contained in the timemap table in the VOB information, with arrows y1, y3, y5, y7. Clarifies the reference relationship between each time code contained in the time map table in the VOB information and the cell information.
【0373】
It is assumed that the operator has specified one of the PGCs and instructed to play the video title. If the specified PGC is the original PGC # 1, the cell information # 1 located at the beginning of the original PGC # 1 is fetched by the playback device. Subsequently, by referring to the AV file and VOB identifier included in the extracted cell information # 1, the AV file corresponding to the cell information, AV file # 1 as VOB, VOB # 1, and the VOB # 1 are used. Timemap table # 1 for VOBs is identified.
【0374】
The specified time map table # 1 shows the size of each VOBU that composes the VOB and the playback time of those VOBUs. Is selected and has the address and elapsed time from the beginning of the VOB, so by referring to the time map table using the cell start time C_V_S_PTM as shown by the arrow y1, the cell start time included in the cell information # 1 Identify which VOBU in the AV file C_V_S_PTM corresponds to, and identify its start address. This reveals the start address of the VOBU corresponding to the cell start time C_V_S_PTM, so the playback device accesses VOB # 1 as shown by arrow y2, and the VOBU # 1 to VOBU columns shown at this start address. Start reading.
【0375】
On the other hand, since the cell information # 1 includes the cell end time C_V_E_PTM together with the cell start time C_V_S_PTM, the cell information # 1 can be changed to the cell information # 1 by referring to the time map table using the cell end time C_V_E_PTM as shown by arrow y3. Identify which VOBU in the AV file the included cell end time C_V_E_PTM corresponds to. This reveals the start address of the VOBU corresponding to the cell end time C_V_E_PTM. Assuming that the VOBU specified here is VOBU # 10, as shown by arrow y4, the reading of the VOBU column ends when VOBU # 10 is reached.
【0376】
If the AV file is accessed via the cell information # 1-VOB information # 1 as described above, the part of the VOB # 1 recorded in the AV file # 1 specified by the cell information # 1 is specified. Only the section can be read. If such a partial section is read out for cell information # 2, cell information # 3, and cell information # 4, all VOBUs included in VOB # 1 are read out and reproduced.
【0377】
As described above, in the reproduction based on the original PGC information, the partial sections in the VOB can be reproduced according to the arrangement order. On the other hand, it is assumed that the operator has instructed to play the video title by designating one of the user-defined PGCs. If the specified PGC is a user-defined PGC # 1, the cell information # 1 located at the beginning of the user-defined PGC information # 1 is fetched by the playback device. Then, by referring to the time map table # 1 using the cell start time C_V_S_PTM included in the cell information as shown by the arrow y5, the cell start time C_V_S_PTM included in the cell information # 1 is VOB. Identify which VOBU in # 1 corresponds to. This reveals that the VOBU corresponding to the cell start time C_V_S_PTM is VOBU # 11, so the playback device accesses VOB # 11 as shown by arrow y6 and VOBU # 11 indicated at this start address. Start reading the VOBU column from.
【0378】
On the other hand, since the cell information # 1 of the user-defined PGC # 1 includes the cell end time C_V_E_PTM together with the cell start time C_V_S_PTM, refer to the time map table using the cell end time C_V_E_PTM as shown by arrow y7. Identify which VOBU in VOB # 1 the cell end time C_V_E_PTM included in cell information # 1 corresponds to. Assuming that the VOBU specified here is VOBU # 21, as shown by arrow y8, the reading of the VOBU column ends when VOBU # 21 is reached.
【0379】
After accessing the AV file via cell information # 1-VOB information # 1 as described above, the same processing is performed for cell information # 2 and cell information # 1 included in user-defined PGC information # 1. 3. Perform for cell information # 4. When the cell information # 2 located next to the cell information # 1 is fetched by the playback device, the AV file identifier included in the fetched cell information # 2 is referred to to correspond to the cell information. The AV file # 2 and the time map table # 2 corresponding to the AV file are specified.
【0380】
In the specified time map table, the size of each VOBU that composes the VOB and the playback time of those VOBUs are recorded, and the representative VOBU is selected at regular intervals, for example, in units of several tens of seconds to further improve access performance. Since it has the address and elapsed time from the beginning of the VOB, the cell start time C_V_S_PTM included in the cell information # 2 can be obtained by referring to the time map table using the cell start time C_V_S_PTM as shown by the arrow y9. Identify which VOBU in the AV file corresponds to. This reveals the start address of the VOBU corresponding to the cell start time C_V_S_PTM, so the video data editor accesses VOB # 2 as shown by arrow y10, and VOBU # 1 to VOBU shown at this start address. Start reading the column.
【0381】
On the other hand, cell information # 2 includes cell end time C_V_E_PTM as well as cell start time C_V_S_PTM. Therefore, by referring to the time map table using cell end time C_V_E_PTM as shown by arrow y11, cell information # 2 Identify which VOBU in the VOB the cell end time C_V_E_PTM contained in contains corresponds to. This reveals the start address of the VOBU corresponding to the cell end time C_V_E_PTM. Assuming that the VOBU specified here is VOBU # 11, as shown by arrow y12, the reading of the VOBU column ends when VOBU # 11 is reached.
【0382】
In playback using user-defined PGC information, arbitrary subsections of VOBs recorded in two AV files can be played back in a predetermined order. This concludes the explanation of the integrity of AV file-VOB information-PGC information. Next, the title search pointer shown in FIG. 70 (d) will be described. (4-1-5) Contents of the title search pointer The "title search pointer" is information for managing VOB information, time map table, PGC information, and AV files recorded in this DVD-RAM in the unit of the video title described above, and is the original PGC information and the information for managing the AV file. The PGC number assigned to the user-defined PGC information is associated with the title type and the title recording history.
【0383】
The "title type" indicates that the video title having each PGC information is the original type by being set to 00 bytes, and the video title consisting of each PGC information is user-defined by being set to 01 bytes. This is the information corresponding to each PGC number with a flag indicating that it is a type. The "title recording history" is information indicating the date on which the PGC information was recorded is the month and day of the year, and the recording time is from the hour, minute, and second.
【0384】
When the RTRW directory in the DVD-RAM is specified, the DVD-RAM standard compliant video data editing device reads this title search pointer from the RTRW management file and puts the original PGC in each directory of the DVD-RAM. , It is possible to immediately recognize how many user-defined PGCs are recorded and when these video titles were recorded in the RTRW directory.
【0385】
(4-1-6) User-defined in this edit-Compatibility between original PGC information The user-defined PGC information defined in the provisional edit can be used to specify the connection order between cells in the main edit as shown in the fourth embodiment. Further, if the user-defined PGC information is updated to the original PGC information after the main editing shown in the fourth embodiment is performed, the original PGC information about the VOB obtained by the connection can be easily created. .. This is because the user-defined PGC information and the original PGC information have the same data structure except for the title type value, and the VOB subsection obtained after this editing is converted to the user-defined PGC information before this editing. This is because it was specified as.
【0386】
Hereinafter, the procedure of the main editing in the fourth embodiment and how the user-defined PGC information is updated to the original PGC information before and after the main editing will be described. FIG. 72 is a diagram showing an example of a user-defined PGC-original PGC. In this figure, the original PGC information # 1 includes only the cell # 1, and the VOB # 1 and the VOB information are integrated to form the original PGC. On the other hand, the user-defined PGC information # 2 forms a user-defined PGC only with cells # 1, cell # 2, and cell # 3.
【0387】
Cell # 1 specifies a subsection from VOBU # 1 to VOBU # i as shown by the dashed arrows y51 and y52, and cell # 2 specifies VOBU # as shown by the dashed arrows y53 and y54. A subsection from i + 1 to VOBU # j is specified. Cell # 3 specifies a subsection from VOBU # j + 1 to VOBU # k + 2, as shown by the dashed arrows y55 and y56. Of these, only cell # 2 in the user-defined PGC information is deleted, and this editing is instructed using the deleted user-defined PGC information, that is, the user-defined PGC information # 2 consisting of cells # 1 to cell # 3. It shall be. FIG. 73 is a diagram in which the portion corresponding to the cell in the deletion range is hatched.
【0388】
As shown inside the frame w11, the deleted cell # 2 specifies one of the video frames of the plurality of picture data included in the VOBU # i + 1 as C_V_S_PTM. Further, as shown inside the frame w12, one of the video frames among the plurality of picture data included in VOBU # j + 1 is designated as C_V_E_PTM. When this editing is performed using this user-defined PGC information # 2, VOBU # i, VOBU # i + 1, VOBU # i + 2 located at the end in cell # 1 and the tip are located in cell # 2. Re-encoding for VOBU # j, VOBU # j + 1, and VOBU # j + 2 is performed according to the procedure shown in the first embodiment-second embodiment, and the concatenation process between extents is performed. 3 Performed according to the procedure shown in the embodiment.
【0389】
FIG. 74 (a) shows which ECC block on the DVD-RAM is released to the free space by this editing using the user-defined PGC information # 2. With reference to the second stage of Fig. 74 (a), VOBU # i, VOBU # i + 1, and VOBU # i + 2 are recorded on the AV block # m, and VOBU # j, VOBU # j + 1, and VOBU. It can be seen that # j + 2 is recorded in the AV block #n. As shown in FIG. 73, cell # 2 specifies the picture data contained in VOBU # i + 1 as C_V_S_PTM, and the picture data contained in VOBU # j + 1 as C_V_E_PTM. Therefore, as shown inside the frames w13 and w14, the ECC block occupied by VOBU # i + 2 to the ECC block occupied by VOBU # j are the SPLIT command and SHORTEN command shown in the third embodiment. Is released to free space. On the other hand, the ECC block occupied by VOBU # i and VOBU # i + 1 and the ECC block occupied by VOBU # j + 1 and VOBU # j + 2 are not released into the free space.
【0390】
FIG. 74 (b) shows an example of VOB, VOB information, and PGC information after this editing. Since the part corresponding to cell # 2 has been deleted, VOB # 1 is divided into (new) VOB # 1-VOB # 2. When the SPLIT command is issued, the VOB information about VOB # 1 is divided into VOB information # 1 and VOB information # 2. The time map table included in these VOB information is also divided into time map table # 1 and time map table # 2. Although not shown, seamless connection information is similarly divided.
【0391】
Each VOBU in VOB # 1-VOB # 2 is referenced via a divided timemap table. The data structure of the user-defined PGC information and the original PGC information are the same except for the title type value, and the partial section of VOB obtained after this editing is the user-defined PGC information # 2 before this editing. Since it was specified, user-defined PGC information # 2 has been updated to the original PGC information. Since the original PGC information is defined using the user-defined PGC information # 2 for which the partial section was specified before this editing, it is not necessary to define the original PGC information again after this editing. (4-2) Functional block of DVD recorder 70 FIG. 75 is a functional block diagram showing the configuration of the DVD recorder 70 according to the fourth embodiment. Each function in the figure is realized by the CPU 1a in the control unit 1 executing the program of the ROM 1e to control the hardware shown in FIG.
【0392】
In FIG. 75, the DVD player includes a disc recording unit 100, a disc reading unit 101, a common file system unit 10, an AV file system unit 11, and a recording / editing / playback control unit 12. 3 Although it is common to the video data editing device shown in the embodiment, the AV data recording unit 13 edits the title recording control unit 22, the AV data playback unit 14 edits the title playback control unit 23, and the AV data editing unit 15 edits. It differs from the third embodiment in that it is replaced by the layered control unit 26. Further, instead of the fragmentation elimination unit 16 shown in the third embodiment, a PGC information table work area 21, an RTRW management file work area 24, and a user-defined PGC information generator 25 are newly provided.
【0393】
(4-2-1) Recording / editing / playback control unit 12 The recording / editing / playback control unit 12 in the fourth embodiment receives from the operator the designation of the directory to be operated in the directory structure on the DVD-RAM. When the operation target is specified, the operation content by the operator is specified based on the user operation notified from the remote control signal receiver 8, and the operation content processing is controlled by title recording for the directory specified as the operation target. Instruct unit 22, title playback control unit 23, etc. to do this.
【0394】
FIG. 77 (a) is a diagram showing an example of graphics data displayed on the television receiver 72 under the control of the recording / editing / playback control unit 12. When any of the directories is set to the focus state, the recording / editing / playback control unit 12 waits for the confirmation key on the remote controller 71 to be pressed. The recording / editing / playback control unit 12 identifies the directory in the focus state as the current directory when the confirmation key is pressed.
【0395】
(4-2-2) PGC Information Table Work Area 24 The PGC information table work area 24 is a memory area in which a logical format is defined so as to sequentially define PGC information. The internal area of this PGC information table work area 24 is managed in a matrix. PGC information table In the work area 24, a plurality of PGC information is arranged in the row direction, and a plurality of cell information is arranged in the column direction. PGC information table Arbitrary cell information among the PGC information stored in the work area 24 is accessed using a set of a row number and a column number.
【0396】
FIG. 76 is an example of the original PGC information stored in the PGCI table work area 24. At the time when the recording of the AV file is completed, the user-defined PGC information table is empty (NULL). Of the PGC information in this figure, the original PGC information # 1 includes cell information # 1 with time T0-time T1 as the start point-end point of the subsection, and time T1-time T2 as the start point-end of the subsection. Cell information # 2 as a point, time T2-cell information # 3 with time T3 as the start point-end point of the subsection, time T3-cell information # 4 with time T4 as the start point-end point of the subsection It can be seen that it is included.
【0397】
(4-2-3) Title recording control unit 22 The title recording control unit 22 records the VOB on the DVD-RAM as in the AV data recording unit 13 in the third embodiment, and together with this recording process, generates a time map table and VOB information in the RTRW management file work area 24. Then, the original PGC information is generated and stored in the PGCI table work area 24.
【0398】
The generation of the original PGC information is realized by the title recording control unit 22 following the procedure shown below. First, the title recording control unit 22 secures a row area in the PGC information table work area 14 when the recording / editing / playback control unit 12 notifies that the recording key is pressed. Next, when the AV file recording control unit 13 assigns the AV file identifier and the VOB identifier to the newly generated VOB, the title recording control unit 22 acquires them and associates them with the newly assigned PGC number. And store it in the newly secured row area.
【0399】
Subsequently, at the start of VOB encoding, the MPEG encoder 2 is instructed to output the PTS of the first video frame, and when the encoder control unit 2g outputs the PTS for the first video frame, this is held and the operator operates. Waits for the marking operation by. FIG. 80 (a) is a diagram showing how data input / output is performed between the components shown in FIG. 75 when a marking operation is performed. It is assumed that the operator presses the mark key while viewing the image displayed on the television receiver 72. Then, the marking operation is notified to the title recording control unit 22 through, in FIG. 80 (a), and the title recording control unit 22 encodes the PTS at the time of pressing as time information as shown in FIG. 80 (a). Obtained from control unit 2g.
【0400】
The above processing is repeated while encoding to VOB is being performed, but if an operation to stop recording is performed during generation, the playback end time for the last encoded video frame will be output. When the encoder control unit 2g is instructed and the encoder control unit 2g outputs the playback end time for the last video frame, it holds it.
【0401】
When the above processing is repeated until the VOB encoding is completed, the title recording control unit 22 displays the AV file identifier, the VOB identifier, the playback start time of the first video frame, and the video frame at the time when the marking operation is performed. Will hold the playback start time of and the playback end time of the last video frame. Of the time information held in this way, a set of time information that is the start point-end point of the subsection is newly secured in the PGC information table work area 14 as one cell information by adding the AV file identifier and VOB identifier. Store in the line area. As a result, the original PGC information is newly generated.
【0402】
After the above generation is completed, the type information indicating that this PGC information is the original PGC information and the recording date and time when the recording of the original PGC information is completed are recorded in association with the PGC number assigned to this original PGC information. A title search pointer indicating history information is generated on the PGC information table work area 21. If the title playback control unit 23 can detect the time when the content of the scene changes significantly, the user-defined PGC information generator 25 automatically acquires the cell information by automatically acquiring the PTS at the time when the scene is changed. You may set it.
【0403】
Further, since the creation of the time map table and VOB information is not the main purpose of this embodiment, the description thereof will be omitted. (4-2-4) Title playback control unit 23 The title reproduction control unit 23 performs total reproduction or partial reproduction of any of the video titles recorded in the current directory designated by the recording / editing / reproduction control unit 12.
【0404】
Specifically, the title playback control unit 23 indicates that the operator plays the video title recorded in that directory while any directory is selected as the current directory as shown in FIG. 77 (a). When the operation of is performed, the screen shown in Fig. 77 (b) is displayed, the original PGC information table and user-defined PGC information table in the RTRW management file in that directory are read, and the entire original PGC or user-defined PGC in the current directory is read. Have the operator specify whether to perform playback or partial playback. FIG. 77 (b) is a diagram showing PGCs and cells listed as operation targets, and the PGC information and cell information appearing here are the same as those shown in the example of FIG. 76. In this dialogue screen, the original PGC is represented as a simple graph with the horizontal axis as the time axis, and is displayed with the recording date and time of the original PGC. The lower right menu in this figure indicates whether to perform full playback or partial playback of the video title in the current directory, and the operator can press the 1 key or 2 key on the remote controller 71. Either of these can be selected. If total playback is instructed, the title playback control unit 23 causes the operator to specify any PGC as an operation target, and if partial playback is instructed, the title playback control unit 23 operates any cell. Let the operator specify as.
【0405】
When the PGC and cell to be played back are specified, the title playback control unit 23 extracts the cell included in the PGC specified as the operation target and refers to the time map table as shown in FIG. 71. By doing so, the partial section is regenerated. When the reproduction of the partial section is completed, the dialogue screen shown in FIG. 77 (b) is displayed, and the selection of the next cell information is awaited.
【0406】
FIG. 78 (a) is a float chart showing the processing contents at the time of partial reproduction of cell information. First, in step S271, C_V_S_PTM and C_V_E_PTM are read from the original PGC information and the cell information to be reproduced in the user-defined PGC information. Subsequently, in step S272, the address of the VOBU (START) including the picture data to which C_V_S_PTM is added is specified. In step S273, the address of the VOBU (END) including the picture data to which C_V_E_PTM is added is specified, and in step S274, the range from VOBU (START) to VOBU (END) is read from the VOB. In step S276, the MPEG decoder 4 is instructed to decode the VOBU in the read range. In step S277, the title reproduction control unit 23 requests the decoder control unit 4k in the MPEG decoder 4 to perform decoding processing, and also performs cell reproduction start time information (C_V_S_PTM) and cell reproduction end time information (C_V_E_PTM) as effective reproduction section information. Is output.
【0407】
The reason why the effective reproduction section is output to the MPEG decoder 4 in this way is that the decoder control unit 4k in the MPEG decoder 4 tries to decode even the picture data outside the partial section specified by the cell. That is, the unit that the MPEG decoder 4 can perform the decoding process is the VOBU unit, in which the entire range from VOBU (START) to VOBU (END) is decoded, and the picture data outside the partial section specified by the cell is decoded. Even it will be played. Since cells are specified in video field units, picture data outside the subsection must be prohibited by some method. The title reproduction control unit 23 outputs the effective section information to the MPEG decoder 4 in order to prohibit the reproduction outside the section. In FIG. 78 (b), only the section from the cell playback start time information (C_V_S_PTM) to the cell playback end time information (C_V_E_PTM) is reproduced and output in the range from VOBU (START) to VOBU (END). It is a figure which shows the state of being.
【0408】
Due to the output of the effective playback section, the MPEG decoder 4 stops the display output of multiple video fields from the beginning of VOBU to C_V_S_PTM among all VOBUs instructed to decode, and then stops the display output of multiple video fields from C_V_E_PTM to the end of VOBU. Stop the display output. As a result, the VOBU string read from the disk access unit 3 via the logical connection line (1) in the hardware configuration diagram shown in FIG. 17 is subject to decoding processing by the MPEG decoder 4. Of the decoding results, playback output is prohibited for the section before C_V_S_PTM and the section after C_V_E_PTM. As a result, only the partial section specified by the cell information is reproduced.
【0409】
As for the original PGC information or the user-defined PGC information, since a plurality of cell information is included in one PGC information, the procedure of FIG. 78 (a) above is applied to all the cell information included in one PGC information. Just repeat. (4-2-5) RTRW management file work area 24 The RTRW management file work area 24 includes an original PGC information table consisting of a plurality of original PGC information generated on the PGC information table work area 24, a user-defined PGC information table consisting of a plurality of user-defined PGC information, and a title search pointer. It is a work area for arranging VOB information and VOB information according to the logical format shown in Fig. 70. If the common file system unit 10 writes the data arranged here to the RTRW directory as a non-AV file, RTRW The RTRW management file has been recorded in the directory.
【0410】
(4-2-6) User-defined PGC information generator 25 The user-defined PGC information generator 25 generates user-defined PGC information based on any of the PGC information recorded in the RTRW management file of the current directory. The cell information (user-defined cell information) in the user-defined PGC information includes the subsections specified by the cell information of the existing PGC information that further specify the inside (1), and the existing cell information. There are two types (2) in which the subsection to be specified is specified as it is, but the user-defined PGC information generator 25 generates these cell information by different methods.
【0411】
The generation of the user-defined cell information (1) that further specifies the inside of the partial section specified by the existing cell information is performed with the partial reproduction using the cell information by the title reproduction control unit 23. That is, during the period of partial reproduction using the existing cell information, the user-defined PGC information generator 25 monitors when the marking operation is performed by the operator, and starts and ends the marking operation time point. The generation of cell information as points is repeated, and user-defined PGC information consisting of such cell information is generated.
【0412】
FIGS. 79 (a) and 79 (b) are diagrams showing how the operator uses the television receiver 72 and the remote controller 71 when generating the user-defined PGC information. FIG. 80 (b) is a diagram showing how data input / output is performed between the components shown in FIG. 75 when a marking operation is performed. While viewing the image displayed on the television receiver 72 as shown in FIG. 79 (a), it is assumed that the image becomes a scene that one likes and the operator presses the mark key. After that, as shown in Fig. 79 (b), it is assumed that the scene in which the image is liked by oneself ends and the scene in which one is not very interested begins. Therefore, it is assumed that the operator presses the mark key.
【0413】
Then, the marking operation is notified to the user-defined PGC information generator 25 through, in FIG. 80 (b), and the user-defined PGC information generator 25 sets the time information of the PTS at the time of pressing as shown in FIG. 80 (b). Is obtained from the decoder control unit 4k. The user-defined PGC information generator 25 attaches an AV file identifier and a VOB identifier to a set of PTSs held in this way, which is the start point-end point of the subsection, and shows them as one cell information. Store in the row area newly secured in the PGC information table work area 24.
【0414】
When generating user-defined cell information that specifies the subsection itself specified in the existing cell information, the user-defined PGC information generator 25 uses the cell information already stored in the row area in the PGC information table work area 24. Copy to another line area. Specifically, the user-defined PGC information generator 25 allocates a row area for one row in the PGC information table work area 24, and assigns a new user-defined PGC information identifier to this row area. Of the cell information in the PGC information already stored in the PGC information table work area 24, when the cell information to be used as an element of the user-defined PGC information is instructed using a set of row number and column number. , The cell information specified by this set is read out and copied to the newly secured row area.
【0415】
(4-2-7) Edit Hierarchy Control Unit 26 The edit layering control unit 26 is intended to allow the operator to view in advance the temporary editing work realized by the definition of the user-defined PGC information and what kind of image will be obtained when the main editing is performed according to the temporary editing result. The title is reproduced so that the preview work of the above, the seamless connection shown in the first embodiment and the second embodiment, and the main editing work realized by the connection processing between the AV files shown in the third embodiment are performed hierarchically. Controls the control unit 23 and the user-defined PGC information generator 25.
【0416】
(4-2-7-1) Editing Hierarchy Editing processing procedure by Hierarchy Control Unit 26 Hereinafter, a specific processing procedure for layering control by the editing layering control unit 26 will be described. When a temporary edit is ordered by pressing the interactive screen remote control 71 in FIG. 77 (a), the edit layer control unit 26 accesses the RTRW directory, and the edit layer control unit 26 sends the common file system unit 10. Instructs the RTRW management file to be read from the RTRW directory and stored in the RTRW management file work area 24. After that, among the RTRW management files read into the RTRW management file work area 24, the original PGC information table, the user-defined PGC information table, and the title search pointer are transferred to the PGC information table work area 24.
【0417】
Based on the transferred original PGC information table, the edit hierarchy control unit 26 displays the dialogue screen shown in FIG. 85 and waits for an instruction from the operator. FIG. 85 is an example of an interactive screen displayed on the television receiver 72 in order to accept an operation of selecting a cell that is a component of a user-defined PGC in temporary editing. In this dialogue screen, the original PGC and the user-defined PGC are represented as a simple graph with the horizontal axis as the time axis, and are displayed with the recording date and time of the original PGC and the user-defined PGC. Further, on the dialogue screen, a plurality of cell information is represented as rectangles arranged in the horizontal direction, and the operator is made to perform an operation of selecting one of the rectangles arranged in the horizontal direction with the cursor keys. .. These original PGCs and cells are the same as those shown in FIG. 76, and thereafter, with FIG. 76 as the initial state, the original PGC information table, the user-defined PGC information table, and the title search pointer will be updated. ..
【0418】
FIG. 81 is a float chart showing the processing contents of the editing hierarchy control unit 26 when defining a user-defined PGC. In this float, the variable j is a variable for indicating each of the plurality of original PGCs arranged vertically on the dialogue screen, and the variable k is a variable of the plurality of cells arranged horizontally on the dialogue screen. It is a variable to indicate each.
【0419】
The variable m is the PGC number to be assigned to the user-defined PGC information to be defined in the RTRW management file, and the variable n is the cell number to be assigned to the cell information to be defined in the RTRW management file. Is. In step S201, the value obtained by adding 1 to the last number of the original PGC information in the RTRW management file is assigned to the variable m and 1 is assigned to the variable n. In step S202, a column for the m-th user-defined PGC information is added to the user-defined PGC information table, and in step S203, a key operation wait is entered. When the key operation is performed, in step S204, among the flags assigned to each key, the flag corresponding to the pressed key is set to "1". In step S205, it is determined whether the flag indicating that the ENTER key is pressed, Enter_Flag is 1, and in step S206, it is determined whether the flag indicating that the end key is pressed, End_Flag is 1. When all of these flags are "0", in step S207, using Right_Flag, Left_Flag, Down_Flag, and Upper_Flag, which are a group of flags indicating that the up key, left key, right key, and down key have been pressed, the following Perform the calculation shown in the formula of, and substitute the calculation result into the variable k and the variable j, respectively.
【0420】
k k + 1 * (Right_Flag) -1 * (Left_Flag) j j + 1 * (Down_Flag) -1 * (Upper_Flag) When the right key is pressed and Right_Flag becomes "1", the variable k is incremented. If the up key is pressed and Upper_Flag becomes "1", the variable j is decremented. When the left key is pressed and Left_Flag becomes "1", the variable k is decremented. If the down key is pressed and Down_Flag becomes "1", the variable j is incremented. After the variables j and k are updated in this way, the cell figure in row j and column k is displayed in focus in step S208, all the flags assigned to the remote controller 71 are cleared to zero in step S209, and then step S203 is performed. It shifts and becomes a state of waiting for key operation again. By repeating the above steps S203 to S209, the cell figures corresponding to the front, rear, left, and right cells are brought into focus in response to the pressing of the key on the remote controller 71.
【0421】
While the above process is repeated, if the ENTER key is pressed while any cell is set to the focus state, the process proceeds to step S251 in FIG. 82. In step S251 of FIG. 82, the operator is presented with the cell information of j rows and k columns as it is, or the inside of the subsection specified by the cell information is used as it is, and the operator is asked to specify either of them. When the cell information is used as it is, the cell figure of j row and k column is copied to m row and n column in step S252, and Original_PGC # j.CELL # k is defined as User_Defined_PGC # m.CELL # n in step S253. After the definition, the variable n is incremented in step S254, and then the process proceeds to step S209 in FIG.
【0422】
When the inside is used more than the partial section specified by the cell information of j row and k column, the process proceeds to step S255 in order to start the partial reproduction by the title reproduction control unit 23 based on the cell information of j row and k column. In step S255, it is determined whether or not the cell information in the j-by-k column has already been regenerated. When the partial section specified by the cell information is played halfway, it is nothing but waste to play the same partial section from the beginning. In this case, the previous judgment is made. This is because it is desirable for the operator to start partial reproduction of the cell information in rows and k columns from the time when the reproduction is interrupted (this time point is called the reproduction interruption time t) (step S266).
【0423】
On the other hand, if the cell information of j row and k column is not regenerated, partial reproduction is started from the beginning of the cell information of j row and k column in step S265, and then the process proceeds to step S256, and a loop consisting of step S256 and step S257. It becomes a state. Step S256 is a step of waiting for the end of reproduction by the cell, and step S257 is a step of waiting for pressing the marking key. When step S257 becomes Yes, the process proceeds to step S259 after acquiring the time information at the time when the button is pressed in step S258.
【0424】
In step S259, it is determined whether or not there are two acquired time information, and if not, the process returns to step S256 without generating cell information, and if so, the two time information acquired in step S260 is used as the starting point. Let it be the end point. One of the time information acquired here is the time when the image displayed on the TV receiver 72 becomes the scene that you like, and the other time information is the time when the scene that you like ends. And. These time information are considered to be partial sections that should be particularly selected as video editing materials inside the original PGC provided by the original PGC information. In order to generate user-defined PGC information for designating these subsections, cell information is generated in the PGC information table work area 24, and the process proceeds to step S261.
【0425】
In step S261, the user-defined PGC information generator 25 acquires the VOB_ID and AV file ID in Original_PGC # j.CELL # k. User_Defined_PGC # m.CELL # n is generated using the start point-end point time information, VOB_ID, and AV file ID acquired in step S262. In step S263, after holding the end point time information as the playback interruption time point t, the variable n is incremented in step S254, and the process proceeds to step S209.
【0426】
By the above processing, new user-defined cell information is generated from the cell information of j row and k column. After that, the next other cell information is set to the focus, and if the user-defined cell information using this as the generation source is generated, the cell information constituting the user-defined PGC information is defined one by one. In the loop state consisting of step S256 and step S257 in FIG. 82, if the reproduction with the j-row and k-column cell information is completed without the mark key being operated, the process proceeds to step S254.
【0427】
If it is determined that the END key has been pressed, step S206 in FIG. 80 (b) becomes Yes and the process proceeds to step S213. In step S213, a menu display indicates whether to define the next UserDefined_PGC. If the operator has an intention to define and is instructed to affirm this, the variable m is incremented in step S214, the variable n is initialized, and the process proceeds to step S209 and step S203.
【0428】
(4-2-7-2) Specific example of user-defined PGC information definition The operation when the user-defined PGC information is defined from the plurality of original PGC information shown in the dialogue screen shown in FIG. 85 will be described below. FIG. 86 is a diagram showing the relationship between the manual operation of the remote controller 71 and the display processing performed in association with the manual operation. The figures from FIG. 87 to FIG. 90 are also drawn for the same purpose, and the operation will be explained with reference to these figures.
【0429】
After cell # 1 existing in the 1st row and 1st column is set to the focus state as shown in FIG. 85, when the ENTER key is pressed by the operator as shown in FIG. 86 (b), step S205 becomes Yes. , Move to the flow chart shown in Fig. 82. In steps S251 to S266 of this float, the first cell information CELL # 1A of UserDefined_PGC # 1 is generated based on Original_PGC # 1.CELL # 1 as shown in FIG. 86 (a). After generation, the variable n is incremented in step S254, the variable n is set to 2, and the process proceeds to step S203 via step S209. Here, if the down key is pressed once as shown in FIG. 87 (b) and the right key is pressed twice as shown in FIGS. 87 (c) and 87 (d), each key is assigned in step S204. Of the flags that have been pressed, the one that corresponds to the pressed key is set to "1".
【0430】
By pressing the down key for the first time, k = 1 (= 1 + 1 * 0-1 * 0) j = 2 (= 1 + 1 * 1-1 * 0) By pressing the right key for the first time k = 2 (= 1 + 1 * 1-1 * 0) j = 2 (= 2 + 1 * 0-1 * 0) By pressing the right key for the second time k = 3 (= 2 + 1 * 1-1 * 0) When j = 2 (2 + 1 * 0-1 * 0), cell # 7 located in the 2nd row and 3rd column is in the focus state as shown in FIG. 87 (a).
【0431】
After the cell existing in the 2nd row and 3rd column is set to the focus state, when the ENTER key is pressed by the operator as shown in Fig. 88 (b), step S205 becomes Yes, and the flower in Fig. 82- To generate the second cell information CELL # 7A of UserDefined_PGC # 1 based on Original_PGC # 2.CELL # 7 located in the 2nd row and 3rd column in the original PGC information table (Fig. 88 (a)). )reference).
【0432】
After generating the second cell information, the above process is repeated. As shown in FIG. 89 (b), when the ENTER key is pressed by the operator, the third cell information CELL # 11A and the fourth cell information CELL # 3A of UserDefined_PGC # 1 are generated. After that, it is assumed that the operator presses the stop key when the process proceeds to step S203. Then, the End_Flag indicating that the stop key has been pressed becomes "1", and the process proceeds to step S213. By pressing the stop key above, the edit hierarchy control unit 26 considers that the definition of the user-defined PGC information # 1 has been completed. In step S213, the operator is asked whether to define the user-defined PGC information # 2 following the user-defined PGC information # 1. If the operator has the intention, the variable m is incremented in step S214 to obtain the variable. After initializing n to 1, the process proceeds to step S209.
【0433】
Such processing is repeated, and as shown in FIG. 91, user-defined PGC information # 2 consisting of CELL # 2B, CELL # 4B, CELL # 10B, and CELL # 5B is defined, and CELL # 3C, CELL # 6C. It is assumed that the user-defined PGC information # 3 consisting of, CELL # 8C and CELL # 9C is defined. FIG. 91 is a diagram showing the contents of the user-defined PGC information table, the original PGC information table, and the title search pointer at the end of the provisional editing.
【0434】
When the end key is pressed in this state, the dialogue screen shown in FIG. 90 is displayed in step S215 shown in FIG. 81, waiting for the user-defined PGC information to be selected by pressing the up key and the down key, and previewing by pressing the play key. Waits for the specification, waits for the main edit to be specified by pressing the main edit key, and waits for the user-defined PGC information table to be recorded. When the operation to record the user-defined PGC is performed, the user-defined PGC information table containing the new user-defined PGC information generated in the PGC information table work area 24 is transferred to the RTRW management file work area 24. Then, in the RTRW management file read out in the RTRW management file work area 24, the part corresponding to the user-defined PGC information table is written. At the same time, the title search pointer for the newly generated user-defined PGC information is transferred to the RTRW management file work area 24 and added to the title search pointer that already exists in the RTRW management file. After writing the user-defined PGC information table and adding the title search pointer, a file system command is issued so that the RTRW management file stored in the RTRW management file work area 24 is written to the RTRW directory.
【0435】
FIG. 83 is a flow chart showing the processing contents at the time of preview and the time of main editing. The operation when previewing the VOB connection work while referring to this float is described below. 92 and 93 are diagrams showing the relationship between the manual operation of the remote controller 71 and the display processing performed in association with the manual operation.
【0436】
In step S220 of the float chart in FIG. 83, the first number in the user-defined PGC information table is assigned to the variable j, and in step S221, the key operation waits. When the key operation is performed, in step S222, among the flags assigned to each key, the flag corresponding to the pressed key is set to "1". In step S223, it is determined whether the flag indicating that the play key has been pressed, Play_Flag is 1, and in step S224, the flag indicating that the edit key has been pressed, whether the edit_Flag is 1. To judge. When all of these flags are "0", in step S225, the calculation shown in the following formula is performed using the flags group Down_Flag and Upper_Flag indicating that the up and down keys have been pressed, and the calculation result is a variable. Substitute each for j.
【0437】
j j + 1 * (Down_Flag) -1 * (Upper_Flag) When the up key is pressed and Upper_Flag becomes "1", the variable j is decremented. If the down key is pressed and Down_Flag becomes "1", the variable j is incremented. After the variable j is updated in this way, the figure corresponding to the PGC information located on the jth line is displayed in focus in step S226, and all the flags assigned to the remote controller 71 are cleared to zero in step S227, and then the step is performed. It shifts to S221 and waits for key operation again. By repeating the above steps S221 to S227, the figures corresponding to the user-defined PGC information before and after are brought into the focus state in response to the pressing of the key on the remote controller 71.
【0438】
While the above process is repeated, if the play key is pressed while any user-defined PGC information is set to the focus state, Play_Flag becomes 1, step S223 becomes Yes, and the process proceeds to step S228. To do. In step S228, the title playback control unit 23 is instructed to play the VOB according to the PGC specified by the operator among the user-defined PGCs. If the PGC specified by the operator is a user-defined PGC, the cells contained in the user-defined PGC are selected from multiple subsections in at least one VOB in any order. Since such reproduction does not satisfy the conditions necessary for seamless reproduction shown in the first embodiment and the second embodiment, the video display and the audio output are interrupted between the cells. However, it can be said that the purpose of previewing the connection of multiple scenes has been achieved.
【0439】
(4-2-7-3) Processing procedure during preview and main editing of layered editing The operation at the time of VOB connection in this editing will be described below. FIG. 94 is a diagram showing the relationship between the manual operation of the remote controller 71 and the display processing performed in association with the manual operation. When the operator presses the up key as shown in FIG. 94 (b), cell # 1A becomes the focus, and the dialogue screen shown in FIG. 94 (a) is displayed on the television receiver 72. When the main edit key is pressed as shown in FIG. 94 (c) in this state, the main edit_Flag becomes 1, step S224 in FIG. 83 becomes Yes, and FIG. 43 shown in the third embodiment. Processes from step S8 to step S16 in the flow chart of.
【0440】
After the processing of the third embodiment is performed, the process proceeds to step S237 of FIG. 84. After setting the variable n to 1 in step S237, search for Original_PGC # j.CELL # k, which was the source of UserDefined_PGC # m.CELL # n in step S238, and check if Original_PGC # j exists in step S239. judge. If it exists, delete Original_PGC # j in step S240 and search for UserDefined_PGC # q that originated Original_PGC # j in step S241. In step S242, it is determined whether or not UserDefined_PGC # q exists at least one, and in step S243, all UserDefined_PGC # q are deleted. In step S244, it is determined whether the variable n is the last number of the cell information, and if not, the process proceeds to step S245, and in step S245, the variable n is updated to the next cell information in the PGC information #m, and the step Move to S238. The loop process consisting of steps S238 to S245 is repeated until the variable n becomes the last number of the cell information in the PGC information #q.
【0441】
It can be seen that the sub-intervals were specified by the user-defined PGC information # 1 for all of VOB # 1, VOB # 2, and VOB # 3, and these were the targets of this editing. The original PGC information, which is the source of the cell information included in the user-defined PGC information # 1, will be deleted because the designated VOB is the target of this editing. The user-defined PGC information that originated from the original PGC information will also be deleted because the designated VOB is the target of this editing.
【0442】
When step S244 becomes Yes and the process proceeds to step S246, the youngest PGC number #e among the free PGC numbers obtained by deleting the original PGC information is acquired. After acquisition, the cell information is updated with the AV file ID and VOB_ID given to the AV file after MERGE in step S247, and then the PGC number of UserDefined_PGC # q is updated to PGC number #e in step S248, and the title is changed. Update the type information in the search pointer to the original type.
【0443】
FIG. 95 is a diagram showing an example of the PGC information table and the title search pointer after the original PGC information-user-defined PGC information is deleted in accordance with this editing. Since VOB # 1, VOB # 2, and VOB # 3, whose subsections were specified by user-defined PGC information # 1, were subject to this editing, the original PGC information # 1 and original PGC that specified these subsections. Information # 2, original PGC information # 3, user-defined PGC information # 2, and user-defined PGC information # 3 have already been deleted, but the former user-defined PGC information # 1 is defined as the original PGC information # 1. You can see that.
【0444】
When the PGC information is updated in the PGC information table work area 24 as described above, the updated original PGC information is transferred to the RTRW management file work area 24 and read into the RTRW management file work area 24. Overwrite the RTRW management file. At the same time, the title search pointer for the newly generated original PGC information is transferred to the RTRW management file work area 24 to overwrite the title search pointer already existing in the RTRW management file.
【0445】
User-defined PGC information table-After overwriting the title search pointer, issue a file system command to write the RTRW management file stored in the RTRW management file work area 24 to the RTRW directory. As described above, according to the present embodiment, the appropriate editing material among the partial sections in the AV data is specified by using the user-defined cell information, and the reproduction order is tentatively determined by freely arranging them. can do.
【0446】
If you want to decide the playback order of the edited product, you do not have to make a prototype of VOB once, so you can easily edit the video in a short period of time. Since it is not necessary to temporarily record the prototype on the recording medium, the capacity of the recording medium does not have to be so large. Since the scene connection can be tentatively determined only by defining the user-defined PGC information, many variations of the playback order can be created in a short period of time. Since the user-defined cell information specifies a partial section in the VOB using the time information, the VOB can maintain the state at the time of recording.
【0447】
By creating a plurality of user-defined PGC information having different playback orders and previewing them, it is possible to narrow down from a plurality of candidates. As a result of narrowing down, the one that has been reproduced to the satisfaction is selected as the target of this editing, and the VOB is processed according to the user-defined PGC information narrowed down from multiple candidates, so the VOB already recorded on the optical disk can be selected. Bold video editing, such as direct rewriting, is performed, and even if the original VOB disappears from the optical disc, this will not be regretted.
【0448】
After the main editing is performed, the title type of the user-defined PGC information targeted for the main editing is set to the original PGC information in the title search pointer, so that new video editing can be started based on this. .. With just one optical disc and one video data editing device, it is possible to realize advanced video editing by narrowing down better ones from multiple candidates, so until then, thinking of video editing like a flower of Takamine. Video enthusiasts in ordinary households will be able to actually challenge video editing, which will stimulate many people's creativity.
【0449】
As for the ratio of VOB and original PGC information, it is desirable to provide one original PGC information for each VOB. Further, time information may be extracted from the cell information mark, information such as an address may be extracted from the time map table, and the information may be displayed on the initial state screen or the like by managing the information in the table and used as selection assistance information for the user.
【0450】
Further, a reduced image of each mark may be created, these may be recorded in a separate file, each mark may have pointer information for these reduced images, and may be used as auxiliary information when displaying cell information in the initial state or the like. .. Finally, the procedure of the title reproduction control unit 23 (FIG. 78) and the procedure of the editing layered control unit 26 (FIGS. 81 to 84) described with reference to the flowchart in the fourth embodiment are realized by the machine language program. , This may be recorded on a recording medium and made a target for distribution / sale. Such recording media include IC cards, optical discs, floppy disks, and the like, and the machine language programs recorded on these media can be used by being installed in a general-purpose computer. This general-purpose computer sequentially executes the installed machine language program to realize the function of the video data editing device shown in the present embodiment.
【0451】
[Effect of the invention]
As described above, according to the present invention, it is possible to specify that the chain information of the original type on the optical disk reproduces the subsections in the order faithful to the arrangement order of the video objects, and the chain information of the user-defined type is , It is possible to specify a playback order tentatively determined in the video editing work for a plurality of partial sections included in the video object.
【0452】
The original type chain information is the final playback order to be determined when the video data editing device processes the video object in the data area according to the user-defined type chain information or overwrites the video object in the data area. Can also be specified. Since the chain information is used for these purposes in the video editing work, the operator can tentatively determine the playback order according to the image imagined in the mind by defining the user-defined type chain information, and the user-defined type chain. By playback based on information, it is possible to confirm what kind of playback video is displayed in the tentatively determined order.
【0453】
By defining the user-defined type chain information, the work of tentatively determining the playback order can be easily performed in a short period of time. Moreover, since the data size of the user-defined type chain information is small, the video object recorded in the data area is not inadvertently overwritten. Even if the video objects recorded in the data area are valuable images recording commemorative events such as entrance ceremonies, athletic meet, family trips, graduation ceremonies, etc. of children, these images will not be overwritten and will not be overwritten. It is possible to tentatively determine the playback order for the recording medium on which the above-mentioned video is recorded.
【0454】
If you define multiple user-defined type chain information and select the one that has been reproduced to your satisfaction as the processing target for this editing, you can directly rewrite the video object already recorded on the optical disc. Even if the original video object disappears from the optical disc due to bold video editing, this will not be regretted.
【0455】
Here, one or more of the user-defined type chain information is designated as the main editing target, and for the file recorded in the data area, any user-defined type chain information is designated as the main editing target. At this time, the boundary part of all the subsections specified in the user-defined type chain information is processed so as to be the start position-end position of the video object.
【0456】
In addition, when any user-defined type chain is specified as the main editing target, the original type chain information and other user-defined type chain information recorded in the index area are deleted and designated as the main editing target. User-defined typechain information is converted to original typechain information. Both the original type chain information and the user-defined type chain information are cell information strings composed of a plurality of cell information, and the index area is further set to the identification information of each cell information column and the first value. Indicates that the cell information string indicated by the identification information is the original type chain information, and the cell information string indicated by the identification information by being set to the second value is the user-defined type chain information. A search pointer area in which a flag group consisting of flags indicating the fact is recorded is provided, and the flag set to the second value in the flag group is the user-defined type chain information corresponding to the flag to be edited. When specified, the second value is updated to the first value.
【0457】
When the playback instruction of the cell information is received, the set of the playback start time information, the playback end time information, and the mapping information are read from the index area, and the mapping information is searched using the playback start time information and the playback end time information. By doing so, the access position identification that specifies the recording position of the advanced video object unit including the picture data indicated by the playback start time information and the recording position of the terminal video object unit including the picture data indicated by the playback end time information. A means and a reading means for reading the video object unit sequence recorded between the specified recording positions are provided to decode the read video object unit sequence, and the boundary portion of the partial section corresponding to the cell information is formed. If the start position-end position of the video object unit does not match, output from the first video field to the last field indicated by the cell information in the decoding result, and prohibit the output of other decoding results. According to the video data editing apparatus provided with the decoding means, the cell information specifies the partial section to be used as the editing target with the time accuracy of the video field, so that the partial section to be used as the editing target is specified with high time accuracy. be able to.
[Simple explanation of drawings]
[Figure 1]
It is a figure which shows the appearance of the DVD-RAM disk which is a recordable optical disk in embodiment of this invention.
[Figure 2]
(a) It is a figure which showed the recording area. (b) It is a figure which shows the cross section and the surface of the DVD-RAM cut out at the sector level.
[Fig. 3]
(a) It is a figure which shows the zone area 0 to 23 and others in a DVD-RAM. (b) It is explanatory drawing which arranged the zone area 0 to 23 and others in the horizontal direction. (c) It is a figure which shows the logical sector number (LSN) in a volume space. (d) It is a figure which shows the logical block number (LBN) in a volume space.
[Fig. 4]
(a) It is a figure which shows what kind of data is recorded in a volume area. (b) It is a figure which shows the hierarchical structure of the data definition defined by the MPEG standard.
[Fig. 5]
(a) It is a figure which shows a plurality of picture data arranged in a display order, and a plurality of picture data arranged in a coding order. (b) It is a figure which shows the correspondence between an audio frame and audio data.
[Fig. 6]
(a) It is the figure which refined the data structure of VOB step by step in the logical format. (b) FIG. 6 (b) is a diagram showing an example of how the VOB is partially deleted. (c) It is a figure which shows the logical format of the video pack arranged at the head of VOBU. (d) It is a figure which shows the logical format of the video pack arranged other than the beginning in VOBU. (e) It is a figure which shows the logical format of an audio pack. (f) It is a figure which shows the logical format of a pack header. (g) It is a figure which shows the logical format of a system header. (h) It is a figure which shows the logical format of a packet header.
[Fig. 7]
(a) It is a figure which shows the video frame and the buffer occupancy in the video buffer. (b) It is a figure which shows the audio frame and the ideal buffer state in an audio buffer. (c) It is a figure which shows the audio frame and the realistic buffer state in an audio buffer. (d) It is explanatory drawing for demonstrating the transfer time of each picture data in more detail.
[Fig. 8]
(a) A diagram showing how to store an audio pack containing audio data to be played in each audio frame and a video pack containing picture data to be played in each video frame. Is. (b) It is a figure explaining the notation in FIG. 8 (a).
[Fig. 9]
It is a figure which shows how to store the audio pack which stored the audio data which should be reproduced in a plurality of audio frames, and the video pack which stored the picture data which should be reproduced in each video frame.
[Fig. 10]
(a) It is a figure which shows the buffer state at the tip of a video stream. (b) It is a figure which shows the buffer state at the end of a video stream. (c) It is a figure which shows the buffer state between VOBs, the video stream which has the buffer state shown in FIG. 10 (b) at the end, and the video stream which has the buffer state shown in FIG. 10 (a) at the tip. Indicates the buffer state when connecting to and seamlessly.
[Fig. 11]
(a) It is a graph drawn by plotting the SCR of the video pack included in the VOB in the order of the arrangement of the video pack. (b) It is a figure which shows an example which the initial value of the SCR of a section B and the final value of the SCR of a section A match. (c) It is a figure which shows an example which the initial value of SCR of section C is higher than the final value of the straight line which shows the SCR of section D. (d) It is a figure which shows an example which the end value of the SCR of an interval E is higher than the initial value of the straight line which shows the SCR of an interval F. (e) The graph showing the continuity of the time stamps shown in FIG. 11 (a) is a diagram describing two VOBs.
[Fig. 12]
(a) It is the figure which the contents of the RTRW management file are detailed step by step. (b) It is a figure which shows the PTM description format. (c) It is a figure which shows the data structure of the audio gap position information.
[Fig. 13]
It is a graph showing the buffer occupancy for each front VOB-rear VOB.
[Fig. 14]
(a) It is a figure which shows an example of a video frame and an audio frame. (b) It is a figure which shows the state which the time difference g1 appeared at the end part of a picture data and an audio data because the play time of a picture data and the play time of an audio data were made to be aligned at the tip part of a VOB. (c) An audio pack G3 including an audio gap including the audio data y-2, y-1, y located at the end of VOB # 1 shown in Fig. 14 (b) and the padding-Packet is shown. It is a figure which shows the audio pack G4 which contains the audio data u, u + 1, u + 2 located at the tip of VOB # 2. (d) It is explanatory drawing which shows that the audio pack G3 including an audio gap is arranged in any one of VOBU # 1, VOBU # 2, and VOBU # 3 located at the tip of VOB # 2.
[Fig. 15]
(a) ~ (d) Explanatory drawing showing the procedure for recreating an audio gap when the VOBU located at the tip of VOB # 2 is deleted from VOB # 1-VOB # 2 that should be played seamlessly. Is.
[Fig. 16]
It is a figure which shows the configuration example of the system which used the video data editing apparatus in this embodiment.
[Fig. 17]
It is a block diagram which shows the hardware structure of a DVD recorder 70.
[Fig. 18]
It is a block diagram which shows the structure of the MPEG encoder 2.
[Fig. 19]
It is a block diagram which shows the structure of the MPEG decoder 4.
[Fig. 20]
It is a timing chart which shows the switching timing of switch SW1 to switch SW4.
[Fig. 21]
It is a flowchart which shows the processing procedure of the processing module for performing seamless processing.
[Fig. 22]
It is a flowchart which shows the processing procedure of the processing module for performing seamless processing.
[Fig. 23]
(a) (b) It is explanatory drawing which shows the state of analyzing the buffer state based on each audio pack. (c) It is a figure which shows the reading range which should be read from the front VOB in step S106. (d) It is a figure which shows the reading range which should be read from the rear VOB in step S107.
[Fig. 24]
(a) It is a figure which shows which audio frame of an audio stream corresponds to the audio frame x, x + 1, y, u, u + 1, u + 2 used in FIG. 22. (b) It is a figure which shows the case where FIRST_SCR + STC_offset coincides with the audio frame boundary of the front VOB. .. (c) It is a figure which shows the case where the video playback start time VOB_V_S_PTM + STC_offset coincides with the audio frame boundary of the front VOB. (d) It is a figure which shows the case where the playback end time of an audio frame y and the audio frame boundary of a rear VOB match.
[Fig. 25]
It is a figure which shows how the audio pack containing a plurality of audio data to be reproduced in a plurality of audio frames, and the video pack containing the picture data to be reproduced in each video frame are multiplexed. ..
[Fig. 26]
It is a figure which shows an example of the subsection of a VOB specified by using a set of time information of C_V_S_PTM and C_V_E_PTM.
[Fig. 27]
(a) It is a figure which shows the reading range which should be read from the front cell in step S106. (b) It is a figure which shows the reading range which should be read from the rear cell in step S107.
[Fig. 28]
(a) This is an example of concatenating cell information whose editing boundaries are defined in the middle of VOBU. (b) In order to justify the display order and the coding order, it is a figure which shows the process according to three rules at the time of reconstruction of a GOP structure.
[Fig. 29]
(a) It is a figure which shows the processing procedure at the time of changing the picture type of the front cell. (b) It is explanatory drawing which shows the procedure which predicts the increase amount β of the buffer occupancy amount with changing the picture type of the front cell.
[Fig. 30]
(a) It is a figure which shows the processing procedure at the time of changing the picture type of a rear cell. (b) It is explanatory drawing which shows the procedure which predicts the increase amount α of the buffer occupancy amount with changing the picture type of a rear cell.
[Fig. 31]
It is a flowchart which shows the processing procedure of the processing module for performing seamless processing.
[Fig. 32]
It is a flowchart which shows the processing procedure of the processing module for performing seamless processing.
[Fig. 33]
It is a flowchart which shows the processing procedure of the processing module for performing seamless processing.
[Fig. 34]
It is a figure which shows which audio frame of an audio stream corresponds to the audio frame x, x + 1, y used in the float of FIG. 31.
[Fig. 35]
It is a figure which shows the hierarchical directory structure.
[Fig. 36]
It is a figure for demonstrating the information other than the sector management table and AV block management table in FIG. 6 among the management information for a file system.
[Fig. 37]
It is the figure which showed the link relation shown by the arrow line of FIG. 6 along the directory structure.
[Fig. 38]
(a) It is a figure which shows the more detailed data structure of a file entry. (b) It is a figure which shows the data structure of the allocation descriptor. (c) It is a figure which shows the recording situation by the upper 2 bits of the data which shows the extent length.
[Fig. 39]
(a) It is a figure which shows the detailed data structure of the file identification descriptor for a directory. (b) It is a figure which shows the detailed data structure of the file identification descriptor for a file.
[Fig. 40]
It is a figure which modeled how the AV data read from a DVD-RAM is buffered in a track buffer.
[Fig. 41]
It is a functional block diagram which showed the structure of a DVD recorder 70 by function.
[Fig. 42]
It is a figure which shows an example of the dialogue screen displayed on the television receiver 72 under the control of a recording / editing / reproduction control unit 12.
[Fig. 43]
This is a float that shows the processing procedure of temporary editing and main editing by the recording / editing / playback control unit 12.
[Fig. 44]
(a)-(f) It is explanatory drawing for supplementary explanation for the processing of the AV data editing part 15 in the flow chart of FIG. 43.
[Fig. 45]
(a)-(e) It is explanatory drawing for supplementary explanation for the processing of the AV data editing part 15 in the flow chart of FIG. 43.
[Fig. 46]
(a)-(f) It is explanatory drawing for supplementary explanation for the processing of the AV data editing part 15 in the flow chart of FIG. 43.
[Fig. 47]
(a) It is a figure which shows the temporal relationship of the extent and the data in memory. (b) It is a figure which shows the positional relationship between the extent, the In area, and the Out area.
[ Fig. 48]
(a) This is a float that shows the processing contents of the AV file system unit 11 when the "SPLIT" command is executed. (b) It is a flowchart which shows the processing content at the time of issuing a SHORTEN command.
[Fig. 49]
It is a flowchart which shows the processing content at the time of issuing a MERGE command.
[Fig. 50]
It is a flowchart when the preceding extent is less than the AV block length, and the succeeding extent is equal to or more than the AV block length.
[Fig. 51]
(a) to (b) are explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. 50.
[Fig. 52]
(a)-(c) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 50.
[Fig. 53]
(a)-(d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 50.
[Fig. 54]
(a)-(d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 50.
[Fig. 55]
It is a flowchart when the subsequent extent is less than the AV block length and the preceding extent is more than the AV block length.
[Fig. 56]
(a) to (b) are explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. 55.
[Fig. 57]
(a) to (c) are explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. 55.
[Fig. 58]
(a)-(d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 55.
[Fig. 59]
(a)-(d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 55.
[Fig. 60]
It is a flowchart which shows the processing content when both the preceding extent and the succeeding extent are less than the AV block length.
[Fig. 61]
(a) to (d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 60.
[Fig. 62]
(a) to (c) are explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. 60.
[Fig. 63]
(a) to (c) are explanatory diagrams for supplementary explanation of the processing of the AV file system unit 11 in the float chart of FIG. 60.
[Fig. 64]
(a) to (d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 60.
[Fig. 65]
This is a float when the preceding extent and the succeeding extent have a length greater than or equal to the AV block length.
[Fig. 66]
(a)-(d) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 65.
[Fig. 67]
This is a float when the preceding extent and the succeeding extent have a length equal to or longer than the AV block length, and the data sizes of the In area and Out area are insufficient.
[Fig. 68]
(a) to (e) It is explanatory drawing for supplementary explanation for the processing of the AV file system part 11 in the flow chart of FIG. 67.
[Fig. 69]
(a)-(d) It is explanatory drawing for supplementary explanation of the processing content by the fragmentation elimination part 16.
[Fig. 70]
(a) It is a figure which the contents of the RTRW management file in 4th Embodiment are detailed step by step. (b) It is a figure which shows the logical format of the original PGC information in 4th Embodiment. (c) It is a figure which shows the logical format of the user-defined PGC information in 4th Embodiment. (d) It is a figure which shows the logical format of a title search pointer.
[Fig. 71]
It shows the interrelationships between AV files, extents, VOBs, VOB information, original PGC information, and user-defined PGC information, and the ones that are integrated are arranged in a thick line frame.
[Fig. 72]
User-Defined PGC-A diagram showing an example of an original PGC.
FIG. 73.
It is the figure which attached the hatching to the part corresponding to the cell which became the deletion range.
[Fig. 74]
(a) Indicates which ECC block on the DVD-RAM will be released to the free space by this editing using the user-defined PGC information # 2. (b) An example of VOB, VOB information, and PGC information after this editing is shown.
[Fig. 75]
It is a functional block diagram which showed the structure of a DVD recorder 70 by function.
[Fig. 76]
This is an example of the original PGC information generated by the original PGC information generator 25 at the time of recording the AV file.
[Fig. 77]
(a) It is a figure which shows an example of the graphic data displayed on a television receiver 72 under the control of a recording / editing / reproduction control unit 12. (b) It is a figure which shows the PGC information and cell information listed as an operation target.
[Fig. 78]
(a) This is a float that shows the processing contents when the title part is played back. (b) In the range from VOBU (START) to VOBU (END), it shows that only the section from the cell playback start time information (C_V_S_PTM) to the cell playback end time information (C_V_E_PTM) is played back and output. It is a figure.
[Fig. 79]
(a) (b) It is a figure which shows the state which the mark key is pressed while watching the image displayed on the television receiver 72.
FIG. 80
(a) (b) It is a figure which shows how the data input / output is performed between the components shown in FIG. 75 when a marking operation is performed.
[Fig. 81]
This is a float that shows the processing contents of the edit layering control unit 26 when defining user-defined PGC information.
[Fig. 82]
This is a float that shows the processing contents of the edit layering control unit 26 when defining user-defined PGC information.
[Fig. 83]
This is a float that shows the processing contents of the recording / editing / playback control unit 12 at the time of preview and main editing.
[Fig. 84]
This is a float that shows the update processing of PGC information that should be performed after this editing.
[Fig. 85]
This is an example of an interactive screen displayed on the television receiver 72 to accept an operation of selecting cell information which is a component of user-defined PGC information in temporary editing.
[Fig. 86]
(a) (b) It is a figure which shows the relationship between the manual operation with respect to the remote control 71, and the display processing performed by the manual operation.
[Fig. 87]
(a)-(d) It is a figure which shows the relationship between the manual operation with respect to the remote control 71, and the display processing performed by the manual operation.
[Fig. 88]
(a) (b) It is a figure which shows the relationship between the manual operation with respect to the remote control 71, and the display processing performed by the manual operation.
[Fig. 89]
(a) (b) It is a figure which shows the relationship between the manual operation with respect to the remote control 71, and the display processing performed by the manual operation.
[Fig. 90]
This is an example of the dialogue screen when waiting for the selection of user-defined PGC information, waiting for the preview to be specified by pressing the play key, and waiting for the main edit to be specified by pressing the main edit key.
[Fig. 91]
User-defined PGC information # 2 consisting of CELL # 2B, CELL # 4B, CELL # 10B, CELL # 5B is defined, and user-defined PGC information # 3 consisting of CELL # 3C, CELL # 6C, CELL # 8C, CELL # 9C. It is a figure which shows an example of the original PGC information table and the user-defined PGC information table at the time when is defined.
[Fig. 92]
(a)-(b) It is a figure which shows the relationship between the manual operation with respect to the remote controller 71, and the display processing performed by the manual operation.
[Fig. 93]
(a)-(c) It is a figure which shows the relationship between the manual operation with respect to the remote controller 71, and the display processing performed by the manual operation.
[Fig. 94]
(a)-(c) It is a figure which shows the relationship between the operation of the remote controller 71 and the display processing performed by the operation.
[Fig. 95]
It is a figure which shows the original PGC information table and the user-defined PGC information table after the VOB processing in this editing is completed.
[Fig. 96]
(a) It is a figure which shows the working environment of video editing using the video deck which can reproduce and record an existing video signal. (b) It is a figure which shows the relationship between an edit material and an edit product.
[Explanation of symbols]
1 Control unit 2 MPEG encoder 3 Disk access section 3a track buffer 3b ECC processing unit 3c drive mechanism 4 MPEG encoder 4a demultiplexer 4b video buffer 4c video decoder 4d audio buffer 4e audio decoder 4f reorder buffer 4g STC 4h adder 4k decoder control unit 5 Video signal processing unit 10 Common file system section 11 AV file system section 12 Recording / editing / playback control unit 13 AV data recording section 14 AV data playback unit 15 AV data editorial department 16 Fragmentation Defragmentation Department 22 Title recording control unit 23 Title playback control unit 24 RTRW management file work area 25 User-defined PGC information generator 26 Editing Hierarchy Control Unit
Contents2
97 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO2004075547A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| CN100452858C | Cited by | China | Search report |
| US8068723B2 | Cited by | United States of America | Applicant |
| US8200070B2 | Cited by | United States of America | Applicant |
| US8340507B2 | Cited by | United States of America | Applicant |
47 members in 11 offices
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 9251994 | Japan | – | |
| 25199497 | Japan | A |
Members47
| Document | Office | Kind | |
|---|---|---|---|
| CA2247626A1 | Canada | A1 | |
| EP0903744A2 | European Patent Office (EPO) | A2 | |
| WO9914935A2 | World Intellectual Property Organization (WIPO) | A2 | |
| EP0903744A3 | European Patent Office (EPO) | A3 | |
| WO9914935A3 | World Intellectual Property Organization (WIPO) | A3 | |
| JPH11187354A | Japan | A | |
| CN1243596A | China | A | |
| JP2000152180A | Japan | A | |
| JP2000152181A | Japan | A | |
| JP2000152182AThis record | Japan | A | |
| JP2000152183A | Japan | A | |
| JP3050311B2 | Japan | B2 | |
| JP3050317B2 | Japan | B2 | |
| JP3050318B2 | Japan | B2 | |
| JP3050319B2 | Japan | B2 | |
| EP1020862A2 | European Patent Office (EPO) | A2 | |
| KR20000069008A | Republic of Korea | A | |
| EP0903744B1 | European Patent Office (EPO) | B1 | |
| US6181870B1 | United States of America | B1 | |
| DE69800480D1 | Germany | D1 | |
| ID27672A | Indonesia | A | |
| TW432372B | Taiwan Province of China | B | |
| DE69800480T2 | Germany | T2 | |
| US2001043799A1 | United States of America | A1 | |
| JP2002093125A | Japan | A | |
| US6487364B2 | United States of America | B2 | |
| US6493505B1 | United States of America | B1 | |
| US6560404B1 | United States of America | B1 | |
| JP3410695B2 | Japan | B2 | |
| US2003175012A1 | United States of America | A1 | |
| MY116283A | Malaysia | A | |
| CN1137487C | China | C | |
| EP1020862A3 | European Patent Office (EPO) | A3 | |
| CN1525452A | China | A | |
| US6795641B2 | United States of America | B2 | |
| CN1555194A | China | A | |
| US2004264947A1 | United States of America | A1 | |
| CN1280798C | China | C | |
| EP1020862B1 | European Patent Office (EPO) | B1 | |
| KR100554432B1 | Republic of Korea | B1 | |
| DE69836342D1 | Germany | D1 | |
| CN1309252C | China | C | |
| US7215876B2 | United States of America | B2 | |
| US2007172208A1 | United States of America | A1 | |
| DE69836342T2 | Germany | T2 | |
| CA2247626C | Canada | C | |
| US8238715B2 | United States of America | B2 |
10 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of completion of termEXPY | EXPY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY |
Numbers
- Publication
- 2000-152182
- Application
- 11310451
Titles2
- Japanese
- 光ディスク再生装置及びその方法
- English
- [Title of Invention] Optical Disc Playback Device and Method Therefor
Classification
- CPC, 20
- G11B7/0037
- H04N9/8042
- G11B20/10527
- G11B27/034
- G11B27/036
- G11B27/105
- G11B27/3027
- G11B27/329
- G11B27/34
- G11B2020/1062
- G11B2220/216
- G11B2220/2516
- G11B2220/2562
- G11B2220/2575
- G11B2220/455
- H04N5/775
- H04N5/781
- H04N5/85
- H04N9/8063
- G11B2220/20
- IPC, 19
- H04N5 91
- G11B7 0037
- G11B7 007
- G11B20 10
- G11B20 12
- G11B27 00
- G11B27 02
- G11B27 034
- G11B27 036
- G11B27 10
- G11B27 30
- G11B27 32
- G11B27 34
- H04N5 775
- H04N5 781
- H04N5 85
- H04N5 92
- H04N9 804
- H04N9 806