Contents recording/playback apparatus and contents edit method
Claim Score by NHIP
Abstract
A contents recording/playback apparatus records and plays back contents data. The contents recording/playback apparatus includes a control button configured to issue an insert instruction of contents data to be inserted into contents data whose recording or playback is in progress, and a data editing unit configured to insert contents data, which is prepared in advance in the apparatus as the contents data to be inserted, in a current recording or playback position of the contents data whose recording or playback is in progress, when the control button is operated while the recording or playback of the contents data is in progress.

Term
Term ended
Projected expiry passed 12 March 2023, 3.5 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
17 claims: 3 independent, 14 dependent
- 1A contents recording/playback apparatus capable of recording and playback of contents data, the apparatus comprising:a control button configured to issue an insert instruction of contents data to be inserted into contents data whose recording or playback is in progress;and a data editing unit configured to insert contents data, which is prepared in advance in the apparatus as the contents data to be inserted, in a current recording or playback position of the contents data whose recording or playback is in progress, when the control button is operated while the recording or playback of the contents data is in progress.
- 10A contents recording/playback apparatus capable of recording and playback of contents data, the apparatus comprising:a recording/playback unit configured to execute recording or playback of audio contents data;an imaging device configured to execute a photographing operation;a control button used to instruct the imaging device to execute the photographing operation;a data editing unit which edits the audio contents data, the data editing unit including a unit configured to record image contents data of a still or moving image obtained upon execution of the photographing operation in correspondence with time information which indicates an elapsed time from the beginning of recording or playback of the audio contents data, when execution of photographing operation is instructed upon operation of the control button during recording or playback of the audio contents data;a playback unit configured to play back the edited audio contents data;and a controlling unit configured to control playback of the recorded image contents data on the basis of the elapsed time from the beginning of playback of the edited audio contents data and the time information so as to play back the recorded image contents data at a timing designated by the time information during playback of the edited audio contents data.
- 13Broadest claimClaim Score 70, broad(NHIP)A contents edit method used in a contents recording/playback apparatus capable of recording and playback of contents data, the method comprising:executing recording or playback of contents data;and inserting contents data, which is prepared in advance in the apparatus, in a current recording or playback position of the contents data whose recording or playback is in progress, when a specified control button provided to the apparatus is operated during recording or playback of the contents data.
Independent claims3
100 paragraphs in 5 sections, as filed
CROSS-REFERENCE TO RELATED APPLICATIONS
P-0001[0001] This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2002-076940, filed Mar. 19, 2002, the entire contents of which are incorporated herein by reference.
BACKGROUND OF THE INVENTION
P-0002[0002] 1. Field of the Invention
P-0003[0003] The present invention relates to a contents recording/playback apparatus which can record and play back contents data such as image data, audio data, and the like, and a contents edit method used in that contents recording/playback apparatus.
P-0004[0004] 2. Description of the Related Art
P-0005[0005] In recent years, various systems for recording/playing back contents data such as image data, audio data, and the like have been developed. For example, Jpn. Pat. Appln. KOKAI Publication No. 2000-236496 discloses an apparatus having a function of managing title names of contents such as recorded video programs. This apparatus generates and manages the title names of contents, using additional information such as an EPG (Electronic Program Guide) and the like.
P-0006[0006] Jpn. Pat. Appln. KOKAI Publication No. 2002-44594 discloses a contents edit apparatus, which is used to edit a plurality of types of contents, such as a moving image, still image, and the like on an edit window using a computer. This contents edit apparatus simultaneously displays a plurality of types of contents such as a moving image, still image, text, and the like on the edit window of the computer. The user designates edit positions of respective contents on the edit window, and can edit these contents.
P-0007[0007] However, portable contents recording/playback apparatuses such as PDAs (Personal Digital Assistants), video cameras, and the like do not have any large-scale display screens which can simultaneously display a plurality of contents, and it is difficult to designate edit positions of respective contents on the edit window. Hence, a mechanism that allows the user to easily edit recorded contents is demanded for such portable contents recording/playback apparatuses.
P-0008[0008] It is preferable if one can manage contents such as recorded moving image data/audio data, and the like by appending some comments to them. However, a portable contents recording/playback apparatus does not normally have an input device such as a keyboard or the like, and even when such apparatus has some input device, it is not easy for the user to make input operation using such an input device. For this reason, the portable contents recording/playback apparatus is required to have an edit function that can easily manage recorded contents without any user's input operations required to create comment messages and the like.
BRIEF SUMMARY OF THE INVENTION
P-0009[0009] Embodiments of the present invention provide a contents recording/playback apparatus and a contents edit method, which can efficiently edit contents data without display of any edit window or user operation to create comment messages and the like.
P-0010[0010] According to an embodiment of the invention, there is provided a contents recording/playback apparatus capable of recording and playback of contents data, the apparatus comprising: a control button configured to issue an insert instruction of contents data to be inserted into contents data whose recording or playback is in progress; and a data editing unit configured to insert contents data, which is prepared in advance in the apparatus as the contents data to be inserted, in a current recording or playback position of the contents data whose recording or playback is in progress, when the control button is operated while the recording or playback of the contents data is in progress.
P-0011[0011] Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The features and advantages of the invention may be realized and obtained by means of the instrumentalities and combinations particularly pointed out hereinafter. dr
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING
P-0012[0012] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention, and together with the general description given above and the detailed description of the embodiments given below, serve to explain the principles of the invention.
P-0013[0013]FIG. 1 is a perspective view showing the outer appearance of a portable contents recording/playback apparatus according to an embodiment of the present invention;
P-0014[0014]FIG. 2 is a block diagram showing the system arrangement of the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0015[0015]FIG. 3 is a view for explaining a title insert function in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0016[0016]FIG. 4 is a flow chart showing the sequence of the title insert process in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0017[0017]FIG. 5 shows the title insert process when title images are physically inserted in moving image contents in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0018[0018]FIG. 6 shows the title insert process when title images are logically inserted in moving image contents in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0019[0019]FIG. 7 is a flow chart showing the processing sequence executed upon playing back moving image contents inserted with title images in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0020[0020]FIG. 8 is a view for explaining a simultaneous recording & playback function in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0021[0021]FIG. 9 shows an example of link information which is used to link audio and image data used in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0022[0022]FIG. 10 is a flow chart showing the sequence of audio recording and photographing processes in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0023[0023]FIG. 11 is a flow chart showing the sequence of the audio playback process in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0024[0024]FIG. 12 is a view for explaining a table of contents (TOC) create function in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0025[0025]FIG. 13 shows an example of link information which is used to link contents data and menu used in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1;
P-0026[0026]FIG. 14 is a flow chart showing the sequence of the table of contents playback process in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1; and
P-0027[0027]FIG. 15 is a flow chart showing the sequence for playing back contents using a table of contents in the portable contents recording/playback apparatus of the embodiment shown in FIG. 1.
DETAILED DESCRIPTION OF THE INVENTION
P-0028[0028] Embodiments of the present invention will be described below.
P-0029[0029]FIG. 1 shows the outer appearance of a portable contents recording/playback apparatus according to an embodiment of the present invention. This portable contents recording/playback apparatus <b>11</b> is realized by a portable electronic device such as a PDA, portable mobile phone, movie/voice recorder, or the like, and can operate by a built-in battery. FIG. 1 exemplifies a portable contents recording/playback apparatus realized as a PDA with a camera, and its arrangement will be described below.
P-0030[0030] As shown in FIG. 1, a display <b>12</b>, control buttons <b>13</b>, and loudspeaker <b>19</b> are arranged on the front surface of the main body of the portable contents recording/playback apparatus <b>11</b>. A camera unit <b>14</b> is arranged on the top surface of the main body to be pivotable to face forwards or backwards.
P-0031[0031] The camera unit <b>14</b> is a imaging device, and can take still and moving images. Image contents data of the taken still or moving image is displayed on the display <b>12</b>, and is recorded on a storage medium in the portable contents recording/playback apparatus <b>11</b>. The image contents data recorded on the storage medium is played back as needed, and is displayed on the display <b>12</b>.
P-0032[0032] A microphone <b>15</b> is also provided to the top surface of the main body of the portable contents recording/playback apparatus <b>11</b>. Audio/voice data input via the microphone <b>15</b> is recorded on the storage medium in the portable contents recording/playback apparatus <b>11</b>.
P-0033[0033] An audio input terminal <b>16</b>, video input terminal <b>17</b>, and card slot <b>18</b> are provided to the side surface of the main body of the portable contents recording/playback apparatus <b>11</b>. Using the audio input terminal <b>16</b> and video input terminal <b>17</b>, audio and image contents data can be input from an external AV apparatus or the like, and can be recorded on the storage medium in the portable contents recording/playback apparatus <b>11</b>.
P-0034[0034] The card slot <b>18</b> can detachably receive an external storage medium <b>21</b> such as a memory card or the like.
P-0035[0035] The portable contents recording/playback apparatus <b>11</b> has a function of recording and playing back audio and image contents data, and also a function of editing such audio and image contents data.
P-0036[0036] This edit function is used to manage contents data stored in the portable contents recording/playback apparatus <b>11</b>. This edit function can implement a process for combining given contents data with other contents data as index information, a process for generating index information using data extracted from given contents data, and the like. More specifically, the edit function includes the following functions
P-0037[0037] (1) a title insert function of inserting a title as audio or image data in an arbitrary position of audio or image contents data, whose recording or playback is in progress;
P-0038[0038] (2) a simultaneous recording & playback function of recording image contents data such as a still image, moving image, or the like during recording or playback of audio contents data, and playing back the image contents data recorded, along the progress of playback of the audio contents data; and
P-0039[0039] (3) a table of contents (TOC) create function of automatically creating a table of contents menu by extracting titles (telops) from moving image contents data which is being recorded or has already been recorded.
P-0040[0040] The title insert function (1) inserts other audio or image contents data into given audio or image contents data during recording or playback of that contents data.
P-0041[0041] Note that “insert” does not mean a process for superimposing a comment message (sub-picture) on a frame. of given image contents, but means a process for inserting other image between frames of image contents or inserting other music contents between frames of music contents.
P-0042[0042] For example, the title insert function is used to insert a title image into moving image contents data as a kind of index information during recording or playback of the moving image contents data. As a title image, a moving or still image prepared in advance by the user in the external storage medium <b>21</b> is used.
P-0043[0043] The control buttons <b>13</b> include an insert button <b>131</b> and photograph button <b>132</b> in addition to, e.g., a power button, record/play button, and the like.
P-0044[0044] The insert button <b>131</b> is used to instruct insertion of other contents data into contents data whose recording or playback is in progress. For example, when the user has pressed the insert button <b>131</b> during, e.g., the imaging and recording processes of moving image contents data using the camera unit <b>14</b>, a title image stored in the external storage medium <b>21</b> is automatically inserted at the current recording position of the moving image contents data, the recording of which is underway. When a plurality of title images are stored in the external storage medium <b>21</b>, for example, a process for automatically switching a title image used every time the insert button <b>131</b> is pressed is executed.
P-0045[0045] The simultaneous recording & playback function (2) is used to display a still or moving image as index information along the progress of playback of music contents data. As index information, a still or moving image taken by the camera unit <b>14</b> is used.
P-0046[0046] When the user takes a still or moving image using the camera unit <b>14</b> during recording or playback of music contents data, link data between the music contents data whose recording or playback is in progress, and the taken image data, is automatically generated.
P-0047[0047] The table of contents creation function (3) automatically generates a table of contents window (table of contents menu) including keywords (keyword titles), from moving image contents data using character images contained in that moving image contents data.
P-0048[0048] This function can automatically create a table of contents by extracting titles (telops) from recorded contents. The user can quickly play back a scene he or she wants to watch merely by selecting a keyword on the automatically generated table of contents window, without having to create indexes by himself or herself.
P-0049[0049] The system arrangement of the portable contents recording/playback apparatus <b>11</b> of this embodiment will be described below with reference to FIG. 2.
P-0050[0050] As shown in FIG. 2, the portable contents recording/playback apparatus <b>11</b> comprises a control unit <b>111</b>, video input unit <b>112</b>, audio input unit <b>113</b>, buffer memory <b>114</b>, compression processing unit <b>115</b>, recording control unit <b>116</b>, telop extraction unit <b>117</b>, text conversion unit <b>118</b>, storage medium <b>120</b> (HDD or the like), video playback unit <b>121</b>, audio playback unit <b>122</b>, and the like, in addition to the aforementioned display <b>12</b>, control buttons <b>13</b>, camera unit <b>14</b>, microphone <b>15</b>, audio input terminal <b>16</b>, video input terminal <b>17</b>, card slot <b>18</b>, loudspeaker <b>19</b>, earphones <b>20</b>, and the like.
P-0051[0051] The control unit <b>111</b> is a processor for controlling the operation of the portable contents recording/playback apparatus <b>11</b>. The control unit <b>111</b> controls to record and play back audio and image contents data and to take a still or moving image using the camera unit <b>14</b> in accordance with user's operations of the control buttons <b>13</b>.
P-0052[0052] The camera unit <b>14</b> comprises an image sensing device such as a CCD or the like, and a signal processing circuit. The camera unit <b>14</b> executes an imaging operation (photographing operation), and image data of a still or moving image obtained by the imaging operation is input to the buffer memory <b>114</b>. The image data input to the buffer memory <b>114</b> is compression-encoded by the compression processing unit <b>115</b>, and the compressed data is recorded as video contents data of the still or moving image in the HDD <b>120</b> via the recording control unit <b>116</b>.
P-0053[0053] When image data of a still or moving image input from an external AV apparatus is to be recorded, that image data is input to the buffer memory <b>114</b> via the video input terminal <b>17</b> and video input unit <b>112</b>.
P-0054[0054] Upon recording audio contents data, audio data input from an external AV apparatus via the audio input terminal <b>16</b> or audio data input via the microphone <b>15</b> is sent to the recording control unit <b>116</b> via the audio input unit <b>113</b>, and is recorded as audio contents in the HDD <b>120</b>.
P-0055[0055] The image contents data and audio contents data, which are recorded as audio and video contents in the HDD <b>120</b>, are respectively played back by the video playback unit <b>121</b> and audio playback unit <b>122</b>. This playback process is executed according to link information recorded in the HDD <b>120</b> under the control of the control unit <b>111</b>. The link information links contents data with each other, and is used to implement the aforementioned edit functions.
P-0056[0056] A title insert unit <b>119</b> inserts a title image stored in the external storage medium <b>21</b> into moving image contents data whose recording or playback is underway. As the insert method, 1) a method of physically inserting a title image into moving image contents data, and 2) a method of logically inserting a title image using link information are available. In either case, a title image is inserted between two consecutive frames of the moving image contents data.
P-0057[0057] When a title image is to be physically inserted during recording of moving image contents data, a title image stored in the external storage medium <b>21</b> is sent to the buffer memory <b>114</b>, and is physically inserted in the moving image contents data as image data for a predetermined number of frames between the current and next frame positions of the moving image contents data.
P-0058[0058] For logical insertion, a title image stored in the external storage medium <b>21</b> is sent to the recording control unit <b>116</b>, and is recorded in the HDD as title contents together with link information with the moving image contents data. This link information is used to link that moving image contents data and title contents. The link information contains insert position information indicating frames of the moving image contents data, between which the title contents is to be inserted. The insert position information indicates the current frame number corresponding to the current recording or playback position of the moving image data upon depression of the insert button <b>131</b>, and the next frame number.
P-0059[0059] The telop extraction unit <b>117</b> and text conversion unit <b>118</b> are provided to implement the aforementioned table of contents creation function. The telop extraction unit <b>117</b> analyzes moving image contents data input to the buffer memory <b>114</b> to detect frames that include character images (telops), and extracts the character images from the detected frames. The text conversion unit <b>118</b> converts each extracted character image into text data by character recognition. The control unit <b>111</b> generates a table of contents window based on the converted text data and the position information of the detected frames, and records it as menu contents in the HDD <b>120</b> via the recording control unit <b>116</b>.
P-0060[0060] The respective edit functions will be explained in detail below. ps <Title Insertion>
P-0061[0061] The title insert function will be explained below with reference to FIGS. <b>3</b> to <b>7</b>.
P-0062[0062] When the user has pressed the insert button <b>131</b> during, e.g., recording of moving image contents data, a title image, which is prepared in advance, is inserted into the moving image contents data, which is being recorded, for a time period in which the insert button <b>131</b> is held down. Of course, a title image may be inserted into moving image contents data for a predetermined number of frames in response to depression of the insert button <b>131</b>.
P-0063[0063]FIG. 3 shows a case wherein the current frame number of moving image contents which is being recorded upon depression of the insert button <b>131</b> is “3”, and a title image is inserted between that frame <b>3</b> and the next frame <b>4</b> for a playback time of two frames.
P-0064[0064] A plurality of types of title images may be prepared in advance, and a title image may be selectively inserted for each scene of a moving image. In this manner, upon playing back a moving image, different title images can be displayed for respective scenes to be played back. Hence, the user can easily recognize the contents data, playback of which is in progress, without inputting any comment messages or the like.
P-0065[0065] Likewise, other audio data, which is prepared in advance, can be inserted as a voice index into audio data during recording of that audio data.
P-0066[0066] A practical process upon, e.g., inserting a title image into moving image contents will be explained below.
P-0067[0067] Title insertion is done in the sequence shown in the flow chart in FIG. 4. More specifically, a recording or playback process of moving image contents is executed (step S<b>101</b>). During recording or playback of the moving image contents, the control unit <b>111</b> monitors if the user has pressed the insert button <b>131</b> (step S<b>102</b>). If the control unit <b>111</b> detects that the user has pressed the insert button <b>131</b> (YES in step S<b>102</b>), a process for inserting a title image at the current recording or playback position of the moving image contents is executed while continuing the recording or playback process of that moving image contents (step S<b>103</b>). FIG. 5 shows the title image insert process.
P-0068[0068]FIG. 5 shows a case wherein a title image is physically inserted into a stream of moving image contents. In this case, the title insert unit <b>119</b> inputs a title image to the image buffer memory <b>114</b> as two frame data between the current frame <b>3</b> and next frame <b>4</b> of the moving image contents data. The buffer memory <b>114</b> sends to the compression processing unit <b>115</b>, image data in the order of frame <b>1</b>, frame <b>2</b>, and frame <b>3</b> of the moving image contents, title image, title image, and frame <b>4</b>, frame <b>5</b>, and frame <b>6</b> of the moving image contents.
P-0069[0069] The compression processing unit <b>115</b> executes a compression encoding process using a motion compensation technique such as MPEG<b>2</b>, MPEG<b>4</b>, or the like. In this compression encoding process, inter encoding or intra encoding is executed while executing a motion estimation process in the input order of moving image data. The stream of the moving image contents data in which the title image has been inserted in this way undergoes a compression process by the compression processing unit <b>115</b>, thus generating compression-encoded video contents data, which includes frames in the order of frame <b>1</b>, frame <b>2</b>, frame <b>3</b>, title image, title image, frame <b>4</b>, frame <b>5</b>, frame <b>6</b>, . . . , frame N. Then, the generated video contents data is recorded in the HDD <b>120</b>.
P-0070[0070]FIG. 6 shows a case wherein a title image is logically inserted into a stream of moving image contents. In this case, a title image to be inserted, which is output from the title insert unit <b>119</b>, is recorded in the HDD <b>120</b> together with link information. The link information contains first link information (link <b>1</b>) which indicates, as insert position information, the current frame number (frame <b>3</b>) and next frame number (frame <b>4</b>) of the moving image contents data upon depression of the insert button <b>131</b>, and second link information (link <b>2</b>) that links the moving image contents data and the title image. Link information <b>2</b> also contains playback time period information indicating the playback time period (the number of frames) of the title image.
P-0071[0071] In this manner, the title image is recorded in the HDD <b>120</b> in correspondence with the insert position information indicating frames <b>3</b> and <b>4</b>, and the moving image contents data, which is being recorded. In this case, the playback process of the recorded moving image contents data is executed in the sequence shown in the flow chart of FIG. 7.
P-0072[0072] The control unit <b>111</b> refers to link information corresponding to moving image contents data to be played back (step S<b>111</b>), and selectively executes a video playback process for playing back the moving image contents data (step S<b>113</b>) and a title image playback process (step S<b>114</b>) while checking for each frame if a title image is to be inserted at the current frame position (step S<b>112</b>).
P-0073[0073] The moving image contents data is played back from frames <b>1</b> to <b>3</b>, the title image is played back for the subsequent playback time for two frames, and the moving image contents data is then played back from frame <b>4</b>. In this manner, the title image is played back between playback frames <b>3</b> and <b>4</b> of the moving image contents data, which are designated by the insert position information. Note that the number of frames used to play back and display the title image is given by the aforementioned playback time period information. When a moving image is used as the title image, or other audio data is inserted into audio data, the aforementioned playback time period information may be not required.
P-0074[0074] <Simultaneous Recording & Playback Function of Audio and Image>
P-0075[0075] The simultaneous recording & playback function of audio and image data will be explained below with reference to FIGS. <b>8</b> to <b>11</b>.
P-0076[0076] Assume that the user takes a still image using the camera unit <b>14</b> during recording of audio contents data. FIG. 8 shows a case wherein the user took three still images A, B, and C during audio recording.
P-0077[0077] Each of Still images A, B, and C is recorded together with link information which indicates an audio recording elapsed time upon taking each still image. Upon playing back the recorded audio contents data, still images A, B, and C are played back and displayed at timings indicated by their link information, so that still images A, B, and C are sequentially played back and displayed in the order named along the progress of audio playback.
P-0078[0078] Also, when the user takes a still image during playback of audio contents data, each still image is recorded together with link information indicating an elapsed time from the beginning of playback of the audio contents, thus linking each still image and music contents.
P-0079[0079]FIG. 9 shows an example of link information which is used to link each still image and audio contents data (audio contents). For example, upon linking two still images A and B to audio contents data, link information corresponding to each of these still images A and B is generated. The link information corresponding to still image A contains link <b>1</b> which indicates an elapsed time (time <b>2</b>) from the beginning of playback or recording of audio contents data, and link <b>2</b> that links the audio contents data and still image A, and the link information corresponding to still image B contains link <b>1</b> which indicates an elapsed time (time <b>4</b>) from the beginning of playback or recording of audio contents data, and link <b>2</b> that links the audio contents data and still image B.
P-0080[0080]FIG. 10 shows the recording processing sequence of audio contents data. A process for recording audio contents data input via the microphone <b>15</b> or audio input terminal <b>15</b> is executed (step S<b>201</b>). The control unit <b>111</b> monitors if the user has pressed the photograph button <b>132</b> during audio recording. Every time the user has pressed the photograph button <b>132</b>, a still image photographing process is executed. Upon execution of the still image photographing process (YES in step S<b>202</b>), link information that contains an elapsed time from the beginning of recording of audio contents data is generated, and is recorded together with the still image obtained by the still image photographing process (step S<b>203</b>).
P-0081[0081]FIG. 11 shows the playback process sequence of the recorded audio contents data. An audio contents data playback process starts (step S<b>211</b>). During the audio contents data playback process, it is checked based on the link information corresponding to that audio contents data and an elapsed time from the beginning of playback of the audio contents data if the current playback position of the audio contents data is a playback position (audio frame) where a still image is to be played back (steps S<b>212</b> and S<b>213</b>). The still image is played back and displayed on the display <b>12</b> at the timing indicated by the link information (step S<b>214</b>).
P-0082[0082] Note that not only still or moving image obtained by the photographing process but also contents data that contains text data such as lyrics or the like can be recorded in correspondence with audio data which is being recorded, by instructing to record such contents data from the corresponding control button <b>13</b>.
P-0083[0083] <Table of Contents Creation>
P-0084[0084] The table of contents creation process will be described below with reference to FIGS. <b>12</b> to <b>15</b>. A case will be explained below wherein a TV program such as a music program or the like, which is input from a TV tuner or the like, is recorded. In this case, the TV program includes moving image contents data and audio contents data, and the moving image contents data and the audio contents data are synchronously recorded.
P-0085[0085] In a music program, a song title and artist name are normally superimposed on the moving image contents data of the music program. Upon playback, when a signer sings a song, a song title and artist name are displayed as a telop on the screen at the beginning of that song.
P-0086[0086] As shown in FIG. 12, a song title and artist name, included in the moving image contents data, are extracted by the telop extraction unit <b>117</b>, and undergo character recognition by the text conversion unit <b>118</b>, thus creating a table of contents window that contains the song names and artist names obtained by the text conversion unit <b>118</b> as keywords.
P-0087[0087] Upon playback, the user selects a keyword of a song to be played back from the table of contents window, thus easily selecting a desired song.
P-0088[0088] The created table of contents window is recorded as menu contents in the HDD <b>120</b>. In this case, the menu contents link to A/V contents which contain moving image and audio contents data that configure the music program. FIG. 13 shows an example of this link information.
P-0089[0089] This link information links the menu contents and corresponding A/V contents, and link information which contains link <b>1</b> that indicates the frame number of moving image contents data which forms the A/V contents, and link <b>2</b> that indicates a corresponding entry (keywords such as a song title, artist name, and the like) on the menu contents is generated for each entry (keywords such as a song title, artist name, and the like) on the table of contents window which forms the menu contents. FIG. 14 is a flow chart showing the sequence of the table of contents creation process executed upon recording moving image contents data.
P-0090[0090] Moving image contents data input on the buffer memory <b>114</b> is analyzed for respective frames to see if the frame of interest contains a character information image (telop) (step S<b>301</b>). Normally, since a character information image is displayed in white on the screen, whether or not the frame of interest includes a character information image (telop) can be determined by binarizing image data of each frame (white and gray) using a predetermined threshold value for each pixel, and checking the degree of grouping of white component pixels.
P-0091[0091] A character information image extraction process is then executed (step S<b>302</b>). In this extraction process, for example, row and column histograms associated with white component pixels are generated for a frame that contains a character information image (telop), and detection of a line that includes a character string and extraction of characters are executed based on the histograms.
P-0092[0092] After that, the extracted characters undergo character recognition, thus converting the character information image into text data indicating an artist name and the like (step S<b>303</b>). Based on the converted text data and the corresponding frame number, the table of contents window which includes the converted text data as an entry, and link information that links each entry to the corresponding frame are generated, and are recorded in the HDD <b>120</b> (step S<b>304</b>).
P-0093[0093] Note that the aforementioned table of contents creation process can also be implemented by analyzing already recorded moving image contents data.
P-0094[0094] A sequence for starting playback of moving image contents data from a frame position corresponding to a keyword selected on the table of contents window will be described below with reference to the flow chart in FIG. 15.
P-0095[0095] The table of contents window (menu) corresponding to moving image contents data to be played back is displayed on the screen of the display <b>12</b> (step S<b>311</b>). If the user has selected one entry (keyword) on this table of contents window, the frame number corresponding to that selected entry is detected as a playback start point on the basis of the link information (step S<b>312</b>). Playback of the moving image contents data to be played back starts from the frame position of the playback start point (step S<b>313</b>).
P-0096[0096] In this way, since the table of contents is automatically created by extracting titles (telops) from the contents, the user can play back moving image contents data from a desired position without display of any edit window or user's operations required to create comment messages and the like.
P-0097[0097] As described above, according to this embodiment, the edit operations required to manage contents. data stored in the portable contents recording/playback apparatus <b>11</b> can be easily performed without display of any edit window or user's operations required to create comment messages and the like.
P-0098[0098] Note that the title insert function, simultaneous record & playback function, and table of contents creation function in this embodiment can be appropriately combined and used. The respective edit functions of this embodiment are suitably applied to a portable electronic apparatus that does not allow easy input operations. Also, since input operations for recording/playback apparatuses such as a TV receiver, digital video recorder, audio player, and the like are normally difficult, this embodiment is effective for such home consumer AV apparatuses.
P-0099[0099] All the aforementioned functions of this embodiment can be implemented as a computer program executable by computer.
P-0100[0100] Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.
Contents5
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10602015B2 | Cited by | United States of America | Search report |
| US2016105620A1 | Cited by | United States of America | Pre-grant |
| US2008015857A1 | Cited by | United States of America | Pre-grant |
| US8340494B2 | Cited by | United States of America | Search report |
| US9503675B2 | Cited by | United States of America | Search report |
| US2010329567A1 | Cited by | United States of America | Pre-grant |
| US2006282760A1 | Cited by | United States of America | Pre-grant |
| US2010129049A1 | Cited by | United States of America | Pre-grant |
| US12328514B2 | Cited by | United States of America | Applicant |
| US2012098998A1 | Cited by | United States of America | Pre-grant |
| US2016105620A1 | Cited by | United States of America | Search report |
| US2008138034A1 | Cited by | United States of America | Pre-grant |
| US2004246259A1 | Cited by | United States of America | Pre-grant |
| US2015093094A1 | Cited by | United States of America | Pre-grant |
| US8453045B2 | Cited by | United States of America | Applicant |
| US2007101270A1 | Cited by | United States of America | Pre-grant |
| US7853866B2 | Cited by | United States of America | Search report |
| US2011254885A1 | Cited by | United States of America | Pre-grant |
| US9100742B2 | Cited by | United States of America | Search report |
| US2010124408A1 | Cited by | United States of America | Pre-grant |
| US4763252A | Cites | United States of America | Pre-grant |
| US5617539A | Cites | United States of America | Pre-grant |
| US5822492A | Cites | United States of America | Pre-grant |
| US6141490A | Cites | United States of America | Pre-grant |
| US6243419B1 | Cites | United States of America | Pre-grant |
| US6353461B1 | Cites | United States of America | Pre-grant |
5 members in 3 offices
Priority claims1
| Document | Office | Kind | Date |
|---|---|---|---|
| 2002076940 | Japan | A |
Members5
| Document | Office | Kind | |
|---|---|---|---|
| EP1347455A2 | European Patent Office (EPO) | A2 | |
| JP2003274352A | Japan | A | |
| US2003190142A1 | United States of America | A1 | |
| EP1347455A3 | European Patent Office (EPO) | A3 | |
| JP3615195B2 | Japan | B2 |
37 transactions on the USPTO file
Abandoned after 1 non-final rejection and 1 final rejection.
- Non-final rejections
- 1
- Final rejections
- 1
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Mail Abandonment for Failure to Respond to Office ActionAbandonedMABN2 | MABN2 | |
| Aband. for Failure to Respond to O. A.AbandonedABN2 | ABN2 | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Mail Notice of Informal or Non-Responsive AmendmentNINA | NINA | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Informal or Non-Responsive Amendment after Examiner ActionA.I. | A.I. | |
| Response after Non-Final ActionA... | A... | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Miscellaneous Incoming LetterLET. | LET. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Miscellaneous Incoming LetterLET. | LET. | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Transfer Inquiry to GAUTI1050 | TI1050 | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Initial Exam Team nnIEXX | IEXX |
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTIONSTCB | STCB | |
| AssignmentAS | AS |
Numbers
- Application
- 38569303
Titles
- English
- Contents recording/playback apparatus and contents edit method
Classification
- CPC, 19
- G11B27/105
- G06F1/1626
- G06F1/1656
- G06F1/1684
- G06F1/1686
- G06F1/1688
- G11B27/11
- G11B27/28
- G11B27/329
- G11B27/34
- G11B2220/65
- H04N5/2621
- H04N5/772
- H04N5/781
- H04N9/7921
- H04N9/8042
- H04N9/8063
- H04N9/8205
- H04N9/8227
- IPC, 17
- G06K9 00
- G06F1 16
- G11B27 02
- G11B27 034
- G11B27 10
- G11B27 11
- G11B27 28
- G11B27 32
- G11B27 34
- H04N5 765
- H04N5 77
- H04N5 781
- H04N5 91
- H04N9 79
- H04N9 804
- H04N9 806
- H04N9 82