System and method for capturing and grouping motion video segments
Claim Score by NHIP
Abstract
A system and method for capturing and grouping motion video segments. The system includes a digital camera for producing and grouping motion video segments including a lens for providing an optical image; an image sensor for receiving the optical image provided by the lens to produce an image signal; a processor responsive to the image signal for producing a plurality of motion video segments; a digital memory for storing the motion video segments; an image display for reviewing the motion video segments; and a user interface for selecting at least two motion video segments to be grouped into a continuous motion video sequence.

Term
Term ended
Projected expiry passed 6 December 2022, 3.8 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
15 claims: 2 independent, 13 dependent
- 1Broadest claimClaim Score 62, broad(NHIP)A digital camera for producing and grouping motion video segments, comprising:a) a lens for providing an optical image;b) an image sensor for receiving the optical image provided by the lens to produce an image signal;c) a processor responsive to the image signal for producing a plurality of motion video segments;d) a digital memory for storing the motion video segments;e) an image display for reviewing the motion video segments;and f) a user interface for selecting at least two motion video segments to be grouped into a continuous motion video sequence.
- 11A method for producing and grouping motion video segments using a hand-held digital camera, the method comprising the steps of:providing the digital camera comprising: i) a lens for providing an optical image;ii) an image sensor for receiving the optical image provided by the lens;iii) a processor;iv) a digital memory;v) an image display;and vi) an user interface;using the image sensor to receive the optical image and produce an image signal;using the processor to produce a plurality of motion video segments responsive to the image signal;viewing the plurality of motion video segments on the image display;using the user interface to select at least two of the plurality of the motion video segments;grouping the selected two of the plurality of motion video segments to produce a continuous motion video sequence;and storing the continuous motion video sequence in the digital memory.
Independent claims2
68 paragraphs in 6 sections, as filed
CROSS REFERENCE TO RELATED APPLICATION
[0001] This is a 111A application of Provisional Application Serial No. 60/367,561, filed Mar. 26, 2002.
[0002] Reference is made to commonly assigned application U.S. Serial No. 60/367,586, entitled “MODULAR DIGITAL IMAGING SYSTEM”, and provisionally filed on Mar. 26, 2002 in the name of Manico et al, and which is assigned to the assignee of this application.
FIELD OF THE INVENTION
[0003] The present invention relates to digital device for recording motion images, and, more particularly, to a system and method for capturing and grouping motion video segments.
BACKGROUND OF THE INVENTION
[0004] Current digital cameras can connect to a host computer by means of a docking unit in order to transfer images to the host computer (e.g., PC). These files can include still image files (e.g. JPEG files) as well as motion video files (e.g. QuickTime files). One example is the Kodak EasyShare DX3600 digital camera, which is sold with an optional docking unit. The camera captures digital still images and motion video segments and stores the images using Flash EPROM memory. The still images and motion video files can be downloaded from the camera to the host computer using the docking unit. If the user configures the EasyShare software on the host computer to provide auto transfers, then, when the user presses the button on the EasyShare docking unit, the still and motion video files are transferred from the camera to a folder on the host computer's hard drive and are erased from the Flash EPROM memory in the digital camera.
[0005] A problem with the prior art is that, while transferring images from the camera to the computer's hard drive (via the docking unit) occurs automatically, the motion video files are not easily viewable on the user's home television. Furthermore, the motion video files take up considerable space on the user's computer hard drive and can be lost if the hard drive crashes.
[0006] Accordingly, there exists a need for an easy-to-use system for capturing and archiving motion video segments and for grouping motion video segments.
SUMMARY OF THE INVENTION
[0007] An object of the present invention is to permit the user of a digital camera to easily capture and archive motion video segments. This object is achieved by a system including a digital camera and a docking unit.
[0008] Another object of the present invention is to provide a system and method for grouping motion video segments.
[0009] These objects are given only by way of illustrative example, and such objects may be exemplary of one or more embodiments of the invention. Other desirable objectives and advantages inherently achieved by the disclosed invention may occur or become apparent to those skilled in the art. The invention is defined by the appended claims.
[0010] According to one aspect of the invention, there is provided a digital camera for producing and grouping motion video segments. The digital camera includes a lens for providing an optical image; an image sensor for receiving the optical image provided by the lens to produce an image signal; a processor responsive to the image signal for producing a plurality of motion video segments; a digital memory for storing the motion video segments; an image display for reviewing the motion video segments; and a user interface for selecting at least two motion video segments to be grouped into a continuous motion video sequence.
[0011] According to another aspect of the invention, there is provided a method for producing and grouping motion video segments using a hand-held digital camera. The method comprising the step of providing the digital camera, wherein the digital camera includes a lens for providing an optical image; an image sensor for receiving the optical image provided by the lens; a processor; a digital memory; an image display; and an user interface. The method further comprises the steps of using the image sensor to receive the optical image and produce an image signal; using the processor to produce a plurality of motion video segments responsive to the image signal; viewing the plurality of motion video segments on the image display; using the user interface to select at least two of the plurality of the motion video segments; grouping the selected two of the plurality of motion video segments to produce a continuous motion video sequence; and storing the continuous motion video sequence in the digital memory.
BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The foregoing and other objects, features, and advantages of the invention will be apparent from the following more particular description of the preferred embodiments of the invention, as illustrated in the accompanying drawings.
[0013]FIG. 1A is an external view of a digital camera in accordance with the present invention.
[0014]FIG. 1B is an external view of the digital camera and docking unit.
[0015]FIG. 2A and FIG. 2B depict block diagrams of two systems suitable for implementing the present invention.
[0016]FIG. 3 is a block diagram of the digital camera suitable for the digital camera of FIG. 1A and FIG <b>1</b>B.
[0017]FIG. 4 is a flow diagram showing an embodiment of a method in accordance with the present invention.
[0018]FIG. 5A and FIG SB depict user interface screens.
[0019]FIG. 6 depicts a directory structure recorded by the digital camera.
DETAILED DESCRIPTION OF THE INVENTION
[0020] The following is a detailed description of the preferred embodiments of the invention, reference being made to the drawings in which the same reference numerals identify the same elements of structure in each of the several figures.
[0021] Referring to FIGS. 1A and 1B, in a preferred embodiment of the present invention, a digital camera <b>300</b> is adapted to capture motion video images and still images and includes a viewable image display <b>332</b>, such as a color LCD, an Organic Light Emitting Display (OLED), or the like. Digital camera <b>300</b> preferably has a generally substantially flat shape. Digital camera <b>300</b> preferably further includes a dual hinge assembly that allows a screen cover <b>301</b> to open and close, like a book, and support the camera/screen in an upright position for image capture and display. The primary cover hinge moves freely but is dampened, the secondary hinge has a locking mechanism that is engaged and disengaged in the full open and full closed positions. The inside surface of the cover preferably includes a non-slip rubber coating to assist in protecting the screen from shock and provides a more secure, non-slip support when used as a stand.
[0022] Digital camera <b>300</b> records images on a solid-state Flash EPROM memory card. This enables the camera to be small in size and low in power consumption. The camera operates as a normal still/video digital camera to capture normal still and video image files. The camera also includes several special modes, which are possible because solid-state memory is used for image storage. These modes include a time-lapse mode, where instead of capturing <b>30</b> images per second, the images are captured at a much slower rate (e.g., 1 image per second) for example to show a sunrise or flower blossom opening. The images can then be played back at a faster rate, such as <b>30</b> images per second. The modes can also include a “slow motion” mode where the images are captured at a higher than normal rate (e.g., 120 images per second) and played back at a slower rate. These modes can be triggered by a significant change in the scene, such as by rapid motion, turning on the lights, etc. When used in the trigger mode, the camera is turned on to capture images at a regular rate (e.g. an image every second) but the images are not recorded until there is a significant change between two captured images, such as due to motion (e.g., a subject entering the room with the camera).
[0023] Digital camera <b>300</b> further includes user controls <b>303</b>, up/down arrows <b>382</b>, left/right arrows <b>384</b>, and selection button <b>386</b>, as will be more particularly described below.
[0024] The camera connects/mates to a docking unit <b>350</b>A, such as shown in FIG. 1B. Docking unit <b>350</b>A can recharge the camera batteries and enable the motion and still image files to be transferred from the camera to a separate archival storage medium, which is preferably a DVD disc.
[0025] As shown in FIG. 2A, a DVD recorder <b>360</b>A can be part of docking unit <b>350</b>A. Alternatively, a DVD recorder can be a peripheral, which attaches to the docking unit. The camera is inserted into the docking unit with the lens facing away from the user and the viewable display facing towards the user, such as shown in FIG. 1B. The combination of the camera, docking unit, and DVD recorder forms a system that automatically transfers video image files from the camera to the DVD disc, so that the DVD disc can be removed from DVD recorder <b>360</b>A and played back on a standard DVD player.
[0026] Docking unit <b>350</b>A is typically located in an all-purpose room (such as the family room) near the TV entertainment system, rather than next to a computer in an office or den and can optionally connect to a TV monitor or a receiver <b>370</b> by means of a suitable video interface <b>372</b>, which may be for example an analog RF video interface or a component digital video interface.
[0027] Docking unit <b>350</b>A, of FIG. 2A, can also be connected to the Internet in order to transfer and receive still and motion video files, as well as other information, as described in commonly assigned U.S. patent application Ser. No. 10/017,809 “SYSTEM INCLUDING A DIGITAL CAMERA AND A DOCKING UNIT FOR COUPLING TO THE INTERNET”, by Belz et. al., the disclosure of which is incorporated herein by reference.
[0028] As shown in FIG. 2B, a docking unit <b>350</b>B can alternatively be designed to attach to a home computer <b>381</b> by means of a suitable digital interface <b>383</b>, which may be for example the well-known USB cable interface or the well-known 802.11 wireless interface. A DVD recorder <b>360</b>B can be part of desktop computer <b>381</b>. Desktop computer <b>381</b> can optionally be connected to other peripherals, such as a color printer <b>385</b>.
[0029] When digital camera <b>300</b> is connected to docking unit <b>350</b>A or <b>350</b>B, the system performs actions that have been previously selected by the user. The docking unit can include a button to initiate these actions/operations/functions, or the actions/operations/functions can be initiated as soon as the camera is inserted into the docking unit.
[0030]FIG. 3 is a block diagram showing features of digital camera <b>300</b> in more detail. Electrical power for all of the circuits of digital camera <b>300</b> is provided by rechargeable batteries <b>346</b> by means of a power supply <b>344</b>. Rechargeable batteries <b>346</b> are recharged by means of power supplied by docking unit <b>350</b>A, <b>350</b>B to a docking interface <b>322</b>. Digital camera <b>300</b> produces digital still images and digital motion video images that are stored on a removable memory card <b>330</b>. Digital camera <b>300</b> further includes a zoom lens <b>312</b> having zoom and focus motor drives <b>310</b> and an adjustable aperture and shutter (not shown). Zoom lens <b>312</b> focuses light from a scene (not shown) to provide an optical image focused on an image sensor <b>314</b>, for example, a single-chip color CMOS or CCD image sensor, using the well-known Bayer color filter pattern. In a preferred arrangement, image sensor <b>314</b> employs “square” pixels in an array of 1800 horizontal pixels by 1200 vertical pixels, thus providing a 3:2 image aspect ratio. Image sensor <b>314</b> is controlled by clock drivers <b>306</b>. Zoom and focus motors <b>310</b> and clock drivers <b>306</b> are controlled by control signals supplied by a control processor and timing generator circuit <b>304</b>.
[0031] Control processor and timing generator <b>304</b> receives inputs from autofocus and auto exposure detectors <b>308</b> and controls a flash <b>302</b>. The analog image signal from image sensor <b>314</b> is amplified and converted to digital data by an analog signal processing (ASP) and analog-to-digital (A/D) converter circuit <b>316</b>. The digital image data from A/D converter circuit <b>316</b> is temporarily stored in a DRAM buffer memory <b>318</b> and subsequently processed by a processor <b>320</b> controlled by the firmware stored in a firmware memory <b>328</b>, which can be flash EPROM memory. It is understood that if image sensor <b>314</b> is a CMOS sensor, the integrated circuit containing image sensor <b>314</b> can also include other circuitry, such as control processor and timing generator <b>304</b>, clock drivers <b>306</b>, and ASP and A/D <b>316</b> converter circuit.
[0032] The processed digital motion and still images are provided to a memory card interface <b>324</b>, which stores the digital images in files on removable memory card <b>330</b>. Removable memory cards <b>330</b> are known to those skilled in the art. For example, removable memory card <b>330</b> can conform to the Compact Flash interface standard, such as described in the CompactFlash Specification Version 1.4, published by the CompactFlash Association, Palo Alto, Calif., Aug. 5, 1998. Other types of removable memory cards, including Smart Media cards, PC cards, SD cards, or Memory Stick cards could alternatively be used.
[0033] It is understood that the still images can be captured using a high resolution (e.g., 1800×1200 pixels), and digital motion images can be captured using a lower resolution (e.g., 640×480 pixels) with a different aspect ratio. Using a CMOS sensor with programmable readout allows the high resolution sensor to provide an extended digital zoom capability when capturing the lower resolution motion images. In addition, the programmable readout can also be used to adjust the portion of image sensor <b>314</b> which is read out during each digital motion image frame to compensate for any camera shake/motion/unsteadiness which might occur during image capture.
[0034] Processor <b>320</b> provides color interpolation followed by color and tone correction, in order to produce rendered still and motion video image data. The rendered motion image data is then compressed and stored as a motion video image file on removable memory card <b>330</b>. Processor <b>320</b> also creates a smaller size digital still “thumbnail” image of at least one video image frame, for example the first or last frame of the sequence. These thumbnail images can be created as described in commonly assigned U.S. Pat. No. 5,164,831 “ELECTRONIC STILL CAMERA PROVIDING MULTI-FORMAT STORAGE OF FULL AND REDUCED RESOLUTION IMAGES” to Kuchta, et. al., the disclosure of which is herein incorporated by reference. This thumbnail image is also stored on removable memory card <b>330</b> in association with the corresponding motion video file, as will be described later with reference to FIG. 6.
[0035] In playback mode, color image display <b>332</b> can display an array of thumbnail images corresponding to the captured still images and motion video segments. The user selects the desired thumbnail image to initiate playback of a particular motion video file. In a preferred embodiment, as the file is played back, the user can select a “make thumbnail” button as a more preferred image from the segment is viewed. A thumbnail image of this more preferred image is then created and stored on removable memory card <b>330</b>, replacing (or alternatively augmenting) the thumbnail image that was automatically created (e.g., the first frame of the sequence) when the motion video segment was captured.
[0036] Color image display <b>332</b> provides a viewable display and can employ an LCD display, an OLED display, or other types of display technologies. Digital camera <b>300</b> is controlled by user controls <b>303</b>. As is best shown in FIG. 1A, user controls <b>303</b> can include select button <b>386</b> (which can be a four-way selection member) which can initiate a picture taking operation, up/down buttons <b>382</b>, and left/right buttons <b>384</b>. The graphical user interface displayed on the color LCD image display <b>332</b> is controlled by the user interface portion of the firmware stored in firmware memory <b>328</b>. The camera user interface can also include a microphone <b>333</b> which connects to an audio amplifier and A/D converter <b>335</b> to provide a digital audio signal to processor <b>320</b>. The camera user interface can also include a digital-to-analog (D/A) converter and audio amplifier <b>337</b>, and a miniature speaker <b>339</b> which plays back the recorded audio, and also makes audible sounds when a new picture is taken, or when the user changes modes or advances to review the next stored still or motion image file. Digital camera <b>300</b> can further include a video output driver and connector (not shown) for directly providing a video output signal to a TV (not shown).
[0037] The still images and the thumbnail image stored on removable memory card <b>330</b> can use the format referred to as the “Exif” image format defined in “Digital Still Camera Image File Format (Exif)” version 2.1, July 1998 by the Japan Electronics Industries Development Association (JEIDA), Tokyo, Japan. This format includes an Exif application segment that stores particular image metadata, for example the date and time the picture was captured, the lens f/number and other camera settings, and image captions or comments that can be selected or entered by the camera user. The motion video images are stored on the removable memory card <b>330</b> using the well-known QuickTime format developed by Apple Computer Inc. It is understood that other still and motion image formats can be employed using various known compression technologies such as JPEG, JPEG2000, MPEG-1, MPEG-2, MPEG-4, and the like. It is further understood that the image format, including the compression technology, can be transcoded as the still or motion image files are transferred from digital camera <b>30</b> to DVD recorder <b>360</b>A,<b>360</b>B.
[0038] The Exif files and Quicktime files are preferably stored on removable memory card <b>330</b> using a directory structure conforming to rules referred to as the “DCF” rules defined in “Design Rule For Camera File System” version 1.0, December 1998 by the Japan Electronics Industries Development Association (JEIDA), Tokyo, Japan. An example directory structure recorded on DOS formatted removable memory card <b>330</b> by digital camera <b>300</b> is depicted in FIG. 6. Two directories are recorded under the root directory <b>400</b>, MISC directory <b>410</b> and DCIM directory <b>420</b>. The MISC directory <b>410</b> contains a file <b>412</b> named AUTPRINT.MRK, which is a print order file using the Digital Printer Order Format (DPOF) format. This file can be used to specify images to be printed, as will be described later, including an index image. The MISC directory <b>410</b> also includes two DPOF auto play files, AUTPLAY1.MRK file <b>414</b> and AUTPLAY.MRK file <b>416</b>. These files can be used to specify that a number of digital video segments and/or still images should be played in a particular sequence as part of a program. Files <b>412</b>-<b>416</b> are examples of control files.
[0039] Subdirectory <b>430</b> is named 100STILL, to conform to the DCF rules, and contains four JPEG compressed Exif image files, PIC<sub>—</sub>0001.JPG file <b>432</b>, PIC<sub>—</sub>0002.JPG file <b>434</b>, PIC<sub>—</sub>0005.JPG file <b>436</b>, and PIC<sub>—</sub>0007.JPG file <b>438</b>. Files <b>432</b>-<b>438</b> are still image files that have been captured by the digital camera <b>300</b>.
[0040] Subdirectory <b>440</b> is named 101MOVIE, to conform to the DCF rules. It is used to store motion video files and the thumbnail still image associated with each motion video file. The files stored in subdirectory <b>440</b> include three Quicktime movie files, file <b>442</b> named VID<sub>—</sub>0003.MOV, file <b>444</b> named VID<sub>—</sub>0004.MOV, and file <b>446</b> named VID<sub>—</sub>0006.MOV. In addition, the files stored in subdirectory <b>440</b> include three associated thumbnail image files, file <b>452</b> named VID<sub>—</sub>0003.TMB, file <b>454</b> named VID<sub>—</sub>0004.TMB, and file <b>456</b> named VID<sub>—</sub>0006.MOV. When the motion video files are initially captured, these three thumbnail files <b>452</b>-<b>456</b> correspond to the first frame of the motion video segment. As the images are reviewed, however, the user can replace one or more of the associated thumbnail images <b>452</b>-<b>456</b> with a preferred image, as was described earlier.
[0041] The user uses user controls <b>303</b> to set the camera in one of the “capture” modes prior to capturing still or motion images. The user sets the camera in the “review” mode in order to review the captured images (e.g., still image files <b>432</b>-<b>438</b> and motion video files <b>442</b>-<b>446</b> in FIG. 6). The user can then review the files and delete undesirable still and motion video files using user controls <b>303</b>.
[0042] The user can also use user controls <b>303</b> to place the camera in a “place order” mode. In this mode, the user can select still images for printing, and can specify how many copies to make. The camera creates an image utilization file, as described in commonly-assigned U.S. Ser. No. 08/977,382 filed Oct. 18, 2002, entitled, “ELECTRONIC CAMERA WITH UTILIZATION SELECTION CAPABILITY” to Parulski et al., the disclosure of which is herein incorporated by reference, and as described in commonly-assigned U.S. Ser. No. 09/004,046 filed Jan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FOR AUTOMATICALLY TRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” to Ward et. al., the disclosure of which is herein incorporated by reference. This image utilization file <b>412</b>, named AUTPRINT.MRK, is an ASCII text file containing these instructions, and is known as a Digital Print Order Format (DPOF) file.
[0043] The user can also select one or more frames from one or more motion video sequence to be saved and/or printed as a still image. In a preferred embodiment, a selected image frame from the motion video file (e.g., file <b>446</b>) is automatically converted by digital camera <b>300</b> into a JPEG still image file (e.g., file <b>438</b>), which is stored on removable memory card <b>330</b>. This JPEG image file is then referenced in the print order file (e.g., AUTPRINT.MRK file <b>412</b>) to indicate the print size, and the number of print copies, that should be made using this still image.
[0044] In a preferred embodiment, the user can also combine a number of motion video files together, so that these files are normally played back, one immediately after the other, when the motion image segments are viewed on image display <b>332</b> of digital camera <b>300</b> or are transferred onto a DVD disc. Instead of merging the actual motion video files, which could take significant computations, an autoplay file (e.g., AUTPLAY.MRK file <b>414</b>) is created which provides an ordered list of the motion image files (e.g. VID<sub>—</sub>0003.MOV file <b>442</b> and VID<sub>—</sub>0004.MOV file <b>444</b>) that should be grouped into a single playback sequence.
[0045] After a series of images have been captured/taken and stored on removable memory card <b>330</b>, digital camera <b>300</b> is connected to docking unit <b>350</b>A, <b>350</b>B. Docking interface <b>322</b> in digital camera <b>300</b> includes an electrical connector that mates with a complimentary connector in the docking unit. Alternatively, removable memory card <b>330</b> can be inserted into a memory card reader in a retail kiosk or other printing device, in order to produce prints or to transfer motion video files to an archival media, such as a DVD disc.
[0046] Referring now to FIG. 4, there is shown a flow diagram showing the process of capturing and reviewing still and motion images using digital camera <b>300</b>, and transferring the images by means of docking unit <b>350</b>A, <b>350</b>B in order to automatically perform user-selected actions, such as creating a DVD disc containing motion images and an index frame indicating the video segments transferred to the DVD disc.
[0047] At block <b>100</b>, the user begins by selecting, using the user interface screens of digital camera <b>300</b>, actions to be performed by digital camera <b>300</b> and docking unit <b>350</b>A, <b>350</b>B when the digital camera is connected to the docking unit. Alternatively, this selection can be done by the user using their home computer (e.g., computer <b>380</b> in FIG. 2B) which transfers the selections to the digital camera <b>300</b> via the docking unit <b>350</b>B, or alternatively at a retail establishment, when the digital camera <b>300</b> and docking unit <b>350</b> are purchased or leased. In some embodiments, this selection process can include customizing the firmware stored in firmware memory <b>328</b>, as described in commonly assigned patent application U.S. Ser. No. 09/549,356 filed Apr. 14, 2000, “CUSTOMIZING A DIGITAL CAMERA” to Prabhu et. al, the disclosure of which is incorporated herein by reference.
[0048] As one example, the actions selected by the user in block <b>100</b> can include automatically creating a DVD disc containing the motion video segments captured by digital camera <b>300</b> as well as the still image files and to then delete the motion video files from digital camera <b>300</b>, while retaining still image files for later printing by a kiosk printer. The selection made in block <b>100</b> is retained in firmware memory <b>328</b> of digital camera <b>300</b>, and used whenever digital camera <b>300</b> is placed in docking unit <b>350</b>A, <b>350</b>B, unless the user decides to select new actions.
[0049] In block <b>102</b>, the user selects a capture mode, which can be a still image capture mode, a normal frame rate motion video capture mode, a time lapse video capture mode, or a high speed video (e.g., slow motion) capture mode. In some embodiments, the user can optionally select whether the recording of motion video images is immediately initiated when the user presses a recording button such as select button <b>386</b>, or is initiated only after digital camera <b>300</b> detects a significant change in the scene, or is initiated at some future time.
[0050] In block <b>104</b>, if the user has selected the still mode, a JPEG still image file is captured and stored each time the capture button (e.g., select button <b>386</b>) is depressed.
[0051] In block <b>106</b>, if the user has selected the normal frame rate motion video capture mode, a Quicktime movie file is captured using a normal (e.g., 30 frames per second) recording rate, as long as the user enables select button <b>386</b>. In addition, a thumbnail image file corresponding to the first video frame is stored, as is described in relation to FIG. 6.
[0052] In block <b>108</b>, if the user has selected the time-lapse motion video capture mode, a Quicktime movie file is captured using a very low frame rate (e.g., one frame every second) from the time the user first presses select button <b>386</b> until the user again presses select button <b>386</b> to stop the recording process. In addition, a thumbnail image file corresponding to the first video frame is stored, as described in relation to FIG. 6. In a preferred embodiment, the recording frame rate is user selectable.
[0053] In block <b>109</b>, if the user has selected the high speed motion video capture mode (e.g., the slow-motion mode), a Quicktime movie file is captured using a relatively high frame rate (e.g., 60 or 120 frames per second) as long as the user enables select button <b>386</b>. To enable this high readout rate, image sensor <b>314</b> can be read in a mode that transfers only some of the pixels, to provide a higher speed, but lower resolution, digital video recording. In addition, a thumbnail image file corresponding to the first video frame is stored, as described in relation to FIG. 6. In a preferred embodiment, the recording frame rate is user selectable.
[0054] In block <b>110</b>, the user decides whether to capture more images, returning to block <b>102</b>, or to review the captured images in block <b>112</b>, using color image display <b>332</b> in FIG. 3. The user interface displayed on color image display <b>332</b> can use the methods described in commonly assigned U.S. Pat. No. 6,147,703 “ELECTRONIC CAMERA WITH IMAGE REVIEW” to Miller, et al., and commonly assigned U.S. Pat. No. 6,233,015 B1 “CAMERA WITH USER COMPLIANT BROWSE AND DISPLAY MODES” to Miller, et al., the disclosures of which are herein incorporated by reference.
[0055]FIG. 5A shows a first user interface screen <b>500</b>A, which can be displayed on color image display <b>332</b> of digital camera <b>300</b>. First user interface screen <b>500</b>A includes a thumbnail image display window <b>510</b>, which displays an array of thumbnail images of the still and motion video files stored on removable memory card <b>330</b>. First user interface screen <b>500</b>A also includes a command area <b>520</b> having a plurality of command icons for performing operations on selected thumbnail images. These command icons include a play icon <b>522</b>, a group icon <b>524</b>, a print icon <b>526</b>, and a delete icon <b>528</b>.
[0056]FIG. 5B shows a second user interface screen <b>500</b>B, which can be displayed on color image display <b>332</b> of digital camera <b>300</b>. Second user interface screen <b>500</b>B plays a video image and optionally displays at least one function <b>530</b> corresponding to user controls <b>303</b> (e.g., controls <b>382</b>, <b>384</b>, <b>386</b>). These functions <b>530</b> can include a print function <b>532</b>, a “slower playback” function <b>533</b>, a “stop” function <b>534</b>, a “faster playback” function <b>535</b>, and a “make thumbnail” function <b>536</b>.
[0057] Referring again to FIG. 4, in block <b>114</b>, the user optionally selects new preferred thumbnail images for one or more motion video files. This is done by first selecting a current thumbnail image from thumbnail image display window <b>510</b>, and then selecting play command icon <b>522</b>, in order to play the motion video segment using user interface screen <b>500</b>B in FIG. 5B. Then, at a preferred point in the motion video segment, the user presses select button <b>386</b> to freeze the image, and then presses a button corresponding to the “make thumbnail” function <b>536</b>. In response, processor <b>320</b> in digital camera <b>300</b> creates a thumbnail image of this particular (e.g., frozen) image frame, and replaces the current thumbnail file (e.g., file <b>452</b> in FIG. 6 associated with Quicktime file <b>442</b>) with this new thumbnail file.
[0058] In block <b>116</b>, the user optionally selects a still image from the motion segment to be printed. This is done by first selecting a current thumbnail image from thumbnail image display window <b>510</b>, and then selecting play command icon <b>522</b>, in order to play this motion video segment using user interface screen <b>500</b>B in FIG. 5B. Then, at the preferred point in the motion video segment, the user presses select button <b>386</b> to freeze the image, and then presses the button corresponding to the “print” function <b>532</b>. In response, processor <b>320</b> in digital camera <b>300</b> creates a full size JPEG image file of the particular (e.g., frozen) image frame, stores the JPEG file in removable memory card <b>330</b>, and adds an appropriate entry to AUTPRINT.MRK print order file <b>412</b>.
[0059] In block <b>118</b>, the user optionally combines several motion video image segments into a single program. This is accomplished by first selecting a plurality of thumbnail images from thumbnail image display window <b>510</b> corresponding to motion video segments, and then selecting group command icon <b>524</b>. In response, processor <b>320</b> in digital camera <b>300</b> creates an autoplay file (e.g., AUTPLAY1.MRK file <b>414</b>) indicating that the selected motion video segments should be treated as a single sequence.
[0060] In block <b>120</b>, the user optionally selects a different frame rate to be used for playback of a motion video file. This is accomplished by first selecting a current thumbnail image from thumbnail image display window <b>510</b>, and then selecting play command icon <b>522</b>, in order to play this motion video segment using user interface screen <b>500</b>B in FIG. 5B. Then, the user presses the button corresponding to “slower” function <b>533</b> or “faster” function <b>535</b>, until the user is satisfied with the playback speed. This feature is particularly useful when the slow frame rate mode (block <b>108</b>) or the high frame rate mode (block <b>110</b>) was used to capture the motion video segment. In response, processor <b>320</b> in digital camera <b>300</b> creates an autoplay file (e.g., AUTPLAY2.MRK file <b>416</b>) indicating that the selected motion video segment should be played back at the user selected frame rate.
[0061] In block <b>122</b>, the user places digital camera <b>300</b> in docking unit <b>350</b>A, <b>350</b>B. The docking unit recharges rechargeable batteries <b>346</b> in digital camera <b>300</b>. In addition, the user selected actions from block <b>100</b> are automatically performed in response to a “user effort” such as placing digital camera <b>300</b> in docking unit <b>350</b>A, <b>350</b>B, or pressing a button on the docking unit after connecting digital camera <b>300</b>.
[0062] In block <b>124</b>, a DVD disc is created by DVD recorder <b>360</b>A in FIG. 2A or by DVD recorder <b>360</b>B in FIG. 2B. This DVD disc includes an index at the beginning of the disc, as is common with DVDs. In the present invention, the DVD index includes thumbnail images corresponding to the associated thumbnail files (e.g., files <b>452</b>-<b>456</b> in FIG. 6). These thumbnail files can be the thumbnails automatically recorded in blocks <b>106</b>-<b>109</b>, or the preferred thumbnails selected by the user in block <b>114</b>. If the user combined several motion video files into one program in block <b>118</b>, these files are combined into one DVD index entry which plays all of the segments in consecutive order. If the user captured still images, these JPEG image files are also recorded onto the DVD as high resolution still image files, which can be accessed by a computer.
[0063] In block <b>126</b>, the motion image files (e.g., files <b>442</b>-<b>446</b>) are erased from removable memory card <b>330</b> in accordance with the example actions selected by the user in block <b>100</b>. The JPEG still image files (e.g., files <b>432</b>-<b>438</b>), including a JPEG file created from the motion video file (e.g., JPEG file <b>438</b>) are retained however, since the print order indicated by the AUTPRINT.MRK file <b>412</b> has not yet been produced.
[0064] In block <b>128</b>, the user removes removable memory card <b>330</b> from digital camera <b>300</b>, and takes removable memory card <b>330</b> to a retail photo printing kiosk (not shown), such as a Kodak PictureMaker kiosk manufactured by Eastman Kodak Company.
[0065] In block <b>130</b>, the kiosk accesses the print order indicated by the AUTPRINT.MRK file <b>412</b>, and produces the prints selected by the user in block <b>116</b>. These can include an index print corresponding to the thumbnail files used in the DVD index. This index print can be sized to fit into the sleeve of the DVD case, thus providing an index having a thumbnail image associated with each motion video segment. As described earlier, the thumbnail images are automatically generated by digital camera <b>300</b>, and may be replaced by a user preferred thumbnail image in block <b>114</b>. The still image files are then erased from removable memory card <b>330</b>.
[0066] The customer can, of course, repeat blocks <b>102</b> to <b>124</b> to capture and transfer more still and motion video images, with the digital camera <b>300</b> and the docking unit <b>350</b> performing the actions selected by the user in block <b>100</b>.
[0067] A computer program product, such as a readable storage medium, can store the programs in accordance with the present invention for operating the methods set forth above. The readable storage medium can be a magnetic storage media, such as a magnetic disk (such as a floppy disk) or magnetic tape; optical storage media, such as an optical disk, an optical tape, or a machine readable bar code; solid state electronic storage devices, such as a random access memory (RAM) or a read only memory (ROM); or any other physical device or medium employed to store computer programs.
[0068] The invention has been described in detail with particular reference to a presently preferred embodiment, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein. Parts List (Not Complete) <b>100</b> block <b>318</b> DRAM buffer memory <b>102</b> block <b>320</b> processor <b>104</b> block <b>322</b> docking interface <b>106</b> block <b>324</b> memory card interface <b>108</b> block <b>328</b> firmware memory <b>109</b> block <b>330</b> removable memory card <b>110</b> block <b>332</b> image display <b>112</b> block <b>333</b> microphone <b>114</b> block <b>335</b> A/D converter <b>116</b> block <b>337</b> D/A and audio amplifier <b>118</b> block <b>339</b> miniature speaker <b>120</b> block <b>344</b> power supply <b>122</b> block <b>346</b> rechargeable batteries <b>124</b> block <b>350</b>A docking unit <b>126</b> bloc <b>350</b>B docking unit <b>130</b> block <b>360</b>A DVD recorder <b>300</b> digital camera <b>360</b>B DVD recorder <b>301</b> screen cover <b>370</b> receiver <b>302</b> flash <b>372</b> video interface <b>303</b> user controls <b>381</b> home computer <b>304</b> control processor and timing <b>382</b> up/down arrows generator circuit <b>383</b> digital interface <b>306</b> clock driver <b>384</b> left/right arrows autofocus and autoexposure <b>385</b> color printer detectors <b>386</b> select button <b>310</b> zoom and focus motor drives <b>400</b> root directory <b>312</b> zoom lens <b>410</b> MISC directory <b>314</b> image sensor <b>412</b>-<b>416</b> control files <b>316</b> analog signal processing and <b>420</b> DCIM directory analog-to-digital converter <b>430</b> subdirectory circuit <b>432</b>-<b>438</b> still image files <b>440</b> subdirectory <b>442</b>-<b>446</b> motion video/movie files <b>452</b>-<b>456</b> thumbnail image files <b>500</b>A user interface screen <b>500</b>B user interface screen <b>510</b> thumbnail image display <b>520</b> command area <b>522</b> play icon <b>524</b> group icon <b>526</b> print icon <b>528</b> delete icon <b>530</b> function <b>532</b> print function <b>533</b> slower playback function <b>534</b> stop function <b>535</b> faster playback function <b>536</b> make thumbnail function
Contents6
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2005257152A1 | Cited by | United States of America | Pre-grant |
| US10354691B2 | Cited by | United States of America | Search report |
| US10542216B2 | Cited by | United States of America | Applicant |
| US2009028530A1 | Cited by | United States of America | Pre-grant |
| US8463056B2 | Cited by | United States of America | Search report |
| CN103379260A | Cited by | China | Search report |
| US11004474B2 | Cited by | United States of America | Applicant |
| US8159560B2 | Cited by | United States of America | Search report |
| US2019045132A1 | Cited by | United States of America | Search report |
| US9516178B2 | Cited by | United States of America | Search report |
| US2004003151A1 | Cited by | United States of America | Pre-grant |
| US2010220198A1 | Cited by | United States of America | Pre-grant |
| US2008158389A1 | Cited by | United States of America | Pre-grant |
| US9369631B2 | Cited by | United States of America | Applicant |
| US2008071932A1 | Cited by | United States of America | Pre-grant |
| US10237480B2 | Cited by | United States of America | Applicant |
| US2009160974A1 | Cited by | United States of America | Pre-grant |
| US2009304273A1 | Cited by | United States of America | Pre-grant |
| US8761570B2 | Cited by | United States of America | Search report |
| US2006164535A1 | Cited by | United States of America | Pre-grant |
| US8054333B2 | Cited by | United States of America | Search report |
| US8327267B2 | Cited by | United States of America | Search report |
| US9805765B2 | Cited by | United States of America | Applicant |
| US7522196B2 | Cited by | United States of America | Search report |
| US2008259173A1 | Cited by | United States of America | Pre-grant |
| US16108A | Cites | United States of America | Pre-grant |
| US2001016108A1 | Cites | United States of America | Pre-grant |
| US2001017714A1 | Cites | United States of America | Pre-grant |
| US2001023436A1 | Cites | United States of America | Pre-grant |
| US2002093571A1 | Cites | United States of America | Pre-grant |
| US2002118950A1 | Cites | United States of America | Pre-grant |
| US2003160890A1 | Cites | United States of America | Pre-grant |
| US2004201680A1 | Cites | United States of America | Pre-grant |
| US2004201774A1 | Cites | United States of America | Pre-grant |
| US5164831A | Cites | United States of America | Pre-grant |
| US5966122A | Cites | United States of America | Pre-grant |
| US6052508A | Cites | United States of America | Pre-grant |
| US6147703A | Cites | United States of America | Pre-grant |
| US6233015B1 | Cites | United States of America | Pre-grant |
| US6504993B1 | Cites | United States of America | Pre-grant |
10 members in 4 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 36756102 | United States of America | P | |
| 31371802 | United States of America | A | |
| 60367561 | – | – | – |
| US20020313718 | – | – | – |
| US20020367561P | – | – | – |
Members10
| Document | Office | Kind | |
|---|---|---|---|
| EP1349390A2 | European Patent Office (EPO) | A2 | |
| US2003184656A1 | United States of America | A1 | |
| US2003184658A1 | United States of America | A1 | |
| US2003184674A1 | United States of America | A1 | |
| CN1447589A | China | A | |
| US2003193578A1 | United States of America | A1 | |
| JP2004032690A | Japan | A | |
| CN1263284C | China | C | |
| EP1349390A3 | European Patent Office (EPO) | A3 | |
| US7295244B2 | United States of America | B2 |
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTIONSTCB | STCB | |
| AssignmentAS | AS |
Numbers
- Publication, DOCDB
- 2003193578
- Publication, EPODOC
- US2003193578
- Application
- 10313718
- Application, DOCDB
- 31371802
- Application, EPODOC
- US20020313718
Titles
- English
- System and method for capturing and grouping motion video segments
Classification
- CPC, 3
- H04N5/765
- H04N5/772
- H04N5/85
- IPC, 3
- H04N5 765
- H04N5 77
- H04N5 85
- USPC, 2
- 348220100
- 386E05002