Field sequential color camera system
Summary by NHIP
Filed Sequential Color Camera System
The system captures images using a color camera with two solid-state imaging devices and an illumination unit emitting multicolor light in a sequential switch mode. Distinctive elements include frame memories recording still images simultaneously with sync signals, a memory output switch reading these images repetitively, and image synthesis means combining the data.
Claim Score by NHIP
Abstract
A filed sequential color camera system includes a color camera, and an illumination unit. The color camera includes a separation optical system to separate an optical image of a subject incident from a lens in two directions; two solid-state imaging devices to convert into electric signals the respective optical images separated in the two directions; an electronic shutter control device to apply sequential exposure control to the two solid-state imaging devices within a time corresponding to a ½ frame for each one frame and at a non-overlapping interval; and a light-emitting sync signal output device to produce a light-emitting sync signal in sync with the sequential exposure control by the electronic shutter control device. The illumination unit receives the light-emitting sync signal from the color camera to emit multicolor light having different wavelength ranges in sync with exposure control of the solid-state imaging devices and in a sequential switch mode.

Term
1.5 yearsleft in the term
Expires 25 March 2028, including 410 days of term adjustment.
- Priority
- Filed
- Granted
- Today
- Expires
9 claims: 4 independent, 5 dependent
- 1A filed sequential color camera system, comprising:a color camera comprising a separation optical system adapted to separate an optical image of a subject incident from a lens in two directions;two solid-state imaging devices to convert into electric signals the respective optical images separated in the two directions;an electronic shutter control means to apply sequential exposure control to said two solid-state imaging devices within a time corresponding to a ½ frame for each one frame and at a non-overlapping interval;and a light-emitting sync signal output means to produce a light-emitting sync signal in sync with the sequential exposure control by said electronic shutter control means, and an illumination unit to receive said light-emitting sync signal from said color camera to emit multicolor light having different wavelength ranges in sync with exposure control of said solid-state imaging devices and in a sequential switch mode, wherein said color camera further comprises: two frame memories to simultaneously record a still image produced out of each of said two solid-state imaging device and an emitting sync signal from said electronic shutter control means;a memory output switch means to read the still image recorded in said frame memories repetitively a plurality of times so that said emitting sync signal is identified as a still image having an observable time length to produce it in a controlled way;and an image synthesis means to synthesize said multicolor still images having an observable time length into a color image which is in turn produced to an image output terminal, said image synthesis means producing said multicolor still images at the same timing while they are corrected for a time difference between the respective imaging timings.
- 6Broadest claimClaim Score 33, narrow(NHIP)A field sequential color camera system, comprising:a color camera comprising a separation optical system adapted to separate an optical image of a subject incident from a lens in two directions;two solid-state imaging devices to convert into electric signals the respective optical images separated in the two directions;an electronic shutter control means to apply sequential exposure control to said two solid-state imaging devices within a time corresponding to a ½ frame for each one frame and at a non-overlapping interval;and a light-emitting sync signal output means to produce a light-emitting sync signal in sync with the sequential exposure control by said electronic shutter control means, and an illumination unit to receive said light-emitting sync signal from said color camera to emit multicolor light having different wavelength ranges in sync with exposure control of said solid-state imaging devices and in a sequential switch mode, wherein said separation optical system constitutes a two-piece color separation prism having a dichroic film adapted to separate light into a blue-and-green wavelength range and a red-and-infrared wavelength range.
- 7A field sequential color camera system, comprising:a color camera comprising a separation optical system adapted to separate an optical image of a subject incident from a lens in two directions;two solid-state imaging devices to convert into electric signals the respective optical images separated in the two directions;an electronic shutter control means to apply sequential exposure control to said two solid-state imaging devices within a time corresponding to a ½ frame for each one frame and at a non-overlapping interval;and a light-emitting sync signal output means to produce a light-emitting sync signal in sync with the sequential exposure control by said electronic shutter control means, and an illumination unit to receive said light-emitting sync signal from said color camera to emit multicolor light having different wavelength ranges in sync with exposure control of said solid-state imaging devices and in a sequential switch mode, wherein said separation optical system constitutes a two-piece color separation prism having a dichroic film adapted to separate light into an ultraviolet-and-blue wavelength range and a red-and-green wavelength range.
- 9A field sequential color camera system, comprising:a color camera comprising a separation optical system adapted to separate an optical image of a subject incident from a lens in two directions;two solid-state imaging devices to convert into electric signals the respective optical images separated in the two directions;an electronic shutter control means to apply sequential exposure control to said two solid-state imaging devices within a time corresponding to a ½ frame for each one frame and at a non overlapping interval;and a light-emitting sync signal output means to produce a light-emitting sync signal in sync with the sequential exposure control by said electronic shutter control means, and an illumination unit to receive said light-emitting sync signal from said color camera to emit multicolor light having different wavelength ranges in sync with exposure control of said solid-state imaging devices and in a sequential switch mode, wherein said color camera further comprises: two frame memories to simultaneously record a still image produced out of each of said two solid-state imaging device and an emitting sync signal from said electronic shutter control means;a memory output switch means to read the still image recorded in said frame memories repetitively a plurality of times so that said emitting sync signal is identified as a still image having an observable time length to produce it in a controlled way;and an image synthesis means to synthesize said multicolor still images having an observable time length into a color image which is in turn produced to an image output terminal, said memory output switch means reading one of the still images recorded by said plurality of frame memories repetitively a plurality of times or reading it repetitively a plurality of times as an instantaneous still image having an observable time length in order of imaging to produce an output.
Independent claims4
77 paragraphs in 8 sections, as filed
FIELD OF THE ART
0001The present invention relates generally to a field sequential color TV camera, and more particularly to a filed sequential color camera system that is in sync with field sequential emission illumination of invisible light and visible light to generate color images at two frames.
BACKGROUND ART
0002A typical prior art field sequential color camera is designed such that a color separation filter is rotated by means of a motor or a light-emitting strobe or diode is allowed to emit light to obtain field sequential color signals which are in turn synthesized into color image signals.
0003On the other hand, the field sequential color camera is used with infrared or near infrared light added to the emissions R, G and B (red, green and blue) for the purpose of correcting flaws for photographic films, observing the surface and interior of the skin of a human being, or it is used with ultraviolet light added to the emissions with a view to inspecting semiconductor patterns. In this regard, see JP(A)2003-333608.
0004With a TV camera that takes 1/60 (or 1/30) second to produce one image, however, there are problems that when images are taken in a field sequential mode while R, G, B visible light plus invisible light such as infrared or ultraviolet light are emitted, four frames are needed, and cameras or subjects shake to blur images, or much time is needed for measurement.
0005In view of such situations, an object of the invention is to provide a field sequential color camera system wherein a light-emitting strobe or diode with R, G, B visible light plus invisible light such as infrared light or ultraviolet light is combined with an illumination unit capable of emissions in a field sequential mode, so that color images of high definitions can be finished and obtained at two frames.
SUMMARY OF THE INVENTION
0006According to the invention, the aforesaid object is achieved as embodied below.
0007(1) A filed sequential color camera system, characterized by comprising:
0008a color camera comprising a separation optical system adapted to separate an optical image of a subject incident from a lens in two directions; two solid-state imaging devices adapted to convert into electric signals the respective optical images separated in said two directions; an electronic shutter control means adapted to apply sequential exposure control to said two solid-state imaging devices within a time corresponding to a <b>1</b>/<b>2</b> frame for each one frame and at a non-overlapping interval; and a light-emitting sync signal output means adapted to produce a light-emitting sync signal in sync with the sequential exposure control by said electronic shutter control means, and
0009an illumination unit adapted to receive said light-emitting sync signal from said color camera to emit light of multiple colors having different wavelength ranges in sync with exposure control of said solid-state imaging devices and in a sequential switch mode.
0010(2) A field sequential color camera system as recited in (1) above, characterized in that said illumination unit is capable of emitting a plurality of visible light having different wavelength ranges and invisible light such as infrared or ultraviolet radiation in a sequential switch mode.
0011(3) A field sequential color camera system as recited in (2) above, characterized in that the visible light from said illumination unit corresponds to the red, green and blue three primary colors of a color TV.
0012(4) A field sequential color camera system as recited in any one of (1) to (3) above, characterized in that said electronic shutter control means applies sequential exposure to said two solid-state imaging devices at equal intervals within a one-frame period and at the same exposure time.
0013(5) A field sequential color camera system as recited in any one of (1) to (3) above, characterized in that said electronic shutter control means applies sequential exposure to said two solid-state imaging devices at equal intervals within a one-frame period and at any exposure time.
0014(6) A field sequential color camera system as recited in any one of (1) to (5) above, characterized in that said separation optical system constitutes a two-piece color separation prism having a dichroic film adapted to separate light into a blue-and-green wavelength range and a red-and-infrared wavelength range.
0015(7) A field sequential color camera system as recited in any one of (1) to (5) above, characterized in that said separation optical system constitutes a two-piece color separation prism having a dichroic film adapted to separate light into an ultraviolet-and-blue wavelength range and a red-and-green wavelength range.
0016(8) A field sequential color camera system as recited in any one of (1) to (5) above, characterized in that said separation optical system has a half-silvered mirror adapted to separate light at any value in two directions.
0017(9) A field sequential color camera system as recited in any one of (1) to (8) above, characterized in that said color camera comprises:
0018two frame memories adapted to simultaneously record a still image produced out of each of said two solid-state imaging device and a light-emitting sync signal from said electronic shutter control means;
0019a memory output switch means adapted to read the still image recorded in said frame memories repetitively a plurality of times so that said light-emitting sync signal is identified as a still image having an observable time length to produce it in a controlled way; and
0020an image synthesis means adapted to synthesize said multicolor still images having an observable time length into a color image which is in turn produced to an image output terminal.
0021(10) A field sequential color camera system as recited in (9) above, characterized in that said image synthesis means is adapted to produce said multicolor still images at the same timing while they are corrected for a time difference between the respective imaging timings.
0022(11) A field sequential color camera system as recited in (9) or (10) above, characterized in that said memory output switch means is adapted to read one of the still images recorded by said plurality of frame memories repetitively a plurality of times or read it repetitively a plurality of times as an instantaneous still image having an observable time length in order of imaging to produce an output.
0023The field sequential color camera system of the invention of this application has such advantages as described below.
00241. According to the invention of claim <b>1</b>, the field sequential color camera system is comprised of an electronic shutter control means adapted to apply sequential exposure control to said two solid-state imaging devices within a time corresponding to a ½ frame for each one frame and at a non-overlapping interval, a light-emitting sync signal output means adapted to produce a light-emitting sync signal in sync with the sequential exposure control by said electronic shutter control means, and an illumination unit adapted to receive said light-emitting sync signal to emit light of multiple colors having different wavelength ranges in sync with exposure control of said solid-state imaging devices and in a sequential switch mode. Consequently, the image of a subject illuminated by, for instance, four-color light is captured as a two-color image within a one-frame period, and a four-color image within a two-frame period in sync with the light emitted by said illumination unit and having different wavelength ranges; that is, there can be a less costly double-speed, field sequential color camera system set up that operates twice as fast as a prior art one, and relies upon monochromic solid-state imaging devices to take images at high resolution.
0025Also, color image signals for an instantaneous still image corresponding to the colors of the subject are obtained at only two frames that run twice as fast as a conventional field sequential color camera: it is possible to achieve fast operation of systems for implementing measurement and sorting depending on the colors of a subject as well as imaging systems.
0026Further, field sequential images are obtained via the monochromic solid-state imaging devices in sync with the colors of light out of the illumination unit capable of emitting multicolor light having different wavelength ranges in a sequential switch mode; it is possible to set up a small-format, double-speed field sequential color camera system that, without recourse to any color filter and its rotation drive mechanism, can produce color images of high reliability and high quality.
0027Yet further, if a light emitting strobe or diode is used as the illumination unit for sequential light emission, anything else is not needed for illumination. Especially if the light emitting diode is used, it is then possible to set up a double-speed field sequential color camera system that has an improved flexibility in the configuration and location of the illumination unit, is of compact size, and can produce color images of high reliability and high quality.
0028At the same time, the aforesaid illumination unit operates such that upon receipt of the emitting sync signal from the aforesaid electronic shutter control means of the inventive field sequential color camera, the light-emitting strobe or diode can be put under on-and-off control in sync with an exposure time within a few μs to ½ frame of the aforesaid solid-state imaging devices for illumination; it is possible to efficiently let in an optical image within the full exposure time of the aforesaid solid-state imaging devices.
0029Especially upon the short-time emission and exposure of a few μs, if two-color, short-time emission and exposure for B and R is implemented just before the completion of frame and short-time emission and exposure for G (except IR) is implemented just after the start of frame, it is then possible to produce the respective signals for B, R and G within a very short time although the vertical blanking interval is included in it: it is possible to measure three colors B, R and G for measuring signals very fast without waiting one frame.
00302. According to the invention as recited in claim <b>1</b>, there can be the advantage of claim <b>1</b> plus the following advantage obtained. That is, the illumination unit may receive the emitting sync signals from the color camera to emit a plurality of visible light having different wavelength ranges and invisible light such as infrared or ultraviolet radiation in sync with the exposure control of the solid-state imaging devices and in a sequential switch mode; for instance, the field sequential color camera system may be used as an imaging system for automatic printers for harnessing infrared light to detect and correct flaws or the like on photographic films, subjects or the like. It is thus possible to set up a less costly field sequential color camera system wherein a single field sequential color camera is used in place of two cameras: a color camera of the NTSC format or the like and an infrared light camera, and operate at least twice as fast as a prior art one.
0031Referring here to semiconductor device pattern inspectors tapping ultraviolet microscopes, they are likely to get complicated and bulky due largely to the fact that an NTSC or other format color camera and an ultraviolet camera are mounted on a lens barrel divided into two. If the inventive field sequential color camera is used in place of two such cameras, some size reductions are then achievable. It is thus possible to set up a less costly field sequential ultraviolet microscope color camera system.
00323. According to the invention recited in claim <b>3</b>, there can be the advantage of claim <b>2</b> plus the following advantage obtained. The visible light from the illumination unit corresponds to the three primary colors, red, green and blue of color televisions; so the colors of the subject can faithfully be taken as still images within a two-frame period.
00334. According to the invention recited in claim <b>4</b>, there can be the advantages of claims <b>1</b> to <b>3</b> plus the following advantage obtained. The electronic shutter control means implements exposure control such that the two CCDs are sequentially, continuously exposed to light within the one-frame period, at an equal interval and for the same exposure time. For instance, when the subject is at rest, it is then possible to obtain image signals by exposure control at an equal ½ frame time interval and at the maximum sensitivity in an exposure time in the time corresponding to the ½ frame. Alternatively, exposure control can be implemented for a very short time to obtain still images of a fast moving object or pick up an instantaneous timing of fast changing natural phenomena as still images at a certain interval, and obtain image signals at a level depending on the illuminance of the subject.
00345. According to the invention recited in claim <b>5</b>, there can be the advantages of claims <b>1</b> to <b>3</b> plus the following advantage obtained. The electronic shutter control means implements exposure control such that the two solid-state imaging devices are sequentially, continuously exposed to light at an equal interval within the one-frame period for any exposure time. For instance, with the channel needed for measurement or a blue component channel on which severer restrictions are imposed in terms of emission luminance, CCD sensitivity or the like, it is possible to extend exposure time and implement exposure control such that equivalent level signals are obtained even with other color component channels, thereby obtaining equivalent image signals having improved S/N with every channels.
00356. According to the invention recited in claim <b>6</b>, there can be the advantages of claims <b>1</b> to <b>5</b> plus the following advantage obtained. With the field sequential color camera system, the separation optical system constitutes a two-piece color separation prism having a dichroic film adapted to separate light into a blue-and-green wavelength range and a red-and-infrared wavelength range so that the optical image of the subject incident from the lens can efficiently be directed to the solid-state imaging devices for each wavelength range. Besides, with the addition of infrared light to the emissions R, G and B, it is possible to use a single field sequential color camera to correct flaws on or in photographic films, observe the surface and interior of the skin of a human being, etc.
00367. According to the invention recited in claim <b>7</b>, there can be the advantages of claims <b>1</b> to <b>5</b> plus the following advantage obtained. With the field sequential ultraviolet microscope color camera system, the separation optical system constitutes a two-piece color separation prism having a dichroic film adapted to separate light into a ultraviolet-and-blue wavelength range and a red-and-green wavelength range so that the optical image of the subject incident from the lens can efficiently be directed to the solid-state imaging devices for each wavelength range. Besides, with the addition of infrared light to the emissions R, G and B, it is possible to use a single field sequential color camera to inspect semiconductor patterns or the like.
00378. According to the invention recited in claim <b>8</b>, there can be the advantages of claims <b>1</b> to <b>5</b> plus the following advantage obtained. The separation optical system uses a half-silvered mirror adapted to separate light at any value in two directions; so there can be a less costly optical system provided.
00389. According to the invention recited in claim <b>9</b>, there can be the advantages of claims <b>1</b> to <b>8</b> plus the following advantage obtained. The still image produced out of each of the two solid-state imaging devices are recorded in two frame memories together with data about color emissions; so it is possible to easily and precisely implement control of repeated reading by the memory output switch means of the still images recorded in the frame memories and control of synthesis by the image synthesis means of the still images into a multicolor image having an observable time length.
0039It is also possible to implement synthesis by the image synthesis means of still images into a color image having an observable time length, which is in turn produced to the synthesized image output terminal for faithful reproduction and observation of the subject image on a standard type color monitor.
004010. According to the invention recited in claim <b>10</b>, there can be the advantage of claim <b>10</b> plus the following advantage obtained. There is the image synthesis means provided wherein, when a moving or rotating subject is imaged, an imaging timing difference, resulting from sequential exposure control by the electronic shutter means of the two solid-state imaging devices at an exposure interval within a ½ frame in a one-frame period, is corrected by reading the multicolor still image out of the frame memories, if required, to produce an image output; so it is possible to easily and inexpensively set up a field sequential color camera system that may be used as a signal-entering field sequential color camera for measuring and sorting systems adapted to implement measurement, sorting or the like depending on the colors of the subject, and observation systems.
004111. According to the invention recited in claim <b>11</b>, there can be the advantages of claims <b>9</b> and <b>10</b> plus the following advantage. Any one of the still images recorded by said plurality of frame memories is read repetitively a plurality of times based on data about the color emissions to produce an image signal comprising a sequence of the same color signals to the image output terminal so that there can be a still image formed having an observable time length on an external video monitor or, alternatively, a full-color signal for measurement can be fed to an external measurement system in order of imaging.
BRIEF DESCRIPTION OF THE DRAWINGS
0042<figref idref="DRAWINGS">FIG. 1</figref> is illustrative in arrangement of an example of the inventive field sequential color camera system.
0043<figref idref="DRAWINGS">FIG. 2</figref> is representative of the operation of long-time emission and long-time exposure in the field sequential color camera system adapted to produce, within a one-frame period, two still images out of solid-state imaging devices according to an example of the invention.
0044<figref idref="DRAWINGS">FIG. 3</figref> is representative of the operation of short-time emission and short-time exposure in the field sequential color camera system adapted to produce, within a one-frame period, two still images out of solid-state image devices according to an example of the invention.
EXPLANATION OF THE REFERENCE NUMERALS
0000<ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0045"><b>1</b>: Field sequential color camera</li><li id="ul0001-0002" num="0046"><b>2</b>: Separation prism</li><li id="ul0001-0003" num="0047"><b>3</b><i>a</i>, <b>3</b><i>b</i>: CCD</li><li id="ul0001-0004" num="0048"><b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b</i>, <b>4</b><i>b</i>′: One-frame memory</li><li id="ul0001-0005" num="0049"><b>5</b>: Image synthesis means</li><li id="ul0001-0006" num="0050"><b>6</b>: Electronic shutter control means</li><li id="ul0001-0007" num="0051"><b>7</b>: Memory output switch means</li><li id="ul0001-0008" num="0052"><b>8</b>: Lens</li><li id="ul0001-0009" num="0053"><b>9</b><i>a</i>, <b>9</b><i>a</i>′, <b>9</b><i>b</i>, <b>9</b><i>b</i>′: Image output terminal</li><li id="ul0001-0010" num="0054"><b>10</b>: External trigger input terminal</li><li id="ul0001-0011" num="0055"><b>11</b>: Emitting sync signal output terminal</li><li id="ul0001-0012" num="0056"><b>15</b>: Recording/reproducing unit</li><li id="ul0001-0013" num="0057"><b>18</b>: Trigger generation means</li><li id="ul0001-0014" num="0058"><b>19</b>: Synthesized image output terminal</li><li id="ul0001-0015" num="0059"><b>20</b>: Illumination unit</li></ul>
BEST MODE FOR CARRYING OUT THE INVENTION
0060The embodiment of the invention is now explained with reference to examples shown in the drawings.
0061<figref idref="DRAWINGS">FIG. 1</figref> is illustrative in arrangement of an example of the inventive field sequential color camera system; <figref idref="DRAWINGS">FIG. 2</figref> is representative of the operation of long-time emission and long-time exposure in the field sequential color camera system adapted to produce, within a one-frame period, two still images out of solid-state image devices according to an example of the invention; and <figref idref="DRAWINGS">FIG. 3</figref> is representative of the operation of short-time emission and short-time exposure in the field sequential color camera system adapted to produce, within a one-frame period, two still images out of solid-state image devices according to an example of the invention.
0062Throughout <figref idref="DRAWINGS">FIGS. 1</figref>, <b>2</b> and <b>3</b>, the reference numerals are indicative of: <ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0063"><b>1</b>: Field sequential color camera</li><li id="ul0002-0002" num="0064"><b>2</b>: Separation prism</li><li id="ul0002-0003" num="0065"><b>3</b><i>a</i>, <b>3</b><i>b</i>: CCD</li><li id="ul0002-0004" num="0066"><b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b</i>, <b>4</b><i>b</i>′: One-frame memory</li><li id="ul0002-0005" num="0067"><b>5</b>: Image synthesis means</li><li id="ul0002-0006" num="0068"><b>6</b>: Electronic shutter control means</li><li id="ul0002-0007" num="0069"><b>7</b>: Memory output switch means</li><li id="ul0002-0008" num="0070"><b>8</b>: Lens</li><li id="ul0002-0009" num="0071"><b>9</b><i>a</i>, <b>9</b><i>a</i>′, <b>9</b><i>b</i>, <b>9</b><i>b</i>′: Image output terminal</li><li id="ul0002-0010" num="0072"><b>10</b>: External trigger input terminal</li><li id="ul0002-0011" num="0073"><b>11</b>: Emitting sync signal output terminal</li><li id="ul0002-0012" num="0074"><b>15</b>: Recording/reproducing unit</li><li id="ul0002-0013" num="0075"><b>18</b>: Trigger generation means</li><li id="ul0002-0014" num="0076"><b>19</b>: Synthesized image output terminal</li><li id="ul0002-0015" num="0077"><b>20</b>: Illumination unit.</li></ul>
EXAMPLES
0078<figref idref="DRAWINGS">FIG. 1</figref> is illustrative in arrangement of an example of the inventive field sequential color camera system.
0079Referring to <figref idref="DRAWINGS">FIG. 1</figref>, the field sequential color camera <b>1</b> is built up of a lens <b>8</b> adapted to let in an optical image from a subject; a separation prism <b>2</b> adapted to separate the subject's image incident from the lens <b>8</b> in two directions; two CCDs (solid-state imaging devices) <b>3</b><i>a </i>and <b>3</b><i>b </i>adapted to implement photoelectric trans-formation of the optical image separated in two directions; an electronic shutter control means <b>6</b> adapted to apply to said CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>sweep pulses SUB<b>1</b>, SUB<b>2</b> and transfer pulses SG<b>1</b>, SG<b>2</b> shown in <figref idref="DRAWINGS">FIG. 2</figref> to select and control either one of sweep of charges built up on the photoelectric planes of said CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>and transfer of them to a vertical transfer register, so that sequential exposure control is implemented in a time corresponding to a ½ frame and at a mutually non-overlapping interval within the same one-frame period; an emitting sync signal output means (not shown) adapted to produce an emitting sync signal in sync with the sequential exposure control of said electronic shutter control means <b>6</b>; four one-frame memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′ adapted to record one each still image within the one-frame period produced out of said CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>and one each still image of the next frame; a memory output switch means <b>7</b> adapted to read one each of the still images recorded in said four one-frame memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′ a plurality of times to convert it into an instantaneous still image having an observable time length or to switch said still images in order of imaging to produce an observable moving picture; image output terminals <b>9</b><i>a</i>, <b>9</b><i>a</i>′, <b>9</b><i>b </i>and <b>9</b><i>b</i>′ for image signals produced out of the memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′ controlled by said memory output switch means <b>7</b>; image synthesis means <b>5</b> and an synthesized image output terminal <b>19</b> adapted to synthesize image signals produced out of the memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′ to produce them as a color image, a trigger generation means <b>18</b> adapted to give a startup timing to said electronic shutter control means <b>6</b>; and an external trigger input terminal <b>10</b>.
0080The field sequential color camera system further comprises an illumination unit <b>20</b> having an illuminator adapted to receive an emitting sync signal produced out of the field sequential color camera <b>1</b> to emit multicolor light having different wavelengths in sync with the electronic shutter control of the field sequential color camera <b>1</b> in a sequential switch mode, and a combined recording and reproducing unit <b>15</b> that is a recording medium for image output signals of the field sequential color camera <b>1</b>.
0081With the field sequential color camera <b>1</b> here, the subject's optical image incident from the lens <b>8</b> is separated in two directions by a two-piece color separation prism <b>2</b> having a dichroic film adapted to separate light into a blue-and-green wavelength range and a red-and-infrared wavelength range, and formed on the photoelectric planes of the two CCDs <b>3</b><i>a </i>and <b>3</b><i>b</i>, respectively.
0082As described in conjunction with the prior art, the photoelectric plane of a CCD is always receiving light, and with the imaging of a fast changing subject, an image output is blurred due to an afterimage. For this reason, a CCD-loaded color camera has an electronic shutter function for obtaining clear-cut images. With the field sequential color camera <b>1</b> here, there is also a means used that harnesses that electronic shutter function to take two instantaneous still images for 1/60 second (or 1/30 second), which have usually been taken at a rate of one per 1/60 second (or 1/30 second).
0083This means for taking the two still images for 1/60 second is now explained with reference to <figref idref="DRAWINGS">FIG. 2</figref> illustrative of long-time emission and long-time exposure within a time corresponding to a ½ frame. As can be seen from <figref idref="DRAWINGS">FIG. 2</figref>, the charge sweep pulses SUB<b>1</b> and SUB<b>2</b> are normally added to the aforesaid CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>to sweep off the charges built up on photodiodes on the photoelectric planes. Then, at the time at which frame taking is implemented, an external trigger is entered in the trigger generation means <b>18</b> via the external trigger input terminal <b>10</b> of the field sequential color camera <b>1</b> to sequentially stop the application of the charge sweep pulses SUB<b>1</b> and SUB<b>2</b> to the CCDs <b>3</b><i>a </i>and <b>3</b><i>b</i>. First, within the period of frame <b>0</b> and in sync with the emission of B (blue) that is the first emission <b>1</b>, the first accumulation a-<b>1</b> of charges on the CCD <b>3</b><i>a </i>is implemented for any time within the ½ frame, after which the transfer pulse SG<b>1</b> is added to the CCD <b>3</b><i>a </i>to transfer the accumulation a-<b>1</b> of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is a-<b>1</b>B at an image signal <b>1</b>.
0084After the completion of the accumulation and transfer of charges on the CCD <b>3</b><i>a</i>, in sync with the emission of R (red) that is the second emission <b>2</b>, the first accumulation b-<b>1</b> of charges on the CCD <b>3</b><i>b </i>is implemented for any time within the ½ frame, after which the transfer pulse SG<b>2</b> is added to the CCD <b>3</b><i>b </i>to transfer the accumulation b-<b>1</b> of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is b-<b>1</b>R at an image signal <b>2</b>.
0085Consequently, within the one-frame period of the frame <b>1</b>, there are a-<b>1</b>B and b-<b>1</b>R generated at the image signals <b>1</b> and <b>2</b>, respectively, so that the respective still images are turned by an analog/digital trans-formation means (not shown) into digital signals, which are in turn recorded in the one-frame memories <b>4</b><i>a </i>and <b>4</b><i>b </i>(see <figref idref="DRAWINGS">FIG. 1</figref>) together with the emitting sync signals from the emitting sync signal output means within the electronic shutter control means <b>6</b>.
0086Subsequently, in sync with the emission of G (green) that is the third emission <b>3</b> within the period of a frame <b>2</b> in <figref idref="DRAWINGS">FIG. 2</figref>, the second accumulation a-<b>2</b> of charges on the CCD <b>3</b><i>a </i>is implemented for any time within the ½ frame, after which the transfer pulse SG<b>1</b> is added to the CCD <b>3</b><i>a </i>to transfer the accumulation a-<b>2</b> of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is a-<b>2</b>G at the image signal <b>1</b>.
0087After the completion of the accumulation and transfer of charges on the CCD <b>3</b><i>a</i>, in sync with the emission of IR (infrared or near infrared light) that is the fourth emission <b>4</b>, the second accumulation b-<b>2</b> of charges on the CCD <b>3</b><i>b </i>is implemented for any time within the ½ frame, after which the transfer pulse SG<b>2</b> is added to the CCD <b>3</b><i>b </i>to transfer the accumulation b-<b>2</b> of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is b-<b>2</b>IR at the image signal <b>2</b>.
0088Consequently, within the one-frame period of the frame <b>2</b>, there are a-<b>2</b>G and b-<b>21</b>R generated at the image signals <b>1</b> and <b>2</b>, respectively, as is the case with the frame <b>1</b>, so that the respective still images are turned by an analog/digital transformation means (not shown) into digital signals, which are in turn recorded in the one-frame memories <b>4</b><i>a</i>′ and <b>4</b><i>b</i>′ together with the emitting sync signals from the emitting sync signal output means within the electronic shutter control means <b>6</b>.
0089In the same way as described above, the emissions <b>1</b> to <b>4</b> are repeated and, at the same time, the accumulation, transfer and recording of charges are implemented in sync with the respective color emissions. If the memory output switch means <b>7</b> is controlled according to the emitting sync signal colors from the electronic shutter control means <b>6</b> to read still images from the frame memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′ a plurality of times, it is then possible to send them to the image output terminals <b>9</b><i>a</i>, <b>9</b><i>a</i>′, <b>9</b><i>b </i>and <b>9</b><i>b</i>′ as an image signal comprising a sequence of the same color signals so that they are turned into still images having a time length observable on an external monitor. Alternatively, it is possible to switch them in order of imaging: in order of B, G/R and IR to feed a full-color signal for measurement to an external measurement unit.
0090At the same time, the image synthesis means <b>5</b> works synthesizing three color signals in the NTSC or other mode corresponding to the R+G+B three primary colors for color televisions to send a sequence of color synthesized image signals to the synthesized image output terminal <b>19</b>.
0091Suppose here that the electronic shutter control means <b>6</b> implements exposure control such that the two CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>are sequentially, continuously exposed to light within the one-frame period, at an equal interval and for the same exposure time. For instance, when the subject is at rest, it is then possible to obtain image signals by exposure control at an equal ½ frame time interval and at the maximum sensitivity in an exposure time in the time corresponding to the ½ frame. Alternatively, exposure control can be implemented for a very short time to obtain still images of a fast moving object or pick up an instantaneous timing of fast changing natural phenomena as still images at a certain interval, and obtain image signals at a level depending on the illuminance of the subject.
0092The electronic shutter control means <b>6</b> implements exposure control such that the two solid-state imaging devices are sequentially, continuously exposed to light at an equal interval within the one-frame period for any exposure time. For instance, with the channel needed for measurement or a blue component channel on which severer restrictions are imposed in terms of emission luminance, CCD sensitivity or the like, it is possible to extend exposure time and implement exposure control such that equivalent level signals are obtained even with other color component channels, thereby obtaining equivalent image signals having improved S/N with every channel.
0093Although inferior in terms of the efficiency of use, it is understood that for the spectral prism <b>2</b>, there may be a half-silvered mirror that separate light equally or at any value in two directions.
0094To take images of a moving or rotating subject, the field sequential color camera system comprises the image synthesis means <b>5</b> adapted to read the multicolor still images recorded in the frame memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′, thereby correcting imaging timing differences resulting from the sequential exposure control by the electronic shutter control means <b>6</b> of the two CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>within the one-frame period and at an exposure interval of up to ½ frame.
0095Likewise, short-time emission and short-time exposure for taking two still images at one frame are now explained with reference to <figref idref="DRAWINGS">FIG. 3</figref>.
0096As can be seen from <figref idref="DRAWINGS">FIG. 3</figref>, the charge sweep pulses SUB<b>1</b> and SUB<b>2</b> are normally added to the aforesaid CCDs <b>3</b><i>a </i>and <b>3</b><i>b </i>to sweep off the charges built up on photodiodes on the photoelectric planes. Then, at the time at which frame taking is implemented, an external trigger is entered in the trigger generation means <b>18</b> via the external trigger input terminal <b>10</b> of the field sequential color camera <b>1</b> to sequentially stop the application of the charge sweep pulses SUB<b>1</b> and SUB<b>2</b> to the CCDs <b>3</b><i>a </i>and <b>3</b><i>b</i>. First, within the period of frame <b>0</b>′ in <figref idref="DRAWINGS">FIG. 3</figref> and in sync with the short-time emission of B (blue) that is the first emission <b>1</b>, the first short-time accumulation a-<b>1</b>′ of charges on the CCD <b>3</b><i>a </i>is implemented, after which the transfer pulse SG<b>1</b> is added to the CCD <b>3</b><i>a </i>to transfer the short-time accumulation a-<b>1</b>′ of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is a-<b>1</b>′B at an image signal <b>1</b>.
0097After the completion of the accumulation and transfer of charges on the CCD <b>3</b><i>a</i>, in sync with the short-time emission of R (red) that is the second emission <b>2</b>, the first short-time accumulation b-<b>1</b>′ of charges on the CCD <b>3</b><i>b </i>is implemented, after which the transfer pulse SG<b>2</b> is added to the CCD <b>3</b><i>b </i>to transfer the short-time accumulation b-<b>1</b>′ of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is b-<b>1</b>′R at an image signal <b>2</b>.
0098Consequently, within the one-frame period of the frame <b>1</b>′, there are a-<b>1</b>′B and b-<b>1</b>′R generated at the image signals <b>1</b> and <b>2</b>, respectively, so that the respective still images are turned by an analog/digital trans-formation means (not shown) into digital signals, which are in turn recorded in the one-frame memories <b>4</b><i>a </i>and <b>4</b><i>b </i>(see <figref idref="DRAWINGS">FIG. 1</figref>) together with the emitting sync signals from the emitting sync signal output means within the electronic shutter control means <b>6</b>.
0099Subsequently, in sync with the short-time emission of G (green) that is the third emission <b>3</b> within the period of a frame <b>2</b>′ in <figref idref="DRAWINGS">FIG. 3</figref>, the second short-time accumulation a-<b>2</b>′ of charges on the CCD <b>3</b><i>a </i>is implemented, after which the transfer pulse SG<b>1</b> is added to the CCD <b>3</b><i>a </i>to transfer the short-time accumulation a-<b>2</b>′ of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is a-<b>2</b>′G at the image signal <b>1</b>.
0100After the completion of the accumulation and transfer of charges on the CCD <b>3</b><i>a</i>, in sync with the short-time emission of IR (infrared or near infrared light) that is the fourth emission <b>4</b>, the second short-time accumulation b-<b>2</b>′ of charges on the CCD <b>3</b><i>b </i>is implemented, after which the transfer pulse SG<b>2</b> is added to the CCD <b>3</b><i>b </i>to transfer the short-time accumulation b-<b>2</b>′ of charges from the photodiodes on the photoelectric plane to the vertical transfer register, where there is b-<b>2</b>′IR at the image signal <b>2</b>.
0101Consequently, within the one-frame period of the frame <b>2</b>′, there are a-<b>2</b>′G and b-<b>2</b>′<b>1</b>R generated at the image signals <b>1</b> and <b>2</b>, respectively, as is the case with the frame <b>1</b>′, so that the respective still images are turned by an analog/digital transformation means (not shown) into digital signals, which are in turn recorded in the one-frame memories <b>4</b><i>a</i>′ and <b>4</b><i>b</i>′ together with the emitting sync signals from the emitting sync signal output means within the electronic shutter control means <b>6</b>.
0102In the same as described above, the emissions <b>1</b> to <b>4</b> are repeated and, at the same time, the accumulation, transfer and recording of charges are implemented in sync with the respective color emissions. If the memory output switch means <b>7</b> is controlled according to the emitting sync signal colors from the electronic shutter control means <b>6</b> to read still images from the frame memories <b>4</b><i>a</i>, <b>4</b><i>a</i>′, <b>4</b><i>b </i>and <b>4</b><i>b</i>′ a plurality of times, it is then possible to send them to the image output terminals <b>9</b><i>a</i>, <b>9</b><i>a</i>′, <b>9</b><i>b </i>and <b>9</b><i>b</i>′ as an image signal comprising a sequence of the same color signals so that they are turned into still images having a time length observable on an external monitor. Alternatively, it is possible to switch them in order of imaging: in order of B, G/R and IR to feed a full-color signal for measurement to an external measurement unit.
0103Especially upon the short-time emission and exposure of a few μs, if two-color, short-time emission and exposure for B and R is implemented just before the completion of the frame and short-time emission and exposure for G (except IR) is implemented just after the start of the frame, it is then possible to produce the respective signals for B, R and G within a very short time although the vertical blanking interval is included in it: it is possible to measure three colors B, R and G for measuring signals very fast without waiting one frame.
0104In the foregoing embodiments, while the two-piece color separation prism comprising a dichroic film adapted to separate light into a blue-and-green wavelength range and a red-and-infrared wavelength range is used as the light separation prism <b>2</b>, it is understood that use may be made of a two-piece color separation prism comprising a dichronic film adapted to separate light into an ultraviolet-and-blue wavelength range and a red-and-green wavelength range. In that case, the explanation of <figref idref="DRAWINGS">FIGS. 1</figref>, <b>2</b> and <b>3</b> may be read in order of G→UV (ultraviolet)→IR→G.
0105In the invention, there is the need of using the CCDs in combination with moiré-preventive quartz low-pass filters located before and after the separation prism <b>2</b>, a trimming filter adapted to cut off extra colors and improve on color reproducibility, the correlated double sampling circuit necessary for the signal amplification circuit of a CCD, a gamma correction circuit, etc.; however, known arts taking no part in the invention are not described or illustrated.
INDUSTRIAL APPLICABILITY
0106With the prior art field sequential color camera, one screen is obtained over four frames whereas, in the inventive field sequential color camera system, color image signals for an instantaneous still image depending on the colors of the subject are obtained at a speed double as fast and within a two-frame period. Especially with infrared or near infrared light added to color emissions R, G and B (red, green and blue), it is possible to correct flaws for photographic films, and observe the surface and interior of the skin of a human being. With ultraviolet light added, it is possible to inspect semiconductor patterns.
Contents8
5 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10560670B2 | Cited by | United States of America | Applicant |
| US2016065865A1 | Cited by | United States of America | Pre-grant |
| EP3308140A4 | Cited by | European Patent Office (EPO) | Search report |
| US9672678B2 | Cited by | United States of America | Applicant |
| WO2016205287A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| JP2001224015A | Cites | Japan | Applicant |
| US2007188650A1 | Cites | United States of America | Search report |
| US4584606A | Cites | United States of America | Search report |
| US4926247A | Cites | United States of America | Search report |
| US5014121A | Cites | United States of America | Search report |
| US5255087A | Cites | United States of America | Search report |
| US5760832A | Cites | United States of America | Search report |
| US6280378B1 | Cites | United States of America | Search report |
| US6422994B1 | Cites | United States of America | Search report |
| US7179222B2 | Cites | United States of America | Search report |
| US7319216B2 | Cites | United States of America | Search report |
| US7612822B2 | Cites | United States of America | Search report |
| US7722534B2 | Cites | United States of America | Search report |
| JPH02119006A | Cites | Japan | Applicant |
| JPH02182094A | Cites | Japan | Applicant |
| JPS63261966A | Cites | Japan | Applicant |
| US20070188650A1 | Cites | United States of America | Search report |
| JPS63261966 | Cites | Japan | Third party observation |
| JPH02119006 | Cites | Japan | Third party observation |
| JPH02182094 | Cites | Japan | Third party observation |
| JP2001224015 | Cites | Japan | Third party observation |
9 members in 5 offices
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 2006035017 | Japan | – | |
| 2006035017 | Japan | A | |
| 2007052793 | Japan | W |
Members9
| Document | Office | Kind | |
|---|---|---|---|
| JP2007215088A | Japan | A | |
| WO2007094438A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP1986442A1 | European Patent Office (EPO) | A1 | |
| US2009059046A1 | United States of America | A1 | |
| CN101385358A | China | A | |
| US7948551B2This record | United States of America | B2 | |
| EP1986442A4 | European Patent Office (EPO) | A4 | |
| JP4899149B2 | Japan | B2 | |
| CN101385358B | China | B |
33 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Payment of Maintenance Fee, 12th Yr, Small EntityM2553 | M2553 | |
| Payment of Maintenance Fee, 8th Yr, Small EntityM2552 | M2552 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Sent to Classification ContractorPGPC | PGPC | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Notice of DO/EO Acceptance MailedM903 | M903 | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Preliminary AmendmentA.PE | A.PE | |
| 371 Completion Date371COMP | 371COMP | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Initial Exam Team nnIEXX | IEXX |
5 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Maintenance fee paymentMAFP | MAFP | |
| Fee paymentFPAY | FPAY | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication
- 7948551
- Application
- 12223624
Titles
- English
- Field sequential color camera system
Patent term adjustment
- A delay
- +415 daysthe office missed an examination deadline
- Applicant delay
- −5 days
- Net adjustment
- 410 days
Classification
- CPC, 4
- H04N23/11
- H04N23/13
- H04N2209/048
- H04N23/74
- IPC, 6
- H04N9 07
- H04N5 225
- H04N23 12
- H04N23 11
- H04N23 13
- H04N23 16