Methods and systems for detecting flash rate of surrounding lights for controlling camcorder frame rate

0001The present invention relates in general to camcorders, and, in particular, to methods and systems for detecting flash rate of surrounding lights, such as fluorescent lights, to control the frame rate of the camcorder.

0002For the past two decades, camcorders, or video camera-recorders, have been a familiar sight throughout the world. They have been particularly in demand in the United States, Japan, Europe, and many other countries because they are inexpensive while extremely useful for numerous purposes. Camcorders and digital still cameras both take pictures using image sensors such as charge-coupled devices (CCD) or CMOS devices. To create a video signal, a camcorder image device must take many pictures every second, which the camera then combines to give the impression of movement. Analog camcorders contain two basic parts: (1) a camera section, consisting of an image sensor, lens and motors to handle the zoom, focus and aperture; and (2) a VCR section, which is a typical but small TV VCR. The function of the camera components is to receive visual information and transform it to electronic video signals.

0003Digital camcorders have the same elements, but have an additional component that takes the analog information the camera gathers and transforms it to digital data. Digital camcorders are so popular because their recorded information is not as prone to degradation, such as fading, as that of analog cameras. Video information in digital form can also be loaded onto computers, and easily edited, copied, and e-mailed.

0004The lens in a camcorder serves to focus light onto a small semiconductor image sensor. This sensor, such as a CCD, measures light with a small array of many tiny light-sensitive diodes, called photosites or pixels. Each photosite measures the amount of light that illuminates a particular point, and transforms this information into electrical charges. A brighter image is represented by a higher electrical charge, and a darker image is represented by a lower charge. An image sensor then creates a video picture by recording these light intensities.

0005Similarly, to create a color image, a camcorder has to detect the levels of each color of light. Since a full spectrum of colors can be created by combining the three colors red, green and blue, a camcorder only needs to measure the levels of these three colors to be able to reproduce full-color pictures. Some high-end camcorders use three separate chips to measure the intensity of these three basic colors while other less expensive camcorders get by with only one image sensor by fitting permanent color filters to individual photosites.

0006Camcorders in different parts of the world are designed in conformity with the local standards of pixel resolution, number of frames per second (fps), etc. The three most commonly used standards are NTSC, PAL, and SECAM. NTSC standard is used in North and South America, Japan, and 30 other countries. This standard requires 30-fps, 720 x 480 rectangular pixel resolution, and 575 scan lines. PAL format is used in Europe, Africa, the Middle East, Australia, China, and others and requires 25-fps, 720 x 576 rectangular pixel resolution, and 625 scan lines. Finally, SECAM format is used in France, the former Soviet Union countries, and others. It also requires 25-fps, 720 x 576 rectangular pixel resolution, and 625 scan lines.

0007It is important to note that in those countries in which a 50-Hz AC power system is used, the fps is 25 and in those with 60-Hz, the fps is 30. One main reason is the simplicity of design when the required number of aperture closures is an integer multiple or a factor of the power supply frequency. As a side benefit, it will synchronize the aperture closures with the surrounding pulsating lights, such as fluorescent lights. This synchronization makes the aperture opening coincide with the same light intensity of the pulsating light as in the previous openings.

0008On the other hand, if the aperture closures and the pulsating of the light are out of phase, the light intensity will vary at each aperture opening and will cause "flickering." This is the case when US-made camcorders operate in Japan under fluorescent lights, or vice versa. There is a need for a camcorder that can automatically detect the frequency of the surrounding pulsating lights and can adjust its frame rate accordingly.

0009Aspects of the present invention are set out in the attached claims.

BRIEF DESCRIPTION OF THE DRAWINGS

0010The foregoing aspects and many of the attendant advantages of the invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein: <ul id="ul0001" list-style="none" compact="compact"><li>Figure 1 is a schematic diagram of the result of a 25-fps camcorder operating under a fluorescent light with a 50-Hz AC power supply.</li><li>Figure 2 is a schematic diagram of the result of a 30-fps camcorder operating under a fluorescent light with a 50-Hz AC power supply.</li><li>Figure 3 is a schematic diagram of the light intensity of a fluorescent light with a 50-Hz AC power supply, sampled at the rates of 100 and 120 per second.</li><li>Figure 4 is a graph of the light intensity of a fluorescent light with a ω_<i>p</i> -Hz AC power supply, sampled at a rate of ω_<i>s</i> per second.</li><li>Figure 5 is a flow diagram of the power supply frequency determination method in accordance with an embodiment of the present invention.</li><li>Figure 6 is a schematic diagram of an exemplary system in accordance with an embodiment of the present invention.</li><li>Figure 7 depicts two exemplary implementations of the light sampling method in accordance with two different embodiments of the present invention.</li></ul>

DETAILED DESCRIPTION

0011Embodiments of the methods and systems for detecting the frequency of any pulsating light, such as fluorescent lights, for different purposes such as adjusting a camcorder's frame rate are described in detail herein. In the following description, some specific details, such as the frequencies of the AC power supplies, are presented to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.

0012Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

0013Figure 1 is a schematic diagram of the result of a 25-fps camcorder operating under a pulsating light, such as a fluorescent light, with a 50-Hz AC power supply. The 50-Hz sinusoidal power supply 100 generates a light intensity 102 proportional to the rectified AC voltage. As a result, there are two flash cycles per each power supply AC cycle, or the light frequency is twice the power supply frequency.

0014If the fps rate of a camcorder, operating under such a light, is a factor of the light frequency - in other words, if the light frequency is an integer multiple of the camcorder's fps - the light intensity will be the same at all openings, 106, of the aperture. This is because the openings, 106, of the aperture are similar to sampling the light intensity at regular intervals. Therefore, samples are taken of similar points, 104, on the light intensity curve - assuming slow movement of the camcorder and of the object. Under such conditions, the constant light intensity, in turn, will result in a normal playback, 108.

0015Figure 2 is a schematic diagram of the result of a 30-fps camcorder operating under a pulsating light, such as a fluorescent light, with a 50-Hz AC power supply. If the fps rate of a camcorder, operating under such a light, is not a factor of the light frequency - in other words, if the light frequency is not an integer multiple of the camcorder's fps - the light intensity will not be the same at all openings, 106, of the aperture. Again, considering the opening of the aperture to be similar to regular sampling of the light intensity, the samples are taken of different points, 104, of the light intensity curve - even assuming slow movement of the camcorder and of the object. This will result in a flickering playback, 108.

0016In one embodiment of the present invention, the camcorder is equipped with a light sensor that takes 120 samples of the light intensity per second. The light sensor may be, for example, a dedicated pixel formed on the image sensor. If this camcorder operates, for a single second, in a location with fluorescent lights and a 60-Hz AC power supply, it will collect 120 readings of the light intensity, 302, which are more or less the same, Figure 3. However, if the same camcorder operates in a location with fluorescent lights and a 50-Hz AC power supply, its readings of the light intensity will vary in time, 304. It will be shown in the following paragraphs that the sensor readings in the latter case belong to a rectified sinusoidal function of time with a lower frequency than that of the power supply.

0017If, by any of the several possible methods, the readings of the above sensor are determined to be time-varying, then it can be concluded that the AC power supply is not 60-Hz; or that it is 50-Hz if it is the only other possibility. But if the readings of this sensor are determined not to be time-varying, then it can be concluded that the AC power supply is 60-Hz. One of the many possible methods is to subtract each new reading from the previous one and observe whether most of the readings' absolute values are within a tight tolerance or are more than a specified number. If they remain within the tolerance, they are not varying with time, and if they are more than a specific number, they are time-varying. Another possible method is to compute and compare the slopes of the lines passing through adjacent pairs of the readings, with specific requirements for non-time-varying and time-varying slopes, etc.

0018Figure 4 is the graph of the light intensity of a fluorescent light with a ω_<i>p</i>-Hz AC power supply, sampled at a rate of ω_<i>s</i> per second. In this figure the rectified sinusoidal curve 102 represents the light intensity as a function of time. Light intensity can be written as:<maths id="math0001" num=""><math display="block"><mrow><mtext mathvariant="italic">I</mtext><mtext> = α |</mtext><mtext mathvariant="italic">Sin</mtext><msub><mrow><mtext>2πω</mtext></mrow><mrow><mtext mathvariant="italic">p</mtext></mrow></msub><mtext> (</mtext><mtext mathvariant="italic">t-</mtext><mtext>τ)|</mtext></mrow></math><img file="EP1599037A2_D0001.tif" /></maths> where <i>I</i> is the light intensity and ω_<i>p</i> is the AC power supply frequency, and α is the light intensity scale factor. If the sampling happens at the rate of ω_<i>s</i> per second (1/ω_<i>s</i> intervals), the sample readings of the light intensity will be:<maths id="math0002" num=""><img file="EP1599037A2_D0002.tif" /></maths><maths id="math0003" num=""><img file="EP1599037A2_D0003.tif" /></maths> Here, if ω_<i>s</i> is a factor of 2ω_<i>p</i>, then <i>I</i> is merely a constant equal to<maths id="math0004" num=""><img file="EP1599037A2_D0004.tif" /></maths><i>where c is a constant</i> But if ω_<i>s</i> is not a factor of 2ω_<i>p</i>, then <i>I</i> represents a digitized and rectified sinusoidal function of time with a frequency of <maths id="math0005" num=""><math display="inline"><mrow><mfrac><mrow><msub><mrow><mtext>ω</mtext></mrow><mrow><mtext mathvariant="italic">p</mtext></mrow></msub></mrow><mrow><msub><mrow><mtext>ω</mtext></mrow><mrow><mtext mathvariant="italic">s</mtext></mrow></msub></mrow></mfrac></mrow></math><img file="EP1599037A2_D0005.tif" /></maths>.

0019In another embodiment of the present invention the sampling light sensor samples at a rate of 100 per second. For pulsating lights with a 50-Hz power supply, the samples will be almost the same, but for pulsating lights with a 60-Hz power supply, the samples will be time-varying. The frequency of the digitized and rectified sinusoidal function representing these varying samples is ω_<i>s</i>/ω_<i>p</i>. With this sensor we can ascertain whether or not the power supply is 50-Hz. And if it is not, in most cases it would be 60-Hz.

0020In yet another embodiment, to determine the frequency of the power supply, the camcorder is equipped with two sensors, such as two pixels, one sampling at 120 samples per second and the other at 100 samples per second. Ideally these sensors should be situated close to each other. If the 120-sample sensor shows a nonvarying reading and the other does not, then the frequency of the power supply is 60-Hz, and if the 100-sample sensor shows a nonvarying reading and the other does not, then the frequency of the power supply is 50-Hz. If the samples of both sensors are time-varying or both are not time-varying, the system should not make a decision and should continue taking more samples.

0021In yet another embodiment of the invention, the average variations of the readings from both sensors are computed for n samples or for m seconds. The smaller average indicates a nonvarying reading and the larger average indicates a varying reading. In yet another embodiment these averages may be used only if they differ by a certain amount. In yet another embodiment these averages may be used only if the smaller one is less than a first amount and the larger one is more than a second amount, where the second amount is more than the first one. As mentioned above, many more methods are contemplated by the inventors to check whether or not the samples are time-varying. The above mentioned methods are merely some examples.

0022The above description of the embodiments of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize. For instance, while specific component values are provided herein, it is to be appreciated that these values are for the sake of illustration and explanation. Various embodiments of the invention may utilize values that are different from what is specified herein.

0023Figure 5 is a flow diagram of the power supply frequency determination method in accordance with an embodiment of the present invention. At step 501 the light is sampled by two different light sensing devices, one at a rate of 100 samples per second and the other at a rate of 120 samples per second. The values of these samples are passed to a processor at step 502, where it is determined whether either sample set is nonvarying.

0024At step 503 a decision is made based on the processor computations. At this step, if the readings of the light sensor with 100 samples per second are determined to be nonvarying and the readings of the other sensor to be varying, a signal is generated indicating that the power supply is at 50-Hz. This determination, at step 504, will be used to control the camcorder's aperture speed. At step 505 also a similar decision is made based on the processor computations. At this step, if the readings of the light sensor with 120 samples per second are determined to be nonvarying and the readings of the other sensor to be varying, a signal is generated indicating that the power supply is at 60-Hz. This determination, at step 506, will be used to control the camcorder's aperture speed. If at steps 503 and 505 the samples of the two sensors are determined to be both varying, then the power supply is not operating at 50 or 60-Hz. But if both readings are determined to be nonvarying, then there is no pulsating lights around.

0025Figure 6 is a schematic diagram of an exemplary system in accordance with an embodiment of the present invention. In this simple system, the light intensity measuring device 602 measures the intensity of the surrounding light of the camcorder. The sampling device 604 may be a part of the light sensing device or a separate functional module capable of sampling the continuous reading of the measuring device 602. The resulting light intensity samples will be processed by a processor 606 which may be as simple as a clocked logic circuit along with a memory element of 608. The processing of the sampled light intensity will determine the frequency at which the power supply operates.

0026Figure 7 depicts two exemplary implementations of the light sampling method in accordance with two different embodiments of the present invention. In Figure 7A, two light sensors 702 are mounted on the camcorder 701, near the lens, to sample the surrounding light at two different sampling rates. In Figure 7B, the two sensors 708 are a part of the pixel array 706 of the camcorder's image sensors 704, with the same function as the two sensors mounted on the camcorder in Figure 7A.

0027The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification and the claims. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.