Optical guidance systems and methods using mutually distinct signal-modifying sensors
20 claims: 2 independent, 18 dependent
- 1第2の物体に対する第1の物体の場所パラメータを決定するための誘導システムであって、前記誘導システムは、変調された光学放射を放出する前記第2の物体に位置する少なくとも1つの放出部を含む送信機と、少なくとも2つの相互に別々の信号修正電気光センサを含む前記第1の物体にある受信機であって、前記少なくとも2つの相互に別々の信号修正電気光センサの各々は、前記変調された光学放射の少なくとも一部を検出するように構成された検出器と、前記検出された変調された光学放射に応答して、復調された電気信号を生成する復調器と、前記検出された変調された光学放射に相互に別々の空間依存修正を加えるそれぞれの空間変動正弦波透過関数を有する信号修正光学要素とを有する、受信機と、プロセッサによって実行されたときに前記復調された電気信号から前記場所パラメータを決定するように前記プロセッサを制御する機械読み取り可能な命令を記憶しているメモリとを備える、誘導システム。
- 2前記第1の物体は、 移動 物体であり、前記第2の物体は、 非移動 物体である、請求項1に記載の誘導システム。
- 3前記第1の物体は、動力付き乗り物、航空機、および荷物配達ドローンのうちの1つである、請求項2に記載の誘導システム。
- 4前記第2の物体は、塔、車道の縁、および車道の中心線のうちの1つである、請求項2に記載の誘導システム。
- 5前記第1の物体は、 非移動 物体であり、前記第2の物体は、 移動 物体である、請求項1に記載の誘導システム。
- 6前記第2の物体は、動力付き乗り物、航空機、および荷物配達ドローンのうちの1つである、請求項5に記載の誘導システム。
- 7前記第1の物体は、塔、車道の縁、および車道の中心線のうちの1つである、請求項5に記載の誘導システム。
- 8前記第1の物体および前記第2の物体は、 移動 物体である、請求項1に記載の誘導システム。
- 9前記第1の物体は、動力付き乗り物および航空機のうちの1つであり、前記第2の物体は、動力付き乗り物および航空機のうちの1つである、請求項8に記載の誘導システム。
- 10前記第1の物体にある追加の受信機をさらに備え、前記受信機および前記追加の受信機は、前記受信機の視野および前記追加の受信機の追加の視野の各々を超える正味視野を有する、請求項1に記載の誘導システム。
- 11前記場所パラメータは、前記受信機に対する前記第1の物体の3次元の場所および3次元の向きを含む、請求項1に記載の誘導システム。
- 12前記場所パラメータは、前記受信機に対する前記第1の物体の速度を含む、請求項1に記載の誘導システム。
- 13前記場所パラメータは、前記受信機に対する前記第1の物体の進行方向を含む、請求項1に記載の誘導システム。
- 14前記場所パラメータは、前記受信機に対する前記第1の物体の向きを含む、請求項1に記載の誘導システム。
- 15前記受信機は、前記第1の物体に取り付けられている、請求項1に記載の誘導システム。
- 16前記送信機は、前記第2の物体に取り付けられている、請求項1に記載の誘導システム。
- 17非移動 物体に対する乗り物の場所パラメータを決定するための誘導システムであって、前記誘導システムは、前記乗り物および前記 非移動 物体のうちの一方に位置する送信機であって、前記送信機は、変調された光学放射の少なくとも1つの放出部を含む、送信機と、前記乗り物および前記 非移動 物体のうちの他方に位置する受信機であって、前記受信機は、少なくとも2つの相互に別々の信号修正電気光センサを含み、前記少なくとも2つの相互に別々の信号修正電気光センサの各々は、前記変調された光学放射の少なくとも一部を検出するように構成された検出器と、前記検出された変調された光学放射に応答して、復調された電気信号を生成する復調器と、前記検出された変調された光学放射に相互に別々の空間依存修正を加えるそれぞれの空間変動正弦波透過関数を有する信号修正光学要素とを有する、受信機と、プロセッサによって実行されたときに前記復調された電気信号から前記場所パラメータを決定するように前記プロセッサを制御する機械読み取り可能な命令を記憶しているメモリとを備え、前記誘導システムは、運転者支援システム、乗り物ナビゲーションシステム、および自律的乗り物ナビゲーションシステムのうちの1つの構成要素である、誘導システム。
- 18前記乗り物は、動力付き乗り物、航空機、および荷物配達ドローンのうちの1つである、請求項17に記載の誘導システム。
- 19前記場所パラメータは、前記受信機に対する前記乗り物の速度、方向、および向きのうちの少なくとも1つを含む、請求項17に記載の誘導システム。
- 20前記 非移動 物体は、塔、車道の縁、および車道の中心線のうちの1つである、請求項17に記載の誘導システム。
Independent claims20
182 paragraphs, as filed
There is growing interest in the commercial use of unmanned aerial vehicles (UAVs) to deliver products to customers. In 2013, each of the well-known companies conducted demonstrations or experiments using UAVs for use as autonomous delivery vehicles. Other than that, it has been proposed to use UAVs to deliver medical supplies and other important commodities in developing countries that lack transportation infrastructure.
Commercial demonstrations of these UAVs rely on GPS navigation systems for guidance. The weakness of this technique is that GPS signals do not reach any delivery location. Such GPS "blind spots" are typically located near buildings in an urban environment where many deliveries can occur.
The lane departure warning system is one of the driver support features included in the new model vehicle. Conventional systems use visual-based positioning, which is inefficient and intermittently reliable. They use millions of image sensor pixels to capture images to extract lane locations, requiring computationally intensive image processing. These image-based systems rely on clear visibility of lane markings, for example, unobstructed by rain, ice, and fog.
In search of higher fuel efficiency and increased payload capacity, commercial airlines are investigating wing morphing, which involves dynamically deforming the shape of the wing of an aircraft in response to in-flight conditions. ing. Techniques for measuring wing deformation such as deflection and twist include post-processing of both planar and stereoscopic images. These systems are computationally inefficient and sensitive to environmental factors such as clouds and rain, which can blur images and thus result in inaccurate measurements. The system is also bulky when a high resolution camera is required, especially in stereoscopic imaging systems that require two cameras.
<p>In one embodiment, the guidance system determines the location parameters of the object, and the guidance system has at least one oscillating element located on the object and at least two mutually separate signal corrections to emit modulated optical radiation. An electro-optical sensor, each of which has a detector and a demodulator to generate a demodulated electrical signal in response to detection of at least a portion of modulated optical radiation, and demodulated electricity. Includes a processor for determining location parameters from the signal.</p><p>In certain embodiments, the guidance system has aberration-corrected imaging, from which a plurality of electro-optical sensors, each of which provides a plurality of modified images separately from each other, and a plurality of electro-optical sensors that share a field of view. Includes an image generator module for linearly and non-linearly processing the spatial frequency characteristics of the modified image and synthesizing aberration-corrected images for imaging systems.</p><p>The present invention further provides, for example,:</p><p>(Item 1) An induction system for determining a location parameter of an object, wherein the induction system is at least one oscillating element located on the object, and the at least one oscillating element emits modulated optical radiation. Emitting at least one oscillating element and at least two mutually separate signal-corrected lightning sensors, each of which responds to a detector and detection of at least a portion of the modulated optical radiation. A demodulator for producing the demodulated electrical signal, at least two mutually separate signal-corrected electro-optical sensors, and a processor for determining the location parameter from the demodulated electrical signal. It has a guidance system.</p><p>(Item 2) The at least one oscillating element comprises three transmitters emitting optical radiation modulated separately from each other, and the location parameters are the three-dimensional location of the object with respect to the electro-optical sensor and 3 The guidance system according to item 1, which is the orientation of the dimension.</p><p>(Item 3) The demodulator is associated with a corresponding one of the at least three electro-optical sensors, and each of the demodulated electrical signals is associated with an associated modulated optical emission, item. The guidance system described in 2.</p><p>(Item 4) The guidance system according to item 3, wherein the at least one transmitter is configured such that the modulated optical radiation is different from other electromagnetic radiation incident on the electric light sensor.</p><p>(Item 5) The guidance system according to item 1, wherein the at least one detector includes a single pixel photodetector for detecting the modulated optical radiation.</p><p>(Item 6) The guidance system according to item 1, wherein each demodulator further comprises a filter for rejecting higher frequency components of the demodulated electrical signal.</p><p>(Item 7) The guidance system according to item 1, wherein each demodulator acts to eliminate the effects of unwanted modulated or unmodulated signals.</p><p>(Item 8) The guidance system according to item 1, wherein the modulated optical radiation comprises a plurality of modulation frequencies for determining the object parameter with a plurality of accuracy of each.</p><p>(Item 9) The guidance system according to item 1, wherein the modulated optical radiation comprises a plurality of modulation frequencies for estimating a range through time processing and estimating an angle through separate signal correction sensors from each other.</p><p>(Item 10) The guidance system according to item 1, wherein the modulated optical radiation comprises a plurality of modulation frequencies in order to reject a signal due to reflection.</p><p>(Item 11) Each of the at least one oscillating element is a back reflector, the system further comprises a transmitter, which emits the modulated optical radiation to reflect off the electro-optical sensor. The guidance system according to item 1, which is transmitted to the back reflector.</p><p>(Item 12) The guidance system according to item 11, wherein the transmitter is configured such that the modulated optical radiation is different from other electromagnetic radiation incident on the electric light sensor.</p><p>(Item 13) The guidance system according to item 1, wherein the modulated optical radiation has a modulated frequency within the radio frequency range.</p><p>(Item 14) The guidance system according to item 1, wherein the modulated optical radiation has a modulation frequency greater than 300 GHz.</p><p>(Item 15) The guidance system according to item 1, wherein the electro-optical sensors are separate from each other by making different spatially dependent corrections to the incident optical radiation.</p><p>(Item 16) The guidance system according to item 15, wherein the phase plate with the spatial variation phase transmission function makes the interstitial spatially dependent corrections to the incident optical radiation.</p><p>(Item 17) A guidance system with aberration-corrected imaging, wherein the guidance system is a plurality of electric light sensors sharing a visual field, and the plurality of electric light sensors are each modified from a plurality of electric light sensors. It comprises a plurality of electro-optical sensors and an image generator module that provide the images separately from each other, and the image generator module processes the spatial frequency characteristics of the plurality of modified images linearly and non-linearly. , A guidance system that synthesizes aberration-corrected images for the imaging system.</p><p>(Item 18) The guidance system according to item 17, wherein the intervening medium between the object in the shared visual field and the plurality of electric light sensors produces an aberration corrected by the imaging system.</p><p>(Item 19) The guidance system according to item 17, wherein the plurality of electro-optical sensors are provided with a plurality of mutually separate signal-correcting optical elements for spatially correcting the phase of incident optical radiation. ..</p><p>(Item 20) The item 19 wherein each electric light sensor includes an image sensor and an image pickup objective lens for forming an image on the image sensor, and the image pickup objective lens includes the signal correction element. Guidance system.</p><p>(Item 21) The item 19 wherein each electric light sensor includes an image sensor and an image pickup objective lens for forming an image on the image sensor, and the signal correction element is separate from the image pickup objective lens. Guidance system.</p><p>(Item 22) The image generator module is a synthesis module, and the synthesis module synthesizes a complex spatial frequency domain representation in order to determine a composite modulation transfer function response and a composite phase response, and the complex spatial frequency. Each of the domain representations comprises a synthesis module and a conversion module, each of which is a complex spatial frequency domain representation of each one of the plurality of modified images, wherein the conversion module includes the composite modulation transfer function and said. The guidance system according to item 17, wherein the aberration-corrected image is generated by combining and converting a composite phase response.</p><p>(Item 23) The induction system according to item 22, wherein the synthesis module determines the complex modulation transfer function response from the magnitude of the root mean square of the plurality of complex spatial frequency domain representations.</p><p>(Item 24) The guidance system according to item 22, wherein the synthesis module determines the composite phase response from a weighted average of the phases of the plurality of complex spatial frequency domain representations.</p><p>(Item 25) The plurality of electro-optical sensors are provided with a plurality of mutually separate signal-correcting optical elements in order to spatially correct the phase of incident optical radiation, and the weights in the weighted averaging are the plurality. 24. The guidance system according to item 24, which is determined from the phase of the signal-correcting optics of.</p><p>26. The guidance system of item 22, wherein the conversion module further applies a normalization coefficient such that the complex modulation transfer function response best matches the reference modulation transfer function response.</p><p>(Item 27) The image generator module comprises a processor and a memory communicatively linked to the processor, which (a) performs a function of synthesizing when executed by the processor. 22. The induction according to item 22, comprising a non-volatile portion comprising a machine-readable synthetic instruction and (b) a machine-readable conversion instruction that, when executed by the processor, performs a coupling and conversion function. system.</p><p>28. The machine-readable synthesis instruction further comprises an instruction for determining the complex modulation transfer function response from the root mean square of the plurality of complex spatial frequency domain representations, according to item 27. Guidance system.</p><p>29. The guidance system of item 27, wherein the machine-readable synthesis instruction further comprises an instruction for determining the composite phase response from the weighted average of the phases of the complex spatial frequency domain representation.</p>
<figref num="1">FIG. 1 illustrates a drone delivery scenario in one embodiment that employs an optical guidance system with separate signal-corrected electro-optical sensors.</figref><figref num="2">figure<u style="Single">2</u>Illustrates an optical guidance system in an embodiment that provides a driver assistance system for improving driver safety by using separate signal correction sensors from each other.</figref><figref num="3">figure<u style="Single">3 shows, in one embodiment, a guidance system for measuring dynamic motion that employs separate signal-corrected electro-optical sensors for measuring the surface profile of an airplane wing.</u></figref><figref num="4">figure<u style="Single">4 describes, in one embodiment, a guidance system in which a positioning device employs mutually separate signal-correcting electro-optical sensors that move a point to be positioned to a reference object.</u></figref><figref num="5">figure<u style="Single">5 illustrates an optical guidance system in an embodiment that uses separate signal correction sensors and oscillating elements.</u></figref><figref num="6">figure<u style="Single">6 illustrates an optical guidance system in an embodiment that uses separate signal correction sensors and transmitters.</u></figref><figref num="7">figure<u style="Single">7 illustrates an optical guidance system in an embodiment that uses separate signal correction sensors, transmitters, and reflectors.</u></figref><figref num="8">figure<u style="Single">8 illustrates an optical guidance system in one embodiment that uses three mutually separate signal correction sensors and three oscillating elements.</u></figref><figref num="9">figure<u style="Single">9 is a flow diagram illustrating an optical guidance method of determining the location parameters of an object using mutually separate signal correction sensors in an embodiment.</u></figref><figref num="10">figure<u style="Single">10 is a flow chart illustrating a method for processing an oscillating element-specific demodulated signal and determining an object location parameter in an embodiment.</u></figref><figref num="11">figure<u style="Single">11 is a flow diagram illustrating, in an embodiment, an optical guidance method for determining a three-dimensional location and three-dimensional orientation of an object with respect to an array of signal-corrected electro-optical sensors that are separate from each other.</u></figref><figref num="12">figure<u style="Single">12 illustrates a sensor and corresponding oscillating element for an optical guidance system that employs mutually separate signal-corrected electro-optical sensors in certain embodiments.</u></figref><figref num="13">figure<u style="Single">13 is</u>Employing signal-correcting electro-optical sensors that are separate from each other in certain embodiments,<u style="Single">An optical guidance system for obtaining location parameters of an object in the presence of ambient noise is illustrated.</u></figref><figref num="14">figure<u style="Single">14 is FIG. 13 rendered as a system block diagram.</u></figref><figref num="15">figure<u style="Single">FIG. 15 illustrates an electro-optical sensor array used in an optical guidance system that employs mutually separate signal-corrected electro-optical sensors in certain embodiments.</u></figref><figref num="16">figure<u style="Single">16 is</u>In one embodiment,<u style="Single">Illustrated is an electro-optical sensor array used in an optical guidance system that employs mutually separate signal-corrected electro-optical sensors with pixel-level optical demodulation.</u></figref><figref num="17">figure<u style="Single">17 illustrates an embodiment of the use of an optical guidance system in an embodiment in which the emitted modulated optical radiation is frequency-modulated in stages and employs mutually separate signal-corrected lightning sensors.</u></figref><figref num="18">figure<u style="Single">18 illustrates an embodiment of a transmitter with an electro-optical sensor.</u></figref><figref num="19">figure<u style="Single">19 illustrates an embodiment of one sensor for a guidance system that employs different signal-corrected electro-optical sensors from each other in one embodiment.</u></figref><figref num="20">figure<u style="Single">20 is</u>In one embodiment,<u style="Single">An exemplary optical guidance system with separate signal correction sensors with a common field of view is illustrated.</u></figref><figref num="21">figure<u style="Single">21 shows an embodiment of a sensor array with a signal correction element as part of the imaging objective.</u></figref><figref num="22">figure<u style="Single">22 shows an embodiment of a sensor array with a signal correction element, which is an element different from the imaging objective.</u></figref><figref num="23">figure<u style="Single">23 illustrates an image generator module, including, in certain embodiments, a memory, a processor, and an interface.</u></figref><figref num="24">figure<u style="Single">24 illustrates an exemplary guidance method with aberration-corrected imaging in certain embodiments.</u></figref><figref num="25">figure<u style="Single">25 is an exemplary induction method with aberration-corrected imaging that employs a non-linear process for calculating a composite OTF magnitude response and a linear process for calculating a composite OTF phase response in certain embodiments. Is illustrated.</u></figref><figref num="26">Figure 26<u style="Single">Provides an exemplary guidance method with aberration-corrected imaging that employs, in certain embodiments, a non-linear process for calculating a composite OTF magnitude response and a linear process for calculating a composite OTF phase response. Illustrated.</u></figref><figref num="27">figure<u style="Single">27, in one embodiment, is a guidance system that employs separate signal-corrected electro-optical sensors that measure information about a remote object by orthogonally sampling the energy emitted or reflected from the remote object. Is illustrated.</u></figref><figref num="28">figure<u style="Single">28 describes, in one embodiment, three optical configurations for an electro-optical sensor used in an optical guidance system with separate signal correction sensors from each other.</u></figref><figref num="29">figure<u style="Single">29 describes, in certain embodiments, the degradation of spatial resolution of conventional imaging systems due to aberrations, which is quantified by the system's modulation transfer function (MTF).</u></figref><figref num="30">Figure 30 shows the loss of MTF power from a ray-based perspective.</figref><figref num="31">FIG. 31 shows, in one embodiment, a method of recovering lost MTF power in a guidance system that employs a complex system response (CSR) and signal-corrected electro-optical sensors that are separate from each other.</figref><figref num="32">FIG. 32 shows that, in one embodiment, CSR is formed based on the exit pupils of the sensors in a guidance system that employ separate signal-corrected electro-optical sensors from each other.</figref><figref num="33">FIG. 33 illustrates a block of construction of a CSR filter based on astigmatism components in an embodiment.</figref><figref num="34">FIG. 34 shows, in one embodiment, a set of building blocks for a CSR filter based on a cylindrical component.</figref><figref num="35">FIG. 35 shows a CSR filter constructed from a CSR building block in an embodiment.</figref><figref num="36">FIG. 36 shows an example of a single CSR filter from FIG. 35 for four angles and an astigmatism construction block for both sine and cosine from FIG. 33 in one embodiment.</figref><figref num="37">FIG. 37 illustrates the CSR filter associated with the cylindrical construction block from FIG. 34 in one embodiment.</figref><figref num="38">FIG. 38 illustrates a set of CSR filters, including astigmatism and defocus, in one embodiment.</figref><figref num="39">FIG. 39 shows, in one embodiment, a CSR filter related to a linear combination of defocus and amplitude from FIG. 38 for multiple angles and an astigmatism building block for both sine and cosine.</figref><figref num="40">FIG. 40 shows a CSR filter in one embodiment similar to FIG. 38, but with the cylindrical CSR building blocks of FIGS. 34 and 37.</figref><figref num="41">FIG. 41 shows an embodiment of an embodiment that records loss OTF due to stereophase aberration and then uses CSR filtering to recover.</figref><figref num="42">FIG. 42 shows a CSR 2910 and a CSR filter for the stereoscopic aberration medium of FIG. 41 in one embodiment.</figref><figref num="43">FIG. 43 shows an example of recovering a lost OTF in a guidance system in which the intervening aberration medium employs separate signal-correcting electro-optical sensors that are one wave of spherical aberration.</figref><figref num="44">FIG. 44 shows a CSR representing the aberration of FIG. 43 in an embodiment.</figref><figref num="45">FIG. 45 shows that the aberration recovers the lost OTF in the guidance system, which employs separate signal-corrected electro-optical sensors, which are 1.25 waves of coma.</figref><figref num="46">FIG. 46 shows the CSR related to the coma aberration of FIG. 45 in a certain embodiment.</figref><figref num="47">FIG. 47 illustrates an example of orthogonal CSR filtering showing aberrations in one embodiment where classical MTFs result in zeros, but orthogonally sampled systems do not.</figref><figref num="48">FIG. 48 shows the CSR for aberrations associated with FIG. 47.</figref><figref num="49">FIG. 49 shows, in one embodiment, a plurality of mutually separate openings, each with its own CSR building block, leading to an optical guidance system with separate signal correction sensors.</figref><figref num="50">FIG. 50 shows the linear processing component of FIG. 49 in one embodiment.</figref><figref num="51">FIG. 51 shows the non-linear processing component of FIG. 49 in one embodiment.</figref><figref num="52">FIG. 52 shows that, in one embodiment, an aberration-corrected image is formed from a 2D inverse Fourier transform of the size estimation product.</figref><figref num="53">FIG. 53 shows, in one embodiment, a ray trace through one channel of an optical / digital guidance system.</figref><figref num="54">FIG. 54 shows the spherical and aspherical components of the lens element shown in FIG. 53 in one embodiment.</figref><figref num="55">FIG. 55 shows the distortion of the lens system in FIG. 53.</figref><figref num="56">FIG. 56 shows the bandpass nature of the illumination used in the optical system of FIG. 53.</figref><figref num="57">FIG. 57 shows a 3lang = EN-US> × 1 channel of a guidance system that employs separate signal-correcting electro-optical sensors from each other.</figref><figref num="58">FIG. 58 shows a system and method for optimizing both object-side and receiver-side subsystem costs and complexity in one embodiment.</figref><figref num="59">FIG. 59 shows the unique object-side projection optics of FIG. 58 in an embodiment.</figref><figref num="60">FIG. 60 shows the optical configuration associated with FIG. 59 in a Zemax type format in an embodiment.</figref>
WO 2013103725A1 "Coded localization system, methods and apparatus", filed January 3, 2013, is incorporated herein by reference in its entirety.
The presence of GPS blind spots is a disadvantage of GPS-based UAVs and other systems, especially those used as autonomous delivery vehicles. For example, optical guidance systems and methods that can complement or replace GPS navigation to guide a UAV to its destination during the last few hundred meters of the journey are disclosed herein. The optical guidance systems and methods disclosed herein with separate signal correction sensors consist of an electro-optical sensor for the detection of optical radiation. Radio frequency signals are always present in dense areas originating from, for example, cellular networks or wireless internet. The optical systems and methods essentially avoid interference from ambient radio frequency signals, as they are not detected by electro-optical sensors. In the present disclosure, optical radiation is radiation having a carrier frequency within the optical range, ranging from ultraviolet, visible, and infrared frequencies. The radio frequency is a frequency in the range of about 3 kHz to about 300 GHz. The system also uses time modulation to reject interference at the carrier frequency of the electro-optical sensor.
As used herein, "separate" signal corrections are defined as, for example, corrections of the same or substantially the same signal incident on a sensor that are separate from each other so that they produce different corrected signals from each other. Refers to the signal correction that is. Further, in the present specification, the signal correction sensors that are separate from each other are sensors that have different signal corrections from each other. Mathematically, "separate from each other" can be understood as the degree of orthogonality of signal correction in either the spatial or time domain. As used herein, the terms "separate from each other" and "orthogonal" are used interchangeably.
FIG. 1 illustrates a drone delivery scenario 100 that employs an optical guidance system with mutually separate signal-corrected electro-optical sensors 122, described in more detail below. Drone 120 is tasked with delivering luggage 124 to structure 105. Drone 120 utilizes an optical guidance system to accomplish this task. The optical guidance system includes a mutually separate signal-correcting electro-optical sensor 122 mounted on the drone 120 and three oscillating elements 106 located in the delivery area. In the present disclosure, the oscillating element can be a transmitter that produces and emits optical radiation, or the oscillating element is a back reflector that reflects some of the optical radiation from a transmitter located somewhere. Can be. For example, in embodiments where the oscillating element is a back reflector, the transmitter may be located in the vicinity of an electro-optical sensor used to detect optical radiation. The electro-optical sensor 122 detects the optical radiation transmitted by the three oscillating elements 106. The electro-optical sensor 122 includes a plurality of sensors for modifying the detected signals separately from each other. Based on that, the guidance system determines the three positioning criteria provided by the oscillating element 106 and uses them to estimate the location and orientation of the ground surface of the delivery area with respect to the luggage delivery drone 120.
Scenario 100 includes another package delivery drone 130 operating within the same area as the package delivery drone 120. The parcel delivery drone 130 includes an oscillating element 132. The light sensor 122 of the parcel delivery drone 120 detects optical radiation from the oscillating element 132. The guidance system thereby provides the parcel delivery drone 120 with the location and orientation of the parcel delivery drone 130 for collision avoidance.
Scenario 100 further includes a structure 110 having a delivery area with an oscillating element 162. This delivery area is inactive because the structure 110 does not expect the cargo to be delivered and does not operate the oscillating element 162. The oscillating element 162 can be triggered, for example, by the homeowner or automatically, using a message from the package delivery tracking system. If multiple deliveries should be made to a nearby location, eg, the delivery area associated with oscillators 162 and 106, the optical radiation provided by oscillators 162 and 106 is of modulation, polarization, and wavelength. At least one will be different. In addition, the optical radiation from oscillators 106, 132, and 162 can be modulated, for example, at or higher frequencies of radio frequency, allowing distinction from other radiation. Other radiation, for example, sunlight from the sun 150, works within the area, but is not related to the baggage delivery drone 120, optical radiation from other oscillating elements, or from windows in buildings 105, 110, 115. The reflection of optical radiation from the oscillating element of. Optical radiation from oscillating element 106 and / or oscillating element 162 can be modulated to identify a particular structure address. The electro-optical sensor 122, separately from each other, demodulates the signal associated with the received optical emission and distinguishes between the different optical emission signals incident upon it.
figure<u style="Single">2</u>Illustrates an exemplary optical guidance system that uses separate signal correction sensors 224, 234, 264, 274, 278 in transport scenario 200 to improve driver safety. Traditional lane departure warning systems suffer from high bandwidth demands that increase system costs and reliance on unobstructed visibility of lane markings that impede functionality. The optical guidance system of Figure 2 is insensitive to common lane marking obstructions such as fog or rain.
System 200 runs along the edge of roadway 280 and at the centerline.<u style="Single">2</u>Along 15, oscillating elements such as active transmitters and passive reflectors<u style="Single">2</u>Includes 10. motorcycle<u style="Single">2</u>60 is approaching a hill and uses sensor 264 to accurately estimate the location of the shoulder. The motorcycle 260 also hosts the transmitter 262, which makes the motorcycle more visible to other vehicles with sensors. The transmitter 262 is configured to communicate, for example, with a sensor 224 on the vehicle 220 so that the vehicle 220 can estimate at least one of the location, direction, speed, and orientation of the motorcycle 260. Similarly, the vehicle 220 supports a transmitter 222 with which the motorcycle sensor 264 works, which estimates at least one of the vehicle 220's position, location, direction, speed, and orientation. Truck 205 is moving downhill towards vehicle 220 and motorcycle 260, but has no sensors to confirm the instrumented roadway and without further assistance through signs or other means. , Do not benefit from the infrastructure.
System 200 also includes a tower with transmitter 240, which is on a different plane than the plane of the roadway and provides global standards. These transmitters enhance the roadway transmitter in the event of a failure due to snow, mud, sand, debris, etc. on the roadway. The orientation from the tower system may not be as precise as the orientation from the roadway-based system. Under extreme obstacles, the tower provides at least a low-precision estimate of "where is the road?", While the roadway sensor provides high-precision information about "where is the edge of the lane?" Under good conditions. I will provide a. Surface conditions can also be estimated based on the performance of the roadway sensor, but the performance of the roadway sensor will deteriorate under extreme weather conditions based on visible wavelength scattering and obscuring effects.
To provide maintenance for the infrastructure and safety for passersby, the flight observer 230 communicates with the roadway oscillators, namely transmitters and passive backreflectors 210, transmitters 222 and 262, and transmitters 272. It is equipped with a sensor 234. The transmitter 272 may be located, for example, within the lighting bar 276 of the emergency vehicle 270 and may be modulated in a manner that identifies the vehicle as an emergency vehicle. The emergency vehicle 270 also has a sensor 274, which points towards the sky and communicates with the transmitter 232 on the flight watcher 230, allowing maintenance personnel to track each other's location and orientation. do. Sensors 234 and 278 also include sensors that communicate with transmitters 222, 210, 262, and 240 to assess road conditions and convey messages to active sign 252, eg, disclosed herein. It can alert you to the oncoming traffic of truck 205, which may not be there. Transmitters and sensors are modulated to eliminate ambient effects of reflections from the sun 250 and roadway 280 and other vehicles 220.
In one embodiment, sensors 264, 224, and 278 house the active transmitter, which provides modulated lighting directed to the passive backreflector section 210 along the roadway 280 and centerline 215. do. In another embodiment, sensors 264, 224, and 278 provide modulated lighting directed to passive backreflector parts of the vehicle, such as front, side, and rear reflectors, license plates, and safety tape or markers. Has an active transmitter.
In another embodiment, sensors 264, 224, and 278 also produce aberration-corrected images of lane markings that are obscured by objects in their respective fields of view, such as rain or fog.
Conventional imaging systems for measuring aircraft wing deformation suffer from the same disadvantages as lane detection prior techniques: heavy computational processing and sensitivity to aberration media between the wing and the imaging system. Therefore, the present inventors have developed a dynamic motion measurement system that overcomes these problems.
figure<u style="Single">3 presents a guidance system for dynamic motion measurements that employs separate signal-correcting electro-optical sensors for measuring the surface profile of an airplane wing.</u>System 300 shows airplane 310, which uses sensors 318 to monitor transmitters 312, 314, and 316. In this embodiment, the transmitter 312 is distributed within a field or array to provide precision surface profile monitoring. Transmitter 314 is positioned on the wing surface and provides wing flexure, orientation, angle of attack, and translation measurements. The transmitter 316 is, for example, on a control surface and directly provides surface angle information. In one embodiment, transmitter 316 on the control surface is used as part of a feedback loop and can affect control mechanism 319. In another embodiment, the airplane 330 has a sensor 334 mounted away from the wing that communicates with an oscillating element 332 that can be a transmitter or backreflector, with respect to the sensor 334 during a Windsia event. It is configured to measure wing flexure 336. In another embodiment, the airplane 350 includes a sensor 354 that communicates with a back reflector 352 located on a rotating propeller blade. In this embodiment, the sensor 354 provides a modulated illumination signal that reflects from, for example, 352 and returns to 354. The sensor 356 also provides a modulated illumination signal that is different from the signal from the sensor 354 in at least one of modulation, polarization, and wavelength that reflects off the 352 and returns to the 356.
FIG. 4 illustrates a guidance system 400 with separate signal-correcting electro-optical sensors from each other. The positioning device 402 is moving a point 405 to be positioned on the tip of the reference object 406. The positioning device 402 and the reference object 406 include oscillator elements 404 and 408, i.e. transmitters or back reflectors, which are, for example, potential aberration media (medium between sensor array 410 and elements 404, 408). Detected by the sensor array 410 through. In this embodiment, the oscillator elements 404 and 408 are transmitters, such as LEDs, that transmit separate electromagnetic signals to be received by the sensor array 410. The potential aberration medium between the sensor array 410 and the elements 404, 408 acts to reduce the accuracy of the guidance system 400. It is, for example, a window or cover with an optical surface that is not flat or transparent to optical quality.
The sensor element within the sensor array 410 includes an imaging lens that maps the angle of the incident signal transmitted to a location on the sensor by the 404 and 408. One sensor constituting the sensor array 410 has a sinusoidal intensity response function 415 with a grayscale level continuous line over a 4 mm range. The width of the detector in the sensor array 410 is 4 mm. The second sensor has a higher frequency intensity response function 417 with a grayscale level continuous line, one cycle of which is about 1/100 of the cycle of IRF415. IRF417 is about 4mm wide. Therefore, in this example, IRF417 has 100 times more cycles than IRF415 over the same size detection area. The additional IRF (not shown) is clear, i.e. there is no grayscale attenuation. This clear channel is the reference channel. Comparison of the amplitude levels detected from IRF415 and IRF417 for clear channels allows estimation of both low and high resolution angles to the oscillator.
The IRF is an amplitude transmission function, eg, a position-dependent transparency function. In addition, one sensor can have an IRF, which does not have a position-dependent transmission function. This channel acts as a reference, or clear channel, when the intensity or range of transmission is unknown.
The fields of view of these sensors overlap and the angle of the object with respect to the sensors is determined by the positioning processor 412, which receives the intensity detected on each sensor array element. Since the sensor array elements include spatial variation IRFs, the intensity measured on each sensor element is at some position on the sensor (for sensor elements with IRF415) or some candidate positions (for sensor elements with IRF417). If) can be mapped to. Sensors with IRF415 provide a "path" estimated relative object angle for each intensity value to correspond to one position on the sensor element that is mapped to a relative angle value. The signal strength measured by the sensor element with the IRF417 provides higher accuracy (within its oscillation cycle). The relative angle can be decoded by comparison to the clear channel if the power transmitted is not known.
In the embodiment of this embodiment, which is one measurement embodiment, each of the sensor elements with IRF415 and IRF417 is 0.4 with respect to the incident signal intensities from the oscillating elements 404 and 406, using a single pixel sensor. Measure the intensity of (or measure a value of 0.4 for the clear channel if the incident signal intensity is unknown). In the sensor element with the IRF416, this means that the signal could be incident on the sensor at many positions corresponding to where the IRF417 is equal to 0.4. The positioning processor 412 selects from these positions according to a single position on the sensor with the IRF415 such that the incident signal would result in a measured relative intensity of 0.4. After calculating the relative position between the point 4450 and the reference 406, the positioning processor employs an iterative feedback algorithm and the positioning device 402 then issues an instruction to determine how to move the point 450. It is transmitted to the positioning device 402.
Plot 418 shows the signal-to-noise ratio (SNR) of the voltage detected by the sensor array 410 as a function of its distance to target point 406. The solid and dotted curves show the SNR with and without ambient light interference 430, respectively. By modulating the radiation from the oscillating element and demodulating the detected signal, the effect of unmodulated ambient light interference 430 on the SNR can be significantly reduced. Most of the effects of unmodulated ambient light interference 430 after detection and demodulation are shot noise.
Plot 420 shows the relative angular accuracy as a function of this distance with and without ambient light interference 430. Relative angular accuracy is normalized to the guidance system field of view in degrees. System 400 has a field of view of lang = EN-US> ± 20 degrees. Plot 420 employs this mutually separate signal-corrected electro-optical sensor, for example at a distance of 4.5 meters from the target point, and the relative accuracy of the guidance system is 1 in 10,000, even with strong interference signals. Show better.
In one embodiment of the guidance system 400, the aberration medium 432 is between the positioning device 402 and the point 405. In this embodiment, the sensor array 410 performs aberration-corrected imaging as described in FIGS. 31-57.
FIG. 5 illustrates an exemplary optical guidance system 500 that uses separate signal correction sensors 531 from each other. The optical guidance system 500 includes an oscillating element 511, a sensor array 530, and a processing module 540. The optical guidance system 500 can be implemented in scenarios 100 (FIG. 1), 200 (FIG. 2), 300 (FIG. 3), and / or 400 (FIG. 4). For example, the oscillating element 511 and the sensor array 530 may be implemented as the oscillating element 106 (FIG. 1) and the electro-optical sensor 122 (FIG. 1), respectively. In another embodiment, the oscillating element 511 and the sensor array 530 may be implemented as the oscillating element 210 (FIG. 2) and the electro-optical sensor 224 (FIG. 2), respectively.
The oscillating element 511 includes at least the oscillating element 511 (1), and may further include an arbitrary number of oscillating elements 511 (2) to 511 (N). Oscillator element 511 provides modulated optical radiation. The sensor array 530 includes a plurality of mutually separate electro-optical sensors 531. The sensor array 530 may further include one or more electro-optical sensors that are not separate from each other without departing from the scope of the invention. The sensor array 530 may include any number of sensors 531. In certain embodiments, the sensor array 530 includes at least three sensors 531. Each sensor 531 includes an optical detector 533 for detecting optical radiation and a demodulator 532 for demodulating the signal associated with the optical radiation and producing a demodulated electrical signal.
The demodulator 532 (i) is such that each of the sensors 531 (i) produces a demodulated electrical signal associated with an incident optical radiation of a different modulation frequency, including the optical radiation emitted by the oscillating element 511. , Separate from each other. Each demodulator 532 (1, 2, ..., N) has a different modulation frequency for any other one of the N demodulators 532 (1, 2, ..., N). Is used to demodulate the signal associated with the incident optical radiation. In one embodiment, each demodulator 532 demodulates the electrical signal produced by the corresponding optical detector 533. In another embodiment, each demodulator 532 demodulates the optical radiation propagating towards the corresponding optical detector 533.
In certain embodiments, the sensor 531 further includes signal-correcting optics 534 that are separate from each other, eg, those disclosed in WO2013103725A1, which are incorporated herein by reference as a whole. The signal-correcting optics 534 alter, for example, the phase, amplitude, or polarization of incident optical radiation. That is, each of the N signal-correcting optical elements 534 (1, 2, ..., N) is any other one of the N signal-correcting optical elements 534 (1, 2, ..., N). Modify the optical radiation incident on it, which is different for each. In certain embodiments, the signal-correcting optics 534 allow the sensor 531 to (a) demodulate the signal associated with the incident optics and (b), for example, change the phase, amplitude, or polarization of the incident optics. Work with demodulator 532 to give a combination. In this embodiment, the demodulated electrical signal produced by the demodulator 532 represents the modification given by both the demodulator 532 and the signal modification optical element 534.
The processing module 540 is communicably connected to the sensor 531 and processes the demodulated electrical signal received from it to determine one or more location parameters for the oscillating element 511. Illustrative location parameters include the distance from the oscillating element 511 to the sensor array 530, the orientation of the sensor array 530 with respect to the oscillating element 511, and the relative location and orientation of the sensor array 530 and the oscillating element 511.
In certain embodiments, the oscillating element 511 provides optical radiation having a modulation frequency above the radio frequency (RF) range. In another embodiment, the demodulator 532 is configured to demodulate with a signal that matches the modulation frequency of the optical radiation of particular interest. For example, the demodulation frequency and signal of the demodulator 532 are configured to match the respective modulation frequency and signal of the oscillating element 511.
In certain embodiments, each optical detector 533 is a single pixel photodetector, eg, a photodiode. In another embodiment, the embodiment optical detector 533 is implemented in a pixel array, with each of the optical detectors 533 corresponding to different pixels in the pixel array. The pixel array is, for example, a complementary metal oxide semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor.
The sensors 531 can be arranged in any spatial configuration within the sensor array 530. In one embodiment, the sensors 531 are arranged along a line. In another embodiment, the sensors 531 are arranged in a plane, but not all on the same line, and the sensor 531 defines a plane. In this embodiment, for example, the location parameter to be determined includes the three-dimensional orientation of the sensor array 530 with respect to one or more oscillating elements 511, or the location parameter to be determined is one with respect to the sensor array 530. It is useful when the above three-dimensional position of the oscillating element 511 is included.
In yet another embodiment, the sensors 531 are arranged in a spherical pattern, with a portion of the sensor acting on a portion of the field of view (FOV) of the entire system. The present embodiment allows a set of relatively simple, low-cost systems to collectively have a very wide field of view.
Optionally, the optical guidance system 500 is from the sun 150 (FIG. 1) and / or an additional oscillating element 570 (eg, ambient optical radiation 550 such as the oscillating element 162 (FIG. 1)) that the optical guidance system 500 does not pay attention to. Operates in the presence of light. In one embodiment, the demodulator 532 is configured to reject the signals associated with the ambient optical radiation 550 and the oscillating element 570. For example, the oscillating element 570 is configured to emit optical radiation with a modulation frequency different from that of the oscillating element 511. In another embodiment, the oscillating element 570 is a reflection associated with the oscillating elements 511 (1), 511 (2) and the like. In this case, the signal from the oscillating element 570 is rejected because its measured range or time phase is larger than the measured range (phase) of the oscillating elements 511 (1), 511 (2) and the like. To. Typical ambient optical radiation, such as sunlight or streetlights, is unmodulated and the associated signal is therefore rejected by demodulator 532.
In one embodiment, the processing module 540 is integrated with the sensor array 530. For example, the processing module 540 and the sensor array 530 may be located on the same circuit board. The processing module 540 may be integrated into one of the sensors 531 and then one of them acts as a master with the other sensor 531 that is a slave. In another embodiment, the processing module 540 is separate from the sensor array 530. For example, the processing module 540 and the sensor array 530 share an enclosure, or the processing module is located on a separate computer at a distance from the sensor array 530.
FIG. 6 illustrates an exemplary optical guidance system 600 that uses a transmitter and signal correction sensors that are separate from each other. The optical guidance system 600 is an embodiment of the optical guidance system 500 (FIG. 5). The optical guidance system 600 is the same as the optical guidance system 500 (FIG. 5), but the oscillating element 511 (FIG. 5) is replaced by the transmitter 611. Transmitter 611 produces and emits modulated optical radiation. The transmitter 611 is an embodiment of the oscillation element 511.
FIG. 7 illustrates an exemplary optical guidance system 700 that uses retroreflectors and separate signal correction sensors from each other. The optical guidance system 700 is an embodiment of the optical guidance system 500 (FIG. 5). The optical guidance system 700 is the same as the optical guidance system 500 (FIG. 5), but the optical guidance system 700 further includes a transmitter 710, and the oscillating element 511 (FIG. 5) is replaced by a back reflector 711. Be done. Transmitter 710 produces and emits modulated optical radiation. The back reflector 711 reflects at least a portion of the modulated optical radiation emitted by the transmitter 710 toward the sensor array 230. The back reflector 711 is an embodiment of the oscillating element 511. In certain embodiments, the transmitter 711 is located in close proximity to the sensor array 530. For example, transmitter 711 integrates with sensor array 530 to minimize the number of separate modules required to form the optical guidance system 700. The transmitter 710 can be steered intermittently, for example, through a MEMS-based mirror, towards retroreflectors 711 (1), 711 (2), and so on.
FIG. 8 illustrates an exemplary optical guidance system 800 that uses oscillating elements and separate signal correction sensors from each other. The optical guidance system 800 is an embodiment of the optical guidance system 500 of FIG. The optical guidance system 800 includes three oscillator elements 511 (1), 511 (2), and 511 (3) (FIG. 5), a sensor array 830, and a processing module 540 (FIG. 5). The sensor array 830 is an embodiment of the sensor array 530 (FIG. 5). The sensor array 830 includes three mutually separate signal-correcting electro-optical sensors 831 (1), 832 (2), and 832 (3). Each of the sensors 831 is an embodiment of the sensor 531 (FIG. 5). Each of the sensors 831 includes a detector 533 and a demodulator 832 for demodulating the electrical signal generated by the detector 533 in response to detection of optical radiation incident on the detector 533. In certain embodiments, the demodulator 832 includes a filter for rejecting higher frequency components such that the output of the demodulator 832 is a lower frequency signal. The demodulator 832 is an embodiment of the demodulator 532 (FIG. 5).
The sensor array 830 receives the modulated optical emissions 810 (1), 810 (2), and 810 (3) from the oscillating elements 511 (1), 511 (2), and 511 (3), respectively. Each of the modulated optical radiations 810 (i) can be incident on one, two, or all of the detectors 533 (i). Modulated optical radiation 810 (1), 810 (2), and 810 (3) have different modulation frequencies from each other. In response to the incident optical radiation, each detector 533 (i) produces an electrical detector signal 820 (i) that is communicated to the corresponding demodulator 832 (i). Each demodulator 832 (i) produces a demodulated electrical signal 835 (i). In the demodulators 832 (1), 832 (2), and 832 (3), the demodulation frequency of the demodulator 832 (i) is the modulation frequency of the modulated optical radiation 810 (i) emitted by the oscillating element 511 (i). Is matched to the oscillating elements 511 (1), 511 (2), and 511 (3), respectively, so that they are identical to. As a result, the demodulator 832 (i) will generate the demodulated electrical signal 835 (i) in response to the detection of the modulated optical emission 810 (i). The demodulated electrical signal 835 (i) is the modulation phase covered by the modulated optical emission 810 (i) as the modulated optical emission 810 (i) travels from the oscillating element 511 (i) to the detector 533 (i). Represents a shift. Filter 834 (i) ensures that the signal associated with the other oscillating element 511 (j) (i is different from j) is rejected and therefore does not contribute to the demodulated electrical signal 835 (i). To.
The processing module 540 processes the demodulated electrical signal 835, and from the relative amplitude and phase of the demodulated electrical signal, the distance between each oscillating element 511 (i) and the corresponding detector 533 (i) and Calculate relative location. In one embodiment, the oscillator elements 511 are arranged in a non-linear configuration and the sensor 831 is also arranged in a non-linear configuration. In this embodiment, the processing module 540 can determine the three-dimensional location and three-dimensional orientation of the oscillating element 511 with respect to the sensor array 830 by triangulation.
FIG. 9 is a flow diagram illustrating an exemplary optical guidance method 900, which uses signal correction sensors that are separate from each other to determine the location parameters of an object. The optical guidance method 900 can be performed by an optical guidance system 500 (FIG. 5), 600 (FIG. 6), 700 (FIG. 7), or 800 (FIG. 8). Optical guidance method 900 includes steps 920 to be performed on each of at least one oscillating element located on the object and steps 930 and 940 to be performed on each of a plurality of mutually separate signal-correcting electro-optical sensors. And process step 950. The optical guidance method 900 is used, for example, in scenario 100 (FIG. 1) for determining the location parameter of the oscillating element 106 with respect to the electro-optical sensor 122 mounted on the parcel delivery drone 120.
At step 920, modulated optical radiation is emitted by the oscillating element. The modulation frequency is specific to a particular oscillator. For example, the oscillating element 511 (i) (FIGS. 5 and 8) emits modulated optical radiation 810 (i) (FIG. 8).
In step 930, the modulated optical radiation generated in step 920 is detected by a detector associated with one of a plurality of mutually separate signal-correcting lightning sensors. For example, detector 533 (i) (FIGS. 5 and 8) detects modulated optical emission 810 (i) (FIG. 8). In step 940, the detector signal generated in response to detection in step 930 is a demodulated signal having the same frequency as the modulated optical radiation emitted by a particular one of at least one oscillator in step 920. Is demodulated using. This produces a demodulated electrical signal that is specific to at least one of the oscillating elements in step 920. For example, the demodulator 832 (i) (FIG. 8) demodulates the electric detector signal 820 (i) (FIG. 8) to generate the demodulated electrical signal 835 (i) (FIG. 8).
In step 950, all of the demodulated electrical signals specific to a particular one of at least one oscillating element are processed to determine location parameters for the object. For example, the processing module 540 (FIGS. 5 and 8) processes the demodulated electrical signals 835 (1), 835 (2), and 835 (3) and corresponds to each oscillator 511 (i) in the detector 833. Determine the distance to (i) or determine the 3D location and 3D orientation of the oscillator element 511 (FIGS. 5 and 8) with respect to the sensor array 830 (FIG. 8).
FIG. 10 is a flow diagram illustrating an exemplary method 1000 for performing step 950 of method 900 (FIG. 9). Steps 1010, 1020, and 1030 of Method 1000 are performed for each of the demodulated electrical signals generated in Step 940 of Method 900 (FIG. 9). In step 1040, the demodulated electrical signal is sent to the processing module. For example, the demodulator 832 (i) of system 800 (FIG. 8) processes the demodulated electrical signal 835 (i) (FIG. 8) specific to the oscillator element 511 (i) (FIGS. 5 and 8) in module 540 (FIG. 8). Send to 5 and 8).
In step 1020, the processing module determines the amplitude and phase shift suffered by the modulated optical radiation as it propagates from the oscillating element to its associated sensor. Amplitude will generally be a function of the angle with respect to the oscillating object, relative to the orientation of the electro-optical sensor, while phase will be a function of the range with respect to the oscillating object. For example, the processing module 540 (FIGS. 5 and 8) processes the demodulated electrical signal 835 (i) received from the demodulators 832 (i) (FIG. 8), and the modulated optical emission 810 (i) is the oscillating element. Amplitude incurred by modulated optical emission 810 (i) as it travels from 511 (i) (FIGS. 5 and 8) to detector 532 (i) (FIGS. 5 and 8) or sensors 831 (i) (FIG. 8). And determine the phase shift. In step 1030, the processing module processes the amplitude and phase shift generated in step 1020 to determine the distance between the oscillating element and the sensor associated with the demodulated electrical signal. For example, the processing module 540 (FIGS. 5 and 8) processes the amplitude and phase shift associated with the demodulated electrical signal 835 (i) (FIG. 8) and the oscillator element 511 (i) (FIGS. 5 and 8). To determine the distance from the detector 532 (i) (Figs. 5 and 8) or the sensor 831 (i) (Fig. 8).
The resolution of distance determination is a function of modulation frequency. At a modulation frequency of lang = EN-US> ν = 20MHz, the wavelength λ of this signal is approximately lang = EN-US> λ = c / ν = 15m, where c is the speed of light. The general rule for distance estimation from coherent phase detection is approximately the distance resolution of lang = EN-US> λ / SNR, where SNR is the signal-to-noise ratio. For a modulation frequency of 20 MHz and an SNR of 1000, the range resolution is about 1.5 cm. A modulation frequency of 30 GHz leads to a 10-mm wavelength and a range resolution of about 10 microns at an SNR of 1000. This illustrates the advantage of using an optical carrier frequency for the radiation emitted by the oscillating element. By using the optical carrier frequency, the modulation frequency can be high. For example, the modulation frequency can be in the upper radio frequency range (above 30GHZ) or even beyond the radio frequency range, eg microwave or optical frequency. This allows distance determination at high resolution. It may also allow depth determination to avoid interference from optical radiation emitted by the oscillating element and reflected from other surfaces before reaching the guidance system, with sufficient resolution. Using Method 1000, the optical induction system disclosed herein can achieve an SNR of about thousands to tens of thousands, such as modulated optical radiation from sunlight or other oscillating elements. It can also be achieved in the presence of strong interference from other sources.
In step 1040, the distance determined in step 1030 is processed to determine the object location parameters. For example, the processing module 540 (FIGS. 5 and 8) processes the distance between the oscillator elements 511 (i) (FIGS. 5 and 8) and their respective sensors 831 (i) (FIG. 8), and the sensor array 830 (FIGS. 5 and 8). Determine the three-dimensional location and three-dimensional orientation of the oscillating element 511 (FIGS. 5 and 8) with respect to FIG. 8). In certain embodiments, step 1040 includes correcting the distance between the oscillating element and an object or a particular point within the object. In another embodiment, step 1040 utilizes triangulation to determine location parameters.
FIG. 11 is a flow diagram illustrating an exemplary optical guidance method 1100 for determining a three-dimensional location and three-dimensional orientation of an object with respect to an array of signal-corrected electro-optical sensors that are separate from each other. Method 1100 is an embodiment of Method 900 (FIG. 9) that uses Method 1000 (FIG. 10) tuned for use with the Optical Guidance System 800 (FIG. 8). The object comprises three oscillating elements of FIG. 8, for example, oscillating elements 511 (1), 511 (2), and 511 (3), arranged in a non-linear configuration. The sensor array includes three sensors of the sensor array 830, for example, sensors 831 (1), 831 (2), and 831 (3). The sensor array can be arranged as discussed in connection with Guidance System 400 (Figure 4) with three different amplitude diagonal responses. FIG. 12 illustrates a scenario 1200 representing this.
In step 1110, method 1100 performs step 910 of method 900 (FIG. 9) for each of the three oscillating elements located on the object. In step 1120, method 1100 performs steps 930 and 940 of method 900 (FIG. 9) for each of the three electro-optical sensors contained within the sensor array. In step 1130, method 1100 applies to steps 1010, 1020, and of method 1000 (FIG. 10) for each of the three demodulated electrical signals generated by each one of the three electro-optical sensors. Do 1030. In step 1140, method 1100 processes the three distances determined in step 1130 to determine the 3D location and 3D orientation with respect to the sensor array.
figure<u style="Single">12</u>Indicates a sensor 831 and a corresponding oscillating element 511 for an exemplary optical guidance system that employs separate signal-correcting electro-optical sensors from each other. In one embodiment, the sensors 831 are arranged on the same line. In another embodiment, the sensors 831 are not aligned on the same line.
figure<u style="Single">13</u>And FIG. 14 illustrates exemplary optical guidance systems 1300, 1400, respectively, which obtain the location parameters of an object in the presence of ambient noise and employ separate signal-correcting electro-optical sensors. The optical guidance system 1300 or 1400 is, for example, an embodiment of the optical guidance system 500 (FIG. 5). The optical guidance system 1300 includes an oscillating element 511 (FIG. 5) and a sensor array 1330. The oscillating element 511 includes specific oscillating elements 511 (1) and 511 (2). Oscillating element 1311 (0) represents a reflection from oscillating element 511 (1) and is therefore in an apparent range farther from 511 (1). The sensor array 1330 includes a plurality of mutually separate signal-correcting electro-optical sensors 1331, which is an embodiment of the sensor 531 (FIG. 5). Each sensor 1331<u style="Single">(i)</u>Is a detector 533 for detecting the modulated optical radiation emitted by the oscillator element 511.<u style="Single">(i)</u>(FIG. 5) and a demodulator 1332 for demodulating the electrical signal generated by detector 533 in response to incident modulation optical radiation. Optionally, each sensor 1331 (i) further includes a signal-correcting optical element 1334, which is an embodiment of the signal-correcting optical element 534 (FIG. 5). The demodulator 1332 is an embodiment of the demodulator 532 (FIG. 5). Each detector 533 (i) interacts with other detectors 533 (j) such that the amplitude of each demodulated signal is a function of the specific configuration of the optics and electronic devices of 533 (i). Separate.
Each demodulator 1332<u style="Single">(i)</u>Is the detector 533<u style="Single">(i)</u>Multiplier 1360 that is concatenated to communicate with<u style="Single">(i)</u>And the multiplier 1360<u style="Single">(i)</u>Filter 1370 that is concatenated to communicate with<u style="Single">(i)</u>And filter 1370<u style="Single">(i)</u>Analog-to-digital converter 1380 connected to communicate with<u style="Single">(i)</u>And include. Each multiplier 1360<u style="Single">(i)</u>In response to the modulated optical radiation incident on it, the corresponding detector 533<u style="Single">(i)</u>Multiplying the electrical signal produced by, the modulated electrical signal has the same modulation frequency as the modulation frequency of the modulated optical radiation emitted by the corresponding one of the oscillating elements 511. Multiplier 1360<u style="Single">(i)</u>The multiplied signal produced by the filter 1370 filters to remove high frequency components.<u style="Single">(i)</u>Filtered by. Filter 1370<u style="Single">(i)</u>Is thereby a multiplier 1360<u style="Single">(i)</u>Rejects signals originating from modulated optical radiation that have a modulation frequency that is different from the modulation frequency of the signal used by. Filter 1370<u style="Single">(i)</u>Is, for example, a bandpass filter or a low frequency pass filter. Therefore, the multiplier 1360<u style="Single">(i)</u>And filter 1370<u style="Single">(i)</u>Is the oscillating element 511<u style="Single">(i)</u>And the corresponding sensor 831 (i) in collaboration with the sensor 1331 as discussed in connection with FIG.<u style="Single">(i)</u>Is matched with a specific oscillating element, for example, oscillating element 511 (1). Analog / Digital Converter 1380<u style="Single">(i)</u>Filter 1370<u style="Single">(i)</u>Converts the analog output of. In one embodiment, this digital signal is filtered by 1370.<u style="Single">(i)</u>It is an amplitude estimation of the signal received from. In another embodiment, the analog / digital converter 1380<u style="Single">(i)</u>The digital signal produced by the corresponding oscillating element 511<u style="Single">(i)</u>From detector 533<u style="Single">(i)</u>Includes an estimate of the modulated phase shift suffered by the modulated optical radiation as it progresses to.
The different modulated signals 1360 (i) can be the same if the relative physical distance from the different electro-optical sensor 1331 (i) is small compared to the modulated wavelength. Each of the modulated signals 1360 (i) may have different phases if the distance between the electro-optical sensors 1331 (i) is large relative to the modulated wavelength. In this case, the different modulations 1360 (i) essentially form the beam.
The processing module 1340, which is an embodiment of the processing module 540 (FIG. 5), is communicatively coupled to the analog / digital converter 1380 and processes the digital signal received from it to oscillate element 511 or an object associated thereto. Determine one or more location parameters for.
In an exemplary use scenario, the optical guidance system 1300 operates in the presence of strong ambient optical radiation 1350, such as sunlight. Over a wide range of wavelengths, the powerful ambient optical radiation 1350 is an oscillating element.<u style="Single">511</u>Can significantly affect the measurement accuracy of. To reduce the negative effects of strong ambient lighting, the optical guidance system 1300 includes separate temporal signal corrections from each other and spatial signal corrections from each other. The time signal correction of the optical guidance system 1300 is provided by the demodulator 1360, which is matched to each of the oscillating elements 511. Spatial signal correction of the optical guidance system 1300 is provided by the signal correction optical element 1334. In this embodiment, the signal correction element 1334 may include spatial variation amplitude transmission functions that are separate from each other in order to improve the positioning ability. In one embodiment, both the spatial and temporal signal correction elements work together to reduce the size, weight, power, and cost of the optical guidance system 1300 while achieving the highest 3D positioning accuracy of the oscillating element 511. It is composed of.
Chart 1365 identifies the oscillating element 511 (1), etc. from the signal 1363 associated with the strong ambient optical emission 1350, and the shot noise 1364 associated with any desirable and undesirable signals sensed by the optical guidance system 1300. The separation of signals near the center frequency 1361 associated with the oscillating element 511 of is illustrated. The modulation scheme utilized by the optical guidance system 1300 can be amplitude modulation. The oscillating element 511 may emit modulated optical radiation that follows a biased sinusoidal pattern in time. Each oscillating element 511 radiates at different modulation frequencies. The demodulated signal 1360 of the time-processed electro-optical sensor 1332 is deliberately set to act as a matching filter for the radiation of one of the objects. The demodulated signal used by the multiplier 1360 is, for example, a sine wave near the center frequency 1361. Filter 1370 is, for example, a passband filter deliberately set to a center frequency 1361 with a bandwidth of 1362. By being unmodulated, most of the strong ambient illumination spectrum is at DCs away from the center frequency 1361. Other sources also exist outside the center frequency 1361 and bandwidth 1362 and may represent interfering signals similar to signal 1363. The effects of these interfering signals are significantly reduced through the modulation of the optical radiation emitted by the oscillating element 511 and the subsequent demodulation by the sensor 1332. The main effect of these interference signals is their addition to shot noise 1364. Shot noise 1364 sampled by the analog-to-digital converter 1380 in sensor 1331 can be minimized by minimizing bandwidth 1362.
Oscillating element<u style="Single">511(1)</u>The effect of oscillating element 1311 (0), which is an undesired reflection from, can be minimized by range discrimination. For example, the oscillating element<u style="Single">511</u>Frequency and<u style="Single">Demodulation signal 1360 Corresponding demodulation signal</u>Range estimation and range determination can be performed by changing. Range determination can be used to eliminate the effects of reflections, as reflections always appear to be in a larger apparent range. See Figure 17 and the accompanying text, which describes the distinction between direct-path and multi-path signals.
In one embodiment, the sensor array 1330 is configured as a set of isolated single pixels. In another embodiment, the sensor array 1330 is configured as an array of pixels, similar to, for example, a common CMOS pixel array found in mobile phone cameras and other imaging systems.
figure<u style="Single">15</u>Illustrates an exemplary electro-optical sensor array 1500 used in an optical guidance system that employs separate signal-corrected electro-optical sensors from each other. The sensor array 1500 is an embodiment of the sensor array 1330 of FIG. 13, and at least a portion of each of the pixels of the sensor array 1500 is the sensor 1331 of FIG. In this embodiment, the sensor 1331 is one component of a pixel-by-pixel parallel analog channel of the sensor array 1500. Modulation / demodulation of sensor 1331 is deliberately configured to comply with CMOS detector constraints, such as a limited area or number of transistors, to reduce costs. The demodulated signal used by the multiplier 1560 is, for example, a binary signal implemented using switching transistors. The phase of a binary switching signal can be varied to match the phase of the transmitted signal through phase locked loop (PLL), quadrature phase sampling, or something known. By demodulating with only two binary signal values, demodulation can be implemented using only a very small number of switching transistors per pixel. The filter 1570 can be implemented as part of the analog / digital converter 1380. The analog-to-digital converter 1580 can be shared between many pixels, such as rows or columns, or another set of multiple pixels, i.e., between many sensors 1331. In certain embodiments intended for high performance, each sensor 1331 has its own analog / digital converter 1580. This type of configuration can be easily implemented within a rear illumination image sensor (BSI) and additional metal layers can be designed for the multiplier 1560, filter 1570, and analog-to-digital converter 1580.
figure<u style="Single">16</u>Illustrates an exemplary electro-optical sensor array 1600 used in an optical guidance system that employs separate signal-corrected electro-optical sensors from each other. The electro-optical sensor array 1600 can be implemented as the sensor array 530 of the optical guidance system 500 (FIG. 5). Each of at least some of the pixels of the sensor array 1600 is an electro-optical sensor 1680. Sensor 1680 is an embodiment of sensor 531 (FIG. 5) configured for optical demodulation of incident modulation optical radiation. The sensor array 1600 is therefore useful in embodiments of the optical guidance system 500 (FIG. 5), where the modulation frequency of the modulated optical radiation emitted by the oscillating element 511 (FIG. 5) is within its optical or THz range. ..
The sensor 1680 includes an optical beam splitter 1687, an electrophotodetector 1681, and a demodulator 1690. The incident modulation THz emission 1685 interferes with the THz demodulated signal to produce the interference signal 1688. The interference signal 1688 has a lower frequency than the incident modulated THz emission 1685 and the THz demodulated signal 1686. The interference signal 1688 is sampled by the electro-optical sensor 1681 and further processed by the demodulator 1690. The demodulator 1690 can demodulate in the GHz and MHz range. In one embodiment, the plurality of demodulators 1690 in the sensor array 1600 share the same analog / digital converter. In another embodiment, each demodulator 1690 has its own analog / digital converter.
figure<u style="Single">17</u>Illustrates an example of the use of an optical guidance system 700 (Fig. 7) that employs separate signal-correcting electro-optical sensors from each other, and the modulated optical radiation emitted by transmitter 710 (Fig. 7) is gradual. Frequency modulated to. graph<u style="Single">17</u>20 shows a simulation of stepwise frequency modulation, where modulated optical radiation with a range of modulation frequency steps is emitted by transmitter 710 (Figure 7). The signal received from the back reflector 711 by the sensor 531 (FIGS. 5 and 7) is demodulated by mixing it with the transmitted signal of transmitter 710 (FIG. 7), and the angle of the demodulated signal is low pass filtering. And phase angle estimation<u style="Single">17</u>Bring 21.
Demodulation is a complex signal<u style="Single">exp (jlang = EN-US> ω (t) t + Φ)</u>Achieved by multiplying the signal received by, in the equation, lang = EN-US> ω<u style="Single">(t)</u>Is the transmission signal angular frequency, t is the time, and Φ is the transmission signal phase. Phase angle estimation<u style="Single">17</u>21 is the output of the low frequency pass filter. 1721Rx1 represents the phase demodulated from the desired signal from the oscillator. 1721Rx2 represents the undesired reflection of optical radiation from the same oscillating element. In one embodiment, phase angle estimation<u style="Single">17</u>21 is the average of the demodulated signals at each of the transmitted frequencies. Phase angle estimation<u style="Single">17</u>21 is Fourier transformed and multiplied by the speed of light to estimate the distance to the distance between the reflector 711 and the sensor 531.<u style="Single">17</u>Bring 23. 1723Rx1 represents the amplitude of the desired signal from the oscillating element, while 1723Rx2 represents the amplitude of the undesired reflection. The range determination process is used to select the signal with the closest range, thereby rejecting unwanted reflections. Signal processing in an embodiment of this use is also applied to the optical guidance systems 500 (FIG. 5), 600 (FIG. 6), and 800 (FIG. 8), and the optical guidance methods 900 (FIG. 9) and 1000 (FIG. 10). Can be applied.
figure<u style="Single">18</u>Is an exemplary transmitter<u style="Single">18</u>30, an embodiment of transmitter 611 (FIG. 6) or transmitter 710 (FIG. 7) with an electro-optical sensor 1740, and an embodiment of sensor 530 (FIG. 5) are illustrated.
Transmitter<u style="Single">18</u>30 is the register section<u style="Single">18</u>Bias section connected with 33<u style="Single">18</u>Signal generator section communicatively connected to 32<u style="Single">18</u>31 and light emitting diode (LED)<u style="Single">18</u>35 and the transistor<u style="Single">18</u>Including 34 and. LED1835 emits modulated optical radiation. Signal generator section<u style="Single">18</u>31 provides a zero average sine wave coupled to bias section 1832. Bias section<u style="Single">18</u>The output of 32 drives transistor 1834, which drives LED 1835. LED<u style="Single">18</u>35 power outputs, register section<u style="Single">18</u>Limited by the registers in 33, the operating voltage of the LEDs, and the conversion efficiency. Signal generator section<u style="Single">18</u>31 provides a modulated signal while the bias section<u style="Single">18</u>32 is LED<u style="Single">18</u>The voltage to 35 is always positive, thus ensuring that the LED radiates to every part of the signal.
Transmitter<u style="Single">18</u>If the modulation frequency of 30 is less than half of the analog / digital digitization frequency, the corresponding sensor is the sensor.<u style="Single">18</u>Can be 40. The sensor is a high pass filter (HPF) with a passband gain greater than 1.<u style="Single">18</u>An electric photodetector that is communicatively connected to the 42<u style="Single">18</u>Including 41. HPF<u style="Single">18</u>42 is a low pass filter (LPF) with a gain of about 1 in the pass band of the filter and a gain much less than 1 in the stop band.<u style="Single">18</u>Connected to communicate with 43. HPF<u style="Single">18</u>The 42 serves to provide gain for high frequencies in the passband while suppressing DC and low frequency interference. LPF<u style="Single">18</u>43 is an analog-to-digital converter (ADC) that digitizes pass-through filtered modulated signals for digital signal processing.<u style="Single">18</u>Connected to communicate with 44. Then the sensor<u style="Single">18</u>Demodulation within 40 is a software demodulation signal<u style="Single">18</u>45 and LPF<u style="Single">18</u>It is done using 46 and. LPF<u style="Single">18</u>Reference numeral 46 denotes a low frequency pass filter implemented in the software, for example, a moving average finite impulse response (FIR) filter.
figure<u style="Single">19</u>Is a sensor<u style="Single">19</u>An exemplary sensor of 40 embodiments<u style="Single">19</u>00 is illustrated. Photodetector element<u style="Single">19</u>52 includes a photodetector X12 S5106 coupled to gain register R9. Gain register R9 is I<sub>pd</sub>lang = EN-US> × R9 << V<sub>supply</sub>Selected to be, in the formula, I<sub>pd</sub>Is the photodetector current, V<sub>supply</sub>Is, for example, a figure<u style="Single">19</u>V3 and V6 in. The photodetector current is generated by at least one of low frequency coherent optical radiation (eg, ambient illumination) and modulated optical radiation. The register R9 serves to convert the total photodetector current due to modulation or ambient illumination to voltage, so the high ambient illumination coupled with the high resistance value R9 is probably high enough to saturate the circuit. Will generate. The low value for R9 allows a slight amplification of the raw photodetector current and allows the high gain to be applied after processing. High pass filter section<u style="Single">19</u>54 eliminates low frequency interference signals and provides gain at high frequencies, which is related to the ratio of register RF to R3. The low pass section 1856 reduces overall bandwidth and noise while providing approximately 1 gain within the passband. High pass filter section<u style="Single">19</u>54 and low pass filter section<u style="Single">19</u>The 56 combinations provide bandpass filter functionality. The filter shown is an active filter, but a passive RC filter can be employed in stages where gain greater than 1 is not required. The cutoff frequency is the filter section<u style="Single">19</u>54 and<u style="Single">19</u>High-pass filter section, determined by the RC combination in each of the 56<u style="Single">13</u>For 54, f<sub>c</sub>= 1 / (2lang = EN-US> π R4 C2), low frequency pass filter section<u style="Single">19</u>For 56, f<sub>c</sub>= 1 / (2lang = EN-US> π R8 C3). In certain embodiments, the modulated signal is digitized and demodulation of the digitized signal occurs within the software.
figure<u style="Single">20</u>Is an exemplary optical guidance system with separate signal correction sensors from each other.<u style="Single">20</u>00 is illustrated. Sensor array<u style="Single">20</u>10 is the common field of view (FOV)<u style="Single">20</u>N electro-optical sensors with 80<u style="Single">20</u>Including 11. Intervening medium<u style="Single">20</u>90 is FOV<u style="Single">20</u>It can exist between the object in 80 and the sensor array. Intervening medium<u style="Single">20</u>90 is FOV<u style="Single">20</u>Guidance system that introduces aberrations into the image of the object in 80<u style="Single">20</u>00 can correct this aberration.
Each electric light sensor<u style="Single">2011 (i)</u>Is a signal correction element<u style="Single">2014 (i)</u>including. Signal correction optics<u style="Single">2014</u>Are separate from each other. That is, N signal correction optics<u style="Single">20</u>Each of the 14 has N signal-correcting optics for the optical radiation incident on it.<u style="Single">20</u>Make different modifications to each of the 14. The signal-correcting optics can change the phase, amplitude, or polarization of incident optical radiation, for example, in a spatially dependent manner.
Signal correction optics<u style="Single">2011</u>Can also be present in an embodiment of a guidance system that uses sensors 531 (i) (FIG. 5) to add different time corrections to the signals. These systems include System 500 (FIG. 5), System 600 (FIG. 6), System 700 (FIG. 7), and System 1400 (FIG. 14).
Each electric light sensor<u style="Single">2011 (i)</u>Is also an image sensor<u style="Single">2016 (i)</u>including. In one embodiment, N image sensors<u style="Single">20</u>Each of the 16 is a separate image sensor module. In different embodiments, N image sensors<u style="Single">20</u>Each of the 16 is implemented as a region of pixels on the image sensor module and each<u style="Single">Electric light</u>Sensor<u style="Single">2011 (i)</u>Images for different regions of pixels on the image sensor module pixel array.
Image generator module<u style="Single">20</u>20 is an image sensor in response to optical radiation incident on the image sensor 2011<u style="Single">20</u>Receive the signal generated by 11. Image generator module<u style="Single">20</u>20 includes synthesis module 2030. The image generator module 2020 includes a linear processing module 2032 and a non-linear processing module 2034 to process the signals received from the sensor array 2010 linearly and non-linearly, respectively. Conversion module<u style="Single">20</u>The 40 is communicably linked to the composite module 2030 and is a composite module for determining aberration-corrected images or related parameters.<u style="Single">20</u>Convert the signal received from 30. For example, the conversion module 2040 may determine parameters for an object in FOV2080, such as its location or orientation.
figure<u style="Single">21</u>Is an exemplary sensor array of the sensor array 2010 (FIG. 20).<u style="Single">21</u>10 is illustrated. Sensor array<u style="Single">21</u>10 is N sensors<u style="Single">2111</u>Including each signal correction element<u style="Single">2112</u>Is incorporated into each imaging objective lens.
figure<u style="Single">22</u>Illustrates an exemplary sensor array 2210, which is an embodiment of the sensor array 2010 (FIG. 20). Sensor array<u style="Single">22</u>10 is N sensors<u style="Single">2211</u>Including each signal correction element<u style="Single">2211</u>Imaging objective lens<u style="Single">2212</u>Is a separate sensor component.
figure<u style="Single">23</u>Is an image generator module that includes memory 2330, processor 2380, and interface 2390.<u style="Single">2020</u>An exemplary image generator module 2320, which is an embodiment of the above, is illustrated. The memory 2330 is communicably linked to the processor 2380, which is communicatively linked to the interface 2390. Memory 2330 contains machine-readable instructions 2340 encoded within the non-volatile portion of memory 2330. The instruction 2340 includes a synthesis instruction 2350 and a conversion instruction 2360. The compositing instruction 2350 is an embodiment of the compositing module 2030 (FIG. 20) such that the processor 2380, together with the processor 2380, can execute the compositing instruction 2350 and perform the functions of the compositing module 2030 (FIG. 20). Similarly, the conversion instruction 2360, along with the processor 2380, is an embodiment of the conversion module 2040 (FIG. 20). Synthesis instruction 2350 includes linear processing instruction 2352 and non-linear processing instruction 2354. Linear processing instruction 2352, along with processor 2380, is an embodiment of linear processing module 2032 (FIG. 20). The nonlinear processing instruction 2354, along with the processor 2380, is an embodiment of the nonlinear processing module 2034 (FIG. 20). Memory 2330 also has each sensor<u style="Single">2011</u>Includes data storage 2370, including image 2371 captured by. Spatial frequency representation 2372 is the 2D Fourier transform of image 2371 and the independent variable is the spatial frequency in two orthogonal directions. The value of the spatial frequency representation 2372 is, in the most common case, a complex quantity. The composite MTF response 2373 and the composite phase response 2374 are calculated from the spatial frequency representation 2372 and stored in memory 2330. The data storage 2370 may also include a complex phase response, a reference MTF2376, and a weight 2375 used to calculate the normalization factor 2377. Interface 2390 is communicably coupled with sensor array 2010 (FIG. 20) so that the image generator module 2320 can receive images captured by image sensor 2016 (FIG. 20). In certain embodiments, interface 2390 is further communicably linked to a separate computer system or user. Interface 2390 may, for example, render one or both of the image for viewing and the response for guidance.
figure<u style="Single">24</u>Is an exemplary method for aberration-corrected imaging in an optical guidance system with separate signal correction sensors from each other.<u style="Single">24</u>00 is illustrated. Method<u style="Single">24</u>00 is, for example, the guidance system 200<u style="Single">Within 0</u>It is implemented in. Method<u style="Single">24</u>00 is the guidance system 200<u style="Single">To 0</u>Relatedly discussed below, but the method<u style="Single">24</u>00 can be used with other systems that image through an aberration medium. In addition, Guidance System 200<u style="Single">0 is</u>,figure<u style="Single">24</u>Can work under methods other than those of.
Step<u style="Single">24</u>In 10, how<u style="Single">24</u>00 uses each of a plurality of mutually separate signal-correcting electro-optical sensors to capture a plurality of modified images that share a common field of view. Each electro-optical sensor gives the signal a correction that is separate from the corrections given by the other sensors. Step<u style="Single">24</u>In 10 embodiments, the sensor array 2010 of system 2000 in FIG. 20 captures multiple images that share a common field of view.
Step<u style="Single">24</u>In 20, how<u style="Single">24</u>00 produces multiple spatial frequency domain representations for each of the plurality of modified images. As mentioned above, the value of the spatial frequency representation is, in the most common case, a complex quantity. Step<u style="Single">24</u>In 20 embodiments, the linear processing module 2032 (FIG. 20) of the synthesis module 2030 of system 2000 linearly processes multiple images received from the sensor array 2010 to generate a spatial frequency representation of the images.
Step<u style="Single">24</u>In 30, how<u style="Single">24</u>00 processes multiple spatial frequency domain representations linearly and non-linearly to produce an aberration-corrected image. Step<u style="Single">24</u>In 30 embodiments, the linear processing module 2032 and the non-linear processing module 2034 of the image generator module 2020 (FIG. 20) process multiple spatial frequency domain representations linearly and non-linearly, respectively, to produce an aberration-corrected image. Generate.
figure<u style="Single">25</u>Is the way<u style="Single">2400</u>Steps<u style="Single">24</u>An exemplary method of 30 embodiments<u style="Single">25</u>00 is illustrated. Step<u style="Single">25</u>In 10, how<u style="Single">25</u>00 synthesizes multiple spatial frequency representations to generate a composite MTF response. Step<u style="Single">25</u>10 is a linear processing step<u style="Single">25</u>Including 15. Step<u style="Single">25</u>In 20, how<u style="Single">25</u>00 synthesizes multiple spatial frequency representations to generate a phase response. Step<u style="Single">25</u>20 is a linear processing step<u style="Single">25</u>Including 25. Step<u style="Single">25</u>In 30, how<u style="Single">25</u>00 is a step<u style="Single">25</u>With composite MTF response from 10<u style="Single">25</u>Combine with a composite phase response from 20. Step<u style="Single">25</u>In 30, how<u style="Single">25</u>00 transforms the combined composite MTF and phase response to produce an aberration-corrected image.
figure<u style="Single">26 illustrates a second exemplary method for restoring image clarity that employs non-linear processing to calculate the composite OTF magnitude response and linear processing to calculate the composite OTF phase response. ..</u>Method 2600 is the same as Method 2500 (FIG. 25), but Steps 2515, 2525, and 2530 of Method 2500 have been superseded by their respective embodiments, Steps 2615, 2625, and 2630. .. Step 2515 calculates the root mean square (rms) of multiple spatial frequency domain representations. Step 2525 calculates the phase weighted average of multiple spatial frequency domain representations. Step 2530 multiplies the composite MTF response, composite phase response, and normalization coefficient to generate a composite complex spatial frequency domain representation of the image captured by the sensor array. In an embodiment of mounting method 2600, the image generator module 2020 system 2000 performs method 2600.
figure<u style="Single">27</u>Illustrates an exemplary optical guidance system 2700 that employs separate signal-correcting electro-optical sensors from each other. The optical guidance system 2700 is an embodiment of the system 2000. Optical Guidance System 2700 is an object<u style="Single">27</u>Objects by orthogonally sampling the energy radiated or reflected from 30<u style="Single">27</u>Measure information about 30. The detectors of the sensors 2701 (i) that are separate from each other can be single pixel or array detectors.
Guidance system<u style="Single">27</u>00 and objects<u style="Single">27</u>A potential aberration medium that acts to alter the optical properties of optical radiation generated by or reflected from object 403 with and from 30.<u style="Single">27</u>There are 20. Aberration medium<u style="Single">27</u>Twenty properties can be known or unknown. Multiple electro-optical sensors<u style="Single">27</u>01 is each of multiple mutually separate signal correction components<u style="Single">27</u>02 and multiple optical detectors for each<u style="Single">27</u>Including 03 and. The signal correction component 2702 is generally a detector.<u style="Single">27</u>It can be a lens with different phase / amplitude profiles and / or different phase amplitude profiles in the vicinity of 03. Detector<u style="Single">27</u>03 can be a single pixel detector or a detector array. Guidance system<u style="Single">2700 (2701 (1, 2, ..., N))</u>Sensors in some domains<u style="Single">27</u>Object for other channels of 00<u style="Single">27</u>Separate from each other to sample information about 30 orthogonally. Having orthogonal samples reduces crossing information between pairs of sensors and maximizes the amount of Fisher information in the system, thereby increasing overall system accuracy. The optical guidance system 2700 may further include an additional electro-optical sensor that is not, or is not different from, the sensor 2701, without departing from the scope of this specification.
The optical guidance system 2700 can also be very low cost due to its low cost components. system<u style="Single">27</u>00 is an object<u style="Single">27</u>A special low-cost orthogonal sensor that measures 30 3D positioning information as precisely as possible.<u style="Single">27</u>Represents one configuration of 01.
figure<u style="Single">28</u>Is a diagram using signal correction optics 534 (Fig. 5)<u style="Single">5</u>Separate sensors from each other<u style="Single">5</u>31 or figure<u style="Single">20</u>Three common optical configurations for the mutually separate sensors 2011 are described. System 2810 describes the relevant time-varying system when the object is stationary on a time scale, and the time-varying system is required to modify at least one of the optical components 2812, and perhaps Focusing is required by changing the interval 2814 or through the quadratic phase term at 2812. Both 2812 and 2814 time corrections can be performed photomechanically through a liquid lens device, such as that supplied by Varioptic (Lyon, France).
System 2820 describes a system with arrays of optical elements 2822 that are separate from each other, generally aspherical optics. The individual optical channels formed by the optical element 2822 are designed to produce separate measurements from each other. The detector 2821 in 2820 can be a set of array detectors or single pixel detectors.
System 2830 is similar to System 2820, but with a common objective lens 2835 in front of an array of optics 2832 that are separate from each other. The common objective lens 2835 may present parallel light, focused light, or something in between to the optical element array 2832. The general optical properties of FIG. 28 can be used alone or together within a particular system.
Again, referring to the optical guidance system 1300 (FIGS. 13 and 14), in one embodiment, the sensor array within the guidance system 1300 is implemented as a signal correction optical element 1334, which is a separate signal correction optics of FIG. 27. Contains element 2702. The present embodiment includes a sensor that modifies the signal with two types of mutually distinct modifications. One is the spatial variation correction of the signal as incident optical radiation, as in the system 2700. The other is the time variation correction of the signal after it is converted from optical radiation to current.
figure<u style="Single">29</u>Describes the degradation of spatial resolution of conventional imaging systems, which is quantified by the system's modulation transfer function (MTF). Aberrations cause loss of MTF power in classical imaging systems. figure<u style="Single">13</u>And figure<u style="Single">27</u>Aberrations in systems such as those can act to significantly reduce the accuracy of object position estimation. The aberration caused by the aberration medium 2720 and the like in FIG. 27 is one such example. Aberrations can also be used deliberately in the system to achieve extended depth of field. In an embodiment, careful design of the mutually separate electro-optical sensors 401 of the guidance system 400 in FIG. 4 can achieve recovery of "loss OTF" due to aberrations, enabling the most accurate position-specific estimation.
The diffraction-limited imaging system produces the 2D MTF given by 2910 in FIG. 29, and the peak MTF magnitude is central. This horizontal slice through the origin of 2DMTF produces MTF2911. Systems with single wavelength coma produce 2D MTF 2920. Horizontal slices through this 2D MTF produce MTF2921. Systems with one-wavelength astigmatism produce 2D MTF2930. Horizontal slices through this MTF produce MTF2931.
FIG. 30 illustrates the fundamental loss of MTF power from a ray-based perspective, by way of example. The ideal system 3010 essentially acts on the ray 3011 from a remote point at infinity to form the ideal point spread function (PSF) or image 3012 of the point. The actual properties of the point image 3012 relate to the details of the ideal system 3010.
The system 3020 is similar to the ideal system 3010, but the aberration medium 3050 essentially changes the relative direction (and / or amplitude and phase) of the rays from a remote point at infinity. The resulting rays in the point image 3022 are no longer ideal and produce aberration images at remote points. Aberration images are classically associated with loss of MTF at some spatial frequencies. The important question is, "Where did this MTF power go?" If this lost power (hereinafter referred to as lost OTF) can be understood, can it be recovered and how? Figure 31 shows the complex system response (CSR) and each other. We show how to recover lost MTF power in a guidance system using separate signal correction electro-optical sensors. The spatial frequency system 3100 essentially images parallel light 3101 from a remote point at infinity. The lens on the spatial frequency system 3100 is an ideal lens intentionally modified by the cubic phase function 3102, the function being (x ^ 3 + y ^ 3). This phase function is an easily explained form of aberration.
The resulting image at the remote point is represented by the PSF3110 in the spatial domain and by its corresponding OTF3120 in the spatial frequency domain. Only the size of OTF3120, i.e. MTF, is shown in FIG. Neither of these two expressions explains where the lost OTF power disappeared. Specific OTF points 3121 and 3122, including magnitude and phase, are represented in Complex System Response (CSR) 3130 and 3140, respectively. The OTF point 3121 is at the horizontal spatial frequency and the OTF point 3122 is at the diagonal spatial frequency, both at the same radial distance from the origin. In general, CSR represents a particular complex OTF point in terms of vertical and horizontal generalized misfocus. The origins of CSR3130 and 3140 represent OTF points 3121 and 3122, respectively, while the remaining regions of 3130 and 3140 represent OTF points for specific spatial frequencies at OTF points 3121 and 3122 with different generalized defocus. .. The generalized defocus is a one-dimensional defocus such as lang = EN-US> α · x ^ 2 or β · y ^ 2, and the two orthogonal dimensions have different defocus characteristics. The classical out-of-focus is two-dimensional, such as lang = EN-US> α · (x ^ 2 + y ^ 2), and the two orthogonal dimensions have the same out-of-focus characteristics. The value at the origin of the CSR represents an OTF of a particular spatial frequency with zero defocus.
The classic out-of-focus line 3150 on the CSR 3130 is horizontal. The classic out-of-focus line 3160 on the CSR 3140 is diagonal. These represent classical defocus lines for two specific spatial frequencies at OTF points 3121 and 3122, respectively.
To understand the orientation of the out-of-focus line 3150, CSR3130 has a non-zero horizontal spatial frequency lang = EN-US> ν, as indicated by point 3121.<sub>x</sub>And a small range of vertical spatial frequencies centered around zero that are almost disappearing lang = EN-US> Δν<sub>y</sub>Recall that it represents an OTF value for imaging an object containing and. Only the size of OTF, i.e. MTF, is shown in the figure. Therefore, lang = EN-US> Δν<sub>y</sub> In the limit of 0, the OTF value in CSR3130 is | lang = EN-US> ν<sub>y</sub>It is constant for |>. The out-of-focus line 3160 is similar to the 3150, but is rotated by 45 degrees because the OTF value in the CSR3140 corresponding to the OTF point 3122 is at the diagonal spatial frequency.
The CSR3130 displays the system power spread along the classic out-of-focus line 3150. Therefore, this spatial frequency system 3100 displays an extended depth of field. CSR3140 describes a system with power away from the classic out-of-focus line 3160. Although power exists along the classical out-of-focus line, the spatial frequency system 3100 has lost OTF power here and at many other spatial frequencies.
Understand CSR, deliberately design the electro-optical sensor 401 of the orthogonal sampling systems 400 (Fig. 4), 2000 (Fig. 20), and 2700 (Fig. 27), and use CSR by designing the CSR filter. Therefore, the influence of aberration on the special system can be significantly reduced. The signal correction optics of the sensors in Systems 400 (Figure 4), 2000 (Figure 20), and 2700 (Figure 27) may include CSR filters as discussed herein. For example, the plurality of signal correction optics 2014 (Fig. 20) can be each plurality of mutually separate CSR filters. In certain embodiments, multiple interconnected CSR filters form a basis set for general out-of-focus.
Figure 32 shows that CSR is formed based on the exit pupils of the sensors in the guidance system, which employ separate signal-correcting electro-optical sensors from each other. CSR is a bilinear function of the exit pupil of an imaging system. FIG. 32 illustrates the process of forming a CSR based on the exit pupil 3201P (x, y). In general, this exit pupil is a complex quantity that includes amplitude and phase as a function of spatial position. Shifted version 3202P (xu / 2, yv / 2) of exit pupil and shifted and conjugated version 3203P<sup>*</sup>(x + u / 2, y + v / 2) is multiplied point by point. The result is a 2D correlation 3210C (u, v). This correlation is a function of both two-dimensional shifts u and v. 2D Fourier transform of C (u, v) is CSR CSR<sub>u, v</sub>(w<sub>u</sub>, w<sub>v</sub>) Brings 3220. The classical OTF associated with the two shifts u and v is found by summing the correlation functions C (u, v) over u and v. The classical OTF for the two spatial shifts u and v is equal to the origin of the CSR, or OTF (u, v) = CSR (0,0). An important characteristic of CSR is that the sum of the squares of CSR for each of the spatial frequencies is constant for each of the phase aberrations of the exit pupil 3201.
The exit pupil P (x, y) is generally a complex quantity, so C (x, y) and CSR (w)<sub>u</sub>, w<sub>v</sub>) Is also a complex quantity. All plots of CSR shown here show magnitude, but all calculations will involve actual complex values.
FIG. 33 illustrates the building block of the CSR filter. The building blocks are orthogonal and therefore the figure<u style="Single">27</u>Electric light sensor<u style="Single">2701</u>Allows each individual channel to have a minimum amount of intersection information and a maximum amount of Fisher information. CSR filters are used to control system effects of aberrations and recover lost OTF power. Plot 3310 and Plot 3320 describe CSR for one spatial frequency for four different angles. The spatial frequency of the CSR will be normalized to a maximum of 1.0 throughout and will be shown from this maximum to 0.25. Graphs A, B, C, and D represent horizontal, left diagonal, right diagonal, and vertical spatial frequencies, respectively. The classical defocus line in A is horizontal, in B it is the upper right diagonal, in C its diagonal is downward right, and in D it is vertical.
The CSR blocks of plots 3310 and 3320 are created through an imaging system with astigmatism components. Alternatively, the exit pupil 3201 in FIG. 32 is shown in FIG.<u style="Single">27</u>Orthogonal sampling system<u style="Single">2700</u>Signal correction component of<u style="Single">2702</u>Designed spatially for each of. For plot 3310, the astigmatism component is defined as P (R, lang = EN-US> θ) = R ^ 2sin (2θ), while for plot 3320, the astigmatism component is P. It is defined as (R, lang = EN-US> θ) = R ^ 2cos (2θ). Where R = (x ^ 2 + y ^ 2) ^ (1/2) and lang = EN-US> θ = arctan (y / x), where R is the radius in the opening plane, θ Is the angle around the opening plane.
Corresponding graphs A, B, C, D in plots 3310 and 3320 are orthogonal. The power as a generalized out-of-focus function for the two component functions produces a non-overlapping CSR. A linear combination of these CSRs can span the entire generalized out-of-focus space.
Adding the defocus to the exit pupil 3201 from FIG. 32 has the effect of translating the CSR power parallel to the defocus line. Changing the amplitude of the astigmatism component causes the CSR power to translate linearly around the out-of-focus axis. These two astigmatism components are called CSR filter building blocks because their linear combination can extend to any desired region of the CSR.
Figure 34 shows here different sets of building blocks for a CSR filter from a cylindrical component. The cylindrical component has an exit pupil 3201 from FIG. 32, which has the form of a 1D lens such as x ^ 2 or y ^ 2. Plot 3410 is associated with the cylindrical component of form P (x, y) = x ^ 2, while plot 3420 is associated with the cylindrical component of form P (x, y) = y ^ 2. For each respective graph A, B, C or D, the cylindrical components also form an orthogonal set. In essence, there is no CSR overlap for any two graphs in Figure 34. However, the horizontal and vertical spatial frequencies A and D translate only along their respective defocus axes. This does not correspond to the astigmatism component from FIG. 33.
The building block in Figure 33 is used to form the CSR filter shown in Figure 35. Building blocks 3501, 3502, and 3503 are three different building blocks P (r, lang = EN-US> θ) = aR ^ 2sin (2θ), P (r, θ) = 0, and P (r, lang). = EN-US> θ) = -aR ^ 2sin (2θ), a complex CSR for horizontal spatial frequency (with normalized radial spatial frequency 0.25) is explained, and a = 3/4 of wavelength. Linearly varying the amplitude of the astigmatism component causes the CSR to translate linearly. Linear summing the complex CSR building blocks results in the resulting CSR filter 3510. This filter is widespread around the defocus line centered on zero defocus. In general, complex weights can be used to form a CSR filter by weighting each CSR described by building blocks 3501, 3502, 3503, but a weight of 1 is used herein. Will.
FIG. 36 shows an example of a single CSR filter from FIG. 35 for four angles and an astigmatism building block for both sine and cosine from FIG. 33. Plot 3610 represents a CSR filter from a linear combination of sinusoidal astigmatism construction blocks with + a, 0, and -a amplitudes, a = 3/4 wavelength. Plot 3620 represents a CSR filter from a linear combination of cosine astigmatism construction blocks with + a, 0, and -a amplitudes, again at a = 3/4 wavelength. The CSR filter 3610A is the same as the CSR filter 3510 in Fig. 35. The CSR filters 3610A, 3610D, 3620B and 3620C are all perpendicular to their respective classical defocus lines. These filters are particularly useful in recovering OTF power, which is typically lost due to aberrations in classical imaging systems. All other CSR filters (3610B 3610C, 3620A, and 3620D) will focus along their respective classical defocus lines and exhibit extended depth of field characteristics. These CSR filters, which vary with only one parameter, are 1D CSR filters.
FIG. 37 illustrates the CSR filters 3710 and 3720 associated with the cylindrical construction block from FIG. 34. The CSR filters 3710 and 3720 are similar to the CSR filters 3610 and 3620 in FIG. 36, respectively, but the power of the CSR filters 3710 and 3720 builds astigmatism from FIG. 34 on or near their respective defocus axes. Focus more closely than from the block.
FIG. 38 illustrates a set of CSR filters 3811-3813, 3801-3803, and 3821-3823 that include astigmatism and defocus. The CSR filter is a linear combination of sinusoidal astigmatism construction blocks from Figure 35 with the addition of defocus. These CSR filters vary in two parameters and are 2D CSR filters. The CSR building blocks 3801, 3802 and 3803 are the same as the CSR building blocks 3501, 3502 and 3503 in FIG. The CSR construction block in the upper row of FIG. 38 is translated parallel to the defocus line through the addition of a +1 wave defocus for each exit pupil. The bottom line represents the same situation, but with a -1 wave out of focus that translates the CSR building block in opposite directions. The linear combination of all building blocks results in a CSR filter 3830. This particular CSR filter is generally rectangular and centered on the zero out-of-focus point.
FIG. 39 shows the CSR filters 3910A to 3910D and 3920A to 3920B and the astigmatism building blocks for both sine and cosine related to linear combinations of defocus and amplitude from FIG. 38 for multiple angles. The CSR filters 3910A, 3910D, 3920B, and 3920C have a uniform rectangular shape centered on the defocus axis, similar to that of FIG. 38.
The CSR filters 4010A-4010D and 4020A-4020D are similar to FIG. 38, but are shown in FIG. 40 using the cylindrical CSR building blocks of FIGS. 34 and 37. Again, the power is concentrated closer to each out-of-focus axis using the cylindrical construction block than with the astigmatism construction block.
Figures 41-48 detail four examples of recording loss OTFs due to aberrations and then using CSR filtering to recover. For these examples, a system 2820 is used with an array detector behind each channel 2822 in FIG. 28. Each aperture of System 2820 has a unique phase that results in orthogonal sampling in the CSR domain. By capturing image data from each aperture and performing appropriate processing, the resulting image can have much less OTF power loss than without orthogonal sampling.
In FIG. 41, the intervening aberration medium is the third-order phase aberration from FIG. 31, morphology P (x, y) = lang = EN-US> α · (x ^ 3 + y ^ 3) (α = 1 wavelength). Is assumed to give the non-ideal phase of. Plot 4110 shows the size of classical 2D OTF (ie, MTF), displayed in contour form. The horizontal and vertical axes of 4110 (and 4120 and 4130) are the units of normalized spatial frequency, with a maximum normalized value of 1.0. All MTFs are shown for a normalized spatial frequency of 0.25. Plot 4120 represents the 2D MTF for the astigmatism 1D CSR filter in FIG. 36 prior to arbitrary processing (the amount of astigmatism varies). Plot 4130 represents the 2D MTF for the astigmatism 2D CSR filter in FIG. 39 prior to arbitrary processing (both astigmatism and out-of-focus variations). The 1D astigmatism CSR filter 2D MTF in plot 4120 is associated with five orthogonal apertures, while the 2D astigmatism CSR filter 2D in plot 4130. The MTF is associated with 15 orthogonal openings. MTFs 4111, 4121, and 4131 shown in 1D plot 4150 are horizontal slices from plots 4110, 4120, and 4130, respectively.
The 2D MTF of the 2D astigmatism CSR filter shown in plot 4130 is higher than the 2D MTF of the 1D astigmatism CSR filter (with less orthogonal aperture) shown in plot 4120, both classical in plot 4110. Significantly higher than 2D MTF.
1D plot 4150 shows the classical diffraction limit MTF 4140. A linear reconstruction of the classical 2D MTF (estimated slices of the classical 2D MTF are represented as blurry MTF 4111 in the 1D plot 4150) can match the diffraction-limited MTF. Such a linear reconstruction can be, for example, a Wiener filter designed with the diffraction limit MTF4140 as the target response and the blurred MTF4111 as the response to be recovered. A filter with an RMS gain of gRMS = 2.25 is required to restore the blurred MTF4111 to the classical diffraction limit MTF4140 through linear filtering. Such filtering would increase the additional noise standard deviation by this factor gRMS = 2.25.
The RMS noise gain for the 2D MTF of the 1D astigmatism CSR filter in plot 4120 is 0.85 and 0.57 for the 2D astigmatism CSR filter 2D MTF4130. Therefore, the additional noise power for a system sampled orthogonally is reduced after processing by orthogonal sampling.
FIG. 42 shows the CSR filter 4210A-D and the CSR filter 4220A-D for the stereoscopic aberration medium of FIG. 41. 4210A-D shows four CSRs for 0.25 spatial frequency at the same four angles as described above. CSR power spreads widely across both diagonals within the 4210B and 4210C. This power can be captured by the CSR filter 4220, which consists of 3910A, 3920B, 3920C, and 3910D from Figure 39. The classical focus can capture the power along the out-of-focus line, while the CSR filtering approach captures the power that would otherwise be lost, the power across the out-of-focus line. CSR filters typically capture OTF power, which is lost in classical imaging. And the CSR processing disclosed herein acts to restore most or all of the OTF.
In CSR4210, the area of non-zero MTF values in the normalized out-of-focus space 4210 exceeds the non-zero MTF area of the 2D CSR filter 4220. Therefore, but not all aberration MTF power will be captured by the CSR filter 4220A-D. This leads to a system MTF that deviates from the ideal diffraction limit MTF. However, a small amount of digital processing, such as weena filtering of the sampled data, can be used to form a final image that matches the diffraction limit response or the like.
FIG. 43 shows an example of recovering a lost OTF in a guidance system using separate signal-correcting electro-optical sensors, the intervening aberration medium is one-wave spherical aberration, and the phase is P (R). , lang = EN-US> θ) = R ^ 4. MTF4311, 4321, and 4331 in plot 4350 are horizontal slices (at zero vertical spatial frequency) of plots 4310, 4320, and 4330, respectively. The classical out-of-focus 2D MTF and the classical out-of-focus 1D MTF 4311 shown in plot 4310 show a significant MTF drop from the diffraction-limited system. The two orthogonal CSR filters MTF are significantly higher, and the 2D CSR filters 2D MTF and 1D MTF 4331 shown in plot 4330 are significantly higher than the orthogonal system 1D CSR filters 2D MTF and 1D MTF 4321 shown in plot 4320. The RMS noise gain for the classical system is 4.04, while it is 0.94 for the 2D MTF shown in plot 3020 and 0.48 for the 2D CSR filter 2D MTF shown in plot 4330.
FIG. 44 shows the CSR representing the aberration of FIG. 43. Again, the 2D CSR filter in FIG. 39 matches the aberration CSR better than the 1D CSR filter in FIG. 36. This better match results in higher MTF and lower processing noise gain.
FIG. 45 illustrates an example of recovering a lost OTF in a guidance system using separate signal-correcting electro-optical sensors, where the aberration is 1.25-wave coma, ie P (R, lang = EN). -US> θ) = 1.25R ^ 3 * sin (θ + π / 4). MTF 4511, 4521, and 4531 in plot 4550 are horizontal slices of plots 4510, 4520, and 4530, respectively (at zero vertical spatial frequency). Again, the lowest MTF is from a classical imaging system, while the highest is from a 2D CSR filtered system. The noise gain for the classical system 4510 is 1.94, 0.83 for the 1D CSR filter associated with its 4520, and 0.58 for the 4530 2D CSR filter.
FIG. 46 illustrates CSR for coma in FIG. 45. This CSR is very wide with respect to the diagonal spatial frequency within 4610B. This results in a low diagonal MTF of 4510.
An example of orthogonal CSR filtering in FIG. 47 shows aberrations that the classical MTF does, but the orthogonally sampled system does not. In this embodiment, both spherical aberration and astigmatism are present. Aberrations are explained as P (R, lang = EN-US> θ) = (3/8) R ^ 4 + (3/4) R ^ 2cos (2θ). MTFs 4711, 4721, and 4731 in plot 4750 are horizontal slices (at zero vertical spatial frequency) of plots 4710, 4720, and 4730, respectively. The classical MTFs in 4710 and 4711 are low enough to produce zeros at horizontal and diagonal spatial frequencies. In these wide areas, essentially no information is transmitted through the channel due to the effects of aberrations. The 2D / 1D MTFs of 4720/4721 and 4730/4731 show very high values. In fact, the MTF did not change significantly with respect to the aforementioned aberrations, especially when compared to large MTF changes in classical systems. The noise gain for the example in Figure 47 is 10 ^ 5 for the classical system, 1D. It is 0.73 for CSR-filtered systems and 0.56 for 2D CSR-filtered systems.
FIG. 48 shows the CSR for the aberrations associated with FIG. 47. In graphs 4810A and 4810B, the CSR power at the origin (0,0) is essentially zero, while the CSR power is relatively high at the origin within the subplot 4810D. This is the CSR version of the 4710 2D MTF in Figure 47, with very low horizontal and diagonal MTFs. However, both 1D and 2D CSR filters 4720 and 4730 can properly match the aberration CSR and result in little MTF or information loss through the aberration channel.
49-52 illustrate examples of optical configurations and CSR processing to produce the results of FIGS. 41, 43, 45, and 47. FIG. 49 illustrates a plurality of mutually separate openings 4901, each of which is an electro-optical sensor.<u style="Single">4901 (1), 4901 (2), ..., 4901 (N)</u>It has a unique CSR construction block that leads to. For the above embodiment, there would be 5 electro-optical sensors for the 1D CSR filter and 15 for the 2D CSR filter.
FIG. 49 shows an optical guidance system 4900 for generating aberration-corrected images. System 4900 includes multiple mutually separate openings, each with its own CSR building block leading to an optical guidance system with separate signal correction sensors from each other. System 4900 in Figure 49 represents both the linear and non-linear components of the CSR processing chain. An electro-optical sensor behind multiple mutually separate openings 4901<u style="Single">4901 (1), 4901 (2), ..., 4901 (N)</u>The output of is subjected to a 2D Fourier transform, which is then acted upon by a non-linear processing step 4910 and a linear processing step 4920. The output of the linear and non-linear processing steps is then combined and inverse Fourier transformed to provide a clear image useful for the rest of the system. Other implementations can be in the spatial domain as well. The process slides the overlapping area, depending on the goals of the system, or for the entire image, the electro-optical sensor 4901 (1),<u style="Single">4901 (2), ..., 4901 (N)</u>It can be done block by block over the sampled images from.
FIG. 50 illustrates the linear processing component 5000 of FIG. Linear processing involves forming a proper phase response. The phase component of the 2D Fourier transform of the electro-optical sensors S1, S2, ..., SN behind multiple mutually separate apertures 5001 is 5030. These phase components are then weighted with a complex system dependent weight 5040 and summed to form the resulting phase angle estimate 5050. The complex system dependent weight 5040 represents the conjugation of the CSR phase to each spatial frequency at 5030 associated with each electro-optical sensor S1 ... SN behind multiple mutually separate openings 5001. Phase can be measured through calibration signals such as projected parallel light, or through some a priori information about objects such as edges, lines, and sparseness. After combining the weighted spatial frequency information, the resulting phase angle for each spatial frequency is estimated. Section 5020 is similar to the linear processing step 4920 in FIG.
The system 5100 in FIG. 51 is a non-linear processing component related to the CSR processing system. Section 5110 represents the non-linear processing step 4910 in FIG. The squared magnitude of the Fourier transform of the spatial data from multiple mutually separate openings 5101 is formed at 5130. These squared magnitude quantities are then summed one by one. The square root of each summed value is then formed at 5140. Result 5150 is the corrected MTF value for each of the 5130 spatial frequencies with respect to the orthogonal electric light sensors S1, S2, ..., SN behind multiple mutually separate openings 5101. This non-linear process essentially forms an RMS value for each of the measured spatial frequencies.
FIG. 52 shows a method for forming an aberration-corrected image from a 2D inverse Fourier transform of the product of size estimation 5210 (section 5110 from FIG. 51) and complex phase angle estimation 5220 (phase angle estimation 5050 from FIG. 50). Shows 5200. Normalization term 5210b is chosen so that the MTF matches the diffraction-limited MTF or other specific target in the absence of aberrations. The final clear image 5250 is formed.
An actual embodiment of an optical / digital orthogonal sampling system is shown in Figures 53-57. One channel of the optical system is represented by the system 5300 in FIG. The aperture aperture of the channel represented by the system 5300 is in front of the first lens element 5300a behind a separate phase filter 5310. The second lens element 5300b acts to make the system 5300 telecentric, and the main rays from each object point in the image plane 5300c are parallel to the optical axis and perpendicular to the image plane. The location of the image spots on the image plane is therefore independent in focus.
figure<u style="Single">27</u>Separate phase and amplitude signal correction components from<u style="Single">2702</u>Can be configured within the system 5300, either directly in front of and / or in the back of the channel. As is well known, since the aperture diaphragm is in front, a separate phase filter 5310 can be used to directly change the exit pupil. Separate phases can also be formed directly as part of the first lens element 5300a. Separate amplitudes and phases can also be placed in the vicinity of the image plane 5300c in front of the detector.
MTFs over lang = EN-US> ± 20 degrees FOV are essentially diffraction limited, as indicated by MTF5320. Also, the relative illuminance shown in 5330 is essentially constant over the entire field of view. Relative illuminance is intentionally designed to be constant as a function of FOV in order to maximize SNR over the entire field of view.
FIG. 54 illustrates the spherical 5410 and aspheric 5411 components of the lens elements 5300a and 5300b of the channel represented by the system 5300 of FIG. This channel, represented by System 5300, is designed to operate at wavelengths of 950 nm. The axial focal length of this system is 5.5mm and F / lang = EN-US> # = 8.
FIG. 55 illustrates the distortion of system 5300 in FIG. 53. To keep the relative illumination constant, the distortion should increase for such simple and low cost systems. In other words, instead of the relative illumination that diminishes in the cosine style over the field of view, the local F / lang = EN-US> # of the system 5300 is slightly diminished at larger angles of view and the apparent aperture size with angle to the object. It is intentionally designed to compensate for the loss of. This change in F / lang = EN-US> # leads to a change in the local focal length with the visual field, and thus a change in magnification or distortion. The distortion is less than 6% for this lens.
FIG. 56 illustrates the bandpass nature of the illumination used in system 5300 in FIG. 53. The detector used is the Hamamatsu S5106 single pixel detector, which has a sharp drop in photosensitivity above lang = EN-US> λ = 970 nm, as shown in plot 5630. The long-pass optical filter 5610 (LP920 from Midwest Optical Systems) has a strong cutoff for illumination wavelengths below 925 nm. In addition, the cutoff frequency of this optical filter as a function of the angle of incidence does not fluctuate very much for angles between lang = EN-US> ± 20 degrees, as shown in plot 5620. The detector's optical long-pass filter and low-pass property provide a band-pass effect centered around lang = EN-US> λ = 950 nm.
One optical configuration for multiple apertures that is mechanically robust and can be manufactured at low cost is monolithic or wafer scale. Figure 57 shows the 3lang = EN-US> × 1 channel of the complete guidance system. System 5700 shows a side view of the system, highlighting the first lens array 5710 and the second lens array 5720. In one embodiment, the dimensions 5759 and 5760 are 12 mm and 45 mm, respectively. Spacers are provided by 5730 and 5740 that separate the lens element and the detector. All components of the monolithic configuration have an optically absorbent coating (other than the center of the optical element), which can reduce the effects of stray light from strong sources such as the sun. For smaller production volumes, the lens array can be a machined, rolled, polished, or injection molded lens. Assembled in the lens holder that forms the lens array. For larger production volumes, the lens array containing the optics can be molded directly into one component. Molding can be through injection molding or duplication with special epoxies on glass or similar substrates.
The electrical components of the entire system are mounted near the image plane. For system 5700, the electrical array 5770 consists of individual detectors 5770a, 5770b, and 5770c mounted on separate electronic circuit boards. In one embodiment, dimensions 5770 and 5771 are 15 mm and dimension 5772 is 23 mm. Each detector board is mounted directly on the second spacer or on the interposer mounted on the second spacer, allowing ease of use and versatility. All 5770 detectors can also be mounted on a single circuit board, depending on production volume.
There are a wide variety of potentially different system configurations, depending on the quantity and / or cost and complexity targets for different subsystems. The system consists of two main subs: i) optics / electronics related to the object to be located and ii) optics / electronics related to the system that receives the information and forms the position estimation. Consists of at least one of the systems. These are referred to as object-side subsystems and receiver-side subsystems, respectively.
In some situations, there may be a large number of distributed object-side subsystems and a relatively small number of receiver-side subsystems. In this case, reducing the cost and complexity of the object-side subsystem can be beneficial. In other situations, there may be a large number of receiver-side subsystems, and it may be necessary to reduce the cost of each receiver-side subsystem. For example, a very sensitive photocounting detector can be used within a receiver-side subsystem to enable long distances with eye-safe transmission power. Reducing the overall cost and complexity of the receiver-side subsystem can therefore be a system-wide trade-off, adding additional cost and complexity to the object-side subsystem. Yet another situation is when the overall cost and complexity are balanced between the object and the receiver-side subsystem.
Figures 58-60 describe systems and methods for coordinating and optimizing the cost and complexity of both object-side and receiver-side subsystems. 58100 describes a general cost / complexity trading space. In order to reduce the cost and / or complexity of the object-side subsystem, the cost and complexity of the receiver-side subsystem needs to be increased and vice versa. There may also be compromises that balance the cost and complexity of both object-side and receiver-side subsystems.
An object-side subsystem 58200 and a receiver-side subsystem 58300 describe an embodiment that reduces the cost and complexity of a receiver-side subsystem while increasing the cost and complexity of an object-side subsystem. A large number of object-side systems with different projected information can be used with a relatively small number of receiver-side systems with minimal complexity.
The object-side subsystem 58200 includes an illumination 58210 and object-side projection optics 58220o and 58220i that are separate from each other. The electronic device 58230 acts to drive the illumination 58210 and provide a time-modulated signal so that the relative difference between the illumination outputs of the LED 58210 is below the desired level. Separate object-side projection optics 58220o and 58220i act to project light towards the remote receiver-side subsystem at essentially constant power-to-angle or spatially variable power-to-angle. Different object-side subsystems can have different power vs. angles. The right and left circularly polarized waves 58220R and 58220L allow the separation of the two outputs in the receiver subsystem 58300, independent of the relative physical orientation of the subsystems 58200 and 58300.
The receiver-side subsystem 58300 consists of right and left circularly polarized waves 58320R and 58320L that separate the two orthogonally polarized signals projected from the object-side subsystem. The optical channel 58310 consists of optics and the detector can be the same as that shown in 58300. RF demodulation and processing The electronic device 58330, like the 58200, acts to demodulate signals from some remote object-side systems. Note that the receiver-side subsystem 58300 has the least physical complexity, while the object-side subsystem 58200 has a higher degree of complexity. The orthogonal polarization device acts to separate the two channels defined by the 58220R and 58220L.
A related variant for the receiver-side subsystem is shown in 58400. This receiver-side subsystem is similar to that of the 58300, but involves the addition of one or more channeles that produce additional information to increase estimation accuracy. The 58400 different channels have either a right or left circular polarization device (such 58420R, 58420L, and 58420L2). The optics and detectors associated with the 58420R and 58420L are assumed to be identical to the corresponding channels within the 58300. The optics associated with the 58420L2 differ by the addition of the 58411. 58411 is a unique intensity and / or phase component that varies the detected intensity versus the angle from the optic axis. The 58411 works in conjunction with the 58200i to give different measurements that can increase the estimation accuracy. For example, the 58411 may increase the detected optical power vs. angular slope beyond that provided by the object-side projection optics 58220i, which are separate from each other. The unique object-side projection optics 58220o project optical power that is detected and considered as a control.
FIG. 59 describes in detail the object-side projection optics 58220o and 58220i that are separate from each other in FIG. 58. 59100 is a drawing of both optics that are separate from each other. The LED is mounted on the 59110 and acts as an aperture stop for the system 59100. 59111 is the first surface of this type of projection optics and 59112 is the second surface. 59120 represents a remote subsystem that receives the power projected from the 59100.
The 59200 describes the relative illuminance for two different versions of the 59100. 59220 describes an essentially constant relative illuminance over a 20 degree field of view, while 59230 describes a relative illuminance that varies essentially linearly with the field of view. 59220 may represent 58220o from FIG. 58 and 59230 may represent 58220i from FIG. 58. Relative illuminance is the relative amount of projected power that can be seen by the remote receiver 59120, depending on the angle of 59120 with respect to 59100. This was assumed to be the output power diagonal of the LED 58210 in Figure 58. If the ILED output anti-angle is not constant, the combination of LED power anti-angle and aspheric optic power anti-angle can be compensated through the aspheric design process to match the design specifications.
The 59230 achieves a unique relative illuminance profile by deliberately designing aspheric optics so that the effective focal length changes as a function of the field of view. In this case, the focal length decreases linearly as a function of the field of view. Many other relative illumination profiles can also be practical. The advantage of the 59230 is that only a single inexpensive optical component is used to correct the power vs. angle of the object-side subsystem.
FIG. 60 details the optical configurations associated with 59220 and 59230 of FIG. 59 in a well-known Zemax-type format. Tables 60100 and 60101 describe single-lens optical systems that form 59220, and Tables 60200 and 60201 describe optical systems that form 59230. Tables 60101 and 60201 describe circularly symmetric aspherical terms such as 4th and 6th order. The optical system of Figure 60 is intended for use with 900 nm illumination.
(Combination of Features) The features described above as well as those claimed below may be combined in various ways without departing from the scope of this specification. For example, it is understood that aspects of one guidance system or method described herein may incorporate or replace features of another guidance system or method described herein. Let's go. The following examples illustrate possible non-limiting combinations of the aforementioned embodiments. It will be apparent that many other modifications and modifications can also be made to the methods and devices herein without departing from the spirit and scope of the invention.
The guidance system for determining the location parameters of the object is (a) at least one oscillating element located on the object to emit modulated optical radiation and (b) at least two mutually separate signals. A modified electro-optical sensor, each demodulated with an electro-optical sensor having a detector and a demodulator for generating a demodulated electrical signal in response to detection of at least a portion of modulated optical radiation. It may include a processor for determining location parameters from demodulated electrical signals.
(A2) At least one oscillating element comprises three transmitters that emit optical radiation modulated separately from each other, and the location parameters are the 3D location and 3D orientation of the object with respect to the electro-optical sensor. , (A1).
The (A3) demodulator is associated with the corresponding one of at least three electro-optical sensors, and each of the demodulated electrical signals is associated with the associated modulated optical radiation, (A1) or (A1) or ( The guidance system described in any of A2).
(A4) The guidance system according to any one of (A1) to (A3), wherein at least one transmitter is configured such that the modulated optical radiation is different from the other optical radiation incident on the electro-optical sensor. ..
(A5) The guidance system according to any one of (A1) to (A4), wherein the optical detector comprises a single-pixel photodetector for detecting modulated optical radiation.
(A6) The guidance system according to any one of (A1) to (A5), wherein each demodulator further comprises a filter for rejecting higher frequency components of the demodulated electrical signal.
(A7) The guidance system according to any one of (A1) to (A6), wherein the modulated optical radiation comprises a plurality of modulation frequencies for determining object parameters with multiple accuracy of each.
(A8) Modulated optical radiation comprises multiple modulation frequencies for estimating range through time processing and estimating angles through separate signal correction sensors from each other, according to (A1) to (A7). Guidance system.
(A9) The guidance system according to (A1) to (A8), wherein the modulated optical emission has a plurality of modulation frequencies in order to reject the signal due to reflection.
(A10) Each of the at least one oscillating element is a backreflector, and the system is further equipped with a transmitter for transmitting modulated optical radiation to the backreflector for reflection to the electro-light sensor. The guidance system according to (A1) to (A9).
(A11) The guidance system according to (A10), wherein the transmitter is configured such that the modulated optical radiation is different from other electromagnetic radiation incident on the electro-optical sensor.
(A12) The guidance system according to (A1) to (A11), wherein the modulated optical radiation has a modulated frequency within the radio frequency range.
(A13) The guidance system according to (A1) to (A12), wherein the modulated optical radiation has a modulation frequency greater than 300 GHz.
(A14) The guidance system according to (A1) to (A13), wherein the electro-optical sensors are separate from each other by making different spatially dependent corrections to the incident optical radiation.
(A15) The guidance system according to (A14), wherein the phase plate with the spatial variation phase transmission function makes separate spatially dependent corrections to the incident optical radiation.
(A16) Multiple electro-optical sensors that share a field of view and provide each of multiple modified images separately from each other and the spatial frequency characteristics of the multiple modified images are processed linearly and non-linearly. A guidance system with aberration-corrected imaging, including an image generator module for synthesizing aberration-corrected images for the imaging system.
(A17) The guidance system according to (A16), wherein the intervening medium between the object in the shared field of view and the plurality of electro-optical sensors produces aberrations corrected by the imaging system.
(A18) The guidance system according to (A17), wherein the plurality of electro-optical sensors are provided with a plurality of mutually separate signal-correcting optics for spatially correcting the phase of the incident optical radiation.
(A19) The guidance system according to (A18), wherein each electro-optical sensor comprises an image sensor and an imaging objective lens for forming an image on it, the imaging objective lens comprising a signal correction element. ..
(A20) The guidance system according to (A18), wherein each electro-optical sensor comprises an image sensor and an imaging objective for forming an image on it, and the signal correction element is separate from the imaging objective. ..
(A21) The image generator module synthesizes a complex spatial frequency domain representation, which is a plurality of complex spatial frequency domain representations, each of which is a complex spatial frequency domain representation of each one of a plurality of modified images. , A synthesis module for determining a composite modulation transfer function response and a composite phase response, and a conversion module for combining and transforming the composite modulation transfer function and the composite phase response to generate an aberration-corrected image. The guidance system according to A16) to (A20).
(A22) The induction system according to (A21), wherein the synthesis module determines the complex modulation transfer function response from the magnitude of the root mean square of multiple complex spatial frequency domain representations.
(A23) The guidance system according to (A22), wherein the synthesis module determines the composite phase response from the weighted average of the phases of a plurality of complex spatial frequency domain representations.
(A24) The plurality of electro-optical sensors are each provided with a plurality of mutually separate signal-correcting optics in order to spatially correct the phase of the incident optical radiation, and the weight in the weighted average is a plurality of signal-correcting optics. The guidance system according to (A23), which is determined from the phase of the element.
(A25) The induction system according to (A22) to (A24), wherein the conversion module further applies a normalization coefficient so that the composite modulation transfer function response best matches the reference modulation transfer function response.
(A26) An image generator module is a memory that is communicatively linked to a processor and (a) a machine-readable compositing instruction that, when executed by the processor, performs a compositing function. (b) It has a memory, with a non-volatile part, including machine-readable conversion instructions that perform binding and conversion functions when executed by the processor, (A22) to (A25). ) Described in the guidance system.
(A27) The guidance system according to (A26), wherein the machine-readable synthetic instructions further include an instruction for determining the complex modulation transfer function response from the root mean square of multiple complex spatial frequency domain representations.
(A28) The guidance system according to (A26) to (A27), wherein the machine-readable synthetic instructions further include instructions for determining the composite phase response from the weighted average of the phases of multiple complex spatial frequency domain representations.
Changes may be made to the systems and methods described above without departing from the scope of this specification. It should be noted, therefore, that the matters contained in the above description and shown in the accompanying drawings should be construed as exemplary rather than in a limiting sense. The following claims are intended to cover the general and specific features described herein and the full description of the scope of the method and system that may be deemed to be contained therein.
60 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| JP03140800A | Cites | Japan |
| JP06160132A | Cites | Japan |
| KR1020120128244A | Cites | Republic of Korea |
| JP02234012A | Cites | Japan |
| JP2009002804A | Cites | Japan |
| JP2007011432A | Cites | Japan |
| JP11094520A | Cites | Japan |
| JP2008249717A | Cites | Japan |
| US5579108A | Cites | United States of America |
43 members in 5 offices
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 61749764 | United States of America | – | |
| 201361749764 | United States of America | P | |
| 61754853 | United States of America | – | |
| 201361754853 | United States of America | P | |
| 61810849 | United States of America | – | |
| 201361810849 | United States of America | P | |
| 61871426 | United States of America | – | |
| 201361871426 | United States of America | P | |
| 61906289 | United States of America | – | |
| 201361906289 | United States of America | P |
Members43
| Document | Office | Kind | |
|---|---|---|---|
| WO2013103725A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2014204360A1 | United States of America | A1 | |
| WO2014175931A2 | World Intellectual Property Organization (WIPO) | A2 | |
| EP2801077A1 | European Patent Office (EPO) | A1 | |
| CN104246826A | China | A | |
| WO2014175931A3 | World Intellectual Property Organization (WIPO) | A3 | |
| JP2015510110A | Japan | A | |
| US2015219437A1 | United States of America | A1 | |
| CN104956439A | China | A | |
| EP2941772A2 | European Patent Office (EPO) | A2 | |
| JP2016503931A | Japan | A | |
| EP2801077A4 | European Patent Office (EPO) | A4 | |
| EP2941772A4 | European Patent Office (EPO) | A4 | |
| US9534884B2 | United States of America | B2 | |
| US2017108330A1 | United States of America | A1 | |
| US9739864B2 | United States of America | B2 | |
| CN104246826B | China | B | |
| US2018003793A1 | United States of America | A1 | |
| CN104956439B | China | B | |
| CN107861102A | China | A | |
| CN108231094A | China | A | |
| US10024651B2 | United States of America | B2 | |
| JP6396214B2 | Japan | B2 | |
| US2018328715A1 | United States of America | A1 | |
| JP2018185307A | Japan | A | |
| JP6429795B2 | Japan | B2 | |
| JP2018189657A | Japan | A | |
| JP6463582B2 | Japan | B2 | |
| EP2941772B1 | European Patent Office (EPO) | B1 | |
| EP3693755A1 | European Patent Office (EPO) | A1 | |
| JP2021081445A | Japan | A | |
| JP6907149B2 | Japan | B2 | |
| CN108231094B | China | B | |
| US11092662B2 | United States of America | B2 | |
| CN107861102B | China | B | |
| US2021356549A1 | United States of America | A1 | |
| JP7108331B2This record | Japan | B2 | |
| US11499816B2 | United States of America | B2 | |
| US2023148273A1 | United States of America | A1 | |
| EP2801077B1 | European Patent Office (EPO) | B1 | |
| US12130642B2 | United States of America | B2 | |
| US12188756B2 | United States of America | B2 | |
| US2025137772A1 | United States of America | A1 |
13 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for extension of timeJAPANESE INTERMEDIATE CODE: A601A601 | A601 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 7108331
- Application
- 29695
Titles2
- Japanese
- 相互に別々の信号修正センサを使用する光学誘導システムおよび方法
- English
- Optical Guidance Systems and Methods Using Separate Signal Correction Sensors
Classification
- CPC, 18
- G01S7/4911
- G01S5/16
- G01S7/4808
- G01S7/4816
- G01S7/4913
- G01S7/4914
- G01S7/4915
- G01S7/499
- G01S17/32
- G01S17/48
- G01S17/89
- G01S17/933
- G01S5/0045
- G01S5/0072
- G01S17/931
- G01S17/74
- G01S17/875
- G01S5/163
- IPC, 12
- G01S5 16
- G05D1 00
- G08G5 00
- G01S7 4911
- G01S7 4913
- G01S7 4914
- G01S7 4915
- G01S17 32
- G01S17 875
- G01S17 89
- G01S17 931
- G01S17 933
