Method and apparatus for high-throughput inspection of large flat patterned media using dynamically programmable optical spatial filtering
Summary by NHIP
Programmable Fourier Filtering Inspection
The method projects an object image through a lens assembly to a Fourier plane where an electrically programmable spatial light modulator blocks periodic components. A feedback signal from the image plane electrically aligns the modulator to yield a filtered transform of predominantly non-periodic defects for detection.
Claim Score by NHIP
Abstract
In an inspection system for planar objects having periodic structures, programmable optical Fourier filtering in the focal plane of a telecentric lens system is used to directly identify physical phenomena indicative of non-periodic defects. Lens assemblies and a coherent optical source are used to generate and observe a spatial Fourier transform of a periodic structure in the Fourier plane. Optical Fourier filtering (OFF) is performed in the focal plane using an electrically programmable and electrically alignable spatial light modulator. The spatial light modulator with high signal to noise ratio is electrically reconfigurable according to a feedback-driven, filter construction and alignment algorithm. The OFF enhances any non-periodic components present in the Fourier plane and final image plane of the object. A system having a plurality of inspection channels provides high-throughput inspection of objects with small non-periodic defects while maintaining high detection sensitivity.

Term
Term ended
Expired 8 December 2023, 2.8 years ago.
- Priority and filed
- Granted
- Expired
- Today
17 claims: 1 independent, 16 dependent
- 1Broadest claimClaim Score 31, narrow(NHIP)In a method for an inspection system for detecting defects in a planar object having periodic structure, a method for providing a modifiable mask to enhance visibility of non-periodic structure in said planar object comprising:projecting, as an input spatial signal, an image of said planar object through a first lens assembly upon a Fourier plane to yield an optical spatial Fourier transform of said spatial signal of said planar object;electrically aligning to said periodic structure an electrically programmable spatial light modulator at the Fourier plane of said first lens assembly in order to block periodic components of said spatial Fourier transform and to yield a filtered optical spatial Fourier transform of predominantly non-periodic components, said spatial light modulator having sufficient resolution, optical energy throughput, and contrast to serve as an effective masking element;and projecting as an output spatial signal an image of said filtered optical spatial Fourier transform through a second lens assembly to an image plane to produce a filtered image to enhance visibility of said non-periodic structure to a spatial optical energy detector;wherein said electrically aligning step employs a converted optical signal from said image plane as a feedback signal.
96 paragraphs in 5 sections, as filed
CROSS-REFERENCES TO RELATED APPLICATIONS
0001Not applicable
STATEMENT AS TO RIGHTS TO INVENTIONS MADE UNDER FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT
0002Not applicable
REFERENCE TO A “SEQUENCE LISTING,” A TABLE, OR A COMPUTER PROGRAM LISTING APPENDIX SUBMITTED ON A COMPACT DISK
0003Not applicable
BACKGROUND OF THE INVENTION
0004This invention relates to the inspection of flat patterned media using optical techniques. More specifically, this invention relates to the automated optical inspection (AOI) of large flat patterned media, such as thin film transistor (TFT) arrays (the main component of liquid crystal flat panel displays (LCD)). Although the invention is applicable to the general case of inspection of any flat, periodically patterned media, it is particularly useful for the high throughput, in-line inspection of TFT arrays at various stages of their production.
0005During the manufacturing of LCD panels, large clear sheets of thin glass are used as a substrate for the deposition of various layers of materials to form electronic circuits that are intended to function as a plurality of separable, identical display panels. This deposition is usually done in stages, where in each stage, a particular material (such as metal, Indium Tin Oxide (ITO), Silicon, Amorphous Silicon, etc.) is deposited over a previous layer (or upon the bare glass substrate) in adherence to a predetermined pattern. Each stage includes various steps such as deposition, masking, etching, and stripping.
0006During each of these stages and at various steps within a stage, many production defects may occur, that may have electronic and/or visual implications for the performance of the final LCD product. Such defects include, but are not limited to: circuit shorts, opens, foreign particles, miss-deposition, feature size problems, and over and under etching. The most common defects, shown in <figref idref="DRAWINGS">FIG. 1</figref>, include: metal protrusion <b>110</b> into ITO <b>112</b>, ITO protrusion <b>114</b> into metal <b>116</b>, a so-called mouse bite <b>118</b>, an open circuit <b>120</b>, a short <b>122</b> in a transistor <b>124</b>, and a foreign particle <b>126</b>.
0007In a specific application domain, such as TFT LCD panel inspection, the article defects subject to detection are small (down to individual micrometers), thus requiring demanding defect detection limits.
0008However, mere detection of defects is insufficient. Detected defects must also be classified as process defects, i.e. minor imperfections, which do not undermine the performance of the finished product but are an early indication of the array manufacturing process drifting out of optimum conditions; reparable defects, which can be repaired to improve the array production yield; and finally killer defects, which disqualify the TFT array from further use.
0009In any conventional AOI system, there is always a compromise between a number of critical characteristics, such as the optical scanning resolution, tact time, detection limits, and cost. These characteristics determine the usefulness or type of application of the AOI instrument. Typically, one characteristic can be optimized or improved by compromising another. For example, the AOI system resolution can be increased, resulting in improved detection limits (smaller defects detectable); these improvements would, however, have an adverse effect on the time needed to complete the inspection (tact time) or the system cost. Conversely, for a different type of application, the detection limits can be relaxed (larger defects detectable) by lowering the system resolution, therefore achieving a shorter tact time and reduced system cost.
0010The inability of the present art to provide high detection sensitivity and tact time matched to the production speed at an acceptable price has imposed on the LCD industry the use of low performance, short tact time systems as in-line instruments. Higher detection sensitivity systems (always requiring long inspection times and incompatible with the production speed) could only be used as off-line instruments, capable of inspecting only selected TFT panels. This method of inspection is often referred to as the sampling mode of operation.
0011The operating resolution of an AOI system has a direct impact on its cost. For a short tact time, this cost increases almost exponentially with the increase in operating resolution. Therefore, for high-throughput, in-line applications at production speeds, where a short tact time is required, only comparatively lower resolutions have been feasible for the system.
0012For the application domain of interest, conventional AOI systems use variants of the pattern comparison technique used to detect the presence and location of defects. These methods take advantage of the periodical character of the object under test and directly compare regions spaced by the pattern period or its multiples.
0013Those skilled in the art may recognize that prior spatial domain image comparison techniques suffer from the pixelation effect, which always degrades the detection limits of the system. The pixelation effect, often interpreted as noise within an image, becomes especially significant in the vicinity of circuit features where rapid transitions of image intensity occur. This leads to false detections or masking of legitimate defects. These effects are highly undesirable since the inspection instruments are expected to have the highest detection sensitivity in the vicinity of TFT array features, such as transistors, data and gate line crossings. Pixelation suppression methods, such as those primarily based on sub-pixel interpolation and approximation techniques, are used as means to partially alleviate these shortcomings. These methods nevertheless fail to satisfy the demands of this particular application domain.
0014These inherent limitations have led developers to explore the promise of suppressing observable periodic patterns in the optical domain before pixelation is introduced by digitization of the object image for analysis. It is known, for example, that a well understood property of lenses is the ability to form a two dimensional Fourier spectrum of the object in the lens focal plane. The Fourier transformation occurs entirely in the optical domain before any digitization of the signal. This presents the opportunity to filter periodic patterns in the image spectrum in an optical, analog manner.
0015Optical filtering presupposes the availability of a suitable spatial light modulator (SLM) placed in the lens focal plane to selectively attenuate the intensity profile formed therein to yield an altered (filtered) image in the image plane. The final image would ideally be digitized through an image capture device, such as a Charge Coupled Device (CCD) sensor. In the particular case of a periodically patterned surface as the object to be inspected, the ideal focal plane intensity profile is a well defined grid of intensity peaks. By means of an ideal specialized filter on the focal plane to mask out these peaks, it was expected that the periodic components of the image would be attenuated while preserving non-periodic signal components, such as those caused by defects in the original pattern.
0016However, the success of this filtering is highly dependent on a number of the properties of the mask placed in the focal plane, including contrast ratio, spatial resolution, optical quality, and the ability to be reprogrammed with high speed. The lack of suitable technology to implement an SLM with the required properties has rendered the optical Fourier filtering principle impractical in the application domain of interest.
0017AOI equipment has been characterized by a variety of problems. Most of the implemented solutions are based on spatial domain pattern comparison techniques often used in combination with sensor-level pixel or sub-pixel precision alignment techniques.
0018U.S. Pat. No. 4,579,455 to Levy et al. describes an alignment and pattern comparison technique where a pair of 7×7 windows are considered on the test and reference images and a squared sum of errors over a multitude of possible 3×3 sub-windows within this window are computed. If the minimum error over these twenty-five combinations exceeds a threshold value, a defect is assumed. The method appears to be capable of compensating for alignment mismatch down to a sensor pixel level.
0019Arguing about the coarse alignment precision of the method by Levy et al., U.S. Pat. No. 4,805,123 to Specht et al. describes an improved alignment and comparison technique for the detection of defects. In this technique, large windows in test and reference images are used to compute a sensor pixel level correlation between a test image and a reference image. The resulting sampled correlation surface's minimum point is found and a quadratic function is fit to the surface in the neighborhood of this minimum point. Using the fitted quadratic function, a sub-pixel precision translation is obtained to align the test and reference images. The aligned images are compared by thresholding image differences on 2×2 sub-windows on the test and aligned reference images.
0020Variations and improvements on these basic techniques have also been proposed. For example, U.S. Pat. No. 5,907,628 to Yolles et al., among other things, points out the drawbacks of using the sampled correlation surface to find the minimum and argues that due to a coarse sampling of the surface this point may not correspond to the true minimum. Hence, they argue that the subsequent sub-pixel interpolation step would do little to improve the detected minimum and a false alignment would result, leading to false alarms in detection. Yolles et al. proposes to alleviate these problems by an elaborate comparison process based on improved comparison entities.
0021Although pattern comparison based instruments have been successfully used in the industry for certain applications, the compromise between the system speed (tact time) and accuracy (defect detection limits) has been a dominant factor imposing what has been considered fundamental limitations. This ever present compromise for conventional inspection methods limits the usefulness of these systems in the application domain of high-throughput, in-line inspection of large flat patterned media at production speeds, where there is concurrent demand for speed and detection sensitivity.
0022The so called Optical Fourier Filtering (OFF) (also known as Fourier Spatial Filtering) is a known and understood technique. The attempts to use OFF for repetitive patterned surface defect detection dates back to a paper by Watkins entitled “Inspection of integrated circuit photo masks with intensity spatial filters,” published in <i>Proceedings of the IEEE </i>vol. 57, No 9, (September 1969), wherein the properties of such spatial filters are described. This was followed by the invention reported in U.S. Pat. No. 4,000,949 to Watkins et al. describing fundamental aspects of basic OFF for patterned surface inspection.
0023As the technology to implement Fourier spatial filters proved feasible in certain application areas, a number of contributions followed. These include, for example, U.S. Pat. No. 4,806,774 to Lin et al., where a basic bright field illumination Fourier spatial filtering setup is described for microcircuit die inspection, and U.S. Pat. No. 5,383,056 and No. 5,627,678 both to Nishii et al., where particular lens arrangements with favorable properties are described. In U.S. Pat. No. 5,276,498 to Galbraith et al., another application of the Fourier spatial filter to highly periodic semiconductor wafer inspection is presented. The described system is designed for scanning a surface incorporating two regions with different light diffracting patterns. This surface is scanned by a narrow beam of light. The system implements a programmable SLM through the use of two successive stages of light valves, each stage being composed of a one-dimensional array of light valves forming linear stripes and being in transverse configuration to one another.
0024Another proposed system in U.S. Pat. No. 5,506,676 to Hendler et al. considers a spatial separator, such as a micro-mirror device, to redirect different parts of the lens focal plane information into different light intensity sensors for parallel analysis and The system does not incorporate an image capture device.
0025Other U.S. Patents which disclose relevant art include: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0026">U.S. Pat. No. 6,490,393 to Zhou, entitled Integrated optical multiplexer and demultiplexer for wavelength division transmission of information;</li><li id="ul0002-0002" num="0027">U.S. Pat. No. 6,137,570 to Chuang et al. entitled System and method for analyzing topological features on a surface;</li><li id="ul0002-0003" num="0028">U.S. Pat. No. 6,128,078 to Fateley entitled Radiation filter, spectrometer and imager using a micro-mirror array;</li><li id="ul0002-0004" num="0029">U.S. Pat. No. 6,084,671 to Holcomb entitled Surface analysis using Gaussian beam profiles;</li><li id="ul0002-0005" num="0030">U.S. Pat. No. 6,061,126 to Yoshimura et al. entitled Detecting system for surface form of object;</li><li id="ul0002-0006" num="0031">U.S. Pat. No. 6,046,808 to Fateley entitled Radiation filter, spectrometer and imager using a micro-mirror array;</li><li id="ul0002-0007" num="0032">U.S. Pat. No. 5,966,212 to Hendler et al. entitled High-speed, high-resolution, large area inspection using multiple optical Fourier transform cells; and</li><li id="ul0002-0008" num="0033">U.S. Pat. No. 5,822,055 to Tsai et al. entitled Optical inspection of a specimen using multi-channel responses from the specimen using bright and darkfield detection.</li></ul></li></ul>
0034Despite their inherent limitations, which cause high false alarm rates or limited sensitivity through relaxed thresholds, conventional pattern matching techniques have remained the dominant inspection techniques throughout the industry. This appears to be due to the nature of the sampling process, which does not attempt to perform 100% inspection at production speeds and does not emphasize the missed defect rate for the inspection system. However, the emerging application domain of high-throughput in-line optical inspection at production speeds imposes tighter speed and accuracy constraints, which are not achievable by such conventional systems at a practical cost.
0035Although OFF has been considered to be a candidate to achieve both speed and detection accuracy concurrently, its application has not been considered practical due to a range of problems. As the size and contrast of the target defects to be detected diminishes, the accuracy, optical quality, and contrast of the masking pattern used as the optical filter becomes crucial. Achieving this type of quality in the past has been impossible except through the use of either static masks (such as photographic films or holographic gratings) or through static or difficult-to-configure mechanical systems. Static masks remain unsuitable for the presently considered application domain, since the pattern on the material to be inspected often needs to be changed during the regular operation of an AOI instrument and static masks cannot be quickly reconfigured to inspect the object with the new pattern or compensate for the varying orientation of the same pattern.
0036Re-configurable mechanical systems such as the ones described in U.S. Pat. No. 5,742,422 to Drake and U.S. Pat. No. 5,970,168 to Montesanto et al. attempt to partially solve this problem while preserving optical quality. However, the resulting systems are unacceptably slow to reconfigure. Moreover, they are constrained with respect to the realizable masking patterns, usually limited to a restricted number of horizontal and vertical lines. The use of lines as the masking pattern also causes its own adverse effects, manifesting as parasitic ghosts of defects in the filtered images. Furthermore, the mechanical implementations of the Fourier filters are complex, costly, unreliable, and unacceptably large in size and, therefore, cannot be easily expanded. For example, it is desirable to provide for multiple parallel inspections of a large surface area within tight tact time requirements.
0037Electrically programmable SLM devices first emerged in the last decade, at first showing some promise in solving the high speed filter reconfiguration problem. However, the available devices, such as light valves and early forms of transmissive LCDs, could not meet desired performance specifications. These requirements include: <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0000"><ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0038">High contrast ratio and high optical quality (transparency/reflectivity and optical uniformity), to achieve very high spectral suppression and undistorted signal transmission, leading to desired detection limits;</li><li id="ul0004-0002" num="0039">High spatial resolution and small size, to be feasible within compact optical arrangements and thus make multiple channel operation realizable;</li><li id="ul0004-0003" num="0040">A large fill-factor to minimize mask surface effects (having the structure of a grid) which causes undesired parasitic diffraction patterns on the filtered image; and</li><li id="ul0004-0004" num="0041">Operability within a large range of incidence angles, required by large Field of View (FOV) optical channel arrangements, enabling the coverage of a larger inspection surface area with a smaller number of inspection channels.</li></ul></li></ul>
0042Therefore, these devices were not practical for use in the high-throughput, in-line optical inspection of large flat patterned media at production speeds, while also satisfying industry requirements for detection limits. Thus, the promise was unfulfilled.
SUMMARY OF THE INVENTION
0043According to the invention, in an inspection system particularly for inspection of planar structures, the optical Fourier filtering (OFF) principle is employed in conjunction with an electrically-programmable and electrically-realignable high-resolution, high-fill factor, high-contrast, high-uniformity, high-light throughput spatial light modulator (SLM) as a programmable Fourier mask. An image of the object to be tested is projected (by illumination using appropriate spatially coherent optical energy or the like) through a first lens assembly onto the Fourier plane at which is located an electrically programmable and electrically realignable Fourier mask or reflective element in the form of s spatial light modulator (SLM). The inverse Fourier transform is projected through a second lens assembly onto the final image plane. The SLM is programmed to invoke a single center spot on the SLM of a size appropriate to the center spot of the Fourier image, and the SLM spot is scanned around the center of the Fourier image to electrically center the SLM blocking pattern with respect to the incident Fourier image by using image intensity feedback from the optical signal as detected at the final image plane. Then the SLM is programmed to invoke an accurate rotationally alignable mask, such as a cross-hair set, centered with respect to the image. The cross-hair set or the like masks any optical radiation in alignment with the cross-hair set. The SLM pattern is then electrically rotated to rotationally align the SLM cross-hair pattern with the periodic pattern of the Fourier image by using image intensity feedback from the optical signal detected at the final image plane. Thereafter, the SLM is programmed to electrically scan and sample the Fourier image detecting, at the final image plane, the intensity profile for every element or line of elements of the Fourier image in accordance with the previously-determined alignment information. For inspection of an object to be tested, the reconstructed Fourier image intensity profile is programmed into the SLM as a mask of the periodic elements so that the Fourier image incident at the Fourier plane at which the SLM is located is masked and the position of non-periodic components, typically defects, are highlighted in the image projected on the final image plane.
0044Commercially available high resolution LCD spatial light modulators are employed for the first time in a system according to the invention.
0045The present invention specifically addresses the problem of optically inspecting large flat patterned media, such as high density TFT-LCD panels for production defects, in a high-throughput in-line mode of operation at production speeds, with target defect detection limits equaling systems operating at much slower speeds.
0046The present invention makes it possible to meet the required tact time and detection limit requirements concurrently by means of a system which has a considerably lower resolution than an equivalently sensitive conventional AOI instrument. In the present invention, lower resolution provides the speed required to meet the tact time while a plurality of parallel OFF inspection channels provides the detection sensitivity to meet the demanding defect detection limits.
0047The invention will be better understood by reference to the following detailed description in connection with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
0048<figref idref="DRAWINGS">FIG. 1</figref> is a top view of a portion of a large flat patterned medium with periodic transistor arrays under construction for illustrating possible non-periodic defects.
0049<figref idref="DRAWINGS">FIG. 2</figref> is a schematic diagram of a lens system illustrating a Fourier plane.
0050<figref idref="DRAWINGS">FIG. 3A</figref> is a photographic image of a TFT LCD array.
0051<figref idref="DRAWINGS">FIG. 3B</figref> is a photographic reconstruction of a Fourier plane image.
0052<figref idref="DRAWINGS">FIG. 4A</figref> is a photographic image of a region of an LCD lattice with defects and a marker.
0053<figref idref="DRAWINGS">FIG. 4B</figref> is a photographic reconstruction of the image plane image that has been filtered, revealing defects due to lack of periodicity.
0054<figref idref="DRAWINGS">FIG. 4C</figref> is a cross-sectional view of a low contrast “dark” defect as seen in <figref idref="DRAWINGS">FIGS. 4A and 4B</figref>.
0055<figref idref="DRAWINGS">FIG. 4D</figref> is a cross-sectional view of a low contrast “dark” defect as seen in <figref idref="DRAWINGS">FIGS. 4A and 4B</figref>.
0056<figref idref="DRAWINGS">FIG. 5A</figref> is a ray tracing diagram of a reflection mode device according to the invention.
0057<figref idref="DRAWINGS">FIG. 5B</figref> is a schematic diagram of the reflection mode device according to the invention.
0058<figref idref="DRAWINGS">FIG. 5C</figref> is a schematic diagram of a reflective mode device employing polarized light.
0059<figref idref="DRAWINGS">FIG. 6</figref> is a flow chart of an algorithm using the SLM and CCD image capture device to determine the correct filtering pattern.
0060<figref idref="DRAWINGS">FIG. 7</figref> is a schematic diagram of a four channel system of the present invention.
0061<figref idref="DRAWINGS">FIG. 8A</figref> is a functional diagram of a single imaging/optical filtering channel.
0062<figref idref="DRAWINGS">FIG. 8B</figref> is a functional diagram for multiple channel operation.
DESCRIPTION OF SPECIFIC EMBODIMENTS OF THE INVENTION
0063<figref idref="DRAWINGS">FIG. 2</figref> illustrates the general arrangement of a lens system illustrating optical Fourier transformation. When a periodically patterned surface, located in the object plane <b>210</b> of the lens system, is illuminated by collimated, spatially coherent light, it acts as a diffraction grating. The diffracted light <b>212</b> is integrated by the lens module <b>214</b> and an interferogram of the periodical structure is formed in the lens focal plane <b>216</b>. This interferogram later results in an image of the object plane after light reaches the image plane <b>218</b>. It is known that the interference pattern observed in the lens focal plane corresponds to the optical Fourier transform of the object plane. Due to this physical property, the lens focal plane is also referred as the Fourier plane. The size of the Fourier plane and thus the spatial frequency scale within the Fourier plane is determined by the design parameters of the first lens module and the wavelength of the illuminating light.
0064<figref idref="DRAWINGS">FIG. 3</figref> illustrates this property. <figref idref="DRAWINGS">FIG. 3A</figref> is an actual image of a TFT LCD array with a substantially periodic structure and <b>310</b> is a single cell. <figref idref="DRAWINGS">FIG. 3B</figref> illustrates the digitally captured image of the lens focal plane interferogram where <b>316</b> and <b>318</b> are the primary axes of periodicity. The central peak <b>312</b> corresponds to the uniform gray level component (DC), located at the exact center point of the pattern, as well as the low frequency unevenness due to illumination and sample reflectivity. The remaining peaks <b>314</b> correspond to the periodic components in the signal.
0065Masking (attenuating) selected regions of the interferogram comprises OFF and achieves the desired filtering effect in the final image. For periodic pattern inspection, this takes the form of masking the components of the interferogram <b>314</b> corresponding to the periodicity of the original signal while preserving transparency for the rest of the focal plane. This operation would suppress the energy of the periodic signal components while passing the signal energy corresponding to non-periodic components, which are identified as defects.
0066<figref idref="DRAWINGS">FIGS. 4A–4D</figref> illustrate the Fourier filtering operation. In <figref idref="DRAWINGS">FIG. 4A</figref>, a region of the LCD lattice with larger <b>412</b> and smaller <b>410</b> defects is illustrated. In <figref idref="DRAWINGS">FIG. 4B</figref>, the same lattice section filtered with a proper optical mask is illustrated and a marker optical fiber <b>414</b> is clearly visible.
0067<figref idref="DRAWINGS">FIGS. 4C and 4D</figref> illustrate cross sectional views of a low contrast “dark” defect <b>410</b>. The defect contrast is significantly improved and the filtered defect signal rises over the uniformly low background <b>416</b>. Since the optical Fourier filter has also eliminated the low spatial frequency background, a simple fixed threshold <b>414</b> is sufficient to perform defect detection. It can be observed that the periodic lattice is close to the camera noise level while the defects are clearly observable with distinguished signal-to-noise ratio (SNR).
0068An embodiment of the present invention targets the high-throughput, in-line inspection of large area flat patterned media such as high resolution TFT LCD panels at production speeds. A significant benefit provided by the present invention is the ability to meet detection limits substantially exceeding the system's optical and image capture resolution through innovative use of OFF. This results in a system which can equal the detection limits of slower, higher resolution conventional systems while achieving a scanning speed not realizable by such conventional systems.
0069Specifically, we have developed an AOI system which can detect low contrast defects only 20 digital units (DU) above the surrounding background (out of 256 DU for an 8-bit camera), of 3 μm equivalent size, with an optical and electronic system designed for 7.6 μm object plane resolution. The detection limit is improved to 2 μm equivalent defect size for medium contrast (˜100 DU above background) defects. These results are equally valid for defects which are adjacent to or within periodic features of the lattice including the transistors.
0070The high speed required to meet the demanding tact time is achieved through reduced system resolution, along with very simple and fast threshold-based digital processing, combined with a large FOV optics design. The system uses multiple identical imaging channels, each equipped with large FOV optics, to cover the entire inspection surface on multiple bi-directional inspection passes.
0071To meet the same demanding detection limits with the reduced system resolution and simple digital signal processing, the invention uses OFF in combination with a high resolution electrically programmable Liquid Crystal on Silicon (LCOS) SLM in the lens focal plane. The periodic components in the signal are suppressed down to camera noise level while illumination intensity is boosted to a level that would normally cause camera saturation. A very high defect SNR is thus achieved. To achieve this high SNR required by the subsequent detection stage, the SLM has to meet strict specifications as herein described.
0072<figref idref="DRAWINGS">FIG. 5A</figref> illustrates the telecentric lens design and optical arrangement for OFF which comprises an embodiment of the present invention. <figref idref="DRAWINGS">FIG. 5B</figref> illustrates the illuminator arrangement and the image capture device.
0073Referring to <figref idref="DRAWINGS">FIG. 5A</figref>, collimated, spatially coherent light generated using a semiconductor laser <b>532</b> and collimating optics <b>536</b> enters the optical path through a beam splitter <b>522</b> and a ¼ λ retardation wave-plate <b>524</b> to illuminate the area being inspected <b>526</b>. The light reflected from the surface of the area being inspected passes through a first lens assembly <b>520</b> and another beam splitter <b>518</b>, which is disposed adjacent to an electrically controllable reflective SLM device <b>516</b>. The SLM device <b>516</b> is placed in the focal plane of the first lens system. The light reflected from the SLM device <b>516</b>, which is filtered by the masking pattern downloaded to the SLM, is reflected by the beam splitter <b>518</b> and passes through a polarizer <b>514</b> and a second lens assembly <b>512</b> and is projected onto the final image plane <b>510</b>. In the final image plane <b>510</b>, a detector <b>540</b> provides a feedback signal <b>541</b> to the electrically controllable SLM <b>516</b> through a feedback network comprising a detector <b>540</b>, an image capture device <b>542</b>, a storage and processing device <b>544</b>, an input/output (I/O) device <b>545</b>, and an electronic servo control <b>546</b>. In particular embodiments, the detector <b>540</b> and image capture device <b>542</b> may be combined into a single CCD image capture device. Moreover, additional feedback loops <b>548</b> may be utilized. As will be described with reference to <figref idref="DRAWINGS">FIG. 6</figref>, below, the SLM <b>516</b> and the feedback network are used in an interactive fashion to determine and optimize the SLM filtering pattern, including electrical centering and rotational alignment of the SLM <b>516</b>.
0074The lens system is designed for 7.6 μm object plane resolution. The first lens has a focal length of 80 mm and the compound optical system composed of the first and second lenses has an f-number of 4.0. The detailed specifications of the lens system are given in Table 1, below. In this particular lens design, which is composed of two groups, the first group <b>520</b> is optimized to produce the required optical resolution (small spot size and minimal aberrations) in the lens focal plane and the compound first <b>520</b> and second group <b>512</b> of lenses are optimized to provide optical resolution matching the image detector resolution in the image plane <b>510</b>.
0075The lens system design is telecentric in order to maintain a consistent spatial frequency spectrum throughout the entire FOV and consequently uniform defect detection limits throughout the entire FOV.
0076As shown in <figref idref="DRAWINGS">FIG. 5B</figref>, another feature of the present invention is that a Time-Delay Integration (TDI) line scan CCD sensor <b>528</b> capable of bi-directional operation may be used. The TDI CCD sensor provides for increased light sensitivity, while the bi-directional property of the image sensor facilitates bi-directional imaging scans of the surface being inspected.
0077One embodiment of the present invention employs a collimated, spatially coherent light source in reflective bright field mode. Due to the use of a line scan CCD sensor, the illuminator is designed for an elliptical field of illumination over the surface being inspected. The light intensity profile is uniform along the long axis of the ellipse. Sizes of the illuminated area are selected to provide the required FOV and localization of light intensity peaks in the Fourier plane. This is achieved by means of a beam path folding mirror <b>534</b>, a collimator lens arrangement <b>536</b> and a single-mode semiconductor laser <b>532</b> producing 30–50 mW of output power. The illumination wavelength is optimized at 660 nm (red) to provide the best contrast compromise between various TFT array materials.
0078The present invention takes advantage of light polarization control to prevent illumination losses resulting from the two beam splitters present in one embodiment of device operation. This is achieved by means of a ¼ λ retardation wave-plate <b>524</b> and two polarizing beam splitters <b>516</b> and <b>522</b>. The complementary polarizer <b>514</b> is used as a clean-up element. This method reduces illumination losses by ˜16 times for this type of two beam splitter arrangement and renders the imaging task feasible with a commercially available single-mode semiconductor laser.
0079<tables id="TABLE-US-00001" num="00001"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="119pt" align="left" /><colspec colname="2" colwidth="98pt" align="left" /><thead><row><entry namest="1" nameend="2" rowsep="1">TABLE 1</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Object plane</entry><entry>31 mm Ø</entry></row><row><entry>Fourier plane</entry><entry>20 mm Ø</entry></row><row><entry>Input beam</entry><entry>Collimated, uniform illumination</entry></row><row><entry>Maximum FOV</entry><entry>±7.13°</entry></row><row><entry>EFL</entry><entry>80.0 mm</entry></row><row><entry>Fourier plane f-number</entry><entry>2.58</entry></row><row><entry>Wavelength</entry><entry> 660 nm</entry></row><row><entry>Object to first lens vertex*</entry><entry> 50 mm</entry></row><row><entry>Last lens vertex to Fourier plane</entry><entry>89.4 mm</entry></row><row><entry>First to last vertex length</entry><entry>48.2 mm</entry></row><row><entry>Fourier plane spot size</entry><entry>4.5, 4.4, 7.2, and 12.9 μm rms</entry></row><row><entry>Input plane wave angles for SS</entry><entry>(0°, 2.2°, 5.1°, and 7.13°)</entry></row><row><entry>Predicted Fourier plane SS for toler-</entry><entry>9.1, 9.6, 13.7, and 20.0 μm rms</entry></row><row><entry>ances</entry></row><row><entry>Barrel Ø</entry><entry>77.8 mm</entry></row><row><entry>Barrel length</entry><entry>85.7 mm</entry></row><row><entry>Element cosmetics</entry><entry>60/40 scratch/dig</entry></row><row><entry>AR coating</entry><entry>λ/4 MgF<sub>2 </sub>(Max R < 0.5%)</entry></row><row><entry>Estimated transmission</entry><entry>~94%</entry></row><row><entry>Proposed test</entry><entry>Spot size or MTF</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
0080<tables id="TABLE-US-00002" num="00002"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="133pt" align="left" /><colspec colname="2" colwidth="84pt" align="left" /><thead><row><entry namest="1" nameend="2" rowsep="1">TABLE 2</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Object plane</entry><entry> 31 mm Ø</entry></row><row><entry>Fourier plane</entry><entry> 20 mm Ø</entry></row><row><entry>Image plane</entry><entry>53.8 mm Ø</entry></row><row><entry>Input beam</entry><entry>f/4.0, telecentric</entry></row><row><entry>Magnification</entry><entry>1.72X</entry></row><row><entry>Inverse transform lens EFL</entry><entry>141.5 mm</entry></row><row><entry>Wavelength</entry><entry> 660 nm</entry></row><row><entry>Fourier plane to first inverse lens vertex</entry><entry> 60 mm</entry></row><row><entry>Last inverse lens vertex to image plane</entry><entry> 109 mm</entry></row><row><entry>Inverse lens first to last vertex length</entry><entry> 95 mm</entry></row><row><entry>Inverse lens barrel Ø</entry><entry> 82.0 mm</entry></row><row><entry>Inverse lens barrel length</entry><entry>113.6 mm</entry></row><row><entry>Nominal MTF performance at 38.5 LP/mm</entry><entry>74%, 75%, 72% and 71%</entry></row><row><entry>Input object field points</entry><entry>(0, 5.7, 12.1, 15.5 mm)</entry></row><row><entry>Predicted MTF performance at</entry><entry>50%, 55%, 56% and 34%</entry></row><row><entry>38.5 LP/mm with</entry></row><row><entry>tolerances (assumes worst</entry></row><row><entry>meridian TAN values)</entry></row><row><entry>Element cosmetics</entry><entry>60/40 scratch/dig</entry></row><row><entry>AR coating</entry><entry>λ/4 MgF<sub>2 </sub>(Max R < 1.5%)</entry></row><row><entry>Estimated Fourier inverse lens transmission</entry><entry>~92%</entry></row><row><entry>Proposed test</entry><entry>Spot size or MTF</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
0081The detailed operation of this polarization control scheme is illustrated in <figref idref="DRAWINGS">FIG. 5C</figref>. An S-plane polarized coherent beam from a laser is fed to the first beam splitter <b>522</b>, where almost total reflection is obtained. Then the reflected beam passes through a ¼ λ retardation wave-plate <b>524</b>, where it is converted into a circularly polarized beam. When the circularly polarized beam is reflected from the inspected surface <b>526</b> and passes through the ¼ λ retardation wave-plate for the second time it becomes polarized in the P-plane, perpendicular to the original polarization plane. This causes the reflected beam to be almost totally transmitted by the beam splitter <b>522</b> to the first lens assembly <b>520</b> and then through the second beam splitter <b>518</b> onto the surface of the SLM device <b>516</b>. The SLM rotates the polarization of the reflected beam by 90 degrees and thus, the beam is almost totally reflected from the second beam splitter <b>518</b>.
0082Although the invention is illustrated with a particular optical arrangement operating in a reflective filtering mode in the focal plane with a Liquid Crystal on Silicon (LCOS) or micro-mirror SLM device, this is only one possibility. Another feasible implementation is in a transmissive mode of operation where the focal plane is equipped with a transmissive SLM of comparable properties.
0083The targeted instrument performance is only possible through the use of an electrically programmable SLM device that meets very demanding performance requirements. Such a device has only recently become available and the present invention presents its first application in the domain of interest.
0084In a specific embodiment of the invention, the programmable optical Fourier filter uses a Vertically Aligned Nematic (VAN) homeotropic Liquid Crystal SLM or Electrically Controlled Birefringence (ECB) Mode Liquid Crystal on Silicon (LCOS) reflective SLM device. Suitable VAN homeotropic Liquid Crystal SLM devices are manufactured by: Philips Electronics of the Netherlands, having a U.S. office at Briarcliff Manor, N.Y.; Microdisplay of San Pablo, Calif. U.S.A.; TDMC of Chunan, Miaoli, Taiwan; and the ILA Devices Section of the JVC Components & Device Company, Japan. ECB Mode LCOS reflective SLM devices are manufactured by Hitachi Corporation of Japan, having a U.S. office at Norcross, Ga. However, a reflective or transmissive device of comparable properties can also be employed, if it satisfies the following specifications.
0085The SLM device employed provides a contrast ratio sufficient to effectively block periodic signal components while still passing non-periodic signal components of the dimensions of primary interest. Accordingly, a contrast ratio exceeding 500:1 is preferred. For embodiments specifying inferior defect detection limits (larger defects detectable) lower contrast ratios can be utilized. In practice, a contrast ration of about 300:1 is required for an instrument according to the invention to perform properly, although it is within the spirit and scope of the invention to employ a contrast ratio as low as 100:1 if other performance requirements are met and detection limits are relaxed. Moreover, the preferred device preserves this high contrast ratio across a wide range of incidence angles (≧±14 degrees). This range should at least support what is determined by the specific telecentric lens design. These properties permit a very high suppression of the periodic components in the original signal across the entire large FOV of the lens system. Hence, the illumination intensity can be significantly increased while the periodic components in the signal are kept below the image capture device random noise level. This leads to high defect SNR and permits the use of very straightforward digital signal processing techniques, such as simple thresholding, to achieve defect detection and sizing.
0086It is important that the SLM device provide a fill factor high enough to suppress parasitic diffraction due to the SLM itself The fill factor is the ratio (in percentage) of the SLM's electrically controllable surface area to its entire optically usable surface area. Since the inter-pixel spaces within the SLM act as a diffraction grating, a large fill factor value (approaching 100%) minimizes parasitic diffraction due to the SLM itself. Hence, a large fill factor, preferably ≧90% further improves the defect SNR achievable.
0087Optical uniformity and wavefront distortion across the surface of the SLM is another important property of the preferred SLM. The invention works more efficiently if the distortion does not exceed one λ over 20 mm. This results in non-distorted final images, which facilitates defect localization as well as prevents deterioration of defect SNR due to corruption of the light amplitude and phase.
0088The SLM used in accordance with the invention preferably has a high overall light throughput. The invention works more efficiently with at least 80% light reflectivity or transmissivity. This high light throughput makes the use of single-mode semiconductor lasers practical.
0089Another property of the employed SLM is its favorable size with adequate resolution. Having a 19.45 mm×14.59 mm active area with 1024×768 active pixels, the device sufficiently matches the lens design (providing a 20 mm×20 mm focal plane size). The resolution makes it possible to selectively attenuate individual peaks in the Fourier spectrum with minimum impairment of the system light throughput. The SLM physical size, while it provides the required resolution, also facilitates compact optical system design such that multiple channel instrument operation is feasible. The latter is one of the features that assists in meeting the requirements of the application domain considered. An SLM device with smaller size and larger number of active pixels would improve the operation of the present instrument and can be used provided it meets the remaining specifications.
0090The demanding defect detection limits required by the application domain of interest are unattainable without an optimal filter implemented in the lens focal plane. Apart from an electrically programmable SLM device of required specification, this system works more efficiently with an algorithm to determine the optimal masking pattern to be programmed into the SLM device. The filter optimization should take into account the following factors:
0091The filter pattern displayed on the SLM device should be sufficient to suppress the periodic components of the signal as much as practical while passing as much energy as possible from non-periodic defects, hence resulting in a high defect SNR.
0092Preferably the filter should be robust against: surface deviations from flatness, such as article tilt or curvature; unavoidable small rotations of the article in the object plane; and semiconductor laser wavelength drift.
0093In a specific embodiment, the algorithm according to the invention interactively uses the SLM, the CCD image capture device, and a feedback network to determine the optimized filtering pattern. The procedure is illustrated in <figref idref="DRAWINGS">FIG. 6</figref> in flowchart form. Note that the filtering pattern diagrams are not to scale and the rotational values are exaggerated for illustration purposes.
0094In order to derive and optimize the filtering pattern, a region of the substrate with the reference periodic pattern is placed under the field of view of the system (Step A). The substrate is mechanically aligned to the best possible extent, such as will be done during the actual inspection of the subsequent substrates for defects (Step B). Although a rotational correspondence to the alignment of the SLM is desirable for improved efficiency of the filter, such a correspondence is not necessary since the algorithm has a provision for compensating for any rotational misalignment. Subsequently, the substrate is moved along the web direction (along the direction of scanning of the line scan camera) so that across the web (perpendicular to the scanning direction of the line scan camera) a periodic region is observed on the CCD image capture device (Step C). The SLM device is kept completely reflective during this operation.
0095The following step is to determine the center axis of the optical system on the SLM (Step D). Again, although a prior mechanical alignment is desirable to have the main optical axis in close vicinity to the SLM center, only a coarse alignment is required. This step will compensate for any center misalignment of the SLM device. For this purpose, a single SLM pixel center spot is displayed on the SLM and the corresponding CCD energy is monitored while this center spot is made to scan the center area of the Fourier image. The spot location leading to the minimum energy in the final image plane corresponds to the optical center. This procedure makes use of the properties of the focal plane image such that the optical center will correspond to the DC component of the signal and hence the maximum energy peak. Accordingly, when this center spot is suppressed by the SLM spot mask, a significant energy drop will be observed in the final image plane.
0096Following center optimization, a rotational alignment verification is performed (Step E). This step is necessary to compensate for any rotational misalignment of the SLM around the optical axis with respect to the reference pattern alignment. It can also be used for the inspection of individual substrates in case no assumption is made about the rotational alignment of the pattern on a particular substrate. For this step, the SLM device is made reflective except a one pixel thin cross-hair mask pattern which is displayed on the SLM and centered with respect to the Fourier image. Accordingly, the center of the cross-hair pattern corresponds to the center location determined in step D. The CCD energy in the final image plane is monitored while the cross-hair pattern is rotated around its center axis. The angular search space is often limited to a small range wherein any misalignments are expected to lie. The angle of rotation leading to the minimum CCD energy is assumed to correspond to the correct value.
0097The subsequent two steps correspond to the determination of the interference peak separations along the rotationally compensated x′ and y′ axis. For example, to determine the peak separation along the x′-axis, the SLM is totally masked except for a thin reflective “window” along the y′-axis (Step F). This line shaped “window” is propagated along the x′-axis and an energy projection (Step G) is computed using the CCD energy for each window position. This profile is either thresholded or used in conjunction with a peak determination procedure to obtain the interference peak separation for the x′-axis. A very similar procedure is repeated to determine the y′-axis peak separation (Steps H and I). For some LCD lattices, the periodicity corresponding to the larger cell dimension may cause interference peaks which are too close to one another on the focal plane. Alternatively for this case, the described procedure may be used on the axis with the larger peak separation and prior knowledge of cell dimensions may be used to derive the value for the other axis.
0098After these steps, a useable filter is obtained (Step K) and can be applied in conjunction with the determined rotational alignment (Step N). The algorithm of the present invention may incorporate optional features, which may be used to further optimize the filter behavior for certain cases. One example is a rotational robustness feature (Step L), which can be used to increase filter robustness against small rotational misalignments of the pattern on the substrate, which may happen from sample to sample. It may especially improve system performance when such inter sample variations occur and when there is not enough time available to perform filter re-optimization. For this step, the base masking spot size is increased toward the SLM periphery in proportion to the distance from the pattern center. This is due to the fact that the displacement of individual interference peaks corresponding to a fixed rotation increases in value as one moves away from the center of rotation. Another example is use of a center cross-hair pattern to suppress the main axis of the interference pattern. It is understood that the shape and size of the mask provides selective suppression of the spectral peaks in the Fourier plane to provide improved selective spectral suppression.
0099The use of OFF with the specific lens design, illuminator, SLM device, and filtering algorithm achieves a very high defect SNR in the optically filtered final image captured by the CCD image capture device. In the digitized image, the periodic lattice residue is suppressed down to the sensor random noise level while all non-periodic defects stand out from a dark background. The defect intensity correlates to their size and contrast.
0100Hence, a very simple and fast digital processing of the captured image in the form of a fixed threshold, placed just above the noise level, can be utilized. This results in a simple and fast hardware implementation in the form of field programmable gate array (FPGA) firmware. The fast image processing is critical to meet the tact time requirements of the application domain. As a result of this processing, the presence, location, and size of the defects are obtained.
0101This is illustrated in <figref idref="DRAWINGS">FIG. 4C</figref> and <figref idref="DRAWINGS">FIG. 4D</figref>, where cross-sectional views of a low contrast “dark” defect <b>410</b> are shown. The defect contrast is significantly improved and the filtered defect signal rises over a uniformly low background <b>416</b>. Since the optical Fourier filter has also eliminated the low spatial frequency background fluctuations, a simple fixed threshold <b>414</b> is sufficient to perform defect detection and thus, cumbersome techniques of background correction or differential thresholding are not necessary.
0102The invention operates more efficiently and the validity of the applied optical filter is increased when mechanically and/or pneumatically constrained means are incorporated to move the inspected flat media (or the optical system), so that the deviation from flatness is less than 10 μm over a media span of 20 mm. Also, the rotational instability of the media while in motion should not exceed ±0.5 degrees.
0103The short tact time requirements of some application domains of interest are not realizable even with single channel, wide FOV optics. Therefore, the present invention operates more efficiently when multiple identical instances of wide FOV imaging channels incorporating OFF are used to concurrently scan multiple FOVs across the web direction in multiple passes. Such a configuration is illustrated in <figref idref="DRAWINGS">FIG. 7</figref> for a hypothetical 4 channel system. The channels <b>710</b>, incorporating all optical filtering, illumination and optics, are connected together through a very rigid and high precision gantry <b>712</b>. The entire area of the substrate <b>718</b> is covered in multiple passes <b>716</b> with either the gantry moving over substrate, or the substrate moving under the gantry.
0104One embodiment of the instrument covers a 2100 mm×1800 mm scan area with 10 imaging channels and 6 detection passes in 60 seconds tact time, achieving a 100% inspection of the surface with a low contrast defect detection limit of 3.5 μm.
0105<figref idref="DRAWINGS">FIG. 8A</figref> illustrates the functional system components for a single imaging/optical filtering channel. <figref idref="DRAWINGS">FIG. 8B</figref> illustrates the functional system components for multiple channel operation. The optical path includes the object plane <b>810</b>, the illumination beam splitter <b>812</b>, the first lens group <b>813</b>, the SLM <b>814</b>, the second lens group <b>816</b> and the image capture device <b>818</b>. In <figref idref="DRAWINGS">FIG. 8A</figref>, each individual channel is controlled by a Front End Processor (FEP) <b>826</b>. This is a processor board composed of one or more FPGAs associated with Synchronous Dynamic Random Access Memory (SDRAM) and Video RAM (VRAM). The FEP controls the laser illumination <b>832</b> through a laser driver module <b>824</b>, the SLM <b>814</b> through an SLM driver module <b>822</b>, and the CCD image capture device <b>818</b> through a transition module <b>820</b>. The FEP in turn is controlled by slower but more flexible general purpose computation hardware <b>828</b> acting as a Peripheral Processor Board (PPB) encompassing a general purpose central processing unit (CPU), memory, and permanent storage device. As seen in <figref idref="DRAWINGS">FIG. 8B</figref>, each FEP-PPB pair can be configured to control more than one camera channel <b>830</b> and <b>840</b> and multiple such pairs are used to perform multiple channel operation. Defect detection, preliminary classification, and image collection is performed at FEP-PPB level, while the System Control Board (SCB) coordinates data flow from multiple channels and provides the control signals to the X-Y-Z stage <b>838</b> through a specific computer controller board <b>836</b>. The stage <b>838</b> transports and constrains the media to be inspected to comply with the flatness and motion requirements of the imaging system. Alternatively, the imaging channels, instead of the media, may be moved along some particular axis. An example could be the movement of cameras along the z-axis for automatic focusing.
0106The invention has been explained with reference to specific embodiments. Other embodiments will be evident to those of ordinary skill in the art. It is therefore not intended that the invention be limited, except as indicated by the appended claims.
Contents5
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2008094616A1 | Cited by | United States of America | Pre-grant |
| US7436503B1 | Cited by | United States of America | Search report |
| US2011185322A1 | Cited by | United States of America | Pre-grant |
| US9041903B2 | Cited by | United States of America | Applicant |
| US10043259B2 | Cited by | United States of America | Applicant |
| US10388320B2 | Cited by | United States of America | Applicant |
| US7295303B1 | Cited by | United States of America | Search report |
| US11366307B2 | Cited by | United States of America | Applicant |
| WO2015157197A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2003128416A1 | Cites | United States of America | Search report |
| US4000949A | Cites | United States of America | Applicant |
| US4579455A | Cites | United States of America | Applicant |
| US4805123A | Cites | United States of America | Applicant |
| US4806774A | Cites | United States of America | Applicant |
| US5276498A | Cites | United States of America | Applicant |
| US5383056A | Cites | United States of America | Applicant |
| US5506676A | Cites | United States of America | Applicant |
| US5617203A | Cites | United States of America | Search report |
| US5627678A | Cites | United States of America | Applicant |
| US5742422A | Cites | United States of America | Applicant |
| US5822055A | Cites | United States of America | Applicant |
| US5907628A | Cites | United States of America | Applicant |
| US5966212A | Cites | United States of America | Applicant |
| US5970168A | Cites | United States of America | Applicant |
| US6046808A | Cites | United States of America | Applicant |
| US6061126A | Cites | United States of America | Applicant |
| US6084671A | Cites | United States of America | Applicant |
| US6128078A | Cites | United States of America | Applicant |
| US6137570A | Cites | United States of America | Applicant |
| US6490393B1 | Cites | United States of America | Applicant |
2 priority claims, no other members on record
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 39676003 | United States of America | A | |
| US20030396760 | – | – | – |
31 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Expire PatentEXP. | EXP. | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response to Election / Restriction FiledELC. | ELC. | |
| Mail Restriction RequirementMCTRS | MCTRS | |
| Restriction/Election RequirementCTRS | CTRS | |
| Preliminary AmendmentA.PE | A.PE | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Cleared by L&R (LARS)L128 | L128 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Initial Exam Team nnIEXX | IEXX |
5 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Lapse for failure to pay maintenance feesLapsedLAPS | LAPS | |
| Maintenance fee reminder mailedREMI | REMI | |
| AssignmentAS | AS |
Numbers
- Publication
- 07041998
- Publication, DOCDB
- 7041998
- Publication, EPODOC
- US7041998
- Application
- 10396760
- Application, DOCDB
- 39676003
- Application, EPODOC
- US20030396760
Titles
- English
- Method and apparatus for high-throughput inspection of large flat patterned media using dynamically programmable optical spatial filtering
Patent term adjustment
- A delay
- +289 daysthe office missed an examination deadline
- Applicant delay
- −30 days
- Net adjustment
- 259 days
Classification
- CPC, 9
- G01N21/95623
- B23Q39/048
- G01N21/21
- G01N2021/1772
- G01N2021/8477
- G01N2201/0612
- G01N2201/0675
- B23Q7/1494
- B23Q15/225
- IPC, 6
- G01N21 86
- G01N21 00
- G01M11 00
- G01N21 21
- G01N21 956
- G02F1 13
- USPC, 3
- 250559400
- 250548000
- 356237400