A method for generating, recording and projecting a three-dimensional image of a scene

Method for generating, recording and projecting three-dimensional spatial images of scenes

The present invention relates to an optical system, in particular to a three-dimensional imaging system using a diffractive lens, a refractive lens or a diffractive/refractive lens.

Normal human vision can provide a sense of color and three-dimensional space (3D) for the space within the field of view. For the camera system to provide a 3D stereoscopic image or stereoscopic model that can be accepted by the viewer, it is necessary to understand stereo vision or the perception of space.

The stimulus to the spatial sensation is called the number of eyes, and there are two types. Monocular can form stereo vision with a single eye, including the relative size of the target, the relationship between them, the linear and aerial appearance, the distribution of light and shadow, the moving parallax of the target and the background, and the adjustment of vision. Binoculars use two kinds of coordinated actions between the eyes: the first is visual convergence, where the optical axis is controlled by muscles and can converge from the parallel state of the line of sight from a distance to a 23-point approach at a point of 150 mm. Convergence angle; the second is stereo vision, in which because there are two different visual viewpoints, the geometric shape of the image can create two different retinal images in the left and right eyes. The difference is due to parallax, that is, the relative displacement of the corresponding or equivalent image point on a target point from the optical axis due to its position in the binocular field of view.

The retinal image will be encoded into frequency-modulated voltage pulses, transmitted along the optical spirit, and the signal processing will be carried out on the middle lateral segment, and then on the visual cortex of the brain. The resulting visual perception is unique to the viewer. For further discussion of human 3D perception, see, for example, Sidney F. Sidney published by Focal Press. Ray's "Applied Photographic Optics Imaging System for Photography, Film and Video" (1988), pages 469-484, which are quoted here for reference.

Many conventional 3D imaging systems use parallax to create 3D effects. Section 65.5 of Rays work mentioned above and quoted here for reference has detailed descriptions of several parallax-based technologies, such as 3D movies, two side-by-side offset images Stereoscopic viewing, 3D post cards, etc. Although these parallax-based systems can provide a certain degree of 3D effects, they feel unrealistic.

Another known but far more complex technique for forming 3D images is panoptics. Although panoptics can produce quite realistic 3D images, its use is quite limited because it requires a coherent light source (such as a laser), and it needs to use darkroom or similar darkroom conditions to generate panoptic images.

The conventional technology called stereo photography to generate 3D uses an array of multiple small lenses (called fly eye or micro lens array) to generate and reproduce 3D images. The technique of stereo photography is in Ives, Herbert E. There is a detailed description in the article "Optical Properties of a Lippmann Lenticulated Sheet" published in Journal of the Optical Society of America 21(3): 171-176 (1931).

Other techniques for using micro lens arrays to generate 3D images can be found in "Discussion of the Optics of a New 3-D Imaging System", Davies, published by Yang et al. in Applied Optics 27(21):4529-4534 in 1988. "Three-Dimensional Imaging System: A New Development" published in Applied Optics 27(21):4520-4528 in 1988, Davies et al. in Optical Engineering 33(11):3624- "Design and Analysis of an Image Transfer System Using Micro-lens Arrays", page 3633, Benton, Stephen A.U.S. Patent No. 3,657,981 "Direct Orthoscopic Stereo Panoramagram Cameera" obtained in 1972, and U.S. Patent No. 3,852,787 obtained by Nims et al. in 1974. "Three Dimensional Pictures and Method of Composing Them" and U.S. Patent No. 5,040,871 "Imaging System" obtained in 1991 by Davies et al., each of which is incorporated herein for reference. The above are in miniature The lens array-based 3D optical system has a disadvantage that all the lenses in the array have a fixed focal length. This greatly limits the types of 3D effects that these arrays can produce.

In recent years, considerable progress has been made in the manufacture of very small-sized surface structures. The use of self-assembled monolayer (SAM) micro-mold printing technology has made it possible to manufacture sub-micron sizes (<10^-6M) structure.

Some compounds can spontaneously produce an ordered two-dimensional crystal array when placed in a suitable environment. For example, alkyl mercaptans show this characteristic on gold. Microprinting or microcontact printing uses a rubber' (polysiloxane elastomer) printer to selectively deposit alkyl mercaptans in small areas on the gold surface. The "mother" mold with the required structure shape and size is manufactured by the photoetching technique well known in the electronic art. Pour polydimethylsiloxane (PDMS), which is a polysiloxane elastomer, on the master mold and allow it to cure, then gently remove it. Then, the printer prepared in this way was coated with an appropriate alkyl mercaptan on the surface of the PDMS, and then inked. Then the PDMS printer is placed on the gold surface, and the desired alkyl mercaptan pattern is selectively deposited on the surface in the form of a single layer. These single-layer structures can be obtained with different head groups (exposed to the environment away from the metallic surface) to correct the characteristics of the surface.

In this way, very small-sized staggered hydrophilic and hydrophobic regions can be formed on a surface. Under proper conditions, when this surface is cooled in the presence of water vapor, condensed water droplets will be selectively deposited in the hydrophilic area. These water drops can be used as convergent or divergent miniature lenses. Lens elements of any shape can be manufactured. SAM can optionally be deposited on flat or curved surfaces, and these surfaces can be optically transparent or opaque. The deviation, adjacency, stacking or other arrangements between the SAM surfaces can be used to manufacture complex lens shapes.

Using a technology similar to the SAM technology discussed above, it can also use transparent polymers to make micro lenses. For example, a solution of an unpolymerized monomer (which is hydrophilic) can be selectively adsorbed in the hydrophilic area of the obtained SAM surface. Then start the polymerization operation there (for example, heating). By changing the shape of the resulting surface area, the amount of solution in the area and the composition of the solution, a variety of different lenses with different optical characteristics can be produced.

For examples of the use of liquid optical elements and SAM optical technology, see Kumar et al. in 1994 in Science 263: 60-62 "Patterned Condensation Figures as Optical Diffraction Gratings", Kumar et al. in 1993 in Appl. Phys. Lett. 63(14): 2002-2004, "Features of Gold Having Micrometer to Centimeter Dimensions Can be Formed Through a Combination of Stamping With an Elastomeric Stamp and an Alkanethiol'Ink' Followed by Chemical Etching", Kumar et al. 1994 Published in Langmuir10(5):1498-1511 in "Patterning Self-Assembled Monolayers: "Applications in Materials Science", Chaudhury et al. published "How to Make Water Run Uphill" in Science 256: 1539-1541 in 1992, and Abbott et al. published in Langmuir 10(5): 1493-1497 in 1994. "Potential-Dependent Wetting of Aqueous Solution on Self-Assembled Monolayers Fromed From 15-(Ferrocenylcarbonyl)pentadecanethiod on Gold" and "Control of the Shape of Liquid Lenses on a Modified" published by the Department of Chemistry of Harvard University, which is being printed by Gorman et al. "Gold Surface Using an Applied Electrical Potential Across a Self-Assembled Monolayer" and other articles, which are quoted here for reference.

The micro lens array can also be manufactured by several other known techniques. Some exemplary techniques for manufacturing micro-lens or micro-mirror arrays are provided in the following documents, and these documents are all quoted here for reference: Liau et al. published in Appl. 1994 in 1994. Phys. Lett. 64(12): 1484-1486 pages of "Large-Numerical-Aperture Micro-lens Fabrication by One-Step Etching and Mass-Transport Smoothing", Jay et al. published in Optical Engineering 33(11): 3552 in 1994 "Preshaping Photoresist for Refractive Micro-lens Fabrication" on page 3555, MacFarlane et al., published in IEEE Photonics Technology Letters 6(9): 1112-1114 in 1994, "Microjet Fabrication of Microlens Arrays", Stern et al. in 1994 Published in Optical Engineering 33(11):3547-3551 "Dry Etching for Coherent Refractive Micro-lens Arrays" and Kendell et al. published in Optical Engineering 33(11):3578-3588 "Micromirror Arrays Using KOH:H" in 1994₂O Micromachining of Silicon for Lens Templates, Geodesic Lenses, and Other Applications".

By using the above-mentioned micro-printing technology, it can be manufactured into a small lens with a variable focal length. Variable zoom can be achieved by several general devices, such as (i) by applying electric potential, (ii) by mechanical deformation, (iii) by selective deposition operations, such as depositing liquid water droplets from the water vapor phase (As described by Kumar et al. (Science 1994) above), and (iv) heating or melting (for example, the structure can be melted to change its optical properties, such as in some micro lens arrays, they are rough first It is molded out of the ground and then melted into a finer optical element).

The degree to which the solution wets or spreads on a surface can be controlled by changing the electronic properties of the system. For example, placing a microelectrode in a liquid lens and changing its potential relative to the surface can change the curvature of the lens. See the article by Abbott et al. above. In other structures, a hydrophobic liquid micro-lens is formed on a surface and covered with a layer of aqueous solution, and the surface potential can be changed with the aqueous solution. These systems provide volumetric lenslets (1nL) with reversible and rapidly changing focal lengths (see the article by Gorman et al. above).

Referring now to FIG. 3, a schematic diagram of a zoom lens 50 is shown. The variable focus lens 50 includes a liquid lens 52 and two SAM surfaces 54. The SAM surface 54 is attached to the liquid lens 52. As can be seen in the stepwise changes from Fig. 3(a) to Fig. 3(c), by changing the distance between the SAM surfaces 54, the shape of the liquid lens 52 and its optical characteristics can be changed. There are also several other methods that can be used to change the shape and optical characteristics of the liquid lens 52. For example, the potential between the lens 52 and the surface 54 can be changed to cause the shape of the lens 52 to change. This will be further explained in conjunction with FIG. 4 below. The refractive index of the lens 52 can be changed by using different liquid materials. The cohesion and adhesion of the liquid lens 52 can be adjusted by changing the chemical properties of the liquid material and changing the chemical properties of the surface 54. The three-dimensional characteristics of the surface 54 can also be changed. For example, when viewed from the top or bottom, the surface 54 may be circular, rectangular, hexagonal, or any other shape, and may move up and down. These technologies can be used alone or in combination to produce a variety of different lens shapes and optical effects.

Now refer to FIG. 4, which shows a schematic diagram of an electrically zoomable lens as disclosed in the article by Abbott et al. cited above. A drop of liquid 52 is dropped on the SAM surface 54 which is formed on a metallic surface 56, preferably gold. By changing the potential between the microelectrode 58 and the SAM surface 54, it will change the curvature of the liquid lens 52 (and therefore its optical characteristics). The gradual changes in Fig. 4(a) to Fig. 4(c) schematically show how the shape of the liquid lens 52 changes. The same effect can also be achieved by using the technique described in the article by Gorman et al., but without the use of microelectrodes 58.

Another way is to use a mechanical method to focus the micro lens. For example, a lens made of a flexible polymer or elastomer can be compressed and relaxed by a piezoelectric device to change its focal length. Another way is to enclose the liquid lens in a flexible housing, which can be compressed or relaxed mechanically.

The present invention provides a 3D optical system, which is different from the conventional technique in that it includes a zoomable micro lens array and an image that looks like an optical system with a considerable depth of field to obtain; that is, in the image, Objects at different distances within a given area can basically be focused and clearly. In another embodiment, the variable-focus microlens array can cooperate with a still or moving image to cause a change in the distance on the surface of the image. Another embodiment is to use a fixed array containing variable focal length elements to produce 3D and other optical effects.

<p>10Image (display)</p><p>12lens array</p><p>14Lens</p><p>15AObject</p><p>15BObject</p><p>15CObject</p><p>16ALight Cone</p><p>16BLight Cone</p><p>16CLight Cone</p><p>18ALight Cone</p><p>18BLight Cone</p><p>18CLight Cone</p><p>20Viewer</p><p>20AViewer</p><p>30Light Cone</p><p>50Variable zoom lens</p><p>52Liquid lens</p><p>54SAM surface</p><p>56Metal surface</p><p>58Microelectrode</p><p>60Camera</p><p>62Motorized optical device</p><p>64Input lens</p><p>66Output lens</p><p>68Controller</p><p>70Control circuit</p><p>72Video Recorder</p><p>74Memory</p><p>76Data line</p><p>78Control circuit</p><p>80Control circuit</p>

Figure 1 is a schematic diagram showing a 3D imaging system using a micro lens array according to a preferred embodiment.

Figures 2(a) to 2(c) are schematic diagrams showing the path of guiding light to the viewer under different conditions.

Figures 3(a) to 3(c) are schematic diagrams showing a technique for changing the focal length of a liquid micro lens by using SAM.

Figures 4(a) to 4(c) are schematic diagrams showing another technique for changing the focal length of a liquid micro lens by using SAM.

Figure 5 is a block diagram of a camera used to generate a two-dimensional image of the type used in the preferred embodiment.

The structure and function of this preferred embodiment can be understood by referring to the drawings. Readers can see that the same component reference numbers are used in multiple drawings. In this case, these reference numbers refer to the same or related structures. In a preferred embodiment, it uses a variable-focus microlens array, such as those manufactured using the technology described above, and cooperates with static or moving images with a considerable depth of field to produce a 3D effect.

Refer to Figure 2(a), the image seen by the human eye contains many very subtle points, which are perceived by people in a continuous detail. When the light falls on each object point, the light will be scattered, and the point will reflect out a light cone 30 in a diffuse manner (that is, the light extends out at a certain three-dimensional angle). When an object is viewed from a considerable distance by the viewer 20, a small portion of the light cone 30 will be received; and the received light rays will be almost parallel (see Figure 2(a): far focal length). However, when the viewing distance is shortened, the light received by the eyes of the viewer 20 becomes less parallel and is received at a larger divergence angle (see Figure 2(a): middle focal length and near focal length). focal length). The complex of the cornea and lens changes shape to focus on objects at different distances. For a more complete description of the above-mentioned type of diffuse reflection, see, for example, Tipler, Paul A.The book Physics for Scientists and Engineers, Third Edition, Extended Edition, pages 982-984, is quoted here for reference.

According to a preferred embodiment, it is covered by an array of micro-lens onto a two-dimensional photo or image in which all points of the image are in focus. Under proper lighting, this system can generate a cone of light with different divergence angles, and can simulate 3D space.

Since the photographic lens has only one main focus, there is only one plane in the photo that is really in focus; and images in front of or behind this plane will gradually lose focus. This problem can be reduced by increasing the depth of the field, but it can only be corrected to a certain degree.

Basically, the preferred embodiment of the present invention is applicable to images generated by an optical system with a large depth of field. For some images, placing the focal plane correctly and using the depth of the scene can get a sense of clarity on the entire image. In other situations, it needs more advanced technology to get the feeling that every point in the image is correctly focused. It can use an improved camera or digital imaging technology. For example, in an image, some areas that are out of focus can be focused by using a digital software-style sharpening filter.

Referring now to FIG. 5, there is shown a block diagram of a camera 60 for generating a two-dimensional image of the type used in the preferred embodiment of the present invention. The camera 60 includes a conventional motorized optical device 62 having an input lens 64 and an output lens 66. Although they are shown as convex lenses in the figure, those skilled in the art should understand that these lenses 64 and 66 can also be of any desired shape. The motorized optical device 62 can focus the image on the image recorder 72. The image can also be focused on the image recorder 72 by individually changing the distance between the image recorder 72 and the output lens 66, or coordinated with the adjustment operation of the motorized optical device 62. The image recorder 72 may be a charge coupled device (CCD), a light multiplier tube (PMT), a photodiode, a sudden collapse photodiode, a photographic film, a photographic plate, or other photosensitive materials. In addition, the image recorder 72 may be a combination of the above-mentioned optical recording or collecting devices.

The focal length of the motorized optical device 62 is controlled by the controller 68, and the controller is connected to the motorized optical device 62 by a control circuit 70. The controller 68 can be a microprocessor, a microcontroller, or other devices that can generate a digital or analog signal for controlling the focal length of the motorized optical device 70.

If the image recorder 72 is a digital device, the images captured by the image recorder 72 will be stored in the memory 74. If the image recorder 72 is a photographic or photosensitive material, the memory 74 is not required.

The memory 74 can be a semiconductor memory, a magnetic memory, an optical memory, or any other type of memory that can be used to store digital information. The video recorder 72 is connected to the memory 74 by a data line 76. The controller 68 can also control the memory 74 and the video recorder 72 via the control lines 78 and 80.

By using the camera 60, it can generate a clear area of collage to form a clear image at all points. For example, the video recorder 72 can be used to capture a series of digital images of the same scene, each of which is focused at a different distance. That is to say, the controller 68 will make the motorized optical device 64 cyclically change through a range of focal length (for example, from 5 meters to infinity), the image recorder 72 will capture images of the scene at different focal lengths, and the memory 74 will Save these captured images. The focal length of the motorized optical device 64 can be changed continuously or in a step-by-step manner, depending on the required conditions and images.

In addition, depending on the conditions and images required, it can capture one to hundreds of images. For example, if the image is completely on the far horizon, it will only need a far focal length image. Therefore, the entire shutter speed can be very short.

The camera 60 may be a still camera or a TV camera. The controller 68 can be used to sequentially change the motorized optical device 64 through any range of focal length, because the required focal length range may vary with the type of scene and the lighting conditions. If the camera 60 is used as a TV camera, the motorized optical device 64 must be designed to be able to operate quickly, because it must capture several images per second (each of which includes several different images). The image obtained at the focal length). In order to save time, the controller 68 can be programmed to cycle the motorized optical device 64 from the required closest focal length to the required farthest focal length to capture the image required to form a picture, and then motorized The optical device 64 cycles from the required farthest focal length back to the required closest focal length to capture an image required to form another frame. In all the following pictures, this process is repeated continuously.

The same segment of the scene stored in the memory 74 in each digital image (for example, a 5×5 pixel array) can be sampled for contrast ratio (the highest contrast ratio corresponds to the sharpest focal length). Then, each 5X5 high contrast ratio segment can be combined into a single image, which is roughly in focus in the entire scene. This can be done by more advanced software algorithms that can distinguish "continuous shapes" or objects, simplify the processing process and make it faster. This process can be carried out more easily in digital form (whether it is a digital analogous original signal or a digital original signal), but it can also be carried out in an analogous format (cutting and pasting).

Referring now to Figure 1, there is shown a preferred embodiment of the present invention. The objects 15A-15C represent the positions of several objects felt by the viewer 20 in the space. The distances between the objects 15A-15C and the viewer 20 are 22A-22C, respectively. The objects 15A-15C will also reflect light cones 16A-16C toward the viewer 20. As discussed above, when the light cone 16 reaches the viewer 20, the angle of its divergence will vary with the distance between the object 15 and the viewer 20. In order to form a 3D image of the object 15A-15C, an image 10 (which is preferably felt clearly in the entire area) is placed in alignment with the position of an array 12 formed by microlenses 14. However, this preferred embodiment can also be applied to an image 10 where not every point is clear.

The array 12 may be a substantially flat two-dimensional array, or it may be an array having a desired degree of curvature or shape depending on the curvature or shape of the image 10. The characteristics of each microlens 14 corresponding to each point or pixel on the image 10 are selected according to the focal length of the camera lens that makes the point or pixel on the image clear. The focal length of the micro lens 14 can be selected so that the light cone 18A-18C can replicate the light cone 16A-16C (based on the expected or known viewing distance measured from the micro lens, or based on changing the relative proportion of the perceived image or any Proportion). In this regard, the viewer 20A can see the same 3D image that the viewer 20 sees.

Since the image 10 can be regarded as a coherent 2D image when viewed by itself, the appearance of the image 10 can be changed or changed between 2D and 3D. If you want to watch 2D, the lens 14 in the array 12 can be removed or adjusted to be optically neutral. If you want to watch 3D, the lens 14 in the array 12 can be adjusted as described above.

A similar method can also be used to form 3D movies/TVs. As those familiar with this art know, television is achieved by quickly broadcasting images in a sequential manner. Therefore, it is necessary to create a sequential image that is in focus (or to a certain degree) on the entire image. To achieve this, it is necessary to use a television camera that can cycle quickly and continuously between the near focus and the far focus. Every clear image can be formed by the techniques discussed above (using depth of field, understanding of the scene, and collage techniques, etc.). In addition, smart software can also be used with still life or TV cameras, so that the depth of field and focus can be set in the loop according to the environmental conditions, pre-input preferences, and appropriate settings in the past (immediately before or in the entire past). The number of focusing steps is optimized. Other software/hardware processing methods can also be used to form clear images in the entire scene, or to the extent required. For example, the periphery of the scene can be selected to be out of focus.

Although the entire field of view of the human eye is quite large, the brain only pays attention to the middle part, and the peripheral part is basically out of focus. In an ideal situation, the image behind the micro lens array will be clear throughout the scene, so that the viewer can view the different parts of the scene that will be in focus when the viewer is correctly focused. However, there are still some situations where the entire image does not need to be clear. For example, in a TV image, when the viewer only looks at a specific field of view in the scene.

After capturing the desired TV image, 3D display can be achieved by placing the image behind the array formed by the variable focus lens 14, as discussed in Figure 1. In each picture in the TV image sequence, for each point or pixel of the picture, there is a corresponding focal length setting value on the lens 14 aligned with the pixel. When each picture is played out in sequence, each pixel will change its focal length to the proper predetermined setting value of the pixel of the picture.

Since each point or pixel has a corresponding lens or compound lens, the light from each pixel can be controlled to reach the eye at a predetermined angle corresponding to the 3D field depth required by the pixel. For any given situation, there may be multiple lens designs that can achieve the desired effect.

Referring again to Figure 2, an important consideration in the operation of the present invention is the distance between the eyes and the pixels. For near displays such as goggles (see Figure 2(b)), it requires a lens design that is different from the lens design required for farther displays (see Figure 2(b)). As shown in Figure 2(b) (medium and far focal length), the combination of its components (such as positive and negative lenses) moves relative to each other to produce the desired optical effect. Therefore, in one embodiment, there are multiple arrays that can move relative to each other to generate correct light output. For a more detailed description of the characteristics of the optical element assembly, see, for example, pages 43-49 of Ray's article (quoted above), which are quoted here for reference.

Consider the similar behavior of a diffuse reflection point and the focal point of a lens; if both the focal point and the reflection point are located at the same distance from the eye, the angle at which the light reaches the eye will be the same. Since the pupil of the eye is quite small, about 5 mm, only a small part of the diffuse reflection cone will be observed by the eye, and there is no need to "reconstruct" the light that has not been seen by the eye.

The above-mentioned technology may be used in such as television display screens, television images, television cameras, computer monitors, advertising displays such as counter tops and window displays, billboards, fabrics, interior decoration, popular style watches , Personal belongings, outdoor installations, disguise, jokes, amusement park rides, games, virtual illusions, books, magazines, post cards and other printed materials, art, sculpture, photography or household use may be needed Illumination effects that make light denser or spread out, and any other applications that require three-dimensional space or variable optical effects, and so on.

The computer monitor is generally placed close to the user, and the user's eyes are fixed at a single distance, which will cause tension in the eye muscles. In order to avoid eye strain and long-term damage, it is recommended to watch distant objects regularly. By using the present invention, the lens array can be adjusted to enable the viewer to adjust the focal length closer or farther when viewing the display screen. This change in the viewing distance (the display screen itself can be kept at the same distance) can be controlled by the user, or acted according to a predetermined algorithm (for example, it can cycle through a certain range in a slow and imperceptible way) To eliminate tension). This algorithm can also be used for medical purposes. The viewing distance can be adjusted to provide medical effects for certain muscle groups. This technique can also be applied to books or other near-field high-intensity work.

According to the present invention, one application of static 3D images is in the field of fine arts and collectibles. However, static images can also be used with fixed focal length lens arrays or zoomable arrays. By adjusting the focal length of the lens that matches the static image, special effects can be obtained. By changing the focal length of a static image in a fluctuating manner, it is possible to obtain weird works of art, as well as attractive images and advertisements. In particular, by selectively adjusting the viewing area that is important in appearance and maintaining the rest of the image as static-or vice versa, or changing the focal length and size of a certain area, this technology will be available To draw the viewers attention to a specific part of the image. For example, if the size of an object (measured as a percentage of the viewer's field of view) remains the same, and the viewer's eyes switch from near focus to far focus, the viewer's perception of how large the object will also change (That is, the viewer will feel that the object becomes larger). Similarly, if the size of an object (measured as a percentage of the viewer's field of view) remains unchanged, and the viewer's eyes switch from the far focus to the near focus, the viewer will feel that the object becomes smaller). This effect can be enhanced by adding a "reference" image-an image of an object of known size. Therefore, such a screen can be selectively changed, for example, in appearance size to capture the viewer's attention.

Surround or all-around horizons are very useful because they can eliminate irrelevant surrounding information and images that can distract attention. There are two general techniques that can be used to provide a full-edge surround view of the viewer's scene. The first is to use a relatively large or curved viewing screen (such as Sony's IMAX theater or planetarium) that is particularly suitable for viewing by a group of people. The second technique is to use separate viewing goggles or glasses. In this technique, a relatively small screen is set close to the eyes. The advantage of using micro-lens is that even at relatively close distances, it is still difficult for ordinary people to distinguish structures smaller than 100 microns-so if the micro-lens in the array is small enough (but it must be large enough to avoid excessive unnecessary Diffraction phenomenon), the screen can maintain an almost continuous state without the pixel effect. Since these screens are quite small, they can achieve the effect of a full-perimeter surrounding the horizon at low cost. In addition, if the screen does not completely occupy the entire viewing angle to eliminate distractions, it can also use a blackened area to surround the screen. Another way is that in some applications, it can be quite beneficial to use external viewing images. For example, a partially transparent display screen can be used to overlay the image taken from the surrounding environment on the displayed image (this can also be used in other embodiments, such as a head-up display). This display mode can be used for military and civilian use. In particular, the information can be displayed to the driver of a moving vehicle. When using goggles, this kind of display result can be seen by only one eye, or both eyes can see at the same time.

If the computer's display is produced in wrap-around goggles, the effective screen size will be the largest. The size of computer monitors has a tendency to gradually increase, because the total information/number of operations simultaneously executed on the computer is increasing. The computer monitor of the wrap-around goggles type allows the user to use the entire field of view as a desktop monitor. This can also be combined with 3D effects, as well as the tension reduction features described above.

In addition, goggles can provide a screen for each eye. This type of goggles requires proper parallax correction so that the two images can overlap each other and the viewer feels as a single image. The advantage of using two screens is that each can be set very close to its associated eye. These two images with different parallaxes can be obtained using a variety of improved camera systems (see Figure 65.10 in Section 65.5 of the article by Ray (quoted above)). Another way is to use a software algorithm to generate a second image from a single scene with different parallaxes. The dual-screen goggles can also be used without parallax corrected images-that is, the same appearance view is displayed on both eyes. This may cause some kind of program damage to the real 3D effect. However, the 3D effect is caused by many factors, and parallax is only one of them.

Referring to Fig. 1 again, the display 10 arranged behind the lens array 12 may be analog or digital, and it may be printing, drawing, typography, etc. It can be a photo or a slide, color or black and white, positive or negative, upside down or offset at any angle, or properly placed in its original form-it can emit or reflect light of any visible or invisible wavelength . It can be a lithograph, a sequential movie image, and it can be an XY plane in a two- or three-dimensional space. It can be a cathode ray tube, a liquid crystal display, a plasma display, an electrochromic display, an electrochemiluminescence display, or other displays known in the art.

The lenses 14 in the array 12 can be changed by the following: size; preferably from 1 cm to 1 micron.

Shape: preferably round, cylindrical, convex, concave, spherical, non-spherical, ellipsoid, linear, compound (for example, Freiny type) or any other known in this art Optical shape.

Construction; these lenses can be mainly reflective, mainly diffractive, or diffractive-reflective mixed design, such as in Missig et al. 1995, published in Applied Optic 34(14): 2452-1461 pages Those disclosed in "Diffractive Optics Applie to Eyepiece Design" are quoted here for reference.

The number of lenses in the array; these arrays can range from 2x2 to almost unlimited arrays, because the form of the lens array 12 can be a fairly large piece.

The number of lens elements used in each "pixel"; as known in the art, compound lenses are very useful in correcting optical aberrations, and are also very useful in different optical effects. For example, spherical aberration or chromatic aberration can be corrected, and a variable focal length lens optical device can be added to the array. In addition, it is also possible to use a fixed focal length array in front of a display, and then use a variable focal length lens array on top of the first array. Or in different application situations, different optical element designs can also be added to the same array.

Lens color: The lens can be colored or uncolored, and can be transparent for visible or invisible wavelengths. For example, it can use a stacked array of red, green and blue lenses. Another way is to use color display pixels on an achromatic lens.

The composition of the lens; as discussed above, these lenses can be made from a variety of materials in a variety of states. These lenses can be liquid solutions, colloids, elastomers, polymers, solids, crystals, suspensions, and the like.

Compression, relaxation, and deformation of lenses; these lenses can be deformed by electrical or mechanical (for example, piezoelectric) devices. The deformation can be used to control the effective focal length or to change other optical characteristics of the lens or lens system (such as aberration or alignment-the alignment can be between the lenses or aligned to the display).

Finally, multiple arrays can be combined or stacked to change or enhance different optical properties. These arrays can be curved or flat.

A variety of other different elements can also be included in these preferred embodiments. For example, filters can be used in the array, placed between the array and the display, and placed in front of the array. These filters can be integral, covering all or most of the pixels, or they can be aligned to only one pixel or a group of selected pixels. Of particular note are neutral density filters (such as liquid crystal display arrays). Other filters include color filters, gradient filters, polarizers (circular type and linear type), and others known to those skilled in the art.

In addition, various coatings can be added on the surface of different components of the present invention, such as anti-glare coatings (usually multi-layered ones). Other coatings can provide scratch resistance or mechanical stability, and protection from environmental factors.

Light blocking structures or materials can also be used to block unnecessary stray light and reflected light. For example, it may be necessary to optically isolate each pixel from neighboring pixels. In an embodiment, it uses SAM to form a micro-shield. For example, a micro lens located in a hydrophilic area can be surrounded by a hydrophobic area, and the surface of the hydrophobic area is selectively filled with light absorbing material. Another way is to use a micro-machined light blocking structure.

The elements of the invention can also have different optical properties. For some applications, it will use substantially transparent components and support materials-for example in a head-up display. In other cases, a mirror-like surface may be required-for example, as a backing material to maximize the use of reflected light, and as a mirror-like optical element. Other materials include semi-transparent mirrors/splitters, gratings, Friney lenses, and other materials known to those familiar with the art.

The size of the entire system can vary from a few microns to hundreds of meters or more. This system can be curved or straight. It can be in the form of a kit. It can be permanently fixed or portable. The screen can be folded or rolled up for easy transportation. These screens can be provided with a cover for protection, or they can be integrated into a complex unit (such as a laptop). This system can also be applied to simulators and virtual fantasy systems. This system can also be used as a rangefinder by matching the effective focal length of the array to the focal plane of the environment. This system can also be used as an advanced auto focus system. For example, this system can be used to quickly find the best focal length, because the miniature lens can focus more quickly on a larger mechanical camera lens, and can then set the lens to the correct focal length. This system can also be used for directional viewing of displays-for example by using a long effective focal length. This system can also be disposable.

An important consideration of the present invention is the type and direction of lighting. The lighting can come from the front (reflective) or from the rear (backlit), or from a number of different intermediate angles. It can have only one light source or multiple light sources. In some cases, it can use both reflective and bright backlight to represent a scene more accurately. For example, when looking from the room to the window, you can feel the strong backlight from the window, and the softer and directional reflected light of the shadow in the room. Combining backlight, reflected light, and intensity/neutral density filtering effects can provide a more realistic image. The directional reflected light can be focused only on a single pixel or a specific area, or it can be comprehensive (like a backlight). This light can be filtered, polarized, coherent or non-coherent. For example, the color temperature of daylight varies throughout the day. The light source corrected by daylight can be filtered to express the red tones of sunset images. This light can be placed in different positions (like the above-mentioned filter), or it can be emitted from different light sources known to those skilled in the art, including incandescent, halogen, fluorescent, mercury, flash, laser, natural daylight , Luminescent materials, phosphorescent materials, chemiluminescent materials, electrochemiluminescent materials, etc. In other embodiments, luminous lenses, liquid lenses, or lenses that cannot be properly treated with luminescent materials can also be used, especially in disposable systems. For example, consider a case where a liquid lens is placed on an electrode. Such a lens (if it contains an ECL patch) can be triggered to emit light.

In the foregoing, preferred embodiments are used to illustrate the present invention. However, the present invention is not limited to the illustrated and described embodiments. On the contrary, the scope of the present invention is defined by the scope of patent application attached below.