Video hologram and device for reconstructing video holograms
11 claims: 1 independent, 10 dependent
- 1Device for reconstructing scenes with videoholograms, with an optical system, comprising at least one real or virtual point- or line-shaped coherent light source and a lens being arranged in the direction of beam propagation downstream of the light source, and a videohologram comprising regularly arranged holographically encoded cells with at least one opening per cell, the amplitude and/or phase of said opening being controllable, and a viewing plane at the location of the light source image, characterized in that at least one viewing window (5) is generated in the viewing plane within a periodicity interval as the Fourier-Transformation of the videohologram (3), through which a viewer can see a three-dimensional scene as a reconstruction, and in that the extension of the viewing window corresponds maximal to the periodicity interval of one diffraction order at the location of the light source image.
Independent claims4
44 paragraphs, as filed
Th־ present invention relates to a video hologram and ־ device for reconstructing video X ״״ ־״ “ '־ ׳. ׳“״ “ ״- -- ״ .-״״ otherwise regular pattern with at least one opening per ceil, the phase or amphtude of said opening being controllable, and a viewing plane boated in the inrage plane ''<sup>9</sup>”for reconstructing video holograms using acousto-optical modulators (AOM) are known from prior ad (Stephen A. Benton, Joel S. Kelli״: Three dimensional display system US 5,172,251). Such acousto-optical modulators transform elect־״ signals optical wave fronts, which are recomposed in a vid״־ frame using deflection m״ors to form two-dimensional holographic areas. A scene visible for the viewer .־reconstruct^ from the individual wave fronts using further optical elements. The optical means us such as lenses and deflection elements, have the dimensions of ־״fructo scenes. Due to their great depth, these elements are voluminous and heavy, difficult to miniaturise them, so that their range of applications is limited.
Another possibility to generate large video holograms is provided by the so-calied .״ , ״״״:.J computer-generated holograms (CGH). In this method, known 00Z75698A1 and US 6,437,919 B1. small CGHs having a small pitch are an optical system. For this, in a first step, the required <sub>fa5</sub>t matrices having a small pitch (usually EASLM addressable spatial light modulators]), and then the matrices are suitable holographic medium and composed to form a large video optically addressable spatial light modulator (OASLM) is used as n a second step, the composed video hologram is reconstructed with coherent light, in transmission or reflection.
In the CGH with controllable openings arranged in a matrix or in an othenv.se regular pattern, known e.g. from WO 01/9561־ A1 or Fu/raya ef ai,
Md device־־, Proceedings ־ O T <sub>Meeling</sub> on Diffractive Optics. 1997, the diffraction on small openings taken Image of for encoding the scenes. The wave fronts emerging from the openings converge in object points of the three-dimensional scene before they reach the viewer.
“tiling method”, using from WO L composed with the help of information is written to [electronically <— reproduced on to a hologram. Usually, anj holographic medium. In a
The smaller the pitch, and thus the smaller the openings in the CGHs, the greater is the diffraction angle, i.e. the viewing angle. Consequently, with these known methods enlarging the viewing angle means to improve the resolution.
As is generally known, in Fourier holograms the scene is reconstructed as a direct or inverse Fourier transform of the hologram in a plane. This reconstruction is continued periodically at a periodicity interval, the extension of said periodicity interval being inversely proportional to the pitch in the hologram.
If the dimension of the reconstruction of the Fourier hologram exceeds the periodicity interval, adjacent diffraction orders will overlap. As the resolution is gradually decreased, i.e. as the pitch of the openings rises, the edges of the reconstruction will be distorted increasingly by overlapping higher diffraction orders. The usable extent of the reconstruction is thus gradually limited.
If greater periodicity intervals and thus greater viewing angles are to be achieved, the required pitch in the hologram comes closer to the wavelength of the light. Then, the CGHs must be sufficiently large in order to be able to reconstruct large scenes. These two conditions require a large CGH having a great number of openings. However, this is currently not feasible in the form of displays with controllable openings (see EP 0992163 B1). CGH with controllable openings only measure one to several inches.
with the pitches still being substantially greater than 1 pm.
The two parameters, pitch and hologram size, are characterised by the so-called space-bandwidth product (SBP) as the number of openings in the hologram. If the reconstruction of a CGH with controllable openings that has a width of 50 cm is to be generated so that a viewer can see the scene at a distance of 1 m and in a 50-cm-Wide horizontal viewing window, the SBP in horizontal direction is about 0.5 . 10<sup>6</sup>. This corresponds to 500.000 openings at a distance of 1 pm in the CGH. Assuming an aspect ratio of 4:3, 375,000 openings are required in the vertical direction. Consequently, the CGH comprises 3.75 . 10<sup>11</sup> openings, if three colour sub-pixels are taken into consideration. This number will triplicate if the fact is taken into account that the CGH with controllable openings usually only allows the amplitudes to be affected. The phases are encoded taking advantage of the so-called detour phase effect, which requires at least three equidistant, openings per sampling point. SLM having such a great number of controllable openings are hitherto unknown.
The hologram values must be calculated from the scenes to be reconstructed. Assuming a colour depth of 1 Byte for each of the three primary colours and a frame rate of 50 Hz, a CGH requires an information flow rate of 50 * 10<sup>12</sup> = 0.5 10 ״ Byte/s.
x fa״« nf data flows of this magnitude exceed the capabilities of todaZ ImputZby far and do thus not allow holograms to be calculated based on םZL. ״״Z transmuting־״־b- through data — בדד— calculate the entire hologram, but only suoh parts of it that can be seen dtredy by th ״arts that change. The kind of hologram which consists of addressab ZXTsJh ־־ the above-mentioned ־tiling hologram־, is disclosed in the above<sup>SU</sup> 'f ed oatent specification WO 01/95016 At. Starting point of the calculations is a
בב ״ ״ .-—.- ״ ״ ״ .- - ב״שב
The image is tracked as the viewer position changes by recalculation of the hologram part that generates the image for the new viewer posbon. However this partly nullifies the reduction in the number of computations.
.«־־. “ - — “ ״“ LX Arrangements with acousWtica! modulators are too volum.no־״ and as not be XZ to dimensions known from state-of-the-art flat displays; v.d־o holograms ״־eZ using the Wing method are two-stage proc־־־־־ which require enormou technical efforts and which cannot easily be reduced to desktop ^dimension, a arrangements based on SIM with controllable openings are too small to be ־ ZZct large scenes. There are —no large controHable SLM ץ extreme Xhes whidi would be needed for this, and this techndogy is further Umited by the computer performance and data network bandwidth available today ”־ an O iechve of the present invent»״ to circumvent the above-— disadvantages and to prov.e extended reai-time reconstmctions of video hoiograms at ככד x-—, .״—״־ , ־! ^־ ־־<sub>y</sub> a video hologram and a device for reconstructing vkteo holograms havingt ־׳ץ ־ Of Claim 1 Preferred embodiments of the invention are laid down in claims 2 .
X video hoiograms and devices for reconstructing video ־.״grams ״ controllable opening־ according to the present invention are charactensed ,״ that, the
1<־ least one viewing window is formed in a periodicity interval as a direc
- Video hologram, said viewing window .!owing a ewe to view a reconstruction of a three-dimensional scene. The maximal ץ־. of the wZg window corresponds to the periodicity i״t־™al in the pfane of the ־-״ Fourier transformation in the image pl־־״«־ ־״־- A frustum stretches between the hologram and the viewing window, said frustum containing the e״t.re threedimensional scene as Fresnel transform of the video hologram.
The viewing window in the present inventio״ is limited approximately to and positioned in reladon to one eye, an eye distance of a viewer or to another ״־,table
Now in this invention, another viewing window is provided for the other eye of the viewer.This is achieved by the fact that the observed light source Is displaced or added a second real or virtual, adequately coherent light source at another suitable position to form a pair of light sources in the optical system. This arrangement allows the threedimensional scene to be seen with both eyes through two associated vowing wmdows. The content of the video hologram can be changed, i.e. encoded. according to t e eye position in synchronism with the activation of the second viewing window. If several viewers view the scene, more viewing windows can be generated by turning on additional light sources.
As regards another aspect of the present invention of the device for reconstructing a video hologram, the optical system and the hologram-bearing medium are arranged so that the higher diffraction oniers of the video hologram have a zero point for the first viewing window or an intensity minimum at the position of the second viewing window. This prevents the viewing window for one eye to cross-talk the other eye of the viewer or to other viewers. It is thus taken advantage of the decrease in intensity of the light towards higher diffraction orders, which is due to the finite width of the openings of the hologram-bearing medium and/or the minima of the intensity distribution. The ״density distribution for rectangular openings, for example, is a sine־ function wh,ch raprdly decreases in amplitude and forms a sin־ function which decreases as the distance
The number of openings in the display determines the maximum number of values that must be calculated for the video hologram. The transmission of data from a computer or through a network to the display representing the video hologram is limited to the same number of values. The data flow rate does not substantially differ from the data flow rates known from typical displays used today. Now. this will be illustrated with the help of an example.
If the viewing window is reduced, for example, from 50 cm (honzontal) by 37.5 cm (vertical) to 1 cm by 1 cm by choosing a sufficiently low-resolution display, the number of openings in the hologram will drop to 1/1875. The required bandwidth is reduced .״ the same way during data transmission through a network. Video holograms created with known methods require 10<sup>12</sup> openings, while this number is reduced to 5 10<sup>8</sup> pixels in this example. The scene can be viewed in full through the remaining viewing window. These requirements on pitch and hologram size according to the space-bandwidth product can already be fulfilled by displays available today. This allows to inexpensively realise large real-time video holograms on displays with large pitch for a large viewing window.
The viewing window is tracked by mechanically or electronically displacing the light sources, by using movable mirrors or by using light sources which can be adequately positioned in any other way. The viewing windows are displaced according to the displacement of the light source images. If the viewer moves, the light source(s) is (are) spatially displaced so that the viewing windows follow the eyes of the viewer(s). This is to ensure that the viewers can also see the reconstructed three-dimensional scene when they move, so that their freedom of movement is not limited. Several systems are known for detecting the position of the viewers, e.g. systems based on magnetic sensors can be used beneficially for this.
This invention also allows to reconstruct a video hologram efficiently in colour. Here, the reconstruction is performed with at least three openings per cell, representing the three primary colours, amplitude or phase of said openings being controllable, and said openings being encoded individually for each of the primaiy colours. Another possibility of reconstructing a video hologram in colour is to perform at least three reconstructions one after another, namely for the individual primary colours, using the device of the present invention.
The present invention allows to efficiently generate holographic reconstructions of spatially extended scenes through controllable displays, such as TFT flat screens, in real-time and providing large viewing angles. These video holograms can be used beneficially in TV, multimedia, game and design applications, in the medical and military sectors, and in many other areas of economy and society. The three-dimensional scenes can be generated by a computer or in any other way.
An embodiment of the present invention is illustrated and explained below in conjunction with the accompanying drawings, wherein
Fig. 1 is a general illustration of a video hologram and a device for reconstructing^ video holograms showing the generation of the diffraction orders and the position of a viewing window;
Fig. 2 is a general illustration of a device for reconstructing video holograms showing a three-dimensional scene which can be viewed through a viewing window;
Fig. 3 is a general illustration of a device for reconstructing video holograms showing the encoding of the three-dimensional scene in a part of the video ׳hologram;
Fig. 4 is a diagram showing the light intensity distribution in the viewing plane depending on the diffraction orders; and
Fig. 5 is a general illustration of a device for reconstructing video holograms showing the position of the viewing windows for both eyes of a viewer with regard to the diffraction orders to prevent cross-talking.
A device for reconstructing video holograms comprises the hologram-bearing medium, a sufficiently coherent, real or virtual, point or line light source and an optical system. The video hologram-bearing medium itself consists of cells which are arranged in a matrix or in an otherwise regular pattern with at least one opening per cell, the phase or amplitude of said opening being controllable. The optical system for reconstructing the video hologram can be realised by an optical imaging system known in the art, consisting of a point or line laser or a sufficiently coherent light source.
Fig. 1 shows the general arrangement of a video hologram and its reconstruction. A light source 1, a lens 2, a hologram-bearing medium 3 and a viewing plane 4 are arranged one after another, seen in the direction of the propagating light. The viewing plane 4 corresponds with the Fourier plane of the inverse transform of the video hologram with the diffraction orders.
The light source 1 is imaged on to the viewing plane 4 through an optical system, represented by the lens2. If a hologram-bearing mediums is inserted, it is reconstructed in the viewing plane 4 as an inverse Fourier transform. The hologrambearing medium 3 with periodic openings creates equidistantly staggered diffraction orders in the viewing plane 4, where the holographic encoding into higher diffraction orders takes place, e.g. by way of the so-called detour phase effect. Because the light intensity decreases towards higher diffraction orders, the 1<sup>st</sup> or -1<sup>st</sup> diffraction order is used as the viewing window 5. If not explicitly expressed otherwise, the 1<sup>st</sup> diffraction order will be taken as a basis in the further description of the invention.
The dimension of the reconstruction was chosen here to correspond with the dimension of the periodicity interval of the 1<sup>st</sup> diffraction order in the viewing plane 4. Consequently, higher diffraction orders are attached without forming a gap, but also without overlapping.
Being the Fourier transform, the selected 1<sup>st</sup> diffraction order forms the reconstruction of the hologram-bearing medium 3. However, it does not represent the actual threedimensional scene 6. It is only used as the viewing window 5 through which the three dimensional scene 6 can be observed (see Fig. 2). The actual three-dimensional scene 6 is Indicated in the form of a circle inside the bundle of rays of the 1 “ diffraction order. The scene is thus located inside the reconstruction frustum which stretches between the hologram-bearing mediums and the viewing windows. The scenes is rendered as the Fresnel transform of the hologram-bearing medium 3, whereas the viewing window 5 is a part of the Fourier transform.
Fig 3 shows the corresponding holographic encoding. The three-dimensional scene is composed of discrete points. A pyramid with the viewing window 5 being the base and the selected point 7 in the scene 6 being the peak, is prolonged through this point and projected on to the hologram-bearing medium 3. A projection area 8 is created in the hologram-bearing medium s that point being holographically encoded in said projection area. The distances between the point 7 to the cells of the hologram-beanng medium 3 can be determined in order to calculate the phase values. This reconstruction allows the size of the viewing window 5 to be constrained by the periodicity interval. If, however, the point7 was encoded in the entire hologram-bearing mediums, the reconstruction would extend beyond the periodicity interval. The viewing zones from adjacent diffraction orders would overtap, which would result in the viewer seeing a periodic continuation of the point 7. The contours of a thus encoded surface would appear blurred due to multiple overlapping.
The intensity decrease towards higher diffraction orders is taken advantage of to suppress cross-talking to other viewing windows. Fig. 4 shows schematically a light intensity distribution over the diffraction orders, said distribution being determined by the width of the openings in the CGH. The abscissa shows the diffraction orders. The 1<sup>st </sup>diffraction order represents the viewing window 5 for the left eye, i.e. the left viewing window, through which the three-dimensional scene can be viewed. Cross-talking into a viewing window for the right eye is suppressed by the decrease in light intensity towards higher diffraction orders and, additionally, by the zero point of the intensity distribution.
Of course, the viewer can view the scene 6 of the hologram 3 with both eyes (see Fig. 5). For the right eye, the right viewing window 5’ represented by the -1<sup>st</sup> diffraction order of the light source 1׳ was chosen. As can be seen in the drawing, this light influences the left eye at a very low intensity. Here, it corresponds to the -6<sup>th</sup> diffraction order.
For the left eye, the 1<sup>st</sup> diffraction order corresponding to the position of the light source 1 was chosen. The left viewing window 5 is formed likewise. According to this invention, the corresponding three-dimensional scenes 6 and 6־ (not shown) are reconstructed using the light sources 1 and 1־ in a fix position in relation to the eyes. For this, the hologram 3 will be re-encoded when the light sources 1 and Γ are turned on. Alternatively, the two light sources, 1 and 1’, can simultaneously reconstruct the hologram 3 in the two viewing windows 5 and 5’.
If the viewer moves, the light sources 1 and Γ are tracked so that the two viewing windows 5 and 5’ remain localised on the eyes of the viewer. The same applies for movements in the normal direction, i.e. perpendicular to the video hologram.
Further, several viewers can view a three-dimensional scene if additional viewing windows are created by turning on additional light sources.
3 sheets
Sheet 1 Sheet 2 Sheet 3
75 members in 14 offices
Priority claims8
| Document | Office | Kind | Date |
|---|---|---|---|
| 10253292 | Germany | A | |
| 10253292 | Germany | A | |
| 0303791 | Germany | W | |
| 0303791 | Germany | W | |
| 102532923 | – | – | – |
| DE2002153292 | – | – | – |
| PCTDE2003003791 | – | – | – |
| WO2003DE03791 | – | – | – |
Members75
| Document | Office | Kind | |
|---|---|---|---|
| GB983644A | United Kingdom | A | |
| AT248254B | Austria | B | |
| DE1453719A1 | Germany | A1 | |
| DE1453719B2 | Germany | B2 | |
| WO2004044659A2 | World Intellectual Property Organization (WIPO) | A2 | |
| DE10353439A1 | Germany | A1 | |
| WO2004044659A3 | World Intellectual Property Organization (WIPO) | A3 | |
| KR20050055052A | Republic of Korea | A | |
| EP1563346A2 | European Patent Office (EPO) | A2 | |
| BR0316222A | Brazil | A | |
| BR0316222A | Brazil | A | |
| MXPA05005229A | Mexico | A | |
| MXPA05005229A | Mexico | A | |
| CN1711509A | China | A | |
| RU2005118086A | Russian Federation | A | |
| JP2006506660A | Japan | A | |
| US2006055994A1 | United States of America | A1 | |
| HK1087198A1 | Hong Kong, China | A1 | |
| US2006238836A1 | United States of America | A1 | |
| US2006238837A1 | United States of America | A1 | |
| US2006238838A1 | United States of America | A1 | |
| US2006238839A1 | United States of America | A1 | |
| US2006238840A1 | United States of America | A1 | |
| US2006238843A1 | United States of America | A1 | |
| US2006238844A1 | United States of America | A1 | |
| RU2293365C2 | Russian Federation | C2 | |
| US7315408B2 | United States of America | B2 | |
| KR20080035668A | Republic of Korea | A | |
| RU2007105102A | Russian Federation | A | |
| US2008252950A1 | United States of America | A1 | |
| CN100437393C | China | C | |
| CN101349889A | China | A | |
| KR100891293B1 | Republic of Korea | B1 | |
| DE10353439B4 | Germany | B4 | |
| RU2363025C2 | Russian Federation | C2 | |
| EP1563346B1 | European Patent Office (EPO) | B1 | |
| KR100915431B1 | Republic of Korea | B1 | |
| AT441877T | Austria | T | |
| ATE441877T1 | Austria | T1 | |
| DE50311875D1 | Germany | D1 | |
| HK1128338A1 | Hong Kong, China | A1 | |
| EP2138910A2 | European Patent Office (EPO) | A2 | |
| EP2138911A2 | European Patent Office (EPO) | A2 | |
| JP4473133B2 | Japan | B2 | |
| JP2010146019A | Japan | A | |
| US7839548B2 | United States of America | B2 | |
| IL168538AThis record | Israel | A | |
| US2011026089A1 | United States of America | A1 | |
| US7924484B2 | United States of America | B2 | |
| US7929189B2 | United States of America | B2 | |
| US8027071B2 | United States of America | B2 | |
| EP2138910A3 | European Patent Office (EPO) | A3 | |
| EP2138911A3 | European Patent Office (EPO) | A3 | |
| US2011304895A1 | United States of America | A1 | |
| CN101349889B | China | B | |
| US8174744B2 | United States of America | B2 | |
| CN102520604A | China | A | |
| US8314981B2 | United States of America | B2 | |
| US8384974B2 | United States of America | B2 | |
| JP2013156646A | Japan | A | |
| US2013265626A1 | United States of America | A1 | |
| JP5371801B2 | Japan | B2 | |
| US8941902B2 | United States of America | B2 | |
| US2015192899A1 | United States of America | A1 | |
| JP2015156029A | Japan | A | |
| JP5788427B2 | Japan | B2 | |
| CN102520604B | China | B | |
| JP6249977B2 | Japan | B2 | |
| JP2018028680A | Japan | A | |
| US9989920B2 | United States of America | B2 | |
| US2019137933A1 | United States of America | A1 | |
| EP2138910B1 | European Patent Office (EPO) | B1 | |
| JP6701143B2 | Japan | B2 | |
| US10884377B2 | United States of America | B2 | |
| EP2138911B1 | European Patent Office (EPO) | B1 |
1 legal event, as the office reported them to INPADOC
Events
| Event | Code | |
|---|---|---|
| Patent not in force due to non-payment of renewal feesMM9K | MM9K |
Numbers
- Publication, DOCDB
- 168538
- Publication, EPODOC
- IL168538
- Application
- 168538
- Application, DOCDB
- 16853805
- Application, EPODOC
- IL20050168538
Titles
- English
- VIDEO HOLOGRAM AND DEVICE FOR RECONSTRUCTING VIDEO HOLOGRAMS
Classification
- CPC, 13
- G03H1/08
- G03H1/00
- G03H1/16
- G03H1/2286
- G03H1/2294
- G03H2001/0858
- G03H2001/2236
- G03H2001/2242
- G03H2001/2271
- G03H2222/22
- G03H2222/34
- G03H2226/05
- G03H2210/30
- IPC, 2
- G03H1 08
- G03H1 22
