Two-dimensional and three-dimensional projecting
Summary by NHIP
Stereoscopic Image Adjuster
The apparatus adjusts two projector images differently based on whether they form a stereoscopic image. It controls brightness of non-overlapping wavelength bands, such as those centered at 435 nm and 475 nm, to manage white points or gamma values.
Claim Score by NHIP
Abstract
A processor adjusts a first image generated by a projector and a second image generated by the projector in a first manner if the first and second images together include a stereoscopic image, and in a second manner if the first and second images do not include a stereoscopic image.

Term
3.6 yearsleft in the term
Expires 9 May 2030, including 1,495 days of term adjustment.
- Priority and filed
- Granted
- Today
- Expires
22 claims: 4 independent, 18 dependent
- 1Broadest claimClaim Score 64, broad(NHIP)An apparatus comprising a processor to adjust a first image generated by a projector and a second image generated by the projector in a first manner to provide a first processed first image and a first processed second image for projecting on a projection screen if the first and second images together comprise a stereoscopic image;and to adjust the first image and the second image in a second manner to provide a second processed first image and a second processed second image for projecting on a projection screen if the first and second images do not comprise a stereoscopic image.
- 14A projector comprising a first image source to generate images in light having a first set of multiple wavelength bands, a second image source to generate images in light having a second set of multiple wavelength bands, and a processor to adjust a first image generated by the first image source and a second image generated by the second image source in a first manner to provide a first processed first image and a first processed second image for projecting on a projection screen if the first and second images together comprise a stereoscopic image;and to adjust the first image and the second image in a second manner to provide a second processed first image and a second processed second image for projecting on a projection screen if the first and second images do not comprise a stereoscopic image.
- 15A method comprising generating a first series of images in a first set of wavelengths and a second series of images in a second set of wavelengths, and if the first and second images comprise a stereoscopic image, adjusting the images in a first manner to provide a first processed first image and a first processed second image for projecting on a projection screen, and if the first and second images do not comprise a stereoscopic image, adjusting the images in a second manner to provide a second processed first image and a second processed second image for projecting on a projection screen.
- 22An apparatus comprising a light source, a first color filter to transmit light in a first three bands of wavelengths and reflect light in other wavelengths, a second color filter to transmit light in a second three bands of wavelengths and reflect light in other wavelengths, a first reflective imaging source to impart an image to light transmitted by the first color filter and direct the light to the second color filter, a second reflective imaging source to impart an image into light reflected by the first color filter and direct the light to the second color filter, and a lens to focus light from the second color filter onto a viewing screen in which the first and second three bands of wavelengths are the same.
Independent claims4
43 paragraphs in 3 sections, as filed
BACKGROUND
This description relates to two-dimensional and three-dimensional projecting.
Stereoscopic projection, commonly called three-dimensional (3D) projecting, delivers slightly different images to each eye of a viewer, which gives the illusion of depth when the viewer's brain assembles the two images into a single scene.
In a polarization-based 3D projection system, two projectors are used, one for each eye, and polarizing filters are used to polarize the light from each projector orthogonally to the other. The viewer wears glasses with corresponding polarizing filters, so that each eye receives only light projected from the corresponding projector.
In anaglyphic projection, the two images are each color-shifted, one into the red end of the visible spectrum and one into the blue end. The viewer wears glasses with red and blue filters, one for each eye, so that each eye sees only the image shifted into the corresponding color. The viewer's brain reassembles the two images into a single reduced-color image with the illusion of depth. Such a system also works with still images, which can be printed with the two color-shifted images overlaid.
A third approach projects alternating images for each eye, and glasses, for example with LCD shutters, actively block the view of the eye opposite the image currently being projected.
SUMMARY
In general, in one aspect, a processor adjusts a first image generated by a projector and a second image generated by the projector in a first manner if the first and second images together include a stereoscopic image, and in a second manner if the first and second images do not include a stereoscopic image.
Implementations may include one or more of the following features. The first image includes light having a first set of multiple wavelength bands and the second image includes light having a second set of multiple wavelength bands, the first and second sets of multiple wavelength bands not overlapping above 20% of peak intensity. The first and second sets of multiple wavelength bands do not overlap above 5% of peak intensity. Adjusting the images includes controlling an image attribute by adjusting brightness of subsets of the first and second sets of wavelength bands. The first set of wavelength bands includes a band of wavelengths having a center wavelength around 435 nm, a band of wavelengths having a center wavelength around 510 nm, and a band of wavelengths having a center wavelength around 610 nm. The second set of wavelength bands includes a band of wavelengths having a center wavelength around 475 nm, a band of wavelengths having a center wavelength around 550 nm, and a band of wavelengths having a center wavelength around 660 nm. The image attribute includes a white point of the composite image. The image attribute includes a gamma value of the composite image. The image attribute includes a contrast value of the composite image. The image attribute includes a brightness of the composite image.
Adjusting the first and second image in the first manner includes changing brightness of the first and second images by equal amounts. Adjusting the first and second image in the second manner includes changing brightness of the first and second images by different amounts. The processor is configured to adjust the images to control an image attribute of the projected light.
In general, in one aspect, a projector includes a first image source to generate images in light having a first set of multiple wavelength bands, a second image source to generate images in light having a second set of multiple wavelength bands, a processor to adjust a first image generated by the first image source and a second image generated by the second image source in a first manner if the first and second images together include a stereoscopic image, and in a second manner if the first and second images do not include a stereoscopic image.
In general, in one aspect, light having a first set of wavelengths is directed to a first image source, light having a second set of wavelengths is directed to a second image source, and an image attribute of a composite image formed from a combination of the light from the first and second image sources is adjusted by decreasing a brightness of light having a subset of the first set of wavelengths and of light having a subset of the second set of wavelengths.
In general, in one aspect, a first series of images is generated in a first set of wavelengths and a second series of images is generated in a second set of wavelengths. If the first and second images include a stereoscopic image, the images are adjusted in a first manner, and if the first and second images do not include a stereoscopic image, the images are adjusted in a second manner.
Implementations may include one or more of the following features. Determining whether the first and second images include a stereoscopic image by receiving an input from an external source of information. The external source of information is a person. The external source of information is a source of the images. Whether the first and second images include a stereoscopic image is determined by comparing the first and second images, and determining that they include a stereoscopic image if they are different, and determining that they do not include a stereoscopic image if they are the same. The first and second image are adjusted in the first manner includes changing brightness of the first and second images by different amounts. The first and second image are adjusted in the second manner includes changing brightness of the first and second images by equal amounts.
In general, in one aspect, a first three-color-band filter and a second three-color-band filter are configured to pass color bands such that, in a projection generated by a light source having uniform intensity over a broad spectrum of light, light that is not filtered by the first and second filters, and light that is filtered by the first and second filters have white points that differ by no more than 0.005 in x and 0.005 in y. In some implementations, the light source is a Xenon lamp.
In general, in one aspect, a first color filter transmits light in a first three bands of wavelengths and reflects light in other wavelengths, a second color filter transmits light in a second three bands of wavelengths and reflects light in other wavelengths, a first reflective imaging source imparts an image to light transmitted by the first color filter and directs the light to the second color filter, a second reflective imaging source imparts an image into light reflected by the first color filter and directs the light to the second color filter, and a lens focuses light from the second color filter onto a viewing screen. In some implementations, the first and second three bands of wavelengths are the same.
Advantages include the ability to use a single projector to project both 2D and 3D images. The color point of 2D projections can be optimized independently of the color point of 3D projections. The 3D projector is easy to maintain because the two image sources are aligned internally to a single device and do not have to be realigned during use.
Other features will be apparent from the description and from the claims.
DESCRIPTION
<figref idrefs="DRAWINGS">FIGS. 1 and 3</figref> are block diagrams of a projector.
<figref idrefs="DRAWINGS">FIGS. 2A-2G</figref> and <b>5</b>A-B are spectral graphs.
FIGS. <b>4</b> and <b>6</b>A-C are flow charts describing image adjustment methods.
In a typical digital projection system, for example system <b>100</b> in <figref idrefs="DRAWINGS">FIG. 1</figref>, a full-color image is created by generating three single-color component images that are simultaneously or sequentially projected to resolve into a single, full-color image when viewed by the audience. A single imaging device <b>102</b>, produces the component images based on an incoming video stream <b>103</b> using light received from a color wheel <b>104</b> that rotates red, green, and blue filters into the path of light <b>106</b> projected from a spread-spectrum (white) light source <b>108</b>, producing colored light <b>106</b>C. In some examples, the light sources include a bulb <b>116</b>, a reflector <b>118</b>, and a homogenizing device <b>120</b>. The homogenizing device <b>120</b>, for example, a light pipe, makes sure that the light reaching the color wheel <b>104</b> is uniform in brightness and color. The imaging device <b>102</b> could be a reflective device, such as a DLP light valve, or a transmissive device, such as an LCD panel (with appropriate changes to the layout of the projection system <b>100</b>).
The filtered and imaged light <b>106</b>I is then focused by a lens <b>110</b> onto a projection screen <b>112</b>, to be seen by a viewer <b>114</b>. As long as the imaging source <b>102</b> and color wheel <b>104</b> switch between component images and colors at the proper rate, the viewer <b>114</b> will perceive a single, full-color image. For example, to produce a full color image at 30 frames per second (fps), the imaging device must produce at least 90 single-color frames per second. The actual rate will depend on the frame-rate of the source material, the number of color segments in the wheel <b>104</b>, and the rate at which the wheel spins. For example, some projectors have more than three segments and spin the wheel 2, 4, or 8 times faster than the minimum needed, according to the number of segments. In some examples, three separate colored light sources are used or three imaging devices are used, one for each color. Each of these approaches can be combined with the others in various ways, for example, to project all three color components simultaneously.
A type of 3D projection is described, for example, in U.S. Pat. No. 6,283,597. Rather than polarize the images for each eye or shift each into a completely different color, the individual red, green, and blue components of each left- and right-eye image are constrained to a narrow band of that color, different for each eye, such that filters can be used to allow only the correct image to reach each eye while still allowing each eye's image to be composed of all three colors. <figref idrefs="DRAWINGS">FIGS. 2A and 2D</figref> show example sets of filtered color bands for two commonly used light sources. Xenon lamps are commonly used in cinema projection, while UHP (ultra high performance) mercury arc lamps are commonly used in home projectors. Images for the left eye are filtered inside the projector into bands <b>202</b>L, <b>204</b>L, and <b>206</b>L, shown separately in <figref idrefs="DRAWINGS">FIGS. 2B and 2E</figref>, while images for the right eye are filtered inside the projector into bands <b>202</b>R, <b>204</b>R, and <b>206</b>R, shown separately in <figref idrefs="DRAWINGS">FIGS. 2C and 2F</figref>. In each graph, the intensity values are normalized to 100 representing the potential intensity of unfiltered light. The transmission rates of the filters, independent of light source, are shown in <figref idrefs="DRAWINGS">FIG. 2G</figref>. Filters in the viewer's glasses transmit the appropriate bands for each eye, while blocking the bands used for the other eye. For good image separation, the bands for the left and right eye should not overlap, meaning that the bands do not have any wavelengths in common above approximately five percent of peak intensity, e.g., above point <b>213</b> in <figref idrefs="DRAWINGS">FIG. 2G</figref>.
For this type of projection, a similar projection system to that shown in <figref idrefs="DRAWINGS">FIG. 1</figref> can be used. Instead of the color filter wheel <b>104</b> having three colors, it has six, corresponding to the six bands <b>202</b>L, <b>204</b>L, <b>206</b>L, <b>202</b>R, <b>204</b>R, and <b>206</b>R. Alternatively, the three-color wheel can still be used, with a second filter or set of filters used to split each color into the two appropriate bands. In such a system, the image source produces six images per frame, i.e., red, blue, and green components for each eye. The viewer <b>114</b> wears glasses <b>116</b> with filters that allow each eye to see the three bands used for the corresponding image. Such a system has advantages of providing a full-color stereoscopic image over a wider viewing angle than systems using polarized light.
In some examples, as shown in <figref idrefs="DRAWINGS">FIGS. 3 and 4</figref>, two imaging sources <b>102</b>R, <b>102</b>L are used with two image streams <b>103</b>R, <b>103</b>L, one for each eye. A three-band spectral filter <b>302</b> is configured to transmit the three bands corresponding to the left eye and reflect all other light, including the three color bands corresponding to the right eye. Each of the imaging sources <b>102</b>R, <b>102</b>L produces the three component-color images for the corresponding eye, synchronized with the color filter wheel <b>104</b>, which filters incoming white light into a wide band for each color, encompassing both bands used for the right and left eye. A second three-band spectral filter <b>304</b> again transmits the bands for the left eye and reflects the rest, re-aligning the images from the two imaging sources before they reach the projection lens <b>110</b>. The extra light (outside the desired color band) in the right-eye image may cause ghosting in the perceived image, but can be filtered out by placing an additional filter in the path of the light immediately before or after imaging source <b>102</b>R to block light outside the right-eye bands. Three-band spectral filters <b>302</b> and <b>304</b> can be identical. An example of a design for such filters is given in a co-pending patent application Forming Spectral Filters of Barret Lippey et al, filed on the same day as this application and incorporated here by reference. This arrangement allows each imaging device to image only three images per frame, rather than six. <figref idrefs="DRAWINGS">FIG. 4</figref> abstractly shows the flow of light for one color. White light <b>106</b> is filtered into blue light <b>106</b>B by color wheel <b>104</b>. Blue light <b>106</b>B is split into a right-eye band <b>106</b>BR and a left-eye band <b>106</b>BL by three-band spectral filter <b>302</b>. After being imaged, the right-eye and left-eye bands <b>106</b>BR, <b>106</b>BL are merged to formed combined light <b>106</b>BRL by three-band spectral filter <b>304</b> and projected. Filters in glasses <b>116</b> re-separate the combined light <b>106</b>BRL back into right-eye and left-eye bands <b>106</b>BR, <b>106</b>BL.
The system of <figref idrefs="DRAWINGS">FIG. 3</figref> can be easily adapted to also project two-dimensional (that is, not stereoscopic) images. By putting the same image on both imaging sources, rather than a right-eye and left-eye image, both bands for each color will show the same image, and a single image will be projected. Unlike the 3D case, where no great degradation of the picture results if the images are not perfectly aligned, it is necessary when projecting two identical images in the 2D case to assure they are aligned within approximately 1 or 2 pixels accuracy. This is relatively easy in the example of <figref idrefs="DRAWINGS">FIG. 3</figref>, since the two imaging devices <b>102</b>R, <b>102</b>L are in a single assembly and use a single projecting lens <b>110</b>. The imaging devices <b>102</b>R, <b>102</b>L can be aligned at the factory, and no further adjustment should be necessary when the projector is installed.
In some examples, when projecting a 2D image, the images produced by the two imaging sources can be manipulated to adjust the white point of the resulting image so that it is different than the white point when projecting a 3D image. Adjusting the color point of a projected image is accomplished by decreasing the intensity of the image projected in certain frequency ranges, giving up brightness in exchange for better color accuracy. In a 3D mode, because the viewer is wearing filters in the 3D glasses, each eye is receiving only half the projected light, decreasing the brightness of the perceived image, as compared to the image viewed without the glasses. Any adjustment to the images that would change too far from the native colors could decrease the brightness below acceptable levels, so the trade-off is made in favor of brightness over color accuracy.
In a 2D mode, the viewer doesn't need the 3D glasses, and each eye can receive the full brightness of the projected image. The white point can be manipulated more during 2D projection without degrading the viewer's experience, as a larger decrease in brightness is possible without going below acceptable levels. For typical theater viewing conditions, a minimum brightness of approximately 12 foot-Lamberts has been established in the cinema industry. As long as the brightness does not drop significantly below that level, the iris of the human eye can make up for reduced brightness. Other attributes of the image can be adjusted in this way as well, for example, gamma, contrast, and brightness, e.g., to compensate for perceived differences in brightness between 2D and 3D projections.
This can be used to improve the color of the projected 2D image. For example, as shown in <figref idrefs="DRAWINGS">FIG. 5A</figref>, a UHP lamp has a spectrum <b>500</b> with a few peaks <b>502</b>, <b>504</b> in the blue and green bands. Without adjustment, the light composed of all six bands (<figref idrefs="DRAWINGS">FIG. 2D</figref>) passed by the filters has a white point of x=0.266, y=0.312. Decreasing the contribution of the blue and green bands by decreasing the brightness of the blue and green component images by 50% in the left and right imaging devices, as shown in FIG. <b>5</b>B, shifts the white point to x=0.307, y=0.319, which is a much more desirable color of white than the uncorrected color of <figref idrefs="DRAWINGS">FIG. 5A</figref>. Similar adjustments can be made for other bulbs or other targeted white points and chromaticities.
In some examples, a digital signal processor determines what adjustment is needed to the source image to produce the desired color point, and it adjusts the image data sent to the two imaging devices accordingly. The digital signal processor may be configured to manipulate the right-eye and left-eye components of a 3D image to keep the brightness high, while manipulating the components of a 2D image to get the specific color point desired at the expense of brightness. The processor may analyze the image streams to determine whether the projection is 2D or 3D, or it may have a specific input with that information. That input could be manual or could be data included with the image streams. The processor can also take into account the effect of the filters worn by the viewer during a 3D projection on the perceived color point. For example, the perceived color point may be different from the projected color point when 3D glasses are used, because each eye is provided with different information, and a system as described may compensate for this. The filters described in the co-pending application cited earlier happen to provide the same perceived white point in both 2D and 3D modes when the projection is done with a Xenon lamp, which has a relatively flat color spectrum, but provide different perceived white points between 2D and 3D modes with a UHP lamp, as described above. To avoid shifting the white point of a Xenon lamp, the filters provide very narrow gaps between the bands, for example, gaps of no more than 30 nm of wavelength at full-width half-maximum. In some useful examples, the difference in white point location for unfiltered light and the filtered light should be less than 0.005 in x and less than 0.005 in y.
In some examples, the color adjustments are computed as follows. A computational approach is used to map the R′, G′ and B′ brightness levels of individual pixels in the encoded video streams to the necessary R*, G* and B* signal levels used to drive a projector with primary chromaticities that differ from the encoded video stream chromaticities. The system is described assuming a numeric representation of the RGB levels, but an equivalent processing structure could be implemented in an analog signal processor. The notations used are shown in table 1.
<tables id="TABLE-US-00001" num="00001"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="49pt" align="left" /><colspec colname="2" colwidth="168pt" align="left" /><thead><row><entry namest="1" nameend="2" rowsep="1">TABLE 1</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>R′, G′, B′</entry><entry>Normalized (0 to 1) non-linearly encoded (gamma) RGB</entry></row><row><entry /><entry>levels of encoded video stream</entry></row><row><entry>R, G, B</entry><entry>Normalized (0 to 1) linear levels of RGB levels of</entry></row><row><entry /><entry>encoded video stream</entry></row><row><entry>X<sub>e</sub>, Y<sub>e</sub>, Z<sub>e</sub></entry><entry>Tristimulus values of the encoded stream pixels</entry></row><row><entry>R*, G*, B*</entry><entry>Normalized (0 to 1) non-linearly encoded RGB drive</entry></row><row><entry /><entry>levels to imaging device</entry></row><row><entry>R<sup>†</sup>, G<sup>†</sup>, B<sup>†</sup></entry><entry>Normalized (0 to 10) linear drive levels using</entry></row><row><entry /><entry>projector chromaticities</entry></row><row><entry>X<sub>d</sub>, Y<sub>d</sub>, Z<sub>d</sub></entry><entry>Tristimulus values of the imaging device while being</entry></row><row><entry /><entry>driven with specific R*, G*, B* levels</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
Using the notation described in table 1, the digital signal processor takes the R′G′B′ levels of each image pixel and computes the appropriate R*G*B* levels to be sent to the imaging device. One goal is for the displayed tristimulus values X<sub>d</sub>, Y<sub>d</sub>, Z<sub>d</sub>, to match the encoded tristimulus values X<sub>e</sub>, Y<sub>e</sub>, Z<sub>e</sub>, where possible.
The first processing step is to calculate the tristimulus levels associated with the encoded video stream R′G′B′. To compute the tristimulus levels, the non-linear encoding of the R′G′B′ levels must be inverted to yield the linear RGB levels. That non-linear mapping is defined as part of the video standard used to create the R′G′B′ signal.
A typical power function like R′ to R mapping is shown in <figref idrefs="DRAWINGS">FIG. 6A</figref>. Identical mapping functions would be used for G′ and B′ channels. Using the linear RGB levels, the tristimulus values for the encoded pixel can be calculated as follows. The initial encoding is defined by Eq. 1,
<maths id="MATH-US-00001" num="00001"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mi>e</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Y</mi><mi>e</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Z</mi><mi>e</mi></msub></mtd></mtr></mtable><mo>]</mo></mrow><mo>=</mo><mrow><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mrow><mi>red</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>red</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>red</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>green</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>green</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>green</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>blue</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>blue</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>blue</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd></mtr></mtable><mo>]</mo></mrow><mo></mo><mrow><mo>[</mo><mtable><mtr><mtd><mi>R</mi></mtd></mtr><mtr><mtd><mi>G</mi></mtd></mtr><mtr><mtd><mi>B</mi></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>1</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><br /> where X<sub>red,encode</sub>, Y<sub>red,encode </sub>and Z<sub>red,encode </sub>are the tristimulus coefficients associated with the red primary as defined in the video encoding standard. The other lines in the matrix of Eq. 1 correspond to the green and blue primaries defined by the video encoding standard.
Since the goal is to match the chromaticities of the projected image to the encoded chromaticities, the identity of Eq. 2 is established:
<maths id="MATH-US-00002" num="00002"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mi>d</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Y</mi><mi>d</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Z</mi><mi>d</mi></msub></mtd></mtr></mtable><mo>]</mo></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mi>e</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Y</mi><mi>e</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Z</mi><mi>e</mi></msub></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>2</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths>
A similar matrix operation to Eq. 1 is performed to map the tristimulus values into the linear R<sup>†</sup>G<sup>†</sup>B<sup>†</sup> levels associated with the display, as shown in Eq. 3,
<maths id="MATH-US-00003" num="00003"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mo>[</mo><mtable><mtr><mtd><msup><mi>R</mi><mi>†</mi></msup></mtd></mtr><mtr><mtd><msup><mi>G</mi><mi>†</mi></msup></mtd></mtr><mtr><mtd><msup><mi>B</mi><mi>†</mi></msup></mtd></mtr></mtable><mo>]</mo></mrow><mo>=</mo><mrow><msup><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mrow><mi>red</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>red</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>red</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>green</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>green</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>green</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>blue</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>blue</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>blue</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd></mtr></mtable><mo>]</mo></mrow><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mi>e</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Y</mi><mi>e</mi></msub></mtd></mtr><mtr><mtd><msub><mi>Z</mi><mi>e</mi></msub></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>3</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><br /> where X<sub>red,display</sub>, Y<sub>red,display </sub>and Z<sub>red,display </sub>are the tristimulus values of the red channel primary of the projector. The other lines in the matrix correspond to the green and blue channel primaries of the projector.
The linear R<sup>†</sup>G<sup>†</sup>B<sup>†</sup> levels are next mapped back into the encoded format that is associated with the imaging device. Showing only the red channel, a schematic process for this step is shown in <figref idrefs="DRAWINGS">FIG. 6B</figref>. It should be noted that the two matrix operations of Eqs. 1 and 3 can be pre-multiplied to form a single operation
<maths id="MATH-US-00004" num="00004"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mo>[</mo><mtable><mtr><mtd><msup><mi>R</mi><mi>†</mi></msup></mtd></mtr><mtr><mtd><msup><mi>G</mi><mi>†</mi></msup></mtd></mtr><mtr><mtd><msup><mi>B</mi><mi>†</mi></msup></mtd></mtr></mtable><mo>]</mo></mrow><mo>=</mo><mrow><mi>M</mi><mo></mo><mrow><mo>[</mo><mtable><mtr><mtd><mi>R</mi></mtd></mtr><mtr><mtd><mi>G</mi></mtd></mtr><mtr><mtd><mi>B</mi></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>4</mn><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mi>where</mi></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mi>M</mi><mo>=</mo><mrow><msup><mrow><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mrow><mi>red</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>red</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>red</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>green</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>green</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>green</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>blue</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>blue</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>blue</mi><mo>,</mo><mi>display</mi></mrow></msub></mtd></mtr></mtable><mo>]</mo></mrow><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mstyle><mtext /></mstyle><mo>[</mo><mtable><mtr><mtd><msub><mi>X</mi><mrow><mi>red</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>red</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>red</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>green</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>green</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>green</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd></mtr><mtr><mtd><msub><mi>X</mi><mrow><mi>blue</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Y</mi><mrow><mi>blue</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd><mtd><msub><mi>Z</mi><mrow><mi>blue</mi><mo>,</mo><mi>encode</mi></mrow></msub></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>5</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><br /> so that the tristimulus values need not be computed explicitly. The 3 processing steps required are shown schematically in <figref idrefs="DRAWINGS">FIG. 6C</figref>.
All of these adjustments, the color point correction and the right/left color bands, can be done to images at the point of projection, so that the source images do not have to be modified in any way to be used in such a system. Images originally intended for projection with a polarization-based 3D projection system can be used unmodified in the system described. If the images are produced with knowledge of the projection technology to be used, further enhancements could be achieved, for example, selecting the colors of the objects to be filmed to take advantage of the improved color definition of the six-color based projection system, or manipulating the colors in the images to create unnatural depth effects when projected and viewed. For the system described above, there will be two different M matrices, one for 2D projection and one for 3D, and they will be switched when the mode is switched. In 3D projection, the matrix coefficients account for the projection system, as described, as well as the three-band filters used in the projector and glasses, and the possible perceptual shifts that occur when different color information is presented to each eye.
Other implementations are within the scope of the claims. For example, the white source light could be split into two beams before being filtered, and transmissively filtered for both sets of color bands. The projection screen can be flat, curved, or domed. Using color-filter-based 3D projection is advantageous because the image separation remains the same over the entire screen, unlike polarization, which may vary.
Contents3
13 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13
Every citation, both waysCites: the store holds 45 of 46
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US8570319B2 | Cited by | United States of America | Search report |
| US9146402B2 | Cited by | United States of America | Applicant |
| US10809543B2 | Cited by | United States of America | Applicant |
| US2011176067A1 | Cited by | United States of America | Pre-grant |
| US2011205494A1 | Cited by | United States of America | Pre-grant |
| US2011080635A1 | Cited by | United States of America | Pre-grant |
| US11994702B2 | Cited by | United States of America | Applicant |
| US8537463B2 | Cited by | United States of America | Applicant |
| US11585971B2 | Cited by | United States of America | Applicant |
| US9958693B2 | Cited by | United States of America | Applicant |
| US2010060857A1 | Cited by | United States of America | Pre-grant |
| US2010067108A1 | Cited by | United States of America | Pre-grant |
| US8220938B2 | Cited by | United States of America | Search report |
| US8403489B2 | Cited by | United States of America | Search report |
| US2010328609A1 | Cited by | United States of America | Pre-grant |
| US8503078B2 | Cited by | United States of America | Applicant |
| US9921412B2 | Cited by | United States of America | Applicant |
| US8459796B2 | Cited by | United States of America | Search report |
| US2010073769A1 | Cited by | United States of America | Pre-grant |
| US8611005B2 | Cited by | United States of America | Applicant |
| US8237777B2 | Cited by | United States of America | Search report |
| US2011175904A1 | Cited by | United States of America | Pre-grant |
| US2010066976A1 | Cited by | United States of America | Pre-grant |
| US10802293B2 | Cited by | United States of America | Applicant |
| US2010328429A1 | Cited by | United States of America | Pre-grant |
| WO0023845A2 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO02076107A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO0232149A2 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| DE10359788A1 | Cites | Germany | Applicant |
| DE19924167A1 | Cites | Germany | Applicant |
| US2001028416A1 | Cites | United States of America | Applicant |
| US2002021832A1 | Cites | United States of America | Search report |
| US2002154404A1 | Cites | United States of America | Applicant |
| US2003020809A1 | Cites | United States of America | Applicant |
| WO2004038457A2 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO2005039192A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO2005109091A2 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO2006004342A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO2006016315A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| US2006119795A1 | Cites | United States of America | Applicant |
| US2007035707A1 | Cites | United States of America | Search report |
| US2007236809A1 | Cites | United States of America | Applicant |
| US2009219382A1 | Cites | United States of America | Search report |
| DE202005001077U1 | Cites | Germany | Applicant |
| US4734756A | Cites | United States of America | Search report |
| US5028121A | Cites | United States of America | Applicant |
| US5042921A | Cites | United States of America | Applicant |
| US5074645A | Cites | United States of America | Applicant |
| US5218386A | Cites | United States of America | Search report |
| US5347644A | Cites | United States of America | Applicant |
| US5537476A | Cites | United States of America | Search report |
| US5552840A | Cites | United States of America | Applicant |
| US5575548A | Cites | United States of America | Applicant |
| US5982538A | Cites | United States of America | Applicant |
| US6142624A | Cites | United States of America | Applicant |
| US6276801B1 | Cites | United States of America | Applicant |
| US6280034B1 | Cites | United States of America | Applicant |
| US6283597B1 | Cites | United States of America | Search report |
| US6309071B1 | Cites | United States of America | Applicant |
| US6624935B2 | Cites | United States of America | Applicant |
| US6650377B2 | Cites | United States of America | Applicant |
| US6672722B2 | Cites | United States of America | Applicant |
| US6698890B1 | Cites | United States of America | Search report |
| US6777070B1 | Cites | United States of America | Applicant |
| US6793341B2 | Cites | United States of America | Applicant |
| US6867775B2 | Cites | United States of America | Search report |
| US6945654B2 | Cites | United States of America | Applicant |
| US6972810B2 | Cites | United States of America | Applicant |
| US7241014B2 | Cites | United States of America | Applicant |
| JPH11281931A | Cites | Japan | Applicant |
| PCT International Search Report (EPO), Nov. 13, 2007, pp. 1-8. | Non-patent | – | Applicant |
| Woods et al., "Ghosting in anaglyphic stereoscopic images," Proceedings of the SPIE, 5291(1):354-365, 2004. Abstract only (IEE Database Accession No. 8283259). | Non-patent | – | Applicant |
| International Search Report and Written Opinion dated Sep. 15, 2006 from International Application No. PCT/US2005/043623. | Non-patent | – | Applicant |
| International Preliminary Report on Patentability dated Jun. 5, 2007 from International Application No. PCT/US2005/043623. | Non-patent | – | Applicant |
| International Search Report and Written Opinion dated Nov. 13, 2007 from International Application No. PCT/US2007/065858. | Non-patent | – | Applicant |
| International Preliminary Report on Patentability dated Apr. 11, 2008 from International Application No. PCT/US2007/065858. | Non-patent | – | Applicant |
| International Search Report and Written Opinion dated Feb. 22, 2008 from International Application No. PCT/US2007/065937. | Non-patent | – | Applicant |
| Action and Response History retrieved for U.S. Appl. No. 11/002,613, through Jun. 10, 2008. | Non-patent | – | Applicant |
| Action and Response History retrieved for U.S. Appl. No. 11/398,376, through Jul. 16, 2008. | Non-patent | – | Applicant |
| International Preliminary Report on Patenability dated Oct. 16, 2008 for related Appl. No. PCT/US07/065937. | Non-patent | – | Applicant |
| Jorke, et al. Infitec-A New Steroscopic Visualisation Tool by Wavelength Multiplex Imaging, www.infitec.net/infitec-english.pdf, Publication date unknown. Downloaded Sep. 20, 2005. | Non-patent | – | Applicant |
4 members in 2 offices
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 39840106 | United States of America | A | |
| US20060398401 | – | – | – |
Members4
| Document | Office | Kind | |
|---|---|---|---|
| US2007236617A1 | United States of America | A1 | |
| WO2007118075A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2007118075A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US7995092B2This record | United States of America | B2 |
67 transactions on the USPTO file
Allowed after 2 non-final rejections.
- Non-final rejections
- 2
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Payment of Maintenance Fee, 12th Year, Large EntityM1553 | M1553 | |
| Payment of Maintenance Fee, 8th Year, Large EntityM1552 | M1552 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Correspondence Address ChangeC.AD | C.AD | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Request for Classification Division DecisionTI1054 | TI1054 | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Transfer Inquiry to GAUTI1050 | TI1050 | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Withdraw Flagged for 5/25W525 | W525 | |
| Flagged for 5/25F525 | F525 | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Application Return from OIPEWROIPE | WROIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Application Return TO OIPEROIPE | ROIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Initial Exam Team nnIEXX | IEXX |
7 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Maintenance fee paymentMAFP | MAFP | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication
- 07995092
- Publication, DOCDB
- 7995092
- Publication, EPODOC
- US7995092
- Application
- 11398401
- Application, DOCDB
- 39840106
- Application, EPODOC
- US20060398401
Titles
- English
- Two-dimensional and three-dimensional projecting
Patent term adjustment
- A delay
- +1,094 daysthe office missed an examination deadline
- B delay
- +856 dayspendency past three years
- Overlap
- −424 daysdelays counted once
- Applicant delay
- −31 days
- Net adjustment
- 1,495 days
Classification
- CPC, 2
- H04N13/334
- H04N13/324
- IPC, 1
- H04N15 00
- USPC, 1
- 348060000