System for processing photographic images
Abstract
An apparatus and method for automatically adjusting density information of pixels contained in image data is disclosed. The image processing method includes the steps of dividing the image data into a plurality of regions based on color information of the pixels contained in the image data and adjusting density information of the pixels contained in at least one particular region among the plurality of regions.

Term
Term ended
Projected expiry passed 20 May 2019, 7.3 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
12 claims: 12 independent, 0 dependent
- 1An image processing method for image data containing pixels (P x ), said method comprising the steps of:dividing (S2) image data into a plurality of regions (A 1 , A 2 ) based on color information of the pixels contained in the image data;and adjusting (S3, S4) density information of the pixels contained in at least one particular region.
- 2The image processing method as defined in claim 1, wherein said step of dividing image data into the plurality of regions (A 1 , A 2 ) includes comparing the color information of the pixels (P x ) with predetermined thresholds.
- 3An image processing method for processing image data containing a plurality of pixels (P x ), comprising the steps of:mapping (S1, F) the plurality of pixels (P x ) into a plurality of points (Q x ) in a color space based on color information (d x ) for each of the pixels (P x );detecting (S2 a plurality of spaces (C i ) contained in the color space (40) according to a concentration of the plurality of points (Q x ) in the color space (40);adjusting (S3) average density information (d i ) of at least one particular space among the plurality of spaces (C i );and adjusting (S4) density information (d x ) of pixels (P x ) contained in the at least one particular space, based on the average density information (d i ) of the particular space.
- 4The image processing method as defined in one of the claims 1-3, wherein said step of adjusting (S4) density information (d x ) further comprises the step of adjusting density information (d x ) of pixels (P x ) in a portion of the image data corresponding to at least one of an over exposed portion and an under exposed portion.
- 7An image processing apparatus for processing image data including pixels (P x ) comprising:means for dividing (S2) the image data into a plurality of regions (A 1 , A 2 ) based on color information of the pixels (P x ) in the image data;and means for adjusting (S3, S4) density information of the pixels (P x ) in at least one particular region.
- 8The image processing apparatus as defined in claim 7, wherein said means for dividing (S2) said image data comprises means for comparing the color information of the pixels (P x ) with predetermined thresholds.
- 9An image processing apparatus for processing image data containing a plurality of pixels (P x ), comprising:means for mapping (S1, F) the plurality of pixels (P x ) into a plurality of points (Q x ) in a color space (40) based on color information (d x ) of each of said pixels (P x );means for detecting (S2) a plurality of spaces (C i ) in said color space (40) according to densities of said plurality of points (Q x ) in said color space (40);means for adjusting (S3) average density information (d i ) of at least one particular space from said plurality of spaces (C i );and means for adjusting (S4) density information (d x ) of pixels (P x ) in said at least one particular space based on said average density information (d i ) of said at least one particular space.
- 10The image processing apparatus as defined in one of the claims 7-9, wherein said means for adjusting (S4) density information (d x ) of the pixels (P x ) further comprises means for adjusting density information of pixels (P x ) in a portion of said image data corresponding to at least one of an over exposed portion and an under exposed portion.
Independent claims12
53 paragraphs, as filed
This invention relates to a system for processing a photographic image, and particularly to an image processing method and apparatus for automatically adjusting the density information of pixels contained in an image data set.
Conventionally, a photograph is provided by printing an image onto photographic paper where the image has been shot on a film using a camera. The film (specifically, a negative film) has exposure characteristics and these characteristics have some margin or variations considering the varied conditions at the time of shooting. However, the photographic paper on which the image will be printed does not have such exposure characteristics. Accordingly, an image appearing in the film may not appear exactly on the printing paper.
For example, in case of photographing a person's figure where the background contains a window into which bright sunlight shines, it is difficult to print both the person's figure and the background with appropriate densities. This is because if it is desired to print the person's figure on the photographic paper using an appropriate density, the background is likely to be whited out due to under exposure. Alternatively if it is desired to print the background on the photographic paper with an appropriate density, the figure is likely to be blacked out due to over exposure.
Previously, an operation called "masked printing" has been necessary for printing both the person's figure and the background onto the photographic paper when the film is shot using the conditions described above. This operation requires a high level of printing skill since it varies the light exposure of one part of the photographic paper from another part by exposing one part of the photographic paper while masking the other part. Accordingly, masked printing has a problem in that it should be done by a manual operation using experts and thus it is expensive.
Also, there is a problem that, if a film is photographed in conditions where it is under exposed or over exposed, it is necessary to appropriately adjust the duration for printing the photographed image on the film to obtain a good photograph print.
It is an object of the present invention to provide an image processing method and an image processing apparatus that makes the masked printing technique unnecessary by automatically adjusting the density information of the pixels containing the image data.
Further, it is another object of the present invention to provide an image processing method and apparatus that makes it unnecessary to adjust the duration for printing an image even when the image or part of the image is photographed with conditions where it is under exposed or over exposed.
An image processing method of the present invention comprises the steps of dividing the image data into a plurality of regions based on color information of pixels contained in the image data; and adjusting the density information of the pixels contained in at least one particular region among the plurality of regions, whereby the above objects are achieved.
Another image processing method of the present invention is an image processing method for processing image data containing a plurality of pixels and comprises the steps of mapping the plurality of pixels into a plurality of points in color space, based on color information for each of the pixels; detecting a plurality of spaces contained in the color space, in accordance with the concentration of the plurality of points in the color space; adjusting the average density information of at least one particular space among the plurality of spaces; and adjusting density information of pixels contained in the particular space, based on the average density information of the particular space, whereby the above objects are achieved.
The step of adjusting the density information of the pixels may further comprise the step of adjusting the density information of pixels contained in a portion of the image data corresponding to an over exposed portion or an under exposed portion of a film.
An image processing apparatus of the present invention comprises means for dividing image data into a plurality of regions based on color information of pixels contained in the image data; and means for adjusting the density information of the pixels contained in at least one particular region among the plurality of regions, whereby the above objects are achieved.
Another image processing apparatus of the present invention is an image processing apparatus for processing image data containing a plurality of pixels and comprises means for mapping the plurality of pixels into a plurality of points in color space, based on the color information for each of the pixels; means for detecting a plurality of spaces contained in the color space, in accordance with the concentration of the plurality of points in the color space; means for adjusting the average density information of at least one particular space among the plurality of spaces; and means for adjusting density information of pixels contained in the particular space, based on the average density information of the particular space, whereby the above objects are achieved.
The means for adjusting the density information of the pixels may further comprise means for adjusting the density information of pixels contained in a portion of the image data corresponding to an over exposed portion or an under exposed portion of a film.
According to the present invention, based on the color information of pixels contained in the image data, the density information of the pixel is automatically adjusted. The masked printing technique previously used by experts thus becomes unnecessary.
According to further aspects of the present invention, the density information of the pixels contained in the portion of the image data corresponding to the under exposed or over exposed portion of the film is automatically adjusted. Thereby, even if the film is photographed with under exposed or over exposed conditions, it becomes unnecessary to adjust the time duration for printing the photographed image onto the photographic paper.
The above and other objects and features of the present invention will be clearly understood from the following description with respect to preferred embodiments thereof when considered in conjunction with the accompanying drawings, wherein the same reference numerals have been used to denote the same or similar parts or elements, and in which: <ul id="ul0001" list-style="none"><li>Figure 1 is a block diagram showing the configuration of an embodiment of the image processing apparatus according to the present invention.</li><li>Figure 2 is a flowchart schematically showing the adjustment processing program.</li><li>Figure 3 is a schematic diagram describing mapping pixels P<sub>X</sub> to points Q<sub>X</sub> in a color space.</li><li>Figure 4 is a schematic diagram showing an example of the distribution of the points Q<sub>X</sub> in the color space.</li><li>Figure 5 is a schematic diagram for describing detection of the spaces C<sub>1</sub> and C<sub>2</sub> in the color space.</li><li>Figure 6 is a schematic diagram showing the relationship between the average density information d<sub>i</sub> of the space C<sub>i</sub> and the new average density information d<sub>i</sub>' of the space C<sub>i</sub>.</li></ul>
The general principles of the present invention will now be explained. For automatically using a masked printing technique, it is critical to determine which part of an image is to be masked. Accordingly, for automatically performing masked printing, it is necessary to automatically dividing image data into a region to be provided with a mask and a region that does not need to be provided with a mask.
This invention uses the color information of the pixels contained in the image data to divide the image data into these regions. The color information of the pixels is represented by a set of components, e.g. red, green and blue that represent the three primary colors.
A photographed subject (object) can be a solid, for example. Alternatively, if the subject (object) is a plane, it is often photographed with depth. In such cases, the difference in density appears in the object image. For example, shading appears at a spherical surface of a red sphere subjected to light from a certain direction, while the color of the sphere is kept red regardless of the shading.
Accordingly using such a way of thinking and applying it to colors, it is possible to divide the image data into a plurality of regions. For example, by dividing a region whose color is red and another region that is not, the red sphere can be detected as a circular region.
A masked printing effect can be achieved by keeping the original density information at a plurality of regions obtained by dividing the image data, while operating on the density information for each of the other regions.
Also, for a portion of the image data corresponding to an over exposed portion or an under exposed portion of the film, it is preferable to emphasize the image by performing a process that multiplies it with a coefficient having an opposite characteristic to the film characteristic. The embodiments of the present invention will now be described with reference to the drawings.
Figure 1 shows a configuration of an image processing apparatus 20 of an embodiment of this invention. The image processing apparatus 20 includes an input interface part 21, a CPU 22, a read only memory (ROM) 23, a random access memory (RAM) 24 and an output interface part 26.
A digital camera 10 is connected to the input interface part 21 of the image processing apparatus 20. The digital camera 10 can be, for example, a CCD camera. The digital camera 10 receives the image photographed on the film and outputs the image data D<sub>1</sub> corresponding to the image. The image data D<sub>1</sub> consists of a plurality of pixels. The image data output from the digital camera 10 is supplied to the CPU 22 via the input interface part 21.
The CPU 22 performs an adjustment processing program for adjusting the density information of the pixels contained in the image data D<sub>1</sub>. The adjustment processing program is stored, for example, in the ROM 23. The RAM 24 is typically a hard disk built in the image processing apparatus 20. The CPU 22, ROM 23 and RAM 24 are all interconnected through a bus 25.
A digital printer 30 is connected to the output interface part 26 of the image processing apparatus 20. The image data D<sub>1</sub> processed with the image processing program becomes image data D<sub>2</sub> and it is output to the digital printer 30 via the output interface part 26. The digital printer 30 prints the revised image data D<sub>2</sub>.
Figure 2 shows a schematic flow of the adjustment processing program. Each step of the adjustment processing program is performed by the CPU 22.
In step S1, pixel P<sub>X</sub> is mapped into a point Q<sub>X</sub> in a color space, wherein the pixel P<sub>X</sub> represents an arbitrary pixel contained in the image data D<sub>1</sub>. The mapping from the pixels P<sub>X</sub> to the points Q<sub>X</sub> in the color space will be described below with reference to Figures 3 and 4. In step S2, a space C<sub>i</sub> (i = 1, 2, ..., n) in the color space where the concentration of the points Q<sub>X</sub> is above a predetermined threshold is detected. Herein, "n" is an arbitrary integer. How to detect the space C<sub>i</sub> will be described below with reference to Figure 5.
In step S3, the average density information d<sub>i</sub> is adjusted. In addition, it is preferable to adjust the average density information d<sub>i</sub> of the space C<sub>i</sub> for all of "i" values. This is done for the purpose of emphasizing the difference in the average density information d<sub>i</sub> among the spaces C<sub>i</sub>. But, a similar effect can also be obtained by adjusting the average density information d<sub>i</sub> of the space C<sub>i</sub> for only at least one particular "i".
In step S4, density information d<sub>X</sub> of the pixel P<sub>X</sub> is adjusted based on the average density information d<sub>i</sub> of the space C<sub>i</sub> adjusted in the step S3.
In this way the density information d<sub>X</sub> of the pixel P<sub>X</sub> is adjusted. With such an adjustment, the density information for all of the image data D<sub>1</sub> are controlled so that a region with a lighter density becomes denser and a region with more density becomes lighter. As a result, a similar effect as that achieved by manual masked printing can be obtained.
The mapping from the pixel P<sub>X</sub> to the point d<sub>X</sub> will now be described with reference to Figure 3.
The pixel P<sub>X</sub> comprises a B value indicating a degree of blue color, a G value indicating a degree of green color and an R value indicating a degree of red color as its color information. In other words, the color information of the pixel is represented with (b<sub>X</sub>, g<sub>X</sub>, r<sub>X</sub>). Herein, b<sub>X</sub> represents the B value of the pixel P<sub>X</sub>, g<sub>X</sub> represents the G value of the pixel P<sub>X</sub> and r<sub>X</sub> represents the R value of the pixel P<sub>X</sub>. Each of b<sub>X</sub>, g<sub>X</sub> and r<sub>X</sub> is an integer, for example between 0 and 255.
The pixel P<sub>X</sub> is mapped to the point Q<sub>X</sub> in the color space 40 through mapping F shown in Figure 3. Herein, the point Q<sub>X</sub> is a point with coordinates (b<sub>X</sub>, g<sub>X</sub>, r<sub>X</sub>). The color space 40 is a three dimensional space defined with a B axis 42, a G axis 44 and an R axis 46.
By mapping all pixels P<sub>X</sub> contained in the image data into the color space 40, a set of the points Q<sub>X</sub> can be obtained.
Figure 4 shows an example of the distribution of the points Q<sub>X</sub> in the color space 40. In Figure 4, spaces C<sub>1</sub> and C<sub>2</sub> indicated with the hatching represent regions with high concentrations of the points Q<sub>X</sub> in the color space 40. The spaces C<sub>1</sub> and C<sub>2</sub> correspond to regions A<sub>1</sub> and A<sub>2</sub> with different colors in the image data D<sub>1</sub>. This is because the proximity of the points Q<sub>X</sub> in the color space 40 are correlated with the similarity of colors in the image data D<sub>1</sub>. For example, the region A<sub>1</sub> is a region related to a beige face in the image data D<sub>1</sub>, and the region A<sub>2</sub> corresponds to a green mountain in the image data D<sub>1</sub>.
In Figure 4, each pixel contained in the region A<sub>1</sub> of the image data D<sub>1</sub> is mapped into the space C<sub>1</sub> of the color space 40 by the mapping F, and each pixel contained in the region A<sub>2</sub> of the image data D<sub>1</sub> is mapped into the space C<sub>2</sub> of the color space 40. This indicates that the image data D1 is divided at least into the regions A<sub>1</sub> and A<sub>2</sub> based on the color information of the pixels contained in the image data D<sub>1</sub>. In this way, the image data D<sub>1</sub> may similarly be divided into N regions based on the color information of the pixels contained in the image data D<sub>1</sub>. Herein, N is an arbitrary integer equal to or greater than 2.
It will now be described specifically how to detect the space C<sub>1</sub> and C<sub>2</sub> in the color space 40 with reference to Figure 5. In Figure 5, a plane 48 is a plane defined with the G axis 44 and the R axis 46. Regions R<sub>1</sub> and R<sub>2</sub> are regions where the concentrations of points Q<sub>X</sub> detected are above a predetermined threshold. This is accomplished by examining the distribution of points Q<sub>X</sub> along the R axis 46. The regions R<sub>1</sub> and R<sub>2</sub> are defined by the following equations (1).<maths id="math0001" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(1)</mtext><mtd><mrow><msub><mrow><mtext>R</mtext></mrow><mrow><mtext>1</mtext></mrow></msub><msub><mrow><mtext>: r</mtext></mrow><mrow><mtext>11</mtext></mrow></msub><msub><mrow><mtext> ≤ R ≤ r</mtext></mrow><mrow><mtext>12</mtext></mrow></msub></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>R</mtext></mrow><mrow><mtext>2</mtext></mrow></msub><msub><mrow><mtext>: r</mtext></mrow><mrow><mtext>21</mtext></mrow></msub><msub><mrow><mtext> ≤ R ≤ r</mtext></mrow><mrow><mtext>22</mtext></mrow></msub></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0001.tif" /></maths> where r<sub>11</sub>, r<sub>12</sub>, r<sub>21</sub> and r<sub>22</sub> are constants.
Similarly, regions G<sub>1</sub> and G<sub>2</sub> where the concentrations of points Q<sub>X</sub> is above a predetermined threshold. This is accomplished by examining the distribution of the points Q<sub>X</sub> along the G axis 44. The regions G<sub>1</sub> and G<sub>2</sub> are defined by the following equations (2).<maths id="math0002" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(2)</mtext><mtd><mrow><msub><mrow><mtext>G</mtext></mrow><mrow><mtext>1</mtext></mrow></msub><msub><mrow><mtext>: g</mtext></mrow><mrow><mtext>11</mtext></mrow></msub><msub><mrow><mtext> ≤ G ≤ g</mtext></mrow><mrow><mtext>12</mtext></mrow></msub></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>G</mtext></mrow><mrow><mtext>2</mtext></mrow></msub><msub><mrow><mtext>: g</mtext></mrow><mrow><mtext>21</mtext></mrow></msub><msub><mrow><mtext> ≤ G ≤ g</mtext></mrow><mrow><mtext>22</mtext></mrow></msub></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0002.tif" /></maths> where g<sub>11</sub>, g<sub>12</sub>, g<sub>21</sub> and g<sub>22</sub> are constants.
Similarly, regions B<sub>1</sub> and B<sub>2</sub> are regions where the concentrations of points Q<sub>X</sub> is above a predetermined threshold. These regions are detected by examining the distribution of the points Q<sub>X</sub> along the B axis 42. The regions B<sub>1</sub> and B<sub>2</sub> are defined by the following equations (3).<maths id="math0003" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(3)</mtext><mtd><mrow><msub><mrow><mtext>B</mtext></mrow><mrow><mtext>1</mtext></mrow></msub><msub><mrow><mtext>: b</mtext></mrow><mrow><mtext>11</mtext></mrow></msub><msub><mrow><mtext> ≤ B ≤ b</mtext></mrow><mrow><mtext>12</mtext></mrow></msub></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>B</mtext></mrow><mrow><mtext>2</mtext></mrow></msub><msub><mrow><mtext>: b</mtext></mrow><mrow><mtext>21</mtext></mrow></msub><msub><mrow><mtext> ≤ B ≤ b</mtext></mrow><mrow><mtext>22</mtext></mrow></msub></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0003.tif" /></maths> where b<sub>11</sub>, b<sub>12</sub>, b<sub>21</sub> and b<sub>22</sub> are constants. According to the equations 1 thorough 3, the space C<sub>1</sub> and C<sub>2</sub> in the color space 40 are represented by the following equations (4).<maths id="math0004" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(4)</mtext><mtd><mrow><msub><mrow><mtext>C</mtext></mrow><mrow><mtext>1</mtext></mrow></msub><msub><mrow><mtext>: r</mtext></mrow><mrow><mtext>11</mtext></mrow></msub><msub><mrow><mtext> ≤ R ≤ r</mtext></mrow><mrow><mtext>12</mtext></mrow></msub><msub><mrow><mtext>, and, g</mtext></mrow><mrow><mtext>11</mtext></mrow></msub><msub><mrow><mtext> ≤ G ≤ g</mtext></mrow><mrow><mtext>12</mtext></mrow></msub><msub><mrow><mtext>, and, b</mtext></mrow><mrow><mtext>11</mtext></mrow></msub><msub><mrow><mtext> ≤ B ≤ b</mtext></mrow><mrow><mtext>12</mtext></mrow></msub></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>C</mtext></mrow><mrow><mtext>2</mtext></mrow></msub><msub><mrow><mtext>: r</mtext></mrow><mrow><mtext>21</mtext></mrow></msub><msub><mrow><mtext> ≤ R ≤ r</mtext></mrow><mrow><mtext>22</mtext></mrow></msub><msub><mrow><mtext>, and, g</mtext></mrow><mrow><mtext>21</mtext></mrow></msub><msub><mrow><mtext> ≤ G ≤ g</mtext></mrow><mrow><mtext>22</mtext></mrow></msub><msub><mrow><mtext>, and, b</mtext></mrow><mrow><mtext>21</mtext></mrow></msub><msub><mrow><mtext> ≤ B ≤ b</mtext></mrow><mrow><mtext>22</mtext></mrow></msub></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0004.tif" /></maths>
A process to adjust the average density information d<sub>i</sub> of the space C<sub>i</sub> in the step S3 will now be described in detail.
The average density information d<sub>i</sub> is calculated according to the following equations (5). In other words, the average density information d<sub>i</sub> is obtained by summing the density information d<sub>X</sub> corresponding to all of the points Q<sub>X</sub> contained in the space C<sub>i</sub>.<maths id="math0005" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(5)</mtext><mtd><mrow><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><msub><mrow><mtext> = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> = (b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext>) / 3</mtext></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0005.tif" /></maths>
Variation Δd<sub>i</sub> is calculated according to the following equation (6).<maths id="math0006" num="(6)"><math display="block"><mrow><msub><mrow><mtext>Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><msub><mrow><mtext> = (T-d</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><mtext>) x K</mtext></mrow></math><img file="EP0959616A2_D0006.tif" /></maths> where T represents a predetermined constant indicating a target value, and K represents a predetermined coefficient. T is, for example, a registered center value of a monitor. The color information (b<sub>X</sub>, g<sub>X</sub>, r<sub>X</sub>) of the pixel P<sub>X</sub> is updated into new color information (b<sub>X</sub>', g<sub>X</sub>', r<sub>X</sub>') according to the following equations (7).<maths id="math0007" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(7)</mtext><mtd><mrow><msub><mrow><mtext>b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0007.tif" /></maths>
New density information d<sub>X</sub>' of the pixel P<sub>X</sub> corresponds to the new color information (b<sub>X</sub>', g<sub>X</sub>', r<sub>X</sub>') according to the following equations (8).<maths id="math0008" num="(8)"><math display="block"><mrow><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = (b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext>') / 3</mtext></mrow></math><img file="EP0959616A2_D0008.tif" /></maths>
Further, new average density information d<sub>i</sub>' of the space C<sub>i</sub> corresponding to the new color information (b<sub>X</sub>', g<sub>X</sub>', r<sub>X</sub>') is calculated according to the following equations (9).<maths id="math0009" num="(9)"><math display="block"><mrow><msub><mrow><mtext>D</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><msub><mrow><mtext>' = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext>'</mtext><mspace linebreak="newline" /><msub><mrow><mtext> = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext> {(b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext>') / 3}</mtext><mspace linebreak="newline" /><msub><mrow><mtext> = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext> {(b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><msub><mrow><mtext> + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><msub><mrow><mtext> + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><mtext>) / 3}</mtext><mspace linebreak="newline" /><msub><mrow><mtext> = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext> {(b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>) / 3 + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><mtext> }</mtext><mspace linebreak="newline" /><msub><mrow><mtext> = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext> (d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><mtext> )</mtext><mspace linebreak="newline" /><msub><mrow><mtext> = Σ</mtext></mrow><mrow><mtext>QX∈Ci</mtext></mrow></msub><msub><mrow><mtext> d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><mspace linebreak="newline" /><msub><mrow><mtext> = d</mtext></mrow><mrow><mtext>i</mtext></mrow></msub><msub><mrow><mtext> + Δd</mtext></mrow><mrow><mtext>i</mtext></mrow></msub></mrow></math><img file="EP0959616A2_D0009.tif" /></maths>
As seen from the equations 6 through 9, in case of the average density information d<sub>i</sub> of the space C<sub>i</sub> being greater than the target value T, the new average density information d<sub>i</sub>' decreases with the amount of the variation Δd<sub>i</sub>. In case the average density information d<sub>i</sub> of the space C<sub>i</sub> is less than the target value T, the new average density information d<sub>i</sub>' increases with the amount of the variation Δd<sub>i</sub>. The absolute value of the variation Δd<sub>i</sub> increases as the average density information d<sub>i</sub> of the space C<sub>i</sub> deviates from the target value T.
Figure 6 shows the relationship between the average density information d<sub>i</sub> of the space C<sub>i</sub> and the new density information d<sub>i</sub>' of the space C<sub>i</sub>. In Figure 6, the solid line indicates the average density information d<sub>i</sub> of the space C<sub>i</sub>, and the broken line indicates the average density information d<sub>i</sub>' of the space C<sub>i</sub>. As indicated, the line indicating the average density information of the space C<sub>i</sub> is moved in such a direction that a lighter density region becomes denser and a denser region becomes lighter.
Although in Figure 6, the new average density information d<sub>i</sub>' is represented by the straight line, it is possible that a curve with a certain curvature may also represent it. For example, the curvature may be a cubic curve (<maths id="math0010" num=""><math display="inline"><mrow><msup><mrow><mtext>y=ax</mtext></mrow><mrow><mtext>3</mtext></mrow></msup><msup><mrow><mtext> + bx</mtext></mrow><mrow><mtext>2</mtext></mrow></msup><mtext> + cx + d</mtext></mrow></math><img file="EP0959616A2_D0010.tif" /></maths>, where a, b, c, d are constants).
In the case where an under exposed image or an over exposed image is photographed on the film, the image may not be able to be properly printed in a photographic paper. The reason why such a phenomenon occurs is that a region of the film characteristic with a bad linearity has been reached. Such a characteristic region is preferably multiplied by a coefficient to provide a pseudo linearity. For example, the color information (b<sub>X</sub>, g<sub>X</sub>, r<sub>X</sub>) of the pixel P<sub>X</sub> is preferably shifted so as to have an opposite characteristic of or against the film characteristic.
For example, for emphasizing the under exposed image photographed to the film, according to the following equations (10), the color information (b<sub>X</sub>, g<sub>X</sub>, r<sub>X</sub>) of the pixel P<sub>X</sub> may be updated to new color information (b<sub>X</sub>', g<sub>X</sub>', r<sub>X</sub>'), and the density information d<sub>X</sub> may be updated to the new density information d<sub>X</sub>'.<maths id="math0011" num=""><math display="block"><mrow><mtable><mtr><mtd><mrow><mtable><mtr><mtd><mrow><mtable><mlabeledtr><mtext>(10)</mtext><mtd><mrow><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> = (b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext> + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext>) / 3</mtext></mrow></mtd></mlabeledtr></mtable></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>sht = K</mtext></mrow><mrow><mtext>1</mtext></mrow></msub><msub><mrow><mtext> X ln (d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>) - K</mtext></mrow><mrow><mtext>2</mtext></mrow></msub></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext> + sht</mtext></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext> + sht</mtext></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext> + sht</mtext></mrow></mtd></mtr><mtr><mtd><mrow><msub><mrow><mtext>d</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' = (b</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' + g</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><msub><mrow><mtext>' + r</mtext></mrow><mrow><mtext>X</mtext></mrow></msub><mtext>') / 3</mtext></mrow></mtd></mtr></mtable></mrow></mtd></mtr></mtable></mrow></math><img file="EP0959616A2_D0011.tif" /></maths> where K<sub>1</sub> and K<sub>2</sub> are predetermined positive coefficients.
Then, it is possible to compensate the under exposed portion or the over exposed portion by adjusting the color information (b<sub>X</sub>, g<sub>X</sub>, r<sub>X</sub>) and the density information d<sub>X</sub> of the pixel P<sub>X</sub>. Thereby, even if the film is photographed such that it is under exposed or over exposed, adjusting the time duration of printing the image photographed on the film to the photographic paper can be made unnecessary.
It is to be understood that although the present invention has been described with regard to preferred embodiments thereof, various other embodiments and variants may occur to those skilled in the art, which are within the scope and sprit of the invention, and such other embodiments and variants are intended to be covered by the following claims.
The text of Japanese priority application number 10-140291 is incorporated herein by reference.
18 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US6954549B2 | Cited by | United States of America | Applicant |
| EP1231566A1 | Cited by | European Patent Office (EPO) | Search report |
| EP1231564A1 | Cited by | European Patent Office (EPO) | Search report |
| EP0441558A1 | Cites | European Patent Office (EPO) | Search report |
| EP0514933A2 | Cites | European Patent Office (EPO) | Search report |
| EP0566064A1 | Cites | European Patent Office (EPO) | Search report |
| US4339517A | Cites | United States of America | Search report |
| US5420704A | Cites | United States of America | Search report |
| US5715377A | Cites | United States of America | Search report |
8 members in 4 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 14029198 | Japan | A | |
| 14029198 | Japan | A | |
| 14029198 | Japan | – | |
| 14029198 | – | – | – |
| JP19980140291 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| EP0959616A2This record | European Patent Office (EPO) | A2 | |
| JPH11339030A | Japan | A | |
| EP0959616A3 | European Patent Office (EPO) | A3 | |
| US6574362B1 | United States of America | B1 | |
| EP0959616B1 | European Patent Office (EPO) | B1 | |
| DE69928861D1 | Germany | D1 | |
| DE69928861T2 | Germany | T2 | |
| JP3845854B2 | Japan | B2 |
28 legal events, as 4 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Notification of lapseLapsedST | ST | FR | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Fr: translation filedET | ET | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Corresponds to:REF | REF | EP | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Designation fees paidAKX | AKX | EP | |
| Designated contracting statesAK | AK | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAL;LT;LV;MK;RO;SIAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 0959616
- Publication, DOCDB
- 0959616
- Publication, EPODOC
- EP0959616
- Application
- 99109962
- Application, DOCDB
- 99109962
- Application, EPODOC
- EP19990109962
Titles3
- German
- System zur Verarbeitung fotografischer Bilder
- English
- System for processing photographic images
- French
- Système de traitement d'images photographiques
Classification
- CPC, 1
- H04N1/6027
- IPC, 3
- G06T5 00
- G03F3 08
- H04N1 60
Designated states2
- Contracting states, 1
- Sweden
- Extension states, 1
- Slovenia