Image quality enhancing method using mean-matching histogram equalization and a circuit therefor
Abstract
A histogram-equalization method for enhancing an image signal represented by a predetermined number of gray levels is disclosed. The method calculates a cumulative density function and a mean level in a unit of a picture, and maps a input sample into a new gray level by a transform function which is defined by use of the cumulative density function and the mean level. The method may include also a step of obtaining a compensated mean level by adding to the mean bright level, so that the input sample is mapped into the compensated mean level according to the mean level. Thus, a brightness compensation may by carried out along with a enhancement of contrast of the image.

Term
Term ended
Projected expiry passed 6 March 2017, 9.6 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
18 claims: 6 independent, 12 dependent
- 1A method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of:(a) obtaining a cumulative density function of the image signal in a unit of a picture;(b) calculating a mean level of the image signal in a unit of a picture;and (c) equalizing the image signal by mapping each sample of the image signal to a gray level by use of a transform function which employs the cumulative density function, wherein, the transform function maps the mean level into the same level.
- 3A method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of:(a) obtaining a gray level distribution of the image signal in a unit of a picture and then obtaining a cumulative density function in a unit of a picture based on the gray level distribution;(b) calculating a mean level of the image signal in a unit of a picture;(c) obtaining a cumulative density function value corresponding to the mean level based on the cumulative density function;and (d) equalizing the image signal by mapping each input sample of the image signal to a gray level according to cumulative density function values corresponding to the input sample and the mean level, wherein the mean level is mapped into the same level.
- 5A method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of:(a) obtaining a cumulative density function of the image signal in a unit of a picture;(b) calculating a mean level of the image signal in a unit of a picture;(c) obtaining a compensated mean level by adding a bright compensation value to the mean level according to the mean level of the input image;and (d) equalizing the image signal by mapping each sample of the image signal to a gray level by use of a transform function which employs the cumulative density function, wherein, the transform function maps the mean level into the compensated mean level.
- 7A method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of:(a) obtaining a gray level distribution of the image signal in a unit of a picture and then obtaining a cumulative density function in a unit of a picture based on the gray level distribution;(b) calculating a mean level of the image signal in a unit of a picture;(c) obtaining a cumulative density function value corresponding to the mean level based on the cumulative density function;and (d) obtaining a compensated mean level by adding a brightness compensation value to the mean level according to the mean level of the input image;and (e) equalizing the image signal by mapping each input sample of the image signal to a gray level according cumulative density function values corresponding to the input sample and the mean level, wherein the mean level is mapped into the compensated mean level.
- 9An image enhancing circuit for histogram-equalizing an image signal represented by a predetermined number of gray levels, said circuit comprising:first calculating means (106;206;306;406) for calculating a mean level of an input image signal in a unit of a picture;second calculating means (102, 104;202, 204;302, 304;402, 404) for calculating a gray level distribution of the image signal in a unit of a picture, calculating a cumulative density function in a unit of a picture based on the gray level distribution, and outputting a cumulative density function value corresponding to each input sample of the image signal and a cumulative density function value of the mean level;and outputting means (112, 114, 116, 118;210 - 216;314 - 320;412 - 418) for mapping the input sample to a gray level according cumulative density function values corresponding to the input sample and the mean level and outputting a mapped level as an equalized signal, wherein the mean level is mapped into the same level.
- 14An image enhancing circuit for histogram-equalizing an image signal represented by a predetermined number of gray levels, said circuit comprising:first calculating means (306;406) for calculating a mean level of an input image signal in a unit of a picture;second calculating means (302, 304;402, 404) for calculating a gray level distribution of the image signal in a unit of a picture, calculating a cumulative density function in a unit of a picture based on the gray level distribution, and outputting a cumulative density function value corresponding to each input sample of the image signal and a cumulative density function value of the mean level;brightness compensating means (312;410) for adding to the mean level a brightness compensation value calculated by a predetermined compensation function according to the mean level of the input image signal to output a compensated mean level;and outputting means (314 - 320;412 - 418) for mapping the input sample to a gray level according cumulative density function values corresponding to the input sample and the mean level and outputting a mapped level as an equalized signal, wherein the mean level is mapped into the compensated mean level.
Independent claims6
84 paragraphs, as filed
The present invention relates to a method for enhancing images using mean-matching histogram equalization and a circuit therefor. More particularly, the present invention relates to an image enhancing method for enhancing the contrast while preserving the mean brightness of a given image, and a circuit suitable for the method.
A histogram of gray levels provides an overall description of the appearance of an image. Properly adjusted gray levels for a given image can enhance the appearance or contrast thereof.
Among the many methods for contrast enhancement, the most widely known one is histogram equalization, in which the contrast of a given image is enhanced according to the sample distribution thereof. The method is disclosed in documents: [1] J.S. Lim, "Two-dimensional Signal and Image Processing," Prentice Hall, Englewood Cliffs, New Jersey, 1990, and [2] R.C. Gonzalez and P. Wints, "Digital Image Processing," Addison-Wesley, Reading, Massachusetts, 1977.
Also, the useful applications of the histogram equalization method for medical image processing and radar image processing are disclosed in documents: [3] J. Zimmerman, S. Pizer, E. Staab, E. Perry, W. McCartney and B. Brenton, "Evaluation of the Effectiveness of Adaptive Histogram Equalization for Contrast Enhancement," IEEE Tr. on Medical Imaging, pp. 304-312, Dec. 1988, and [4] Y. Li, W. Wang and D.Y. Yu, "Application of Adaptive Histogram Equalization to X-ray Chest Image," Proc. of the SPIE, pp. 513-514, vol. 2321, 1994.
In general, since histogram equalization causes the dynamic range of an image to be stretched, the density distribution of the resultant image is made flat and the contrast of the image is enhanced as a consequence thereof.
However, such a widely-known feature of the histogram equalization can become a defect in some practical instances. That is, as the output density of the histogram equalization becomes uniform, the mean brightness of an output image approaches the middle gray level value. Actually, for the histogram equalization of an analog image, the mean brightness of the output image is exactly the middle gray level regardless of the mean brightness of the input image. It is obvious that this feature is not desirable in an some real applications. For instance, an image taken at nighttime can appear to be an image taken in the daytime after histogram equalization has been performed. Meanwhile, too dark or too bright image signals result in a low contrast -after the equalization.
With a view to solving or reducing the above problems, it is an aim of embodiments of the present invention to provide an image enhancing method wherein contrast is enhanced while the mean brightness of a given image is preserved by employing a cumulative density function of the given image in a transform function and controlling the transform function so that the mean gray level of the given image is mapped into itself during histogram equalization.
It is an another aim of embodiments of the present invention to provide an image enhancing method which concurrently enables brightness compensation and contrast enhancement by adding a brightness compensation value to a mean brightness level of an input image according to the mean brightness level and controlling the transform function so that the mean gray level of the input image is mapped into the compensated mean level.
It is yet another aim of embodiments of the present invention to provide an image enhancing circuit wherein contrast is enhanced while the mean brightness of a given image is preserved by employing a cumulative density function of the given image in a transform function and controlling the transform function so that the mean gray level of the given image is mapped into itself during histogram equalization.
It is still yet another aim of embodiments of the present invention to provide an image enhancing circuit which concurrently enables brightness compensation and contrast enhancement by adding a brightness compensation value to a mean brightness level of an input image according to the mean brightness level and controlling the transform function so that the mean gray level of the input image is mapped into the compensated mean level.
According to a first aspect of the invention, there is provided a method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of: (a) obtaining a cumulative density function of the image signal in a unit of a picture; (b) calculating a mean level of the image signal in a unit of a picture; and (c) equalizing the image signal by mapping each sample of the image signal to a gray level by use of a transform function which employs the cumulative density function, wherein, the transform function maps the mean level into the same level.
The method may further comprise a step: (d) delaying the image signal by a unit of a picture; wherein, a delayed image signal is equalized in said step (c).
According to a second aspect of the invention, there is provided a method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of: (a) obtaining a gray level distribution of the image signal in a unit of a picture and then obtaining a cumulative density function in a unit of a picture based on the gray level distribution; (b) calculating a mean level of the image signal in a unit of a picture; (c) obtaining a cumulative density function value corresponding to the mean level based on the cumulative density function; and (d) equalizing the image signal by mapping each input sample of the image signal to a gray level according to cumulative density function values corresponding to the input sample and the mean level, wherein the mean level is mapped into the same level.
Preferably, the second aspect further comprises a step: (e) delaying the image signal by a unit of a picture; wherein, a delayed image signal is equalized in said step (c).
According to a third aspect, there is provided a method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of: (a) obtaining a cumulative density function of the image signal in a unit of a picture; (b) calculating a mean level of the image signal in a unit of a picture; (c) obtaining a compensated mean level by adding a bright compensation value to the mean level according to the mean level of the input image; and (d) equalizing the image signal by mapping each sample of the image signal to a gray level by use of a transform function which employs the cumulative density function, wherein, the transform function maps the mean level into the compensated mean level.
Preferably, the third aspect includes a step: (e) delaying the image signal by a unit of a picture; wherein, a delayed image signal is equalized in said step (d).
According to a fourth asepct of the invention, there is provided a method for enhancing image by histogram-equalizing an image signal represented by a predetermined number of gray levels, said method comprising the steps of: (a) obtaining a gray level distribution of the image signal in a unit of a picture and then obtaining a cumulative density function in a unit of a picture based on the gray level distribution; (b) calculating a mean level of the image signal in a unit of a picture; (c) obtaining a cumulative density function value corresponding to the mean level based on the cumulative density function; and (d) obtaining a compensated mean level by adding a brightness compensation value to the mean level according to the mean level of the input image; and (e) equalizing the image signal by mapping each input sample of the image signal to a gray level according cumulative density function values corresponding to the input sample and the mean level, wherein the mean level is mapped into the compensated mean level.
The method for enhancing image may further comprise a step: (f) delaying the image signal by a unit of a picture; wherein, a delayed image signal is equalized in said step (e).
According to a fifth aspect of the invention, there is provided an image enhancing circuit for histogram-equalizing an image signal represented by a predetermined number of gray levels, said circuit comprising: first calculating means for calculating a mean level of an input image signal in a unit of a picture; second calculating means for calculating a gray level distribution of the image signal in a unit of a picture, calculating a cumulative density function in a unit of a picture based on the gray level distribution, and outputting a cumulative density function value corresponding to each input sample of the image signal and a cumulative density function value of the mean level; and outputting means for mapping the input sample to a gray level according cumulative density function values corresponding to the input sample and the mean level and outputting a mapped level as an equalized signal, wherein the mean level is mapped into the same level.
The circuit preferably further comprises a picture memory for delaying the image signal by a unit of a picture to provide said outputting means with a image sample which belongs to a same frame as that from which the cumulative density function is calculated.
The circuit preferably further comprises a buffer for storing the cumulative density function calculated by said second calculating means, updating by a unit of a picture, and outputting a cumulative density function values corresponding to the input sample and the mean level.
Preferably, said outputting means comprises: a first mapper for mapping the input sample to a gray level of a first range according to a first transform function which is defined by use of the cumulative density function; a second mapper for mapping the input sample to a gray level of a first range according to a second transform function which is defined by use of the cumulative density function; a comparator for comparing the input sample with the mean level to generate a selection control signal; and a selector for selecting one of output signals from said first mapper and said second mapper according to the selection control signal, wherein said selector selects the output signal from said first mapper when the selection control signal indicates that the input sample is equal to or less than the mean level, and selects the output signal from said second mapper when the selection control signal indicates that the input sample is larger than the mean level.
Said outputting means may comprise: a first mapper for mapping the image sample output by said picture memory to a gray level of a first range according to a first transform function which is defined by use of the cumulative density function; a second mapper for mapping the image sample output by said picture memory to a gray level of a first range according to a second transform function which is defined by use of the cumulative density function; a comparator for comparing the image sample output by said picture memory with the mean level to generate a selection control signal; and a selector for selecting one of output signals from said first mapper and said second mapper according to the selection control signal, wherein said selector selects the output signal from said first mapper when the selection control signal indicates that the image sample output by said picture memory is equal to or less than the mean level, and selects the output signal from said second mapper when the selection control signal indicates that the image sample output by said picture memory is larger than the mean level.
According to a sixth aspect of the invention, there is provided an image enhancing circuit for histogram-equalizing an image signal represented by a predetermined number of gray levels, said circuit comprising: first calculating means for calculating a mean level of an input image signal in a unit of a picture; second calculating means for calculating a gray level distribution of the image signal in a unit of a picture, calculating a cumulative density function in a unit of a picture based on the gray level distribution, and outputting a cumulative density function value corresponding to each input sample of the image signal and a cumulative density function value of the mean level; brightness compensating means for adding to the mean level a brightness compensation value calculated by a predetermined compensation function according to the mean level of the input image signal to output a compensated mean level; and outputting means for mapping the input sample to a gray level according cumulative density function values corresponding to the input sample and the mean level and outputting a mapped level as an equalized signal, wherein the mean level is mapped into the compensated mean level.
The circuit may further comprise a picture memory for delaying the image signal by a unit of a picture to provide said outputting means with a image sample which belongs to a same frame as that from which the cumulative density function is calculated.
Preferably, there is further provided a buffer for storing the cumulative density function calculated by said second calculating means updating by a unit of a picture, and outputting a cumulative density function values corresponding to the input sample and the mean level.
Said outputting means preferably comprises: a first mapper for mapping the input sample to a gray level of a first range according to a first transform function which is defined by use of the cumulative density function; a second mapper for mapping the input sample to a gray level of a first range according to a second transform function which is defined by use of the cumulative density function; a comparator for comparing the input sample with the mean level to generate a selection control signal; and a selector for selecting one of output signals from said first mapper and said second mapper according to the selection control signal, wherein said selector selects the output signal from said first mapper when the selection control signal indicates that the input sample is equal to or less than the mean level, and selects the output signal from said second mapper when the selection control signal indicates that the input sample is larger than the mean level.
Said outputting means preferably comprises: a first mapper for mapping the image sample output by said picture memory to a gray level of a first range according to a first transform function which is defined by use of the cumulative density function; a second mapper for mapping the image sample output by said picture memory to a gray level of a first range according to a second transform function which is defined by use of the cumulative density function; a comparator for comparing the image sample output by said picture memory with the mean level to generate a selection control signal; and a selector for selecting one of output signals from said first mapper and said second mapper according to the selection control signal, wherein said selector selects the output signal from said first mapper when the selection control signal indicates that the image sample output by said picture memory is equal to or less than the mean level, and selects the output signal from said second mapper when the selection control signal indicates that the image sample output by said picture memory is larger than the mean level.
For a better understanding of the invention, and to show how embodiments of the same may be carried into effect, reference will now be made, by way of example, to the accompanying diagrammatic drawings, in which: <ul id="ul0001" list-style="none"><li>Figure 1 is a block diagram of an image enhancing circuit using mean-matching histogram equalization according to a first embodiment of the present invention;</li><li>Figure 2 is a block diagram of an image enhancing circuit using mean-matching histogram equalization according to a second embodiment of the present invention;</li><li>Figure 3 is a block diagram of an image enhancing circuit using mean-matching histogram equalization according to a third embodiment of the present invention;</li><li>Figures 4A and 4B are graphs showing examples of a brightness compensation function applied to the present invention;</li><li>Figures 5A and 5B are graphs showing examples of the relation between the mean level of an input image and the mean level compensated by the brightness compensation functions shown in Figures 4A and 4B, respectively; and</li><li>Figure 6 is a block diagram of an image enhancing circuit using mean-matching histogram equalization according to a fourth embodiment of the present invention.</li></ul>
The image enhancement method using mean-matching histogram equalization according to the present invention will now be described.
Here, {X} denotes a given image, and X<sub>m</sub> denotes the mean brightness level (hereinafter, will be abbreviated as "mean level") of {X}. The given image {X} is composed of L discrete gray levels denoted by {X<sub>0</sub>, X<sub>1</sub>,..., X<sub>L-1</sub>}, where X<sub>0</sub>=0 represents a black level and X<sub>L-1</sub>=1 represents a white level. Also, it is assumed that X<sub>m</sub> ∈{X<sub>0</sub>, X<sub>1</sub>,..., X<sub>L-1</sub>}.
A probability density function (PDF) for {X} is defined as follows.<maths id="math0001" num="(1)"><math display="block"><mrow><mtext mathvariant="italic">p</mtext><mtext>(</mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">k</mtext></mrow></msub><mtext mathvariant="italic">)</mtext><mtext> = </mtext><mfrac><mrow><msub><mrow><mtext mathvariant="italic">n</mtext></mrow><mrow><mtext mathvariant="italic">k</mtext></mrow></msub></mrow><mrow><mtext mathvariant="italic">n</mtext></mrow></mfrac><mtext> , for k=0, 1, ..., L-1</mtext></mrow></math><img file="EP0801360A2_D0001.tif" /></maths> where, n<sub>k</sub> represents the number of occurrences of the gray level X<sub>k</sub> in the image {X} and n represents the total number of samples in {X}.
Also, a cumulative density function (CDF) is defined as<maths id="math0002" num=""><img file="EP0801360A2_D0002.tif" /></maths>
Based on the CDF, the output of a typical histogram equalization, Y<sub>t</sub>, for the given input sample X<sub>k</sub> is given by<maths id="math0003" num="(3)"><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">Y</mtext></mrow><mrow><mtext mathvariant="italic">t</mtext></mrow></msub><mtext> = </mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext>0</mtext></mrow></msub><mtext> + (</mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">L</mtext><mtext>-1</mtext></mrow></msub><mtext> - </mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext>0</mtext></mrow></msub><mtext>) </mtext><mtext mathvariant="italic">c</mtext><mtext> (</mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">k</mtext></mrow></msub><mtext>)</mtext><mspace linebreak="newline" /><mtext>= </mtext><mtext mathvariant="italic">c</mtext><mtext> (</mtext><msub><mrow><mtext mathvariant="italic">X</mtext></mrow><mrow><mtext mathvariant="italic">k</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP0801360A2_D0003.tif" /></maths> where, it was assumed that X<sub>0</sub>=0 (Black) and X<sub>L-1</sub>=1 (white).
The biggest problem occurring during the histogram equalization is that the mean brightness level of an output signal can be drastically changed from that of an input signal depending on the CDF used as a transform function.
To overcome such a drawback, in a first method of the present invention, the following mapping operation which is based on the mean of the input image combined with the CDF is proposed.<maths id="math0004" num=""><img file="EP0801360A2_D0004.tif" /></maths>
That is, the samples which are equal to or less than the mean level X<sub>m</sub> are mapped into gray levels of from X<sub>0</sub> to X<sub>m</sub> (X<sub>0</sub>, X<sub>m</sub>) by<maths id="math0005" num=""><img file="EP0801360A2_D0005.tif" /></maths> and the samples greater than the mean level are mapped into gray levels of from X<sub>m</sub> to X<sub>L-1</sub> (X<sub>m</sub>, X<sub>L-1</sub>) by<maths id="math0006" num=""><img file="EP0801360A2_D0006.tif" /></maths> It is noted that X<sub>m</sub> is into X<sub>m</sub> in the expression (4).
Thus, when a given image is histogram-equalized according to a cumulative density function, the mean brightness of the given image is prevented from being changed due to histogram equalization by modifying a transform function according to the equation (4) so that the mean level of the given image is mapped into itself. Such a method is referred to, in the present invention, as a mean-matching histogram equalization.
In a second method according to the present invention, the following mapping operation is proposed, which can also compensate the level of brightness when the mean brightness of a given input image signal is excessively dark or bright.<maths id="math0007" num=""><img file="EP0801360A2_D0007.tif" /></maths> where,<maths id="math0008" num="(6)"><math display="block"><mrow><msub><mrow><mtext>B</mtext></mrow><mrow><mtext>m</mtext></mrow></msub><msub><mrow><mtext>=X</mtext></mrow><mrow><mtext>m</mtext></mrow></msub><mtext>+Δ</mtext></mrow></math><img file="EP0801360A2_D0008.tif" /></maths>
Here, B<sub>m</sub> is a compensated mean level and Δ is a brightness compensation value which is preset by use of a predetermined compensation function according to the brightness level. Thus, the compensated mean level B<sub>m</sub> results from adding the brightness compensation value Δ to the mean level X<sub>m</sub>. At this time, we also assume that B<sub>m</sub>∈{X<sub>0</sub>, X<sub>1</sub>,..., X<sub>L-1</sub>}.
Thus, the equalized output Y<sub>H</sub> becomes brighter when the brightness compensation value is greater than 0 (Δ>0), and the equalized output Y<sub>H</sub> becomes darker when the brightness compensation value is less than 0 (Δ<0). As Δ is increased, the dynamic range of a lower gray level portion of the image is enhanced, and as Δ is decreased, the dynamic range of an upper gray level portion is enhanced. The compensated mean level B<sub>m</sub> appropriately compensated according the mean level X<sub>m</sub> of the given image signal, that is, the brightness and darkness of the image, enhances greatly the quality of the input image along with the mean-matching histogram equalization.
As a consequence, according to the equation (5), the input samples which are equal to or less than the mean X<sub>m</sub> are mapped into gray levels of from X<sub>0</sub> to B<sub>m</sub> (X<sub>0</sub>, B<sub>m</sub>) by<maths id="math0009" num=""><img file="EP0801360A2_D0009.tif" /></maths> and the samples greater than the mean X<sub>m</sub> are mapped into gray levels of from B<sub>m</sub> to X<sub>L-1</sub> (B<sub>m</sub>, X<sub>L-1</sub>) by<maths id="math0010" num=""><img file="EP0801360A2_D0010.tif" /></maths> It is noted that X<sub>m</sub> is mapped into B<sub>m</sub> in expression (5).
Thus, when a given image is histogram-equalized according to a cumulative density function, the mean brightness of the given image is compensated, while contrast is also enhanced, by modifying a transform function according to the equation (5) so that the mean level of the given image is mapped into the compensated mean level.
Referring to Figures 1-6, an embodiment of an image enhancement circuit using the mean-matching histogram equalization will now be described.
Figure 1 is a block diagram of an image enhancement circuit using the mean-matching histogram equalization according to a first embodiment of the present invention.
In Figure 1, a frame histogram calculator 102 calculates the probability density function p(X<sub>k</sub>) which represents a gray level distribution in the input image {X} according to the equation (1) by a unit of a picture. At this stage, a frame is used for the picture unit. However, a field may be used for the picture unit alternatively.
A cumulative density function (CDF) calculator 104 calculates the cumulative density function c(X<sub>k</sub>) according to the equation (2) based on the probability density function p(X<sub>k</sub>) of one frame calculated by the frame histogram calculator 102.
A frame mean calculator 106 calculates the mean level X<sub>m</sub> of the one frame input image {X} in a unit of one frame and outputs the mean level X<sub>m</sub> in a unit of a frame to a CDF memory 110, a first and a second mapper 112 and 114, and a comparator 116 according to a synchronization signal (here, a frame sync signal SYNC).
A frame memory 108 stores the input image {X} by a frame unit. Since the cumulative density function c(X<sub>k</sub>) calculated by the CDF calculator 104 is the cumulative density function of an image delayed by one frame compared with the currently input image {X}, the input image {X} is delayed by one frame by the frame memory 108 so that an image signal of the frame corresponding to the cumulative density function c(X<sub>k</sub>) is input to the first and the second mappers 112 and 114.
The CDF memory 110 stores the cumulative density function c(X<sub>k</sub>) calculated by the CDF calculator 104 by a unit of one frame, updates the stored values according to the synchronization signal SYNC, and outputs the cumulative density function value c(X<sub>k</sub>) corresponding to a sample X<sub>k</sub> output by the frame memory 108 and the cumulative density function value c(X<sub>m</sub>) corresponding to the mean level X<sub>m</sub> output by frame mean calculator 106. At this stage, the CDF memory 110 is used as a buffer.
The first mapper 112 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from the CDF memory 110, the mean level X<sub>m</sub> from the frame mean calculator 106 and the one-frame delayed input sample X<sub>k</sub> from the frame memory 108, and maps the one-frame delayed input sample X<sub>k</sub> to a gray level of from X<sub>0</sub> to X<sub>m</sub> according to the first expression in the equation(4) to output an enhanced signal Y<sub>H</sub>.
The second mapper 114 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from the CDF memory 110, the mean level X<sub>m</sub> from the frame mean calculator 106 and the one-frame delayed input sample X<sub>k</sub> from the frame memory 108, and maps the one-frame delayed input sample X<sub>k</sub> to a gray level of from X<sub>m</sub> to X<sub>L-1</sub> according to the second expression in the equation (4) to output an enhanced signal Y<sub>H</sub>.
The comparator 116 compares the input sample X<sub>k</sub> output by the frame memory 108 with the mean level X<sub>m</sub> output by the frame mean calculator 104, and outputs a selection control signal according to the compared result.
A selector 118 selects the signal output by the first mapper 112 or that by the second mapper 114 in accordance with the selection control signal. Specifically, the selector 118 selects the signal output by the first mapper 112 in case that the selection control signal indicates that the input sample X<sub>k</sub> is less than or equal to the mean level X<sub>m</sub>. Meanwhile, the selector 118 selects the signal output by the second mapper 114 in the case that the selection control signal indicates that the input sample X<sub>k</sub> is greater than the mean level X<sub>m</sub>. Then, the selector 118 outputs the selected signal as the output image Y<sub>H</sub> in expression (4).
In embodiments of the present invention, the histogram calculator 102 and the CDF calculator 104 can be incorporated into a single block for calculating the gray level distribution and calculating the CDF also according to the gray level distribution in a unit of a picture with respect to the input image {X}.
Figure 2 is a block diagram of an image enhancement circuit using the mean-matching histogram equalization according to a second embodiment of the present invention.
In Figure 2, a frame histogram calculator 202 calculates the probability density function p(X<sub>k</sub>) which represents a gray level distribution in the input image {X} according to the equation (1) by a unit of a picture.
A CDF calculator 204 calculates the cumulative density function c(X<sub>k</sub>) according to the equation (2) based on the probability density function p(X<sub>k</sub>) of one frame calculated by the frame histogram calculator 202.
A frame mean calculator 206 calculates the mean level X<sub>m</sub> of the input image {X} in a unit of one frame and outputs the mean level X<sub>m</sub> to a CDF memory 208, a first and a second mappers 210 and 212, and a comparator 214 according to a frame sync signal SYNC.
The CDF memory 208 stores the cumulative density function value c(X<sub>k</sub>), for k=0, 1,..., L-1 calculated by CDF calculator 204 by a unit of one frame, updates the stored values according to the frame sync signal SYNC, and outputs the cumulative density function value c(X<sub>k</sub>) corresponding to an input sample X<sub>k</sub> and the cumulative density function value c(X<sub>m</sub>) corresponding to the mean level X<sub>m</sub> output by the frame mean calculator 206.
The first mapper 210 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from the CDF memory 208, the mean level X<sub>m</sub> from the frame mean calculator 206, and the input sample X<sub>k</sub>, and then maps the input sample X<sub>k</sub> to a gray level of from X<sub>0</sub> to X<sub>m</sub> according to the first expression in the equation (4) to thereby output an enhanced signal Y<sub>H</sub>.
The second mapper 212 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from the CDF memory 208, the mean level X<sub>m</sub> from the frame mean calculator 206, and the input sample X<sub>k</sub>, and then maps the input sample X<sub>k</sub> to a gray level of from X<sub>m</sub> to X<sub>L-1</sub> according to the second expression in the equation (4) to output an enhanced signal Y<sub>H</sub>.
The comparator 214 compares the input sample X<sub>k</sub> with the mean level X<sub>m</sub> output by the frame mean calculator 206, and outputs a selection control signal.
A selector 216 selects the signal output by the first mapper 210 or that by the second mapper 212 in accordance with the selection control signal. Specifically, the selector 216 selects the signal output by the first mapper 210 in case that the selection control signal indicates that the input sample X<sub>k</sub> is less than or equal to the mean level X<sub>m</sub>. Meanwhile, the selector 216 selects the signal output by the second mapper 212 in the case that the selection control signal indicates that the input sample X<sub>k</sub> is greater than the mean level X<sub>m</sub>.
In this embodiment of Figure 2, a frame memory has been omitted, compared with the first embodiment of the present invention of Figure 1, considering the feature that there exists a high correlation between the neighbouring frames. Thus, the sample X<sub>k</sub> input to the first and the second mappers 210 and 212 belong to a frame next to the one to which the output signals of the CDF memory 208 is related. Consequently, the hardware is reduced.
Figure 3 illustrates a third embodiment of an image enhancing circuit using mean-matching histogram equalization according to the present invention. The components of the circuit shown in Figure 3 are similar to the components of the circuit shown in Figure 1 except for a brightness compensator 312, and a first and a second mappers 314 and 316. Thus, the description will be focused on the brightness compensator 312, and the first and the second mappers 314 and 316.
In Figure 3, the brightness compensator 312 receives the mean level X<sub>m</sub> output by a frame mean calculator 306, adds a brightness compensation value (Δ) corresponding to the mean brightness of an input image, as described in the equation (6), and outputs the compensated mean level B<sub>m</sub>.
The brightness compensation value Δ is determined by use of a predetermined compensation function such as ones shown in Figures 4A and 4B. However, the compensation functions shown in Figures 4A and 4B are not more than exemplary ones, and other functions of different shape can be contemplated as well.
The brightness of the equalized output is controlled the brightness compensation value according to the compensation function as shown in Figures 4A and 4B. Specifically, when the mean level X<sub>m</sub> of the input image is very low, i.e., for a quite dark image, the equalized output becomes brighter by the mean-matching histogram equalization method of the present invention since a brightness compensation value Δ greater than "0" is added to the mean level X<sub>m</sub>.
Meanwhile, when the mean level X<sub>m</sub> of the input image is very high, i.e., for a quite bright image, the equalized output becomes darker by the mean-matching histogram equalization method of the present invention since a brightness compensation value Δ less than "0" is added to the mean level X<sub>m</sub>. Accordingly, the compensated mean level B<sub>m</sub> compensated by a suitable brightness compensation value Δ according to the mean level X<sub>m</sub> drastically improves the quality of the input image.
Figures 5A and 5B show the relation between the compensated mean level B<sub>m</sub> compensated by a compensated brightness compensation value Δ in accordance with the brightness compensation function shown in Figures 4A and 4B and the mean level X<sub>m</sub> of the input image.
The first mapper 314 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from a CDF memory 310, the compensated mean level B<sub>m</sub> from the brightness compensator 312 and the input sample (X<sub>k</sub>) from a frame memory 308, and maps the input sample (X<sub>k</sub>) to a gray level of from X<sub>0</sub> to B<sub>m</sub> according to the first expression in the equation (5) to output an enhanced signal Y<sub>H</sub>.
The second mapper 316 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from the CDF memory 310, the compensated mean level B<sub>m</sub> from the brightness compensator 312 and the input sample X<sub>k</sub> from the frame memory 308, and maps the input sample X<sub>k</sub> to a gray level of from B<sub>m</sub> to X<sub>L-1</sub> according to the second expression in the equation (5) to output an enhanced signal Y<sub>H</sub>.
Figure 6 illustrates a fourth embodiment of an image enhancing circuit using mean-matching histogram equalization according to the present invention. The components of the circuit shown in Figure 6 are similar to the components of the circuit shown in Figure 2 except for a brightness compensator 410, and a first and a second mappers 412 and 414. Thus, the description will be focused on the brightness compensator 410, and the first and the second mappers 412 and 414.
In Figure 6, the brightness compensator 410 receives the mean level X<sub>m</sub> output by a frame mean calculator 406, adds a brightness compensation value (Δ) corresponding to the mean brightness of an input image, as described in the equation (6), and outputs the compensated mean level B<sub>m</sub>.
The first mapper 412 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from a CDF memory 408, the compensated mean level B<sub>m</sub> from the brightness compensator 410 and the input sample X<sub>k</sub>, and maps the input sample X<sub>k</sub> to a gray level of from X<sub>0</sub> to B<sub>m</sub> according to the first expression in the equation (5) to output an enhanced signal Y<sub>H</sub>.
The second mapper 414 receives the cumulative density function values c(X<sub>k</sub>) and c(X<sub>m</sub>) from the CDF memory 408, the compensated mean level B<sub>m</sub> from the brightness compensator 410 and the input sample X<sub>k</sub>, and maps the input sample X<sub>k</sub> to a gray level of from B<sub>m</sub> to X<sub>L-1</sub> according to the second expression in the equation (5) to output an enhanced signal Y<sub>H</sub>.
As was the case for the image enhancing circuit of Figure 2, the hardware is reduced by omitting the frame memory considering the characteristics that there exists a high correlation between the neighboring frames.
As described above, in embodiments of the present invention, a transform function is controlled to allow the mean gray level of the given image to be mapped into itself when the histogram equalization is performed using the cumulative density function of the given image signal as the transform function, so that the mean brightness of a given image is preserved while contrast is enhanced.
Also, embodiments of the present invention can achieve the brightness compensation and contrast enhancement concurrently by controlling the transform function to allow the mean gray level of the given image to be mapped into the compensated mean level which is compensated according to the brightness thereof when the histogram equalization is performed in accordance with the cumulative density function of the given image signal. Furthermore, the image quality can be dramatically improved by enhancing the contrast of too dark or too bright input image signals.
The reader's attention is directed to all papers and documents which are filed concurrently with or previous to this specification in connection with this application and which are open to public inspection with this specification, and the contents of all such papers and documents are incorporated herein by reference.
All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive.
Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent or similar features.
The invention is not restricted to the details of the foregoing embodiment(s). The invention extends to any novel one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method or process so disclosed.
16 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US7227991B2 | Cited by | United States of America | Applicant |
| EP1326209A1 | Cited by | European Patent Office (EPO) | Search report |
| WO0030366A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US7359573B2 | Cited by | United States of America | Search report |
| EP1003340A1 | Cited by | European Patent Office (EPO) | Search report |
| EP0516084A2 | Cites | European Patent Office (EPO) | Search report |
15 members in 7 offices
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 19960010783 | Republic of Korea | A | |
| 19960010783 | Republic of Korea | A | |
| 9610783 | Republic of Korea | – | |
| 19960017211 | Republic of Korea | A | |
| 19960017211 | Republic of Korea | A | |
| 9617211 | Republic of Korea | – | |
| 9610783 | – | – | – |
| 9617211 | – | – | – |
| KR19960010783 | – | – | – |
| KR19960017211 | – | – | – |
Members15
| Document | Office | Kind | |
|---|---|---|---|
| EP0801360A2This record | European Patent Office (EPO) | A2 | |
| CN1162799A | China | A | |
| KR970071239A | Republic of Korea | A | |
| KR970078438A | Republic of Korea | A | |
| EP0801360A3 | European Patent Office (EPO) | A3 | |
| JPH1032769A | Japan | A | |
| US5862254A | United States of America | A | |
| KR0176602B1 | Republic of Korea | B1 | |
| KR100213039B1 | Republic of Korea | B1 | |
| JP3130268B2 | Japan | B2 | |
| CN1081370C | China | C | |
| EP0801360B1 | European Patent Office (EPO) | B1 | |
| DE69716803D1 | Germany | D1 | |
| DE69716803T2 | Germany | T2 | |
| ES2185874T3 | Spain | T3 |
26 legal events, as 4 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Announcement of lapse in spainLapsedFD2A | FD2A | ES | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent expired after termination of 20 yearsExpiredPE20 | PE20 | GB | |
| Expiry of rightR071 | R071 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Definitive protectionFG2A | FG2A | ES | |
| Corresponds to:REF | REF | EP | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOS IGRAGRAH | GRAH | EP | |
| Despatch of communication of intention to grantORIGINAL CODE: EPIDOS AGRAGRAG | GRAG | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOS IGRAGRAH | GRAH | EP | |
| Despatch of communication of intention to grantORIGINAL CODE: EPIDOS AGRAGRAG | GRAG | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Designated contracting statesAK | AK | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 0801360
- Publication, DOCDB
- 0801360
- Publication, EPODOC
- EP0801360
- Application
- 97301507
- Application, DOCDB
- 97301507
- Application, EPODOC
- EP19970301507
Titles3
- German
- Bildqualitätverbesserungsverfahren durch Histogramm-Entzerrung mit Mittelwertübereinstimmung und Schaltung dafür
- English
- Image quality enhancing method using mean-matching histogram equalization and a circuit therefor
- French
- Méthode d'amélioration de qualité d'image utilisant l'égalisation d'histogramme avec correspondance de la moyenne et circuit correspondant
Classification
- CPC, 2
- G06T5/92
- G06T5/40
- IPC, 3
- H04N5 57
- G06T5 00
- G06T5 40
Designated states1
- Contracting states, 1
- United Kingdom