Image processing program product and image processing apparatus
Abstract
An image processing apparatus includes: a first area extraction means that extracts as a first area an area assuming an intensity value equal to or greater than a first threshold value from an image; a second area extraction means that extracts as a second area an area assuming an intensity value equal to or greater than a second threshold value smaller than the first threshold value from the image; a light source area designating means that designates as a light source area an area in the image containing a light source based upon characteristic quantities indicating characteristics of the first area and the second area; and a control means that controls the first area extraction means, the second area extraction means and the light source area designating means.

Term
1.7 yearsto projected expiry
Projected expiry 6 June 2028, counted from filing; an application has no term until it is granted.
- Priority
- Filed
- Published
- Today
- Projected expiry
18 claims: 4 independent, 14 dependent
- 1A computer-readable computer program product containing an image processing control program with the control program comprising:a first area extraction instruction for extracting as a first area an area assuming an intensity value equal to or greater than a first threshold value from an image;a second area extraction instruction for extracting as a second area an area assuming an intensity value equal to or greater than a second threshold value smaller than the first threshold value from the image;and a light source area designation instruction for designating an area in the image that contains a light source as a light source area based upon characteristic quantities indicating characteristics of the first area and the second area.
- 5An image processing program product according to any one of claims 1 through 4, wherein:a decision is made in response to the light source area designation instruction, as to whether or not the second area is the light source area based upon a ratio of an aerial size of the second area and an aerial size of the first area present within the second area and a positional relationship between a gravitational center of the second area and a gravitational center of the first area present within the second area.
- 14An image processing apparatus, comprising:a first area extraction means that extracts as a first area an area assuming an intensity value equal to or greater than a first threshold value from an image;a second area extraction means that extracts as a second area an area assuming an intensity value equal to or greater than a second threshold value smaller than the first threshold value from the image;a light source area designating means that designates as a light source area an area in the image containing a light source based upon characteristic quantities indicating characteristics of the first area and the second area;and a control means that controls the first area extraction means, the second area extraction means and the light source area designating means.
Independent claims4
122 paragraphs in 3 sections, as filed
INCORPORATION BY REFERENCE
0001The disclosure of the following priority application is herein incorporated by reference: <ul id="ul0001" list-style="none" compact="compact"><li>Japanese Patent Application No. <patcit id="pcit0001" dnum="JP2007150545A"><text>2007-150545 filed June 6, 2007</text></patcit></li></ul>
0002The present invention relates to an image processing program product and an image processing apparatus.
0003Japanese Laid Open Patent Publication No. <patcit id="pcit0002" dnum="JP2005092724A"><text>2005-92724</text></patcit> discloses a bright beam drawing processing method. In this bright beam drawing processing method, a bright beam is drawn starting from a bright point pixel by detecting bright point pixels within an image.
0004However, bright points within the image are detected based upon intensity values in the bright beam drawing processing method disclosed in Japanese Laid Open Patent Publication No. <patcit id="pcit0003" dnum="JP2005092724A"><text>2005-92724</text></patcit>, and this gives rise to a concern that a point at which a light source is not actually photographed may be detected as a bright point.
0005According to the 1st aspect of the present invention, a computer-readable computer program product containing an image processing control program with the control program which comprises: a first area extraction instruction for extracting as a first area an area assuming an intensity value equal to or greater than a first threshold value from an image; a second area extraction instruction for extracting as a second area an area assuming a intensity value equal to or greater than a second threshold value smaller than the first threshold value from the image; and a light source area designation instruction for designating an area in the image that contains a light source as a light source area based upon characteristic quantities indicating characteristics of the first area and the second area.
0006According to the 2nd aspect of the present invention, in the image processing program product according to the 1st aspect, it is preferred that a decision is made in response to the light source area designation instruction, as to whether or not the second area is the light source area based upon an inclusive relationship that may exist between the second area and the first area.
0007According to the 3rd aspect of the present invention, in the image processing program product according to the 1st aspect, it is preferred that a decision is made in response to the light source area designation instruction, as to whether or not the second area is the light source area based upon a ratio of an areal size of the second area and an areal size of the first area present within the second area.
0008According to the 4th aspect of the present invention, in the image processing program product according to the 1st aspect, it is preferred that a decision is made in response to the light source area designation instruction, as to whether or not the second area is the light source area based upon a positional relationship between a gravitational center of the second area and a gravitational center of the first area present within the second area.
0009According to the 5th aspect of the present invention, in the image processing program product according to the 1st aspect, it is preferred that a decision is made in response to the light source area designation instruction, as to whether or not the second area is the light source area based upon a ratio of an aerial size of the second area and an aerial size of the first area present within the second area and a positional relationship between a gravitational center of the second area and a gravitational center of the first area present within the second area.
0010According to the 6th aspect of the present invention, in the image processing program product according to the 5th aspect, it is preferred that a light source position present inside the light source area is determined in response to the light source area designation instruction, based upon the positional relationship between the gravitational center of the second area and the gravitational center of the first area present within the second area.
0011According to the 7th aspect of the present invention, in the image processing program product according to the 6th aspect, it is preferred that the control program further comprises a bright beam drawing instruction for drawing bright beams along a plurality of directions from a starting point set at the light source position designated in response to the light source area designation instruction.
0012According to the 8th aspect of the present invention, in the image processing program product according to the 7th aspect, it is preferred that the control program further comprises a bright beam size determination instruction for determining a width and length of the bright beams to be drawn based upon a size of the image and the aerial size of the light source area.
0013According to the 9th aspect of the present invention, in the image processing program product according to the 7th aspect, it is preferred that the control program further comprises a bright beam color determination instruction for determining a color of the bright beams to be drawn based upon color information provided at a point set apart from the gravitational center of the light source area by a predetermined distance or more.
0014According to the 10th aspect of the present invention, in the image processing program product according to the 8th aspect, it is preferred that the control program further comprises: a bright beam color determination instruction for determining a color of the bright beams to be drawn based upon information provided at a point set apart from the gravitational center of the light source area by a predetermined distance or more, wherein: the bright beams are drawn in response to the bright beam drawing instruction, based upon the length of the bright beams determined in response to the bright beam size determination instruction and the color of the bright beams determined in response to the bright beam color determination instruction.
0015According to the 11th aspect of the present invention, in the image processing program product according to the 10th aspect, it is preferred that the bright beams are drawn in response to the bright beam drawing instruction, so that intensity of the bright beams is attenuated through simple attenuation as a distance from the light source position increases if the length of the bright beams is smaller than a predetermined value and the bright beams are drawn so as to cyclically attenuate and amplify the intensity of the bright beams as the distance from the light source position increases if the length of the bright beams is equal to or greater than the predetermined value.
0016According to the 12th aspect of the present invention, in the image processing program product according to the 10th aspect, it is preferred that the hue of the bright beams is cyclically altered in response to the bright beam drawing instruction, if the color of the bright beams is white.
0017According to the 13th aspect of the present invention, in the image processing program product according to the 7th aspect, it is preferred that a light diffusion effect is rendered over and area where a plurality of bright beams intersect one another in response to the bright beam drawing instruction.
0018According to the 14th aspect of the present invention, an image processing apparatus, comprising: a first area extraction means that extracts as a first area an area assuming an intensity value equal to or greater than a first threshold value from an image; a second area extraction means that extracts as a second area an area assuming an intensity value equal to or greater than a second threshold value smaller than the first threshold value from the image; a light source area designating means that designates as a light source area an area in the image containing a light source based upon characteristic quantities indicating characteristics of the first area and the second area; and a control means that controls the first area extraction means, the second area extraction means and the light source area designating means.
0019According to the 15th aspect of the present invention, in the image processing apparatus according to the 14th aspect, it is preferred that the light source area designating means determines whether or not the second area is the light source area based upon a ratio of an aerial size of the second area and an aerial size of the first area present within the second area and a positional relationship between a gravitational center of the second area and a gravitational center of the first area present within the second area.
0020According to the 16th aspect of the present invention, in the image processing apparatus according to the 15th aspect, it is preferred that the light source area designating means designates a light source position within the light source area based upon the positional relationship between the gravitational center of the second area and the gravitational center of the first area present within the second area.
0021According to the 17th aspect of the present invention, the image processing apparatus according to the 16th aspect further comprises a bright beam drawing means that draws bright beams along a plurality directions from a starting point set at the light source position designated by the light source area designating means.
0022According to the 18th aspect of the present invention, the image processing apparatus according to the 17th aspect further comprises: a bright beam size determining means that determines a width and a length of the bright beams to be drawn based upon a size of the image and the aerial size of the light source area; and a bright beam color determining means that determines a color of the bright beams to be drawn based upon color information provided at a point set apart from a gravitational center of the light source area by a predetermined distance or more, wherein: the bright beam drawing means draws the bright beams based upon the length of the bright beams determined by the bright beam size determining means and the color of the bright beams determined by the bright beam color determining means.
BRIEF DESCRIPTION OF THE DRAWINGS
0023<ul id="ul0002" list-style="none" compact="compact"><li><figref idref="f0001">FIG. 1</figref> is a block diagram showing the structure adopted in the image processing apparatus achieved in an embodiment of the present invention;</li><li><figref idref="f0002">FIG. 2</figref> presents a specific example of points of contact at which the first extracted area and the outer frame may contact each other;</li><li><figref idref="f0003">FIG. 3</figref> presents a specific example of the distances that may be measured along eight different directions extending from the gravitational center of the first extracted area to the edge of the first extracted area;</li><li><figref idref="f0004">FIG. 4A and FIG. 4B</figref> presents specific examples of first extracted areas that may be present within the second extracted area;</li><li><figref idref="f0005">FIG. 5A and FIG. 5B</figref> presents specific examples of second extracted areas, one in <figref idref="f0005">FIG. 5A</figref> that is a light source area and the other in <figref idref="f0005">FIG. 5B</figref> that is not a light source area;</li><li><figref idref="f0006">FIG. 6</figref> presents a specific example of a central area and an outer area in the light source area;</li><li><figref idref="f0007">FIG. 7A and FIG. 7B</figref> schematically illustrates how a star manifesting in an image maybe attenuated by using a star filter;</li><li><figref idref="f0008">FIG. 8A and FIG. 8B</figref> schematically illustrates the width and length of a star being drawn;</li><li><figref idref="f0009">FIG. 9</figref> presents a specific example of Y (x) that may be used in simple star attenuation;</li><li><figref idref="f0010">FIG. 10</figref> presents a specific example of Ratio(x) that may be used in simple star attenuation;</li><li><figref idref="f0011">FIG. 11</figref> presents a specific example of Y(x) that may be used in cyclical star attenuation;</li><li><figref idref="f0012">FIG. 12</figref> presents a specific example of Ratio(x) that may be used in cyclical star attenuation;</li><li><figref idref="f0013">FIG. 13A and FIG. 13B</figref> schematically illustrates an effect achieved by diffusing the central area of a star;</li><li><figref idref="f0014">FIG. 14</figref> presents a specific example of the diffusion effect at the central area of a star;</li><li><figref idref="f0015">FIG. 15</figref> presents a flowchart of the processing executed in the image processing apparatus;</li><li><figref idref="f0016">FIG. 16</figref> presents a flowchart of the processing executed to designate a light source area;</li><li><figref idref="f0017">FIG. 17</figref> presents a flowchart of the processing executed to determine the star size;</li><li><figref idref="f0018">FIG. 18</figref> presents a flowchart of the processing executed to determine the star color;</li><li><figref idref="f0019">FIG. 19</figref> presents a flowchart of the star drawing processing; and</li><li><figref idref="f0020">FIG. 20</figref> illustrates how the computer program product to be used to execute the image processing in the embodiment of the present invention, may be distributed.</li></ul>
DETAIL DESCRIPTION OF PREFERRED EMBODIMENTS
0024The following is an explanation of the best mode for carrying out the present invention, given in reference to the drawings. <figref idref="f0001">FIG. 1</figref> is a block diagram showing the structure adopted in an embodiment of the image processing apparatus according to the present invention. An image processing apparatus 100, which may be a personal computer, includes an operation member 101, a connection I/F (connection interface) 102, a control device 103, an HDD (hard disk drive) 104 and a monitor 105.
0025The operation member 101 includes various devices operated by the user, such as a keyboard and a mouse. The connection I/F 102, which is an interface used to achieve a connection with an external device, may be, for instance, a USB interface via which the image processing apparatus is connected with a digital camera through a wired connection or a wireless LAN module via which a wireless connection is achieved. Image data originating from a digital camera can be taken into the image processing apparatus via the connection I/F 102 in the embodiment.
0026The HDD 104 is a storage device in which image data having been taken in via the connection I/F 102 are recorded and various computer programs and the like to be executed by the control device 103 are also stored. At the monitor 105, which may be a liquid crystal monitor, various types of display data output from the control device 103 are displayed.
0027The control device 103, constituted with a CPU, a memory and other peripheral circuits, includes functional units such as a light source area designating unit 103a, a star size determining unit 103b, a star color determining unit 103c and a star drawing unit 103d. The control device 103 in the embodiment reads an image recorded in the HDD 104 and draws a star over an area (light source area) containing a light source within the image. The term "star" in this context refers to bright beams drawn along a plurality of directions extending from the gravitational center of a light source area within the image. Such bright beams may be drawn along, for instance, four directions, six directions or eight directions extending from the gravitational center of the light source area. The following explanation is provided by assuming that image data expressed in the RGB color space are recorded in the HDD 104.
0028The light source area designating unit 103a designates a light source area within the image. More specifically, the light source area designating unit 103a extracts a light source area in reference to intensity values Y at the pixels. The light source area extraction is executed by calculating the intensity value Y defined as in (1) below based upon pixel values (R, G, B) (0 ≤ R, G, B ≤ 255) for each pixel. <maths id="math0001" num="(1)"><math display="block"><mi mathvariant="normal">Y</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">0.2990</mn><mo mathvariant="normal">×</mo><mi mathvariant="normal">R</mi><mo mathvariant="normal">+</mo><mn mathvariant="normal">0.5870</mn><mo mathvariant="normal">×</mo><mi mathvariant="normal">G</mi><mo mathvariant="normal">+</mo><mn mathvariant="normal">0.1140</mn><mo mathvariant="normal">×</mo><mi mathvariant="normal">B</mi></math><img file="EP2015250A2_D0001.tif" /></maths>
0029An area within the image constituted with pixels having intensity values Y calculated as expressed in (1) equal to or greater than a predetermined value may not always be an actual light source area, since the image may contain an area other than a light source area, such as a white wall where intensity values Y are equal to or greater than the predetermined value. The following processing is executed in the embodiment so as to accurately designate the correct area as a light source area.
0030The light source area designating unit 103a extracts an area constituted with pixels having intensity values Y calculated as expressed in (1) equal to or greater than a predetermined intensity value Y<sub>1</sub> (e.g., Y<sub>1</sub> = 250). If there are a plurality of such areas, each constituted with pixels assuming intensity values Y equal to or greater than the predetermined intensity value Y<sub>1</sub>, within the image, the plurality of areas are extracted. An area extracted as described above is to be referred to as a first extracted area, so as to distinguish it from other areas to be explained later.
0031The light source area designating unit 103a calculates the areal size and the gravitational center position of each first extracted area it has extracted. The gravitational center position may be calculated in the form of specific coordinate values (an x-coordinate value and a y-coordinate value) in the xy coordinate system representing the entire image. The light source area designating unit 103a defines a specific outer frame that contacts the outline of the first extracted area and calculates the coordinate values (an x-coordinate value and a y-coordinate value) of a contact point at which the first extracted area and the outer frame contact each other. For instance, if a first extracted area 2a, such as that shown in <figref idref="f0002">FIG. 2</figref>, has been extracted, the light source area designating unit 103a sets an outer frame 2b and calculates the coordinate values assumed at contact points 2c 2d, 2e, and 2f at which the first extracted area 2a and the outer frame 2b are in contact.
0032The light source area designating unit 103a calculates the distances a<sub>i</sub> (i = 1, 2, ..., 8) from the gravitational center 3a of the first extracted area to the edge of the area along eight different directions, i.e., upward, downward, left, right and the diagonals. The light source area designating unit 103a stores the areal size, the gravitational center position coordinate values, the coordinate values of the contact points at which the area and the outer frame are in contact and the distances from the gravitational center to the area edge having been calculated as described above into memory.
0033The light source area designating unit 103a extracts an area constituted with pixels having intensity values Y calculated as expressed in (1) equal to or greater than a predetermined intensity value Y<sub>2</sub> (e.g., Y<sub>2</sub> = 240). If there are a plurality of such areas, each constituted with pixels assuming intensity values Y equal to or greater than the predetermined intensity value Y<sub>2</sub>, within the image, the plurality of areas are extracted. An area extracted as described above is to be referred to as a second extracted area, so as to distinguish it from the first extracted area mentioned earlier.
0034The light source area designating unit 103a calculates the areal size and the coordinate values (an x-coordinate value and a y-coordinate value) of the gravitational center position of each second extracted area it has extracted. The light source area designating unit 103a calculates the distances b<sub>i</sub> (i = 1, 2,..., 8) from the gravitational center of the second extracted area to the edge of the area along eight different directions, i.e., upward, downward, left, right and the diagonals, as it did for the first extracted area, as explained in reference to <figref idref="f0003">FIG. 3</figref>. The light source area designating unit 103a stores the areal size, the gravitational center position coordinate values, and the distances from the gravitational center to the area edge having been calculated as described above into memory.
0035In a second extracted area 4a extracted by setting Y<sub>1</sub> > Y<sub>2</sub> as explained above, a single extracted area 2a may be present, as shown in <figref idref="f0004">FIG. 4A</figref>, or a plurality of first extracted areas 2a may be present as shown in <figref idref="f0004">FIG. 4B</figref>. The light source area designating unit 103a in the embodiment designates a light source area through different methods adopted for a second extracted area 4a containing a single first extracted area 2a and a second extracted area 4a containing a plurality of first extracted areas 2a.
0036While a plurality of second extracted areas may have been extracted from the image, as described earlier, an explanation is given in reference to the embodiment on the processing executed to determine whether or not a given second extracted area 4a is to be designated as a light source area. Namely, if a plurality of second extracted areas 4a has been extracted, a decision as to whether or not each of the second extracted areas 4a should be designated as a light source area can be made simply by executing the processing described below for the individual second extracted areas 4a.
(A) Second extracted area 4a containing a single first extracted area 2a
0037A second extracted area 4a containing a single first extracted area 2a is likely to have a high degree of independence as a light source area and is, therefore, judged to be a light source area unless its shape is skewed. The light source area designating unit 103a makes the decision as to whether or not to designate the second extracted area 4a as a light source area as expressed in (2) and (3) below based upon the distances b<sub>i</sub> calculated along the eight directions extending from the gravitational center to the edge of the area. In expressions (2) and (3), max(b<sub>i</sub>) represents the largest value among b<sub>1</sub> through b<sub>8</sub> and min(b<sub>i</sub>) represents the smallest value among b<sub>1</sub> through b<sub>8</sub>. If the condition set forth in expressions (2) is satisfied, the light source area designating unit 103a designates the second extracted area 4a as a light source area, whereas if the condition set forth in expression (3) is satisfied, it does not designate the second extracted area 4a as a light source area. <maths id="math0002" num="(2)"><math display="block"><mi>max</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo mathvariant="normal">/</mo><mi>min</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo mathvariant="normal">≤</mo><mn mathvariant="normal">3.0</mn></math><img file="EP2015250A2_D0002.tif" /></maths><maths id="math0003" num="(3)"><math display="block"><mi>max</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo mathvariant="normal">/</mo><mi>min</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo>></mo><mn mathvariant="normal">3.0</mn></math><img file="EP2015250A2_D0003.tif" /></maths>
0038If the second extracted area is designated as a light source area, the light source area designating unit 103a designates the gravitational center position of the first extracted area present inside the second extracted area as a light source position.
(B) Second extracted area 4a containing a plurality of first extracted areas 2a
0039B indicates the second extracted area 4a and A<sub>i</sub> (i = 1, 2, ..., n) indicates a single first extracted area 2a or a plurality (n) of first extracted areas 2a present in the second extracted area. g<sub>B</sub> represents the gravitational center of B, whereas g<sub>i</sub> (i = 1, 2, ..., n) represents the gravitational center of A<sub>i</sub> (i = 1, 2, ..., n).
0040Since the second extracted area 4a (B) is extracted by using a reference value (threshold value) for intensity values Y set to Y<sub>2</sub> (e.g., Y<sub>2</sub> = 240) slightly lower than Y<sub>1</sub> (e.g., Y<sub>1</sub> = 250), the second extracted area 4a (B) may contain a plurality of first extracted areas 2a (A<sub>i</sub>). This may occur for either of the following two reasons. <ul id="ul0003" list-style="none" compact="compact"><li>Reason 1: The second extracted area 4a (B) is not a light source area.</li><li>Reason 2: While the second extracted area 4a (B) is a light source area, a plurality of first extracted areas 2a (A<sub>i</sub>) have been extracted in correspondence to the reference value Y<sub>1</sub>.</li></ul>
0041Even when reason 2 above is deemed applicable, i.e., even when B is a light source area, a majority of A<sub>i</sub> are judged not to be light source areas. Under such circumstances, a star is drawn by using bright beams extending along a plurality of directions from a starting point set at g<sub>B</sub> or at the gravitational center g<sub>i</sub> (i = 1, 2, ... , n) of an area A<sub>i</sub> reasonably close to g<sub>B</sub>. The light source area designating unit 103a executes the following processing to make a decision as to whether or not the second extracted area 4a (B) is a light source area.
0042The light source area designating unit 103a extracts as a gravitational center G the closest gravitational center g<sub>i</sub> to the gravitational center g<sub>B</sub> of the area B, among the gravitational centers g<sub>i</sub> (i = 1, 2, ..., n) of the plurality of areas A<sub>i</sub> present within the area B. In the embodiment, if B is judged to be a light source area, the gravitational center G is designated as the light source position and a star is drawn by using bright beams extending along a plurality of directions from the starting point set at the gravitational center G, without drawing a star with bright beams extending along a plurality of directions from a starting point set at another gravitational center g<sub>i</sub>.
0043As long as B is a light source area, the position of the gravitational center g<sub>B</sub> of B and the position of the extracted gravitational center G should not be set apart from each other over a significant distance, as indicated in <figref idref="f0005">FIG. 5A</figref>. However, if B is not a light source area, the two positions are set apart by a significant distance, as indicated in <figref idref="f0005">FIG. 5B</figref>. Based upon this principle, the accuracy of the decision indicating that B is a light source area is judged in the embodiment. More specifically, if the distance between G and g<sub>B</sub> is beyond an allowable range, the light source area designating unit 103a judges that the decision indicating that B is a light source area is inaccurate. If, on the other hand, the distance between G and g<sub>B</sub> is within the allowable range, it judges at the decision indicating that B is a light source area is accurate.
0044The light source area designating unit 103a judges that the decision indicating that B is a light source area is inaccurate if the distance between G and g<sub>B</sub> satisfies the condition set forth in expression (4) below, but judges that the decision is accurate if the condition is not satisfied. <maths id="math0004" num="(4)"><math display="block"><mfenced><mi>Distance between G and</mi><mspace width="1em" /><msub><mi mathvariant="normal">g</mi><mi mathvariant="normal">B</mi></msub></mfenced><mo mathvariant="normal">></mo><mn mathvariant="normal">2</mn><mo mathvariant="normal">×</mo><mi>min</mi><mfenced><msub><mi mathvariant="normal">a</mi><mi mathvariant="normal">i</mi></msub></mfenced></math><img file="EP2015250A2_D0004.tif" /></maths>
0045If the decision indicating that B is a light source area is judged to be accurate through the decision-making executed based upon expression (4), the light source area designating unit 103a makes a decision based upon expressions (5) and (6) below as to whether or not to designate B as a light source area. If the condition set forth in either expression (5) or expression (6) is satisfied, the light source area designating unit 103a does not designate B as a light source area, but it designates B as a light source area if neither of the conditions set forth in expressions (5) and expression (6) is satisfied. <maths id="math0005" num="(5)"><math display="block"><mi>max</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo mathvariant="normal">/</mo><mi>min</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo>></mo><mn mathvariant="normal">3.0</mn></math><img file="EP2015250A2_D0005.tif" /></maths><maths id="math0006" num="(6)"><math display="block"><mfenced><mi>Size of area B</mi></mfenced><mo>/</mo><mfenced><msub><mi>Size of area A</mi><mi mathvariant="normal">i</mi></msub><mspace width="1em" /><mi>containing G</mi></mfenced><mo>></mo><mn>1.0</mn><mo>+</mo><mfenced><msub><mi mathvariant="normal">Y</mi><mn>1</mn></msub><mo>/</mo><msub><mi mathvariant="normal">Y</mi><mn>2</mn></msub></mfenced></math><img file="EP2015250A2_D0006.tif" /></maths>
0046Upon designating B as a light source area, the light source area designating unit 103a designates as the light source position the gravitational center G closest to the gravitational center g<sub>B</sub> of B, among the gravitational centers g<sub>i</sub> (i = 1, 2, ..., n) of the plurality of areas A<sub>i</sub> present in the area B. Through the processing described above, the light source area designating unit 103a is able to designate a light source area and a light source position within the image with superior accuracy.
0047The star size determining unit 103b determines the size of the star to be drawn from the starting point set at the light source position designated by the light source area designating unit 103a as described above, i.e., determines the width and the length of bright beams. It is preferable that the bright beam width be determined in correspondence to the areal size S of the light source area and the range of the light source area. The range of the light source area is equivalent to the distances b<sub>i</sub> (i = 1, 2, ..., 8) to points taken at the edge of the area, calculated along the eight directions by the light source area designating unit 103a through the processing described earlier.
0048In an image photographed by using an optical filter, bright beams do not become wider once the actual light source exceeds a specific size. Accordingly, it is preferable to set a specific upper limit value (width_limit) for the bright beam width (width) to be drawn in the light source area. Unless such an upper limit is set for the bright beam width to be drawn in a relatively small image, wide bright beams, not in keeping with the image size, may be drawn. For this reason, the upper limit value (width_limit) should be selected by also taking into consideration the image size.
0049In order to ensure that excessively narrow bright beams, not in keeping with the image size, are not drawn, a lower limit value (Min_width) for to the bright beam width (width) should also be set. The lower limit value (Min_width) may be set to, for instance, 3 [pixels] . The bright beam width (width) should assume an odd number value, to assure symmetry relative to the central axis of the star.
0050More specifically, the star size determining unit 103b determines the star size as explained below. The star size determining unit 103b selects the upper limit value (width_limit) [pixels] to the bright beam width by applying conditional expressions in (7) through (9) below to the image size W [pixels] x H [pixels]. <maths id="math0007" num="(7)"><math display="block"><mi>min</mi><mfenced><mi mathvariant="normal">W</mi><mo></mo><mi mathvariant="normal">H</mi></mfenced><mo mathvariant="normal"><</mo><mn mathvariant="normal">1000</mn><mo>→</mo><mi>width_limit</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">5</mn></math><img file="EP2015250A2_D0007.tif" /></maths><maths id="math0008" num="(8)"><math display="block"><mn mathvariant="normal">1000</mn><mo mathvariant="normal">≤</mo><mi>min</mi><mfenced><mi mathvariant="normal">W</mi><mo></mo><mi mathvariant="normal">H</mi></mfenced><mo mathvariant="normal">≤</mo><mn mathvariant="normal">2000</mn><mo mathvariant="normal">→</mo><mi>width_limit</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">7</mn></math><img file="EP2015250A2_D0008.tif" /></maths><maths id="math0009" num="(9)"><math display="block"><mn mathvariant="normal">2000</mn><mo><</mo><mi>min</mi><mfenced><mi mathvariant="normal">W</mi><mo></mo><mi mathvariant="normal">H</mi></mfenced><mo mathvariant="normal">→</mo><mi>width_limit</mi><mo mathvariant="normal">=</mo><mn>9</mn></math><img file="EP2015250A2_D0009.tif" /></maths>
0051The star size determining unit 103b calculates an assumed radius (Temp_R) as expressed in (10) below based upon the areal size S of the light source area. <maths id="math0010" num="(10)"><math display="block"><mi>Temp_R</mi><mo>:</mo><mo>=</mo><msqrt><mfrac><mi mathvariant="normal">S</mi><mi>π</mi></mfrac></msqrt></math><img file="EP2015250A2_D0010.tif" /></maths>
0052The star size determining unit 103b calculates an assumed width (Temp_width) [pixels] to be used to determine the bright beam width, as expressed in (11) below. <maths id="math0011" num="(11)"><math display="block"><mi>Temp_width</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">2</mn><mo mathvariant="normal">×</mo><mi>min</mi><mfenced><mi>min</mi><mfenced><msub><mi mathvariant="normal">b</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo mathvariant="normal">,</mo><mi>Temp_R</mi></mfenced></math><img file="EP2015250A2_D0011.tif" /></maths>
0053As indicated in expression (12) below, the star size determining unit 103b sets the bright beam width (width) to the lower limit value (Min_width) if the calculated width (Temp_width) is smaller than the bright beam width lower limit value (Min_width). If, on the other hand, the calculated width (Temp_width) is greater than the bright beam width upper limit value (width_limit), it sets the bright beam width (width) to the bright beam width upper limit value (width_limit), as indicated in expression (13) below. <maths id="math0012" num="(12)"><math display="block"><mi>Temp_width</mi><mo mathvariant="normal"><</mo><mi>Min_width</mi><mo mathvariant="normal">→</mo><mi>width</mi><mo mathvariant="normal">=</mo><mi>Min_width</mi></math><img file="EP2015250A2_D0012.tif" /></maths><maths id="math0013" num="(13)"><math display="block"><mi>Temp_width</mi><mo mathvariant="normal">></mo><mi>width_limit</mi><mo mathvariant="normal">→</mo><mi>width</mi><mo mathvariant="normal">=</mo><mi>width_limit</mi></math><img file="EP2015250A2_D0013.tif" /></maths>
0054If the calculated width (Temp_width) does not fit either the conditions set forth in expression (12) or expression (13), i.e., if (Min_width) ≤ (Temp_width) ≤ (width_limit), the star size determining unit 103b rounds off the value of the calculated width (Temp_width) to an integral value. If the integral value is an odd number, the integral value is directly designated as the bright beam width (width), whereas if the integral value is an even number, the value obtained by adding 1 to the integral value is designated as the bright beam width (width).
0055Next, a method that may be adopted when determining the length of bright beams in the star is explained. In principle, when the actual light source is larger in size, longer bright beams are drawn and thus, the bright beam length is determined in correspondence to the areal size S of the light source area. It is known that a bright beam length in keeping with the light source size can be selected in proportion to log (S). When the areal size S of the light source area is small, a bright beam length (length) [pixels] calculated as expressed in (14) below may not be large enough and thus may not be in keeping with the light source size. A in expression (14) represents a proportional constant. <maths id="math0014" num="(14)"><math display="block"><mi>length</mi><mo mathvariant="normal">=</mo><mi mathvariant="normal">A</mi><mo mathvariant="normal">×</mo><mi>log</mi><mfenced><mi mathvariant="normal">S</mi></mfenced></math><img file="EP2015250A2_D0014.tif" /></maths>
0056In the embodiment, the minimum length for bright beams is defined and bright beams are drawn over a length equal to or greater than the minimum length at all times. It is preferable that the minimum length be determined in correspondence to the image size W [pixels] x H [pixels]. Since setting a greater length is in keeping with a wider bright beam, the star length is corrected to assume a greater value if bright beams are wider than the lower limit value (Min_width) (= 3 [pixels]) mentioned earlier.
0057Namely, the star size determining unit 103b calculates the bright beam length as expressed in (15) below. <maths id="math0015" num="(15)"><math display="block"><mi>length</mi><mo mathvariant="normal">=</mo><mi>min</mi><mfenced><mi mathvariant="normal">W</mi><mo></mo><mi mathvariant="normal">H</mi></mfenced><mo mathvariant="normal">/</mo><mn mathvariant="normal">20</mn><mo mathvariant="normal">+</mo><mi>max</mi><mfenced open="{" close="}"><msub><mi mathvariant="normal">a</mi><mi mathvariant="normal">i</mi></msub></mfenced><mo mathvariant="normal">+</mo><mi mathvariant="normal">A</mi><mo mathvariant="normal">×</mo><mi>logS</mi><mo>×</mo><msup><mfenced><mfrac><mi>width</mi><mi>min_width</mi></mfrac></mfenced><mi>α</mi></msup></math><img file="EP2015250A2_D0015.tif" /></maths>
0058In expression (15), the first term (min (W, H)/ 20) represents the minimum bright beam length (Min_Length) corresponding to the image size and α represents a parameter used to correct the bright beam length in correspondence to the bright beam width as mentioned above.
0059The star color determining unit 103c determines the color of the star where bright beams are to be drawn from the starting point set at the light source position designated through the processing executed by the light source area designating unit 103a as explained earlier. The color assumed at the center of a light source area within an image is invariably white, irrespective of the color of the light source. This means that the R, G and B values are all close to 255 and that the R, G and B values are not the best information to be used when determining the star color. In reference to the embodiment, an example in which the star color is determined based upon the color information provided at an outer position in the designated light source area, i.e., at a point set apart from the gravitational center by a specific distance, is explained. For instance, the star color determining unit 103c may determine the color of the star by using the color information provided at a point within an outer area 6c, instead of a central area 6b in the light source area 6a shown in <figref idref="f0006">FIG. 6</figref>.
0060More specifically, the star color determining unit 103c may execute the following processing. In order to obtain the color information at a point inside the outer area 6c, the star color determining unit 103c scans the light source area along the eight directions extending from the gravitational center of the light source area, i.e., from the gravitational center g<sub>B</sub> of the second extracted area described earlier, in the upward direction, the downward direction, to the left, to the right and in the diagonal directions, to locate points each satisfying the condition set forth in either expression (16) or expression (17), so as to extract one eligible point in correspondence to each direction, i.e., a total of eight points. <maths id="math0016" num="(16)"><math display="block"><mi>max</mi><mfenced><mi mathvariant="normal">R</mi><mo></mo><mi mathvariant="normal">G</mi><mo></mo><mi mathvariant="normal">B</mi></mfenced><mo mathvariant="normal">-</mo><mi>min</mi><mfenced><mi mathvariant="normal">R</mi><mo></mo><mi mathvariant="normal">G</mi><mo></mo><mi mathvariant="normal">B</mi></mfenced><mo mathvariant="normal">></mo><mn mathvariant="normal">140</mn></math><img file="EP2015250A2_D0016.tif" /></maths><maths id="math0017" num="(17)"><math display="block"><mi mathvariant="normal">Y</mi><mo><</mo><mn>100</mn></math><img file="EP2015250A2_D0017.tif" /></maths>
0061The star color determining unit 103c calculates the eight points thus extracted for their hue circle angle distribution and eliminates any point far off the hue circle angle distribution. The star color determining unit 103c then determines the star color (Init_R, Init_G, Init_B) based upon the average of the hue circle angles of the remaining points.
0062The star drawing unit 103d draws a star in the color having been determined by the star color determining unit 103c by using bright beams with the width and the length having been determined by the star size determining unit 103b extending from the starting point set at the light source position having been designated by the light source area designating unit 103a. The star drawing unit 103d in the embodiment executes processing so as to draw a more natural looking star by reproducing a phenomenon that would manifest if the light source was photographed with an actual star filter.
0063For instance, if the light source was photographed with an actual star filter, the star would become attenuated as the distance from the light source position increased. Namely, a bright beam in a star becomes narrower and the level of intensity becomes lower as the distance from the light source position increases. In addition, a star does not always dissipate through simple attenuation. For instance, a star drawn with bright beams of a significant length may include portions with cyclical attenuation, in which attenuated bright beams become amplified and then become attenuated again. <figref idref="f0007">FIG. 7A and FIG. 7B</figref> schematically illustrates how a star in an image photographed by using a star filter may become attenuated. For purposes of simplification of the illustration, <figref idref="f0007">FIG. 7A and FIG. 7B</figref> only shows a single bright beam extending to the right from the light source position in a star formed at the light source area.
0064When the bright beam is short, it is gradually attenuated and dissipates completely (simple attenuation) as shown in <figref idref="f0007">FIG. 7A</figref>, whereas if the bright beam is long, the bright beam dissipates after repeating the process of becoming attenuated and then becoming amplified (cyclical attenuation), as shown in <figref idref="f0007">FIG. 7B</figref>. The star drawing unit 103d in the embodiment makes a decision as to whether to draw the star through simple attenuation or through cyclical attenuation based upon the bright beam length having been determined by the star size determining unit 103b, so as to achieve effects similar to those realized by photographing an image with a star filter.
0065The bright beams in a star formed in an image photographed by using a star filter become narrower as the distance from the light source position increases, as shown in <figref idref="f0007">FIG. 7A and FIG. 7B</figref>. For this reason, a star drawn by using a bright beam extending to the right from the light source position and sustaining the bright beam width (width) having been determined by the star size determining unit 103b from the starting point over the full bright beam length (length), as shown in <figref idref="f0008">FIG. 8A</figref> would not look natural. The star drawing unit 103d in the embodiment instead draws a star by using a bright beam with the pixel row drawn on the central axis of the star assuming a length equal to the calculated bright beam length (length), but the pixel rows of the bright beam drawn above and below the pixel row on the central axis parallel to the pixel row drawn on the central axis assuming smaller lengths further away from the central axis, so that the bright beam becomes narrower as the distance from the light source position increases, as illustrated in <figref idref="f0008">FIG. 8B</figref>.
0066When the light source is white, the star formed in an image photographed by using an actual star filter will include a rainbow of color in the bright beam. Accordingly, the star drawing unit 103d adjusts the attenuation processing depending upon whether the star color having been determined by the star color determining unit 103c is white, so as to ensure that the star includes rainbow colors in the bright beams. The following is a description of a specific example of processing that may be executed by the star drawing unit 103d.
0067Basedupon the star color (Init_R, Init_G, Init_B) having been determined by the star color determining unit 103c, the star drawing unit 103d makes a decision as to whether or not the color of the star to be drawn is white. In more specific terms, if the star color (Init_R, Init_G, Init_B) satisfies the condition expressed in (18) below, the star color is judged to be white, whereas if it does not satisfy the condition, the star is assumed to be a color other than white. <maths id="math0018" num="(18)"><math display="block"><mi>max</mi><mfenced><mi>Init_R</mi><mo></mo><mi>Init_G</mi><mo></mo><mi>InitB</mi></mfenced><mo>-</mo><mi>min</mi><mfenced><mi>Init_R</mi><mo></mo><mi>Init_G</mi><mo></mo><mi>InitB</mi></mfenced><mo><</mo><mn>30</mn></math><img file="EP2015250A2_D0018.tif" /></maths>
0068The star drawing unit 103d executes the star drawing processing based upon the star color having been determined. The drawing processing executed when the star color is other than white is now explained. In reference to the embodiment, a specific example of the processing executed to draw a bright beam extending from the light source position to the right in the star, as shown in <figref idref="f0007">FIG. 7A and FIG. 7B</figref>, is described. Since bright beams extending along other directions (e.g., upward, downward and to the left), too, can be drawn along the specific directions by executing processing similar to that explained below, a repeated explanation is not provided.
0069Based upon the bright beam width (width), the star drawing unit 103d determines through calculation the exact pixel range, ranging above and below the central axis of the star, over which the bright beam needs to be drawn, as expressed in (19) below. In the expression (19), n represents the number of pixel rows present above and below the central axis of the star, over which the bright beam needs to be drawn. <maths id="math0019" num="(19)"><math display="block"><mi mathvariant="normal">n</mi><mo>=</mo><mfenced><mi>width</mi><mo>-</mo><mn>1</mn></mfenced><mo>/</mo><mn>2</mn></math><img file="EP2015250A2_D0019.tif" /></maths>
0070For instance, width = 5 in the example presented in <figref idref="f0008">FIG. 8A and FIG. 8B</figref> and, in this case, n is calculated to be 2, since the bright beam needs to be drawn over two pixel rows above and below the central axis of the star.
0071In this example, described by assuming that a bright beam extending from the light source position to the right is being drawn, the star drawing unit 103d calculates the range over which the bright beam needs to be drawn, represented by a specific number of pixel rows present above and below the central axis of the star. When drawing a bright beam extending upward or downward from the light source position, on the other hand, the star drawing unit 103d will need to calculate the range over which the bright beam is to be drawn, represented by a specific number of pixel rows present to the left and to the right of the central axis of the star.
0072The star drawing unit 103d calculates the length to be assumed for the pixel row in the bright beam, to be drawn on the central axis of the star and the length to be assumed for each pixel row in the bright beam, to be drawn above or below the central axis. The bright beam length (length) has already been calculated. While the length of the pixel row in the bright beam to be drawn on the central axis of the star assumes the value of the bright beam length (length), the pixel rows in the bright beam to be drawn above and below parallel to the pixel row on the central axis need to assume smaller length as the distance from the central axis increases, as explained earlier in reference to <figref idref="f0008">FIG. 8A and FIG. 8B</figref>. Accordingly, end<sub>k</sub> representing the length of the pixel row present at a kth position (k = 1, 2, ..., n) from the central axis may be calculated as expressed in (20) and (21) with L representing the third term in expression (15).
0073The term end<sub>0</sub> indicates the length of the pixel row in the bright beam to be drawn on the central axis of the star and end<sub>1</sub> indicates the pixel row length assumed for both the pixel row in the bright beam to be drawn parallel to the central axis at the first position above the central axis and a pixel row in the bright beam to be drawn parallel to the central axis at a first position below the central axis. Likewise, end<sub>2</sub> indicates the pixel row length assumed for both the pixel row in the bright beam to be drawn parallel to the central axis at a second position above the central axis and a pixel row in the bright beam to be drawn parallel to the central axis at a second position below the central axis, and end<sub>n</sub> indicates the pixel row length assumed for the pixel rows in the bright beam to be drawn parallel to the central axis at nth positions above and below the central axis. <maths id="math0020" num="(20)"><math display="block"><mi>width</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">3</mn><mo mathvariant="normal">→</mo><msub><mi>end</mi><mn mathvariant="normal">0</mn></msub><mo mathvariant="normal">=</mo><mi>length</mi><mo mathvariant="normal">,</mo><msub><mi>end</mi><mn mathvariant="normal">1</mn></msub><mo mathvariant="normal">=</mo><mi>length</mi><mo mathvariant="normal">-</mo><mfenced><mi mathvariant="normal">L</mi><mo mathvariant="normal">/</mo><mn mathvariant="normal">2</mn></mfenced></math><img file="EP2015250A2_D0020.tif" /></maths><maths id="math0021" num="(21)"><math display="block"><mi>width</mi><mo mathvariant="normal">></mo><mn mathvariant="normal">3</mn><mo mathvariant="normal">→</mo><msub><mi>end</mi><mn mathvariant="normal">0</mn></msub><mo mathvariant="normal">=</mo><msub><mi>end</mi><mn mathvariant="normal">1</mn></msub><mo mathvariant="normal">=</mo><mi>length</mi><mo mathvariant="normal">,</mo><msub><mi>end</mi><mi mathvariant="normal">k</mi></msub><mo mathvariant="normal">=</mo><mi>length</mi><mo mathvariant="normal">-</mo><mfenced><mi mathvariant="normal">L</mi><mo mathvariant="normal">/</mo><mn mathvariant="normal">2</mn></mfenced><mo mathvariant="normal">×</mo><mfenced><mfenced><mi mathvariant="normal">k</mi><mo mathvariant="normal">-</mo><mn mathvariant="normal">1</mn></mfenced><mo mathvariant="normal">/</mo><mi mathvariant="normal">n</mi></mfenced></math><img file="EP2015250A2_D0021.tif" /></maths>
0074Based upon the bright beam length (length), the star drawing unit 103d determines whether to draw the star with simple attenuation or with cyclical attenuation, as described earlier. More specifically, it makes the decision as expressed in (22) and (23) below. <maths id="math0022" num="(22)"><math display="block"><mi>Length</mi><mo><</mo><mn>3</mn><mo>×</mo><mi>Min_Length</mi><mo>→</mo><mi>simple attenuation</mi></math><img file="EP2015250A2_D0022.tif" /></maths><maths id="math0023" num="(23)"><math display="block"><mi>Length</mi><mo>≥</mo><mn>3</mn><mo>×</mo><mi>Min_Length</mi><mo>→</mo><mi>cyclical attenuation</mi></math><img file="EP2015250A2_D0023.tif" /></maths>
0075A method that may be adopted when drawing a star through simple attenuation is now described. The star drawing unit 103d defines a point at which x = Y_br is true, as expressed in (24) below, with x representing the displacement to the right from the light source position. <maths id="math0024" num="(24)"><math display="block"><mi>Y_br</mi><mo mathvariant="normal">=</mo><mi>Min_Length</mi><mo mathvariant="normal">+</mo><mi>max</mi><mfenced><msub><mi mathvariant="normal">a</mi><mn mathvariant="normal">1</mn></msub></mfenced><mo mathvariant="normal">+</mo><mfenced><mi mathvariant="normal">L</mi><mo mathvariant="normal">/</mo><mn mathvariant="normal">3</mn></mfenced></math><img file="EP2015250A2_D0024.tif" /></maths>
0076Then, as shown in <figref idref="f0009">FIG. 9</figref>, a function Y(x), whereby the intensity value Y becomes attenuated as expressed in a quadratic expression when 0 ≤ x ≤ Y_br and as expressed in a linear expression when Y_br ≤ x ≤ end<sub>k</sub> is set. Y_MAX, Y_MID1, Y_MID2, Y_MIN1 and Y_MIN2 in <figref idref="f0009">FIG. 9</figref> are parameters upon which the bright beam attenuation is dependant and they may be respectively set too, for instance, 250, 200, 150, 80 and 30.
0077For instance, a function indicating the attenuation of the intensity in the pixel row in the bright beam to be drawn parallel to the central axis at the kthposition from the central axis should be determined so that the curve representing the function passes through two points, i.e., (Y_br, Y_MID1 - ((Y_MID1 - Y_MID2) / n) · k) and (end<sub>k</sub>, Y_MIN1 - ((Y_MIN1 - Y_MIN2) / n) · k).
0078Once C<sub>k</sub> and D<sub>k</sub> are defined as expressed in (25) and (26) below, the quadratic expression in the range 0 ≤ x ≤ Y_br can be written as in (27) and the linear expression in the range Y_br ≤ x ≤ end<sub>k</sub> can be written as in (28) below. <maths id="math0025" num="(25)"><math display="block"><msub><mi mathvariant="normal">C</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Y_MAX</mi></mfenced><mo>/</mo><msup><mfenced><mi>Y_br</mi></mfenced><mn>2</mn></msup></math><img file="EP2015250A2_D0025.tif" /></maths><maths id="math0026" num="(26)"><math display="block"><msub><mi mathvariant="normal">D</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Y_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>+</mo><mfrac><mrow><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><msup><mfenced><mi>Y_br</mi></mfenced><mn>2</mn></msup><mo>/</mo><mfenced><msub><mi>end</mi><mi>k</mi></msub><mo>-</mo><mi>Y_br</mi></mfenced></math><img file="EP2015250A2_D0026.tif" /></maths><maths id="math0027" num="(27)"><math display="block"><mi mathvariant="normal">Y</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">C</mi><mi>k</mi></msub><mo>⋅</mo><msup><mi>x</mi><mn>2</mn></msup><mo>+</mo><mi>Y_MAX</mi></math><img file="EP2015250A2_D0027.tif" /></maths><maths id="math0028" num="(28)"><math display="block"><mi mathvariant="normal">Y</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">D</mi><mi>k</mi></msub><mo></mo><mfenced><mi>x</mi><mo>-</mo><mi>Y_br</mi></mfenced><mo>+</mo><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0028.tif" /></maths>
0079The RGB values (Cross_R(x), Cross_G(x), Cross_B(x)) at position x in each pixel row included in the bright beam are obtained by first determining color difference values Cr and Cb in the YCbCr color space based upon (Init_R, Init_G, Init_B) and then converting (Y(x), Cb, Cr) to (Cross_R(x), Cross_G(x), Cross_B(x)). Data in the RGB color space are converted to YCbCr color space as expressed in (29) through (31) below, whereas data in the YCbCr color space are converted to the RGB color space by using conversion expressions that are a reversal of those in (29) through (31). <maths id="math0029" num="(29)"><math display="block"><mi mathvariant="normal">Y</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">0.2990</mn><mo mathvariant="normal">×</mo><mi mathvariant="normal">R</mi><mo mathvariant="normal">+</mo><mn mathvariant="normal">0.5870</mn><mo mathvariant="normal">×</mo><mi mathvariant="normal">G</mi><mo mathvariant="normal">+</mo><mn mathvariant="normal">0.1140</mn><mo mathvariant="normal">×</mo><mi mathvariant="normal">B</mi></math><img file="EP2015250A2_D0029.tif" /></maths><maths id="math0030" num="(30)"><math display="block"><mi>Cr</mi><mo mathvariant="normal">=</mo><mn mathvariant="normal">0.4978</mn><mo></mo><mi mathvariant="normal">R</mi><mo>-</mo><mn mathvariant="normal">0.4185</mn><mo></mo><mi mathvariant="normal">G</mi><mo>-</mo><mn mathvariant="normal">0.0813</mn><mo></mo><mi mathvariant="normal">B</mi></math><img file="EP2015250A2_D0030.tif" /></maths><maths id="math0031" num="(31)"><math display="block"><mi>Cb</mi><mo mathvariant="normal">=</mo><mo>-</mo><mn mathvariant="normal">0.1686</mn><mo></mo><mi mathvariant="normal">R</mi><mo>-</mo><mn mathvariant="normal">0.3311</mn><mo></mo><mi mathvariant="normal">G</mi><mo>+</mo><mn mathvariant="normal">0.4997</mn><mo></mo><mi mathvariant="normal">B</mi></math><img file="EP2015250A2_D0031.tif" /></maths>
0080Any of Cross_R(x), Cross_G(x) and Cross_B(x) having been calculated that is smaller than 0 is corrected to 0, whereas any of Star_R(x), Star_G(x) and Star_B(x) with a value greater than 255 is corrected to 255.
0081A mixing ratio Ratio(x) at which the pixel values (R, G, B) in the input image and the (Cross_R(x), Cross_G(x), Cross_B(x)) values are to be mixed is determined, with the pixel values (R(x), G(x), B(x)) at position x calculated as expressed in (32) below. <maths id="math0032" num="(32)"><math display="block"><mfenced><mi mathvariant="normal">R</mi><mfenced><mi>x</mi></mfenced><mo>,</mo><mi mathvariant="normal">G</mi><mfenced><mi>x</mi></mfenced><mo>,</mo><mi mathvariant="normal">B</mi><mfenced><mi>x</mi></mfenced></mfenced><mo>=</mo><mfenced><mn>1.0</mn><mo>-</mo><mi>Ratio</mi><mfenced><mi>x</mi></mfenced></mfenced><mo></mo><mfenced><mi mathvariant="normal">R</mi><mo></mo><mi mathvariant="normal">G</mi><mo></mo><mi mathvariant="normal">B</mi></mfenced><mo>+</mo><mi>Ratio</mi><mfenced><mi>x</mi></mfenced><mo></mo><mfenced><mi>Cross_R</mi><mfenced><mi>x</mi></mfenced><mo>,</mo><mi>Cross_G</mi><mfenced><mi>x</mi></mfenced><mo>,</mo><mi>Cross_B</mi><mfenced><mi>x</mi></mfenced></mfenced></math><img file="EP2015250A2_D0032.tif" /></maths>
0082The mixing ratio Ratio (x) is a linear function assuming a divergence point at Ratio_br as shown in <figref idref="f0010">FIG. 10</figref>.
0083In the example presented in <figref idref="f0010">FIG. 10</figref>, Ratio_MAX = 1.0, Ratio_MID = 0.80, Ratio_MIN1 = 0.40 and Ratio_MIN2 = 0.20. In addition, the specific Ratio(x) for the pixel row in the bright beam to be drawn parallel to the central axis at the kth position from the central axis is written as a linear expression represented by a curve passing through two points (Ratio_br, Ratio_MAX - ((Ratio_MAX - Ratio_MID) / n) · k) and (end<sub>k</sub>, Ratio_MIN1 - ((Ratio_MIN1 - Ratio_MIN2) / n) · k).
0084E<sub>k</sub> and F<sub>k</sub> are defined as expressed in (33) and (34), the linear expression in the range 0 ≤ x ≤ Ratio_br is written as in (35) below and the linear expression in the range Ratio_br ≤ x ≤ end<sub>k</sub> is written as in (36) below. <maths id="math0033" num="(33)"><math display="block"><msub><mi mathvariant="normal">E</mi><mi>k</mi></msub><mo>=</mo><mo>-</mo><mfrac><mrow><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>/</mo><mi>Ratio_br</mi></math><img file="EP2015250A2_D0033.tif" /></maths><maths id="math0034" num="(34)"><math display="block"><msub><mi mathvariant="normal">F</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Ratio_MAX</mi><mo>+</mo><mfrac><mrow><mi>Ratio_MAX</mi><mo>-</mo><mi>Ratio_MID</mi></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><mfenced><msub><mi>end</mi><mi>k</mi></msub><mo>-</mo><mi>Ratio_br</mi></mfenced></math><img file="EP2015250A2_D0034.tif" /></maths><maths id="math0035" num="(35)"><math display="block"><mi>Ratio</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">E</mi><mi>x</mi></msub><mo>⋅</mo><mi>x</mi><mo>+</mo><mi>Ratio_MAX</mi></math><img file="EP2015250A2_D0035.tif" /></maths><maths id="math0036" num="(36)"><math display="block"><mi>Ratio</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">F</mi><mi>x</mi></msub><mo></mo><mfenced><mi>x</mi><mo>-</mo><mi>Ratio_br</mi></mfenced><mo>+</mo><mi>Ratio_MAX</mi><mo>-</mo><mfrac><mrow><mi>Ratio_MAX</mi><mo>-</mo><mi>Ratio_MID</mi></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0036.tif" /></maths>
0085The star drawing unit 103d calculates pixel values (R(x), G(x), B(x)) at position x by using expression (32) presented earlier and then is able to draw the star in a color other than white through simple attenuation by drawing bright beams extending from the starting point set at the light source position in the image having been designated by the light source area designating unit 103a.
0086A method that may be adopted when drawing a star by cyclically attenuating the star is now explained. As in the case of the simple attenuation, Y(x) and Ratio(x) are set, and the star drawing unit 103d calculates the pixel values (R(x), G(x), B(x)) at position x by using expression (32) and draws a star within the image by drawing bright beams extending from the starting point set at the light source position having been designated by the light source area designating unit 103a. An explanation of processing similar to that executed in the simple attenuation drawing explained above is not provided.
0087The function Y (x) is set so that the attenuated intensity value Y assumes a minimal value when x = Y_br1 and that the intensity value Y undergoes simple attenuation in the range Y_br2 ≤ x, as shown in <figref idref="f0011">FIG. 11</figref>. For instance, Y_MAX, Y_MID1, Y_MID2, Y_LOC_MINI1, Y_LOC_MINI2, Y_MIN1 and Y_MIN2 may be respectively set to 250, 200, 180, 100, 50, 40 and 20. It is assumed that Y_br1 is equal to length/3 and that Y_br2 is equal to length/2.
0088The function Y(x) is set so that the intensity value Y becomes attenuated as expressed in a quadratic expression in the range 0 ≤ x ≤ Y_br1 and in the range Y_br1 ≤ x ≤ Y_br2 and as expressed in a linear expression in the range Y_br2 ≤ x ≤ end<sub>k</sub>. For instance, a function indicating the attenuation of the intensity in the pixel row in the bright beam to be drawn parallel to the central axis at the kth position from the central axis should be determined so that the curve representing the function passes through three points, i.e., (Y_br1, (Y_LOC_MID1 - ((Y_LOC_MID1 - Y_LOC_MID2) / n) · k), (Y_br2, Y_MID1 - ((Y_MID1 - Y_MID2) / n) · k) and (end<sub>k</sub>, Y_MIN1 - ((Y_MIN1 - Y_MIN2) / n) · k).
0089Once L<sub>k</sub>, M<sub>k</sub> and N<sub>k</sub> are defined as expressed in (37) (38) and (39) below, the quadratic expression in the range 0 ≤ x ≤ Y_br1 can be written as in (40), the quadratic expression in the range Y_br1 ≤ x ≤ Y_br2 can be written as in (41) below and the linear expression in the range Y_br2 ≤ x ≤ end<sub>k</sub>, can be written as in (42) below. <maths id="math0037" num="(37)"><math display="block"><msub><mi mathvariant="normal">L</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Y_MAX</mi><mo>-</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>+</mo><mfrac><mrow><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><msup><mfenced><mi>Y_br</mi><mo></mo><mn>1</mn></mfenced><mn>2</mn></msup></math><img file="EP2015250A2_D0037.tif" /></maths><maths id="math0038" num="(38)"><math display="block"><msub><mi mathvariant="normal">M</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><msup><mfenced><mi>Y_br</mi><mo></mo><mn>2</mn><mo>-</mo><mi>Y_br</mi><mo></mo><mn>1</mn></mfenced><mn>2</mn></msup></math><img file="EP2015250A2_D0038.tif" /></maths><maths id="math0039" num="(39)"><math display="block"><msub><mi mathvariant="normal">N</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Y_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><mfenced><msub><mi>end</mi><mi>k</mi></msub><mo>-</mo><mi>Y_br</mi><mo></mo><mn>2</mn></mfenced></math><img file="EP2015250A2_D0039.tif" /></maths><maths id="math0040" num="(40)"><math display="block"><mi mathvariant="normal">Y</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">L</mi><mi>k</mi></msub><mo>⋅</mo><msup><mfenced><mi>x</mi><mo>-</mo><mi>Y_br</mi><mo></mo><mn>1</mn></mfenced><mn>2</mn></msup><mo>+</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0040.tif" /></maths><maths id="math0041" num="(41)"><math display="block"><mi mathvariant="normal">Y</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">M</mi><mi>k</mi></msub><mo>⋅</mo><msup><mfenced><mi>x</mi><mo>-</mo><mi>Y_br</mi><mo></mo><mn>1</mn></mfenced><mn>2</mn></msup><mo>+</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0041.tif" /></maths><maths id="math0042" num="(42)"><math display="block"><mi mathvariant="normal">Y</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">N</mi><mi>k</mi></msub><mo>⋅</mo><mfenced><mi>x</mi><mo>-</mo><mi>Y_br</mi><mo></mo><mn>2</mn></mfenced><mo>+</mo><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Y_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Y_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0042.tif" /></maths>
0090The mixing ratio Ratio (x) is a linear function assuming divergence points at Ratio_br1 and Ratio_br2, as shown in <figref idref="f0012">FIG. 12</figref>. It is assumed that the divergence points Ratio_br1 and Ratio_br2 in <figref idref="f0012">FIG. 12</figref> are respectively equivalent to Y_br1 and Y_br2 mentioned earlier. Ratio_MAX, Ratio_MID1, Ratio_LOC_MID1, Ratio_MID2, Ratio_LOC_MID2, Ratio_MIN1 and Ratio_MIN2 may be respectively set to 1.0, 0.90, 0.80, 0.60, 0.40, 0.30 and 0.20.
0091In addition, the specific Ratio(x) for the pixel row in the bright beam to be drawn parallel to the central axis at the kth position from the central axis is written as a linear expression represented by curve passing through three points (Ratio_br1, Ratio_LOC_MID1 - ((Ratio_LOC_ MID1 - Ratio_LOC_MID2) / n) · k), (Ratio_br2, Ratio_MID1 - ((Ratio_MID1 - Ratio_MID2) / n) · k) and (end<sub>k</sub>, Ratio_MIN1 - ((Ratio_MIN1 - Ratio_MIN2) / n) · k).
0092Once S<sub>k</sub>, T<sub>k</sub> and U<sub>k</sub> are defined as expressed in (43) (44) and (45), the quadratic expression in the range 0 ≤ x ≤ Ratio_br1 can be written as in (46) below, the quadratic expression in the range Ratio_br1 ≤ x ≤ Ratio_br2 can be written as in (47) below and the linear expression in the range Ratio_br2 ≤ x ≤ end<sub>k</sub> can be written as in (48) below. <maths id="math0043" num="(43)"><math display="block"><msub><mi mathvariant="normal">S</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Ratio_MAX</mi><mo>-</mo><mi>Ratio_LOC_MIN</mi><mo></mo><mn>1</mn><mo>+</mo><mfrac><mrow><mi>Ratio_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><mi>Ratio_br</mi><mo></mo><mn>1</mn></math><img file="EP2015250A2_D0043.tif" /></maths><maths id="math0044" num="(44)"><math display="block"><msub><mi mathvariant="normal">T</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Ratio_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><mfenced><mi>Ratio_br</mi><mo></mo><mn>2</mn><mo>-</mo><mi>Ratio_br</mi><mo></mo><mn>1</mn></mfenced></math><img file="EP2015250A2_D0044.tif" /></maths><maths id="math0045" num="(45)"><math display="block"><msub><mi mathvariant="normal">U</mi><mi>k</mi></msub><mo>=</mo><mfenced><mi>Ratio_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi><mo>-</mo><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></mfenced><mo>/</mo><mfenced><msub><mi>end</mi><mi>k</mi></msub><mo>-</mo><mi>Ratio_br</mi><mo></mo><mn>2</mn></mfenced></math><img file="EP2015250A2_D0045.tif" /></maths><maths id="math0046" num="(46)"><math display="block"><mi>Ratio</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">S</mi><mi>k</mi></msub><mo>⋅</mo><mi>x</mi><mo>+</mo><mi>Ratio_MAX</mi></math><img file="EP2015250A2_D0046.tif" /></maths><maths id="math0047" num="(47)"><math display="block"><mi>Ratio</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">T</mi><mi>x</mi></msub><mo>⋅</mo><mfenced><mi>x</mi><mo>-</mo><mi>Ratio_br</mi><mo></mo><mn>1</mn></mfenced><mo>+</mo><mi>Ratio_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_LOC_MIN</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_LOC_MIN</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0047.tif" /></maths><maths id="math0048" num="(48)"><math display="block"><mi>Ratio</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><msub><mi mathvariant="normal">U</mi><mi>k</mi></msub><mo>⋅</mo><mfenced><mi>x</mi><mo>-</mo><mi>Ratio_br</mi><mo></mo><mn>2</mn></mfenced><mo>+</mo><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mfrac><mrow><mi>Ratio_MID</mi><mo></mo><mn>1</mn><mo>-</mo><mi>Ratio_MID</mi><mo></mo><mn>2</mn></mrow><mi>n</mi></mfrac><mo>⋅</mo><mi>k</mi></math><img file="EP2015250A2_D0048.tif" /></maths>
0093When drawing a star assuming a white color, too, the functions Y(x) and Ratio (x) are set in much the same way as when drawing a star in a color other than white, and accordingly, a repeated explanation is omitted. When the star color is white, the values (Cross_R (x), Cross_G(x), Cross_B(x)) at position x are calculated through a method different from that adopted when calculating the corresponding values for a star in a color other than white. Accordingly, the calculation method adopted in conjunction with a white star is explained below.
0094As explained earlier, a white star in an image photographed by using an actual star filter includes rainbow colors in the bright beams. A star containing rainbow colors in the bright beams is formed as the hue H at position x changes cyclically. More specifically, the star drawing unit 103d assumes temporary RGB values (Y(x), Y(x), Y(x)) at position x and obtains (H, S, V) by converting the R, G and B values in the HSV color space. (H(x), S, H) with H(x) expressed in (49) below replacing H are converted to R, G and B values and these R, G and B values are designated as (Cross_R(x), Cross_G(x), Cross_B(x)) at position x. <maths id="math0049" num="(49)"><math display="block"><mi mathvariant="normal">H</mi><mfenced><mi>x</mi></mfenced><mo>=</mo><mi>sin</mi><mfenced><mfrac><mn>3</mn><mi>length</mi></mfrac><mo>⋅</mo><mn>2</mn><mo></mo><mi mathvariant="italic">πx</mi></mfenced></math><img file="EP2015250A2_D0049.tif" /></maths>
0095The star drawing unit 103d calculates pixel values (R(x), G(x), B(x)) at position x by using expression (32) based upon (Cross_R(x), Cross_G(x), Cross_B(x) at position x calculated as described above and then draws a star with rainbow colors in the bright beams by drawing bright beams over the image, which extend from the starting point set at a light source position having been designated by the light source area designating unit 103a.
0096The star drawing unit 103d also corrects the star to render an effect of light diffusion over the center of the star, i.e., over the area where the plurality of bright beams intersect one another. For instance, if bright beams extending along four directions, i.e., upward, downward, to the left and to the right, have been drawn to extend from the starting point set at the light source position through the processing described above, noticeable corners are present in the central area of the star, as shown in <figref idref="f0013">FIG. 13A</figref>. In the embodiment, as shown in <figref idref="f0013">FIG. 13B</figref>, a light diffusion effect is rendered over the central area of the star so as to achieve the effect similar to that in an image photographed by using an actual star filter.
0097More specifically, the star drawing unit 103d sets an xy coordinate system with the origin point O thereof set at the light source position and renders the light diffusion effect individually in the first quadrant, the second quadrant on the third quadrant and the fourth quadrant of the coordinate system as shown in <figref idref="f0014">FIG. 14</figref>. While the following explanation focuses on the light diffusion effect rendered in the first quadrant, the light diffusion effect is rendered in the other quadrants through similar processing.
0098The star drawing unit 103d sets an astroid curve representing an equation written as in (50) below within the first quadrant. This curve passes through two points (n, 2n) and (2n, n) for n = (width -1)/2. <maths id="math0050" num="(50)"><math display="block"><msup><mi>x</mi><mfrac><mn>2</mn><mn>3</mn></mfrac></msup><mo>+</mo><msup><mi>y</mi><mfrac><mn>2</mn><mn>3</mn></mfrac></msup><mo>=</mo><mfenced><mn>1</mn><mo>+</mo><msup><mn>2</mn><mfrac><mn>2</mn><mn>3</mn></mfrac></msup></mfenced><mo></mo><msup><mi>n</mi><mfrac><mn>2</mn><mn>3</mn></mfrac></msup></math><img file="EP2015250A2_D0050.tif" /></maths>
0099The star drawing unit 103d designates an area under the curve where x ≥ n and y ≥ n are both true as a light diffusion effect target area.
0100The star drawing unit 103d calculates the intensity value Y (x, y) as expressed in (51) below for each point (x, y) present within the designated area. <maths id="math0051" num="(51)"><math display="block"><mi mathvariant="normal">Y</mi><mfenced><mi>x</mi><mo></mo><mi>y</mi></mfenced><mo>=</mo><mi>Y_MAX</mi><mo>×</mo><mfrac><msqrt><mn>2</mn><mo></mo><mi>n</mi></msqrt><msqrt><msup><mi>x</mi><mn>2</mn></msup><mo>+</mo><msup><mi>y</mi><mn>2</mn></msup></msqrt></mfrac></math><img file="EP2015250A2_D0051.tif" /></maths>
0101The star drawing unit 103d is able to render the light diffusion effect over the central area of the star by setting the mixing ratio Ratio (x, y) at which the input image and the intensity value Y (x, y) are to be mixed within the designated area to a predetermined value, e.g., 0.90 and then drawing the star based upon R, G and B values calculated for the individual pixels within the area, as expressed in (32) presented earlier.
0102<figref idref="f0015">FIG. 15</figref> presents a flowchart of the processing executed by the image processing apparatus in the embodiment. The processing in <figref idref="f0015">FIG. 15</figref> is executed to draw a star in an image by the control device 103 based upon a program started up in response to a star drawing instruction issued by the user.
0103In step S10, the control device 103 reads star drawing target image data from the HDD 104 and then the operation proceeds to step S20. In step S20, the light source area designating unit 103a executes the processing to be detailed later in reference to <figref idref="f0016">FIG. 16</figref> to designate a light source area within the image. Then, the operation proceeds to step S30, in which the star size determining unit 103b executes the processing to be detailed later in reference to <figref idref="f0017">FIG. 17</figref> to determine the size of the star to be drawn in the image, i.e., the width and the length of the bright beams. Subsequently, the operation proceeds to step S40.
0104In step S40, the star color determining unit 103c executes the processing to be detailed later in reference to <figref idref="f0018">FIG. 18</figref> to determine the color of the star to be drawn in the image. Then, the operation proceeds to step S50 in which the star drawing unit 103d draws a star in the size determined in step S30 and the color determined in step S40 at the light source position designated in step S20. The processing then ends.
0105<figref idref="f0016">FIG. 16</figref> presents a flowchart of the light source area designation processing executed in step S20. In step S21, the light source area designating unit 103a extracts an area (first extracted area) constituted with pixels each assuming an intensity value Y equal to or greater than the predetermined intensity value Y<sub>1</sub> (e.g., Y<sub>1</sub> = 250). The operation then proceeds to step S22 in which the light source area designating unit 103a extracts an area (second extracted area) constituted with pixels each assuming an intensity value Y equal to or greater than the predetermined value Y<sub>2</sub> (e.g., Y<sub>2</sub> = 240). The operation then proceeds to step S23.
0106In step S23, the light source area designating unit 103a detects the relationship with which one type of area among the two types of areas having been extracted in steps S21 and S22 is contained in the other type of area. Namely, it determines whether or not the second extracted area contains a plurality of first extracted areas, as explained earlier. Subsequently, the operation proceeds to step S24 in which a decision is made as to whether or not the second extracted area is a light source area based upon the inclusive relationship between the gravitational center of the second extracted area and the gravitational center of each first extracted area present in the second extracted area and the ratio of the areal size of the second extracted area and the areal size of the first extracted area present in the second extracted area and, based upon the results of the decision-making, a light source area is designated in the image. The operation then returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0107<figref idref="f0017">FIG. 17</figref> presents a flowchart of the star size determining processing executed in step S30. In step S31, the star size determining unit 103b determines the lower limit (Min_width) to the bright beam width based upon the image size W [pixels] x H [pixels]. The operation subsequently proceeds to step S32 in which the star size determining unit 103b calculates the lengths b<sub>i</sub> from the gravitational center of the light source area to specific points on the edge of the area, before the operation proceeds to step S33.
0108In step S33, the star size determining unit 103b calculates the assumed radius (Temp_R) based upon the areal size (S) of the light source area as expressed in (10). Subsequently, the operation proceeds to step S34 in which the star size determining unit 103b determines the bright beam width based upon the relationship between the value of the assumed width (Temp_width) calculated as expressed in (11) and the lower limit (Min_width) value of the bright beam width relative to each other. The operation then proceeds to step S35.
0109In step S35, the star size determining unit 103b calculates the minimum bright beam length in correspondence to the image size W [pixels] x H [pixels]. The operation then proceeds to step S36 in which the star size determining unit 103b calculates the bright beam length (length) as expressed in (15) mentioned earlier. The operation then returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0110<figref idref="f0018">FIG. 18</figref> presents a flowchart of the star color determining processing executed in step S40. In step S41, the star color determining unit 103c scans the light source area for points at which the condition set forth in either expression (16) or expression (17) is satisfied, along eight directions running from the gravitational center of the light source area, i.e., upward, downward, to the left, to the right and along the diagonals, in order to obtain color information from an outer area of the light source area, i.e., color information sampled at points present within the outer area 6c in <figref idref="f0006">FIG. 6</figref>. The star color determining unit extracts one point satisfying the condition along each direction, i.e., a total of eight points.
0111Subsequently, the operation proceeds to step S42, in which the star color determining unit 103c calculates the distribution of the hue circle angles of the eight extracted points, before the operation proceeds to step S43. In step S43, any point, the hue circle angle of which is far off the distribution is eliminated and the star color (Init_R, Init_G, Init_B) is determined based upon the average of the hue circle angles assumed at the remaining points. The operation then returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0112<figref idref="f0019">FIG. 19</figref> presents a flowchart of the star drawing processing executed in step S50. In step S51, the star drawing unit 103d makes a decision as to whether or not the bright beam length (length) is equal to or greater than a specific value. If an affirmative decision is made, the operation proceeds to step S52 in which the star drawing unit 103d makes a decision as to whether or not the star color is white. If a negative decision is made, the operation proceeds to step S53 in which the star drawing unit 103d draws a cyclically attenuating star in the YCbCr color space as described earlier and then the operation proceeds to step S55. In step S55, the star drawing unit 103d renders the diffusion effect over the central area of the star before the operation returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0113If, on the other hand, an affirmative decision is made in step S52, the operation proceeds to step S54 in which the star drawing unit 103d draws a cyclically attenuating star in the HSV color space, before the operation proceeds to step S55. The operation then returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0114If a negative decision is made in step S51, the operation proceeds to step S56. In step S56, the star drawing unit 103d makes a decision as to whether or not the star color is white. If a negative decision is made, the operation proceeds to step S57 in which the star drawing unit 103d draws a star that is attenuated through simple attenuation in the YCbCr color space as described earlier and then the operation proceeds to step S55. Subsequently, the operation returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0115If an affirmative decision is made in step S56, the operation proceeds to step S58 in which the star drawing unit 103d draws a star that is attenuated through simple attenuation in the HSV color space as described earlier and then the operation proceeds to step S55. Subsequently, the operation returns to the processing shown in <figref idref="f0015">FIG. 15</figref>.
0116As explained earlier, the image processing apparatus 100 may be, for instance, a personal computer. The image processing program product according to the present invention may be provided in a recording medium 200 (e.g., a CD-ROM) or as a data signal transmitted through a communication network 400 (e. g. , the Internet) as shown in <figref idref="f0020">FIG. 20</figref>. A personal computer 100 takes in the image processing program via a CD-ROM 200. The personal computer 100 has the capability to connect with a communication network 400. A computer 300 is a server that provides the program stored in a recording medium such as a hard disk. The computer 300 transmits the image processing program read out from the hard disk, embodied as a data signal on a carrier wave, to the personal computer 100 via the communication network 400. In short, the image processing program can be distributed as a computer program product adopting any of various modes including the recording medium 200 and the data signal transmitted via the communication network 400.
0117The following advantages are achieved in the embodiment described above. <ol id="ol0001" compact="compact"><li>(1) The light source area designating unit 103a extracts an area constituted with pixels each assuming an intensity value Y equal to or greater than the predetermined intensity value Y<sub>1</sub> in an image as a first extracted area, extracts an area in the image constituted with pixels each assuming an intensity value Y equal to or greater than a predetermined intensity value Y<sub>2</sub> smaller than the intensity value y<sub>1</sub> as a second extracted area and designates an area within the image as a light source area based upon characteristic quantities indicating the characteristics of the first extracted area and the second extracted area. As a result, the light source area can be designated with better accuracy compared to the light source area designation executed based upon a single intensity value.</li><li>(2) Based upon the ratio of the areal size of the second extracted area and the areal size of the first extracted area present inside the second extracted area and the positional relationship between the gravitational center of the second extracted area and the gravitational center of the first extracted area present inside the second extracted area, the light source area designating unit 103a determines whether or not the second extracted area is a light source area. In other words, the areal sizes and the gravitational center positions are used as the characteristic quantities indicating the characteristics of the first extracted area and the second extracted area. Consequently, a light source area inside the image can be determined with an even higher level of accuracy.</li><li>(3) Based upon the positional relationship between the gravitational center of the second extracted area and the gravitational center of the first extracted area present in the second extracted area, the light source area designating unit 103a determines the light source position inside the light source area. Thus, a light source position in the image can be determined with a high level of accuracy.</li><li>(4) The star drawing unit 103d draws a star over the image by drawing bright beams along a plurality of directions from the starting point set in the light source area designated by the light source area designating unit 103a. As a result, a star similar to a star that would appear in an image photographed by using an actual star filter can be drawn the light source area in the image.</li><li>(5) The star size determining unit 103b determines the width and the length of the bright beams to be drawn based upon the image size and the areal size of the light source area. Consequently, a natural-looking star can be drawn.</li><li>(6) The star color determining unit 103c determines the color of the star to be drawn based upon the color information provided at points set apart from the gravitational center in the light source area by a predetermined distance or more. As a result, the optimal star color matching the color of the light source is selected.</li><li>(7) The star drawing unit 103d adjusts the star drawing method in correspondence to the length of pixel rows in the bright beams and the star color. More specifically, if the length of pixel rows included in the bright beams is smaller than the predetermined value, the bright beams are drawn so that the intensity of the pixel rows in the bright beams become attenuated through simple attenuation as the distance from the gravitational center of the light source area increases, whereas if the length of pixel rows in the bright beams equal to or greater than the predetermined value, the star drawing unit draws the bright beams so as to cyclically attenuate and amplify the intensity of the pixel rows in the bright beams as the distance from the gravitational center of the light source area increases. When the color of the star is white, the hue of the bright beams changes cyclically. Thus, an image with a star drawn therein, similar to an image obtained by photographing a white-color light source with an actual star filter, is obtained.</li><li>(8) The star drawing unit 103d renders an light diffusion effect over an area at which a plurality of bright beams intersect one another, i.e., over the central area of a star. Thus, an image with a star drawn therein, similar to an image obtained by photographing a light source with an actual star filter, is obtained.</li></ol>
-Variations-
0118The image processing apparatus achieved in the embodiment described above allows for the following variations. <ol id="ol0002" compact="compact"><li>(1) In the embodiment described above, the gravitational center g<sub>i</sub> of the first extracted area among a plurality of first extracted areas present in the second extracted area, which is closest to the gravitational center g<sub>B</sub> of the second extracted area, is extracted as the gravitational center G and is then designated as the light source position. Then, bright beams are drawn to extend from the starting point set at the light source position. Alternatively, the gravitational centers g<sub>i</sub> of first extracted areas present within a predetermined range from the gravitational center g<sub>B</sub> of the second extracted area may be all designated as light source positions and bright beams may be drawn from starting points set at the individual light source positions. In addition, the gravitational center g<sub>B</sub> of the second extracted area may be designated as the light source position, instead.</li><li>(2) The star color determining unit 103c in the embodiment described above scans the light source area along the eight directions extending upward, downward, to the length, to the right and along the diagonals from the gravitational center g<sub>B</sub> of the second extracted area to locate points each satisfying the condition set forth either in expression (16) or in expression (17) and extracts one eligible point in correspondence to each direction, i.e., a total of eight points. It then calculates the distribution of the hue circle angles at the extracted eight points, eliminates any point the hue circle angles of which is far off the distribution, and then determines the star color (Init_R, Init_G, Init_B) based upon the average of the hue circle angles at the remaining points. Alternatively, the star color determining unit 103c may extract any four points among the eight points having been extracted, e.g., four points with the third-highest intensity value Y, the fourth highest intensity value Y, the fifth highest intensity value Y and the sixth highest intensity value Y and then may determine the star color (Init_R, Init_G, Init_B) based upon the averages of the values corresponding to the individual colors R, G and B indicated at the four points.</li><li>(3) In the embodiment described above, a star is drawn at the light source position having been designated by the light source area designating unit 103a. The light source area or the light source position designated by the light source area designating unit 103a may also be used in another type of image processing. For instance, the image processing of the brightness of the image may automatically be determined based upon the results of analysis of the distribution of light source areas or light source positions inside the image.</li><li>(4) An explanation is given above on an example in which the light source area designating unit 103a designates a light source area within an image based upon the areal sizes and the gravitational center positions representing characteristic quantities indicating the characteristics of the first extracted area and the second extracted area. A light source area may instead be designated by using another type of information as characteristic quantities indicating the characteristics of the first extracted area and the second extracted area. For instance, instead of the gravitational center positions indicating the positions of the gravitational centers of the first extracted area and the second extracted area, the positions of points with the highest intensity values in the first extracted area and the second extracted area may be used as characteristic quantities. Alternatively, in place of the gravitational center positions in the first extracted area and the second extracted area, the positions of the central point of the rectangle circumscribing the first extracted area and the central point of the rectangle circumscribing the second extracted area may be used as characteristic quantities. In addition, either the areal sizes or the gravitational center positions alone may be used as characteristic quantities of the first extracted area and the second extracted area. Moreover, the light source area designating unit 103a may designate a first extracted area present within the second extracted area as a light source area in the image without using any characteristic quantities indicating the characteristics of the first extracted area and the second extracted area.</li><li>(5) An explanation is given above in reference to the embodiment on an example in which the image processing apparatus 100 is constituted with a personal computer. Instead, the image processing apparatus 100 may be constituted with another type of information device that records images, such as a digital camera or a portable telephone.</li></ol>
0119The above described embodiment are examples and various modifications can be made without departing from the scope of invention.
Contents3
71 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| EP1513103A2 | Cites | European Patent Office (EPO) | Search report |
| EP1513103A2 | Cites | European Patent Office (EPO) | Applicant |
| EP1837803A2 | Cites | European Patent Office (EPO) | Search report |
| EP1837803A2 | Cites | European Patent Office (EPO) | Applicant |
| US2004071352A1 | Cites | United States of America | Search report |
| US2005063604A1 | Cites | United States of America | Search report |
| JP2005092724A | Cites | Japan | Applicant |
| US4045655A | Cites | United States of America | Search report |
| US5150422A | Cites | United States of America | Search report |
| US5878156A | Cites | United States of America | Search report |
| US6343137B1 | Cites | United States of America | Search report |
| US6658163B1 | Cites | United States of America | Search report |
9 members in 4 offices; this record represents the family
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 2007150545 | Japan | – | |
| 2007150545 | Japan | A |
Members9
| Document | Office | Kind | |
|---|---|---|---|
| JP2008305081A | Japan | A | |
| US2009010532A1 | United States of America | A1 | |
| EP2015250A2This record | European Patent Office (EPO) | A2 | |
| EP2015250A3 | European Patent Office (EPO) | A3 | |
| EP2015250B1 | European Patent Office (EPO) | B1 | |
| AT549702T | Austria | T | |
| ATE549702T1 | Austria | T1 | |
| JP4985117B2 | Japan | B2 | |
| US8326044B2 | United States of America | B2 |
78 legal events, as 8 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Opt-out of the competence of the unified patent court (upc) registeredP01 | P01 | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filed against granted patent, or epo opposition proceedings concluded without decisionGrantedR097 | R097 | DE | |
| Patent lapsedLapsedMM4A | MM4A | IE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lt: invalidation of european patent or patent extensionLTIE | LTIE | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Discontinued in the netherlands as no translation has been filedVDEP | VDEP | NL | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Reference to at number (ep patent validated in austria)REF | REF | AT | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Amendment of ipc main classPREVIOUS MAIN CLASS: G06T0005000000R079 | R079 | DE | |
| First examination report despatched17Q | 17Q | EP | |
| Designation fees paidAKX | AKX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 2015250
- Application
- 81577322
Titles3
- German
- Bildverarbeitungsprogrammprodukt und Bildverarbeitungsvorrichtung
- English
- Image processing program product and image processing apparatus
- French
- Produit de programme de traitement d'image et appareil de traitement d'image
Classification
- CPC, 1
- G06T11/10
- IPC, 3
- G06T5 00
- G06T7 00
- G06T11 00
Designated states38
- Contracting states, 34
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Croatia
- Hungary
- Ireland
- Iceland
- Italy
- Liechtenstein
- Lithuania
- Luxembourg
- Latvia
- Monaco
and 10 moreShow fewer
- Malta
- Netherlands (Kingdom of the)
- Norway
- Poland
- Portugal
- Romania
- Sweden
- Slovenia
- Slovakia
- Türkiye
- Extension states, 4
- Albania
- Bosnia and Herzegovina
- North Macedonia
- Serbia