Image processing apparatus, image processing method, and recording medium

BACKGROUND OF THE INVENTION

00011. Field of the Invention

0002The present invention relates to an image processing apparatus, an image processing method, and a recording medium.

00032. Description of Related Art

0004Conventionally-known image processing apparatuses perform image processing such as sharpening for image data with a processing degree specified by a user (Japanese Patent Laid-open Publication No. 2001-167265 (PTL 1)).

0005However, in the case of the aforementioned PTL 1 or the like, each time the processing degree of the image processing is changed, image processing needs to be performed with a new processing degree. It is therefore difficult for an image processing apparatus including an arithmetic unit not having high processing capacity to perform processing at higher speed. Particularly in the case of repeatedly fine-tuning the processing degree of the image processing or changing the processing degree for only a part of the image, it takes a lot of time to provide a processed image having an appearance (processing degree) desired by a user.

SUMMARY OF THE INVENTION

0006The present invention was made in the light of the above described problem, and an object of the present invention is to provide an image processing apparatus, an image processing method, and a recording medium which can shorten processing time that it takes to change the output style of only a predetermined region of a processing object image.

0007According to an embodiment of the present invention, there is provided an image processing apparatus, including: a first acquisition unit to acquire a first image; a second acquisition unit to acquire a second image obtained by performing predetermined image processing for the first image; a compositing unit to generate a composite image composed of the first and second images that are combined to be superimposed on each other; a specifying unit to specify, based on a user's predetermined operation of an operation input unit, a change region in the composite image whose composition ratio is to be changed; and a controller to change transparency of the upper one of the first and second images to change the composition ratio at which the compositing unit combines the first and second images in the change region specified by the specifying unit.

0008According to an embodiment of the present invention, there is provided an image processing method, including the steps of: acquiring a first image; acquiring a second image obtained by performing image processing for the first image; generating a composite image composed of the first and second images that are combined to be superimposed on each other; specifying a change region in the composite image whose composition ratio is to be changed based on a user's predetermined operation of an operation input unit; and changing transparency of the upper one of the first and second images to change the specified composition ratio of the first image to second image in the specified change region.

0009According to an embodiment of the present invention, there is provided a recording medium recording a program for causing a computer of an image processing apparatus to function as: a first acquisition unit to acquire a first image; a second acquisition unit to acquire a second image obtained by performing predetermined image processing for the first image; a compositing unit to generate a composite image composed of the first and second images that are combined to be superimposed on each other; a specifying unit to specify, based on a user's predetermined operation of an operation input unit, a change region in the composite image whose composition ratio is to be changed; and a controller to change transparency of the upper one of the first and second images to change the composition ratio at which the compositing unit combines the first and second images in the change region specified by the specifying unit.

BRIEF DESCRIPTION OF THE DRAWINGS

0010<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram showing a schematic configuration of an image output apparatus of an embodiment to which the present invention is applied.

0011<figref idref="DRAWINGS">FIG. 2</figref> is a flowchart showing an example of an operation concerning an image generation process by the image output apparatus of <figref idref="DRAWINGS">FIG. 1</figref>.

0012<figref idref="DRAWINGS">FIGS. 3A and 3B</figref> are views for explaining the image generation process of <figref idref="DRAWINGS">FIG. 2</figref>.

0013<figref idref="DRAWINGS">FIGS. 4A and 4B</figref> are views for explaining the image generation process of <figref idref="DRAWINGS">FIG. 2</figref>.

0014<figref idref="DRAWINGS">FIGS. 5A and 5B</figref> are views for explaining the image generation process of <figref idref="DRAWINGS">FIG. 2</figref>.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

0015Hereinafter, a description is given of a specific mode of the present invention using drawings. However, the scope of the invention is not limited to the examples shown in the drawings.

0016<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram showing a schematic configuration of an image output apparatus <b>100</b> of an embodiment to which the present invention is applied.

0017The image output apparatus <b>100</b> of this embodiment combines a first image P<b>1</b> and a second image P<b>2</b> to generate a composite image P<b>3</b> and changes a composition ratio of the first image P<b>1</b> to second image P<b>2</b> in a predetermined region A of the composite image P<b>3</b> specified based on a user's predetermined operation of an operation input unit <b>2</b>.

0018Specifically, as shown in <figref idref="DRAWINGS">FIG. 1</figref>, the image output apparatus <b>100</b> includes a display unit <b>1</b>, the operation input unit <b>2</b>, an image processing unit <b>3</b>, a composite image generation unit <b>4</b>, an image recording unit <b>5</b>, a printing unit <b>6</b>, a memory <b>7</b>, and a central controller <b>8</b>.

0019The display unit <b>1</b> includes a display panel <b>1</b><i>a </i>and a display controller <b>1</b><i>b. </i>

0020The display controller <b>1</b><i>b </i>causes a display screen of a display panel <b>1</b><i>a </i>to display image data of the composite image P<b>3</b> (see a composite image P<b>3</b><i>a </i>in <figref idref="DRAWINGS">FIGS. 3A and 3B</figref>, for example) generated by the composite image generation unit <b>4</b> or image data which is read from a recording medium M of the image recording unit <b>5</b> and is decoded by the image processing unit <b>3</b>.

0021The display panel <b>1</b><i>a </i>is composed of a liquid crystal display panel, an organic EL display panel, or the like, for example, but is not limited to those examples.

0022The operation input unit <b>2</b> includes operating portions composed of data input keys for entering numerals, characters, and the like, up, down, right, and left keys for data selection, feeding operation, and the like, various function keys, and the like. The operation input unit <b>2</b> outputs a predetermined operation signal according to an operation of the operating portions.

0023The operation input unit <b>2</b> includes a touch panel <b>2</b><i>a </i>integrally provided for the display panel <b>1</b><i>a </i>of the display unit <b>1</b>.

0024The touch panel <b>2</b><i>a </i>detects the position of a user's finger (hand), a touch pen, or the like which is in direct or indirect contact with the display screen constituting an image display region of the display panel <b>1</b><i>a </i>(hereinafter, referred to as a touch position). Specifically, the touch panel <b>2</b><i>a </i>is provided on or inside the display screen and is configured to detect XY coordinates of the touch position on the display screen by various methods including a resistive film method, an ultrasonic surface acoustic wave method, and a capacitive method. The touch panel <b>2</b><i>a </i>is configured to output a position signal concerning the XY coordinates of the touch position.

0025The precision of detecting the touch position on the display screen by the touch panel <b>2</b><i>a </i>can be properly and arbitrarily changed. For example, the touch position may include only one pixel precisely or may include plural pixels within a predetermined range around the one pixel.

0026The image processing unit <b>3</b> includes an art conversion section <b>3</b><i>a. </i>

0027The art conversion section <b>3</b><i>a </i>is configured to perform art conversion which processes a predetermined image Pa as a processing object into an image having various types of visual effects.

0028Herein, the art conversion refers to image processing to change the visual effect of the predetermined image Pa as a processing object, that is, to change the display style of the image Pa which is being displayed on the display unit <b>1</b>. To be specific, examples of the art conversion are “color pencil effect conversion” to obtain an image including a visual effect as if the image is drawn by color pencils (see <figref idref="DRAWINGS">FIG. 3A</figref>), “oil painting effect conversion” to obtain an image including a visual effect as if the image is drawn by oil paints, and “water color effect conversion” as if the image is drawn by watercolors. However, these are just examples, and the art conversion is not limited to these types of conversion and can be properly and arbitrarily changed.

0029The art conversion section <b>3</b><i>a </i>performs art conversion including a predetermined type of processing specified based on a user's predetermined operation of the operation input unit <b>2</b> (the color pencil effect conversion, for example) for the predetermined image Pa.

0030The technique to process an image into an image including various types of visual effects is implemented by a process substantially similar to the processes using software concerning publicly-known image processing, for example. The image processing is performed by changing the hue, saturation, and value in a HSV color space or using various types of filter. Such a technique is publicly known, so detailed description thereof is omitted. The “xx effect” refers to a visual effect obtained by art conversion which can be implemented by the software concerning the publicly-known image processing.

0031The image processing is not limited to the art conversion processing the predetermined image Pa to a painting-like image. The image processing can be properly and arbitrarily changed to contour enhancement, gray level correction, binarization, or the like.

0032Moreover, the image processing unit <b>3</b> may include an encoder which compresses and encodes image data according to a predetermined coding system (JPEG, for example), a decoder which decodes encoded image data recorded in a recording medium M with a decoding system corresponding to the predetermined coding system, and the like. Herein, the encoder and decoder are not shown in the drawings.

0033The composite image generation unit <b>4</b> includes a first image acquisition section <b>4</b><i>a</i>, a second image acquisition section <b>4</b><i>b</i>, an image compositing section <b>4</b><i>c</i>, and a region specifying section <b>4</b><i>d</i>, and a composition ratio controller <b>4</b><i>e. </i>

0034The first image acquisition section <b>4</b><i>a </i>is configured to acquire the first image P<b>1</b>.

0035Specifically, the first image acquisition section <b>4</b><i>a </i>acquires the first image P<b>1</b> which is an image for composition by the image compositing section <b>4</b><i>c</i>. To be specific, the first image acquisition section <b>4</b><i>a </i>acquires image data of a predetermined image Pa which is read from the recording medium M and is decoded by the image processing unit <b>3</b> as the first image P<b>1</b>.

0036The first image acquisition section <b>4</b><i>a </i>may acquire one processed image (not shown) which is obtained by performing a predetermined type of image processing (the oil painting effect art conversion, for example) for image data of the predetermined image Pa by the image processing unit <b>3</b> as the first image P<b>1</b>.

0037The second image acquisition section <b>4</b><i>b </i>is configured to acquire a second image P<b>2</b>.

0038Specifically, the second image acquisition section <b>4</b><i>b </i>acquires the second image P<b>2</b> as an image for composition by the image compositing section <b>4</b><i>c</i>. To be specific, the second image acquisition section <b>4</b><i>b </i>acquires, as the second image P<b>2</b>, image data of a processed image Pb which is obtained by performing a predetermined type of art conversion (color pencil effect art conversion, for example) for the image data of the predetermined image Pa acquired as the first image P<b>1</b> by the art conversion section <b>3</b><i>a </i>of the image processing unit <b>3</b>.

0039If one processed image (not shown) is acquired as the first image P<b>1</b> by the first image acquisition section <b>4</b><i>a</i>, the second image acquisition section <b>4</b><i>b </i>may acquire, as the second image P<b>2</b>, another processed image (not shown) which is obtained by performing a different predetermined type of art conversion from the type of art conversion (image processing) performed for the one processed image (the first image P<b>1</b>).

0040The image compositing section <b>4</b><i>c </i>is configured to combine the first and second images P<b>1</b> and P<b>2</b> to generate the composite image P<b>3</b>.

0041Specifically, the image compositing section <b>4</b><i>c </i>combines the image data of the predetermined image Pa acquired by the first image acquisition section <b>4</b><i>a </i>as the first image P<b>1</b> and the image data of the processed image Pb which is already subjected to the predetermined type of art conversion and is acquired by the second image acquisition section <b>4</b><i>b </i>as the second image P<b>2</b>. To be specific, the image compositing section <b>4</b><i>c </i>generates the composite image P<b>3</b> so that pixels of the image data of the predetermined image Pa as the first image P<b>1</b> are laid on the corresponding pixels of the image data of the processed image Pb as the second image P<b>2</b>. For example, the image compositing section <b>4</b><i>c </i>superimposes the image data of the predetermined image P<b>1</b> placed on the lower side in the vertical direction and the image data of the processed image Pb placed on the upper side one on the other to generate the composite image P<b>3</b> (the composite image P<b>3</b><i>a</i>, for example; see <figref idref="DRAWINGS">FIG. 3B</figref>).

0042The vertical direction is a direction substantially orthogonal to the display screen (the image display region) of the display unit <b>1</b> on which the composite image P<b>3</b> is displayed (a viewing direction). The upper side is the near side to a viewer, and the lower side is the far side.

0043The region specifying section <b>4</b><i>d </i>is configured to specify a predetermined region A of the composite image P<b>3</b>.

0044Specifically, the region specifying section <b>4</b><i>d </i>specifies the predetermined region A of the composite image P<b>3</b> (see <figref idref="DRAWINGS">FIG. 4A</figref>) based on a user's predetermined operation of the operation input unit <b>2</b>. To be specific, the region specifying section <b>4</b><i>d </i>specifies the predetermined region A of the composite image P<b>3</b> based on the touch position detected by the touch panel <b>2</b><i>a </i>according to a user's touch operation of the touch panel <b>2</b><i>a </i>of the operation input unit <b>2</b>. For example, if the touch position is detected according to the user's predetermined touch operation of the touch panel <b>2</b><i>a </i>in the state where the composite image P<b>3</b> is displayed on the display panel <b>1</b><i>a </i>of the display unit <b>1</b>, the operation input unit <b>2</b> outputs a position signal concerning the XY coordinates of the touch position to the region specifying section <b>4</b><i>d</i>. Upon receiving the position signal outputted from the operation input unit <b>2</b>, the region specifying section <b>4</b><i>d </i>specifies the predetermined region A of the composite image P<b>3</b> (a face region A<b>1</b>, for example) based on the received position signal.

0045Herein, the region specifying section <b>4</b><i>d </i>may specify the input state of the position signal concerning the user's touch position on the touch panel <b>2</b><i>a </i>which is outputted from the operation input portion <b>2</b> as the user's touch operation on the touch panel <b>2</b><i>a</i>. The input state includes the number of position signals inputted per unit time according to the number of times that the user touches the touch panel <b>2</b><i>a </i>per unit time, time for which the position signal continues to be inputted according to the time from the start to the end of the touch operation on the touch panel <b>2</b><i>a</i>, and the like.

0046The operation to specify the predetermined region A of the composite image P<b>3</b> is performed by using the touch panel <b>2</b><i>a</i>, but this is just an example. The specifying operation is not limited to the above example and may be performed using another button of the operation input unit <b>2</b>, for example, up, down, right, and left keys.

0047The composition ratio controller <b>4</b><i>e </i>is configured to change the composition ratio of the first image P<b>1</b> to the second image P<b>2</b>.

0048The composition ratio controller <b>4</b><i>e </i>changes the composition ratio at which the image compositing section <b>4</b><i>c </i>combines the predetermined image Pa (the first image P<b>1</b>) and the processed image Pb (the second image P<b>2</b>) in the predetermined region A of the composite image P<b>3</b> which is specified by the region specifying section <b>4</b><i>d</i>. To be specific, the composition ratio controller <b>4</b><i>e </i>changes the composition ratio by changing the transparency of the processed image Pb in the predetermined region A of the predetermined image Pa and processed image Pb superimposed one on the other. The transparency refers to the degree at which the processed image (the upper image) Pb allows the predetermined image (the lower image) Pa to be seen therethrough.

0049For example, the composition ratio controller <b>4</b><i>e </i>uses an alpha value (0&lt;=α&lt;=1) which is a weight used for alpha bending of the processed image Pb with the predetermined image Pa to change the composition ratio of the processed image Pb to the predetermined image Pa. To be specific, the composition ratio controller <b>4</b><i>e </i>specifies the position of the predetermined region A in the processed image Pb, which is the upper image of the composite image P<b>3</b>, and generates position information indicating the position of the predetermined region A in the composite image P<b>3</b> (an alpha map, for example). The composition ratio controller <b>4</b><i>e </i>then determines the pixel value of each pixel of the predetermined region A in the following manner. If the alpha value of each pixel of the processed image Pb in the predetermined region A is 0 (see <figref idref="DRAWINGS">FIG. 3A</figref>), the transparency of the processed image Pb is equal to 0%, and each pixel of the predetermined region A is set to the pixel value of the corresponding pixel of the processed image Pb (see <figref idref="DRAWINGS">FIG. 3B</figref>). If the alpha value of each pixel of the processed image Pb in the predetermined region A is 1 (see <figref idref="DRAWINGS">FIG. 5A</figref>), the transparency of the processed image Pb is equal to 100%, and each pixel of the predetermined region A is set to the pixel value of the corresponding pixel of the predetermined image Pa (see <figref idref="DRAWINGS">FIG. 5B</figref>). If the alpha value of each pixel of the processed image Pb in the predetermined region A is 0&lt;α&lt;1 (see <figref idref="DRAWINGS">FIG. 4A</figref>), the transparency of the processed image Pb varies from 0 to 100%, and each pixel of the predetermined region A is set to a sum (blending) of a product of the pixel value of each pixel of the predetermined image Pa and the alpha value (transparency) and a product of the pixel value of the corresponding pixel of the processed image Pb and 1′s complement (1−α) (see <figref idref="DRAWINGS">FIG. 4B</figref>).

0050In <figref idref="DRAWINGS">FIGS. 4A and 5A</figref>, the transparency (α value) of the predetermined region A is schematically represented by the number of dots. A larger number of dots represent a higher transparency (α value).

0051Moreover, the composition ratio controller <b>4</b><i>e </i>may change the transparency of the processed image Pb in the predetermined region A based on the type of the detected touch operation when detecting the user's touch operation of a region on the display screen of the touch panel <b>2</b><i>a </i>where the predetermined region A of the composite image P<b>3</b> is displayed. The composition ratio controller <b>4</b><i>e </i>may change the transparency based on the number of position signals inputted per unit time according to the number of times that the user touches the touch panel <b>2</b><i>a </i>per unit time or based on the time for which the user continues to perform the touch operation of the touch panel <b>2</b><i>a</i>. For example, the composition ratio controller <b>4</b><i>e </i>gradually increases or reduces the transparency of the processed image Pb in the predetermined region A of the composite image P<b>3</b> according to an increase in the number of position signals inputted per unit time or the time for which the position signal continues to be inputted. Whether to increase or reduce the transparency may be set based on a user's predetermined operation of the operation input section <b>2</b>.

0052The composition ratio controller <b>4</b><i>e </i>changes the transparency of the processed image Pb in the predetermined region A based on a touch operation (a sliding operation) that the user slidingly touches a predetermined part of the touch panel <b>2</b><i>a </i>(for example, a right or left edge portion) in a predetermined direction. For example, the composition ratio controller <b>4</b><i>e </i>gradually increases the transparency of the processed image Pb in the predetermined region A of the composite image P<b>3</b> at a predetermined rate (for example, by 5%) according to the number of times of sliding operation that the user slidingly touches downward one of right and left edges of the touch panel <b>2</b><i>a</i>. On the other hand, the composition ratio controller <b>4</b><i>e </i>gradually reduces the transparency of the processed image Pb in the predetermined region A of the composite image P<b>3</b> at a predetermined rate (for example, by 5%) according to the number of times of the sliding operation that the user slidingly touches upward one of right and left edges of the touch panel <b>2</b><i>a. </i>

0053The composition ratio is changed by changing the transparency of the second image P<b>2</b> in the predetermined region A of the first and second images P<b>1</b> and P<b>2</b> superimposed one on the other. However, this method to change the composition ratio is just an example. The way of changing the composition ratio is not limited to this example and can be properly and arbitrarily changed.

0054The image recording unit <b>5</b> is configured to allow the recording medium M to be loaded in and unloaded from the same. The image recording unit <b>5</b> controls reading of data from the loaded recording medium M and writing of data in the recording medium M.

0055Specifically, the image recording unit <b>5</b> records, in the recording medium M, image data of the composite image P<b>3</b> encoded with a predetermined compression method (JPEG, for example) by the encoder (not shown) of the image processing unit <b>3</b>. To be specific, the recording medium M stores the image data of the composite image P<b>3</b> in which the composition ratio of the first image P<b>1</b> to the second image P<b>2</b> combined by the image compositing section <b>4</b><i>c </i>is changed by the composition ratio controller <b>4</b><i>e. </i>

0056The recording medium M is composed of, for example, a non-volatile memory (flash memory) or the like, but is just an example. The recording medium M is not limited to this example and can be properly and arbitrarily changed.

0057The printing unit <b>6</b> generates a print of the composite image P<b>3</b> based on image data of the composite image P<b>3</b> generated by the composite image generation unit <b>4</b>. To be specific, based on a predetermined print instruction operation by the user at the operation input unit <b>2</b>, the printing unit <b>6</b> acquires image data of the composite image P<b>3</b> from the memory <b>7</b> and prints the composite image P<b>3</b> on a predetermined printing material by a predetermined printing method to generate a print of the composite image P<b>3</b>.

0058The printing material may be a sticker sheet or a normal sheet, for example. The predetermined printing method can be one of various publicly-known printing methods, and examples thereof are off-set printing, ink-jet printing, and the like.

0059The memory <b>7</b> includes a buffer memory temporarily storing image data of the first and second images P<b>1</b> and P<b>2</b> and the like, a working memory serving as a working area of the CPU of the central controller <b>8</b>, a program memory storing various programs and data concerning the functions of the image output apparatus, and the like. These memories are not shown in the drawings.

0060The central controller <b>8</b> controls each section of the image output apparatus <b>100</b>. To be specific, the central controller <b>8</b> includes the CPU (not shown) controlling each section of the image output apparatus <b>100</b> and performs various control operations according to various processing programs (not shown).

0061Next, a description is given of an image generation process by the image output apparatus <b>100</b> with reference to <figref idref="DRAWINGS">FIGS. 2 to 5B</figref>.

0062<figref idref="DRAWINGS">FIG. 2</figref> is a flowchart showing an example of the operation concerning the image generation process.

0063The following image generation process is executed when a composite image generation mode is selected and specified among plural operation modes based on a user's predetermined operation of the up, down, right, and left keys, various function keys, or the like of the operation input portion <b>2</b>.

0064In the following description, the first image P<b>1</b> is the predetermined image Pa which is not subjected to predetermined image processing by the image processing unit <b>3</b>, and the second image P<b>2</b> is the processed image Pb which is subjected to predetermined art conversion (for example, color pencil effect conversion) by the image processing unit <b>3</b> (art conversion section <b>3</b><i>a</i>).

0065As shown in <figref idref="DRAWINGS">FIG. 2</figref>, at first, if the predetermined image Pa is specified among a predetermined number of images displayed on the display unit <b>1</b> based on a user's predetermined operation of the operation input unit <b>2</b>, the first image acquisition section <b>4</b><i>a </i>of the composite image generation unit <b>4</b> acquires image data of the predetermined image Pa which is read from the recording medium M and decoded by the image processing unit <b>3</b> as the first image P<b>1</b> (step S<b>1</b>). The composite image generation unit <b>4</b> then temporarily stores the image data of the predetermined image Pa acquired as the first image P<b>1</b> in a predetermined storage area of the memory <b>7</b>.

0066Subsequently, the art conversion unit <b>3</b><i>a </i>of the image processing unit <b>3</b> performs a predetermined type of art conversion (color pencil effect conversion, for example) for the predetermined image Pa acquired as the first image P<b>1</b> to generate the processed image Pb. The second image acquisition unit <b>4</b><i>b </i>then acquires as the second image P<b>2</b>, image data of the processed image Pb generated (step S<b>2</b>). Subsequently, the composite image generation unit <b>4</b> temporarily stores the image data of the processed image Pb acquired as the second image P<b>2</b> in a predetermined storage area of the memory <b>7</b>.

0067The type of art conversion performed for the predetermined image Pa may be set based on a user's predetermined operation of the operation input unit <b>2</b> or may be set to a type previously determined by default.

0068Next, the composition ratio controller <b>4</b><i>e </i>of the composite image generation unit <b>4</b> sets the transparency of the processed image Pb as the second image P<b>2</b> to 0%. The image synthetic section <b>4</b><i>c </i>then combines the image data of the predetermined image Pa (the first image P<b>1</b>) and the image data of the processed image Pb (the second image P<b>2</b>) to generate the composite image P<b>3</b> (step S<b>3</b>).

0069To be specific, the image compositing section <b>4</b><i>c </i>places the image data of the first image P<b>1</b> on the lower side and the image data of the second image P<b>2</b> on the upper side to generate the composite image P<b>3</b><i>a </i>(see <figref idref="DRAWINGS">FIG. 3B</figref>) so that pixels of the first image P<b>1</b> are superimposed on the corresponding pixels of the second image P<b>2</b>. In this case, the alpha value of each pixel of the second image P<b>2</b> is α=0 (see <figref idref="DRAWINGS">FIG. 3A</figref>), and each pixel of the composite image P<b>3</b><i>a </i>has the same pixel value as the corresponding pixel of the second image P<b>2</b> (the processed image Pb).

0070Thereafter, the display controller <b>1</b><i>b </i>acquires the image data of the composite image P<b>3</b> (for example, the composite image P<b>3</b><i>a</i>) generated by the composite image generation unit <b>4</b> and causes the display screen of the display panel <b>1</b><i>a </i>to display the same (step S<b>4</b>).

0071Subsequently, the CPU of the central controller <b>8</b> determines based on a user's predetermined operation of the operation input unit <b>2</b> whether a termination instruction to terminate the image generation process is inputted (step S<b>5</b>).

0072Herein, if it is determined that the termination instruction is inputted (YES in step S<b>5</b>), the image recording unit <b>5</b> records the image data of the composite image P<b>3</b> generated by the image compositing section <b>4</b><i>c </i>in the recording medium M (step S<b>6</b>) and then terminates the image generation process.

0073On the other hand, if it is determined that the termination instruction is not inputted (NO in step S<b>5</b>), the composite image generation unit <b>4</b> determines whether the predetermined region A of the composite image P<b>3</b> is already specified by the region specifying section <b>4</b><i>d </i>(step S<b>7</b>).

0074Herein, if it is determined that the predetermined region A of the composite image P<b>3</b> is not yet specified (NO in the step S<b>7</b>), the region specifying section <b>4</b><i>d </i>determines based on a user's predetermined operation of the operation input unit <b>2</b> whether the instruction to specify the predetermined region A of the composite image P<b>3</b> is inputted (step S<b>8</b>). To be specific, the region specifying section <b>4</b><i>d </i>determines based on the touch position detected by the touch panel <b>2</b><i>a </i>according to a user's predetermined touch operation of the touch panel <b>2</b><i>a </i>whether the instruction to specify the predetermined region A of the composite image P<b>3</b> (for example, the face region A<b>1</b>) is inputted.

0075If it is determined in the step S<b>8</b> that the instruction to specify the predetermined region A is not inputted (NO in the step S<b>8</b>), the region specifying section <b>4</b><i>d </i>returns the process to the step S<b>4</b>, and the display controller <b>1</b><i>b </i>causes the display screen of the display panel <b>1</b><i>a </i>to display the image data of the composite image P<b>3</b> (the composite image P<b>3</b><i>a</i>, for example) (step S<b>4</b>).

0076On the other hand, if it is determined in the step S<b>8</b> that the instruction to specify the predetermined region A is inputted (YES in the step S<b>8</b>), the composition ratio controller <b>4</b><i>e </i>determines based on a user's predetermined operation of the operation input unit <b>2</b> whether an instruction to change the transparency of the predetermined region A of the composite image P<b>3</b> is inputted (step S<b>9</b>).

0077To be specific, the composition ratio controller <b>4</b><i>e </i>determines whether the instruction to change the transparency of the predetermined region A of the composite image P<b>3</b> is inputted according to the input state of the position signal concerning the touch position outputted from the operation input unit <b>2</b> based on a user's predetermined touch operation of the touch panel <b>2</b><i>a</i>, that is, the type of the user's touch operation of the touch panel <b>2</b><i>a</i>. For example, the composition ratio controller <b>4</b><i>e </i>determines that the instruction to change the transparency of the predetermined region A is inputted when the predetermined portion of the touch panel <b>2</b><i>a </i>(for example, a portion of the specified composite image P<b>3</b> where the predetermined region A is displayed) is touched by the user in the predetermined direction and position signals concerning the touch positions are sequentially inputted due to the user's operation.

0078If it is determined in the step S<b>9</b> that the instruction to change the transparency of the predetermined region A is not inputted (NO in the step S<b>9</b>), the composite image generation unit <b>4</b> returns the process to the step S<b>4</b>, and the display controller <b>1</b><i>b </i>causes the display screen of the display panel <b>1</b><i>a </i>to display the image data of the composite image P<b>3</b> (the composite image P<b>3</b><i>a</i>, for example; see <figref idref="DRAWINGS">FIG. 3B</figref>).

0079On the other hand, if it is determined in the step S<b>9</b> that the instruction to change the transparency of the predetermined region A is inputted (YES in the step S<b>9</b>), the composite image generation unit <b>4</b> causes the process to branch according to the type of the user's operation of the operation input unit <b>2</b> (the user's touch operation of the touch panel <b>2</b><i>a</i>, for example) (step S<b>10</b>). To be specific, if the user's operation of the operation input unit <b>2</b> is the operation to increase the transparency of the second image P<b>2</b> (the operation to increase the transparency in the step S<b>10</b>), the composite image generation unit <b>4</b> moves the process to step S<b>111</b>. If the user's operation of the operation input unit <b>2</b> is the operation to reduce the transparency of the second image P<b>2</b> (the operation to reduce the transparency in the step S<b>10</b>), the composite image generation unit <b>4</b> moves the process to step S<b>121</b>.

<Case of Increasing Transparency of Second Image P

2

>

0080In the step S<b>9</b>, if the portion of the touch panel <b>2</b><i>a </i>where the specified predetermined region A is displayed is subjected to the downward touch operation to sequentially supply plural position signals constituting a trajectory extending downward, the composition ratio controller <b>4</b><i>e </i>identifies the user's operation as the operation to increase the transparency of the second image P<b>2</b> (the operation to increase the transparency in the step S<b>10</b>) and then increases the transparency of the second image P<b>2</b> (the processed image Pb) in the predetermined region A of the composite image P<b>3</b> at a predetermined rate (by 5%, for example) (step S<b>111</b>). The image compositing section <b>4</b><i>c </i>generates the composite image P<b>3</b> according to the new transparency of the second image P<b>2</b> changed by the composition ratio controller <b>4</b><i>e </i>(the composition ratio of the first image P<b>1</b> to the second image P<b>2</b>).

0081Accordingly, if the transparency of the second image P<b>2</b> in the predetermined region A is 5%, for example, the alpha value of the second image P<b>2</b> is α=0.05 (0&lt;α&lt;1) (see <figref idref="DRAWINGS">FIG. 4A</figref>), the pixel value of each pixel in the predetermined region A of the composite image P<b>3</b><i>b </i>is set to a sum (blending) of a product of the pixel value of the corresponding pixel of the first image P<b>1</b> (the predetermined image Pa) and the alpha value (α=0.05) and a product of the pixel value of the corresponding pixel of the second image P<b>2</b> (the processed image Pb) and the 1's complement (1−α) (see <figref idref="DRAWINGS">FIG. 4B</figref>).

0082Next, the composition ratio controller <b>4</b><i>e </i>determines whether or not the changed transparency of the second image P<b>2</b> is <b>100</b>% or more (step S<b>112</b>).

0083Herein, if it is determined that the new transparency of the second image P<b>2</b> is not <b>100</b>% or more (NO in the step S<b>112</b>), the composition ratio controller <b>4</b><i>e </i>returns the process to the step S<b>4</b>. The display controller <b>1</b><i>b </i>then acquires the image data of the generated composite image P<b>3</b> (the composite image P<b>3</b><i>b</i>, for example) and causes the display screen of the display panel la to display the same (step S<b>4</b>).

0084Thereafter, the processing of the step S<b>4</b> and after is executed. To be specific, if it is determined in the step S<b>7</b> that the predetermined region A of the composite image P<b>3</b> is already specified (YES in the step S<b>7</b>), the process of the step S<b>8</b> is skipped. In step S<b>9</b>, the composition ratio controller <b>4</b><i>e </i>then determines whether the instruction to change the transparency of the predetermined region A of the composite image P<b>3</b> is inputted (the step S<b>9</b>).

0085In the step S<b>10</b>, each time the user performs the operation to increase the transparency of the second image P<b>2</b> (the operation to increase the transparency in the step S<b>10</b>), the composition ratio controller <b>4</b><i>e </i>increases the transparency of the second image P<b>2</b> (the processed image Pb) in the predetermined region A of the composite image P<b>3</b> at a predetermined rate (by 5%, for example) (the step S<b>111</b>).

0086On the other hand, it is determined in step S<b>112</b> that the changed transparency of the second image P<b>2</b> is 100% or more (YES in the step S<b>112</b>), the composition ratio controller <b>4</b><i>e </i>sets the transparency of the second image P<b>2</b> to 100% (step S<b>113</b>). The image synthetic section <b>4</b><i>c </i>then generates the composite image P<b>3</b> according to the transparency of the second image P<b>2</b> changed by the composition ratio controller <b>4</b><i>e </i>(the composition ratio of the first image P<b>1</b> to the second image P<b>2</b>).

0087Accordingly, if the transparency of the second image P<b>2</b> in the predetermined region A is 100%, for example, the alpha value of each pixel of the second image P<b>2</b> is equal to 1 (see <figref idref="DRAWINGS">FIG. 5A</figref>), and each pixel of the predetermined region A of the composite image P<b>3</b><i>c </i>has the same pixel value as the corresponding pixel of the first image P<b>1</b> (the predetermined image Pa) (see <figref idref="DRAWINGS">FIG. 5B</figref>).

0088The composite image generation unit <b>4</b> then returns the process to the step S<b>4</b>. The display controller <b>1</b><i>b </i>acquires the image data of the generated composite image P<b>3</b> (for example, the composite image P<b>3</b><i>c</i>) and causes the display screen of the display panel <b>1</b><i>a </i>to display the same (step S<b>4</b>).

0089Moreover, if the user determines that the predetermined region A of the composite image P<b>3</b> displayed in the step <b>4</b> has an appearance desired by the user and performs a predetermined operation of the operation input unit <b>2</b> to instruct termination of the image generation process, the CPU of the central controller <b>8</b> determines in the step S<b>5</b> that the termination instruction to terminate the image generation process is inputted (YES in the step S<b>5</b>). In the step S<b>5</b>, the image recording unit <b>5</b> then records the image data of the composite image P<b>3</b> in the recording medium M and then terminates the image generation process.

<Case of Reducing Transparency of Second Image P

2

>

0090In the step S<b>9</b>, if the portion of the touch panel <b>2</b><i>a </i>where the specified predetermined region A is displayed is subjected to the upward touch operation to sequentially supply plural position signals constituting a trajectory extending upward, the composition ratio controller <b>4</b><i>e </i>identifies the user's operation as the operation to reduce the transparency of the second image P<b>2</b> (the operation to increase the transparency in the step S<b>10</b>) and then reduces the transparency of the second image P<b>2</b> (the processed image Pb) in the predetermined region A of the composite image P<b>3</b> at a predetermined rate (by 5%, for example) (step S<b>121</b>). The image compositing section <b>4</b><i>c </i>generates the composite image P<b>3</b> (the composite image P<b>3</b><i>b</i>, for example) according to the new transparency of the second image P<b>2</b> changed by the composition ratio controller <b>4</b><i>e </i>(the composition ratio of the first image P<b>1</b> to the second image P<b>2</b>).

0091The method of generating the composite image P<b>3</b> is the same as that in the case of increasing the transparency of the second image P<b>2</b>, and the detailed description thereof is omitted.

0092Next, the composition ratio controller <b>4</b><i>e </i>determines whether or not the changed transparency of the second mage P<b>2</b> is 0% or less (step S<b>122</b>).

0093Herein, if it is determined that the changed transparency of the second image P<b>2</b> is not 0% or less (NO, in the step S<b>122</b>), the composition ratio controller <b>4</b><i>e </i>returns the process to the step S<b>4</b>. The display controller <b>1</b><i>b </i>then acquires the image data of the generated composite image P<b>3</b> (the composite image P<b>3</b><i>b</i>, for example) and causes the display screen of the display panel la to display the same (step S<b>4</b>).

0094Thereafter, the processing of the step S<b>4</b> and after is executed. To be specific, each time the user performs the operation to reduce the transparency of the second image P<b>2</b> (the operation to reduce the transparency in the step S<b>10</b>), the composition ratio controller <b>4</b><i>e </i>reduces the transparency of the second image P<b>2</b> (the processed image Pb) in the predetermined region A of the composite image P<b>3</b> at a predetermined rate (by <b>5</b>%, for example) (step S<b>121</b>).

0095On the other hand, it is determined in step S<b>122</b> that the changed transparency of the second image P<b>2</b> is 0% or less (YES in the step S<b>122</b>), the composition ratio controller <b>4</b><i>e </i>sets the transparency of the second image P<b>2</b> to 0% (step S<b>123</b>). The image synthetic section <b>4</b><i>c </i>then generates the composite image P<b>3</b> according to the new transparency of the second image P<b>2</b> changed by the composition ratio controller <b>4</b><i>e </i>(the composition ratio of the first image P<b>1</b> to the second image P<b>2</b>).

0096Accordingly, if the transparency of the second image P<b>2</b> in the predetermined region A is 0%, for example, the alpha value of each pixel of the second image P<b>2</b> is equal to α=0 (see <figref idref="DRAWINGS">FIG. 3A</figref>), and each pixel of the predetermined region A of the composite image P<b>3</b><i>a </i>has the same pixel value as the corresponding pixel of the second image P<b>2</b> (the processed image Pb) (see <figref idref="DRAWINGS">FIG. 3B</figref>). The pixel value of each pixel of the composite image P<b>3</b><i>a </i>is set to the pixel value of the corresponding pixel of the second image P<b>2</b>.

0097The composite image generation unit <b>4</b> then returns the process to the step S<b>4</b>. The display controller <b>1</b><i>b </i>acquires the image data of the generated composite image P<b>3</b> (for example, the composite image P<b>3</b><i>a</i>) and causes the display screen of the display panel <b>1</b><i>a </i>to display the same (step S<b>4</b>).

0098Moreover, if it is determined by the user that the predetermined region A of the composite image P<b>3</b> displayed in the step <b>4</b> has an appearance desired by the user and a predetermined operation of the operation input unit <b>2</b> is performed to instruct termination of the image generation process, the CPU of the central controller <b>8</b> determines in the step S<b>5</b> that the termination instruction to terminate the image generation process is inputted (YES in the step S<b>5</b>). In the step S<b>5</b>, the image recording unit <b>5</b> then records the image data of the composite image P<b>3</b> in the recording medium M and then terminates the image generation process.

0099As described above, according to the image output apparatus <b>100</b> of this embodiment, the first image P<b>1</b>, that is, the predetermined image Pa or a processed image obtained by performing a predetermined type of image processing for the predetermined image Pa, and the second image P<b>2</b>, that is, another processed image Pb obtained by performing a different predetermined type of image processing from the type of the image processing concerning the first image P<b>1</b>, are superimposed on each other to generate the composite image P<b>3</b>, and the composition ratio of the first image P<b>1</b> to second image P<b>2</b> in the predetermined region A of the composite image P<b>3</b> which is specified based on a user's predetermined operation of the operation input unit <b>2</b> is changed. Accordingly, it is possible to obtain an image of an appearance desired by the user without the need to repeatedly perform image processing for one image with the processing degree of the image processing successively changed based on a user's predetermined operation of the operation input unit <b>2</b>.

0100Specifically, it takes a lot of time for an image output apparatus including an arithmetic device not having a high processing capacity to execute image processing even only once. Moreover, it takes longer time to provide an image having an appearance desired by the user if the number of times that image processing is repeated with the processing degree being fine-tuned. On the other hand, the image output device <b>100</b> of this embodiment does not repeat image processing with varying processing degree and changes the composition ratio of the first image P<b>1</b> to the second image P<b>2</b> in the predetermined region A of the composite image P<b>3</b>. Thus, it seems as if the image output device <b>100</b> perform image processing with the processing degree varied in real time. However, the image processing is not performed actually, and the time spent to obtain an image of an appearance desired by the user can be shortened. The composition ratio of the first image P<b>1</b> to the second image P<b>2</b> in the predetermined region A of the composite image P<b>3</b> can be changed by only changing the transparency of the predetermined region A of the upper image of the first and second images P<b>1</b> and P<b>2</b> which are superimposed on each other. It is therefore possible to generate an image with the changed composition ratio at high speed without using an arithmetic unit with a high processing capacity.

0101Accordingly, the process to generate the composite image P<b>3</b> with the output style of the predetermined region A changed can be performed at higher speed. Moreover, even if the output style of only the predetermine region A in the processing object image is changed, it is possible to reduce the stress on the user due to long time spent by the processing.

0102The predetermined region A of the composite image P<b>3</b> is specified based on the touch position detected by the touch panel <b>2</b><i>a </i>according to a user's touch operation of the touch panel <b>2</b><i>a</i>. Accordingly, the predetermined region A of the composite image P<b>3</b> can be easily specified by a predetermined operation performed for the touch panel <b>2</b><i>a </i>by the user. In other words, the predetermined region A can be easily specified based on a user's intuitive operation of the touch panel <b>2</b><i>a. </i>

0103Furthermore, the transparency of the upper image (the processed image Pb) in the predetermined region A can be changed based on the type of the user's touch operation of the region of the touch panel <b>2</b><i>a </i>where the predetermined region A specified is displayed. Accordingly, the user's intuitive operation of the touch panel <b>2</b><i>a </i>can be related to change in transparency of the upper image in the predetermine region A, and the transparency of the upper image in the predetermined region A can be changed with an easier operation.

0104Moreover, the composite image P<b>3</b> with the changed composition ratio of the first image P<b>1</b> to the second image P<b>2</b> is recorded in the recording medium M. Accordingly, the composite image P<b>3</b> can be effectively used in other processes such as processes to display or print the composite image P<b>3</b>.

0105The present invention is not limited to the aforementioned embodiment, and various improvements and modification of the design can be made without departing from the spirit of the invention.

0106For example, in the image generation process of the aforementioned embodiment, it can be configured to generate the composite image P<b>3</b> including the image data of the predetermined image Pa placed on the upper side and the image data of the processed image Pb placed on the lower side which are superimposed one on the other, that is, the composite image P<b>3</b> not looking image-processed and gradually perform image processing by changing the transparency of the predetermined region A.

0107Moreover, it can be configured to place a color image on the lower side while placing an image obtained by binarizing the color image on the upper side and cause the color image to gradually appear by changing the transparency of the predetermined region A.

0108In the aforementioned embodiment, the transparency of the upper image (the processed image Pb) in the predetermined region A is changed based on the type of the user's touch operation of the predetermined region A of the composite image P<b>3</b> displayed on the touch panel <b>2</b><i>a</i>. The way of changing the transparency is not limited to this example. The transparency can be changed based on the type of the user's touch operation of a predetermined position (a right or left edge portion, for example) of the touch panel <b>2</b><i>a. </i>

0109In the image generation process of this embodiment, the composite image P<b>3</b> in which the composition ratio of the first image P<b>1</b> to the second image P<b>2</b> is changed is recorded in the recording medium M. However, the printing unit <b>6</b> may make a print of the composite image P<b>3</b>. This can easily provide the print of the composite image P<b>3</b> with the composition ratio of the first image P<b>1</b> to the second image P<b>2</b> changed.

0110Furthermore, in the aforementioned embodiment, the image output apparatus <b>100</b> does not necessarily include the image recording unit <b>5</b> and printing unit <b>6</b>. The image output apparatus may be provided with any one of the image recording unit <b>5</b> and printing unit <b>6</b>. Moreover, the image output apparatus may be configured to not include any one of the image recording unit <b>5</b> and printing unit <b>6</b> and output the image data of the generated composite image P<b>3</b> to an external recording deice or a printer (not shown).

0111Moreover, in the above embodiment, the operation input unit <b>2</b> includes the touch panel <b>2</b><i>a</i>. However, it can be properly and arbitrarily changed whether the touch panel <b>2</b><i>a </i>is provided, that is, whether the predetermined region A of the composite image P<b>3</b> is specified based on the touch position detected by the touch panel <b>2</b><i>a. </i>

0112Furthermore, the configuration of the image output apparatus <b>100</b> as an image processing apparatus shown in the above embodiment by way of example is just an example, and the image processing apparatus is not limited to this example and can be properly and arbitrarily changed.

0113In addition, the above embodiment is implemented by the composite image generation unit <b>4</b> which is driven under the control of the central controller <b>8</b> but not limited to this example. The invention may be implemented by execution of predetermined programs and the like by the CPU of the central controller <b>8</b>.

0114Specifically, the program memory configured to store programs stores programs including a first acquisition process routine, a second acquisition process routine, a composition process routine, a specifying process routine, and a control processing routine. The CPU of the central controller <b>8</b> may be caused by the first acquisition process routine to acquire the predetermined image Pa as the first image P<b>1</b>. The CPU of the central controller <b>8</b> may be caused by the second acquisition process routine to acquire the second image P<b>2</b> obtained by performing predetermined image processing for the first image P<b>1</b>. Moreover, the CPU of the central controller <b>8</b> may be caused by the composition process routine to combine the acquired first image P<b>1</b> and acquired second image P<b>2</b> superimposed on each other to generate the composite image P<b>3</b>. The CPU of the central controller <b>8</b> may be caused by the specifying process routine to specify the predetermined region A of the composite image P<b>3</b> based on a user's predetermined operation of the operation input unit <b>2</b>. The CPU of the central controller <b>8</b> may be caused by the control process routine to change the composition ratio of the first image P<b>1</b> to the second image P<b>2</b> in the specified predetermined region A by changing the transparency of the upper image of the predetermine region A in the first image P<b>1</b> and second image P<b>2</b> superimposed on each other.

0115Furthermore, a computer-readable medium storing the programs to execute the aforementioned processes can be a ROM, a hard disk, a non-volatile memory such as a flash memory, and a portable recording medium such as a CD ROM. Moreover, the medium providing data of the programs through a predetermined communication line can be a carrier wave.

0116Some embodiments of the present invention are described above. The scope of the invention is not limited to the aforementioned embodiment and includes a scope of the invention described in claims and equivalents thereof.

0117The entire disclosure of Japanese Patent Application No. 2011-077381 filed on Mar. 31, 2011 including description, claims, drawings, and abstract are incorporated herein by reference in its entirety.

0118Although various exemplary embodiments have been shown and described, the invention is not limited to the embodiments shown. Therefore, the scope of the invention is intended to be limited solely by the scope of the claims that follow.