Imaging apparatus

The present invention relates to an imaging device, and relates to an imaging device capable of taking a commemorative photograph with a particularly suitable composition.

In Patent Document 1, the image displayed on the monitor at the time of provisional shooting is primarily stored as a reference image for composition matching, the reference image is made semitransparent and combined with a through image for display, and the semitransparent image is displayed. An imaging device has been proposed that can take an image according to the composition intended by the client by taking an image according to the above.

Further, in Patent Document 2, information related to the brightness distribution in the shooting screen is detected, and the position of the edge corresponding to the upper end of the main subject is specified from the shooting screen based on the information related to the detected brightness distribution. However, an imaging device has been proposed that determines the quality of the composition by comparing it with a predetermined appropriate range and issues a warning when the composition is defective.

Further, Patent Document 3 proposes an imaging system that distributes shooting conditions of a shot image via a network and presents advice by comparing with a composition preset in a server or the like on the net.<patcit num="1"><text>Japanese Unexamined Patent Publication No. 2004-221868</text></patcit><patcit num="2"><text>Japanese Unexamined Patent Publication No. 8-286226</text></patcit><patcit num="3"><text>Japanese Unexamined Patent Publication No. 8-328069</text></patcit>

<p> However, the image pickup apparatus described in Patent Document 1 has a drawback that it is difficult to visually recognize the through image because the semitransparent reference image is combined with the through image and displayed. Also, due to the difference in height between the requester and the photographer, the presence or absence of zoom operation, etc., when the person requested to take a commemorative photo is taken, the composition is exactly the same as when the user decides the composition. It's difficult to get.</p><p> Further, the imaging device described in Patent Document 2 provides only advice based on a general composition, and has a drawback that it cannot give advice based on a composition originally intended by the user.</p><p> Further, the imaging system described in Patent Document 3 has a drawback that it does not function unless it can be connected to a network.</p><p> The present invention has been made in view of such circumstances, and another person who is requested by the user to take a commemorative photo included in the subject can take a commemorative photo with a composition intended by the user. It is an object of the present invention to provide an image pickup apparatus.</p>

<p> The image pickup apparatus according to claim 1 includes an image pickup means for capturing an image, an image acquisition means for acquiring an image signal for composition determination via the image pickup means, and the image acquisition means for achieving the object. A first face detecting means for detecting a reference face from the composition-determining image signals acquired by the above-mentioned image acquisition means, and a composition-determining image based on the composition-determining image signal acquired by the image acquisition means. A display means to be displayed, a setting means for setting a desired position where another face should enter from the composition-determining image displayed on the display means, and a reference face position detected by the face detection means. And a first reference line setting means for setting a first reference line based on a desired position set by the setting means.</p><p> According to the imaging apparatus according to claim 1, an image signal for composition determination is acquired, and a reference face is detected from the image signals for composition determination. In addition, an image for composition determination is displayed based on the image signal for composition determination, a desired position where another face should enter is set from the displayed image for composition determination, and a reference face position is set. And set the first reference line based on the desired position where the other face should enter. This first reference line is used as a reference when taking a commemorative photo. As a result, the composition desired by the user can be set in the image pickup apparatus in advance.</p><p> The imaging device according to claim 2 is the first reference set by the first reference line setting means on the composition-determining image displayed on the display means in the imaging device according to claim 1. It is characterized by being provided with a display control means for synthesizing lines.</p><p> According to the imaging apparatus according to claim 2, an image obtained by synthesizing the first reference line on the image for determining composition is displayed on the display means. As a result, when requesting another person to take a commemorative photo, the desired composition can be shown to the other person. Therefore, it is possible to have a commemorative photo taken with the desired composition.</p><p> The imaging device according to claim 3 is the imaging device according to claim 1 or 2, wherein the image acquisition means continuously acquires an image signal indicating a subject via the imaging means, and the image acquisition means. It is a second face detecting means for detecting the face of the subject from the image signal continuously acquired by the above, and the subject is from a position substantially the same as the reference face position detected by the first face detecting means. Based on the second face detecting means for detecting the face and detecting the face of the subject from the desired position set by the setting means and its vicinity, and the position of the face detected by the second face detecting means. A second reference line setting means for setting a second reference line, a first reference line set by the first reference line setting means, and a second reference line set by the second reference line setting means. An angle calculating means for calculating the angle formed by the reference line of 2, a determining means for determining whether or not the angle calculated by the angle calculating means is equal to or greater than a predetermined threshold, and the angle calculating means using the determining means. When it is determined that the angle calculated by the above method is equal to or greater than a predetermined threshold value, an output means for outputting advice for inducing a composition change is provided.</p><p> According to the imaging apparatus according to claim 3, image signals indicating the subject are continuously acquired, and the face of the subject is detected from the continuously acquired image signals. At this time, the face of the subject is detected from a position substantially the same as the position of the face detected from the image for determining the composition, and the face of the subject is detected from the desired position set from the image for determining the composition and its vicinity. To detect. A second reference line is set based on the detected face position, the angle formed by the first reference line and the second reference line is calculated, and if the calculated angle is equal to or greater than a predetermined threshold value, the angle is calculated. , Outputs advice to guide composition changes. As a result, when taking a commemorative photo, it is possible to guide another person who has been requested to take a picture so as to have a desired composition. Therefore, you can have a commemorative photo taken with the composition you want.</p><p> The imaging device according to claim 4 includes the advice storage means for storing a plurality of advices in the imaging device according to claim 3, and the output means is the advice storage means based on the calculated angle. It is characterized by selecting and outputting appropriate advice from the advice stored in.</p><p> According to the imaging apparatus according to claim 4, shooting is performed by selecting appropriate advice from the advice stored in the advice storage means based on the angle formed by the first reference line and the second reference line. Can give accurate advice to others who have been requested.</p><p> The image pickup apparatus according to claim 5 is the image pickup apparatus according to claim 3, wherein the display means displays a through image based on an image signal continuously acquired by the image acquisition means. The output means is characterized in that the advice is output to the display means.</p><p> According to the imaging device according to claim 5, by outputting the advice to the display means, it is possible to give advice in an easy-to-understand manner to another person who has been requested to take a picture.</p><p> The imaging device according to claim 6 is the imaging device according to claim 1 or 2, wherein the image acquisition means continuously acquires an image signal indicating a subject via the imaging means, and the image acquisition means. It is a second face detecting means for detecting the face of the subject from the image signal continuously acquired by the above, and the subject is from a position substantially the same as the reference face position detected by the first face detecting means. Based on the second face detecting means for detecting the face and detecting the face of the subject from the desired position set by the setting means and its vicinity, and the position of the face detected by the second face detecting means. A second reference line setting means for setting a second reference line, a first reference line set by the first reference line setting means, and a second reference line set by the second reference line setting means. The image acquisition means includes an angle calculation means for calculating the angle formed by the reference line 2 and a determination means for determining whether or not the angle calculated by the angle calculation means is equal to or greater than a predetermined threshold value. When the determination means determines that the angle calculated by the angle calculation means is smaller than a predetermined threshold value, the subject image is photographed via the imaging means.</p><p> According to the imaging device according to claim 6, when the angle formed by the first reference line and the second reference line is smaller than a predetermined threshold value, the subject image is photographed without missing a photo opportunity. , You can take a commemorative photo of the composition you want.</p><p> The imaging device according to claim 7 is a touch panel having substantially the same shape as the display means provided on the front surface of the display means in the imaging device according to any one of claims 1 to 6, and input to the touch panel. The region setting means includes a detection means for detecting the above, and the region setting means sets a position where the input is detected by the detection means of the display means as the desired region.</p><p> According to the imaging apparatus according to claim 7, a touch panel having substantially the same shape as the display means is provided on the front surface of the display means, and a position where an input of the display means to the touch panel is detected is set as a desired position. This facilitates the composition setting operation.</p><p> The imaging device according to claim 8 is the imaging device according to claim 7, wherein the first face detecting means is a means for detecting all faces included in the image signal for determining composition. When a plurality of faces are detected from the image signal for determining the composition, the plurality of faces include faces including pixels displayed at a position overlapping the position where the input is detected by the detection means of the display means. It is characterized by including means for selecting from the above and means for detecting the selected face as a reference face.</p><p> According to the imaging device according to claim 8, when a plurality of faces are detected from the image signal for composition determination, the pixels displayed at a position overlapping the position where the input to the touch panel of the display means is detected. The first reference line is set based on the position of the including face and the desired position set from the image for determining the composition. This facilitates the composition setting operation.</p>

<p> According to the present invention, another person who is requested by the user to take a commemorative photo included in the subject can take a commemorative photo with a composition intended by the user.</p>

Hereinafter, the best mode for carrying out the camera according to the present invention will be described in detail according to the accompanying drawings.

&lt;First embodiment&gt; FIG. 1 is a front perspective view showing an embodiment of the image pickup apparatus according to the first embodiment of the present invention. FIG. 2 is a rear view showing an embodiment of the image pickup apparatus. This image pickup device is a digital camera that receives light that has passed through a lens by an image pickup device, converts it into a digital signal, and records it on a storage medium.

The camera body 12 of the digital camera 10 is formed in a horizontally long square box shape, and on the front surface thereof, as shown in FIG. 1, a lens 14, a strobe 16, a finder window 18, a self-timer lamp 20, and an AF auxiliary light. A lamp 22, a strobe dimming sensor 24, etc. are arranged. A shutter button 26, a power / mode switch 28, a mode dial 30, and the like are arranged on the upper surface of the camera body 12. On the other hand, on the back surface of the camera body 12, as shown in FIG. 2, a monitor 31 (not shown in FIG. 2 because it is arranged on the back surface of the touch panel 32), a touch panel 32, a finder eyepiece 34, and a speaker. 36, zoom button 38, cross button 40, MENU / OK button 42, DISP button 44, BACK button 46, etc. are arranged.

A tripod screw hole and a battery insertion portion and a memory card slot are provided on the lower surface of the camera body 12 (not shown) via an openable / closable cover, and the battery and memory are provided in the battery insertion portion and the memory card slot. The card is loaded.

The lens 14 is composed of a retractable zoom lens, and is extended from the camera body 12 by setting the camera mode to the shooting mode with the power / mode switch 28. Since the zoom mechanism and the retractable mechanism of the lens 14 are known techniques, the description of the specific configuration thereof will be omitted here.

The strobe 16 irradiates the strobe light toward the main subject.

The finder window 18 is a part of a peephole that determines a subject to be photographed.

The self-timer lamp 20 is composed of, for example, an LED, and emits light when taking a picture by using the self-timer function of taking a picture after a certain period of time has passed after pressing the shutter button 26 described later.

The AF auxiliary light lamp 22 is composed of, for example, a high-brightness LED, and emits light as needed during AF.

The strobe dimming sensor 24 adjusts the amount of light emitted from the strobe 16.

The shutter button 26 is composed of a two-step stroke type switch composed of so-called "half-press" and "full-press". The digital camera 10 activates AE / AF when the shutter button 26 is "half-pressed", and executes shooting when the shutter button 26 is "fully pressed".

The power / mode switch 28 has both a function as a power switch for turning on / off the power of the digital camera 10 and a function as a mode switch for setting the mode of the digital camera 10. It is slidably arranged between the "position" and the "shooting position". The power of the digital camera 10 is turned on by sliding the power / mode switch 28 to match the "playback position" or "shooting position", and the power is turned off by adjusting to the "OFF position". Then, by sliding the power / mode switch 28 to match the "playback position", the "playback mode" is set, and by adjusting to the "shooting position", the "shooting mode" is set.

The mode dial 30 functions as a shooting mode setting means for setting the shooting mode of the digital camera 10, and the shooting mode of the digital camera 10 is set to various modes depending on the setting position of the mode dial. For example, "auto shooting mode" in which the aperture, shutter speed, etc. are automatically set by the digital camera 10, "movie shooting mode" for movie shooting, "portrait shooting mode" suitable for portrait shooting, and suitable for moving object shooting. "Sports shooting mode", "landscape shooting mode" suitable for landscape shooting, "night scene shooting mode" suitable for evening and night scene shooting, the photographer sets the aperture scale, and the digital camera 10 automatically sets the shutter speed. "Aperture priority shooting mode", the shutter speed is set by the photographer, and the digital camera 10 automatically sets the aperture scale, "shutter speed priority shooting mode", the aperture, shutter speed, etc. are set by the photographer. There are "manual shooting mode" to be set, "commemorative photo shooting mode" to tell others the set composition and have them take the intended commemorative photo (details will be described later).

The monitor 31 is composed of a liquid crystal display capable of displaying colors. The monitor 31 is used as an image display panel for displaying captured images in the playback mode, and is also used as a user interface display panel for performing various setting operations. Further, in the shooting mode, a through image is displayed as needed and used as an electronic finder for confirming the angle of view.

The touch panel 32 is an analog resistance film type in which transparent conductive films (ITO) are bonded to each other at a predetermined distance so that the transparent conductive films formed on a material (mainly film or glass) formed on one side face each other. It is a touch panel, and a signal is input when the transparent conductive films come into contact with each other when pressed with a finger or a pen. The touch panel 32 has substantially the same size as the monitor 31, and is arranged so as to be overlapped on the front surface of the monitor 31.

The zoom button 38 functions as a zoom instruction means for instructing zoom, and includes a zoom telebutton 38T for instructing zoom to the telephoto side and a zoom wide button 38W for instructing zoom to the wide-angle side. In the digital camera 10, the focal length of the lens 14 is changed by operating the zoom telebutton 38T and the zoom wide button 38W in the shooting mode. Further, in the playback mode, the zoom tele button 38T and the zoom wide button 38W are operated to enlarge or reduce the image being played.

The cross-shaped button 40 functions as a direction indicating means for inputting instructions in four directions of up, down, left, and right, and is used, for example, for selecting a menu item on a menu screen.

The MENU / OK button 42 functions as a button (MENU button) for instructing the transition from the normal screen to the menu screen of each mode, and also as a button (OK button) for instructing confirmation of selection contents, execution of processing, etc. To do.

The DISP button 44 functions as a button for instructing the display switching of the monitor 31, and when the DISP button 44 is pressed during shooting, the display of the monitor 31 is switched from ON to framing guide display to OFF. Also, if this DISP button 44 is pressed during playback, it can be switched to normal playback playback without character display multi-playback.

The BACK button 46 functions as a button for instructing to cancel the input operation or return to the previous operation state.

FIG. 3 is a block diagram showing a schematic configuration inside the digital camera 10.

As shown in the figure, the digital camera 10 has a CPU 110, a key input unit (shutter button 26, power / mode switch 28, mode dial 30, zoom button 38, cross button 40, MENU / OK button 42, DISP button 44, BACK button 46, etc.) 112, address data bus 114, DRAM 116, built-in flash memory 118, lens / aperture 120, lens / aperture drive unit 122, image sensor 124, timing generator (TG) 126, analog processing unit 128, image signal Processing unit 130, face detection unit 132, AF detection unit 134, AE / AWB detection unit 136, card I / F 138, memory card 139, video encoder 140, reference line generation unit 142, reference line calculation unit 144, advice table storage unit It is composed of 146 mag.

The CPU 110 comprehensively controls the entire digital camera 10 according to a predetermined control program based on the operation signal input from the key input unit 112.

Further, when the image data generated by the image signal processing unit 130 is input, the CPU 110 performs compression processing in a predetermined format on the image data to generate compressed image data, and when the compressed image data is input, the CPU 110 generates the compressed image data. Uncompressed image data is generated by subjecting compressed image data to decompression processing in a predetermined format.

The DRAM 116 connected to the CPU 110 via the address data bus 114 is used as a calculation work area of the CPU 110 and also as a temporary storage area for image data and the like. Further, the built-in flash memory 118 stores various setting information related to the operation of the digital camera 10, such as a control program executed by the CPU 110, various data required for control, and user setting information.

The lens / diaphragm 120 includes a lens 14, and is mainly composed of a zoom lens, a focus lens, and a diaphragm.

The lens / aperture drive unit 122 controls the operation of the lens / aperture 120 in response to a command from the CPU 110.

The image pickup device 124 is composed of, for example, a color CCD having a predetermined color filter array, and electronically captures an image of a subject imaged by the lens 14. The timing generator (TG) 126 outputs a timing signal for driving the image sensor 124 in response to a command from the CPU 110.

The analog processing unit 128 samples and holds (correlated double sampling processing) the R, G, and B signals for each pixel with respect to the image signal output from the image sensor 124, and amplifies the analog R, G, and B signals. Generate a signal. Then, the analog R, G, B signals are converted into digital R, G, B signals and output to the CPU 110.

The image signal processing unit 130 includes a simultaneous circuit (a processing circuit that interpolates the spatial deviation of the color signal due to the color filter arrangement of the single plate CCD and converts the color signal into a simultaneous expression), a white balance correction circuit, and a gamma correction. Including the circuit, contour correction circuit, brightness / color difference signal generation circuit, etc., the input image signal is subjected to necessary signal processing according to the command from CPU110, and the brightness data (Y data) and color difference data (Cr, Cb data) are applied. ) To generate image data (YUV data).

The face detection unit 132 extracts a face area in the image from the input image data according to a command from the CPU 110, and detects the position (for example, the center of gravity of the face area). In this face region extraction, for example, skin color data is extracted from the original image, and a cluster of photometric points determined to be in the skin color range is extracted as a face. Another method of extracting the face area from the image is to convert the photometric data into hue and saturation, create a two-dimensional histogram of the converted hue and saturation, and analyze it to determine the face region. Or, a method of extracting a face candidate area corresponding to the shape of a human face and determining the face area from the feature amount in the area, a method of extracting the outline of the human face from the image and determining the face area, a plurality of methods. A method of extracting a human face by preparing a face-shaped template, calculating the correlation between the template and the image, and using this correlation value as a face candidate area is known. Can be extracted using.

The AF detection unit 134 is a high-pass filter that passes only the high-frequency component of the G signal, an absolute value processing unit, an AF area detection unit that cuts out a signal in a predetermined focus area (for example, the center of the screen), and an absolute value in the AF area. It consists of an integration unit that integrates value data.

The AE / AWB detection unit 136 calculates the physical quantity required for AE control and AWB control from the input image signal in accordance with the command from the CPU 110. For example, as a physical quantity required for AE control, one screen is divided into a plurality of areas (for example, 16 × 16), and the integrated value of the image signals of R, G, and B is calculated for each divided area.

The card I / F 138 controls the reading / writing of data to the memory card 139 loaded in the media slot according to the command from the CPU 110.

The video encoder 140 controls the display on the monitor 31 according to a command from the CPU 110. That is, according to the command from the CPU 110, the input image signal is converted into a video signal (for example, NTSC signal, PAL signal, SCAM signal) for display on the monitor 31 and output to the monitor 31, and if necessary. The reference line output from the reference line generation unit 142 and the character and graphic information output from the reference line calculation unit 144 and the like are combined and output to the monitor 31.

The reference line generation unit 142 generates a reference line as a reference for composition determination based on the position of the face detected by the face detection unit 132, and outputs the reference line to the video encoder 140. The method by which the reference line generation unit 142 generates the reference line will be described in detail later.

The reference line calculation unit 144 commemorates the reference line generated by the reference line generation unit 142 based on the image data acquired by the image sensor 124 in the shooting for determining the composition (hereinafter referred to as temporary shooting) and to others. The angle formed by the reference line generator 142 generated by the reference line generation unit 142 is calculated based on the image data acquired by the image sensor 124 in the shooting when the photograph is requested (hereinafter referred to as the main shooting).

Further, the reference line calculation unit 144 extracts advice from the advice table stored in the advice table storage unit 146 based on the calculated angle, and outputs the advice to the video encoder 140. The processing performed by the reference line calculation unit 144 will be described in detail later.

The advice table storage unit 146 provides the angle between the reference lines calculated by the reference line calculation unit 144 and advice for instructing the photographer how to shoot with the composition intended by the client. The advice table associated with is stored.

Next, the operation of the digital camera 10 of the present embodiment configured as described above will be described.

First, a general procedure for taking and recording an image will be described. As described above, the digital camera 10 is set to the shooting mode by adjusting the power / mode switch 28 to the shooting position, and shooting becomes possible. Then, by setting the shooting mode, the lens 14 is extended and the shooting standby state is set.

Under this shooting mode, the subject light that has passed through the lens 14 is imaged on the light receiving surface of the image sensor 124 via the lens / diaphragm 120. On the light receiving surface of the image sensor 124, a large number of photodiodes (light receiving light) are passed through red (R), green (G), and blue (B) color filters arranged in a predetermined arrangement structure (Bayer, G stripe, etc.). Elements) are arranged two-dimensionally. The subject light that has passed through the lens 14 is received by each photodiode and converted into a signal charge of an amount corresponding to the amount of incident light.

The signal charge accumulated in each photodiode is sequentially read out as a voltage signal (image signal) corresponding to the signal charge based on the drive pulse given from the timing generator (TG) 126, and is added to the analog processing unit 128.

The analog processing unit 128 generates digital R, G, and B signals from the input image signal and outputs them to the DRAM 116.

When the captured image is output to the monitor 31, a luminance / color difference signal is generated by the image signal processing unit 130 from the image signal output to the DRAM 116, and the signal is sent to the video encoder 140. The video encoder 140 converts the input luminance / color difference signal into a display signal format (for example, an NTSC color composite video signal) and outputs the signal to the monitor 31. As a result, the image captured by the image sensor 124 is displayed on the monitor 31.

An image signal is periodically captured from the image sensor 124, the image data in the DRAM 116 is periodically rewritten by the luminance / color difference signal generated from the image signal, and the image data is output to the monitor 31 to be imaged by the image sensor 124. The image is displayed in real time. The photographer can confirm the shooting angle of view by viewing the image (through image) displayed in real time on the monitor 31.

Shooting is performed by pressing the shutter button 26. When the shutter button 26 is pressed halfway, an S1ON signal is input to the CPU 110, and the CPU 110 performs AE / AF processing.

First, the image signal captured from the image sensor 124 is input to the AF detection unit 134 and the AE / AWB detection unit 136. The integrated value data obtained by the AF detection unit 134 is notified to the CPU 110. The CPU 110 calculates the focus evaluation value (AF evaluation value) at a plurality of AF detection points while moving the focus lens group of the lens / aperture 120 by controlling the lens / aperture drive unit 122, and the evaluation value becomes maximum. The lens position is determined as the in-focus position. Then, the lens / aperture drive unit 122 is controlled so that the focus lens group moves to the obtained focusing position.

The CPU 110 detects the brightness of the subject (subject brightness) based on the integrated value obtained from the AE / AWB detection unit 136, and calculates an exposure value (shooting EV value) suitable for shooting. Then, the aperture value and the shutter speed are determined from the obtained shooting EV value and a predetermined program diagram, and the electronic shutter of the image sensor 124 and the lens / aperture drive unit 122 are controlled accordingly to obtain an appropriate exposure amount. At the same time, it is determined from the detected subject brightness whether or not the strobe is required to emit light.

Further, the AE / AWB detection unit 136 calculates the average integrated value for each color of the R, G, and B signals for each division area at the time of automatic white balance adjustment, and provides the calculation result to the CPU 110. The CPU110 obtains the ratio of R / G and B / G for each divided area from the obtained integrated value of R, the integrated value of B, and the integrated value of G, and obtains R / G and B / G values of R. The light source type is determined based on the distribution of / G and B / G in the color space. Then, according to the white balance adjustment value suitable for the determined light source type, for example, the value of each ratio becomes about 1 (that is, the RGB integration ratio on one screen becomes R: G: B1: 1: 1). As described above, the gain value (white balance correction value) for the R, G, and B signals of the white balance adjustment circuit is controlled, and the signal of each color channel is corrected.

As described above, the AE / AF process is performed by pressing the shutter button 26 halfway. The photographer operates the zoom button 38 as necessary to zoom the lens 14 to adjust the angle of view.

After that, when the shutter button 26 is fully pressed, an S2ON signal is input to the CPU 110, and the CPU 110 starts shooting and recording processing. That is, the image sensor 124 is exposed at a shutter speed and an aperture value determined based on the photometric result. At this time, the strobe 16 is fired as needed.

The image signal output from the image sensor 124 is taken into the DRAM 116 via the analog processing unit 128, converted into a luminance / color difference signal by the image signal processing unit 130, and then stored in the DRAM 116.

The image data stored in the DRAM 116 is added to the compression / decompression processing unit 148, compressed according to a predetermined compression format (for example, JPEG format), and then stored in the DRAM 116 for an image in a predetermined image recording format (for example, Exif format). After being made into a file, it is recorded in the memory card 139 via the card I / F138.

The image recorded on the memory card 139 as described above can be played back and displayed on the monitor 31 by setting the power / mode switch 28 to the playback position and setting the mode of the digital camera 10 to the playback mode. ..

When the power / mode switch 28 is set to the playback position and the mode of the digital camera 10 is set to the playback mode, the CPU 110 outputs a command to the card I / F 138 and reads the last recorded image file on the memory card 139. Let me put it out.

The compressed image data of the read image file is added to the CPU 110, expanded into an uncompressed luminance / color difference signal, and then output to the monitor 31 via the video encoder 140. As a result, the image recorded on the memory card 139 is reproduced and displayed on the monitor 31.

The frame advance of the image is performed by operating the left and right keys of the cross button 40, and when the right key of the cross button 40 is pressed, the next image file is read from the memory card 139 and reproduced and displayed on the monitor 31. When the left key of the cross button 40 is pressed, the previous image file is read from the memory card 139 and displayed on the monitor 31 for playback.

By the way, the digital camera 10 of the present embodiment has, in addition to the normal shooting mode, a commemorative photo shooting mode in which the set composition is transmitted to another person and the intended commemorative photo is taken. Hereinafter, the procedure of shooting and recording processing in this commemorative photo shooting mode will be described.

FIG. 4 is a flowchart showing the flow of provisional photography processing in the commemorative photography mode of the digital camera 10.

When the CPU 110 detects that the user has fully pressed the shutter button 26, it issues a command to the lens / aperture 120, the image sensor 124, etc., and determines the composition based on the general image shooting processing procedure described above. Take an image of (step S10). The composition determination image taken in step S10 is displayed on the monitor 31.

The CPU 110 inputs the image data captured in step S10 to the face detection unit 132, and the face detection unit 132 extracts a face area in the image from the image data based on a command from the CPU 110 and positions it (in this implementation). In the morphology, the center of gravity of the face region) is detected (step S12). When the image data includes a plurality of faces, the face detection unit 132 extracts a plurality of face regions and detects the center of gravity of the face region for each of the plurality of face regions. At the same time, the CPU 110 instructs the video encoder 140 to display a square frame (hereinafter referred to as a face detection frame) in the face area detected by the face detection unit 132, and the video encoder 140 is photographed in step S10. The face detection frame is combined with the image and output to the monitor 31. As a result, as shown in FIG. 5, an image in which the face detection frame is superimposed on the image taken in step S10 is displayed on the monitor 31.

The CPU 110 determines whether or not the face detected in step S12 is the face to be the subject of the commemorative photo based on the signal input from the key input unit (step S14). If only one face is detected in step S12, the CPU 110 sets the detected face as face a (reference face) and the position of the center of gravity of the face area as the position of face a (step). YES on S14). When the horizontal direction is x, the vertical direction is y, and the upper left of the image is (0,0), the position of the center of gravity is represented by the coordinates (X, Y) (X, Y are integers), and the face area is the center of gravity. Represented as a predetermined area subject to the coordinates of the position of.

When a plurality of faces are detected in step S12 (NO in step S14), the CPU 110 outputs a message prompting the user to input an instruction to the touch panel 32 via the speaker 36. When the user makes an input to the touch panel 32, the CPU 110 detects the position on the touch panel 32 where the input is made. In the present embodiment, the position on the touch panel 32 where the input is performed is represented by the coordinates as well as the position of the center of gravity of the face area. Then, a face area including coordinates indicating the position on the touch panel 32 where the input is detected is extracted, and the face in this face area is designated as face a (step S16). When the image shown in FIG. 5 is displayed on the monitor 31, when the input to the detection block at the position marked with a cross is detected, the CPU 110 detects this and the face area including the pixels marked with a cross, that is, the first Let the face displayed on the left be face a.

When face a is selected in step S14 or S16, the CPU 110 sends the speaker 36 a message prompting the user to enter a position in the commemorative photo where a face other than face a (for example, his face) should enter. Output via. When the user inputs to the touch panel 32, the CPU 110 detects the position where the input is made and sets a predetermined area centered on the position where the input is detected as the area where the face b is displayed (the area where the face b is displayed). Step S18). When the image shown in FIG. 5 is displayed on the monitor 31, when the user detects an input at the position of the black circle on the touch panel 32, the CPU 110 detects this and determines the predetermined position centered on the position of the black circle in FIG. The area area, that is, the area of the dotted line including the black circle mark is defined as the area of the face b.

The CPU 110 inputs the center of gravity of the face area of the face a selected in step S14 or S16 and the position where the input is detected in step S18 to the reference line generation unit 142, and the reference line generation unit 142 inputs these points. Is generated as a reference line (hereinafter referred to as reference line 1) (step S20), and the information of the reference line 1 is saved in the memory area of the reference line generation unit 142 (step S22). Further, the input area of the face b is also saved in the memory area of the reference line generation unit 142.

This completes the temporary shooting, that is, the shooting for deciding the composition in preparation for the commemorative shooting. As a result, the desired composition can be set in the digital camera 10. In steps S16 and S18, although it is desired to output the message via the speaker 36, the character information may be superimposed on the image and displayed on the monitor 31. Further, although the area where the face b is displayed is set in step S18, the setting of the area is not essential because the reference line 1 can be generated if the input position can be detected.

Next, start taking a commemorative photo (hereinafter referred to as the main shooting) requested by another person. FIG. 6 is a flowchart showing the flow of the main shooting process in the commemorative photo shooting mode of the digital camera 10.

At the start of the flow shown in Fig. 6, the user first asks another person to take a commemorative photo. When an instruction is input to the CPU 110 by the user operating the key input unit 112, the CPU 110 outputs the area of the reference line 1 and the face b saved in the memory area of the reference line generation unit 142 to the video encoder 140. , The video encoder 140 superimposes a frame showing the reference line 1 and the area of the face b on the image taken by the temporary shooting and displays it on the monitor 31. As a result, the other person who is requested to take a picture can confirm the composition set by the user. If the area where the face b is displayed is not set in step S18, the position where the input to the touch panel 32 is performed may be displayed instead of the frame indicating the area of the face b.

The other person who is requested to take a commemorative photo operates the key input unit 112 to start the main shooting when the user seems to have entered the angle of view as a subject. When an instruction to start main shooting is input to the CPU 110 by operating the key input unit 112 by another person, the CPU 110 issues a command to the lens / aperture 120, the image sensor 124, etc., based on the procedure described above. And take a through image (step S30). The through image taken in step S30 is displayed on the monitor 31.

The face detection unit 132 detects all face areas from the through image taken in step S30, and detects the positions of face a, face b, face a, and face b from the through image (step S32). The positions of face a and face b are obtained as the center of gravity of the face region of face a and face b.

The CPU110 determines whether or not the face detected as face a in step S21 is the same as the face a detected in step S14 or S16, and the coordinates of the center of gravity of the face area detected as face a in step S21. , It is determined whether or not the position of the center of gravity of the face a detected in step S14 or S16 is substantially the same (assuming that the position is substantially the same if it is within a predetermined range, the same applies hereinafter) (step S34).

If the face detected as face a in step S32 is not the same as the face a detected in step S14 or S16, or the coordinates of the center of gravity of the face area detected as face a in step S32 and step S14 or S16. If the CPU 110 determines that the position of the center of gravity of the detected face a is not substantially the same (NO in step S34), the face a, face b and face a, face b are again taken from the through image taken in step S30. The step (step S32) of detecting the position of is performed.

The face detected as face a in step S32 is the same as the face a detected in step S14 or S16, and the coordinates of the center of gravity of the face area detected as face a in step S32 and the coordinates of the center of gravity in step S14 or S16. When the CPU 110 determines that the position of the center of gravity of the detected face a is substantially the same (YES in step S34), the CPU 110 tells the reference line generator 142 the face area detected as the face a in step S32. The coordinates of the center of gravity of the above and the coordinates of the center of gravity of the face region detected as face b in step S32 are input to the reference line generation unit 142, and the reference line generation unit 142 connects the two input coordinates in the figure. As shown in 7, a new reference line (hereinafter referred to as reference line 2) is generated (step S36).

Then, the reference line calculation unit 144 acquires the information of the reference line 1 generated in step S22 and stored in the memory area of the reference line generation unit 142, and the reference line 1 and the reference line 2 generated in step S36. The angle formed by (defined as θ1, hereinafter referred to as angle θ1) is calculated (step S38).

The reference line calculation unit 144 determines whether or not the angle θ1 is equal to or greater than the threshold value (step S40).

When the reference line calculation unit 144 determines that the angle θ1 is equal to or greater than the threshold value, that is, the face area detected as the face b in step S32 substantially matches the area set as the area where the face b is displayed in step S18. If not (NO in step S40), the composition is different from the user's desired composition. Therefore, the reference line calculation unit 144 acquires the advice corresponding to the angle θ1 from the advice table stored in the advice table storage unit 146, and outputs the advice to the video encoder 140 (step S42).

If counterclockwise is defined as a positive angle, the angle θ1 is a negative angle, and in order to bring the angle θ1 closer to 0, rotate the digital camera 10 so that the right side is lowered, that is, rotate the digital camera 10 clockwise. I need to let you. Therefore, in the advice table, if the angle θ1 is a negative angle and its absolute value is greater than or equal to the threshold value, graphic information such as an arrow indicating clockwise rotation and characters such as "Please lower to the right" Information etc. are stored in association with advice.

On the contrary, when the angle θ1 is a positive angle, it is necessary to rotate the digital camera 10 counterclockwise. Therefore, in the advice table, if the angle θ1 is a positive angle and its absolute value is greater than or equal to the threshold value, graphic information such as an arrow indicating counterclockwise rotation, such as "Please raise the right a little more", etc. Character information etc. are associated and saved as advice.

The video encoder 140 includes a through image taken in step S30, a face detection frame showing all face areas detected by the face detection unit 132, and a reference line 1 and a reference line 2 output from the reference line generation unit 142. , The advice output from the reference line calculation unit 144 is combined and output to the monitor 31 (step S44). The display of the monitor 31 when the graphic information is output as advice from the reference line calculation unit 144 is as shown in FIG. 8, and the display of the monitor 31 when the character information is output as advice from the reference line calculation unit 144 is shown in FIG. Will be. As a result, it is possible to guide another person who has been requested to take a picture so as to have a desired composition. Then, the process returns to the step (step S32) of detecting the face from the captured through image.

When the reference line calculation unit 144 determines that the angle θ1 is smaller than the threshold value, as shown in FIG. 10, the face is detected in the area of the face b or the area substantially the same as the area of the face b set in step S18. This is the case when the composition is as desired by the user or when the composition is close to the composition. Therefore, the reference line calculation unit 144 outputs the determination result to the CPU 110, and the CPU 110 performs AE / AF processing, shooting, and recording processing by the same method as the general method described above (step S46). In the present embodiment, when a user's face is detected within the area of face b set in step S18, AE / AF processing, shooting, and recording processing are automatically performed. In this way, by performing the shooting process without missing the timing of the set composition, it is possible to reliably shoot with the set composition.

According to the present embodiment, by setting the composition in advance, when requesting another person to take a commemorative photo, the desired composition can be shown to the other person. This allows you to take a commemorative photo with the composition you want.

Further, according to the present embodiment, when taking a commemorative photo, it is possible to guide another person who has been requested to take a picture so as to have a desired composition.

In the present embodiment, the touch panel 32 is provided on the front surface of the monitor 31, and the area where the face b is displayed is set (step S18) based on the detection on the touch panel 32. However, the touch panel is not provided. The area where the face b is displayed may be set (step S18) in response to the input from the key input unit 112.

Further, in the present embodiment , when requesting the taking of a commemorative photo before the start of the main shooting, the image taken by the provisional shooting is overlaid with a frame showing the reference line 1 and the area of the face b on the monitor 31. It was displayed, but this display is not mandatory.

Further, in the present embodiment, the CPU 110 determines whether or not the face detected as the face a in step S21 is the same as the face a detected in step S14 or S16 in step S34, and the face in step S21. It was determined whether the coordinates of the center of gravity of the face region detected as a and the position of the center of gravity of face a detected in step S14 or S16 were substantially the same, but it was detected as face a in step S21. It is not essential to detect whether or not the face is the same as the face a detected in step S14 or S16, and even if this is omitted, it is possible to take a commemorative photo having the same or close to the desired composition. However, by detecting whether or not the face is the same as the face a detected in step S14 or S16, it is possible to avoid the problem that an unrelated face is detected and a commemorative photo that does not meet the wishes is taken. be able to.

Further, in the present embodiment, in step S44, the advice output from the reference line calculation unit 144 is combined with the through image and output to the monitor 31, but the speaker emits voice or sound that prompts the user to change the composition. It may be output via 36, or the voice or sound may be used in combination with the display on the monitor 31.

Further, in the present embodiment, when the user's face is detected in the area of the face b or the area substantially the same as the area of the face b set in the step S18 in the step S46, the AE / AF process is automatically performed. , Shooting and recording processing was performed, but when the user pressed the shutter button 26 halfway and the S1ON signal was input to the CPU 110, AE / AF processing was performed, and the user pressed the shutter button 26 fully to perform the CPU 110. The shooting and recording processing may be performed when the S2ON signal is input to the camera.

Further, in the present embodiment, in step S40, it is determined whether or not the angle θ1 is equal to or greater than the threshold value, but the angle θ1 is equal to or greater than the predetermined threshold value and is greater than or equal to the second threshold value. The advice generation process (step S42) may be performed only in the case. When the angle θ1 is larger than the second threshold value, it means that the pose is intentionally deviated from the composition. In such a case, it is possible to give more accurate advice by not giving advice. ..

Further, in the main shooting in the present embodiment, the face detected as the face a in step S32 is the same as the face a detected in step S14 or S16, and the face region detected as the face a in step S32. If the coordinates of the center of gravity of the face and the position of the center of gravity of the face a detected in step S14 or S16 are substantially the same (YES in step S34), the area of the face b or the face b set in step S18. It may be determined whether or not a face is detected in an area substantially the same as the area, and if a face is detected, shooting may be performed automatically. Further, a frame showing the area of the reference line 1 and the face b may be displayed on the monitor 31 to convey the desired composition to another person who has requested the taking of a commemorative photo.

Further, the application of the present invention is not limited to a digital camera, and can be similarly applied to an imaging device such as a camera-equipped mobile phone or a video camera.

<figref num="1">It is a front perspective view of the digital camera 10 of the 1st Embodiment of this invention.</figref><figref num="2">It is a rear view of the said digital camera 10.</figref><figref num="3">It is a block diagram which shows the schematic structure of the said digital camera 10.</figref><figref num="4">It is a flowchart which shows the flow of the process of temporary photography in the commemorative photography mode of the said digital camera 10.</figref><figref num="5">It is a figure explaining the content of the provisional shooting process of the said digital camera 10.</figref><figref num="6">It is a flowchart which shows the flow of the process of the main shooting in the commemorative photography mode of the said digital camera 10.</figref><figref num="7">It is a figure explaining the content of the provisional shooting process of the said digital camera 10.</figref><figref num="8">It is a figure explaining the content of the provisional shooting process of the said digital camera 10.</figref><figref num="9">It is a figure explaining the content of the provisional shooting process of the said digital camera 10.</figref><figref num="10">It is a figure explaining the content of the provisional shooting process of the said digital camera 10.</figref>

Code description

10 ... Digital camera, 12 ... Camera body, 14 ... Lens, 16 ... Strobe, 18 ... Finder window, 20 ... Self-timer lamp, 22 ... AF auxiliary light lamp, 24 ... strobe dimming sensor, 26 ... shutter button, 28 ... power / mode switch, 30 ... mode dial, 32 ... monitor, 34 ... finder eyepiece, 38 .. .Zoom button, 40 ... Cross button, 42 ... MENU / OK button, 44 ... DISP button, 46 ... BACK button, 110 ... CPU, 112 ... Key input section, 114. .. Address / Data Bus, 116: DRAM, 118: Built-in Flash Memory, 120: Lens / Aperture, 122: Lens / Aperture Drive, 124: Imaging Element, 126: Timing Generator (TG), 128: Analog Processing Unit, 130: Image signal processing unit, 132: Face detection unit, 134: AF detection unit, 136: AE / AWB detection unit, 138: Card I / F, 139: Memory card, 140: Video encoder, 142: Reference line generation unit , 144: Reference line calculation unit, 146: Advice table storage unit