Imaging apparatus and imaging method

The present disclosure relates to an imaging apparatus and an imaging method, and particularly to a technique of focus adjustment at the time of imaging.

In image pickup devices (video cameras) for broadcasting stations and commercial use, focus adjustment is often performed by manual focus operation that reflects the intention of the creator. Some image pickup devices that can perform manual focus operations in this way perform a display that assists focus adjustment with a viewfinder in order to facilitate focus operations by the photographer. For example, high-frequency components are extracted from the luminance signals constituting the video signal to generate a contour enhancement signal, and the contour enhancement signal is added to the luminance signal of the main line. By doing so, the outline in the captured image is displayed in an emphasized manner in the viewfinder, and the photographer who sees the display in the viewfinder can easily check the focus adjustment condition of the outline portion.

In addition, by displaying the focus adjustment state of the image obtained by capturing with the image pickup device quantitatively on the viewfinder with numerical values and graphs, it is possible to check the focus adjustment state for manual focus adjustment. , Convenient. When the focus adjustment state is displayed numerically in this way, for example, the high frequency component of the luminance signal of the image obtained by imaging is detected and the detection level is displayed.

Patent Document 1 describes a technique for displaying an image in which contour portions are coordinated with a viewfinder.

<p><patcit num="1"><text>Japanese Unexamined Patent Publication No. 2010-135865</text></patcit></p>

<p> By the way, in recent years, in the case of a single-plate type image pickup device included in an image pickup apparatus, a high-resolution image sensor has been developed in which the color arrangement of pixels is a special arrangement such as a Bayer arrangement. The image pickup signal obtained by imaging with an image sensor having such a special pixel arrangement is a signal in which the number of pixels and the arrangement interval are different for each color, and there is a problem that the luminance component cannot be detected under the same conditions for each color. .. Therefore, there is a problem that an accurate focus adjustment state cannot be displayed only by detecting and displaying the brightness level of the signal of each color output by the image sensor.</p><p> For example, in the case of a Bayer array image sensor, the number of green pixels is larger than that of red pixels and blue pixels. Therefore, if the luminance component is detected under the same conditions for each color, a relatively high luminance component is detected when a green object is imaged. On the other hand, when a red object or a blue object is imaged, the detection level of the luminance component becomes low even if the focus state is the same as when the green subject is imaged. Therefore, the brightness detection level fluctuates depending on the color of the subject to be imaged, and it is difficult to accurately detect the in-focus state regardless of the color. Conventionally, in order to accurately detect the in-focus state of focus independent of color, a large-scale and complicated circuit is required, and a large-scale processing using the large-scale circuit is required. It was not preferable as an imaging device.</p><p> In the explanation so far, the problem of focus adjustment by manual focus operation has been described, but in order to perform accurate detection even when detecting the in-focus state with an image pickup device that performs autofocus adjustment. Had a similar problem.</p><p> An object of the present disclosure is to provide an imaging device and an imaging method capable of easily and satisfactorily detecting a focus adjustment state from a signal obtained by imaging.</p>

<p> In the present disclosure, the brightness of the first, second, and third colors in the focus determination region of the image pickup signal imaged by the image sensor having the pixels of the first, second, and third colors are individually integrated, and the brightness is obtained. Performs a process of calculating the ratio of each color of the integral value of. Then, the integrated value of the brightness of the first color in the focus determination region obtained from the image pickup signal is normalized by the ratio of each color of the calculated integrated value of the brightness. Further, the guidance display process corresponding to the integrated value of the brightness of the normalized first color is performed.</p><p> By doing so, the fluctuation status of the integrated value of the brightness of a specific color in the focus determination area is displayed on the screen of the viewfinder or the like. The just focus state can be obtained by adjusting the focus so that the displayed integral value becomes the highest. In this case, the integrated value of the brightness of a specific color is normalized by the ratio of the integrated value of each color of the brightness at that time, and the normalized integrated value is used for the display. Stable display is possible regardless of the color.</p>

<p> According to the present disclosure, since the focus adjustment state is displayed based on the value obtained by normalizing the integrated value of the brightness of a specific color by the ratio of the integrated value of each color of the brightness at that time, it does not depend on the color of the subject. A stable focus adjustment status can be displayed.</p>

<figref num="1">It is a figure which shows the structure of the image pickup apparatus by one Embodiment of this disclosure.</figref><figref num="2">It is explanatory drawing which shows the pixel arrangement example of the image pickup device provided with the image pickup apparatus by one Embodiment of this disclosure.</figref><figref num="3">It is a characteristic figure which shows the example of the luminance level of each color component by the example of one Embodiment of this disclosure.</figref><figref num="4">It is explanatory drawing which shows the example of the display screen by the example of one Embodiment of this disclosure.</figref><figref num="5">It is a figure which shows the structure of the image pickup apparatus by the example of another embodiment (an example of performing autofocus adjustment) of the present disclosure.</figref>

An embodiment of the present disclosure will be described in the following order. 1. Configuration example of the imaging device (Fig. 1) 2. Example of pixel arrangement of image sensor (Fig. 2) 3. Examples of processing and display in the imaging device (Figs. 3 and 4) 4. Example applied to autofocus (Fig. 5) 5. Modification example

[1. Configuration example of imaging device] The configuration of the image pickup apparatus of the embodiment of the present disclosure (hereinafter, referred to as this example) will be described with reference to FIG. FIG. 1 is a diagram showing the configuration of the image pickup apparatus of this example. The image pickup device 100 includes an image pickup device 101 including an image pickup element 101a and a circuit that reads an image pickup signal from the image pickup element 101a. A lens device 200 including a lens 201 is attached to the image pickup device 100. Although the lens 201 is shown as one lens in FIG. 1, it is actually composed of a plurality of lenses (multiple groups). The lens device 200 includes a focus ring for adjusting the focus, and when the photographer turns the focus ring, the position of the lens for the focus adjustment is moved and the focus is adjusted. Then, the image light incident on the image pickup surface via the lens 201 is converted into an electrical image pickup signal by the image pickup element 101a included in the image pickup unit 101. The image sensor 101a is a so-called single-plate image sensor, and red pixels, green pixels, and blue pixels are arranged on the image pickup surface of the one image sensor 101a. As the type of the image sensor 101a, various types such as a CCD image sensor and a CMOS image sensor can be applied. An example of the pixel arrangement of the image sensor 101a will be described later.

The image pickup signal obtained by the image pickup unit 101 is supplied to the image pickup signal processing unit 102. The image pickup signal output by the image pickup unit 101 is so-called RAW data (raw data) that outputs the image pickup signal read from the image sensor 101a as it is. Therefore, as for the image pickup signal output by the image pickup unit 101, the red signal R obtained by the red pixel, the green signal G obtained by the green pixel, and the blue signal B obtained by the blue pixel correspond to the pixel arrangement of the image pickup element 101a. It is a mixed signal. When each signal processing system in the imaging device is digitized, the digitized RAW data may be output from the imaging unit 101 and supplied to the imaging signal processing unit 102.

The image pickup signal processing unit 102 performs various processes on the supplied image pickup signal to obtain an appropriate image pickup signal. For example, processing such as gamma correction and white balance adjustment is performed. Then, the image pickup signal processed by the image pickup signal processing unit 102 is supplied to the image format conversion unit 103 and converted into image data in a predetermined format. Then, the image data converted by the image format conversion unit 103 is output to the outside from the image signal output terminal 104. Further, the image pickup apparatus 100 includes a RAW data output terminal 107, and the RAW data supplied to the image pickup signal processing unit 102 can be output as it is from the RAW data output terminal 107 to the outside.

Further, the image format conversion unit 103 performs a conversion process for obtaining image data to be displayed by the viewfinder 106, and supplies the converted image data to the display processing unit 105. The display processing unit 105 processes the supplied image data and displays it on the viewfinder 106. In this case, the focus bar signal generated by the focus bar generation unit 117, which will be described later, is supplied to the display processing unit 105, and a process of displaying a figure called the focus bar on the captured image displayed by the viewfinder 106 is performed. It is said. A specific example of the focus bar will be described later.

Further, the image pickup signal (RAW data) output by the image pickup unit 101 is supplied to the R detection area integration unit 111, the G detection area integration unit 112, and the B detection area integration unit 113. The R detection area integrating unit 111 detects the high-frequency luminance component of the red signal R included in the imaging signal in the focus detection area, and integrates the detected luminance value. The G detection area integrating unit 112 detects the high-frequency luminance component of the green signal G included in the imaging signal in the focus detection area, and integrates the detected luminance value. The B detection area integrating unit 113 detects the high-frequency luminance component of the blue signal B included in the imaging signal in the focus detection area, and integrates the detected luminance value. As will be described later, when the band of the luminance component determined by the pixel arrangement of the image sensor 101a fluctuates in each color, the processing is performed so that the same conditions are met. Specifically, when the image sensor 101a having the standard bayer arrangement shown in FIG. 2A, which will be described later, is used, the green signal G detected by the G detection area integrating unit 112 is a signal thinned out for each pixel, and the like. It is assumed that the signal has the same band (pixel spacing) as the signals R and B of the color of.

The luminance value integration between the R detection area integration unit 111, the G detection area integration unit 112, and the B detection area integration unit 113 is, for example, a signal in the focus detection area for each imaging signal of one frame imaged by the imaging unit 101. To do. The focus detection area is set by a control unit (not shown) of the image pickup apparatus 100. For example, a focus detection area is set near the center of the image pickup screen, and the focus state in the focus detection area is detected. The range of the focus detection area on the screen may be set by, for example, a user operation.

The integrated values obtained by the respective detection area integrating units 111, 112, 113 are supplied to the peak maximum value selecting unit 114, and the integrated value of the color to be the maximum value is selected. Then, the integrated value of the color selected by the peak maximum value selection unit 114 is supplied to the focus bar generation unit 117.

Further, the imaging signal output by the imaging unit 101 is supplied to the RGB luminance ratio calculation unit 115. The RGB luminance ratio calculation unit 115 compares the integrated value of the red signal R of the imaging signal in the focus detection area with the integrated value of the green signal G and the integrated value of the blue signal B, and determines the ratio of the integrated values of each color. calculate. This ratio is calculated, for example, for each image pickup signal of one frame imaged by the image pickup unit 101. Then, the data of the ratio calculated by the RGB luminance ratio calculation unit 115 is supplied to the G luminance normalization unit 116.

Further, the green signal G of the imaging signal output by the imaging unit 101 is supplied to the G luminance normalizing unit 116. The G-luminance normalization unit 116 calculates the integral value of the high frequency range of the green signal G in the focus detection area, and normalizes the calculated integral value with the ratio data supplied from the RGB luminance ratio calculation unit 115. To do. The calculation of the integrated value and the normalization process in the G-luminance normalization unit 116 are also performed for each frame.

Next, the normalization process based on the ratio data in the G-luminance normalization unit 116 will be described. When the integral value of the green signal G is the highest integral value among the three colors in the ratio data, the integral value of the green signal G obtained by the G luminance normalizing unit 116 is used as the normalized data as it is. Then, when the integral value of the red signal R is the highest integral value among the three colors, the integral value of the green signal G is normalized based on the ratio of the integral value of the red signal R and the integral value of the green signal G. To become. For example, when the ratio of the integral value of the red signal R to the integral value of the green signal G is 2: 1 and the red component is twice the green component, normalization that doubles the integral value of the green signal G is performed. Do. Similarly, when the integral value of the blue signal B is the highest integral value among the three colors, the integral value of the green signal G is calculated based on the ratio of the integral value of the blue signal B and the integral value of the green signal G. Normalize.

Then, the integrated value of the green signal G normalized by the G luminance normalizing unit 116 is supplied to the focus bar generating unit 117. The focus bar generation unit 117 performs display processing for generating a display signal for displaying a bar graph (bar) indicating the focus state of the captured image. That is, based on the sum of the integrated value of the color selected by the peak maximum value selection unit 114 in the focus bar generation unit 117 and the integrated value of the green signal G normalized by the G luminance normalizing unit 116. , Set the length of the bar graph. Then, a bar graph display signal for displaying the bar graph of the set length is generated. The bar graph display signal generated by the focus bar generation unit 117 is supplied to the display processing unit 105, and the bar graph display signal is superimposed on the display signal of the captured image supplied to the viewfinder 106 to display the bar graph on the viewfinder 106. ..

[2. Example of pixel arrangement of image sensor] FIG. 2 shows an example of pixel arrangement of the image sensor 101a included in the image pickup unit 101. In FIG. 2, the portion indicated by R is a pixel that obtains a red signal R, the portion indicated by G is a pixel that obtains a green signal G, and the portion indicated by B is a pixel that obtains a blue signal B. In each pixel array shown in FIG. 2, the horizontal direction on the drawing is the horizontal direction, and the vertical direction is the vertical direction. Figure 2 (a) is an example of a standard Bayer array. In the case of this standard Bayer array, pixels that obtain a red signal R and pixels that obtain a green signal G are alternately arranged one by one on a certain horizontal line. Then, on the horizontal line adjacent to the horizontal line, the pixels that obtain the blue signal B and the pixels that obtain the green signal G are alternately arranged one by one. Further, the arrangement position of the pixel that obtains the green signal G on the horizontal line with the pixel that obtains the red signal R and the arrangement position of the pixel that obtains the green signal G on the horizontal line that has the pixel that obtains the blue signal B are It is in a state of being shifted one pixel at a time.

Therefore, in the case of the image sensor with the standard Bayer array shown in FIG. 2 (a), the minimum placement interval Pg of the pixels of the green signal G is the pixel placement pitch when viewed in units of two horizontally adjacent lines in the vertical direction. Matches with. On the other hand, the minimum arrangement interval Pr of the pixels of the red signal R and the minimum arrangement interval Pb of the pixels of the blue signal B are two pixel pitches that are twice the minimum arrangement interval Pg of the green. The minimum horizontal arrangement intervals Pr, Pg, and Pb of the pixels of each color determine the band of the high frequency component of each color component included in the imaging signal (RAW data). Specifically, the green signal G is a signal detected at a 1-pixel pitch, and the red signal R and the blue signal B are signals detected at a 2-pixel pitch. When this pixel pitch is directly reflected in the frequency band of the imaging signal, the green signal G has a frequency component twice as high as that of the other color signals R and B.

FIG. 2B shows an example of the pixel arrangement of the image sensor of the double Bayer arrangement in which the Bayer arrangement is modified. In the case of this double bayer arrangement, the pixel arrangement position is shifted by 1/2 pixel for each horizontal line. Pixels that obtain a red signal R and pixels that obtain a blue signal B are alternately arranged one by one on a certain horizontal line. Then, only the pixels that obtain the green signal G are arranged in the horizontal line adjacent to the horizontal line in which the red pixels and the blue pixels are arranged. In the case of this double Bayer arrangement as well, as in the case of the standard Bayer arrangement, the green signal G is a signal detected at a 1-pixel pitch, and the red signal R and the blue signal B are signals detected at a 2-pixel pitch.

As the image sensor 101a included in the image pickup unit 101, for example, the standard Bayer array shown in FIG. 2A is applied. The pixel arrangement shown in FIGS. 2A and 2B is an example, and other pixel arrangements may be applied.

[3. Example of processing and display with an image pickup device] Next, a processing example of displaying the focus bar on the viewfinder 106 at the time of imaging with the image pickup apparatus 100 of this example will be described. The bar graph shown by the display signal generated by the focus bar generation unit 117 shows the integral value of the color selected by the peak maximum value selection unit 114 and the integral value of the green signal G normalized by the G luminance normalization unit 116. It is a graph of the length corresponding to the value which added and.

The integrated value of the color selected by the peak maximum value selection unit 114 is the integrated value of the color having the highest integrated value of the luminance value obtained from the imaging signal. Therefore, the value obtained by integrating the signals of the most dominant colors among the imaging signals obtained by imaging the subject is one element of the length of the bar graph.

The integral value of the green signal G normalized by the G luminance normalization unit 116, which is another element of the length of the bar graph, is used for displaying the bar graph because the green signal G is the signal having the highest frequency component. To do. That is, as described in the bayer arrangement of FIG. 2 (a), the green signal G has a frequency component twice as high as that of the other color signals R and B from the minimum horizontal placement intervals Pr, Pg, and Pb. .. The focus bar, which indicates the focus state, can accurately guide the current focus adjustment state by indicating the amount of high-frequency components of the imaging signal.

In this way, the integral value of the green signal G containing the highest frequency component is used for display to indicate the amount of the high frequency component, but depending on the subject to be imaged, the green signal G contained in the imaging signal may be small. Conceivable. For example, in the imaging signal obtained when a red subject is imaged, the green signal G is detected at a relatively low level and the red signal R is detected at a relatively high level. However, in reality, no matter what color the subject is imaged, only the components of a specific color are rarely detected, and the components of the three colors are detected at the corresponding levels. FIG. 3 shows an example of the level of each color signal R, G, B for each frequency when a subject having a large amount of red component is imaged. The peak luminance value Yr of the red signal R is the peak luminance of the green signal G. It is higher than the value Yg and the peak luminance value Yb of the blue signal B.

Therefore, when a subject with many red components is imaged, the integrated value of the green signal G is normalized by the ratio of the red signal and the green signal by normalizing with the G luminance normalizing unit 116, and the red signal is obtained. An integral value corresponding to the case where the high frequency component is detected is obtained. Therefore, one element of the length of the bar graph shows the high frequency component corresponding to the case where the subject of any color is captured at a pitch of one pixel.

FIG. 4 shows a display example of a bar graph. As shown in FIG. 4A, a focus bar 11 having a certain length is displayed in a relatively inconspicuous color such as white on the lower side of the screen 10, and the first element display 11a is displayed in the focus bar 11. And the second element display 11b are performed in a relatively conspicuous color such as green or black. The first element display 11a is a display corresponding to the integrated value of the color selected by the peak maximum value selection unit 114. The second element display 11b is a display corresponding to the integrated value of the green signal G normalized by the G luminance normalizing unit 116. The length of each element display 11a and 11b changes according to the fluctuation of the corresponding integrated value.

In FIG. 4A, the first element display 11a and the second element display 11b are shown by giving different diagonal lines, but the display may not be distinguished on the actual screen. That is, the length of the bar graph obtained by adding the first element display 11a and the second element display 11b can be seen from the screen displayed by the viewfinder 106. It is shown that the longer the length of the bar graph obtained by adding the first element display 11a and the second element display 11b, the larger the high frequency component in the focus detection area of the captured image, and the closer to the just focus state. The photographer performing the focus operation checks the display on the viewfinder 106 and operates the focus ring of the lens device 200 to add the first element display 11a and the second element display 11b to the length of the bar graph. Adjust so that is the longest. On the actual screen, the second element display 11b is the element corresponding to the highest frequency component, and the level fluctuates relatively quickly in response to the operation of the focus ring. On the other hand, the first element display 11a is an element corresponding to the detection of the frequency component in the mid range lower than the second element display 11b, and has a slower fluctuation than the second element display 11b. Therefore, the first element display 11a shows the in-focus state to some extent, and the second element display 11b shows the strict in-focus state. It becomes a display form.

As a mode for displaying the focus bar, a mode for displaying only one of the first element display 11a and the second element display 11b may be prepared. For example, as shown in FIG. 4B, even if the viewfinder 106 displays the focus bar 12 that displays the element 12a corresponding to the integrated value of the green signal G normalized by the G luminance normalization unit 116. Good. Alternatively, a bar graph display of only the elements corresponding to the integrated values of the colors selected by the peak maximum value selection unit 114 may be used. Such selection of the display mode is performed, for example, by processing in the focus bar generation unit 117, which is the display processing unit of the focus bar.

As described above, the viewfinder 106 of the image pickup apparatus 100 can easily and satisfactorily perform the guidance display for assisting the focus operation by performing the focus bar display in which the display changes according to the integrated value of the luminance. As shown in Fig. 1, the process for displaying the focus bar is as simple as detecting and integrating each color component, selecting peaks, and normalizing based on the ratio. it can.

[4. Example applied to autofocus] In the example of the embodiment described so far, the focus state is detected and applied to the process of displaying the focus state. On the other hand, the autofocus adjustment may be performed by driving the focus lens in the lens device mounted on the image pickup device based on the detected focus state.

FIG. 5 shows a configuration example of the image pickup apparatus 100'that performs autofocus adjustment. The image pickup apparatus 100'provides an R detection area integration unit 111, a G detection area integration unit 112, a B detection area integration unit 113, and a peak maximum value selection unit 114, similarly to the image pickup apparatus 100 of the example of FIG. The peak maximum value selection unit 114 obtains the integrated value of the color that becomes the maximum value. Further, the image pickup apparatus 100'includes an RGB luminance ratio calculation unit 115 and a G luminance normalization unit 116 to obtain an integrated value of the normalized green signal G. Then, the integrated value selected by the peak maximum value selection unit 114 and the integrated value normalized by the G brightness normalization unit 116 are supplied to the focus bar generation unit 117 and to the focus state determination unit 118. ..

The image pickup apparatus 100'is different from the image pickup apparatus 100 shown in FIG. 1 in that it includes a focus state determination unit 118. The focus state determination unit 118 is a focus processing unit that executes automatic focus adjustment control based on the focus state determination result. That is, the focus state determination unit 118 sends a command to the lens drive unit 202 of the lens device 200'mounted on the image pickup device 100', drives the focus lens in the lens 201, and automatically adjusts the focus. Do. In order to perform this automatic focus adjustment, the focus state determination unit 118 adds the integrated value selected by the peak maximum value selection unit 114 and the integrated value normalized by the G brightness normalization unit 116. judge. Then, the focus lens is driven so that the added value becomes the maximum.

The other parts of the image pickup apparatus 100'shown in FIG. 5 are configured in the same manner as the image pickup apparatus 100 shown in FIG. In the example of FIG. 5, both the focus bar display in the viewfinder 106 and the autofocus control for controlling the focus lens are performed as a configuration including both the focus bar generation unit 117 and the focus state determination unit 118. I made it. On the other hand, the focus bar generation unit 117 may not be provided, and the image pickup device may be configured to perform only autofocus control. Also, when the focus state determination unit 118 determines the focus state, either the integrated value selected by the peak maximum value selection unit 114 or the integrated value normalized by the G brightness normalization unit 116 is used. May be used for autofocus control.

[5. Modification example] In the image pickup apparatus shown in FIGS. 1 and 5, processing such as integration of detection signals of each color and calculation of ratio from the image pickup signal is performed by a dedicated circuit block. On the other hand, for example, a processing unit for calculating an imaging signal is provided, and the processing for obtaining the integrated value of the color that becomes the maximum value and the processing for obtaining the integrated value of the normalized green signal G in the arithmetic processing unit are provided. May be done. This processing can be realized by implementing software (program) that performs the same processing as the configuration shown in FIG. 1 in the arithmetic processing unit.

Further, in the above-described embodiment, the image sensor 101a has a Bayer array having pixels for obtaining a red signal, pixels for obtaining a green signal, and pixels for obtaining a blue signal. On the other hand, the focus state detection process described in the above-described embodiment may be applied to an image pickup device having a so-called three-plate image sensor configuration in which pixels of each color are arranged in different image pickup devices. .. Further, the pixel arrangement of the image pickup device 101a shown in FIG. 2 is also shown as an example, and can be applied to other pixel arrangements.

Further, as the image sensor 101a, an example in which pixels of the red signal and the blue signal of the green signal, which are the three primary colors of the additive color mixture, are arranged has been described, but it can also be applied to the image sensor in which the pixels of the three primary colors of the subtractive color mixture are arranged. is there. In the case of the three primary colors of this subtractive color mixture, the same processing can be performed by normalizing the signal of the color having the narrowest pixel arrangement pitch by the ratio with other colors.

Further, in the above-described embodiment, the guidance display by the bar graph is used. For example, the integrated value selected by the peak maximum value selection unit 114 and the integrated value normalized by the G brightness normalizing unit 116 are used. The added value of may be displayed in another form such as a numerical display.

The present disclosure may also have the following structure. (1) An image pickup unit that takes an image with an image sensor having first, second, and third color pixels, and an image pickup unit. A luminance ratio calculation unit that individually integrates the brightness of the first, second, and third colors in the focus determination region of the imaging signal output by the imaging unit and calculates the ratio of each color of the integrated luminance value. A brightness normalization unit that normalizes the integrated value of the brightness of the first color in the focus determination region of the imaging signal output by the imaging unit with the ratio of the integrated value of the brightness calculated by the brightness ratio calculation unit. It is provided with a display processing unit that displays in response to fluctuations in the integrated value of the brightness normalized by the brightness normalization unit. Imaging device.

(2) A color-coded integrating unit that integrates the brightness of the first, second, and third colors of the imaging signal output by the imaging unit, and A maximum value selection unit for selecting the maximum integrated value among the integrated values obtained by the color-coded integrating unit is further provided. The integrated value selected by the maximum value selection unit is supplied to the display processing unit, and the display processing unit displays a display corresponding to the fluctuation between the integrated value of the normalized brightness and the integrated value of the selected brightness. Do The imaging device according to (1) above.

(3) The display processing unit has a length corresponding to the sum of the integrated value of the normalized brightness and the integrated value of the selected brightness or the integrated value of the normalized brightness on the screen. Performs graph display processing that changes The imaging device according to (1) or (2) above.

(4) The image sensor is an element in which the number of pixels in the horizontal direction of the pixels of the first color and the number of pixels in the horizontal direction of the pixels of the second and third colors are different. The imaging device according to any one of (1) to (3) above.

(5) The image pickup device is an element in which red pixels, green pixels, and blue pixels are arranged in a Bayer array or a modified Bayer array. The integrated value of the brightness of the first color to be normalized by the brightness normalizing unit is the integrated value of the brightness of green. The imaging device according to any one of (1) to (4) above.

(6) A focus processing unit for driving a focus lens arranged in an optical path of image light incident on the image sensor is provided based on an integrated value of the brightness of the first color obtained by the brightness normalization unit. Ta The imaging device according to any one of (1) to (5) above.

100,100'... image pickup device, 101 ... image pickup unit, 102 ... image pickup signal processing unit, 103 ... image format conversion unit, 104 ... image signal output terminal, 105 ... display processing unit, 106 ... Viewfinder, 107 ... RAW data output terminal, 111 ... R detection area integration unit, 112 ... G detection area integration unit, 113 ... B detection area integration unit, 114 ... Peak maximum value selection unit, 115 ... RGB brightness ratio calculation unit, 116 ... G brightness normalization unit, 117 ... focus bar generation unit, 118 ... focus state determination unit, 200,200'... lens Device, 201 ... lens, 202 ... lens drive