Method of eliminating a shutter-lag, camera module, and mobile device having the same

Method for eliminating shutter delay, camera module and mobile device with the method module

METHOD OF ELIMINATING A SHUTTER-LAG, CAMERA MODULE, AND MOBILE DEVICE HAVING THE SAME

[Cross reference to related applications]

According to 35 USC §119, this application claims the priority of Korean Patent Application No. 10-2011-0124906 filed with the Korean Intellectual Property Office (KIPO) on November 28, 2011. The entire content of this case is incorporated by reference. In this article.

The example embodiment generally relates to an electrical device (e.g., a mobile device). More specifically, the example embodiment of the inventive concept relates to a mobile device with a camera module.

According to the mobile aggregation trend, mobile devices may include camera modules. Generally speaking, the shutter delay can indicate the delay between the timing of the user pressing (for example, triggering) the shutter and the timing of actually capturing an image. Therefore, the shutter delay can be an important evaluation factor for evaluating the performance of the camera module. For example, regarding a camera module with a long shutter delay, the user may not be able to accurately obtain the image of the moment the user wants.

In order to reduce the shutter delay, the conventional camera module can maintain the sensor output image even in the preview mode and still have a user-set capture size. In this case, since the sensor output image has a high resolution in the preview mode, the conventional camera module may consume unnecessary power. Therefore, in the conventional camera module, there may be a trade-off relationship between the length of the shutter delay and the amount of unnecessary power consumption.

Some example embodiments provide a method for eliminating shutter delay, which can maintain the output image of the sensor to have a low resolution in the preview mode of the camera image sensor (CIS), and can be used in the camera image sensor. Prevent shutter delay when capturing images in the capture preparation mode of the detector.

Some example embodiments provide a camera module that can maintain a sensor output image to have a low resolution in the preview mode of the camera image sensor, and can be captured in the capture preparation mode of the camera image sensor Prevent shutter delay when taking images.

Some example embodiments provide a mobile device with the camera module.

According to an example embodiment of the inventive concept, a method of reducing the shutter delay in a camera image sensor may include: maintaining the sensor output image to have a low resolution in the preview mode of the camera image sensor; Changing the resolution of the sensor output image from a low resolution to a high resolution in the acquisition preparation signal, so as to change the operation mode of the camera image sensor from the preview mode to the acquisition preparation mode, so The low resolution is a resolution equal to or lower than a reference resolution, and the high resolution is a resolution higher than the reference resolution; and in the capture preparation mode of the camera image sensor The sensor output image is captured in response to the captured signal.

In an example embodiment, the method may further include the following step: when the sensor output image is captured in the capture preparation mode, changing the resolution of the sensor output image from high to low Resolution in order to The operation mode of the camera image sensor is changed from the capture preparation mode to the preview mode.

In an example embodiment, the method may further include the following step: when the predetermined time elapses in the capture preparation mode, changing the resolution of the sensor output image from a high resolution to a low resolution, so as to change The operation mode of the camera image sensor is changed from the capture preparation mode to the preview mode.

In an example embodiment, the method may further include the following step: when the input mode change signal is captured in the preparation mode, the resolution of the sensor output image is changed from a high resolution to a low resolution, so as to change The operation mode of the camera image sensor is changed from the capture preparation mode to the preview mode.

In an example embodiment, when the capture preparation signal is input in the preview mode of the camera image sensor, the resolution of the image output by the sensor can be changed from a low resolution to a high resolution.

In an example embodiment, when the predetermined time elapses after the capture preparation signal is input in the preview mode of the camera image sensor, the resolution of the sensor output image can be changed from a low resolution to a high resolution Spend.

In an example embodiment, the capture preparation signal may correspond to an auto-focus start signal for performing a focusing operation.

In an example embodiment, the capture preparation signal may correspond to an external input signal used to perform a focusing operation.

In an example embodiment, the capture preparation signal may correspond to at least one signal selected among a touch input signal, a button input signal, and a sound input signal.

In an example embodiment, the capture preparation signal may correspond to a smile detection signal used to perform a smile detection operation.

In an example embodiment, the capture preparation signal may correspond to a face detection signal used to perform a face detection operation.

In an example embodiment, the size of the image output by the sensor with low resolution may correspond to the size of the display output, and as the display output size changes, the size of the image output by the sensor with low resolution is The size can be changed.

In an example embodiment, the size of the sensor output image with high resolution may correspond to a predetermined size, and the predetermined size may be changed by the user.

According to example embodiments of the inventive concept, a camera module may include: an image sensor unit that generates a sensor output image by performing photoelectric conversion; and a mode control unit that maintains the sensor output image In order to have a low resolution in the preview mode of the camera module, the resolution of the sensor output image is changed from the low resolution to the high resolution in response to a capture preparation signal, and the The sensor output image is maintained to have the high resolution in the capture preparation mode of the camera module, the low resolution is a resolution equal to or lower than the reference resolution, and the high resolution is high The resolution at the reference resolution; and an image signal processing unit that processes the sensor output image to generate image data.

In an example embodiment, the camera module may be implemented by a system on chip (SOC).

In an example embodiment, the mode control unit may use the sensor The output image is set to have a low resolution in the preview mode of the camera module, and the mode control unit can set the sensor output image to have a high resolution in the capture preparation mode of the camera module. Resolution.

In an example embodiment, the mode control unit may change the operation mode of the camera module from the capture preparation mode when the sensor output image is captured in the capture preparation mode of the camera module It is preview mode.

In an example embodiment, the mode control unit may change the operation mode of the camera module from the capture preparation mode to the preview mode when a predetermined time elapses in the capture preparation mode of the camera module.

In an example embodiment, the mode control unit may change the operation mode of the camera module from the capture preparation mode to the preview mode when the mode change signal is input in the capture preparation mode of the camera module.

In an example embodiment, the capture preparation signal may correspond to an auto-focus start signal for performing a focusing operation.

In an example embodiment, the capture preparation signal may correspond to an external input signal used to perform a focusing operation.

In an example embodiment, the capture preparation signal may correspond to a smile detection signal used to perform a smile detection operation.

In an example embodiment, the capture preparation signal may correspond to a face detection signal used to perform a face detection operation.

According to example embodiments of the inventive concept, a mobile device may include: a camera image sensor that generates a sensor output image; an application processor that processes the sensor output image; and at least one display A device that generates a display based on the output image of the sensor. Here, the application processor may include: a mode controller that maintains the sensor output image to have a low resolution in the preview mode of the camera image sensor, in response to a capture preparation signal And the resolution of the sensor output image is changed from the low resolution to the high resolution, and the sensor output image is maintained to be in the capture preparation mode of the camera image sensor High resolution; an image signal processor, which processes the sensor output image to generate first image data; a post-processor, which performs post-processing on the first image data to generate second image data; and display control A device that provides the second image data, and the display is generated based on the second image data.

In an example embodiment, the application processor may further include a memory device, and the memory device temporarily stores the first image data to output the first image data to the post-processor.

In an example embodiment, the mode controller may include a real-time operation system (RTOS).

In an example embodiment, the mobile device may correspond to a cellular phone, a smart phone, a digital camera, a tablet computer, or a camcorder.

In an example embodiment, the application processor may be coupled to an external display device via at least one input/output (I/O) terminal, and the application processor may output the external display device video material.

In an example embodiment, the application processor may communicate with the camera image sensor based on MIPI, ITU-R BT.601, ITU-R BT.656, or ITU-R BT.709.

In an example embodiment, the capture preparation signal may correspond to an auto-focus start signal for performing a focusing operation.

In an example embodiment, the capture preparation signal may correspond to an external input signal used to perform a focusing operation.

In an example embodiment, the capture preparation signal may correspond to a smile detection signal used to perform a smile detection operation.

In an example embodiment, the capture preparation signal may correspond to a face detection signal used to perform a face detection operation.

According to an example embodiment of the inventive concept, a method of operating an image sensor of a camera module may include: using a first resolution as the image output resolution of the image sensor and outputting from the image sensor Preview image; changing the image output resolution of the image sensor from the first resolution to a second resolution in response to a capture preparation signal received at the camera module, the first resolution The second resolution is higher than the first resolution; and the second resolution is used as the image output resolution of the image sensor to capture the selected image, and the selected image is in response to The capture signal received at the camera module is captured, and the capture preparation signal is received at the camera module before the capture signal.

Therefore, the method of eliminating the shutter delay according to the example embodiment of the inventive concept can prevent unnecessary power consumption in the preview mode of the camera image sensor, and by maintaining the sensor output image as the camera image sensor The preview mode of the sensor has a low resolution, and the resolution of the sensor output image is changed from a low resolution to a high resolution by responding to the acquisition preparation signal Resolution, and by maintaining the sensor output image to have a high resolution in the capture preparation mode of the camera image sensor, it can be prevented when capturing images in the capture preparation mode of the camera image sensor Shutter delay.

In addition, the camera module and the mobile device having the camera module according to the example embodiment can prevent unnecessary power consumption in the preview mode of the camera image sensor, and maintain the output image of the sensor in the camera The image sensor has a low resolution in the preview mode. By responding to the acquisition preparation signal, the resolution of the sensor output image is changed from low resolution to high resolution, and the sensor output image Maintaining high resolution in the capture preparation mode of the camera image sensor can prevent shutter delay when capturing images in the capture preparation mode of the camera image sensor.

By describing the example embodiments in detail with reference to the accompanying drawings, the above and other features and advantages of the example embodiments will become more apparent. The accompanying drawings are intended to depict example embodiments, and should not be interpreted as an expected category that limits the scope of the patent application. Unless explicitly stated, the accompanying drawings are not considered to be drawn to scale.

Detailed example embodiments are disclosed herein. However, the specific structure and function details disclosed herein are only representative for the purpose of describing example embodiments. However, the example embodiments may be embodied in many alternative forms and should not be construed as being limited to the embodiments set forth herein.

Therefore, although the example embodiments can have various modifications and alternative forms, their embodiments are shown by examples in the drawings and will be discussed in this document. Row detailed description. However, it should be understood that it is not intended to limit the example embodiments to the specific forms disclosed, but rather, the example embodiments should cover all modifications, equivalents, and alternatives that fall within the scope of the example embodiments. Similar numbers refer to similar elements throughout the description of the figures.

It should be understood that although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of the example embodiment, the first element may be referred to as the second element, and similarly, the second element may be referred to as the first element. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

It should be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element, or intervening elements may be present. In contrast, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements. Other words used to describe the relationship between elements should be interpreted in similar styles (for example, "between" versus "directly between", "adjacent" versus "directly adjacent", etc.).

The terminology used herein is only for the purpose of describing specific embodiments, and is not intended to limit the example embodiments. As used herein, the singular forms "a" and "the" are intended to also include the plural forms, unless the context clearly dictates otherwise. It should be further understood that the terms "including" and/or "including" when used herein designate the existence of the described features, wholes, steps, operations, elements and/or components, but do not exclude one or more other features, wholes The existence or addition of, steps, operations, elements, components, and/or groups thereof.

It should also be noted that in some alternative implementations, the proposed functions/acts may occur out of the order shown in the figures. For example, two figures shown one after the other may actually be executed substantially simultaneously or may sometimes be executed in the reverse order, depending on the functionality/action involved.

FIG. 1 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

Referring to FIG. 1, the method illustrated in FIG. 1 may include: maintaining the sensor output image to have a low resolution in the preview mode of the camera image sensor in step S120, and responding to the captured image in step S140 Get the ready signal to change the resolution of the sensor output image from low resolution to high resolution, change the operation mode of the camera image sensor from preview mode to capture preparation mode; and in step S160, the camera image sensor In the acquisition preparation mode of the sensor, the output image of the sensor is captured in response to the acquisition signal. In addition, the method of FIG. 1 may include, in step S180, by changing the resolution of the sensor output image from a high resolution to a low resolution at the timing when the capture of the sensor output image is completed, the camera image is sensed The operation mode of the device is changed from the capture preparation mode to the preview mode.

Generally speaking, when the user selects the camera function of a mobile device with a camera module, the camera image sensor of the camera module can enter the preview mode. Here, the user views the preview image in real time in the preview mode. Therefore, the user can determine the subject of the photography while watching the preview image in the preview mode. For example, the preview mode can provide convenience to users. However, when the camera image sensor is operating in the preview mode, if the sensor output image output from the camera image sensor is set to have a high resolution Resolution (that is, called full frame preview), the camera image sensor may consume unnecessary power. Therefore, the conventional method has been used. By this method, the sensor output image is set to have a low resolution in the preview mode of the camera image sensor, and the sensor output image responds to the user triggering the shutter release operation The captured signal generated at the time is changed to have a high resolution. For example, the user can trigger the shutter release operation by pressing the shutter release button to open and close the shutter according to the image capturing operation, or perform some other activation operations. For the sake of clarity, the operation of initiating the shutter release operation will be referred to as triggering the shutter or pressing the shutter release button hereinafter. However, the example embodiment of the inventive concept is not limited to the method of initiating the shutter release operation including pressing the button, and can be applied to any method that causes the user to initiate the shutter release operation.

Since the operation for changing the resolution of the image output by the sensor (for example) from a low resolution to a high resolution causes a delay, the timing of the user pressing the shutter release button may be different from the timing of actually capturing the image. Therefore, the conventional method causes a delay (ie, shutter delay) between the timing of the user pressing the shutter release button and the timing of actually capturing images. As a result, the user may not be able to accurately obtain the image of the moment the user wants. For example, since the shutter delay of the camera module in the cellular phone can be, for example, 0.1 to 0.3 seconds, the user can obtain an image at the instant when the user presses the shutter release button and the timing delay is 0.1 to 0.3 seconds.

To overcome the above problems, the method of FIG. 1 may include maintaining the sensor output image to have a low resolution in the preview mode of the camera image sensor, as described with reference to step S120. If the sensor output image on the camera The image sensor has a high resolution in the preview mode to prevent shutter delay, which can consume unnecessary power. Therefore, the sensor output image can be maintained at a low resolution in the preview mode of the camera image sensor. In some example embodiments, the method of FIG. 1 may use the sub-sampling function to maintain the sensor output image to have a low resolution in the preview mode of the camera image sensor. Here, it should be understood that the "resolution" of the sensor output image may include the "pixel" of the sensor output image, the "size" of the sensor output image, the "capacity" of the sensor output image, and the The term "sampling rate" of the output image of the detector. According to example embodiments of the inventive concept, the size of the output image of the sensor with low resolution can correspond to the display output size. For example, the size of the output image of a sensor with low resolution can be VGA (640^＊480 pixels) size. Therefore, as used herein, the low resolution can be any resolution equal to or lower than the reference resolution, for example, VGA (640^＊480), and the high resolution can be any resolution higher than the reference resolution. In addition, as the display output size changes, the size of the output image of the sensor with low resolution can be changed. For example, when the camera module using the method of FIG. 1 is coupled to an external display device, and the image data is output on the external display device, the size of the image output by the sensor with low resolution can be changed to the external display The display output size of the device.

As described above with reference to step S140, the method of FIG. 1 may include, when the capture preparation signal is input in the preview mode of the camera image sensor, by responding to the capture preparation signal, the resolution of the sensor output image is automatically Change the low resolution to high resolution to change the operation of the camera image sensor The mode is changed from the preview mode to the capture preparation mode. For example, the method in Figure 1 does not include that when the shutter is pressed or the shutter is triggered in other ways in the capture preparation mode of the camera image sensor, the resolution of the sensor output image (for example) is changed from a low resolution It is high resolution. In fact, when the operation mode of the sensor output image is changed from the preview mode to the capture preparation mode, the method of FIG. 1 changes the resolution of the sensor output image (for example) from a low resolution to a high resolution. As a result, before the capture signal is input, for example, before the user presses the shutter release button, the sensor output image may already have a high resolution. Therefore, after the user presses the shutter release button, an operation for changing the resolution of the image output by the sensor (for example) from a low resolution to a high resolution may not be required. Therefore, the shutter delay may not be caused, and the shutter delay corresponds to the delay between the timing when the user presses the shutter release button and the timing when the image is actually captured. According to example embodiments of the inventive concept, the size of the output image of the sensor with high resolution can correspond to a predetermined or reference size. In addition, the user can change the predetermined or reference size. For example, the size of the output image of the sensor with high resolution can be the full frame size, for example, 5Mpixel (2608^＊1960 pixels), 8Mpixel (3264^＊2448 pixels) and so on. As described above, the camera module using the method of FIG. 1 can be operated in the preview mode to allow the user to view the preview image in real time, or can be operated in the capture preparation mode to allow the user to capture the image. At the same time, the preview mode can be substantially referred to as a low-resolution preview mode, and the capture preparation mode can be substantially referred to as a high-resolution preview mode.

According to an example embodiment of the inventive concept, the capture preparation signal may be an auto-focus start signal for performing a focusing operation. For example, when using When the auto-focus function is selected on the camera function setting menu, the time sequence for the resolution of the sensor output image to change from low-resolution to high-resolution can correspond to the timing of inputting the auto-focus start signal. According to an example embodiment of the inventive concept, the capture preparation signal may be an external input signal for performing a focusing operation. Here, the external input signal may be at least one signal selected from the touch input signal, the button input signal, and the sound input signal. For example, when the user touches the subject of photography on the display device, presses the focus button of the camera, or emits a sound for performing the focus operation, the resolution of the image output by the sensor changes from a low resolution to a high resolution The timing can correspond to the timing of inputting external input signals.

According to an example embodiment of the inventive concept, the capture preparation signal may be a smile detection signal for performing a smile detection operation. For example, when the user selects the smile detection function on the camera function setting menu, the resolution of the sensor output image changes from a low resolution to a high resolution timing corresponding to the detection of a subject (e.g., The timing of generating a smile detection signal when smiling on the face of a person. According to an example embodiment of the inventive concept, the capture preparation signal may be a face detection signal for performing a face detection operation. For example, when the user selects the face detection function on the camera function setting menu, the time sequence for the resolution of the sensor output image to change from low resolution to high resolution can correspond to the detection of a subject (e.g., The timing of the face detection signal generated when the face of a human is. In some example embodiments, the acquisition preparation signal may be selected among various signals generated by the camera module before the user presses the shutter.

As mentioned above, the resolution of the sensors output image can respond to the captured Prepare the signal and change from low resolution to high resolution. According to an example embodiment of the inventive concept, once the capture preparation signal is input in the preview mode of the camera image sensor, the resolution of the image output by the sensor can be changed from a low resolution to a high resolution. According to an example embodiment of the inventive concept, when the predetermined or reference time elapses after the acquisition preparation signal is input in the preview mode of the camera image sensor, the resolution of the sensor output image can be changed from low to high Resolution. When the resolution of the image output by the sensor changes from low resolution to high resolution, the operation mode of the camera image sensor changes from preview mode to capture preparation mode, so once in the preview mode of the camera image sensor If the input and acquisition preparation signal is lowered, it may be necessary to change the resolution of the sensor output image from a low resolution to a high resolution. However, once the acquisition preparation signal is input in the preview mode of the camera image sensor, the resolution of the sensor output image changes from a low resolution to a high resolution, which can cause problems in the image displayed on the display device. Noise. In this case, in order to align the clock edge and the like, when the predetermined or reference time is elapsed after the acquisition preparation signal is input in the preview mode of the camera image sensor, the resolution of the sensor output image can be automatically The low resolution is changed to the high resolution.

As described above with reference to step S160, the method of FIG. 1 may include capturing the output image of the sensor in response to the capture signal in the capture preparation mode of the camera image sensor, and the capture signal is when the user triggers the shutter produce. As mentioned above, since the sensor output image has high resolution in the capture preparation mode of the camera image sensor, after the capture signal is input in the capture preparation mode of the camera image sensor, for example, user After the shutter is triggered, an operation for changing the resolution of the image output by the sensor (for example) from a low resolution to a high resolution may not be required. Therefore, the shutter delay may not be caused, and the shutter delay corresponds to the delay between the timing when the user presses the shutter release button and the timing when the image is actually captured. In addition, since the acquisition preparation signal can be, for example, a signal related to one or more of the following: i) focus operation, such as autofocus start signal; ii) external input signal, such as touch input signal, button Input signal, voice input signal, etc.; iii) smile detection signal, and iv) face detection signal, so the focusing operation can also be performed in the capture preparation mode of the camera image sensor. Therefore, the user may not be able to recognize the delay due to the focusing operation, which is essentially the maximum delay caused in the camera module. In some example embodiments, the method of FIG. 1 can audibly or visually inform the user of the completion of the focusing operation.

Next, as described above with reference to step S180, the method of FIG. 1 may include changing the resolution of the sensor output image from a high resolution to a low resolution at the timing when the capture of the sensor output image is completed, Change the operating mode of the camera image sensor from the capture preparation mode to the preview mode. In addition, according to an example embodiment of the inventive concept, the method of FIG. 1 may include continuously repeating steps S120, S140, S160, and S180 to capture new images. As mentioned above, the method of Figure 1 can prevent unnecessary power consumption in the preview mode of the camera image sensor, and by maintaining the sensor output image to have the camera image sensor in the preview mode Low resolution, by responding to the acquisition preparation signal to change the resolution of the sensor output image from low resolution to high resolution, and by changing the sensor output image Maintaining high resolution in the capture preparation mode of the camera image sensor can prevent shutter delays when capturing images in the capture preparation mode of the camera image sensor.

FIG. 2 is a diagram illustrating the operation performed by the method of FIG. 1.

Referring to FIG. 2, by the method of FIG. 1, the operation mode of the camera image sensor can be changed between preview modes 11 and 13 and capture preparation mode 12. In the preview modes 11 and 13 of the camera image sensor, the sensor output image can be maintained at a low resolution. In the capture preparation mode 12 of the camera image sensor, the sensor output image can be maintained with high resolution. Therefore, the preview modes 11 and 13 of the camera image sensor can be essentially referred to as low-resolution preview modes, and the capture preparation mode 12 of the camera image sensor can be essentially referred to as the high-resolution preview mode. As illustrated in FIG. 2, when the acquisition preparation signal PSE is input in the preview mode 11 of the camera image sensor, the method of FIG. 1 can respond to the acquisition preparation signal PSE and the resolution of the sensor output image is automatically The low resolution is changed to the high resolution to change the operation mode of the camera image sensor from the preview mode 11 to the capture preparation mode 12. Here, the acquisition preparation signal PSE may include, for example, one or more of an auto focus start signal, an external input signal, a smile detection signal, and a face detection signal. Examples of external input signals include touch input signals, button input signals, voice input signals, and so on.

Generally speaking, the capture signal SS can be generated when the user presses the shutter release button. Therefore, when the capture signal SS is input in the capture preparation mode 12 of the camera image sensor, the method of FIG. 1 can capture the sensor output image in response to the capture signal SS. Here, since the sensor output image is The camera image sensor already has high resolution in the capture preparation mode 12, so after the capture signal SS is input in the capture preparation mode 12 of the camera image sensor, it may not be used to output the image from the sensor The resolution (for example) is changed from low resolution to high resolution operation. Therefore, the shutter delay may not be caused, and the shutter delay corresponds to the delay between the timing when the user presses the shutter release button and the timing when the image is actually captured. In addition, when the sensor output image is captured in the capture preparation mode 12 of the camera image sensor, the method shown in FIG. 1 can output the sensor output image at the completion timing CS of the sensor output image. The resolution changes from high resolution to low resolution. As a result, the operating mode of the camera image sensor can be changed from the capture preparation mode 12 to the preview mode 13. For example, the sensor output image can be maintained at a low resolution until the capture preparation signal PSE for capturing a new image is input in the preview mode 13 of the camera image sensor. As mentioned above, the method of FIG. 1 can prevent unnecessary power consumption in the preview modes 11 and 13 of the camera image sensor, and can be used when capturing images in the capture preparation mode 12 of the camera image sensor Avoid causing shutter delay.

FIG. 3 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

Referring to FIG. 3, the method of FIG. 3 may include: maintaining the sensor output image to have a low resolution in the preview mode of the camera image sensor in step S220, and in step S240 by responding to the capture preparation signal Change the resolution of the sensor output image from low resolution to high resolution, and change the operating mode of the camera image sensor from preview mode to capture preparation mode In step S260, in the capture preparation mode of the camera image sensor, the output image of the sensor is captured in response to the capture signal. Steps S220, S240, and S260 may be the same as steps S120, S140, and S160 described above with reference to FIG. 1. Therefore, its description will be omitted below.

In step S270, after the sensor output image is captured in the capture preparation mode of the camera image sensor, the method of FIG. 3 maintains the camera image sensor to operate in the capture preparation mode until predetermined or referenced The time has elapsed since the completion timing of the capture of the image output by the sensor. Then, in step S280, when the predetermined or reference time has elapsed since the capture completion timing of the sensor output image, the resolution of the sensor output image can be changed from a high resolution to a low resolution. The operating mode of the camera image sensor is changed from the capture preparation mode to the preview mode. Generally speaking, the delay due to the focusing operation can be substantially the maximum delay caused in the camera module. In addition, the camera module can provide functions for simultaneously capturing multiple images according to user needs. Therefore, because the method of FIG. 3 maintains the camera image sensor to operate in the capture preparation mode until the predetermined or reference time elapses from the capture completion timing of the image output by the sensor, the method of FIG. 3 allows The camera module can continuously capture multiple images after the focusing operation has been completed. As a result, the method of FIG. 3 can reduce the number of times the operation mode is changed between the preview mode and the capture preparation mode. As mentioned above, the method of Figure 3 can prevent unnecessary power consumption in the preview mode of the camera image sensor, and by maintaining the sensor output image to have the camera image sensor in the preview mode Low resolution, the resolution of the sensor output image is changed from the low resolution by responding to the acquisition preparation signal Change to high resolution, and by maintaining the sensor output image to have high resolution in the capture preparation mode of the camera image sensor, the image can be captured in the capture preparation mode of the camera image sensor Time to prevent shutter delay.

FIG. 4 is a diagram illustrating the operation performed by the method of FIG. 3.

Referring to FIG. 4, by the method of FIG. 3, the operation mode of the camera image sensor can be changed between preview modes 21 and 23 and capture preparation mode 22. In the preview modes 21 and 23 of the camera image sensor, the sensor output image can be maintained at a low resolution. In the capture preparation mode 22 of the camera image sensor, the sensor output image can be maintained at a high resolution. Therefore, the preview modes 21 and 23 of the camera image sensor can be essentially referred to as low-resolution preview modes, and the capture preparation mode 22 of the camera image sensor can be essentially referred to as high-resolution preview modes. As illustrated in FIG. 4, when the acquisition preparation signal PSE is input in the preview mode 21 of the camera image sensor, the method of FIG. 3 can respond to the acquisition preparation signal PSE to lower the resolution of the sensor output image The resolution is changed to a high resolution to change the operation mode of the camera image sensor from the preview mode 21 to the capture preparation mode 22. Here, the acquisition preparation signal PSE may include an autofocus start signal, an external input signal (for example, a touch input signal, a button input signal, a voice input signal, etc.), a smile detection signal, and a face detection signal.

Generally speaking, the capture signal SS can be generated when the user presses the shutter release button. Therefore, when the capture signal SS is input in the capture preparation mode 22 of the camera image sensor, the method of FIG. 3 can respond to the capture signal SS and capture the sensor output image. Here, since the sensor output image has high resolution in the capture preparation mode 22 of the camera image sensor, it may be possible after the capture signal SS is input in the capture preparation mode 22 of the camera image sensor No operation for changing the resolution of the image output by the sensor (for example) from a low resolution to a high resolution is required. Therefore, the shutter delay may not be caused, and the shutter delay corresponds to the delay between the timing when the user presses the shutter release button and the timing when the image is actually captured. In addition, when the sensor output image is captured in the capture preparation mode 22 of the camera image sensor, the method of FIG. 3 can elapse from the capture completion timing CS of the sensor output image at the predetermined or reference time PT When changing the resolution of the sensor output image from high resolution to low resolution. As a result, the operating mode of the camera image sensor can be changed from the capture preparation mode 22 to the preview mode 23. For example, because the method of FIG. 3 maintains the camera image sensor to operate in the capture preparation mode 22 until the predetermined or reference time PT elapses from the capture completion timing CS of the image output by the sensor, the diagram The method 3 enables the camera module to capture additional image ASS.

After the predetermined or reference time PT elapses from the capture completion timing CS of the sensor output image, the operation mode of the camera image sensor can be changed from the capture preparation mode 22 to the preview mode 23. Then, the sensor output image can be maintained at a low resolution until the capture preparation signal PSE for capturing a new image is input in the preview mode 23 of the camera image sensor. As mentioned above, the method of FIG. 3 can prevent unnecessary power consumption in the preview modes 21 and 23 of the camera image sensor, and It can prevent shutter delay when capturing images in the capture preparation mode 22 of the camera image sensor. In addition, the method of FIG. 3 can reduce the number of times of changing the operation mode between the preview modes 21 and 23 and the capture preparation mode 22 by enabling the camera module to continuously capture multiple images after the focusing operation has been completed.

FIG. 5 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

Referring to FIG. 5, the method of FIG. 5 may include maintaining the sensor output image to have a low resolution in the preview mode of the camera image sensor in step S320, and responding to the capture preparation signal in step S340 The resolution of the image output by the sensor is changed from low resolution to high resolution, and the operation mode of the camera image sensor is changed from preview mode to capture preparation mode. Steps S320 and S340 may be the same as steps S120 and S140 discussed above with reference to FIG. 1. Therefore, its description will be omitted below.

The method of FIG. 5 may include, in step S360, when the mode change signal is received in the capture preparation mode of the camera image sensor, in step S380, by changing the resolution of the sensor output image from high resolution to The operation mode of the camera image sensor is changed from the capture preparation mode to the preview mode due to the low resolution. For example, when the mode change signal is input, the mode change signal can be received. For example, when the user presses a button to change the operation mode of the camera image sensor from the acquisition preparation mode to the preview mode, it can be generated to change the operation mode of the camera image sensor from the acquisition preparation mode Change the signal for the mode of the preview mode. Then, the resolution of the sensor output image can be changed from high resolution in response to the mode change signal. Change to a low resolution, so that the operating mode of the camera image sensor can be changed from the capture preparation mode to the preview mode. After the camera image sensor enters the capture preparation mode in response to the capture preparation signal, the user can intentionally change the operation mode of the camera image sensor from the capture preparation mode to the preview mode. For example, the operation mode of the camera image sensor can be changed from the capture preparation mode to the preview mode without the user capturing any images. Therefore, the method of FIG. 5 can change the operation mode of the camera image sensor from the capture preparation mode to the preview mode in response to the mode change signal input by the user. As mentioned above, the method of Figure 5 can prevent unnecessary power consumption in the preview mode of the camera image sensor, and by maintaining the sensor output image to have the camera image sensor in the preview mode Low resolution, by responding to the acquisition preparation signal to change the resolution of the sensor output image from low resolution to high resolution, and by maintaining the sensor output image on the camera image sensor The high resolution in the capture preparation mode can prevent shutter delay when capturing images in the capture preparation mode of the camera image sensor. In addition, the method of FIG. 5 can reduce the power consumption of the camera module by allowing the user to directly end the capture preparation mode of the camera image sensor that consumes relatively high power.

FIG. 6 is a diagram illustrating the operation performed by the method of FIG. 5.

Referring to FIG. 6, by the method of FIG. 5, the operation mode of the camera image sensor can be changed between the preview modes 31 and 33 and the capture preparation mode 32. In the preview modes 31 and 33 of the camera image sensor, the sensor output image can be maintained at a low resolution. Image sensing in camera In the capture preparation mode 32 of the sensor, the sensor output image can be maintained with high resolution. Therefore, the preview modes 31 and 33 of the camera image sensor can be essentially referred to as low-resolution preview modes, and the capture preparation mode 32 of the camera image sensor can be essentially referred to as the high-resolution preview mode. As illustrated in FIG. 6, when the capture preparation signal PSE is input in the preview mode 31 of the camera image sensor, the method of FIG. 5 can respond to the capture preparation signal PSE and the resolution of the sensor output image is automatically The low resolution is changed to the high resolution to change the operation mode of the camera image sensor from the preview mode 31 to the capture preparation mode 32. Here, the acquisition preparation signal PSE may include an autofocus start signal, an external input signal (for example, a touch input signal, a button input signal, a voice input signal, etc.), a smile detection signal, and a face detection signal.

When the mode change signal MCS is input in the capture preparation mode 32 of the camera image sensor, the method of FIG. 5 can change the camera image by changing the resolution of the sensor output image from high resolution to low resolution The operating mode of the sensor is changed from the capture preparation mode 32 to the preview mode 33. For example, when the user presses a button to change the operation mode of the camera image sensor from the capture preparation mode 32 to the preview mode 33, it can be used to change the operation mode of the camera image sensor from the capture preparation mode. The mode 32 is changed to the mode change signal MCS of the preview mode 33. For example, the method of FIG. 5 allows the user to intentionally change the operation mode of the camera image sensor from the capture preparation mode 32 to the preview mode 33. As mentioned above, the method of FIG. 5 can prevent unnecessary power consumption in the preview modes 31 and 33 of the camera image sensor, and can be used in the camera image sensor. Prevents shutter delay when capturing images in the capture preparation mode 32. In addition, the method of FIG. 5 can reduce the power consumption of the camera module by allowing the user to directly end the capture preparation mode 32 of the camera image sensor that consumes relatively high power.

FIG. 7 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

Referring to FIG. 7, the method of FIG. 7 may include maintaining the sensor output image to have a low resolution in the preview mode of the camera image sensor in step S420, and responding to the capture preparation signal in step S440 The resolution of the image output by the sensor is changed from low resolution to high resolution, and the operation mode of the camera image sensor is changed from preview mode to capture preparation mode. Steps S420 and S440 can be the same as steps S120 and S140 described above with reference to FIG. 1. Therefore, its description will be omitted below.

The method of FIG. 7 may include, in step S460, after waiting for the user to input (for example) triggering the shutter action during a predetermined or reference time period in the capture preparation mode of the camera image sensor, in step S480 by sensing The resolution of the output image of the sensor is changed from high resolution to low resolution and the operation mode of the camera image sensor is changed from the capture preparation mode to the preview mode. For example, when the predetermined or reference time elapses in the capture preparation mode of the camera image sensor, the method of FIG. 7 can change the operation mode of the camera image sensor from the capture preparation mode to the preview mode. For example, when the user does not press the shutter release button during the predetermined or reference time period in the capture preparation mode of the camera image sensor, the operation mode of the camera image sensor can be changed from the capture preparation mode to preview mold Mode. For example, the resolution of the image output by the sensor can be changed from a high resolution to a low resolution. For example, when the user does not press the shutter release button during a predetermined or reference time after the operation mode of the camera image sensor is changed from the preview mode to the capture preparation mode, it can be determined that the user does not want to press the shutter release button . Therefore, the method of FIG. 7 can reduce power consumption by changing the operation mode of the camera image sensor from the capture preparation mode to the preview mode. Here, the predetermined or reference time can be set in different ways according to one or more conditions. According to example embodiments of the inventive concept, the predetermined or reference time can be calculated from the input timing of the acquisition preparation signal. According to example embodiments of the inventive concept, when the user inputs a specific signal, the predetermined or reference time can be calculated from the input timing of the specific signal. Examples of specific signals include signals associated with a half-pressed shutter button. As mentioned above, the method of Figure 7 can prevent unnecessary power consumption in the preview mode of the camera image sensor, and by maintaining the sensor output image to have Low resolution, by responding to the acquisition preparation signal to change the resolution of the sensor output image from low resolution to high resolution, and by maintaining the sensor output image on the camera image sensor The high resolution in the capture preparation mode can prevent shutter delays when capturing images in the capture preparation mode of the camera image sensor. In addition, the method of FIG. 7 can reduce the power consumption of the camera module by limiting the capture preparation mode of the camera image sensor to a predetermined or reference time. The capture preparation mode of the camera image sensor consumes relatively high power.

FIG. 8 is a diagram illustrating the operation performed by the method of FIG. 7.

Referring to Figure 8, by the method of Figure 7, the preview mode 41 and Change the operating mode of the camera image sensor between 43 and capture preparation mode 42. In the preview modes 41 and 43 of the camera image sensor, the sensor output image can be maintained at a low resolution. In the capture preparation mode 42 of the camera image sensor, the sensor output image can be maintained at a high resolution. Therefore, the preview modes 41 and 43 of the camera image sensor can be essentially referred to as low-resolution preview modes, and the capture preparation mode 42 of the camera image sensor can be essentially referred to as high-resolution preview modes. As illustrated in FIG. 8, when the acquisition preparation signal PSE is input in the preview mode 41 of the camera image sensor, the method of FIG. 7 can respond to the acquisition preparation signal PSE and the resolution of the sensor output image is automatically The low resolution is changed to the high resolution to change the operation mode of the camera image sensor from the preview mode 41 to the capture preparation mode 42. Here, the acquisition preparation signal PSE may include an auto focus start signal, an external input signal, a smile detection signal, and a face detection signal. Examples of external input signals may include touch input signals, button input signals, voice input signals, and so on.

When the predetermined or reference time PCT elapses in the capture preparation mode 42 of the camera image sensor, the method of FIG. 7 can change the resolution of the sensor output image from a high resolution to a low resolution. The operation mode of the image sensor is changed from the capture preparation mode 42 to the preview mode 43. For example, when the user does not press the shutter release button during the predetermined or reference time PCT in the capture preparation mode 42 of the camera image sensor, the operation mode of the camera image sensor can be selected from the capture preparation mode 42 Change to preview mode 43. For example, the resolution of the image output by the sensor can be changed from a high resolution to a low resolution. Based on the practical example of the inventive concept For example, the predetermined or reference time PCT can be calculated from the input timing of the acquisition preparation signal PSE. According to example embodiments of the inventive concept, when the user inputs a specific signal, the predetermined or reference time can be calculated from the input timing of the specific signal (for example, a half-press shutter signal). For example, when the user does not press the shutter release button during the predetermined or reference time PCT after the operation mode of the camera image sensor is changed from the preview mode 41 to the capture preparation mode 42, it can be determined that the user does not want to press Shutter release button. Therefore, the method of FIG. 7 can change the operation mode of the camera image sensor from the capture preparation mode 42 to the preview mode 43. As described above, the method of FIG. 7 can prevent unnecessary power consumption in the preview modes 41 and 43 of the camera image sensor, and can be used when capturing images in the capture preparation mode 42 of the camera image sensor Avoid causing shutter delay. In addition, the method of FIG. 7 can reduce the power consumption of the camera module by limiting the capture preparation mode 42 of the camera image sensor to a predetermined or reference time PCT. The capture preparation mode 42 of the camera image sensor consumes relatively high Electricity.

The methods described above with reference to FIG. 1, FIG. 3, FIG. 5, and FIG. 7 can each be executed, for example, by any of the devices described below with reference to FIG. 11 to FIG. 26.

FIG. 9 is a conceptual diagram illustrating a method of eliminating shutter delay according to an example embodiment.

Referring to FIG. 9, the camera image sensor in the camera module can be operated in the preview mode 50 or the capture preparation mode 60. The preview mode 50 of the camera image sensor indicates a mode for viewing preview images in real time. The capture preparation mode of the camera image sensor 60 indicates that it is used to prepare for image capture The mode. Here, in the capture preparation mode 60 of the camera image sensor, the user can watch the preview image in real time until the image capture starts. Image capture can start when, for example, the user presses the shutter release button. However, the sensor output image can be maintained at a low resolution in the preview mode 50 of the camera image sensor, and the sensor output image can be maintained at a high resolution in the capture preparation mode 60 of the camera image sensor. Resolution. For example, the preview mode 50 of the camera image sensor may be substantially referred to as a low-resolution preview mode, and the capture preparation mode 60 of the camera image sensor may be substantially referred to as a high-resolution preview mode. For example, the output image size of the sensor with low resolution can be VGA (640^＊480) size, and the output image size of the sensor with high resolution can be the full frame size (for example, 5M(2608^＊1960), 8M (3264^＊2448) etc.). In summary, the method for eliminating shutter delay according to example embodiments performs a mode change operation between the preview mode 50 and the capture preparation mode 60.

As mentioned above, the resolution of the sensor output image in the preview mode 50 of the camera image sensor is different from the resolution of the sensor output image in the capture preparation mode 60 of the camera image sensor. In the conventional method, the resolution of the image output by the sensor is changed from a low resolution to a high resolution based on the captured signal, and the captured signal is generated when the user presses the shutter release button. However, since the conventional method causes a delay between the timing when the user presses the shutter release button and the timing when the image is actually captured (for example, called the shutter delay), the user may not be able to accurately obtain the moment the user wants. image. In order to overcome the above problems, the method for eliminating shutter delay according to example embodiments can respond to the capture preparation signal related to the focus operation and change The operation mode of the camera image sensor is changed from the preview mode 50 to the capture preparation mode 60. According to the example embodiment of the inventive concept, unlike the conventional method, the method of eliminating the shutter delay according to the example embodiment can change the operation mode of the camera image sensor from the preview mode 50 to the acquisition preparation mode regardless of the acquisition signal 60. Here, the acquisition preparation signal may include an autofocus start signal, an external input signal, a smile detection signal, and a face detection signal. Examples of external input signals may include touch input signals, button input signals, voice input signals, and so on. In some example embodiments, may further comprise capturing preparation signal for performing a fingerprint detection operation of the finger pattern detection signal, for performing a specific operation of the detection object article detection signals. The resolution of the sensor output image can be changed from a low resolution (LOW_RES) to a high resolution (HIGH_RES) in response to the acquisition preparation signal in the preview mode 50 of the camera image sensor. As a result, since the sensor output image has high resolution in the capture preparation mode 60 of the camera image sensor, it may not cause the shutter delay, which corresponds to the timing and timing of the user pressing the shutter release button The delay between the timing of the actual image capture.

In addition, the method for eliminating shutter delay according to example embodiments can change the operation mode of the camera image sensor from the capture preparation mode 60 to the preview mode 50 in various ways. For example, in the capture preparation mode 60 of the camera image sensor, the resolution of the sensor output image can be changed from high resolution HIGH_RES to low resolution LOW_RES in various ways. According to an example embodiment of the inventive concept, when the sensor output image is captured in the capture preparation mode 60 of the camera image sensor, the sensor output image can be The resolution of the sensor output image is changed from a high resolution to a low resolution at the timing when the capture of the output image is completed. According to an example embodiment of the inventive concept, when the predetermined or reference time elapses from the acquisition completion timing of the sensor output image, the resolution of the sensor output image can be changed from a high resolution to a low resolution. According to an example embodiment of the inventive concept, when the mode change signal is input in the capture preparation mode 60 of the camera image sensor, the resolution of the image output by the sensor can be changed from a high resolution to a low resolution. According to an example embodiment of the inventive concept, when the predetermined or reference time elapses in the capture preparation mode 60 of the camera image sensor, the resolution of the image output by the sensor can be changed from a high resolution to a low resolution. As described above, the method for eliminating shutter delay according to example embodiments can prevent unnecessary power consumption in the preview mode 50 of the camera image sensor, and can be used in the capture preparation mode 60 of the camera image sensor Prevent shutter delay when capturing images. In addition, the method for eliminating shutter delay according to example embodiments can minimize the capture preparation mode 60 of the camera image sensor, which consumes relatively high power.

FIG. 10 is a timing diagram illustrating a method of eliminating shutter delay according to an example embodiment.

Referring to FIG. 10, the method for eliminating shutter delay according to example embodiments can change the operation mode of the camera image sensor between a preview mode and a capture preparation mode. Here, the first mode change MODE CHANGE_1 indicates that the operation mode of the camera image sensor is changed from the preview mode to the capture preparation mode, and the second mode change MODE CHANGE_2 indicates that the operation mode of the camera image sensor is changed from the capture preparation mode It is preview mode. As illustrated in Figure 10, since the sensor output image is maintained at a low resolution in the preview mode of the camera image sensor, the clock frequency used to operate the camera image sensor is relatively low and is used to perform The power consumption of the preview mode is relatively low. On the other hand, since the sensor output image is maintained at a high resolution in the capture preparation mode of the camera image sensor, the clock frequency used to operate the camera image sensor is relatively high and is used to perform the capture. The power consumption of the standby mode is relatively high. Therefore, in order to reduce the power consumption of the camera image sensor, it may be necessary to minimize the capture preparation mode that consumes a relatively high amount of power. Therefore, the method for eliminating shutter delay according to example embodiments may use a capture preparation signal, which is desirably generated before the user initiates image capture by, for example, pressing the shutter release button.

In detail, when the capture preparation signal is input in the preview mode of the camera image sensor, the first mode change MODE CHANGE_1 can lower the resolution of the sensor output image by responding to the capture preparation signal Change to high resolution and execute. For example, the operation mode of the camera image sensor can be changed from the preview mode to the capture preparation mode in response to the capture preparation signal. Generally speaking, since the focus operation is desirably performed when performing image capture, the capture preparation signal may be a signal related to the focus operation. For example, the acquisition preparation signal may include an auto focus start signal for performing a focusing operation, an external input signal for performing a focusing operation (for example, a touch input signal), and a smile detection for performing a smile detection operation. Signal, and the face detection signal used to perform the face detection operation. In some example embodiments, the capture preparation signal may further include Fingerprint detection signals for performing fingerprint detection operations, object detection signals for performing specific object detection operations, etc. As described above, the method for eliminating shutter delay according to example embodiments can use the capture preparation signal to execute the first mode change MODE CHANGE_1 before inputting the capture signal. As a result, since the sensor output image is maintained at a high resolution in the capture preparation mode of the camera image sensor, the shutter delay due to the change in the resolution of the sensor output image may not be caused.

According to the required conditions, the second mode change MODE CHANGE_2 can be executed in various ways. For example, the second mode change MODE CHANGE_2 can be performed by changing the resolution of the sensor output image from a high resolution to a low resolution. According to an example embodiment of the inventive concept, when the sensor output image is captured in the capture preparation mode of the camera image sensor, the second mode change MODE can be executed at the completion timing of the capture of the sensor output image CHANGE_2. According to an example embodiment of the inventive concept, when the predetermined or reference time has elapsed since the acquisition completion timing of the sensor output image, the second mode change MODE CHANGE_2 can be executed. According to an example embodiment of the inventive concept, when the mode change signal is input in the capture preparation mode of the camera image sensor, the second mode change MODE CHANGE_2 can be executed. According to an example embodiment of the inventive concept, when the predetermined or reference time elapses in the capture preparation mode of the camera image sensor, the second mode change MODE CHANGE_2 can be executed. As described above, the method of eliminating shutter delay according to example embodiments can prevent unnecessary power consumption in the preview mode of the camera image sensor, and can be captured in the capture preparation mode of the camera image sensor Prevent citation Start the shutter delay. In addition, the method for eliminating shutter delay according to example embodiments can minimize the capture preparation mode 60 of the camera image sensor. During the capture preparation mode 60, the camera image sensor can consume a relatively high amount of power.

According to example embodiments of the inventive concept, the method of measuring the clock frequency for operating the camera module and the power consumption for operating the camera module can be used to check whether the camera module and the electrical device with the camera module are used A method for eliminating shutter delay according to example embodiments. For example, based on Mobile Industry Processor Interface (MIPI) for camera modules, International Telecommunication Union-Radio (ITU-R) BT.601, ITU-R In the case of BT.656 or ITU-R BT.709 communication, (for example) between the application processor and the camera image sensor, the camera module and the camera module can be checked by measuring the clock frequency and power consumption. Does an electrical device with a camera module use the method for eliminating shutter delay according to example embodiments? The clock frequency and power consumption are used to implement MIPI, ITU-R BT.601, ITU-R BT for the camera module .656 or ITU-R BT.709.

FIG. 11 is a block diagram illustrating a camera module according to example embodiments.

Referring to FIG. 11, the camera module 100 may include an image sensor unit 120, an image signal processing unit 140 and a mode control unit 160. In some example embodiments, the camera module 100 may be implemented by a System-On-Chip (SOC).

The image sensor unit 120 can receive an image corresponding to the subject of the photography The light signal LIG, and the sensor output image SOI is generated by performing photoelectric conversion on the light signal LIG. For this operation, the image sensor unit 120 may include at least one image sensor, and the image sensor may be a Complementary Metal-Oxide Semiconductor (CMOS) image sensor or a charge coupled device (Charge Coupled Device; CCD) image sensor. Based on the control signal CTL1 output from the mode control unit 160, the sensor output image SOI can have a low resolution in the preview mode and can have a high resolution in the capture preparation mode. Here, it should be understood that the "resolution" of the sensor output image SOI includes the "pixel" of the sensor output image SOI, the "size" of the sensor output image SOI, and the "capacity" of the sensor output image SOI. ", the term "sampling rate" of the sensor output image SOI. According to example embodiments of the inventive concept, the size of the SOI output image of the sensor with low resolution can correspond to the display output size. For example, the size of the SOI output image of the sensor with low resolution can be VGA (640^＊480) Size. In addition, as the size of the display output changes, the size of the SOI output image of the sensor with low resolution can be changed. For example, when a mobile device with the camera module 100 is coupled to an external display device, the size of the sensor output image SOI with a low resolution can be changed to the display output size of the external display device. In addition, the size of the SOI output image of the sensor with high resolution can correspond to a predetermined size, and the predetermined size can be changed by the user. For example, the size of the SOI output image of the sensor with high resolution can be the size of the full frame (for example, 5M(2608^＊1960), 8M (3264^＊2448) etc.). The image sensor unit 120 can provide the sensor output image SOI, the sensor The resolution of the output image SOI changes according to the operation mode of the camera module 100 or the operation of the camera image sensor. In some example embodiments, when the operation mode of the camera module 100 is changed, the image sensor unit 120 may output an interrupt signal to the image signal processing unit 140 to ensure the continuity of the image SOI output by the sensor.

The image signal processing unit 140 can process the sensor output image SOI output from the image sensor unit 120 to generate image data IDA. For this operation, the image signal processing unit 140 may include at least one image signal processor (ISP). For example, the image signal processing unit 140 may perform processing for auto exposure (AE), auto white balance (AWB), auto focus (AF), and the like. In addition, the image signal processing unit 140 can further perform a scaler, output format, color correction, and grayscale correction (gamma correction), shadow compensation, etc. In detail, the image signal processing unit 140 can process the sensor output image SOI with low resolution or the sensor output image SOI with high resolution based on the control signal CTL2 output from the mode control unit 160. For example, when a low-resolution sensor output image SOI is input from the image sensor unit 120 in the preview mode, the image signal processing unit 140 can process the low-resolution sensor output image SOI to output Applicable to image data IDA in preview mode. On the other hand, when a high-resolution sensor output image SOI is input from the image sensor unit 120 in the capture preparation mode, the image signal processing unit 140 can process the high-resolution sensor output image SOI To output image data suitable for capture preparation mode IDA. In some example embodiments, the image sensor unit 120 is coupled to the image signal processing unit 140 based on MIPI and an Inter-Integrated Circuit (I2C). However, it is not limited to this.

The mode control unit 160 can change the operation mode of the camera module 100 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. In detail, when the capture preparation signal SPS is input in the preview mode, the mode control unit 160 can output the control signal CTL1 to the image sensor unit 120 to control the sensor output from the image sensor unit 120 The resolution of the output image SOI is changed from low resolution to high resolution. Generally speaking, since it is necessary to perform a focusing operation when performing image capturing, the capturing preparation signal SPS may be a signal related to the focusing operation of the camera module 100. According to an example embodiment of the inventive concept, the capture preparation signal SPS may be an auto-focus start signal for performing a focusing operation. According to an example embodiment of the inventive concept, the capture preparation signal SPS may be an external input signal for performing a focusing operation, such as a touch input signal. According to an example embodiment of the inventive concept, the capture preparation signal SPS may be a smile detection signal used to perform a smile detection operation. According to an example embodiment of the inventive concept, the capture preparation signal SPS may be a face detection signal for performing a face detection operation. Since the mode control unit 160 uses the capture preparation signal SPS that must be generated in the camera module before the user presses the shutter release button, when the user presses the shutter release button in the capture preparation mode, the mode control unit 160 can Control the sensor to output the image SOI to make it have high resolution. As a result, because the sensor output image SOI is maintained at a high resolution in the acquisition preparation mode, it may not cause shutter delay. The shutter delay corresponds to the delay between the timing when the user presses the shutter release button and the timing when the image is actually captured.

In addition, according to one or more conditions, the mode control unit 160 can change the operation mode of the camera module 100 from the capture preparation mode to the preview mode in various ways. As described above, the image sensor unit 120 can output a low-resolution sensor output image SOI in the preview mode, and can output a high-resolution sensor output image SOI in the capture preparation mode. Therefore, the mode control unit 120 may need to change the operation mode of the camera module 100 from the capture preparation mode to the preview mode under certain conditions. According to an example embodiment of the inventive concept, when the sensor output image SOI is captured in the capture preparation mode, the mode control unit 160 can switch the camera module 100 at the completion timing of the capture of the sensor output image SOI The operation mode is changed from the capture preparation mode to the preview mode. According to an example embodiment of the inventive concept, when the predetermined or reference time elapses from the acquisition completion timing of the sensor output image SOI, the mode control unit 160 can change the operation mode of the camera module 100 from the acquisition preparation mode to Preview mode. According to an example embodiment of the inventive concept, when a mode change signal is input in the capture preparation mode, the mode control unit 160 can change the operation mode of the camera module 100 from the capture preparation mode to the preview mode. According to an example embodiment of the inventive concept, when the predetermined or reference time elapses in the capture preparation mode, the mode control unit 160 can change the operation mode of the camera module 100 from the capture preparation mode to the preview mode. As a result, the mode control unit 160 can reduce the power consumption of the camera module 100 by changing the operation mode of the camera module 100 from the capture preparation mode to the preview mode under certain conditions. The capture preparation mode consumes relatively high power.

As described above, the mode control unit 160 can control the image sensor unit 120 and the image signal processing unit 140 by outputting the control signals CTL1 and CTL2 to the image sensor unit 120 and the image signal processing unit 140. Therefore, the image sensor unit 120 can output a low-resolution sensor output image SOI in the preview mode, and can output a high-resolution sensor output image SOI in the capture preparation mode. In addition, the image signal processing unit 140 can process and output the sensor output image SOI with low resolution in the preview mode, and can process and output the sensor output image SOI with high resolution in the capture preparation mode. As a result, the camera module 100 can prevent unnecessary power consumption in the preview mode, and can prevent a shutter delay when capturing images in the capturing preparation mode. In addition, the camera module 100 can minimize the capture preparation mode that consumes relatively high power. According to example embodiments of the inventive concept, the image signal processing unit 140 and/or the mode control unit 160 may be implemented inside an application processor. According to example embodiments of the inventive concept, the image signal processing unit 140 and/or the mode control unit 160 may be implemented outside the application processor. In mobile devices, the image signal processing unit 140 and/or the mode control unit 160 may need to be implemented inside the application processor. In this case, the mode control unit 160 may include a real-time operation system (RTOS), and the image signal processing unit 140 may be controlled by the RTOS.

FIG. 12 is a block diagram illustrating an example of the image sensor unit in the camera module of FIG. 11.

Referring to FIG. 12, the image sensor unit 120 may include a lens 121, a camera image sensor 122, a motor 123 and a sensor controller 124.

The lens 121 can concentrate light (that is, the light signal LIG corresponding to the subject of photography) on the light receiving area (for example, a plurality of unit pixels included in the unit pixel array). The camera image sensor 122 can generate data DATA with thematic information based on the light signal LIG input through the lens 121. In some example embodiments, the camera image sensor 122 may be a CMOS image sensor or a CCD image sensor. The camera image sensor 122 can provide data DATA to the sensor controller 124 based on the clock signal CLK. The motor 123 can perform the focusing operation or the shutter operation of the lens 121 based on the control signal CTRL provided from the sensor controller 124. The sensor controller 124 can control the camera image sensor 122 and the motor 123, and can process the data DATA input from the camera image sensor 122 to output the sensor output image SOI. At the same time, the sensor controller 124 can be coupled to the image signal processor (ISP) of the image signal processing unit 140 to provide the sensor output image SOI to the image signal processor of the image signal processing unit 140. In some example embodiments, the sensor controller 124 may be coupled to the image signal processor of the image signal processing unit 140 based on MIPI and I2C bus. However, it is not limited to this.

As described above, the image sensor unit 120 can receive the light signal LIG, and can generate the sensor output image SOI by performing photoelectric conversion on the light signal LIG. Here, the sensor output image SOI may have a low resolution in the preview mode, and may have a high resolution in the capture preparation mode. The size of the SOI output image of the sensor with low resolution can correspond to the display The output size, and the size of the output image SOI of the sensor with low resolution can be changed with the display output size. The size of the SOI output image of the sensor with high resolution can correspond to a predetermined size, and the predetermined size can be changed by the user. In short, the operation mode of the camera module 100 can be changed from the preview mode to the capture preparation mode based on the capture preparation signal SPS. As a result, when the user presses the shutter release button in the capturing preparation mode, the image sensor unit 120 can output the sensor output image SOI with high resolution. In addition, the operation mode of the camera module 100 can be changed from the capture preparation mode to the preview mode in various ways according to the required conditions. As a result, since the capture preparation mode for the image sensor unit 120 to output the sensor output image SOI with high resolution is minimized, the power consumption of the camera module 100 can be reduced.

FIG. 13 is a block diagram illustrating an example of an image signal processing unit in the camera module of FIG. 11.

Referring to FIG. 13, the image signal processing unit 140 may include an image signal processor 142, a memory device 144, a post-processor 146 and a display controller 148.

The image signal processor 142 can receive the sensor output image SOI output from the image sensor unit 120, and can generate the first image data ID_1 by processing the sensor output image SOI. In fact, the user may not be able to recognize the sensor output image SOI output from the image sensor unit 120. Therefore, the image signal processor 142 can convert the sensor output image SOI into a signal that can be identified by the user, such as the first image data ID_1. For example, the image signal processor 142 can control the image sensor The sensor output by the unit 120 outputs the color type, image size, frame speed, etc. of the image SOI to generate the first image data ID_1. In FIG. 13, it is illustrated that the image signal processor 142 performs the function of the pre-processor. However, the pre-processor may be independently included in the image signal processing unit 140. In this case, the pre-processor can convert the first image data ID_1 into a signal suitable for the post-processor 146.

The memory device 144 can temporarily store the sensor output image SOI output from the image signal processor 142, and can output the sensor output image SOI to the post-processor 146. For example, the memory device 144 may include a volatile memory device such as a dynamic random access memory (DRAM) device, a static random access memory (SRAM) device, etc. And devices such as erasable programmable read-only memory (EPROM) devices, electrically erasable programmable read-only memory (electrically erasable programmable read-only memory) memory; EEPROM) devices, non-volatile memory devices such as flash memory devices. The memory device 144 can perform a buffer function. In some example embodiments, the memory device 144 may not be included in the image signal processing unit 140 according to required conditions. The post-processor 146 can generate the second image data ID_2 by performing post-processing on the first image data ID_1 output from the image signal processor 142. For example, the post-processor 146 can convert, for example, the first image data ID_1 input from the image signal processor 142 or the pre-processor into the second image data that can be displayed on the display device by the display controller 148 ID_2. Next, display control The device 148 can display the second image data ID_2 as the image data IDA on the display device.

The image signal processing unit 140 can output image data IDA by processing the sensor output image SOI output from the image sensor unit 120. In some example embodiments, the image data IDA may be output based on various codecs (for example, JPEG, TIF, GIF, PCX, etc.). According to example embodiments of the inventive concept, the image signal processing unit 140 may be implemented inside an application processor. According to example embodiments of the inventive concept, the image signal processing unit 140 may be implemented outside the application processor. For example, when the image signal processing unit 140 is implemented inside the application processor, when the image signal processing unit 140 communicates with the mode control unit 160, it may not cause a delay. Therefore, if the mode control unit 160 includes an RTOS, the image signal processing unit 140 can be controlled by the RTOS. As described above, based on the control signal CTL2 output from the mode control unit 160, the image signal processing unit 140 can process the low-resolution sensor output image SOI in the preview mode, and can process it in the capture preparation mode The sensor with high resolution outputs the image SOI. As a result, the camera module 100 can reduce power consumption for the preview mode.

FIG. 14 is a block diagram illustrating an example of a mode control unit in the camera module of FIG. 11.

Referring to FIG. 14, the mode control unit 160 may include an input block 162, a control block 164 and an output block 166.

The input block 162 can receive the capture preparation signal SPS, and can output the first internal signal IS_1 to the control block 164. Here, capture the ready signal SPS It can include an auto-focus start signal used to perform a focusing operation, an external input signal used to perform a focusing operation (for example, a touch input signal), a smile detection signal used to perform a smile detection operation, and a face detection signal used to perform face detection. Face detection signal for detection operation. Therefore, the input block 162 can provide the control block 164 with an internal signal IS_1 corresponding to an autofocus start signal, an external input signal, a smile detection signal, or a face detection signal based on the capture preparation signal SPS. The control block 164 can generate a second internal signal IS_2 for controlling the image sensor unit 120 and the image signal processing unit 140 based on the first internal signal IS_1, and can provide the second internal signal IS_2 to the output block 166. Here, the second internal signal IS_2 may correspond to the control signals CTL1 and CTL2 for controlling the image sensor unit 120 and the image signal processing unit 140. Next, the output block 166 can provide the control signals CTL1 and CTL2 to the image sensor unit 120 and the image signal processing unit 140 based on the second internal signal IS_2.

The mode control unit 160 can change the operation mode of the camera module 100 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. In addition, the mode control unit 160 can change the operation mode of the camera module 100 from the capture preparation mode to the preview mode under certain conditions. As described above, the mode control unit 160 can control the image sensor unit 120 to output a low-resolution sensor output image SOI in the preview mode, and can control the image signal processing unit 140 to process the image sensor unit 120 in the preview mode. The low-resolution sensor outputs the image SOI. On the other hand, the mode control unit 160 can control the image sensor unit 120 to output a high-resolution sensor output image SOI in the capture preparation mode, and can control image signal processing The unit 140 outputs an image SOI with a high-resolution sensor in the capture preparation mode. As a result, the camera module 100 can prevent unnecessary power consumption in the preview mode, and can prevent a shutter delay when capturing images in the capturing preparation mode. In addition, the camera module 100 can minimize the capture preparation mode that consumes relatively high power.

FIG. 15 is a block diagram illustrating an example in which the camera module of FIG. 11 is applied to a mobile device.

15, the camera module 200 may include an image sensor unit 220, an image signal processing unit 240, and a mode control unit 260. Here, the mode control unit 260 may be included in the application processor 270. According to example embodiments of the inventive concept, the camera module 200 may be implemented by a system-on-chip (SOC).

The image sensor unit 220 can generate the sensor output image SOI by receiving the light signal LIG corresponding to the subject of the photography, and performing photoelectric conversion on the light signal LIG. The image signal processing unit 240 can process the sensor output image SOI output from the image sensor unit 220 to generate image data IDA. The mode control unit 260 can change the operation mode of the camera module 200 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. Since the image sensor unit 220, the image signal processing unit 240, and the mode control unit 260 are described above, the repeated description will be omitted below. As illustrated in FIG. 15, the mode control unit 260 may be included in the application processor 270. Generally speaking, since mobile devices can be mainly operated on batteries, as the mobile devices become smaller, the mobile devices need to consume less power. Examples of mobile devices can include smart phones, smart pads, and PDAs And a portable game console. Therefore, the mobile device may include an application processor for performing various functions. For example, the application processor of the mobile device can correspond to the central processing unit (CPU) of the computer. Therefore, the application processor 270 may include a mode control unit 260, which changes the operation mode of the camera module 200 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. In this case, the delay caused when the application processor 270 communicates with the mode control unit 260 can be minimized.

As described above, when the capture preparation signal SPS is input in the preview mode, the application processor 270 with the mode control unit 260 can output the control signal CTL1 to the image sensor unit 220 to switch the camera module 200 The operation mode is changed from the preview mode to the capture preparation mode. Therefore, the image sensor unit 220 can output the sensor output image SOI with low resolution in the preview mode, and then can start from the start timing of the capture preparation mode (that is, since the input of the capture preparation signal SPS From time sequence) to output a high-resolution sensor output image SOI. As a result, the shutter delay may not be caused, and the shutter delay corresponds to the delay between the timing when the user presses the shutter release button and the timing when the image is actually captured. In addition, the application processor 270 with the mode control unit 260 can change the operation mode of the camera module 200 from the capture preparation mode to the preview mode by outputting the control signal CTL1 to the image sensor unit 220 under certain conditions. For example, when the sensor output image is captured in the capture preparation mode, when the predetermined or reference time elapses in the capture preparation mode, or when the mode change signal is input in the capture preparation mode. As a result, because the image The acquisition preparation mode of the sensor unit 220 outputting the sensor output image with high resolution SOI is minimized, so the power consumption of the camera module 200 can be reduced. In some example embodiments, the mode control unit 260 may include a real-time operating system (RTOS), and the image signal processing unit 240 may be controlled by the RTOS.

16 is a block diagram illustrating another example in which the camera module of FIG. 11 is applied to a mobile device.

16, the camera module 300 may include an image sensor unit 320, an image signal processing unit 340, and a mode control unit 360. Here, the image signal processing unit 340 and the mode control unit 360 may be included in the application processor 370. In some example embodiments, the camera module 300 may be implemented by a system-on-chip (SOC).

The image sensor unit 320 can generate the sensor output image SOI by receiving the light signal LIG corresponding to the subject of the photography, and performing photoelectric conversion on the light signal LIG. The image signal processing unit 340 can process the sensor output image SOI output from the image sensor unit 220 to generate image data IDA. The mode control unit 360 can change the operation mode of the camera module 300 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. Since the image sensor unit 320, the image signal processing unit 340, and the mode control unit 360 are described above, the repeated description will be omitted below. As illustrated in FIG. 16, the image signal processing unit 340 and the mode control unit 360 may be included in the application processor 370. For example, the application processor 370 may include changing the operation mode of the camera module 300 from the preview mode to the capture preparation mode based on the capture preparation signal SPS The mode control unit 360 of the image sensor unit 320, and the image signal processing unit 340 that outputs the image data IDA by processing the sensor output image SOI output from the image sensor unit 320. In this case, the delay caused when the application processor 370 communicates with the image signal processing unit 340 and the mode control unit 360 can be minimized.

FIG. 17 is a block diagram illustrating another example in which the camera module of FIG. 11 is applied to a mobile device.

Referring to FIG. 17, the camera module 400 may include an image sensor unit 420, an image signal processing unit 440 and a mode control unit 460. Here, the mode control unit 460 may be coupled to the application processor 470. For example, the mode control unit 460 may be a processor independent of the application processor 470. In some example embodiments, the camera module 400 may be implemented by a system-on-chip (SOC).

The image sensor unit 420 can generate a sensor output image SOI by receiving a light signal LIG corresponding to the subject of photography, and performing photoelectric conversion on the light signal LIG. The image signal processing unit 440 can process the sensor output image SOI output from the image sensor unit 420 to generate image data IDA. The mode control unit 460 can change the operation mode of the camera module 400 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. Since the image sensor unit 420, the image signal processing unit 440, and the mode control unit 460 are described above, the repeated description will be omitted below. As illustrated in FIG. 17, the mode control unit 460 may be a processor independent of the application processor 470. For example, the mode control unit 460 can be coupled to the application processor 470, and can be based on self-application processing The capture preparation signal SPS output by the device 470 changes the operation mode of the camera module 400 from the preview mode to the capture preparation mode. Generally speaking, the application processor can perform multi-tasking operations for mobile devices. Therefore, when the application processor is overloaded, the camera module of the mobile device may malfunction. Therefore, because the mode control unit 460 is implemented independently of the application processor 470, the camera module 400 can achieve operational reliability.

FIG. 18 is a block diagram illustrating another example in which the camera module of FIG. 11 is applied to a mobile device.

Referring to FIG. 18, the camera module 500 may include an image sensor unit 520, an image signal processing unit 540, and a mode control unit 560. Here, the mode control unit 560 may be coupled to the application processor 570. For example, the mode control unit 560 may be a processor independent of the application processor 570. In addition, the image signal processing unit 540 may be included in the application processor 570. In some example embodiments, the camera module 500 may be implemented by a system-on-chip (SOC).

The image sensor unit 520 can generate the sensor output image SOI by receiving the light signal LIG corresponding to the subject of the photography, and performing photoelectric conversion on the light signal LIG. The image signal processing unit 540 can process the sensor output image SOI output from the image sensor unit 520 to generate image data IDA. The mode control unit 560 can change the operation mode of the camera module 500 from the preview mode to the capture preparation mode based on the capture preparation signal SPS. Since the image sensor unit 520, the image signal processing unit 540, and the mode control unit 560 are described above, the repeated description will be omitted below. As illustrated in FIG. 18, the application processor 570 may include The image signal processing unit 540 that processes the sensor output image SOI output from the image sensor unit 520 and output image data IDA. However, the mode control unit 560 can be a processor independent of the application processor 570, and can be coupled to the application processor 570. As a result, the delay caused when the application processor 570 communicates with the image signal processing unit 540 can be minimized. In addition, because the mode control unit 560 is implemented independently of the application processor 570, the camera module 500 can achieve operational reliability.

FIG. 19 is a block diagram illustrating a mobile device according to an example embodiment.

Referring to FIG. 19, the mobile device 600 may include a camera image sensor 620, an application processor 640, and at least one display device 660. In some example embodiments, the mobile device 600 may further include a plurality of functional circuits 680 for performing various functions for the mobile device 600.

According to the mobile aggregation trend, the mobile device 600 can perform various functions. As illustrated in FIG. 19, the mobile device 600 may include a camera module for performing camera functions. Here, except for the camera image sensor 620, all the components of the camera module can be included in the application processor 640 of the mobile device 600. According to example embodiments of the inventive concept, the application processor 640 may include a mode controller, an image signal processor, a post processor, and a display controller. The mode controller can maintain the sensor output image to have a low resolution in the preview mode, and can change the resolution of the sensor output image from a low resolution to a high resolution in response to the acquisition preparation signal. Maintain the sensor output image with high resolution in the acquisition preparation mode. Here, the sensor output image can be from the camera image sensor 620 Output. The image signal processor can process the sensor output image to generate the first image data. The post-processor can perform post-processing on the first image data to generate the second image data. The display controller can output the second image data to at least one display device. Here, the mode controller of the application processor 640 may correspond to the mode control unit 160 of FIG. 11, and the image signal processor, post-processor, and display controller of the application processor 640 may correspond to the image signal of FIG. 11 Processing unit 140.

As described above, the mobile device 600 may include an application processor 640 for performing various functions for the mobile device 600, and the application processor 640 may include previewing the operation mode of the camera module in response to the capture preparation signal. The mode is changed to the mode controller of the capture preparation mode, and the components that process the sensor output image to output the image data. These components include, for example, an image signal processor, a post-processor, and a display controller. Therefore, the delay caused when the application processor 640 communicates with the mode controller, the image signal processor, the post processor, and the display controller can be minimized. At the same time, the application processor 640 can be respectively coupled to a functional circuit 680 for performing specific functions of the mobile device 600. Therefore, the application processor 640 can control the functional circuit 680. All in all, when the camera module is operating in the mobile device 600, the sensor output image can be maintained at a low resolution in the preview mode, and the resolution of the sensor output image can be low resolution in response to the acquisition preparation signal The resolution is changed to a high resolution, and the sensor output image can be maintained with a high resolution in the capture preparation mode. As a result, the mobile device 600 can prevent unnecessary power consumption in the preview mode of the camera module, and can be used in the capture preparation mode of the camera module Prevent shutter delay when capturing images. In addition, the mobile device 600 can minimize the capture preparation mode of the camera module that consumes relatively high power.

20 is a diagram illustrating an example in which the mobile device of FIG. 19 is coupled to at least one external display device.

Referring to FIG. 20, the mobile device 600 may include at least one internal display device 660, and may be coupled to the external display devices 690_1 to 690_n. Here, the external display devices 690_1 to 690_n may be respective internal display devices of the external devices 680_1 to 680_n. For example, when the mobile device 600 is a smart phone, the internal display device 660 may correspond to the liquid crystal display (LCD) device of the smart phone, or the active matrix organic light emitting diode (active matrix organic light emitting diode) of the smart phone. light emitting diodes; AMOLED) display device. The external devices 680_1 to 680_n may each correspond to a laptop, a TV, a monitor, a projector, etc., which can be connected to a smart phone in a wireless manner or a wired manner. Therefore, when the mobile device 600 executes the camera function, while the subject of photography is displayed on the internal display device 660, the subject of photography can also be displayed on the external display devices 690_1 to 690_n coupled to the mobile device 600. For this operation, the mobile device 600 can provide the image data IDA to the external devices 680_1 to 680_n. Since the mobile device 600 shares the image data IDA with the external devices 680_1 to 680_n, the user with the mobile device 600 and the user with the external devices 680_1 to 680_n can view the same image in real time. According to an example embodiment of the inventive concept, as the user with the mobile device 600 views and selects the subject of photography on the internal display device 660, the user with one of the external devices 680_1 to 680_n can Press the shutter release button to perform image capture of the subject of photography, and the subject is displayed on the corresponding one of the external display devices 690_1 to 690_n. As a result, the mobile device 600 can be used in various applications such as video phone conferencing, video conferencing, remote control, and so on.

21 to 24 are diagrams illustrating various examples implemented by the mobile device of FIG. 19.

Referring to FIGS. 21-24, the mobile device 600 can be implemented as a cellular phone 910, a smart phone 920, a digital camera 930, a camcorder 940, and so on. As mentioned above, mobile devices can perform various functions according to the mobile aggregation trend. For example, in the case of the cellular phone 910 and the smart phone 920, although the main function of the cellular phone 910 and the smart phone 920 is a communication function, the cellular phone 910 and the smart phone 920 can perform a camera function. On the other hand, in the case of the digital camera 930 and the video camera 940, although the main functions of the digital camera 930 and the video camera 940 are camera functions, the digital camera 930 and the video camera 940 can perform communication functions. The mobile device 600 may include a camera image sensor 620, an application processor 640, and at least one display device 660 to perform camera functions. In addition, the mobile device 600 may further include a plurality of functional circuits 680 to perform other functions. Since the mobile device 600 is described above, the repeated description will be omitted below. In the mobile device 600, the application processor 640 can maintain the sensor output image with a low resolution in the preview mode, and can change the resolution of the sensor output image from the low resolution in response to the acquisition preparation signal Change to high resolution, and the sensor output image can be maintained with high resolution in the capture preparation mode. As a result, the line The mobile device 600 can prevent unnecessary power consumption in the preview mode of the camera image sensor 620, and can prevent a shutter delay when capturing images in the capture preparation mode of the camera image sensor 620. In addition, the mobile device 600 can minimize the capture preparation mode of the camera image sensor 620, which consumes relatively high power.

Figure 25 is a block diagram illustrating an electrical device according to an example embodiment.

25, the electrical device 1000 may include a processor 1010, a memory device 1020, a storage device 1030, an input/output (I/O) device 1040, a power supply 1050, and a camera module 1060. Here, the camera module 1060 may correspond to the camera module 100 in FIG. 11. Not illustrated in FIG. 25, the electrical device 1000 may further include multiple ports for contacting a video card, a sound card, a memory card, a universal serial bus (USB) device, and other electrical devices.

The processor 1010 may perform various calculation functions. The processor 1010 may be a microprocessor, a central processing unit (CPU), or the like. The processor 1010 can be coupled to the memory device 1020, the storage device 1030, and the I/O device 1040 via an address bus, a control bus, a data bus, and the like. In some example embodiments, the processor 1010 may be coupled to an expansion bus such as a peripheral component interconnection (PCI) bus. The memory device 1020 can store data used for the operation of the electric device 1000. For example, the memory device 1020 may include volatile semiconductor memory devices such as DRAM devices, SRAM devices, mobile DRAM, etc., and non-volatile semiconductor memory devices such as EPROM devices, EEPROM devices, flash memory devices, etc. . Storage device 1030 It can be a solid-state drive device, a hard disk drive device, a CD-ROM device, etc. The I/O device 1040 may include an input device such as a keyboard, a keypad, a mouse, etc., and an output device such as a printer, a display device, and the like. The power supply 1050 can provide power for the operation of the electric device 1000.

The camera module 1060 can communicate with the processor 1010 via a bus or other communication links. In some example embodiments, the processor 1010 may be an application processor. Here, all or some components of the camera module can be coupled to the application processor, or can be included in the application processor. As described above, the camera module 1060 may include an image sensor unit, an image signal processing unit, and a mode control unit. Here, the mode control unit can control the image sensor unit to output a low-resolution sensor output image in the preview mode, and can control the image sensor unit to output a high-resolution image in the capture preparation mode The sensor output image. In addition, the mode control unit can control the image signal processing unit to process and output a low-resolution sensor output image in the preview mode, and can control the image signal processing unit to process in the capture preparation mode and output high-resolution images The high-degree sensor outputs the image. As a result, the camera module 1060 can prevent unnecessary power consumption in the preview mode of the camera module 1060, and can prevent a shutter delay when capturing images in the capture preparation mode of the camera module 1060. In addition, the camera module 1060 can minimize the capture preparation mode of the camera module 1060, and the capture preparation mode of the camera module 1060 consumes relatively high power. It should be understood that the electrical device 1000 is interpreted as a system having a camera module 1060.

FIG. 26 is a block diagram illustrating an example of an interface for the electrical device of FIG. 25 picture.

Referring to FIG. 26, the electrical device 1100 can be implemented by a data processing device that uses or supports a mobile industry processor interface (MIPI) interface. The electrical device 1100 may include an application processor 1110, an image sensor 1140, a display device 1150, and so on. The CSI host 1112 of the application processor 1110 can use a camera serial interface (CSI) to perform serial communication with the CSI device 1141 of the image sensor 1140. According to example embodiments of the inventive concept, the CSI host 1112 may include an optical deserializer (DES), and the CSI device 1141 may include an optical serializer (SER). The DSI host 1111 of the application processor 1110 can use a display serial interface (DSI) to perform serial communication with the DSI device 1151 of the display device 1150. According to example embodiments of the inventive concept, the DSI host 1111 may include an optical serializer (SER), and the DSI device 1151 may include an optical deserializer (DES).

In addition, the electrical device 1100 may further include a radio frequency (RF) chip 1160. The RF chip 1160 can perform communication with the application processor 1110. The physical layer (PHY) 1113 of the electrical device 1100 and the physical layer (PHY) 1161 of the RF chip 1160 can perform data communication based on MIPI DigRF. The application processor 1110 may further include a DigRF MASTER 1114 that controls the data communication of the PHY 1161. The electrical device 1100 may include a global positioning system (GPS) 1120, a storage 1170, a MIC 1180, a DRAM device 1185, and a speaker 1190. In addition, the electrical device 1100 can use ultra-wideband (ultra Wideband; UWB) 1210, wireless local area network (WLAN) 1220, and worldwide interoperability for microwave access (WIMAX) 1230 perform communications. However, the structure and interface of the electric device 1100 are not limited thereto.

Example embodiments of the inventive concept can be applied to camera modules and electrical devices (for example, mobile devices) having camera modules. For example, example embodiments of the inventive concept can be applied to electrical devices, including, for example, computers, laptops, digital cameras, 3D cameras, video camcorders, cellular phones, smart phones, and personal digital assistants. (personal digital assistant; PDA), portable multimedia player (PMP), navigation system, surveillance system, auto focus system, video phone, digital TV, etc.

Having thus described the example embodiment, it will be apparent that the example embodiment can be varied in many ways. These changes should not be regarded as departing from the expected spirit and scope of the example embodiments, and all such modifications that are obvious to those familiar with the art are intended to be included in the scope of the following patent applications.

<p>11Preview mode</p><p>12Acquisition preparation mode</p><p>13Preview mode</p><p>21Preview mode</p><p>22Acquisition preparation mode</p><p>23Preview mode</p><p>31Preview mode</p><p>32Acquisition preparation mode</p><p>33Preview mode</p><p>41Preview mode</p><p>42Acquisition preparation mode</p><p>43Preview mode</p><p>50Preview mode</p><p>60Acquisition preparation mode</p><p>100Camera Module</p><p>120Image sensor unit</p><p>121Lens</p><p>122Camera image sensor</p><p>123Motor</p><p>124Sensor Controller</p><p>140Image signal processing unit</p><p>142Image signal processor</p><p>144Memory device</p><p>146Post processor</p><p>148Display Controller</p><p>160Mode Control Unit</p><p>162input block</p><p>164Control block</p><p>166output block</p><p>200Camera Module</p><p>220Image sensor unit</p><p>240Image signal processing unit</p><p>260Mode Control Unit</p><p>270Application Program Processor</p><p>300Camera Module</p><p>320Image sensor unit</p><p>340Image signal processing unit</p><p>360Mode Control Unit</p><p>370Application Program Processor</p><p>400Camera Module</p><p>420Image sensor unit</p><p>440Image signal processing unit</p><p>460Mode Control Unit</p><p>470Application Program Processor</p><p>500Camera Module</p><p>520Image sensor unit</p><p>540Image signal processing unit</p><p>560Mode Control Unit</p><p>570Application Program Processor</p><p>600Mobile device</p><p>620Camera image sensor</p><p>640Application Program Processor</p><p>660Display Device/Internal Display Device</p><p>680Functional circuit</p><p>680_1External device</p><p>680_nExternal device</p><p>690_1External display device</p><p>690_nExternal display device</p><p>910Cellular Phone</p><p>920Smart Phone</p><p>930digital camera</p><p>940Camcorder</p><p>1000Electrical device</p><p>1010Processor</p><p>1020Memory device</p><p>1030Storage device</p><p>1040Input/Output Device</p><p>1050Power Supply</p><p>1060Camera Module</p><p>1100electric device</p><p>1110Application Program Processor</p><p>1111DSI host</p><p>1112CSI host</p><p>1113Physical layer (PHY)</p><p>1114DigRF MASTER</p><p>1120Global Positioning System (GPS)</p><p>1140Image Sensor</p><p>1141CSI device</p><p>1150Display device</p><p>1151DSI device</p><p>1160Radio Frequency (RF) Chip</p><p>1161Physical layer (PHY)</p><p>1162DigRF SLAVE</p><p>1170Storage</p><p>1180MIC</p><p>1185DRAM device</p><p>1190Speaker</p><p>1210Ultra Wideband (UWB)</p><p>1220Wireless Local Area Network (WLAN)</p><p>1230Worldwide Interoperability for Microwave Access (WIMAX)</p><p>ASSImage</p><p>CLKclock signal</p><p>CSAcquisition complete timing</p><p>CTL1Control signal</p><p>CTL2Control signal</p><p>CTRLControl signal</p><p>DATAData</p><p>HIGH_RESHigh resolution</p><p>IDAImage data</p><p>ID_1First image data</p><p>ID_2Second image data</p><p>IS_1First internal signal</p><p>IS_2Second internal signal</p><p>LIGOptical signal</p><p>LOW_RESLow resolution</p><p>MCSMode change signal</p><p>MODE CHANGE_1The first mode change</p><p>MODE CHANGE_2The second mode change</p><p>PCTScheduled or reference time</p><p>PSECapture ready signal</p><p>PTScheduled or reference time</p><p>SOISensor output image</p><p>SPSCapture ready signal</p><p>SSAcquisition signal</p><p>S120~S180Step</p><p>S220~S280Step</p><p>S320~S380Step</p><p>S420~S480Step</p>

FIG. 1 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

FIG. 2 is a diagram illustrating the operation performed by the method of FIG. 1.

FIG. 3 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

FIG. 4 is a diagram illustrating the operation performed by the method of FIG. 3.

FIG. 5 is a diagram illustrating a method for eliminating shutter delay according to an example embodiment flow chart.

FIG. 6 is a diagram illustrating the operation performed by the method of FIG. 5.

FIG. 7 is a flowchart illustrating a method of eliminating shutter delay according to an example embodiment.

FIG. 8 is a diagram illustrating the operation performed by the method of FIG. 7.

FIG. 9 is a conceptual diagram illustrating a method of eliminating shutter delay according to an example embodiment.

FIG. 10 is a timing diagram illustrating a method of eliminating shutter delay according to an example embodiment.

FIG. 11 is a block diagram illustrating a camera module according to example embodiments.

FIG. 12 is a block diagram illustrating an example of the image sensor unit in the camera module of FIG. 11.

FIG. 13 is a block diagram illustrating an example of an image signal processing unit in the camera module of FIG. 11.

FIG. 14 is a block diagram illustrating an example of a mode control unit in the camera module of FIG. 11.

FIG. 15 is a block diagram illustrating an example in which the camera module of FIG. 11 is applied to a mobile device.

16 is a block diagram illustrating another example in which the camera module of FIG. 11 is applied to a mobile device.

FIG. 17 is a block diagram illustrating another example in which the camera module of FIG. 11 is applied to a mobile device.

FIG. 18 is a block diagram illustrating another example in which the camera module of FIG. 11 is applied to a mobile device.

FIG. 19 is a block diagram illustrating a mobile device according to an example embodiment.

20 is a diagram illustrating an example in which the mobile device of FIG. 19 is coupled to at least one external display device.

21 to 24 are diagrams illustrating various examples implemented by the mobile device of FIG. 19.

Figure 25 is a block diagram illustrating an electrical device according to an example embodiment.

FIG. 26 is a block diagram illustrating an example of an interface used in the electrical device of FIG. 25.