Combined object capturing system and display device and associated method

The disclosure of the present application relates to an integrated object capture system and display device based on three-dimensional (3D) measurement and two-dimensional (2D) measurement of an object near the display device, and related methods.

<p> There are known devices and methods for performing non-contact measurements of 3D surface shapes of tangible objects, such as through the use of structured optical triangulation. Triangulation, which measures the surface shape of a tangible object, generally projects light (structured light) that has been subjected to one or more of amplitude modulation, time modulation, and wavelength modulation onto the surface of the object. Use. An image of structured light projected onto the surface of an object (hereinafter referred to as an "image") is captured by the camera in a direction different from the direction in which the structured light is projected. The image is then analyzed to calculate the shape of the surface of the object. Some parameters such as the image, the shape of the surface, the distance between the surface of the object and the components of the system, the specific system parameters that scan the orientation of the object related to the components of the system, etc. , Affects the analysis results. Most of these listed parameters are generally known or easily identified, except for the shape of the object, the distance between the surface of the object and the components of the system, and the orientation of the object associated with the components of the system. Therefore, it is possible to determine the shape of the surface of the object and analyze the image using the triangulation method.</p>

<p> According to embodiments disclosed in the present application, an object capture that is integrated with the display device, integrated with the display device, otherwise attached to the display device, or otherwise positioned side by side with the display device. A system, at least one projector for projecting a structured light pattern onto the surface of an object, and at least one detector, at least one of which acts on the surface of the object. A system is provided that includes at least one detector that captures at least one image of the structured light pattern to be captured, and a computing device for making measurements on the captured image.</p><p> According to an embodiment of the disclosure of the present application, a method for capturing an object near a display device, wherein at least one structured light pattern is projected onto the surface of the object from at least one projection device, and at least one. A step of capturing at least one image of an object by one detector, wherein at least one image contains an image of a structured light pattern acting on the surface of the object, and a step of seeking measurements on the surface of the object. Methods are provided that include.</p><p> According to the embodiments disclosed in the present application, the display device can provide a position and orientation with respect to an object and make assumptions about the projection device and the detection device. The surface of the object can be placed in a position and orientation that occurs during use of the display device.</p><p> According to embodiments disclosed in the present application, measurements on the surface of an object can determine the level of use of a display device or a computer connected to the display device or any other device connected to the display device.</p><p> According to embodiments disclosed in the present application, measurements on the surface of an object are constantly processed to determine the level of use of a display device or a computer connected to the display device or any other device connected to the display device. Is possible.</p><p> The above-mentioned functions and purposes of the disclosure of the present application will become clearer by referring to the following description with the accompanying drawings in which similar reference numerals indicate similar elements.</p>

<figref num="1">It is a perspective view of the embodiment of the integrated object capture system and the display device for capturing an object near the display device according to one or more embodiments disclosed in the present application.</figref><figref num="2">FIG. 3 is a block diagram of an integrated object capture system and display device for capturing an object near the display device according to one or more embodiments disclosed in the present application.</figref><figref num="3">It is a figure which shows the embodiment of the integrated object capture system and the display device including the desktop computer by one or more embodiments of the present disclosure.</figref><figref num="4">It is a figure which shows the embodiment of the integrated object capture system and the display device including the laptop computer by one or more embodiments of the present disclosure.</figref>

Generally, the disclosure of the present application includes an integrated object capture system and display device for capturing an image of an object near the display device. A particular embodiment of the disclosure of the present application will then be discussed with reference to the above figure in which similar reference numerals indicate similar components.

FIG. 1 shows a perspective view of an embodiment of an integrated object capture system and display device 100 for capturing at least one image, scene, or video of object 111 according to one or more embodiments disclosed in the present application. Object 111 is positioned close to the integrated object capture system and display device 100. The integrated object capture system and display device 100 can include an object capture system 102.

In one or more embodiments, the object capture system 102 is integrated or integrated with the display device 101. Although the object capture system 102 will be shown as integrated or integrated with the display device 101 herein, the terms "integrated" and "integrated" are also fixed. Alternatively, it shall indicate an object capture system 102 that is detachably connected to or otherwise attached to the display device, or is otherwise positioned side by side or adjacent to the display device 101. Is understood. In one or more embodiments, the object capture system 102, positioned side by side or adjacent to the display device 101, is an integrated device.

The object capture system 102 includes at least one projection device 106 that projects the structured light 113 around the projection range 114. The structured light 113 can be projected onto the surface 110 of the object 111 near the display device 101.

The object capture system 102 further includes at least one detection device 108, at least one of the detection devices 108 capturing at least one image of the structured light 113 acting on the surface 110 of the object 111. The detector 108 can include a field of view 118 that surrounds a portion of the surface 110 of the object 111. As used herein, it will be described that the object capture system 102 captures an image of the object 111, in which case such image capture will capture any number of captured images or images or scenes of the object 111. It is understood that it is possible to include. In one or more embodiments, the computing device 104 is connected to the projection device 106 and the detection device 108, whereby the computing device 104 analyzes the image captured by the detection device 108 and the object 111 It is possible to perform desired operations such as, but not limited to, the 3D shape of the surface 110 of the surface 110, the distance to the object 111, the orientation of the captured surface 110, the 2D image of the surface 110 of the object 111, and the recognition of the object 111. It will be possible. The computing device 104 can also control one or both of the projection device 106 and the detection device 108, and each component of each device.

In one or more embodiments, the computing device 104 can be integrated with the object capture system 102. In one or more embodiments, the computing device 104 is separable from the object capture system 102.

The display device 101 can be any device that displays information towards the user or the object 111. The display device 101 can be a computer monitor, LCD, desktop computer, laptop computer, television, mobile phone or mobile phone, personal digital assistant, handheld computing device, remote terminal, or any other type. It is possible, but not limited to, a display unit or a device capable of including a display unit.

In one or more embodiments, at least one component of the object capture system 102 can be fixedly or detachably mounted or integrated within the display device 101. For example, the projection device 106 and the detection device 108 of the object capture unit 102 can be fixedly or detachably attached to the display device 101 or integrated into the display device 101, respectively. In one or more embodiments, at least one component of the object capture system 102 can be positioned side by side or adjacent to the display device 101.

In one or more embodiments, one or both of the positions and orientations of the object 111 with respect to the object capture system 100 can be determined based on the position and orientation of the object 111 with respect to the display device 101. The display device 101 can provide one or both of the reference position and the reference orientation with respect to the position and orientation of the object 111. For example, the object 111 can be positioned adjacent to the display portion or screen of the display device 101 so that the surface 110 to be analyzed by the object capture system 102 is oriented towards the display portion of the display device 101. It is possible to turn to. The object capture system 102 is capable of analyzing the surface 110 of the object 111 at the positions and orientations assumed for the display device 101. In one or more embodiments, the object capture system 102 can make its calculations based on the assumption that the object 111 is located in one or both of the reference position and the reference orientation.

In one or more embodiments, the computing device 104 can be integrated or integrated with the display device 101. In one or more embodiments, the computing device 104 is separable from the display device 101. In one or more embodiments, the computing device 104 interacts with the display device 101, whereby the computing device 104 causes the display device 101 to provide an image. In one or more embodiments, the images provided represent information placed or stored on the computing device 104.

The computing device 104 of the object capture system 100 can include a general purpose computer system suitable for implementing a method for measuring the shape of a tangible object according to the present disclosure in 3D and 2D. The computing system 104 is merely an example of a suitable computing environment and is not intended to imply any limitation with respect to the use or scope of functionality of the present invention. In various embodiments, the systems and methods of the present application for an integrated object capture system and display device 100 operate with the environment or configuration of a number of other general purpose or dedicated computing systems. One or more examples of well-known computing systems, environments, and configurations that may be suitable for use with the present invention are personal computers, server computers, handheld or laptop devices, microprocessors. It includes, but is not limited to, systems, microprocessor-based systems, programmable home electronics, networked PCs, minicomputers, mainframe computers, distributed computing environments including any of the systems or devices described above, and the like.

In various embodiments, the analysis performed by the computing system 104 with algorithms and methods that will be discussed in more detail can be explained in the general context of computer executable instructions, such as program modules executed by a computer. is there. In general, a program module includes routines, programs, objects, components, data structures, etc. that perform a particular task or implement a particular abstract data type. These algorithms and methods are also feasible in a distributed computing environment where tasks are performed by remote processing devices linked through communication networks. In a distributed computing environment, program modules can be located within both local and remote computer storage media, including memory storage devices. In one or more embodiments, the computing system 104 can analyze the image captured by the detector 108 by executing one or more computer programs. The computer program can be stored in a memory medium or storage medium such as one or both of the memory and ROM, or can be supplied to the CPU through a network connection or another I / O connection.

Although the present specification will indicate that a computer or computing device is connected to or associated with a display device 101, the terms "computer" and "computing device" are also used. It is understood to indicate the computing device 104, or otherwise indicate another device connected to or associated with the display device 101.

The object 111 may be any tangible object that can be captured by the object capture system 102, which is the face of the user of the display device 101 and a part of the body of the user of the display device 101 (eg,). Hands, palms, fingerprints, etc.), capture badges, and any other object identifiable by the integrated object capture system and display 100, but not limited to these. In one or more embodiments, if the object 111 is associated with a user of display device 101, then one or both of the reference position and reference orientation provided by display device 101 is associated with the user of display device 101. It is possible to correspond to one or both of the positions and orientations to be used. For example, if the object 111 is the face of the user of the display device 101, one or both of the reference position and the reference orientation provided by the display device 101 will be maintained by the user during the operation of the display device 101. It can be one or both of the positions and orientations to be used.

In one or more embodiments, the object 111 can be captured by the object capture system 102, and the captured image is then captured for identification purposes based on the historical operation of the integrated object capture system and display device 100. Can be used for. The historical operation can include a setup phase of the object capture system 102, in which the projection device 106 projects the structured light 113 onto the object 111 and the detection device 108 is on the surface 110 of the object 111. The captured image is captured and the computing device 104 analyzes the captured image. Measurements based on the results of historical movements of object 111 can be recorded. In the subsequent motion of the object capture system 102, the measurement of the trailing motion caused by the computing system 104 is comparable to the measurement of the historical motion. If the measurement of the subsequent motion corresponds to the measurement of the historical motion, the object 111 is identified as a historical object, otherwise the object 111 is identified as an object other than the historical object.

In one or more embodiments, the measurement results used in the setup phase can be obtained from an external source and input into the integrated object capture system and display device 100.

In at least one embodiment, the object capture system 102 may be coupled to the display device 101 via an interface so that measurements made during the operation of the integrated object capture system and display device 100 can be made. , Make the display device 101 execute the function of the display device 101. In at least one embodiment, the object capture system 102 may be coupled to the display device 101 via an interface, whereby the display device 101 is based on measurements made during the operation of the object capture system 102. Alternatively, it can provide a level of access to the computing device 104, or the display device 101 or another device connected to the computing device 104. If the object 111 is identifiable as a historical object, then the object 111 is licensed for a level of access to the display device 101 or another device, and this level of access is associated with the historical object. For example, the level of access associated with historical objects can be determined during the setup phase of object capture system 102. For example, it is possible to analyze the user's face, thereby recognizing certain characteristics of the user captured by the object capture system 102, thereby allowing the user a secure access to the computing system 104 and a display device 101. One or both of the safe uses of the will be provided.

In at least one embodiment, the level of access to the display device 101 is connected to the image that can be displayed on the display device 101 and the display device 101 or the computing device 104 or the display device 101 or the computing device 104. Access to or use of a function that can be performed by the user on any other device that has been made and that can be automatically displayed by display device 101 or performed by computing device 104. It is possible to determine at least one of the features that can be done. In at least one embodiment, if object 111 is not identified as a historical object associated with the level of access required to perform certain functions of display device 101 or computing device 104, then the user has such a function. Cannot be executed.

In one or more embodiments, it is possible to constantly process the measurements described herein. FIG. 2 shows a block diagram of an integrated object capture system and display device 100 for capturing an object 111 near the display device 101, according to one or more embodiments disclosed in the present application. The integrated object capture system and display device 100 can include at least one projection device 106 and at least one detection device 108. In at least one embodiment, the projection device 106 is a slide projector that includes a light source 126 and a light modulator 122 for modulating the light emitted from the light source 126. The light modulator 122 may be a slide type including a slide, a liquid crystal display (LCD) type including a liquid crystal screen, or another device for creating structured light 113. In at least one embodiment, the projection device 106 is a lens 181 having vertices 124 for projecting a slide image onto the surface 110 of an object 111 near the display device 101 as a structured light 113 for a projection range 114. Can be included. According to this and other embodiments, the structured light 113 can also be generated using other methods such as interferometry, moiré, and diffracted light generation.

In at least one embodiment, the projection device 106 projects the structured light 113 at a wavelength selected from one of optical wavelengths, visible wavelengths, and infrared wavelengths. In at least one embodiment, the projection device 106 is a continuous light source. In at least one embodiment, the projection device 106 is incorporated within the display device 101 itself, which projects the structured light 113.

In at least one embodiment, the detector 108 can include a photographic lens 180 with apex 130, a matrix emission receiver 128, and a driver 132. The photographic lens 180 forms an image on the surface of the matrix emission receiver 128. The driver 132 acts as an electronic signal management and processing unit that controls the operation of the matrix emission receiver 128, and the matrix emission as desired or necessary before the captured image is transferred to the computing device 104. It is possible to convert the image captured by the receiver 128 to another format (eg VGA, bmp, jpeg, etc.). The detector 108 can include a field of view 118 that includes a portion of the surface 110 of the object 111. The projector 106 can include a projector axis 112 and a detector 108 can include a detector axis 116, whereby a triangular angle 120 is such that the projector axis 112 and the detector axis 116 It becomes the angle between.

According to one or more embodiments shown in FIG. 3, the integrated body uptake system and display device 100 can include a display device 101 with a display or monitor for the desktop computer 104.

FIG. 4 shows an embodiment of the integrated object capture system and display device 100 according to one or more embodiments disclosed in the present application. In the integrated object capture system and display device 100, the display device 101 is wrapped. It is a component of the top computer 104.

Although the devices and methods have been described with respect to what is currently considered to be the most practical embodiment, it should be understood that the disclosure of the present application need not be limited to the disclosed embodiments. It is intended to cover the intent of the claims and the various modifications and similar configurations contained within the claims, and the claims include all such modifications and similar structures. The broadest interpretation should be given to include. The disclosure of the present application includes any and all embodiments of the following claims.