A wide field of view camera for integration with a mobile device
Abstract
Disclosed herein are various embodiments of an imaging device having a wide field of view, the imaging device being configured to connect to another device. According to one embodiment, the wide field of view camera may include an array of cameras for recording a wide view of the surrounding environment (for example, a 360° view) and generating a 360° image of the surrounding environment. The wide field of view camera can be configured to connect and/or attach to another device including a mobile device. Embodiments include wired or wireless connection mechanisms to facilitate communication between the wide field of view camera and another device. The connection mechanism can enable the transmission of data associated with the wide-field camera to another device. The embodiment includes an attachment mechanism to lock the wide field of view camera to another device.
Term
No projected expiry on record.
- Priority
- Filed
- Published
- Today
26 claims: 3 independent, 23 dependent
- 1An imaging device comprising:an array of light sensors arranged around an ellipsoidal substrate;an array of lenses corresponding to the array of light sensors, the array of lenses configured to receive a plurality of light beams and Focusing the plurality of light beams on the corresponding light sensor in the array of light sensors;a processor configured to receive a plurality of images corresponding to the array of light sensors, and generating images including surrounding An image of a wide view of an environment of the imaging device;and a connection mechanism configured to communicate with another device, wherein the communication includes transferring any image associated with the plurality of images and including the wide view The data of the image. 一種成像裝置,其包含: 光感測器之一陣列,其圍繞一橢球體基板安置;相應於光感測器之該陣列的鏡頭之一陣列,鏡頭之該陣列經配置以接收複數個光束且將該複數個光束聚焦於光感測器之該陣列中的該相應光感測器;一處理器,其經配置以接收相應於光感測器之該陣列的複數個影像,且產生包含圍繞該成像裝置之一環境的一寬視圖之一影像;以及一連接機構,其經配置以與另一裝置通訊,其中該通訊包括轉移相關聯於該複數個影像中之任何影像及包含該寬視圖之該影像的資料。
- 15An imaging device, comprising:a plurality of light sensors arranged to receive light from 360° surrounding the imaging device, wherein the light received by the plurality of light sensors is used to generate a plurality of images;a process A device that is configured to receive the plurality of images, combine any of the plurality of images and generate an image that includes a wide view of an environment surrounding the imaging device;a connection mechanism that is configured to communicate with another Device communication, where the communication includes transmitting any image associated with the plurality of images and image data of the image including the wide view to the other device;and an attachment mechanism configured to the imaging device Lock to the other device. 一種成像裝置,其包含: 複數個光感測器,其經佈置來自圍繞該成像裝置的360°接收光,其中藉由該複數個光感測器接收的光用於產生複數個影像;一處理器,其經配置以接收該複數個影像,組合該複數個影像中之任何影像且產生包含圍繞該成像裝置之一環境之一寬視圖的一影像;一連接機構,其經配置以與另一裝置通訊,其中該通訊包括傳輸相關聯於該複數個影像中之任何影像及包含該寬視圖之該影像的影像資料至該另一裝置;以及一附接機構,其經配置以將該成像裝置鎖緊至該另一裝置。
- 21A method comprising the following steps:disposing an array of light sensors on a curved three-dimensional surface, wherein the array of light sensors substantially covers the curved three-dimensional surface;disposing an array close to the array of light sensors A plurality of lenses to receive a plurality of light beams and focus the plurality of light beams on the array of the light sensor;configure a processor connected to the array of the light sensor to receive the array corresponding to the light sensor And generate an image including a wide field of view of an environment surrounding the curved three-dimensional surface;and configuring a connection mechanism to communicate with another device, wherein the communication includes shifting associated with the wide field of view The data of the image. 一種方法,其包含以下步驟: 在一彎曲三維表面上安置光感測器之一陣列,其中光感測器之該陣列實質上覆蓋該彎曲三維表面;配置接近於光感測器之該陣列的複數個鏡頭以接收複數個光束且將該複數個光束聚焦於光感測器之該陣列上;配置連接至光感測器之該陣列的一處理器以接收相應於光感測器之該陣列的複數個影像,且產生包含圍繞該彎曲三維表面之一環境之一寬視場的一影像;以及配置一連接機構以與另一裝置通訊,其中該通訊包括轉移相關聯於包含該寬視場之該影像的資料。
Independent claims3
114 paragraphs in 1 section, as filed
Wide field of view camera for integration with mobile devices
A WIDE FIELD OF VIEW CAMERA FOR INTEGRATION WITH A MOBILE DEVICE
Cross-reference of related applications: This application claims the U.S. Provisional Patent Application No. 62/249,130 filed on October 30, 2015, the U.S. Provisional Application No. 62/380,250 filed on August 26, 2016, and 2016 The priority and rights of U.S. Patent Application No. 15/336,689 filed on October 27, which are incorporated herein by reference in their entirety.
This application relates to a wide field of view camera, and more specifically, to a wide field of view camera configured for integration with a mobile device.
Generally speaking, today's cameras include directional cameras that record images of the environment from one direction, such as front cameras or back cameras of mobile devices. The conventional camera on the mobile device has a limited field of view, and the small digital camera on the mobile device can have a trimming factor several times smaller than the 35 mm film format.
Disclosed herein are various embodiments of wide-field cameras configured for integration with mobile devices. According to one embodiment, the wide field of view camera may include a camera array for recording a wide view of the surrounding environment (for example, a 360° view) and generating a 360° image of the surrounding environment. The wide field of view camera can be configured to connect and/or attach to a mobile device. Embodiments include wired or wireless connection mechanisms to facilitate communication between the wide field of view camera and another device. The connection mechanism can enable the transmission of data associated with the wide-field camera to another device. The embodiment includes an attachment mechanism to lock the wide field of view camera to another device.
Disclosed herein are various embodiments of wide-field imaging and embodiments for configuring a wide-field imaging device to connect and/or attach to another device. According to one embodiment, an array of cameras is placed on a sphere, with each camera recording a portion of the surrounding 360° environment. The processor executes programs to identify and correct distortions in the image, assemble the images from all cameras, and generate a single wide view (for example, a 360° view) of the environment. The processor may be located in the imaging device and/or in another device. The wide field of view camera can output data associated with the image to another device (for example, a mobile device).
In another embodiment, multiple wide-angle lenses direct light to the internal camera optics to form images corresponding to the multiple wide-angle lenses on a single photo sensor array. Third, the processor executes the program to identify and correct the distortion in the image, and generate a wide view of the environment (for example, a 360° view). The wide field of view camera can output data associated with the image to another device (for example, a mobile device).
In various embodiments disclosed herein, the resulting view of the environment may be a static image or a video. The resulting view can be a two-dimensional or three-dimensional representation of the environment. In order to obtain a three-dimensional representation of the environment, such as a three-dimensional image or a three-dimensional video, the various 360° cameras disclosed herein can be combined to simultaneously record images of the environment from different perspectives. In another embodiment, a three-dimensional representation of the environment (such as a stereoscopic image or a stereoscopic video) can be generated by positioning a single imaging device including the 360° camera disclosed herein in different positions to obtain different perspectives.
In an embodiment, the imaging device may be configured to connect and/or attach to another device. The imaging device may include a connection mechanism to facilitate communication between the imaging device and another device. The connection mechanism may include a wired or wireless connection, such as, for example, a USB connector, a Bluetooth device, a Wi-Fi device, and the like. The imaging device may include an attachment mechanism to lock the imaging device to another device. The attachment mechanism may include an opening to receive another device, a compression device, or the like. Various embodiments of configuring an imaging device for connection and/or attachment to another device are discussed below with reference to Figures 7-13B.<b>Imaging device</b>
Figures 1A-1B show an imaging device with a wide field of view in a recording environment according to an embodiment. The imaging device includes an array of cameras 100 arranged on a curved three-dimensional surface 110. In Figure 1, for simplicity, only a few cameras in the array of cameras 100 are marked. The array of cameras 100 includes a plurality of cameras 120. The array of the camera 100 receives a plurality of light beams 105 from a wide-angle view (e.g., a 360° view). The curved three-dimensional surface 110 can take any shape, such as an ellipsoid, a sphere, a sphere, a cube with rounded edges, or any three-dimensional shape. Some shapes can obstruct certain viewing angles, such as shapes with sharp edges or concave surfaces. Preferred embodiments include shapes that do not have sharp edges or concave surfaces.
The camera 100 substantially covers the curved three-dimensional surface 110. The camera 100 can be placed on the curved three-dimensional surface 110 in various ways: the camera 100 can be evenly distributed on the curved three-dimensional surface 110; the camera 100 can be placed at the intersection of evenly distributed longitude and latitude lines; the camera 100 can be more densely distributed In the area of interest, for example, in the front area 130 and/or the back area 140; etc. In an embodiment, the camera density may be adjustable by, for example, including one or more cameras on a track extending along the length of the curved three-dimensional surface 110 and mechanically connecting the one or more cameras to the The actuator thus enables the movement of one or more cameras. Increasing the camera distribution density can improve the photo quality by focusing additional cameras on the area of interest (such as, for example, the detected facial impression).
Embodiments include enabling movement of a plurality of cameras based on, for example, the movement and/or inactivity of any of the plurality of cameras. For example, the array of lenses can be movably arranged inside the camera port on the ellipsoid substrate. For example, the array of lenses can be configured to shrink to the inside of the camera port in response to a plurality of light sensors being inactive, and to be aligned with the outer surface of the ellipsoid substrate. In another example, the array of lenses may be configured to protrude from the outer surface of the ellipsoid substrate in response to the plurality of light sensors being active, and the plurality of lenses may be positioned to receive light that is not obstructed by the ellipsoid substrate. The processor connected to the camera can control the movement of the camera.
The array of cameras 100 can be arranged on a curved substrate. In one embodiment, the curved substrate matches the shape of the curved three-dimensional surface 110. In another embodiment, a plurality of curved substrates whose curvature does not match the curvature of the three-dimensional surface 110 may be arranged to substantially cover the three-dimensional surface 110.
In another embodiment, the array of cameras 100 is divided into smaller arrays of cameras, and each smaller array of cameras is arranged on a flat substrate. The size associated with each planar substrate is configured to be smaller than the curvature associated with the three-dimensional surface. The multiple small arrays of the camera are placed on a curved three-dimensional surface to substantially cover the surface as described above.
The camera 120 represents a single camera in the array of cameras 100. In FIG. 1B, each camera 120 includes a lens 150 and a light sensor 160. The lens 150 receives the light beam 170 and focuses the light beam on the light sensor 160. The lens 150 may be any type of lens, such as a spherical lens, a wide-angle lens, or a lens having a focal length between an extremely short focal length and an extremely long focal length. The lens 150 may be a small lens, such as a lens of millimeter, micrometer, nanometer, picometer, etc. The light sensor 160 may be a CMOS sensor, a CCD sensor, or any sensor configured to sense light.
The processor connected to the array of light sensors receives a plurality of images corresponding to the array of light sensors. The processor generates an image that includes a wide-angle view (for example, a 360° view) of the environment surrounding the imaging device. The processor may be placed inside the three-dimensional surface, or may be placed outside the three-dimensional surface. The imaging device described herein may be a standalone camera or may be part of another device such as a mobile device.
Figure 2 shows an imaging device with a 180° view of a recording environment according to an embodiment. An ellipsoidal lens 200, such as a spherical lens, focuses the beam 210 on a curved array of elements 220. Each element 230 in the array of elements 220 can be a camera 120 or a light sensor 160 as described above (in Figure 1B). The curvature of the curved array of elements 220 corresponds to the curvature of the ellipsoidal lens 200. For example, the curvature of the curved array of elements is the same as or proportional to the curvature of the ellipsoidal lens 200. The curved array of elements 220 can be assembled according to any of the techniques described above.
Figure 3 shows an imaging device with a 180° view of a recording environment according to another embodiment. An ellipsoidal lens 300, such as a spherical lens, focuses the beam 310 on a curved array of elements 320. Each element 340 in the array of elements 320 can be a camera 120 or a light sensor 160 as described above (in Figure 1B). The array of elements 320 is arranged on the half of the ellipsoidal lens 300, and the element 340 receives the light beam 310 after the light beam is diffracted at the entrance point 330. The curved array of elements 320 can be assembled according to any of the techniques described above.
By combining two or more imaging devices disclosed in Figures 1-3, a wide view (for example, a 360° view) of the environment can be recorded.
Figure 4 shows a wide-field imaging device according to another embodiment. The imaging device includes two wide-angle lenses 400 and 410 that receive a plurality of light beams 420. For simplicity, only one beam 420 is marked in the drawing. The element 430 contains the internal optics of the imaging device.
Figure 5A shows the internal optics of the wide-field imaging device according to one embodiment. The elements 500 and 510 are wide-angle lenses that receive a plurality of light beams 590 and 595 from around the imaging device at most 180°. The elements 520 and 530 are convex lenses, which receive a plurality of light beams 590 and 595 from a plurality of wide-angle lenses 500 and 510 and focus the light beams of the plurality of light beams 590 and 595 on the deflector 585.
The deflector 585 receives the plurality of light beams 590, 595 from the first plurality of convex lenses 520, 530, and the deflector 585 changes the direction of the plurality of light beams 590, 595 to guide the plurality of light beams 590, 595 to the second plurality of convex lenses 540, 550. The deflector 585 can be a mirror or a mirror. The deflector 585 may be fixed, or it may be implemented by a micro-electromechanical system (MEMS) device, a nano-electromechanical system (NEMS) device, or a pico-electromechanical system (PENS) device. ) Actuation of devices, etc. For example, the deflector may be a single mirror or a mirror, which changes its position between the position 587 of the deflected beam 590 and the position 589 of the deflected beam 595. In another embodiment, the deflector 585 can deflect the light beam 595 to the position 591 of the lens 540, 560, thereby avoiding the need for the lens 550, 570.
The second plurality of convex lenses 540, 550 receives the plurality of light beams 590, 595 from the deflector 585, and focuses the plurality of light beams 590, 595 on the plurality of concave lenses 560, 570.
The plural concave lenses 560 and 570 receive the plural light beams 590 and 595 from the second plural convex lenses 540 and 550, and the plural concave lenses 560 and 570 guide the plural light beams 590 and 595 to the array of the light sensor 580.
The array of the light sensor 580 receives a plurality of light beams 590, 595 from the plurality of concave lenses 560, 570, and forms a plurality of images corresponding to the first plurality of convex lenses 500, 510. The array of light sensors 580 can have various sizes, such as 16x9 mm and 4x3 mm.
A processor connected to the array of light sensors 580 receives a plurality of images and generates images including a wide view (eg, 360° view) surrounding the imaging device. The software associated with the processor can identify and correct lens artifacts and/or distortions, and associate the two images to generate a wide-angle view (eg, a 360° view) around the imaging device.
Figure 5B shows an image formed by an array of light sensors 580 according to one embodiment. The array of the light sensor 580 can form two images 582 and 584 corresponding to the two convex lenses 500 and 510. The size of the array of light sensors 580 can be 16x9 mm. In another embodiment, in the presence of the actuated deflector 585 at position 587 or 591, the array of light sensors 580 can form a single image 682 as depicted in FIG. 6B. The single image 682 alternates between an image corresponding to the lens 500 and an image associated with the lens 510.
Fig. 6A shows the internal optics of the wide-field imaging device according to another embodiment. Elements 600-630 correspond to elements 500-530 in Figure 5A, respectively. The deflector 685 receives the plurality of light beams 690, 695 from the first plurality of convex lenses 620, 630, and the deflector 685 changes the direction of the plurality of light beams 690, 695 to guide the plurality of light beams 690, 695 to the second plurality of convex lenses 640, 650. The deflector 685 can be a mirror or a mirror. The deflector 685 may be fixed, or it may be implemented by a micro-electromechanical system (MEMS) device, a nano-electromechanical system (NEMS) device, or a pico-electromechanical system (PENS) device. ) Actuation of devices, etc.
Similar to FIG. 5A, the convex lenses 640, 650 and the concave lenses 660, 670 focus the light beams 690, 695 to a plurality of photo sensor arrays 675, 680. The plurality of light sensor arrays 675, 680 receive the plurality of light beams 690, 695 from the plurality of concave lenses 660, 670, and form a plurality of images corresponding to the first plurality of convex lenses 600, 610.
Figure 6B shows an image 682 formed by a plurality of photo sensor arrays 675, 680 according to one embodiment. The plurality of light sensor arrays 675, 680 can have light sensors of various sizes, such as 4x3 mm.
In order to obtain a three-dimensional representation of the environment, such as a three-dimensional image or a three-dimensional video, the various 360° cameras disclosed herein can be combined to simultaneously record images of the environment from different perspectives. For example, the imaging device disclosed in Figure 1A can be combined with the imaging device disclosed in Figure 4 to simultaneously record images of the environment. In another embodiment, a three-dimensional representation of the environment (such as a three-dimensional image) can be relayed by positioning a single device (for example, the imaging device disclosed in Figure 1A or the imaging device disclosed in Figure 4) at the first position. It is produced by placing the device in the second position. The processors coupled to both of the cameras can generate three-dimensional images or videos based on both of the imaging device recordings.<b>Method for configuring imaging device</b>
Figure 7 shows a method of configuring a wide field of view camera to attach and/or connect to another device according to an example. In step 700, the array of light sensors is placed on the curved three-dimensional surface so that the array of light sensors substantially covers the curved three-dimensional surface. The surface can be an ellipsoid, a sphere, a sphere, a cube with rounded edges, or any other three-dimensional shape. Some shapes can hinder the viewing angle of certain cameras, such as shapes with sharp edges or concave surfaces. Preferred embodiments include shapes that do not have sharp edges or concave surfaces. The array of light sensors can be arranged on a flat substrate or a curved substrate.
In step 710, a plurality of lenses are arranged close to the array of light sensors to receive the plurality of light beams and focus the plurality of light beams on the array of light sensors. In one embodiment, the correspondence between the array of light sensors and the lens is one-to-one. In another embodiment, a convex lens corresponds to an array of light sensors, wherein the curvature associated with the convex lens corresponds to the curvature of the curved array associated with the light sensor. The lens can be a spherical lens, a wide-angle lens, or a lens with a focal length between an extremely short focal length and an extremely long focal length.
The array of light sensors includes a plurality of sub-arrays of light sensors, and the plurality of sub-arrays of light sensors have varying densities. For example, the array of light sensors may have a higher density in the area of interest, such as the front or back of the imaging device.
In step 720, the processor connected to the array of light sensors is configured to receive a plurality of images corresponding to the array of light sensors, and generate an environment including a curved three-dimensional surface (for example, the surface of an imaging device) The wide field of view (e.g., 360° view) image. The imaging device thus assembled may be a stand-alone camera or may be part of another device such as a mobile device. The processor may be located in, for example, an imaging device, a mobile device, or a combination thereof. The memory device may be located in, for example, an imaging device, a mobile device, or a combination thereof. The processor can retrieve and/or store data associated with a plurality of images and/or wide-field images in a memory device. The processor in the imaging device and the processor in the mobile device can perform all or part of the image processing steps to generate a wide field of view image. The processor in the imaging device can perform one or more imaging processing steps and the processor in the mobile device can perform one or more processing steps. For example, the processor in the imaging device can compress multiple images by identifying the redundancy in the multiple images, and use the connecting mechanism to transmit the compressed multiple images to the processor in the mobile device, and the processing in the mobile device The device can use the compressed multiple images to generate a wide field of view image (for example, a 360° view image). In various embodiments, additional method steps may be performed to enable the production of the embodiments described above.
In step 730, the connection mechanism connected to the processor (or a plurality of processors) facilitates communication between the imaging device and another device (for example, a mobile device), wherein the communication includes associating an image with a wide field of view Transfer data from to another device. The connection mechanism may include any wired or wireless connection or a combination of wired and/or wireless connections. Examples of wired connections include universal serial bus (USB) connectors (for example, 1.0, 2.0, 3.0, 3.1, type c, mini, micro, etc.), Apple Lightning® connectors, or any other computer bus Or a combination of computer bus. Examples of wireless connections include one or more of any combination of personal area network (PAN) devices, local area network (LAN) devices, wide area network (WAN) devices, or wireless devices. Connections. The connection mechanism can be operated using standardized communication protocols. Communication via the connecting mechanism may include transmitting data and/or receiving data from another device.
In an embodiment, the attachment mechanism can lock the imaging device to another device. The attachment mechanism may include, for example, an opening to receive another device, a compression mechanism, a latch, a mobile device housing, a handle, a fusion surface, or any combination thereof. The attachment mechanism may also include a release mechanism to release the imaging device from another device. For example, if the attachment mechanism includes a compression mechanism that applies a force on the outer surface of another device to hold the other device in place, the release mechanism can reduce or eliminate the applied force on the outer surface of the other device. The release mechanism may allow another device to be removed from the imaging device. Embodiments include an attachment mechanism that operates in conjunction with a connection mechanism. For example, the USB connection portion can be positioned in the opening to receive another device, so that the USB can facilitate connection with another device, and the combination of the opening and the USB connection portion can lock the other device in place. In an embodiment, the imaging device may be integrated with another device. For example, the fusion surface can attach the imaging device to another device (e.g., a mobile device), and the connection mechanism (e.g., wired connection) under the fusion surface can facilitate communication between the imaging device and the other device.<b>Has connection and</b><b>/</b><b>Or the imaging device of the attachment mechanism</b>
Figures 8A-8B show an imaging device capable of recording a distortion-free wide view (for example, a 360° view) of the surrounding environment according to one embodiment. In various embodiments, the 360° view includes a 360° view around all 3-dimensional axes X, Y, Z. The imaging device includes a first plurality of cameras 800 and a second plurality of cameras 830.
The first plurality of cameras 800 includes a plurality of wide-angle lenses 810, 720, such as fisheye lenses. The plurality of wide-angle lenses 810 and 820 may be evenly distributed around the first plurality of cameras 800. For example, if the plurality of wide-angle lenses 810 include two lenses, the two lenses are placed on opposite sides of the camera. The first plurality of cameras 800 are configured to record the first plurality of images related to the surrounding environment. Each of the first plurality of images includes the periphery of the image that is distorted by the wide-angle lens of the plurality of wide-angle lenses and the center of the image that is not distorted by the wide-angle lens.
The second plurality of cameras 830 includes a plurality of lenses 840 and 850. The plurality of lenses 840 and 850 may be evenly distributed around the second plurality of cameras 830. The plurality of lenses 840 and 850 may be distributed to the left and right sides of the first plurality of cameras 800, and/or distributed to the top and bottom of the first plurality of cameras 800, etc. The plurality of lenses 840 and 850 can be any kind of lenses ranging from a very short effective focal length lens to a very long effective focal length lens, such as a standard lens. The second plurality of cameras 830 is configured to record the second plurality of images related to the surrounding environment. Each image in the second plurality of images includes an image center that is not distorted by the cameras in the second plurality of cameras, wherein the plurality of image centers associated with the second plurality of images overlap and are associated with the first plurality of images Multiple images around.
In one embodiment, the imaging device includes a rotating ring 860 configured to rotate the first plurality of cameras 800 and/or the second plurality of cameras 830. The swivel 860 can rotate around one, two, or all three 3-dimensional axes. The first plurality of cameras 800 and the second plurality of cameras 830 can be rotated relative to each other, or can be rotated relative to a device in which the first plurality of cameras and the second plurality of cameras are installed. FIG. 8B shows the position where the first plurality of cameras 800 rotate relative to the second plurality of cameras 830 relative to the position shown in FIG. 8A. The swivel 860 may be connected to a motor that automatically rotates the swivel 860. The motor can be a microelectromechanical system ("MEMS") device, a nano-electromechanical system ("NEMS") device, a microelectromechanical system device, etc. The motor can be connected to the processor associated with the imaging device , The processor associated with the mobile device 805. In one embodiment, after the first photo is recorded, the motor rotates the rotating ring 860 at any angle from 0° to 90°, and the cameras 800 and 830 record the second photo. In addition, the rotating ring 860 may include a locking mechanism such that when the rotating ring 860 rotates the cameras 800 and/or 830 to a desired position, the locking mechanism engages to keep the cameras 800 and/or 830 in place.
The first plurality of cameras 800 and the second plurality of cameras 830 can record the first plurality of images and the second plurality of images synchronously or asynchronously. The imaging device may include a processor configured to combine the first plurality of images and the second plurality of images into images that are not distorted by the plurality of wide-angle lenses. The processor may also be associated with the mobile device 805.
The imaging device disclosed herein can be a standalone device, can be an accessory to the mobile device 805, or can be integrated into the mobile device 805. In addition, the first plurality of cameras 800 and/or the second plurality of cameras 830 may be independent devices, may be an accessory to the mobile device 805, or may be integrated into the mobile device 805. The mobile device 805 accessory can be connected to the phone via a USB port or wirelessly. When the first plurality of cameras 800 and/or the second plurality of cameras 830 are coupled to the mobile device 805, the cameras 800 and 830 can be powered by the mobile device 805 and communicatively coupled to the processor associated with the mobile device 805, In this way, the images recorded by the cameras 800 and 830 are stored on the mobile device 805. Alternatively, the images recorded by the cameras 800 and 830 may be stored in the cameras 800 and 830 and sent to the mobile device 805 for processing and/or display.
Figure 9A shows a side view of a plurality of cameras partially activated according to an embodiment. The first plurality of cameras 900 associated with the mobile device 905 includes a first wide-angle lens 910 and a second wide-angle lens 920, a plurality of light sensors 940, and are coupled to the first wide-angle lens 910, the second wide-angle lens 920, and a plurality of light sensors 940 is an array of light deflectors 930. The lenses 910 and 920 may be fisheye lenses. The array of light deflectors 930 may include one or more light deflectors. The second plurality of cameras may include cameras 850 and 840 associated with the mobile device 905.
The first plurality of cameras 900 is operable to retract inside the camera port 960 associated with the mobile device 905 when the first plurality of cameras 900 are inactive, and to align with one or more surfaces associated with the outer casing The housing is associated with the mobile device 905, so that the first plurality of cameras 900 become unnoticed when inactive. The first plurality of cameras 900 are operable to protrude from the outer casing associated with the mobile device 905 when the cameras are in motion, and position the lenses 910, 920 to receive most of the light that is not obstructed by the mobile device 905.
The array of light deflectors 930 is operable to change the direction of the light beam 950 by changing the position of the array associated with the light deflectors 930. The change in the direction of the beam 950 can be from 0° to 180°. Each light deflector in the array of light deflectors 930 is operable to rotate around an axis 935 associated with the individual light deflector and assume at least two positions. The first position is operable to deflect the light beam 950 associated with the first lens 910 to the light sensor 940 associated with the first plurality of cameras 900. The second position is operable to deflect the light beam associated with the second lens 920 to the light sensor 940 associated with the first plurality of cameras 900. Each light deflector in the array of light deflectors 930 can rotate independently of each other, or the light deflectors can rotate uniformly. Each light deflector in the array of light deflectors 930 may present a different position from each other, the light deflectors may present the same position, or the light deflectors may present a position such that the array of light deflectors 930 Create a smooth surface, such as a flat or curved surface. For example, the light deflector 970 has assumed a different position than the rest of the light deflectors in the array of light deflectors 930, thus resulting in a non-smooth surface.
Each light deflector in the array of light deflectors 930 may be a mirror or a mirror that is operable to reflect light. The array of light deflectors 930 may include a mixture of specular light deflectors and specular light deflectors, or may include only specular light deflectors or only specular light deflectors. The mirror can be made of any reflective material, such as glass, reflective plastic, metal, etc. can be Polo , Amish roof ridge mirror, five , etc. The array of light deflectors 930 may be actuated by a very small device or may be part of a very small device, such as a micro-electromechanical system ("MEMS") device, a nano-electromechanical system (nano-electromechanical system; "NEMS") devices, MEMS devices, etc.
In addition to the first lens 910 and the second lens 920 as described above, the first plurality of cameras 900 may include a third lens, a fourth lens, and a fifth lens. Each lens can correspond to the side of the first plurality of cameras 900. In addition to the first position and the second position as described above, the array of the light deflector 930 is operable to present a third position, a fourth position, a fifth position, etc., wherein the array of the light deflector 930 is associated with Each position is configured to deflect the light beam associated with the lens to the light sensor 940 associated with the first plurality of cameras 900. Any one of the positions of the light deflectors in the array associated with the light deflectors 930 can deflect light by 0°, that is, the array of light deflectors 930 causes the light beam to pass through the light sensor 940.
According to one embodiment, the first plurality of cameras 900 may include lenses arranged between the plurality of light sensors 940 and the array of light deflectors 930. The lens may have an effective focal length between a very short effective focal length and a very long effective focal length. In another embodiment, the first plurality of cameras 900 may further include a light guide connected to the lenses 910, 920, an array of the light deflector 930, and a plurality of light sensors 940, wherein the light guide is operable to connect the lenses 910, 920 and Transmission beam 950 between lenses. The light guide can be made of any material that totally reflects light.
According to another embodiment, the mobile device 905 may include a second camera, wherein the second camera is displaced a short distance from the first plurality of cameras 900. In various embodiments, the short distance between two cameras roughly corresponds to the distance between human eyes, and in some cases simulates the distance between human eyes. In other embodiments, the short distance between the two cameras is reduced to almost zero in order to minimize the space occupied by the two cameras on the mobile device 905. The second camera includes a second lens that is operable to capture a second image. The second image corresponds to the first image captured by the first plurality of cameras 900, where the second image and the first image include three-dimensional images. The three-dimensional image is a two-dimensional image with a slight offset in the same scene, and corresponds to the left eye and right eye of the viewer. When two images are viewed by a person, the images give an impression of depth of field. The second camera may be a second stretchable camera, a traditional mobile phone camera, or a mobile phone camera integrated into the display, as described in this application. The mobile device 905 includes a processor coupled to the second camera and the first plurality of cameras 900. The processor is operable to extract depth information based on the first image and the second image, to correct aberrations in each image, to correct the image, and to generate a three-dimensional image.
Figure 9B shows an array of light deflectors 930 according to one embodiment. The axis 935 associated with the light deflectors in the array of light deflectors 930 can be positioned anywhere on the light deflectors. For example, the axis 935 may be the axis of symmetry associated with the light deflector, or may be aligned with any edge of the light deflector in the array of light deflectors 930 associated with it. For example, the rotation axis 935 associated with the light deflector 970 is aligned with the edge associated with the light deflector 970. The axis of rotation 935 associated with the light deflector 980 is aligned with the axis of symmetry associated with the light deflector, such as the horizontal axis of symmetry, as shown in FIG. 9B. The light deflectors 970 and 980 can rotate independently of the rest of the light deflectors, as shown in Fig. 9B.
FIG. 10A shows a first plurality of cameras and a second plurality of cameras integrated into a mobile device according to an embodiment. The first plurality of cameras 1000 includes two wide-angle lenses 1010 and 1020. The second plurality of cameras 1030 includes two lenses 1040 and 1050. The second plurality of cameras 1030 are arranged to record images in the area where the wide-angle lenses 1010 and 1020 produce distorted images. For example, the second plurality of cameras 1030 are arranged at an angle of 90° relative to the first plurality of cameras 1000, as shown in FIG. 12A. The first plurality of cameras 1000 and the second plurality of cameras 1030 are integrated into the mobile device. The first plurality of cameras 1000 includes a front camera and a back camera associated with the mobile device 1005. The second plurality of cameras 1030 includes side cameras, such as a left camera and a right camera.
The mobile device 1005 may include one or more sides. For example, the mobile device 1005 may have 6 sides, such as a standard iPhone or android phone, or the mobile device 1005 may be curved, such as an ellipsoid, containing only a single side.
Figure 12B is an imaging apparatus according to an embodiment. The imaging device contains six sides. Two wide-angle lenses 1060 are installed on opposite sides of the imaging device. The four standard lenses 1070, 1072, 1074, and 1076 are arranged in the middle of the remaining four sides associated with the imaging device. For the edge 1090, the separate side with the standard lens mounted is equipped with an attachment mechanism such as a rail to receive a bracket configured to support the imaging device. The support can be an elongated selfie stick, a tripod, etc. For example, in Figure 10B, two elongated brackets 1080 are attached to the edge 1090 associated with the imaging device, so that the two sides containing the edge have standard lenses mounted thereon. The angle between the bracket 1080 and the edge 1090 is between 130° and 145° so as not to block the view of the standard lenses 1070, 1074, 1076.
Figures 10C-10D show an imaging device configured to connect and/or attach to a mobile device according to another embodiment. The imaging device 1015 includes two sides. A wide-angle lens 1025 is arranged on one side of the imaging device 1015, and a standard lens 1035 is arranged on the other side of the imaging device 1015. The imaging device 1025 can be attached to the back side associated with the mobile device 1005, as shown in FIG. 10D. The component 1045 is a front camera associated with the mobile device 1005.
Figure 11 shows an imaging device 1100 configured to connect and/or attach to another device 1110 according to one embodiment. Covers embodiments for configuring the imaging device 1100 to connect and/or attach to various devices. The other device 1110 may include, for example, mobile devices (for example, mobile phones, tablet computers, personal computers, manually operated and unmanned vehicles, camera stands and other appliances or any combination of mobile devices) and fixed devices (for example, anchored in appropriate Large objects that cannot be moved without damage). Examples of manually controlled and unmanned vehicles include automobiles, ships, submarines, airplanes, spacecraft, unmanned drones, satellites, etc. Several connections (that is, the data connection between the imaging device 1100 and another device) and attachments (that is, the physical locking of the imaging device 1100 and another device) described herein with reference to FIGS. 8A-12B are applicable to More than one another device.
Although Figure 11 depicts a wired connection configuration, it covers a variety of connection configurations. The imaging device 1100 can be connected to another device 1110 via any wired or wireless connection or a combination of wired and/or wireless connections. For example, the imaging device 1100 can be connected via a universal serial bus (USB) connector (e.g., 1.0, 2.0, 3.0, 3.1, type c, mini, micro, etc.), Apple Lightning® connector, or any other computer The bus or the combination of the computer bus is connected to another device 1110. Examples of wireless connections include one or more of any combination of personal area network (PAN) devices, local area network (LAN) devices, wide area network (WAN) devices, or wireless devices. Connections. Wireless PAN devices include, for example, Bluetooth® devices. The wireless LAN device includes, for example, a WI-FI® device. Wireless WAN devices include, for example, 4G devices. Examples of connection combinations include micro USB connectors and PAN (E.g. Bluetooth®), which is configured to connect to another device (e.g., mobile phone). The imaging device 1100 can be configured to connect to another device by including a connecting device (for example, a Bluetooth® device and/or a micro USB cable) or by including a port compatible with the connecting device (for example, a USB port) 1110.
Wired connection can provide a higher data transfer rate than wireless connection. The embodiments of the present invention cover a large amount of image data that can be well suited for wired connection. Other embodiments cover the use of multiple connections to transfer a large amount of image data, such as using a combination of wired and/or wireless connections, so that the first connection can transmit one part of the data and another connection can transmit another part of the data. The wireless data transfer speed can be increased by, for example, using multiple frequency bands.
In an embodiment, the imaging device 1100 may include an attachment mechanism. The attachment mechanism can lock the imaging device 1100 to another device 1110. The attachment mechanism may include, for example, an opening to receive another device, a compression mechanism, a latch, a mobile device housing, a handle, a fusion surface, or any combination thereof. The attachment mechanism may also include a release mechanism to release the imaging device 1100 from another device 1110. For example, if the attachment mechanism includes a compression mechanism that exerts a force on the outer surface of another device 1110 to hold the other device 1110 in place, the release mechanism can reduce or eliminate all on the outer surface of the other device 1110. Apply force. The release mechanism may allow another device 1110 to be removed from the imaging device 1100.
The imaging device 1100 may include a handle 1120 attached at the base and a USB cable 1130 attached or attachable (e.g., via a USB port) at the bottom of the handle. The handle can increase the distance between the user's hand and one or more cameras of the imaging device 1100 to reduce obstruction to the one or more cameras. The lower portion of the handle may include a clamp (for example, composed of rubber) to stabilize the imaging device 1100 during use. Stabilizing the imaging device 1100 during use can increase the image quality.
Embodiments encompass that the imaging device 1100 includes additional attachment features. For example, the handle 1120 can be configured to attach to a camera mount. Attaching the handle 1120 of the imaging device 1100 to the camera bracket can stabilize the imaging device 1100 and increase the image quality during use.
Figures 12A-12B show an imaging device 1200 configured to connect to another device 1210 according to one embodiment. The imaging device 1200 can be connected to another device 1210 via any wired or wireless connection or a combination of wired and/or wireless connections. Examples of another device and wired and wireless connections (and combinations thereof) are discussed above with reference to FIG. 11.
In one embodiment, the image information can be output to the other device 1210 by projecting the image to the camera of the other device 1210. For example, the imaging device 1200 can be mounted on a part of another device 1210, including a camera lens of another device 1210. The imaging device 1200 may include a projector aligned with the sight of a camera lens of another device 1210. For example, the imaging device 1200 may include an opening sized for another device (e.g., a mobile phone) and a projector positioned in the opening to be aligned with a camera lens of the other device (e.g., a camera lens of a mobile phone). The projector can transmit light to the camera of another device. The other device 1210 can record the image data provided by the imaging device 1200.
In one embodiment, the image information can be transferred to another device 1210 by displaying the image in front of the camera of the other device 1210. For example, the imaging device 1200 can be mounted on a part of another device 1210, including a camera lens of another device 1210. The imaging device 1200 may include a display aligned with the sight of a camera lens of another device. For example, the imaging device 1200 may include an opening sized for another device (e.g., a mobile phone) and a display positioned in the opening to be aligned with a camera lens of the other device (e.g., a camera lens of a mobile phone). The display can provide an image detectable by a camera of another device 1210.
The imaging device 1200 may be configured to attach another device (for example, a mobile phone and/or a tablet computer). The imaging device 1200 may be configured to attach to the top portion, bottom portion, and/or side portion of another device 1210, for example. The imaging device 1200 may include an attachment mechanism capable of locking the imaging device 1200 to another device 1210. The attachment mechanism may include, for example, an opening to receive another device, a compression mechanism, a latch, a mobile device housing, a handle, a fusion surface, or any combination thereof. For example, the imaging device 1200 may include an opening that extends the length of the imaging device 1200. The opening may include additional attachment mechanisms, such as, for example, a latch or compression device. For example, a portion of another device 1210 (e.g., top, bottom, or side portion) may be slid into the opening and remain fixed within the opening due to the additional attachment mechanism in the opening. One or more side walls of the opening can maintain the position of the imaging device 1200 on the other device 1210 by, for example, preventing the imaging device 1200 from sliding across the other device 1210. In an embodiment, the imaging device 1200 may be configured to be attached to another device 1210 by being attached to a housing that is configured to be attached to another device 1210. The embodiment includes an imaging device 1200, and another device 1210 is fastened into a single device. For example, the surface of the imaging device 1200 may be fused to the surface of another device 1210. The imaging device 1200 and another device 910 with a fused surface can be operated as an integrated device. Embodiments include attachment mechanisms that also serve as connection mechanisms. For example, the attachment mechanism may include a wired connector (e.g., a micro USB connector). The wired connector can be plugged into a port (for example, a micro USB port) of another device 1210, which attaches the imaging device 1200 to another device.
The imaging device 1200 may extend beyond one or more outer edges of another device 1210. For example, the imaging device 1200 may extend beyond the front and rear edges of another device 1210. In an example, the imaging device 1200 may extend beyond one or more side edges of another device 1210. By extending beyond one or more outer edges of the other device 1210, the imaging device 1200 can obtain a wide-angle view with less obstruction from the other device 1210. For example, if the imaging device 1200 is attached to the top portion of another device 1210 and extends above the side of the other device 1210, then a group of light sensors of the array of light sensors adjacent to the outer edge of the other device 1210 The detector receives a light beam that is not obstructed by the other device 1210 (for example, a light beam traveling parallel to the outer edge of the other device 1210). In other words, the imaging device 1200 may have a wide-angle view extending from above the top portion of the other device 1210 to the side of the other device 1210 and below the other device 1210. In other words, in contrast, if the imaging device 1200 is attached to the top portion of another device and does not extend above the side of the other device 1210, the view extending below the other device may be obstructed by the other device 1210.
Figures 13A-13B show a pair of imaging devices 1302, 1304 configured to connect and/or attach to another device 1310 according to one embodiment. The pair of imaging devices 1302, 1304 can be connected to another device 1310 via any wired or wireless connection or a combination of wired and/or wireless connections. An example of another device is discussed above with reference to FIG. 11. Examples of wired and wireless connections (and combinations thereof) are discussed above with reference to Figure 11. Embodiments include transferring image information from imaging device 1302 and/or imaging device 1304 via a projector and/or display close to a camera of another device, as discussed with reference to FIGS. 12A-12B.
The pair of imaging devices 1302, 1304 can be configured to attach another device 1310 (e.g., a mobile phone and/or a tablet). The pair of imaging devices 1302, 1304 may be configured to be attached to the top portion, bottom portion, and/or side portion of another device 1310, for example. The pair of imaging devices 1302, 1304 may be configured to attach to the same or different parts of the device 1310. For example, both the pair of imaging devices 1302, 1304 may be configured to be attached to the top portion, bottom portion, and/or side portion of another device 1310. In an example, the imaging device 1302 may be configured to attach to the top portion, and the imaging device 1304 may be configured to attach to the bottom portion of another device 1310. In an example, the imaging device 1302 can be configured to be attached to a side portion, and the imaging device 1304 can be configured to be attached to another side portion of another device 1310. The pair of imaging devices 1302, 1304 may include an opening extending the length of the pair of imaging devices 1302, 1304. The opening may include an attachment mechanism, such as, for example, a latch or compression device. A portion of the other device 1310 (e.g., top, bottom, or side portion) can be slid into the opening of the imaging device 1302, 1304, and remains fixed within the opening due to the attachment mechanism. One or more side walls of the opening can maintain the position of the pair of imaging devices 1302, 1304 on the other device 1310 by, for example, preventing the pair of imaging devices 1302, 1304 from sliding across the other device 1310. An embodiment includes an attachment mechanism that acts as a connection device. For example, the attachment mechanism may include a wired connector (e.g., a micro USB connector). The wired connector can be inserted into a port (for example, a micro USB port) of another device 1310, and the port can attach either or both of the pair of imaging devices 1302, 1304 to the other device 1310. In an embodiment, the pair of imaging devices 1302, 1304 may be configured to be attached to another device 1310 by being attached to a housing that is configured to be attached to another device 1310.
Although only two imaging devices are shown in Figures 13A-13B, embodiments with more than two imaging devices are covered. For example, four imaging devices may be attached to another device 1310, wherein the imaging devices are attached to the bottom portion, top portion, first side portion, and second side portion of the other device 1310. Attaching multiple imaging devices to another device can reduce obstruction to the image (for example, obstruction from another device). Multiple imaging devices may be attached to a housing (e.g., phone housing, tablet computer housing, etc.) that is configured for another device (e.g., phone, tablet computer, etc.). One or more wired connections may be included in the housing so that the imaging device can share data via the wired connection.
Having more than one imaging device configured to attach to another device (e.g., the pair of imaging devices 1302, 1304) can reduce obstruction to the image (e.g., obstruction from another device). For example, the imaging device 1302 on the top part of the other device 1310 cannot extend to the outer edge of the first or second side of the other device 1310, so a part of the wide-angle view can be on the first side and the second side Not hindered by the upper surface of another device 1310. However, because the imaging device 1304 can be located on the lower part of another device, the obstruction from the upper surface of the other device 1310 can be eliminated by the following methods: using sophisticated image processing techniques to omit imaging under the obstruction The image captured by the device 1302, and the images captured by the imaging device 1304 are combined to fill the gap to produce a wide-angle view (eg, 360° view) of the surrounding environment without obstruction (eg, another device to which the imaging device can be attached) ).<b>computer</b>
Figure 14 is a diagrammatic representation of a machine of a computer system 900 in an exemplary form within which a set of executable instructions can be used to cause the machine to perform any one or more of the methods or modules discussed herein.
In the example of FIG. 14, the computer system 1400 includes a processor, a main memory, a non-volatile memory, and a network interface device. Various common components (for example, cache memory) are omitted for simplicity of description. The computer system 900 is intended to illustrate a hardware device on which any of the components described in the example of Figures 1-13B (and any other components described in this specification) can be implemented. The computer system 1400 can be of any applicable known or suitable type. The components of the computer system 1400 can be coupled together via a bus or via some other known or suitable devices.
This disclosure covers the computer system 1400 in any suitable physical form. As an example and without limitation, the computer system 1400 may be an embedded computer system, a system-on-chip (SOC), a single-board computer system (SBC) (such as, for example, Computer-on-module (COM) or system-on-module (SOM)), desktop computer system, laptop or notebook computer system, interactive life information station, Mainframe computers, computer system networks, mobile phones, personal digital assistants (personal digital assistants) assistant; PDA), server, or a combination of two or more of these. Where appropriate, the computer system 1400 may include one or more computer systems 1400; be single or distributed; span multiple locations; span multiple machines; or reside in the cloud, which may include one or more networks One or more cloud components. When appropriate, one or more computer systems 1400 can perform one or more steps of one or more methods described or exemplified herein, without substantial space or time constraints. As an example and by way of limitation, one or more computer systems 1400 can perform one or more steps of one or more methods described or illustrated herein in real time or in batch mode. The one or more computer systems 1400 can perform one or more steps of the one or more methods described or exemplified herein at different times or at different locations as appropriate.
The processor may be, for example, a conventional microprocessor, such as an Intel Pentium® microprocessor or a Motorola PowerPC® microprocessor. Those skilled in the relevant arts will recognize that the term "machine-readable (storage) medium" or "computer-readable (storage) medium" includes any type of device that can be accessed by a processor.
The memory system is coupled to the processor by, for example, a bus. The memory may include, for example, but not limited to, random access memory (RAM), such as dynamic RAM (DRAM) and static RAM (SRAM). The memory can be local, remote or distributed.
The bus also couples the processor to the non-volatile memory and the driving unit. Non-volatile memory is often a magnetic floppy disk or hard disk, magneto-optical disk, optical disk, read-only memory (read-only memory; ROM) (such as CD-ROM, EPROM or EEPROM), magnetic card or optical card or used for large amounts of data. Another form of storage. This data is often written into the memory through a direct memory access process during software execution in the computer system 900. Non-volatile memory storage can be local, remote or distributed. Non-volatile memory is optional because the system can use all applicable data available in the memory to generate it. A typical computer system will usually include at least a processor, memory, and a device (for example, a bus) that couples the memory to the processor.
The software is typically stored in non-volatile memory and/or drive units. In fact, it may not even be possible to store a complete large program in memory. However, it should be understood that for running software, it may be necessary to move to a computer-readable location suitable for processing, and for illustrative purposes, that location is referred to herein as memory. Even when software is moved to memory for execution, the processor will typically use hardware registers to store the values associated with the software, and will use local cache memory, which ideally speeds up execution. As used herein, when a software program is referred to as "executing in a computer-readable medium," the software program is assumed to be stored in any known or suitable location (from non-volatile memory to hardware register ). When at least one value associated with the program is stored in a register that can be read by the processor, the processor is regarded as "configured to execute the program."
The bus also couples the processor to the network interface device. The interface may include one or more of a modem or a network interface. It will be understood that the modem or network interface can be regarded as part of the computer system 1400. Interfaces may include analog modems, ISDN modems, cable modems, symbol ring interfaces, satellite transmission interfaces (for example, "direct PC"), or other interfaces for coupling computer systems to other computer systems. The interface may include one or more input and/or output devices. I/O devices may include, for example, but not limited to, keyboards, mice or other pointing devices, disk drives, printers, scanners, and other input and/or output devices, including display devices. The display device may include, for example, but not limited to, a cathode ray tube (CRT), a liquid crystal display (LCD), or some other applicable known or suitable display devices. For simplicity, it is assumed that the controller of any device not depicted in the example in Figure 8 resides in the interface.
In operation, the computer system 1400 can be controlled by operating system software, which includes a file management system, such as a disk operating system. An example of operating system software with associated file management system software is the operating system family called Windows® from Microsoft Corporation of Redmond, Washington, and its associated file management system. Another example is Linux<sup>TM</sup>Operating system, and its associated file management system. File management systems are typically stored in non-volatile memory and/or drive units, and cause the processor to perform various actions required by the operating system to input and output data and store data in memory, including files Stored in non-volatile memory and/or drive unit.
Some parts of the detailed description can be presented in the algorithm and the meaning of the operation symbols on the data bits in the computer memory. These algorithm descriptions and representations are methods used by those skilled in the field of data processing technology to most effectively convey the substance of their work to other skilled practitioners in the technical field. Algorithms are conceived in this article and generally as a self-consistent sequence of operations that produce the desired result. These operations are those that require physical manipulation of physical quantities. Usually, although not necessarily, these equivalent quantities take the form of electrical or magnetic signals that can be stored, transferred, combined, compared, and otherwise manipulated. Referencing such signals as bits, values, components, symbols, characteristics, items, numbers, or the like sometimes proves to be appropriate, mainly for general purpose reasons.
However, it should be borne in mind that all these terms and similar terms are not related to appropriate physical quantities and are merely suitable labels applied to these equivalent quantities. Unless expressly stated otherwise and is obvious from the following discussion, it should be understood that in various places described in this article, such as "processing" or "calculation" or "arithmetic" or "decision" or "display" or " the term computer system generating discussion refers to "and so forth, or similar electronic computing device, the action and processes of the computer system will register in a computer memory systems and represented as physical (electronic) quantities within the control data and converted to Computer system memory or register or other such information storage, transmission device, or display device in other similarly expressed physical quantities of data.
The algorithms and displays presented in this article are not essentially about any particular computer or other device. Various general-purpose systems can be used with the programs taught in this article, or it may prove appropriate to construct more specialized equipment to carry out some embodiments. The required structure for a variety of these systems will appear in the description below. In addition, the techniques are not described with reference to any specific programming language, and various programming languages can therefore be used to implement various embodiments.
In an alternative embodiment, the machine operates as a standalone device, or can be connected (eg, networked) to other machines. In network connection deployment, the machine can operate in a server or client machine in a client-server network environment, or as a peer machine in an inter-level (or distributed) network environment.
The machine can be server computer, client computer, personal computer (PC), tablet PC, laptop, set-top box (STB), personal digital assistant (PDA) , Cellular phone, iPhone, Blackberry, processor, phone, web device, network router, switch or bridge, or any machine capable of executing an instruction set (sequentially or otherwise), the instruction set specifies that the The action taken by the machine.
Although a machine-readable medium or a machine-readable storage medium is shown as a single medium in the exemplary embodiment, the terms "machine-readable medium" and "machine-readable storage medium" shall be used to include storage of one or more instruction sets Single media or multiple media (such as centralized or distributed databases and/or associated caches and servers). The terms "machine-readable medium" and "machine-readable storage medium" should also be used to include any medium that can store, encode, or implement a set of instructions executed by a machine, where the set of instructions enables the machine to perform the currently disclosed technologies and innovations Any one or more of the methods or modules.
Generally speaking, the routines executed to implement the embodiments of the present disclosure can be implemented as part of the operating system or specific applications, components, programs, objects, modules, or a sequence of instructions called "computer programs". A computer program typically includes one or more instructions set at various times in various memories and storage devices in the computer, and the one or more instructions are read by one or more processing units or processors in the computer. When fetching and executing, the computer is caused to operate to execute various aspects of the elements related to the present disclosure.
In addition, although the embodiments have been described in the context of fully functioning computers and computer systems, those skilled in the art will understand that the various embodiments can be distributed as program products in various forms, regardless of the specific nature used to affect the distribution. Types of machine or computer-readable media are equally applicable to the present disclosure.
Other examples of machine-readable storage media, machine-readable media, or computer-readable (storage) media include, but are not limited to, recordable media (such as volatile and non-volatile memory devices, floppy disks, and other removable Disks, hard drives, optical discs (such as compact disk read-only memory (CD-ROM), digital versatile disc (DVD), etc.) and other types of transmission media (such as Digital and analog communication links).
In some cases, the operation of the memory device (such as the state change from binary one to binary zero, and vice versa) may include, for example, a conversion, such as a physical conversion. In the case of a specific type of memory device, such physical conversion may include the physical conversion of the product entity to a different state or item. For example, but without limitation, for some types of memory devices, the state change may involve the accumulation and storage of charges or the release of stored charges. Similarly, in other memory devices, the state change may include a physical change or transformation in the magnetic orientation, or a physical change or transformation in the molecular structure, such as a change or transformation from a crystalline entity to an amorphous form, or vice versa. The above is not intended to be an exhaustive list, in which the state change from binary one to binary zero in the memory device or vice versa may include transitions, such as physical transitions. In fact, the above intends to provide illustrative examples.
Storage media can typically be non-transitory or include non-transitory devices. In this scenario, the non-transitory storage medium may include a tangible device, which means that the device has a specific physical form, although the device can change its physical state. Thus, for example, non-transitory refers to a device that remains tangible regardless of the state change.<b>Remark</b>
The language used in this specification has been selected mainly for readability and teaching purposes, and may not have been selected to outline or limit the subject matter of the invention. Therefore, it is intended that the scope of the present invention is not limited by this "implementation mode", but is limited by any claims, and an application is issued based on these claims. Accordingly, the disclosures of the various embodiments are intended to illustrate rather than limit the scope of the embodiments, which are described in the scope of the following patent applications.
<p>100Camera</p><p>105Beam</p><p>110Curved three-dimensional surface</p><p>120Camera</p><p>130Front area</p><p>140Back area</p><p>150Lens</p><p>160Light Sensor</p><p>170Beam</p><p>200Ellipsoid lens</p><p>210Beam</p><p>220Component</p><p>230Component</p><p>300Ellipsoid lens</p><p>310Beam</p><p>320Component</p><p>330Entry Point</p><p>340Component</p><p>400Wide-angle lens</p><p>410Wide-angle lens</p><p>420Beam</p><p>430Component</p><p>500Element/Convex lens</p><p>510Element/Convex lens</p><p>520Element/Convex lens</p><p>530Element/Convex lens</p><p>540Convex lens/lens</p><p>550Convex lens/lens</p><p>560lens/concave lens</p><p>570lens/concave lens</p><p>580Light Sensor</p><p>582Image</p><p>584Image</p><p>585 deflector</p><p>587Location</p><p>589Location</p><p>590Beam</p><p>591Location</p><p>595Beam</p><p>600Element/Convex lens</p><p>610Element/Convex lens</p><p>620Element/Convex lens</p><p>630Element/Convex lens</p><p>640Convex lens</p><p>650Convex lens</p><p>660Concave lens</p><p>670Concave lens</p><p>675Light Sensor Array</p><p>680Light Sensor Array</p><p>682Image</p><p>685 deflector</p><p>690Beam</p><p>695Beam</p><p>700step</p><p>710Step</p><p>720Step</p><p>730Step</p><p>800Camera</p><p>805Mobile device</p><p>810Wide-angle lens</p><p>820Wide-angle lens</p><p>830Camera</p><p>840Lens</p><p>850lens</p><p>860Swivel</p><p>900Camera</p><p>905Mobile device</p><p>910The first wide-angle lens/lens</p><p>920Second wide-angle lens/lens</p><p>930Optical Deflector</p><p>935Axis/rotation axis</p><p>940Light Sensor</p><p>950Beam</p><p>960Camera port</p><p>970Optical Deflector</p><p>980Optical Deflector</p><p>1000The first plural cameras</p><p>1005Mobile device</p><p>1015Imaging device</p><p>1020Wide-angle lens</p><p>1025Wide-angle lens</p><p>1030The second plural cameras</p><p>1035Standard lens</p><p>1045Component</p><p>1050Lens</p><p>1060Wide-angle lens</p><p>1070Standard lens</p><p>1072Standard lens</p><p>1074Standard lens</p><p>1076Standard lens</p><p>1080Support</p><p>1090Edge</p><p>1100imaging device</p><p>1110Another device</p><p>1120Handle</p><p>1200imaging device</p><p>1210Another device</p><p>1302Imaging device</p><p>1304Imaging device</p><p>1310Another device</p><p>1400Computer system</p>
Figures 1A-1B show an imaging device with a wide field of view in a recording environment according to an embodiment.
Figure 2 shows an imaging device with a substantially 180° view of the recording environment according to one embodiment.
Figure 3 shows an imaging device with a substantially 180° view of a recording environment according to another embodiment.
Figure 4 shows a wide-field imaging device according to another embodiment.
Figure 5A shows the internal optics of the wide-field imaging device according to one embodiment.
Figure 5B shows an image formed by an array of light sensors according to one embodiment.
Fig. 6A shows the internal optics of the wide-field imaging device according to another embodiment.
Figure 6B shows an image formed by a plurality of photo sensor arrays according to one embodiment.
Figure 7 shows a method of configuring an imaging device to connect with another device according to an embodiment.
Figures 8A-8B show an imaging device capable of recording a distortion-free full view of the surrounding environment according to an embodiment.
Figure 9A shows a side view of a plurality of cameras partially activated according to an embodiment.
Figure 9B shows an array of light deflectors 930 according to one embodiment.
Figure 10A shows an imaging device integrated into another device according to one embodiment.
Figure 10B shows an imaging device configured to connect to another device according to one embodiment.
Figures 10C-10D show an imaging device configured to connect and/or attach to another device according to one embodiment.
Figure 11 shows an imaging device configured to connect and/or attach to another device according to one embodiment.
Figures 12A-12B show an imaging device configured to connect and/or attach to another device according to one embodiment.
Figures 13A-13B show a pair of imaging devices configured to connect and/or attach to another device according to one embodiment.
Figure 14 is a diagrammatic representation of a machine of a computer system 1400 in an exemplary form within which a set of executable instructions can be used to cause the machine to perform any one or more of the methods or modules discussed herein.
Domestic deposit information (please note in the order of deposit institution, date and number)
Foreign hosting information (please note in the order of hosting country, institution, date, and number) None
(請換頁單獨記載) 無
241 members in 14 offices
Priority claims25
| Document | Office | Kind | Date |
|---|---|---|---|
| 201562249130 | United States of America | P | |
| 201562249130 | United States of America | P | |
| 62249130 | United States of America | – | |
| 201662300631 | United States of America | P | |
| 201662300631 | United States of America | P | |
| 62300631 | United States of America | – | |
| 201662317467 | United States of America | P | |
| 201662317467 | United States of America | P | |
| 62317467 | United States of America | – | |
| 201662380250 | United States of America | P | |
| 201662380250 | United States of America | P | |
| 62380250 | United States of America | – | |
| 15336689 | United States of America | – | |
| 201615336689 | United States of America | A | |
| 201615336689 | United States of America | A | |
| 201562249130P | – | – | – |
| 201615336689 | – | – | – |
| 201662300631P | – | – | – |
| 201662317467P | – | – | – |
| 201662380250P | – | – | – |
| US201562249130P | – | – | – |
| US201615336689 | – | – | – |
| US201662300631P | – | – | – |
| US201662317467P | – | – | – |
| US201662380250P | – | – | – |
Members241
| Document | Office | Kind | |
|---|---|---|---|
| US9525764B1 | United States of America | B1 | |
| US9560252B1 | United States of America | B1 | |
| US9560443B1 | United States of America | B1 | |
| US9591212B1 | United States of America | B1 | |
| CA2976829A1 | Canada | A1 | |
| CA3003136A1 | Canada | A1 | |
| CA3003140A1 | Canada | A1 | |
| CA3003141A1 | Canada | A1 | |
| US2017121840A1 | United States of America | A1 | |
| US2017123452A1 | United States of America | A1 | |
| US2017123453A1 | United States of America | A1 | |
| US2017123454A1 | United States of America | A1 | |
| US2017123575A1 | United States of America | A1 | |
| US2017124372A1 | United States of America | A1 | |
| US2017124377A1 | United States of America | A1 | |
| US2017124932A1 | United States of America | A1 | |
| US2017124933A1 | United States of America | A1 | |
| US2017124942A1 | United States of America | A1 | |
| US2017125888A1 | United States of America | A1 | |
| US2017125897A1 | United States of America | A1 | |
| US2017126268A1 | United States of America | A1 | |
| US2017126857A1 | United States of America | A1 | |
| US2017126858A1 | United States of America | A1 | |
| US2017126860A1 | United States of America | A1 | |
| US2017126861A1 | United States of America | A1 | |
| US2017126862A1 | United States of America | A1 | |
| US2017126863A1 | United States of America | A1 | |
| US2017126868A1 | United States of America | A1 | |
| US2017126870A1 | United States of America | A1 | |
| US2017126937A1 | United States of America | A1 | |
| US2017126971A1 | United States of America | A1 | |
| US2017126972A1 | United States of America | A1 | |
| US2017126979A1 | United States of America | A1 | |
| WO2017074879A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017074880A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017074881A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017074882A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075005A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075043A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075047A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075092A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075099A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075102A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075103A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075239A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2017075247A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2017075250A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2017075444A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075459A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075469A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075471A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075479A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075481A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075486A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075491A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075501A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017075511A1 | World Intellectual Property Organization (WIPO) | A1 | |
| TW201719265A | Taiwan Province of China | A | |
| TW201719267AThis record | Taiwan Province of China | A | |
| TW201719496A | Taiwan Province of China | A | |
| TW201719847A | Taiwan Province of China | A | |
| TW201719965A | Taiwan Province of China | A | |
| TW201720078A | Taiwan Province of China | A | |
| TW201720081A | Taiwan Province of China | A | |
| TW201720097A | Taiwan Province of China | A | |
| TW201720178A | Taiwan Province of China | A | |
| US2017163889A1 | United States of America | A1 | |
| US2017171448A1 | United States of America | A1 | |
| WO2017075250A3 | World Intellectual Property Organization (WIPO) | A3 | |
| TW201721273A | Taiwan Province of China | A | |
| TW201721342A | Taiwan Province of China | A | |
| TW201721343A | Taiwan Province of China | A | |
| TW201721582A | Taiwan Province of China | A | |
| TW201722127A | Taiwan Province of China | A | |
| TW201722135A | Taiwan Province of China | A | |
| WO2017075239A3 | World Intellectual Property Organization (WIPO) | A3 | |
| TW201724939A | Taiwan Province of China | A | |
| WO2017075247A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US9710689B2 | United States of America | B2 | |
| TW201727307A | Taiwan Province of China | A | |
| TW201727323A | Taiwan Province of China | A | |
| TW201727437A | Taiwan Province of China | A | |
| TW201727456A | Taiwan Province of China | A | |
| TW201727457A | Taiwan Province of China | A | |
| TW201727515A | Taiwan Province of China | A | |
| TW201728155A | Taiwan Province of China | A | |
| TW201728156A | Taiwan Province of China | A | |
| US9723114B2 | United States of America | B2 | |
| KR20170093192A | Republic of Korea | A | |
| US9736383B2 | United States of America | B2 | |
| US2017237884A1 | United States of America | A1 | |
| AU2016343749A1 | Australia | A1 | |
| US2017249271A1 | United States of America | A1 | |
| US2017251085A1 | United States of America | A1 | |
| US2017251086A1 | United States of America | A1 | |
| US2017251137A1 | United States of America | A1 | |
| WO2017075247A4 | World Intellectual Property Organization (WIPO) | A4 | |
| WO2017147134A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017147136A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017147184A1 | World Intellectual Property Organization (WIPO) | A1 |
Numbers
- Publication
- 201719267
- Publication, DOCDB
- 201719267
- Publication, EPODOC
- TW201719267
- Application
- 105135138
- Application, DOCDB
- 105135138
- Application, EPODOC
- TW20165135138
Titles3
- English
- Wide field of view camera for integration with mobile devices
- Chinese
- 用於與行動裝置整合的寬視場攝影機
- English
- A wide field of view camera for integration with a mobile device
Classification
- CPC, 30
- G02B13/06
- H04N5/23238
- H04N23/698
- G03B17/56
- G03B37/04
- H04N1/00307
- H04N2213/001
- H04N5/2254
- H04N13/239
- H04N5/2257
- H04N5/2258
- H04N13/243
- H04N5/2259
- H04N23/58
- H04N5/232
- H04N23/45
- H04N5/23206
- H04N23/661
- H04N5/23216
- H04N23/57
- H04N23/62
- H04N23/631
- G02B27/1066
- G06F3/04817
- H04N5/217
- H04N5/2253
- H04N23/54
- H04N23/81
- H04N5/232933
- H04N5/265
- IPC, 5
- G03B19 18
- H04N5 225
- H04N1 036
- H04N13 239
- H04N13 243