Far-Field Sensing for Rotation of Finger

CROSS-REFERENCE TO RELATED APPLICATIONS

0001This application is a continuation-in-part of U.S. patent application Ser. No. 13/843,457, filed Mar. 15, 2013, entitled “Far-Field Sensing for Rotation of Finger,” which claims the benefit under 37 C.F.R. §119(e) of U.S. Provisional Application No. 61/666,768, filed Jun. 29, 2012, entitled “Far-Field Sensing for Rotation of Finger,” the contents of both of which are incorporated by reference as if fully disclosed herein.

TECHNICAL FIELD

0002This application generally relates to fingerprint imaging and fingerprint sensors.

BACKGROUND

0003Fingerprint recognition systems provide for user authentication by collection of fingerprint images and comparing against a database of known fingerprint information. For example, after collecting and processing a set of fingerprint images for an authorized user, accessing users can be authorized by collecting additional fingerprint images, and comparing these additional images against the database.

0004Collecting fingerprint images, whether from an authorized user, an accessing user, or a new user, typically involves determining the angle at which the user's finger is oriented with respect to the fingerprint sensor. For example, if multiple images are collected at different times, or by different sensors, the relative orientations can be used to compare the different images with those in an authorized user database.

0005Similarly, when collecting and processing fingerprint images, the angle of a given user's fingerprint may be different from the orientation of the authorized fingerprint images. For example, when the accessing user fingerprint is being compared with a known fingerprint, it may be necessary to adjust the fingerprint image collected from the accessing user, so that it can be more easily compared with fingerprint information from the known authorized user (or with a group of known users).

0006Orientation of fingerprints can take substantial processing power, whether performed with respect to the fingerprint sensor, or with respect to a known fingerprint database. Finger orientation can also pose difficulties for sensor design, and orientation errors can introduce misalignment, mismatching and processing effects into the fingerprint image data.

0007Thus, there is a general need for improved fingerprint acquisition and authorization techniques, with greater processing efficiency and alignment capability. There is also a need for fingerprint enrollment and recognition systems that are robust to undesired failure modes exhibited by the prior art, and which provide additional utility and value across a wide range of different electronic devices and other applications.

SUMMARY

0008This application is directed to fingerprint imaging and image processing techniques, and electronic devices utilizing these techniques. Depending on application, the devices may utilize one or more fingerprint image sensors configured to provide fingerprint image data from a user. One or more orientation sensors can be disposed separately from the image sensor, and configured for determining an orientation of the use's finger from which the image information is provided.

0009Typically, one or more electronic circuits can be coupled to the imaging and orientation sensors, and configured for combining sensor information to determine the orientation of the user's finger, for example with respect to the electronic device. A processor can then be configured to generate an oriented fingerprint image, based on the fingerprint image data in combination with the sensed orientation.

0010Some electronic devices also include touch screen or other display component. In these examples, the orientation sensors can be disposed about the periphery of the display. Alternatively, the orientation sensors may be included in the touch screen

0011The orientation sensors may include far-field sensors, which are configured to sense the finger orientation at a distance of more than two millimeters, or more. For example, the far-field sensors may include capacitive sensors configured to sense the finger orientation at a distance of more than two centimeters.

0012In some configurations, the fingerprint sensor may be configured into a control device. A grounding ring may be disposed about the sensor, with gaps or notches configured to determine finger orientation based on differences in grounding strength.

0013Various processor components can be configured to produce individual oriented image swatches, based on the fingerprint image data and the orientation of the finger. Memory can be provided for storing the individual (e.g., oriented) image swatches, and to combine a plurality of swatches into a unified fingerprint image.

0014While multiple embodiments are disclosed, including variations thereof, still other embodiments of the present disclosure will become apparent to those skilled in the art from the following detailed description, which shows and describes illustrative embodiments of the disclosure. As will be realized, the disclosure is capable of modifications in various obvious aspects, all without departing from the spirit and scope of the present disclosure. Accordingly, the drawings and detailed description are to be regarded as illustrative in nature and not restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

0015While the specification concludes with claims particularly pointing out and distinctly claiming the subject matter that is regarded as forming the present disclosure, it is believed that the disclosure will be better understood from the following description taken in conjunction with the accompanying Figures, in which:

0016<figref idref="DRAWINGS">FIG. 1</figref> shows a conceptual drawing of communication between a touch I/O device and a computing system.

0017<figref idref="DRAWINGS">FIG. 2</figref> shows a conceptual drawing of a system including a fingerprint recognition device.

0018<figref idref="DRAWINGS">FIG. 3A</figref> shows a conceptual drawing of a first example fingerprint sensor and one or more orientation sensors included in a portion of a device, including a first orientation of a user's finger with respect to the touch I/O device.

0019<figref idref="DRAWINGS">FIG. 3B</figref> shows a conceptual drawing of a first example fingerprint sensor and one or more orientation sensors included in a portion of a device, including a second orientation of a user's finger with respect to the touch I/O device.

0020<figref idref="DRAWINGS">FIG. 3C</figref> shows a conceptual drawing of a first example fingerprint sensor and one or more orientation sensors included in a portion of a device, including a third orientation of a user's finger with respect to the touch I/O device.

0021<figref idref="DRAWINGS">FIG. 4</figref> shows a conceptual drawing of a second example fingerprint sensor and one or more orientation sensors included in a portion of a device.

0022<figref idref="DRAWINGS">FIG. 5</figref> shows a conceptual drawing of a fingerprint sensor assisted by one or more orientation sensors while receiving or processing a fingerprint image.

DETAILED DESCRIPTION

0023The present disclosure is directed to a fingerprint imaging system or apparatus, electronic devices including the system or apparatus, and methods for their use. The imaging system includes a fingerprint sensor configured to provide fingerprint image data for the finger of a user, and one or more (e.g., separately disposed) orientation sensors configured to determine an orientation of the finger.

0024Processing and circuits components are configured to combine information from the fingerprint sensor and orientation sensors, in order to determine the orientation of the finger with respect to the fingerprint sensor, and to generate an oriented fingerprint image based on the sensor data. In electronic device applications, the orientation sensors may be disposed about the perimeter of touch screen or other display, and the fingerprint sensor can be provided on or underneath a control button, for example with a separate grounding disposed about the button, in order to provide orientation information based on grounding.

0025The present disclosure recognizes that personal information data, including biometric data, in the present technology, can be used to the benefit of users. For example, the use of biometric authentication data can be used for convenient access to device features without the use of passwords. In other examples, user biometric data is collected for providing users with feedback about their health or fitness levels. Further, other uses for personal information data, including biometric data, that benefit the user are also contemplated by the present disclosure.

0026The present disclosure further contemplates that the entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure, including the use of data encryption and security methods that meets or exceeds industry or government standards. For example, personal information from users should be collected for legitimate and reasonable uses of the entity and not shared or sold outside of those legitimate uses. Further, such collection should occur only after receiving the informed consent of the users. Additionally, such entities would take any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices.

0027Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data, including biometric data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, in the case of biometric authentication methods, the present technology can be configured to allow users to optionally bypass biometric authentication steps by providing secure information such as passwords, personal identification numbers (PINS), touch gestures, or other authentication methods, alone or in combination, known to those of skill in the art. In another example, users can select to remove, disable, or restrict access to certain health-related applications collecting users' personal health or fitness data.

0028Fingerprint Sensor Device and System

0029<figref idref="DRAWINGS">FIG. 1</figref> shows a conceptual drawing of communication between a touch I/O device and a computing system.

0030<figref idref="DRAWINGS">FIG. 2</figref> shows a conceptual drawing of a system including a fingerprint recognition device.

0031Touch I/O device <b>1001</b> can receive touch input for interacting with computing system <b>1003</b> via wired or wireless communication channel <b>1002</b>. Touch I/O device <b>1001</b> may be used to provide user input to computing system <b>1003</b> in lieu of or in combination with other input devices such as a keyboard, mouse, etc. One or more touch I/O devices <b>1001</b> may also be used for providing user input to computing system <b>1003</b>. Touch I/O device <b>1001</b> may be an integral part of computing system <b>1003</b> (e.g., touch screen on a laptop) or may be separate from computing system <b>1003</b>.

0032For example, touch I/O device <b>1001</b> can interact with a user with the user touching the touch I/O device <b>1001</b> with the user's finger (or otherwise bringing the user's finger near to the touch I/O device <b>1001</b>), with the effect that the touch I/O device <b>1001</b> can receive fingerprint image data, and optionally provide feedback to the user that the fingerprint image data was received.

0033Touch I/O device <b>1001</b> may include a touch sensitive panel which is wholly or partially transparent, semitransparent, non-transparent, opaque or any combination thereof. Touch I/O device <b>1001</b> may be embodied as a touch screen, touch pad, a touch screen functioning as a touch pad (e.g., a touch screen replacing the touchpad of a laptop), a touch screen or touchpad combined or incorporated with any other input device (e.g., a touch screen or touchpad disposed on a keyboard) or any multi-dimensional object having a touch sensitive surface for receiving touch input.

0034In one example, touch I/O device <b>1001</b> embodied as a touch screen may include a transparent and/or semitransparent touch sensitive panel partially or wholly positioned over at least a portion of a display. According to this embodiment, touch I/O device <b>1001</b> functions to display graphical data transmitted from computing system <b>1003</b> (and/or another source) and also functions to receive user input. In other embodiments, touch I/O device <b>1001</b> may be embodied as an integrated touch screen where touch sensitive components/devices are integral with display components/devices. In still other embodiments a touch screen may be used as a supplemental or additional display screen for displaying supplemental or the same graphical data as a primary display and to receive touch input.

0035Touch I/O device <b>1001</b> may be configured to detect the location of one or more touches or near touches on device <b>1001</b> based on capacitive, resistive, optical, acoustic, inductive, mechanical, chemical measurements, or any phenomena that can be measured with respect to the occurrences of the one or more touches or near touches in proximity to device <b>1001</b>. Software, hardware, firmware or any combination thereof may be used to process the measurements of the detected touches to identify and track one or more gestures or fingerprints. A gesture or fingerprint may correspond to stationary or non-stationary, single or multiple, touches or near touches on touch I/O device <b>1001</b>. A gesture or fingerprint may be performed by moving one or more fingers or other objects in a particular manner on touch I/O device <b>1001</b> such as tapping, pressing, rocking, scrubbing, twisting, changing orientation, pressing with varying pressure and the like at essentially the same time, contiguously, or consecutively. A gesture or fingerprint may be characterized by, but is not limited to a pinching, sliding, swiping, rotating, flexing, dragging, or tapping motion between or with any other finger or fingers. A single gesture may be performed with one or more hands, by one or more users, or any combination thereof.

0036Computing system <b>1003</b> may drive a display with graphical data to display a graphical user interface (GUI). The GUI may be configured to receive touch input via touch I/O device <b>1001</b>. Embodied as a touch screen, touch I/O device <b>1001</b> may display the GUI. Alternatively, the GUI may be displayed on a display separate from touch I/O device <b>1001</b>. The GUI may include graphical elements displayed at particular locations within the interface. Graphical elements may include but are not limited to a variety of displayed virtual input devices including virtual scroll wheels, a virtual keyboard, virtual knobs, virtual buttons, any virtual UI, and the like. A user may perform gestures at one or more particular locations on touch I/O device <b>1001</b> which may be associated with the graphical elements of the GUI. In other embodiments, the user may perform gestures at one or more locations that are independent of the locations of graphical elements of the GUI. Gestures performed on touch I/O device <b>1001</b> may directly or indirectly manipulate, control, modify, move, actuate, initiate or generally affect graphical elements such as cursors, icons, media files, lists, text, all or portions of images, or the like within the GUI. For instance, in the case of a touch screen, a user may directly interact with a graphical element by performing a gesture over the graphical element on the touch screen. Alternatively, a touch pad generally provides indirect interaction. Gestures may also affect non-displayed GUI elements (e.g., causing user interfaces to appear) or may affect other actions within computing system <b>1003</b> (e.g., affect a state or mode of a GUI, application, or operating system). Gestures may or may not be performed on touch I/O device <b>1001</b> in conjunction with a displayed cursor. For instance, in the case in which gestures are performed on a touchpad, a cursor (or pointer) may be displayed on a display screen or touch screen and the cursor may be controlled via touch input on the touchpad to interact with graphical objects on the display screen. In other embodiments in which gestures are performed directly on a touch screen, a user may interact directly with objects on the touch screen, with or without a cursor or pointer being displayed on the touch screen.

0037Feedback may be provided to the user via communication channel <b>1002</b> in response to or based on the touch or near touches on touch I/O device <b>1001</b>. Feedback may be transmitted optically, mechanically, electrically, olfactory, acoustically, or the like or any combination thereof and in a variable or non-variable manner. For example, feedback can include interaction with a user indicating (A) that one or more sets of fingerprint image information have been received, (B) that one or more sets of fingerprint image information have been enrolled in a database, (C) that one or more sets of fingerprint image information have been confirmed as associated with the user, or otherwise.

0038Attention is now directed towards embodiments of a system architecture that may be embodied within any portable or non-portable device including but not limited to a communication device (e.g. mobile phone, smart phone), a multi-media device (e.g., MP3 player, TV, radio), a portable or handheld computer (e.g., tablet, netbook, laptop), a desktop computer, an All-In-One desktop, a peripheral device, or any other system or device adaptable to the inclusion of system architecture <b>2000</b>, including combinations of two or more of these types of devices. A block diagram of one embodiment of system <b>2000</b> can generally include one or more computer-readable mediums <b>2001</b>, processing system <b>2004</b>, Input/Output (I/O) subsystem <b>2006</b>, radio frequency (RF) or other electromagnetic (EMF) circuitry <b>2008</b> and audio circuitry <b>2010</b>. These components may be coupled by one or more communication buses or signal lines <b>2003</b>. Each such bus or signal line may be denoted in the form <b>2003</b>-X, where X is a unique number. The bus or signal line may carry data of the appropriate type between components; each bus or signal line may differ from other buses/lines, but may perform generally similar operations.

0039It should be apparent that the architecture shown in the figure is only one example architecture of system <b>2000</b>, and that system <b>2000</b> could have more or fewer components than shown, or a different configuration of components. The various components shown in the figure can be implemented in hardware, software, firmware or any combination thereof, including one or more signal processing and/or application specific integrated circuits.

0040RF circuitry <b>2008</b> is used to send and receive information over a wireless link or network to one or more other devices and includes well-known circuitry for performing this function. RF circuitry <b>2008</b> and audio circuitry <b>2010</b> are coupled to processing system <b>2004</b> via peripherals interface <b>2016</b>. Interface <b>2016</b> includes various known components for establishing and maintaining communication between peripherals and processing system <b>2004</b>. Audio circuitry <b>2010</b> is coupled to audio speaker <b>2050</b> and microphone <b>2052</b> and includes known circuitry for processing voice signals received from interface <b>2016</b> to enable a user to communicate in real-time with other users. In some embodiments, audio circuitry <b>2010</b> includes a headphone jack (not shown).

0041Peripherals interface <b>2016</b> couples the input and output peripherals of the system to processor <b>2018</b> and computer-readable medium <b>2001</b>. One or more processors <b>2018</b> communicate with one or more computer-readable mediums <b>2001</b> via controller <b>2020</b>. Computer-readable medium <b>2001</b> can be any device or medium that can store code and/or data for use by one or more processors <b>2018</b>. Medium <b>2001</b> can include a memory hierarchy, including but not limited to cache, main memory and secondary memory. The memory hierarchy can be implemented using any combination of RAM (e.g., SRAM, DRAM, DDRAM), ROM, FLASH, magnetic and/or optical storage devices, such as disk drives, magnetic tape, CDs (compact disks) and DVDs (digital video discs). Medium <b>2001</b> may also include a transmission medium for carrying information-bearing signals indicative of computer instructions or data (with or without a carrier wave upon which the signals are modulated, or any other form of signal modulation). For example, the transmission medium may include a communications network, including but not limited to the Internet (also referred to as the World Wide Web), intranet(s), Local Area Networks (LANs), Wide Local Area Networks (WLANs), Storage Area Networks (SANs), Metropolitan Area Networks (MAN) and the like.

0042One or more processors <b>2018</b> can execute, run or interpret various software components stored in medium <b>2001</b> to perform various functions for system <b>2000</b>. In some embodiments, the software components include operating system <b>2022</b>, communication module (or set of instructions) <b>2024</b>, touch processing module (or set of instructions) <b>2026</b>, graphics module (or set of instructions) <b>2028</b>, one or more applications (or set of instructions) <b>2030</b>, and fingerprint sensing module (or set of instructions) <b>2038</b>. Each of these modules and above noted applications correspond to a set of instructions for performing one or more functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise rearranged in various embodiments. In some embodiments, medium <b>2001</b> may store a subset of the modules and data structures identified above. Furthermore, medium <b>2001</b> may store additional modules and data structures not described above.

0043Operating system <b>2022</b> includes various procedures, sets of instructions, software components and/or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

0044Communication module <b>2024</b> facilitates communication with other devices over one or more external ports <b>2036</b> or via RF circuitry <b>2008</b> and includes various software components for handling data received from RF circuitry <b>2008</b> and/or external port <b>2036</b>.

0045Graphics module <b>2028</b> includes various known software components for rendering, animating and displaying graphical objects on a display surface. In embodiments in which touch I/O device <b>2012</b> is a touch sensitive display (e.g., touch screen), graphics module <b>2028</b> can include components for rendering, displaying, and animating objects on the touch sensitive display.

0046One or more applications <b>2030</b> can include any applications installed on system <b>2000</b>, including without limitation, a browser, address book, contact list, email, instant messaging, word processing, keyboard emulation, widgets, JAVA-enabled applications, encryption, digital rights management, voice recognition, voice replication, location determination capability (such as that provided by the global positioning system (GPS) or other positioning systems), a music player, etc.

0047Touch processing module <b>2026</b> includes various software components for performing various tasks associated with touch I/O device <b>2012</b> including but not limited to receiving and processing touch input received from I/O device <b>2012</b> via touch I/O device controller <b>2032</b>.

0048System <b>2000</b> may further include fingerprint sensing module <b>2038</b> for performing the method/functions as described herein in connection with <figref idref="DRAWINGS">FIGS. 1-4</figref>. Fingerprint sensing module <b>2038</b> may at least be executed to, or otherwise function to, perform various tasks associated with the fingerprint sensor, such as receiving and processing fingerprint sensor input. The fingerprint sensing module <b>2038</b> may also control certain operational aspects of the fingerprint sensor <b>2042</b>, such as its capture of fingerprint data and/or transmission of the same to the processor <b>2018</b> and/or secure processor <b>2040</b>. Module <b>2038</b> may also interact with the touch I/O device <b>2012</b>, graphics module <b>2028</b> or other graphical display. Module <b>2038</b> may be embodied as hardware, software, firmware, or any combination thereof. Although module <b>2038</b> is shown to reside within medium <b>2001</b>, all or portions of module <b>2038</b> may be embodied within other components within system <b>2000</b> or may be wholly embodied as a separate component within system <b>2000</b>.

0049I/O subsystem <b>2006</b> is coupled to touch I/O device <b>2012</b> and one or more other I/O devices <b>2014</b> for controlling or performing various functions. Touch I/O device <b>2012</b> communicates with processing system <b>2004</b> via touch I/O device controller <b>2032</b>, which includes various components for processing user touch input (e.g., scanning hardware). One or more other input controllers <b>2034</b> receives/sends electrical signals from/to other I/O devices <b>2014</b>. Other I/O devices <b>2014</b> may include physical buttons, dials, slider switches, sticks, keyboards, touch pads, additional display screens, or any combination thereof.

0050If embodied as a touch screen, touch I/O device <b>2012</b> displays visual output to the user in a GUI. The visual output may include text, graphics, video, and any combination thereof. Some or all of the visual output may correspond to user-interface objects. Touch I/O device <b>2012</b> forms a touch-sensitive surface that accepts touch input from the user. Touch I/O device <b>2012</b> and touch screen controller <b>2032</b> (along with any associated modules and/or sets of instructions in medium <b>2001</b>) detects and tracks touches or near touches (and any movement or release of the touch) on touch I/O device <b>2012</b> and converts the detected touch input into interaction with graphical objects, such as one or more user-interface objects. In the case in which device <b>2012</b> is embodied as a touch screen, the user can directly interact with graphical objects that are displayed on the touch screen. Alternatively, in the case in which device <b>2012</b> is embodied as a touch device other than a touch screen (e.g., a touch pad), the user may indirectly interact with graphical objects that are displayed on a separate display screen embodied as I/O device <b>2014</b>.

0051Touch I/O device <b>2012</b> may include technologies analogous to the multi-touch surfaces described in the following U.S. Pat. No.: 6,323,846 (Westerman et al.), U.S. Pat. No. 6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932 (Westerman), and/or U.S. Patent Publication 2002/0015024A1, each of which is hereby incorporated by reference.

0052In embodiments in which touch I/O device <b>2012</b> is a touch screen, the touch screen may use LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, OLED (organic LED), or OEL (organic electro luminescence), although other display technologies may be used in other embodiments.

0053Feedback may be provided by touch I/O device <b>2012</b> based on the user's touch input as well as a state or states of what is being displayed and/or of the computing system. Feedback may be transmitted optically (e.g., light signal or displayed image), mechanically (e.g., haptic feedback, touch feedback, force feedback, or the like), electrically (e.g., electrical stimulation), olfactory, acoustically (e.g., beep or the like), or the like or any combination thereof and in a variable or non-variable manner.

0054System <b>2000</b> also includes power system <b>2044</b> for powering the various hardware components and may include a power management system, one or more power sources, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator and any other components typically associated with the generation, management and distribution of power in portable devices.

0055In some embodiments, peripherals interface <b>2016</b>, one or more processors <b>2018</b>, and memory controller <b>2020</b> may be implemented on a single chip, such as processing system <b>2004</b>. In some other embodiments, they may be implemented on separate chips.

0056In addition to the foregoing, the system <b>2000</b> may include a secure processor <b>2040</b> in communication with a fingerprint sensor <b>2042</b>, via a fingerprint I/O controller <b>2043</b>. Secure processor <b>2040</b> may be implemented as one or more processing units. The operation of these various elements will now be described.

0057The fingerprint sensor <b>2042</b> may operate to capacitively capture a series of images, or nodes. When taken together, these nodes may form a set of fingerprint image information. A collection of nodes may be referred to herein as a “mesh”, “mosaic”, “template”, or other indicator of fingerprint information.

0058Each node of fingerprint information may be separately captured by the fingerprint sensor <b>2042</b>, which may be an array sensor. Generally, there can be some overlap between images in nodes representing adjacent or nearby portions of a fingerprint. Such overlap may assist in assembling the fingerprint from the nodes, as various image recognition techniques may be employed to use the overlap to properly identify and/or align adjacent nodes in the fingerprint information.

0059Sensed fingerprint data may be transmitted through the fingerprint I/O controller <b>2043</b> to the processor <b>2018</b> and/or the secure processor <b>2040</b>. In some embodiments, the data is relayed from the fingerprint I/O controller <b>2043</b> to the secure processor <b>2040</b> directly. The fingerprint data is encrypted, obfuscated, or otherwise prevented from being accessed by an unauthorized device or element, by any of the fingerprint sensor <b>2042</b>, the fingerprint I/O controller <b>2043</b> or another element prior to being transmitted to either processor. The secure processor <b>2040</b> may decrypt the data to reconstruct the node. In some embodiments, unencrypted data may be transmitted directly to the secure processor <b>2040</b> from the fingerprint controller <b>2043</b> (or the sensor <b>2042</b> if no controller is present). The secure processor may then encrypt this data.

0060Fingerprint data, either as individual nodes, collections of nodes, or substantially complete fingerprint templates, may be stored in the computer-readable medium <b>2001</b> and accessed as necessary. In some embodiments, only the secure processor <b>2040</b> may access stored fingerprint data, while in other embodiments either the secure processor or the processor <b>2018</b> may access such data.

0061Fingerprint Sensor Including Orientation Sensors

0062<figref idref="DRAWINGS">FIG. 3A</figref> shows a conceptual drawing of an exemplary fingerprint sensor <b>2042</b> and one or more orientation sensors <b>2102</b> included in a portion of a device <b>2100</b>, including a first orientation of a user's finger <b>2104</b> with respect to the capacitive touch screen or other touch I/O device <b>2012</b>.

0063<figref idref="DRAWINGS">FIG. 3B</figref> shows a conceptual drawing of an exemplary fingerprint sensor <b>2042</b> with one or more orientation sensors <b>2102</b> included in a portion of a device <b>2100</b>, including a second orientation of a user's finger <b>2104</b> with respect to the touch I/O device <b>2012</b>.

0064<figref idref="DRAWINGS">FIG. 3C</figref> shows a conceptual drawing of an exemplary fingerprint sensor <b>2042</b> with one or more orientation sensors <b>2102</b> included in a portion of a device <b>2100</b>, including a third orientation of a user's finger <b>2104</b> with respect to the touch I/O device <b>2012</b>.

0065A device <b>2100</b>, such as a smart phone or a tablet computer, includes a fingerprint sensor <b>2042</b>, on or near which the user places their finger <b>2104</b>, with the effect that the fingerprint sensor <b>2042</b> can receive one or more fingerprint images. In one embodiment, the fingerprint sensor <b>2042</b> optionally includes the touch I/O device <b>2012</b> described herein, and further optionally includes one or more processing units, such as the processor <b>2018</b> and the secure processor <b>2040</b> described herein. Moreover, the fingerprint sensor <b>2042</b> can include, or have access to, memory or storage in which it can maintain and manipulate fingerprint information, such as one or more databases of fingerprint information which can be used to manipulate and compare fingerprint information, as described herein.

0066In one embodiment, the touch I/O device <b>2012</b> includes one or more orientation sensors <b>2102</b>. The orientation sensors can be disposed in one or more optional locations about the touch I/O device <b>2012</b>.

0067For a first example, the one or more orientation sensors <b>2102</b> can be disposed about a rim of the device <b>2100</b>, with the effect of generally surrounding the fingerprint sensor <b>2042</b>. This has the effect that the one or more orientation sensors can each provide at least some information regarding an orientation of the user's finger <b>2104</b> with respect to the fingerprint sensor <b>2042</b>. For a second example, the one or more orientation sensors <b>2102</b> can be disposed in other locations, such as in a pattern on the face of the device <b>2100</b>, or on the back of the device <b>2100</b>, or on one or more sides of the device <b>2100</b>. More generally, the one or more orientation sensors <b>2102</b> can include any sensor for proximity which is located outside of the fingerprint sensor device <b>2042</b> itself, such as outside a button or touch button <b>2106</b>, under which the fingerprint sensor <b>2042</b> is located.

0068In one embodiment, the one or more orientation sensors <b>2102</b> can provide information with respect to orientation of one or more fingerprint images (or swatches thereof). Depending upon the number of orientation sensors <b>2102</b>, the search space for the orientation of one or more fingerprint images (or swatches thereof) can be reduced to a limit of plus or minus 20 degrees, approximately. For example, if there are more such orientation sensors <b>2102</b>, the search space for the orientation of one or more fingerprint images can be reduced to a limit which is relatively lesser, while if there are fewer such orientation sensors <b>2102</b>, the search space for the orientation of one or more fingerprint images can be reduced to a limit which is relatively larger.

0069In one embodiment, the one or more orientation sensors <b>2102</b> can include capacitive sensors, with the effect that, when the user's finger <b>2104</b> is oriented at a first angle with respect to the fingerprint sensor <b>2042</b>, the capacitive sensors will each provide information regarding a measure of distance of the user's finger <b>2042</b> from each such capacitive sensor. For example, the capacitive sensors can include self-capacitive sensors, with the effect of being able to determine whether the user's finger <b>2042</b> is hovering above those sensors. This has the effect that a processing unit can determine an angle at which the user's finger <b>2104</b> is presented with respect to the fingerprint sensor <b>2042</b>.

0070More specifically, the one or more orientation sensors <b>2102</b> can include capacitive far-field sensors, with the effect that the one or more orientation sensors <b>2102</b> can provide signals with respect to the user's finger <b>21204</b> (or fingers <b>2104</b>, or hand <b>2108</b>) relatively distantly from signals that might have been provided by the fingerprint sensor <b>2042</b> or the touch I/O screen <b>2012</b>. For example, in some embodiments, the signals provided by the touch I/O screen <b>2012</b> would not be effective more than a few millimeters away from the touch I/O screen <b>2012</b>. Similarly, if the touch I/O screen <b>2012</b> is turned off, it would not be providing touch information with respect to the user's fingers.

0071In one embodiment, this has the effect that the capacitive far-field sensors operate as relatively longer-range capacitive sensors. For example, the capacitive far-field sensors can be disposed about the edge or rim of the device <b>2100</b>, with the effect that the orientation of the user's finger <b>2104</b> can be sensed by one or more capacitive far-field sensors even when the user's finger <b>2104</b> is more than several millimeters (and possibly even several centimeters) from the one or more capacitive far-field sensors.

0072For example, the capacitive far-field sensors can include capacitive hover sensors, with the effect that the orientation sensors <b>2102</b> can operate to determine an orientation of the user's finger <b>2104</b>, whether or not the user's finger <b>2104</b> is actually touching those sensors.

0073More specifically, when the user's finger <b>2104</b> is presented at a particular angle with respect to the fingerprint sensor <b>2042</b> (such as for example with an axis of the user's finger <b>2104</b> at a right angle with respect to an edge of the touch I/O device <b>2012</b>), the one or more orientation sensors <b>2102</b> can each provide information indicating a distance from each particular orientation sensor <b>2102</b> to the user's finger <b>2104</b>. From this information, a processing unit can determine at what angle the axis of the user's finger <b>2104</b> is presented with respect to the edge of the touch I/O device <b>2012</b>. This has the effect that a processing unit can determine a relative orientation of any fingerprint image information received with respect to the user's finger <b>2104</b> when the user's finger <b>2104</b> is presented in that particular orientation.

0074For a first example, <figref idref="DRAWINGS">FIG. 3A</figref> shows the user's finger <b>2104</b> oriented at an angle close to a right angle with respect to an edge of the touch I/O device <b>2012</b>. This has the effect that the one or more orientation sensors <b>2102</b> disposed near the user's finger <b>2104</b> can provide information showing that the user's finger <b>2104</b> does not cross any second edge of the touch I/O device <b>2012</b>, and further, that the one or more orientation sensors <b>2102</b> disposed near the user's finger <b>2104</b> can provide information showing the approximate angle at which the user's finger <b>2104</b> is oriented with respect to the fingerprint sensor <b>2042</b>.

0075For a second example, <figref idref="DRAWINGS">FIG. 3B</figref> shows the user's finger <b>2104</b> oriented at angle sufficiently distant from a right angle with respect to an edge of touch I/O device <b>2012</b>, that the user's finger <b>2104</b> also crosses a second edge of the touch I/O device <b>2012</b>. This has the effect that the one or more orientation sensors <b>2102</b> disposed near the user's finger <b>2104</b> can provide information showing that the user's finger <b>2104</b> does indeed cross at least one additional edge of the touch I/O device <b>2012</b>, and further that the one or more orientation sensors <b>2102</b> disposed near the user's finger <b>2104</b> can provide information showing the approximate angle at which the user's finger <b>2104</b> is oriented with respect to the fingerprint sensor <b>2042</b>.

0076For a third example, <figref idref="DRAWINGS">FIG. 3C</figref> shows the user's finger <b>2104</b> oriented an angle sufficiently distant from a right angle with respect to an edge of touch I/O device <b>2012</b>, that both the user's finger <b>2104</b> disposed on the fingerprint sensor, and other user's fingers <b>2104</b> are also disposed near to one or more orientation sensors <b>2102</b>. This has the effect that the one or more orientation sensors <b>2102</b> disposed near the user's finger <b>2104</b> can provide information showing that the user's finger <b>2104</b> does indeed cross at least one additional edge of the touch I/O device <b>2012</b>, and further, that more than one such user's finger <b>2104</b> can be sensed by one or more orientation sensors <b>2102</b>.

0077In such cases, the one or more orientation sensors <b>2102</b> providing information regarding additional user's fingers <b>2104</b> can indicate a location and orientation each of those additional user's fingers <b>2104</b>, with the effect that a processing unit can determine a location and orientation of the user's hand <b>2108</b> (with concomitant information about a location and orientation of the user's finger <b>2104</b> for which fingerprint image data is being received).

0078In one embodiment, the orientation sensors <b>2102</b> include far-field capacitive sensors, capable of determining distance information with respect to one or more of the user's fingers <b>2104</b>, such as using capacitive sense technology. In such cases, the orientation sensors <b>2102</b> need not have sufficiently accurate sense technology as to obtain sufficient detail to determine fingerprint image data. They need merely have sufficiently accurate sense technology as to determine a measure of distance, and measure orientation, or another measure suitable for similar purposes, with respect to one or more of the user's fingers <b>2104</b>.

0079In the context of the invention, there is no particular requirement for any such limitation as described in such embodiments. For example, the orientation sensors <b>2102</b> might include optical sensors, infrared sensors, ultrasonic sensors, resistive sensors or other sensors responsive to EMF effects, strain gauges, temperature sensors, or any other type of sensor suitable to achieve the effects described herein with respect to such sensors. Moreover, the orientation sensors <b>2102</b> might include capabilities for determining, in lieu of or in addition to distance, a surface angle or other indicator of directionality with respect to one or more of the user's fingers <b>2104</b>.

0080For example, in embodiments in which the orientation sensors <b>2102</b> include optical sensors or infrared sensors, the orientation sensors <b>2102</b> could be used to obtain a picture of the user's finger <b>2104</b>. Having obtained a picture of the user's finger <b>2104</b>, the orientation sensors <b>2102</b> can use edge detection to determine an orientation of the user's finger <b>2104</b>.

0081<figref idref="DRAWINGS">FIG. 4</figref> shows a conceptual drawing of a second example fingerprint sensor <b>2042</b> and one or more orientation sensors <b>2102</b> included in a frame <b>2103</b> or other portion of a device <b>2100</b>.

0082In one embodiment, the touch I/O device <b>2012</b> includes one or more orientation sensors <b>2102</b>, and optionally includes a capacitive touch screen as part of the touch I/O device <b>1001</b>, with the effect that the capacitive touch screen can determine information with respect to one or more of location and orientation information with respect to one or more of the user's fingers <b>2104</b>. For example, the capacitive touch screen might be capable of determining a proximity of one or more of the user's fingers <b>2104</b>, from which information can be determined (such as by the processor <b>2018</b>, the secure processor <b>2040</b> or any other processing unit) regarding a location or orientation of the user's hand <b>2108</b>, and regarding an orientation of the user's finger <b>2104</b> from which a fingerprint image is received.

0083In one embodiment, the touch I/O device <b>2012</b> uses a processing unit to receive information from the orientation sensors <b>2102</b>, and optionally from the capacitive touch screen, from which a processing unit can determine information as described above, from which a processing unit can determine an orientation of the user's finger <b>2104</b> from which a fingerprint image is received.

0084In one embodiment, the touch I/O device <b>2012</b> includes a touch button <b>2106</b> surrounded by a grounding ring <b>2110</b>, with the effect that the grounding ring <b>2110</b> eliminates extraneous EMF effects other than the capacitive effect between the fingerprint sensor <b>2042</b> and the user's fingerprint. In one embodiment, the grounding ring <b>2110</b> includes a notched circular ring <b>2110</b>, such as a relatively circular ring with one or more gaps defined thereby, with the effect that a strongest grounding path can be determined with respect to the relatively circular ring <b>2110</b>. For example, the touch I/O device <b>2012</b> can include a differential amplifier between adjacent notches of the notched circular ring <b>2110</b>, with the effect that relatively small differences in grounding strength between individual elements of the notched grounding ring <b>2110</b> can be determined in response to an orientation of the user's finger <b>2104</b>.

0085<figref idref="DRAWINGS">FIG. 5</figref> shows a conceptual drawing of a fingerprint sensor assisted by one or more orientation sensors while receiving or processing a fingerprint image.

0086In one embodiment, the touch I/O device <b>2012</b> includes a secure processor <b>2040</b>, and includes, or has access to, a memory or storage device <b>2200</b>, with the effect that the secure processor <b>2040</b> can maintain and manipulate fingerprint image data, along with associated orientation information. In alternative embodiments, any processing unit may access the memory or storage device <b>2200</b>.

0087In one embodiment, each database of fingerprint information can include a set of fingerprint image data, which can include a set of fingerprint image data, such as may be received from interacting with a fingerprint sensor associated with the touch I/O device <b>2012</b> described herein. For example, each set of fingerprint image data be captured by the fingerprint sensor and maintained in memory or storage included with or accessible to a processing unit.

0088In one embodiment, it is possible that the fingerprint sensor is not large enough to capture an entire fingerprint at once, and can only capture a swatch <b>2202</b> of that fingerprint image. For example, it might occur that only one or more individual image swatches <b>2202</b> of the user's fingerprint image are captured by the fingerprint sensor, rather than an entire fingerprint image. In one embodiment, whether an entire fingerprint image, or a swatch of a fingerprint image is received, the fingerprint image (or swatch thereof) is associated with orientation information, as the latter is received from one or more orientation sensors. In such cases, receiving orientation information from one or more orientation sensors is intended to include both those orientation sensors which are specifically disposed for obtaining orientation information, and any orientation information which might be gleaned from the capacitive touch screen of the touch I/O device <b>2012</b>.

0089In one embodiment, the secure processor <b>2040</b> associates the received (or optionally, calculated) orientation information <b>2204</b> with the fingerprint image information (or swatch thereof). The secure processor <b>2040</b> manipulates the fingerprint image information (or swatch thereof), with the effect of producing an oriented image swatch <b>2206</b>. The secure processor <b>2040</b> can combine a first oriented image swatch <b>2206</b> with a second oriented image swatch <b>2206</b> to provide a combined data structure of collected swatch information <b>2208</b>.

0090In alternative embodiments, the secure processor <b>2040</b> can associate the received (or optionally, calculated) orientation information with the fingerprint image information, to provide an oriented fingerprint image. The secure processor <b>2040</b> can combine a first oriented fingerprint image with a second oriented fingerprint image to provide a combined data structure representing a unified fingerprint image. For example, in one such case, the secure processor <b>2040</b> can combine a first oriented fingerprint image with a second oriented fingerprint image to provide a combined data structure representing a unified fingerprint image, such as a combined fingerprint image including data from both the first oriented fingerprint image and the second oriented fingerprint image. In other embodiments, any processing unit may perform any of the operations discussed above.

Alternative Embodiments

0091After reading this application, those skilled in the art would recognize that combining fingerprint image information (or swatches thereof) with associated orientation information is responsive to, and transformative of, real-world data such as fingerprint image data received from a user's fingerprint, and provides a useful and tangible result in the service of enrolling and comparing fingerprints in a biometric security context. Moreover, after reading this application, those skilled in the art would recognize that processing of fingerprint data by a computing device includes substantial computer control and programming, involves substantial records of fingerprint information, and involves interaction with fingerprint sensing hardware and optionally a user interface for fingerprint enrollment and authentication.

0092Certain aspects of the embodiments described in the present disclosure may be provided as a computer program product, or software, that may include, for example, a computer-readable storage medium or a non-transitory machine-readable medium having stored thereon instructions, which may be used to program a computer system (or other electronic devices) to perform a process according to the present disclosure. A non-transitory machine-readable medium includes any mechanism for storing information in a form (e.g., software, processing application) readable by a machine (e.g., a computer). The non-transitory machine-readable medium may take the form of, but is not limited to, a magnetic storage medium (e.g., floppy diskette, video cassette, and so on); optical storage medium (e.g., CD-ROM); magneto-optical storage medium; read only memory (ROM); random access memory (RAM); erasable programmable memory (e.g., EPROM and EEPROM); flash memory; and so on.

0093While the present disclosure has been described with reference to various embodiments, it will be understood that these embodiments are illustrative and that the scope of the disclosure is not limited to them. Many variations, modifications, additions, and improvements are possible. More generally, embodiments in accordance with the present disclosure have been described in the context of particular embodiments. Functionality may be separated or combined in procedures differently in various embodiments of the disclosure or described with different terminology. These and other variations, modifications, additions, and improvements may fall within the scope of the disclosure as defined in the claims that follow.