Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs
22 claims: 5 independent, 17 dependent
- 1方法であって、 1つ以上のバイオメトリックセンサとディスプレイとを有する電子デバイスにおいて、 前記電子デバイスがロック状態である間に、前記1つ以上のバイオメトリックセンサを用いてバイオメトリック認証チェックを実行することに関連付けられた条件を検出することと、 前記条件を検出したことに応じて、第1のバイオメトリック認証チェックを実行することであって、 前記1つ以上のバイオメトリックセンサを用いて第1のバイオメトリックデータをキャプチャすることと、 前記第1のバイオメトリックデータをキャプチャした後に、 前記第1のバイオメトリックデータがバイオメトリック認証基準を満たすとの判定に従って、前記電子デバイスを前記ロック状態からロック解除状態に遷移させることと、 前記第1のバイオメトリックデータが前記バイオメトリック認証基準を満たさないとの判定に従って、前記電子デバイスを前記ロック状態に維持することとを含む、実行することと、 前記第1のバイオメトリック認証チェックを実行した後に、前記電子デバイスを介して、ユーザからの更なる認証情報を受け付けること無く個別の動作を実行する要求を検出することと、 前記個別の動作を実行する前記要求を検出したことに応じて、 前記個別の動作が認証を要しないとの判定に従って、前記個別の動作を実行することと、 前記個別の動作が認証を要し且つ前記電子デバイスが前記ロック解除状態であるとの判定に従って、前記個別の動作を実行することと、 前記個別の動作が認証を要し且つ、前記第1のバイオメトリックデータが前記バイオメトリック認証基準を満たすことに失敗した結果として前記電子デバイスが前記ロック状態であるとの判定に従って、 前記1つ以上のバイオメトリックセンサを用いて第2のバイオメトリックデータをキャプチャすることと、 前記第2のバイオメトリックデータをキャプチャした後に、第2のバイオメトリック認証チェックを実行することであって、 前記第2のバイオメトリックデータが前記バイオメトリック認証基準を満たすとの判定に従って、前記個別の動作を実行することと、 前記第2のバイオメトリックデータが前記バイオメトリック認証基準を満たさないとの判定に従って、前記個別の動作を実行しないようにすることとを含む、実行することと、を含む方法。
- 2請求項1に記載の方法であって、前記電子デバイスを介して、前記ユーザからの更なる認証情報を受け付けること無く個別の動作を実行する前記要求を検出することは、前記電子デバイスが前記ロック状態のときに表示可能でないコンテンツを表示する要求を検出することを含む、方法。
- 3請求項1又は2に記載の方法であって、前記電子デバイスは、成功する認証無しに所定の数より多くのバイオメトリック認証チェックを実行することが制限される、方法。
- 4請求項3に記載の方法であって、前記電子デバイスは、前記個別の動作を実行する前記要求を検出したことに応じた使用のために少なくとも1回のバイオメトリック認証チェックを残しておくために、前記条件を検出したことに応じて前記所定の数より少ないバイオメトリック認証チェックを実行する、方法。
- 5請求項1から4のいずれか1項に記載の方法であって、前記1つ以上のバイオメトリックセンサを用いて前記バイオメトリック認証チェックを実行することに関連付けられた条件を検出することは、 前記電子デバイスの前記ディスプレイが非表示である間に、ディスプレイ起動条件を検出することを含む、方法。
- 6請求項1から5のいずれか1項に記載の方法であって、更に、 前記個別の動作を実行する前記要求を検出したことに応じて、且つ前記個別の動作が認証を要する及び前記電子デバイスが前記ロック状態であるとの判定に従って、非バイオメトリック認証を提供するための1つ以上のユーザインタフェースオブジェクトを含む他の認証インタフェースを表示することを含む、方法。
- 7請求項1から6のいずれか1項に記載の方法であって、更に、 前記個別の動作を実行する前記要求を検出したことに応じて、且つ前記個別の動作が認証を要する及び前記電子デバイスが前記ロック状態であるとの判定に従って、認証の他の形態に進むオプションを表示すること無く、バイオメトリック認証のための認証表示を表示することを含む、方法。
- 8請求項1から7のいずれか1項に記載の方法であって、更に、 前記第2のバイオメトリック認証チェックは、非バイオメトリック認証を提供するための1つ以上のユーザインタフェースオブジェクトを含む他の認証インタフェースを表示している間に実行され、 前記バイオメトリック認証基準は、前記バイオメトリック認証基準が満たされるための、前記他の認証インタフェースを用いる認証が未だ開始されていないことの要件を含む、方法。
- 9請求項1から8のいずれか1項に記載の方法であって、前記第2のバイオメトリック認証チェックを実行することは、非バイオメトリック認証を提供するための1つ以上のユーザインタフェースオブジェクトを含む他の認証インタフェースを表示している間に、前記第2のバイオメトリック認証チェックの少なくとも一部を実行することを含む、方法。
- 10請求項1から9のいずれか1項に記載の方法であって、更に、 非バイオメトリック認証を提供するための1つ以上のユーザインタフェースオブジェクトを含む他の認証インタフェースを表示している間に、前記バイオメトリック認証基準が満たされたと判定することと、 前記バイオメトリック認証基準が満たされたと判定したことに応じて、前記個別の動作を実行することと、を含む方法。
- 11請求項1から10のいずれか1項に記載の方法であって、更に、 前記電子デバイスが前記ロック状態である間に前記個別の動作を実行する前記要求を検出したことに応じて、前記第2のバイオメトリックデータが前記バイオメトリック認証基準を満たさないとの判定に従って前記電子デバイスを前記ロック状態に維持することを含む、方法。
- 12請求項1から11のいずれか1項に記載の方法であって、個別の動作を実行する前記要求は、 通知の選択と、 スワイプジェスチャと、 所定の態様での前記電子デバイスの動きと、 アフォーダンスの選択と、の少なくとも1つを含む、方法。
- 13請求項1から12のいずれか1項に記載の方法であって、更に、 前記電子デバイスがロック状態である間に、認証を要しない動作を実行する要求を受け付けることと、 認証を要しない前記動作を実行する前記要求に応じて、認証を待つこと無く前記動作を実行することと、を含む方法。
- 14請求項1から13のいずれか1項に記載の方法であって、更に、 前記第1のバイオメトリック認証チェックを実行している間に、前記ユーザから更なる認証情報を受け付けること無く第2の動作を実行する第2の要求を受け付けることと、 前記第2の動作を実行する前記第2の要求を受け付けたことに応じて、 前記第1のバイオメトリックデータが前記バイオメトリック認証基準を満たさないと判定した後に前記第2の動作を実行する前記第2の要求を受け付けたとの判定に従って、他の認証インタフェースを表示することと、 前記第1のバイオメトリックデータを評価する前に前記第2の動作を実行する前記第2の要求を受け付けたとの判定に従って、前記他の認証インタフェースを表示すること無く、バイオメトリック認証をしようとする表示を含むバイオメトリック認証インジケータを表示することと、を含む方法。
- 15請求項14に記載の方法であって、前記第1のバイオメトリックデータを評価する前に前記第2の動作を実行する前記第2の要求を受け付けたとの判定に従って前記第2の動作を実行する前記第2の要求を受け付けたことに応じて表示される前記バイオメトリック認証インジケータは、通知に関連付けられるアプリケーションの表示を含む、方法。
- 16請求項1から15のいずれか1項に記載の方法であって、更に、 前記個別の動作を実行する前記要求を検出したことに応じて、前記第2のバイオメトリックデータが前記バイオメトリック認証基準を満たさないとの判定に従って、他の認証ユーザインタフェースを表示することと、 前記他の認証ユーザインタフェースを表示している間に、前記他の認証ユーザインタフェースに対応する他の認証試行を検出することと、 前記他の認証ユーザインタフェースに対応する前記他の認証試行を検出したことに応じて、 前記認証試行が成功し、且つ前記認証試行に対応するバイオメトリックデータが、前記電子デバイスの許可済ユーザに対応する保存されたバイオメトリックデータに対する第1の類似性基準を満たすとの判定に従って、前記個別の動作を実行し、前記他の認証試行に対応する前記バイオメトリックデータに基づく追加情報を、前記電子デバイスの前記許可済ユーザを識別するために将来のバイオメトリック認証試行において使用することができるバイオメトリックデータとして保存することと、 前記認証試行が成功し、且つ前記認証試行に対応するバイオメトリックデータが、前記電子デバイスの許可済ユーザに対応する保存されたバイオメトリックデータに対する前記第1の類似性基準を満たさないとの判定に従って、前記他の認証試行に対応する前記バイオメトリックデータに基づく追加情報を、前記電子デバイスの前記許可済ユーザを識別するために将来のバイオメトリック認証試行において使用することができるバイオメトリックデータとして保存すること無く、前記個別の動作を実行することと、を含む方法。
- 17請求項16に記載の方法であって、更に、 前記他の認証ユーザインタフェースに対応する前記他の認証試行を検出したことに応じて、前記認証試行が成功し、且つ前記認証試行に対応するバイオメトリックデータが、前記電子デバイスの許可済ユーザに対応する保存されたバイオメトリックデータに対する類似性基準を満たすとの判定に従って、前記電子デバイスの前記許可済ユーザを識別するために将来のバイオメトリック認証試行において使用される情報が変更されたことを示す出力を出力することを含む、方法。
- 18請求項16に記載の方法であって、更に、 前記電子デバイスがロック解除状態である間に、バイオメトリック認証における使用のための追加情報を保存する要求を受け付けることと、 バイオメトリック認証における使用のための追加情報を保存する前記要求に応じて、 第3のバイオメトリックデータをキャプチャすることと、 前記第3のバイオメトリックデータが前記電子デバイスの許可済ユーザに対応する保存されたバイオメトリックデータに対する第2の類似性基準を満たすとの判定に従って、前記電子デバイスの前記許可済ユーザを識別するために将来のバイオメトリック認証において使用することができる前記第3のバイオメトリックデータに基づく追加情報を保存することであって、前記第2の類似性基準は、前記第3のバイオメトリックデータと前記保存されたバイオメトリックデータとの間の、前記第1の類似性基準で要求されるよりも少ない類似性を要する、保存することと、 前記第3のバイオメトリックデータが前記電子デバイスの許可済ユーザに対応する保存されたバイオメトリックデータに対する前記第2の類似性基準を満たさないとの判定に従って、前記電子デバイスの前記許可済ユーザを識別するために将来のバイオメトリック認証において使用することができる前記第3のバイオメトリックデータに基づく追加情報を保存しないようにすることと、を含む方法。
- 19請求項1から18のいずれか1項に記載の方法であって、更に、 前記ロック解除状態の間に且つ前記個別の動作を実行する前記要求を検出する前に、個別の動作を実行する前記要求を提供する命令に対応するプロンプトを出力することを含む、方法。
- 20電子デバイスであって、 請求項1から19のいずれか1項に記載の方法を実行する命令を含む、1つ以上のコンピュータプログラムを格納するメモリと、 前記メモリに格納された前記命令を実行することが可能な1つ以上のプロセッサと、を含む、電子デバイス。
- 21請求項1から19のいずれか1項に記載の方法を実行する命令を含むコンピュータプログラム。
- 22コンピュータプログラムに従って請求項1から19のいずれか1項に記載の方法を実行するための手段を含む電子デバイス。
Independent claims22
783 paragraphs, as filed
Related Applications This application has priority over US Patent Application No. 61 / 875,669 filed on September 9, 2013 and US Patent Non-Provisional Application No. 14 / 480,183 filed on September 8, 2014. All of these applications are incorporated herein by reference in their entirety.
The present application relates to electronic devices having fingerprint sensors as a whole, including, but not limited to, electronic devices having fingerprint sensors for detecting inputs for manipulating user interfaces.
The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has increased significantly in recent years. Exemplary touch-sensitive surfaces include touch pads and touch screen displays. Such surfaces are widely used to manipulate the user interface on the display. In addition, some electronic devices include a fingerprint sensor to authenticate the user.
Illustrative operations include adjusting the position and / or size of one or more user interface objects, activating a button, or opening a file / application represented by a user interface object, and 1 Associating metadata with one or more user interface objects, or manipulating the user interface in other ways. Exemplary user interface objects include control elements such as digital images, images, text, icons, buttons, and other graphics. In some situations, users may use a file management program (eg, Finder from Apple Inc., Cupertino, CA), an image management application (eg, Aperture® or iPhoto, manufactured by Apple Inc., Cupertino, Calif.). Registered Trademarks), Digital Content (eg, Video and Music) Management Applications (eg, Apple, Cupertino, Calif.) ITunes®, drawing and presentation applications from Inc. (eg Keynote® from Apple Inc. in Cupertino, CA), document creation applications (eg Pages from Apple Inc. in Cupertino, Calif.) (Registered Trademarks)), Website Creation Applications (eg, iWeb® from Apple Inc., Cupertino, CA), Disc Authorizing Applications (eg, iDVD® from Apple Inc., Cupertino, Calif.), Or you need to perform such an operation on a user interface object in a spreadsheet application (eg, Numbers®, Apple Inc., Cupertino, CA).
However, the methods for performing these operations are cumbersome and inefficient. In addition, these methods take longer than necessary, thereby wasting energy. This latter consideration is especially important for battery-powered devices.
Therefore, there is a need for electronic devices that provide faster, more efficient methods and interfaces for manipulating user interfaces. Such methods and interfaces optionally complement or replace conventional methods for manipulating user interfaces. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
The above defects and other problems associated with user interfaces for electronic devices with touch sensitive surfaces are reduced or eliminated by the disclosed devices. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (eg, a notebook computer, tablet computer, or handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a "touch screen" or "touch screen display"). In some embodiments, the device has a fingerprint sensor. In some embodiments, the device is a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or instructions stored in memory to perform multiple functions. Have a set. In some embodiments, the user interacts with the GUI on the touch-sensitive surface and / or the fingerprint sensor, primarily through finger contact and gestures. In some embodiments, the features include image editing, drawing, presenting, word processing, website creation, disc authoring, spreadsheet creation, gameplay, making phone calls, video conferencing, emailing, instant messaging. , Training support, digital photography, digital video recording, web browsing, digital music playback, and / or digital video playback, optionally. Executable instructions for performing these functions are optionally included in non-temporary computer-readable storage media or other computer program products configured to be executed by one or more processors.
There is a need for electronic devices with faster, more efficient methods and interfaces for enrolling fingerprints with the device. Such methods and interfaces can complement or replace conventional methods for enrolling fingerprints with the device. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method is to display the fingerprint registration interface, detect multiple individual and distinct static finger gestures performed on the corresponding finger on the fingerprint sensor, and multiple individual and separate finger gestures performed on the corresponding finger. Includes collecting fingerprint information from stationary finger gestures. After collecting the fingerprint information, the method is based on the fingerprint information collected for the corresponding finger to determine if the collected fingerprint information is sufficient to enroll the fingerprint of the corresponding finger with the device. Including that. According to the determination that the fingerprint information collected for the corresponding finger is sufficient to register the fingerprint of the corresponding finger, the method comprises using the device to register the fingerprint of the corresponding finger. According to the determination that the fingerprint information collected for the corresponding finger is insufficient to register the fingerprint of the corresponding finger, the method displays a message on the fingerprint registration interface to the user. Includes encouraging one or more additional stationary finger gestures on the fingerprint sensor with the corresponding finger.
According to some embodiments, the electronic device comprises a display unit configured to display a fingerprint registration interface, a fingerprint sensor unit, and a processing unit coupled to the display unit and the fingerprint sensor unit. The processing unit detects multiple individual and separate quiescent finger gestures performed on the corresponding finger on the fingerprint sensor unit, and fingerprint information from multiple individual and separate quiescent finger gestures performed on the corresponding finger. Is configured to collect. After collecting the fingerprint information, the processing unit also, based on the fingerprint information collected for that corresponding finger, is the collected fingerprint information sufficient to register the fingerprint of that corresponding finger with the device? Is configured to determine. According to the determination that the fingerprint information collected for the corresponding finger is sufficient to register the corresponding fingerprint, the processing unit is configured to use the device to register the fingerprint of the corresponding finger. To. According to the determination that the fingerprint information collected for the corresponding finger is insufficient to register the fingerprint of the corresponding finger, the processing unit enters the fingerprint registration interface with one or more of the corresponding fingers to the user. It is configured to enable the display of a message prompting the fingerprint sensor to perform further static finger gestures.
As described above, the electronic device including the display and the fingerprint sensor is provided with a faster and more efficient method and interface for registering the fingerprint using the device, and the effectiveness and efficiency of such a device. , Increase user satisfaction. Such methods and interfaces can complement or replace conventional methods for enrolling fingerprints with the device.
There is a need for electronic devices with faster, more efficient methods and interfaces to perform fingerprint-based operations. Such methods and interfaces can complement or replace conventional methods for performing operations. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
According to some embodiments, the method is performed on an electronic device comprising a fingerprint sensor. The method comprises detecting the first input using a fingerprint sensor. The method also includes determining whether the first input contains a fingerprint in response to the detection of the first input. The method is to perform the first operation based on the presence of the fingerprint, regardless of the fingerprint identification information, according to the determination that the first input contains a fingerprint, and the fingerprint of the first input is a registered fingerprint. It further comprises performing a second action conditionally based on the registered fingerprint according to the determination that it matches.
According to some embodiments, the electronic device includes a fingerprint sensor unit configured to detect a first input and a processing unit coupled to the fingerprint sensor unit. The processing unit is configured to determine if the first input contains a fingerprint in response to the detection of the first input. The processing unit is also configured to perform the first operation based on the presence of the fingerprint, regardless of the fingerprint identification information, according to the determination that the first input contains a fingerprint. The processing unit is further configured to conditionally perform a second operation based on the registered fingerprint according to the determination that the fingerprint of the first input matches the registered fingerprint.
As such, electronic devices with fingerprint sensors provide faster, more efficient methods and interfaces for performing fingerprint-based operations, increasing the effectiveness, efficiency, and user satisfaction of such devices. .. Such methods and interfaces can complement or replace conventional methods for performing fingerprint-based operations.
There is a need for electronic devices with faster and more efficient methods and interfaces for adding data to credential fields such as passwords, credit card numbers and revealing organized credentials. Such methods and interfaces can complement or replace conventional methods for adding data to credential fields and revealing organized credentials. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method is to store one or more sets of credentials, to display a form with fields corresponding to one or more credentials in one or more sets of credentials, and to display one or more sets of credentials. One finger input, depending on whether you receive a request that includes finger input on a fingerprint sensor that automatically fills out a form with one or more credentials, and that you receive a request to automatically fill out a form. Fill out the form with one or more credentials and use one or more sets of credentials for finger input, as determined to contain fingerprints associated with users who are authorized to use one or more sets of credentials. Includes withdrawing from filling out the form with one or more credentials, as determined to contain fingerprints that are not associated with the authorized user.
According to some embodiments, the electronic device is configured to display a form with fields corresponding to one or more credentials in a set of one or more credentials, with a display unit and one or more. It comprises a credential storage unit configured to store a set of credentials, a fingerprint sensor unit, a display unit, a credential storage unit, and a processing unit coupled to the fingerprint sensor unit. The processing unit received a request containing finger input on the fingerprint sensor to automatically fill out the form with one or more credentials in a set of one or more credentials, and received a request to fill out the form automatically. Accordingly, according to the determination that the finger input contains a fingerprint associated with a user who is authorized to use one or more sets of credentials, fill out the form with one or more credentials and the finger input is 1 It is configured to stop filling out the form with one or more credentials, as determined to contain fingerprints that are not associated with a user authorized to use the set of one or more credentials.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method depends on storing one or more sets of credentials, receiving a request to display one or more sets of credentials, and receiving a request to display one or more sets of credentials. To display the organized version of one or more sets of credentials, and to detect fingerprints on the fingerprint sensor while displaying the organized version of one or more sets of credentials. Unorganized one or more sets of credentials, depending on the detection of the fingerprint, and according to the determination that the fingerprint was associated with a user authorized to reveal one or more sets of credentials. Including displaying the version.
According to some embodiments, the electronic device comprises a display unit, a fingerprint sensor unit, a display unit, a credential storage unit, and a processing unit coupled to the fingerprint sensor unit. The processing unit receives a request to display one or more sets of credentials, and an organized version of one or more sets of credentials in response to a request to display one or more sets of credentials. Depending on whether a fingerprint is detected on the fingerprint sensor while the organized version of one or more sets of credentials is displayed, and the fingerprint is one or more credentials. It is configured to enable the display of unorganized versions of one or more sets of credentials, as determined to be associated with a user authorized to reveal the set.
In this way, electronic devices with displays and fingerprint sensors have faster, more efficient methods and interfaces for automatically adding data to the credential field to reveal the organized credentials. It enhances the effectiveness, efficiency and user satisfaction of such devices. Such methods and interfaces can complement or replace conventional methods for adding data to credential fields and revealing organized credentials.
There is a need for electronic devices with more efficient and secure methods and interfaces to manage the automatic use of stored credentials. Such methods and interfaces can complement or replace conventional methods for managing the automatic use of stored credentials.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method is to store the corresponding credential of the user of the device on the device, and (1) receive the fingerprint with the fingerprint sensor of the device while running the software application, and (2) receive the fingerprint. Accordingly, and according to the determination that the credential usage criteria are met, including the determination that the received fingerprint matches at least one of the registered fingerprint sets, the user's corresponding credential in the software application. Includes and includes the automatic use of. The method also receives a request to enroll further fingerprints with the device after automatically using the user's corresponding credentials in response to receiving the fingerprint, and with the device additional fingerprints. Depending on the request to be registered, additional fingerprints may be added to the set of registered fingerprints, and additional fingerprints may be added to the set of registered fingerprints, so that the registered fingerprints will have the corresponding credentials. Includes preventing it from being used to allow automatic use of.
According to some embodiments, the electronic device comprises, on the device, a storage unit configured to store the corresponding credentials of the user of the device and a processing unit coupled to the storage unit. .. While running the software application, the processing unit (1) receives the fingerprint on the device's fingerprint sensor, (2) responds to the receipt of the fingerprint, and the received fingerprint is a set of registered fingerprints. It is configured to include automatically using the user's corresponding credential in a software application according to the determination that the credential usage criteria are met, including the determination to match at least one. The processing unit automatically uses the user's corresponding credentials in response to receiving the fingerprint, then receives a request to enroll further fingerprints using the device and causes the device to enroll further fingerprints. Upon request, add more fingerprints to the set of registered fingerprints, and in response to adding more fingerprints to the set of registered fingerprints, the registered fingerprints will automatically use the corresponding credentials. Further configured to prevent it from being used to allow.
As such, electronic devices with displays and fingerprint sensors provide more efficient and secure methods and interfaces for managing the automated use of credentials, and the effectiveness, efficiency and user satisfaction of such devices. Increase the degree. Such methods and interfaces can complement or replace conventional methods for managing the automatic use of credentials.
There is a need for electronic devices with faster, more efficient methods and interfaces for revealing organized information. Such methods and interfaces can complement or replace conventional methods of displaying information on the device. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method is to display the organized version of the first information on the display and to detect finger input on the fingerprint sensor while displaying the organized version of the first information on the display. ,including. The method is as follows, according to the determination that the finger print contains a fingerprint that matches the registered fingerprint authorized to reveal the first information in response to the detection of the finger print on the fingerprint sensor. Includes a fingerprint that matches the previously registered fingerprint, replacing the display of the organized version of the information with the unorganized version of the first information, and allowing finger input to reveal the first information. Further including maintaining the display of the organized version of the first information on the display according to the determination that there is no.
According to some embodiments, the electronic device is coupled to a display unit, a fingerprint sensor unit, a display unit, and a fingerprint sensor unit, which are configured to display an organized version of the first information on the display. It is equipped with a processing unit that has been processed. The processing unit is configured to detect finger input on the fingerprint sensor while enabling the display of the organized version of the first information on the display unit. In response to the detection of the finger input on the fingerprint sensor, the processing unit determines that the finger input contains a fingerprint that matches the registered fingerprint that is allowed to reveal the first information. Replaced the display of the organized version of information with the unorganized version of information 1 and does not include fingerprints that match previously registered fingerprints where finger input was allowed to reveal the first information. According to the determination, it is further configured to maintain the display of the organized version of the first information on the display.
As such, electronic devices with displays and fingerprint sensors provide faster, more efficient methods and interfaces for revealing organized information, and the effectiveness and efficiency of such devices. , Increase user satisfaction. Such methods and interfaces can complement or replace conventional methods of displaying information on the device.
There is a need for electronic devices with faster, more efficient methods and interfaces to provide various unlock modes for such electronic devices. Such methods and interfaces can complement or replace conventional methods for providing various unlock modes. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
According to some embodiments, the method is performed on an electronic device comprising a fingerprint sensor and a display. While the device's mode of operation is in the locked mode, where access to the corresponding feature set of the electronic device is locked, the method receives a first input on the fingerprint sensor that corresponds to a request to initiate unlocking of the device. Including to detect. Depending on the fingerprint sensor detecting the first input, the method further determines that the first input is one of unlock criteria, first unlock failure criteria, or second unlock failure criteria. Further includes determining whether the condition is satisfied. According to the determination that the first input meets the unlock criteria, the method comprises moving the device from the locked mode to the unlocked mode in which the corresponding feature set of the electronic device is unlocked. According to the determination that the first input meets the first unlock failure criterion, the method keeps the device in locked mode and the device locks in the first set of one or more unlocking actions. Keep the device in locked mode according to the adjustment of the unlock settings to enable unlocking through the unlocking action and the determination that the first input meets the second unlocking failure criterion. Adjusting the unlock settings so that the device enables unlocking through unlocking behavior in a second set of unlocking behaviors that is different from the first set of unlocking behaviors. include.
According to some embodiments, the electronic device comprises a display unit configured to display a graphical user interface, a fingerprint sensor unit, and a processing unit coupled to the display unit and the fingerprint sensor unit. When the operating mode of the device is in the locked mode where access to the corresponding feature set of the electronic device is locked, the fingerprint sensor unit detects the first input corresponding to the request to initiate unlocking of the device. .. Depending on the fingerprint sensor unit detecting the first input, the processing unit may use one of the unlock criteria, the first unlock failure criterion, or the second unlock failure criterion for the first input. It is configured to determine whether one is satisfied. The processing unit further shifts the device from locked mode to unlocked mode in which the corresponding feature set of the electronic device is unlocked, as determined by the determination that the first input meets the unlock criteria. It is composed. The processing unit keeps the device in locked mode according to the determination that the first input meets the first unlock failure criterion, and the device is in the first set of one or more unlock operations. It is further configured to adjust the unlock settings to enable unlocking through the unlocking action. The processing unit keeps the device in locked mode according to the determination that the first input meets the second unlock failure criterion, and the device is one or more different from the first set of unlocking operations. It is further configured to adjust the unlock setting to enable unlocking through the unlocking motion in the second set of unlocking motions.
As such, electronic devices with displays and fingerprint sensors provide faster, more efficient ways to provide various unlock modes, such as device effectiveness, efficiency, and user. Increase satisfaction. Such methods and interfaces can complement or replace conventional methods for providing various unlock modes.
There is a need for electronic devices with more efficient and secure methods and interfaces for controlling access to device information and functions and unlocking the device. Such methods and interfaces may complement or replace conventional methods for controlling access to device information and functions and unlocking devices. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method is to display the first user interface on the display to detect the first input while the device is in the locked mode where access to the corresponding feature set of the electronic device is locked. In response to the detection of the first input, the display shows the second user interface in the limited access mode where access is restricted according to the restriction criteria, and the second user interface in the limited access mode. According to the detection of the first fingerprint on the fingerprint sensor while displaying and the determination that the first fingerprint is one of multiple registered fingerprints registered using the device. , Displays the second user interface in full access mode, where access to it is not restricted according to restriction criteria, and unlocks the device from locked mode, unlocking the corresponding feature set of the electronic device. Keeps the display of the second user interface in limited access mode and puts the device in locked mode, following the transition to mode and the determination that the first fingerprint is not one of multiple registered fingerprints. Including to maintain.
According to some embodiments, the electronic device includes a display unit, a fingerprint sensor unit, and a processing unit coupled to the display unit and the fingerprint sensor unit. The processing unit detects the first input by enabling the display of the first user interface on the display unit while the device is in the locked mode where access to the corresponding feature set of the electronic device is locked. Then, in response to the detection of the first input, enable the display of the second user interface on the display unit in the limited access mode whose access is restricted according to the restriction criteria, and in the limited access mode. While enabling the display of the second user interface, the first fingerprint is detected on the fingerprint sensor and the first fingerprint is one of several registered fingerprints registered using the device. According to the determination that there is, access to the second user interface is not restricted according to the restriction criteria. Enable the display of the second user interface in full access mode and change the device from locked mode to the corresponding characteristics of the electronic device. Go to unlocked mode where the set is unlocked and keep the display of the second user interface in limited access mode according to the determination that the first fingerprint is not one of multiple registered fingerprints. And is configured to keep the device in locked mode.
As such, electronic devices with displays and fingerprint sensors provide more efficient and secure methods and interfaces for controlling access to device information and functions to unlock the device, such devices. Increase effectiveness, efficiency and user satisfaction. Such methods and interfaces may complement or replace conventional methods for controlling access to device information and functions and unlocking devices.
There is a need for electronic devices with more efficient methods and interfaces for context-dependently unlocking applications or devices. Such methods and interfaces can complement or replace conventional methods for unlocking. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the time between battery charging.
The method according to some embodiments is performed on an electronic device comprising a display and a fingerprint sensor. The method is one of the locked device user interfaces for electronic devices on the display while the electronic device is in locked mode, which prevents access to the features of multiple different applications on the electronic device. A request to display a first user interface and a limited access user interface for a corresponding application in multiple different applications and to initiate unlocking of one or more functions of the device using a fingerprint sensor. Includes detecting the first input corresponding to. The method uses a fingerprint sensor to detect a first input that corresponds to a request to initiate unlocking of one or more features of the device, with the first user interface being the locked device user for the electronic device. Further comprising transitioning the device from the locked mode to the multi-application unlocked mode in which the functionality of a plurality of various applications is unlocked according to the determination of the interface. The method also locks the device from locked mode, with one or more previously locked features of the corresponding application, according to the determination that the first user interface is a limited access user interface for the corresponding application. This includes moving to an unlocked, single application unlocked mode and continuing to prevent access to one or more previously locked features of other applications in multiple different applications.
According to some embodiments, the electronic device comprises a display unit, a fingerprint sensor unit, a display unit and a processing unit coupled to the fingerprint sensor unit, which are configured to display a first user interface. To prepare for. The processing unit is one of the locked device user interfaces for the electronic device on the display unit while the electronic device is in a locked mode that prevents access to the features of multiple different applications on the electronic device. Enables the display of one first user interface and the limited access user interface of the corresponding application in multiple different applications and initiates the unlocking of one or more functions of the device using the fingerprint sensor. It is configured to detect the first input that corresponds to the request. The processing unit uses a fingerprint sensor to detect a first input that corresponds to a request to initiate unlocking of one or more functions of the device, with the first user interface being the locked device user of the electronic device. According to the determination of the interface, the device is further configured to transition from the locked mode to the multi-application unlocked mode in which the functions of a plurality of various applications are unlocked. The processing unit also determines that the first user interface is a limited access user interface for the corresponding application, and the device is moved from locked mode to one or more previously locked features of the corresponding application. A single unlocked application is configured to move into unlocked mode and continue to prevent access to one or more previously locked features of other applications in multiple different applications.
As such, electronic devices with displays and fingerprint sensors are provided with efficient methods and interfaces for context-dependently unlocking applications or devices, such as device effectiveness, efficiency, and user satisfaction. Increase the degree. Such methods and interfaces can complement or replace conventional methods for unlocking.
In some embodiments, the electronic device comprises one or more, including a fingerprint sensor, a display, and / or a touch sensing surface, one or more processors, a memory, and one or more programs. A program is stored in memory and is configured to be executed by one or more processors, one or more of which contains instructions for performing the operation of any of the methods described above. According to some embodiments, it has a fingerprint sensor, a display, optionally a touch sensing surface, a memory, and one or more processors that execute one or more programs stored in the memory. The graphical user interface on the electronic device contains one or more of the elements displayed in any of the above methods, and these elements are input as described in any of the above methods. It will be updated according to. When the computer-readable storage medium according to some embodiments is performed by an electronic device having a fingerprint sensor and optionally a display and / or a touch-sensitive surface, the method described above for the electronic device. It remembers the instruction to execute one of the actions of. The electronic device according to some embodiments comprises a fingerprint sensor and optionally a display and / or one or more touch sensitive surfaces and means for performing the operation of any of the methods described above. .. The information processing apparatus used in the electronic device having the fingerprint sensor and optionally the display and / or the touch sensing surface according to some embodiments operates in any of the above methods. Includes means to perform.
As such, electronic devices with displays and fingerprint sensors provide faster, more efficient methods and interfaces for changing beam formation parameters based on fingerprint orientation, and the effectiveness of such devices. , Efficiency, increase user satisfaction. Such methods and interfaces can complement or replace conventional methods for changing beam formation parameters.
For a better understanding of the various embodiments described, please refer to the "Description of Embodiments" below, along with the drawings below, and similar reference numbers correspond throughout those figures. Refers to the part.
<figref num="1A">FIG. 3 is a block diagram illustrating a portable multifunction device with a touch-sensitive display and a fingerprint sensor, according to some embodiments.</figref>
<figref num="1B">It is a block diagram which shows the exemplary component for event processing which concerns on some embodiments.</figref>
<figref num="2">A portable multifunctional device having a touch screen and a fingerprint sensor, according to some embodiments.</figref>
<figref num="3">FIG. 6 is a block diagram of an exemplary multifunction device having a plurality of sensors, including a display and a fingerprint sensor, and optionally a touch sensing surface, according to some embodiments.</figref>
<figref num="4A">Shown is an exemplary user interface for an application menu in a portable multifunctional device, according to some embodiments.</figref>
<figref num="4B">Shown is an exemplary user interface for a multifunctional device having a touch sensitive surface separate from a fingerprint sensor and a display, according to some embodiments.</figref>
<figref num="4C">FIG. 3 shows a schematic of two hands associated with a fingerprint, according to some embodiments.</figref>
<figref num="4D">Shown are various types of rotation of a fingerprint on a fingerprint sensor, according to some embodiments.</figref>
<figref num="5A">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5B">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5C">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5D">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5E">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5F">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5G">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5H">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5I">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5J">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5K">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5L">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5M">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5N">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5O">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5P">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5Q">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5R">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5S">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5T">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5U">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5V">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5W">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5X">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5Y">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5Z">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5AA">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5BB">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5CC">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5DD">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref><figref num="5EE">Shown will be an exemplary user interface for registering fingerprints using a device, according to some embodiments.</figref>
<figref num="6A">It is a flow figure which shows the method of registering a fingerprint using the device by some embodiments.</figref><figref num="6B">It is a flow figure which shows the method of registering a fingerprint using the device by some embodiments.</figref><figref num="6C">It is a flow figure which shows the method of registering a fingerprint using the device by some embodiments.</figref><figref num="6D">It is a flow figure which shows the method of registering a fingerprint using the device by some embodiments.</figref>
<figref num="7">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="8A">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8B">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8C">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8D">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8E">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8F">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8G">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8H">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8I">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8J">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8K">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8L">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8M">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8N">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8O">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8P">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8Q">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8R">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8S">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8T">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8U">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8V">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref><figref num="8W">Shown is an exemplary user interface for performing fingerprint-based operations, according to some embodiments.</figref>
<figref num="9A">It is a flow diagram which shows the method of performing the operation based on the fingerprint which concerns on some embodiments.</figref><figref num="9B">It is a flow diagram which shows the method of performing the operation based on the fingerprint which concerns on some embodiments.</figref>
<figref num="10">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="11A">Shown is an exemplary user interface for adding a credential to a credential field and displaying an unorganized version of the credential in response to fingerprint-based user authentication, according to some embodiments.</figref><figref num="11B">Shown is an exemplary user interface for adding a credential to a credential field and displaying an unorganized version of the credential in response to fingerprint-based user authentication, according to some embodiments.</figref><figref num="11C">Shown is an exemplary user interface for adding a credential to a credential field and displaying an unorganized version of the credential in response to fingerprint-based user authentication, according to some embodiments.</figref><figref num="11D">Shown is an exemplary user interface for adding a credential to a credential field and displaying an unorganized version of the credential in response to fingerprint-based user authentication, according to some embodiments.</figref>
<figref num="12A">FIG. 3 shows a flow diagram that allows automatic data addition to a credential field using fingerprint-based user authentication and allows display of an unorganized version of the credential, according to some embodiments.</figref><figref num="12B">FIG. 3 shows a flow diagram that allows automatic data addition to a credential field using fingerprint-based user authentication and allows display of an unorganized version of the credential, according to some embodiments.</figref>
<figref num="13">FIG. 3 is a functional block diagram of an electronic device according to some embodiments.</figref>
<figref num="14A">Shown is an exemplary user interface for displaying an unorganized version of credentials in response to fingerprint-based user authentication, according to some embodiments.</figref><figref num="14B">Shown is an exemplary user interface for displaying an unorganized version of credentials in response to fingerprint-based user authentication, according to some embodiments.</figref><figref num="14C">Shown is an exemplary user interface for displaying an unorganized version of credentials in response to fingerprint-based user authentication, according to some embodiments.</figref>
<figref num="15A">FIG. 5 is a flow diagram illustrating a method of allowing the display of an unorganized version of credentials using fingerprint-based user authentication, according to some embodiments.</figref><figref num="15B">FIG. 5 is a flow diagram illustrating a method of allowing the display of an unorganized version of credentials using fingerprint-based user authentication, according to some embodiments.</figref>
<figref num="16">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="17A">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17B">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17C">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17D">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17E">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17F">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17G">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17H">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17I">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref><figref num="17J">Shown will be an exemplary user interface for managing the automatic use of credentials stored through registered fingerprints, according to some embodiments.</figref>
<figref num="18A">It is a flow diagram which shows the method of managing the automatic use of the credential stored through the registered fingerprint which concerns on some embodiments.</figref><figref num="18B">It is a flow diagram which shows the method of managing the automatic use of the credential stored through the registered fingerprint which concerns on some embodiments.</figref><figref num="18C">It is a flow diagram which shows the method of managing the automatic use of the credential stored through the registered fingerprint which concerns on some embodiments.</figref>
<figref num="19">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="20A">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20B">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20C">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20D">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20E">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20F">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20G">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20H">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20I">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20J">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20K">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20L">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20M">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20N">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20O">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20P">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20Q">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20R">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20S">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref><figref num="20T">Shown is an exemplary user interface for revealing organized information for some embodiments.</figref>
<figref num="21A">It is a flow diagram which shows the method of clarifying the organized information which concerns on some embodiments.</figref><figref num="21B">It is a flow diagram which shows the method of clarifying the organized information which concerns on some embodiments.</figref><figref num="21C">It is a flow diagram which shows the method of clarifying the organized information which concerns on some embodiments.</figref>
<figref num="22">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="23A">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23B">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23C">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23D">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23E">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23F">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23G">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23H">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23I">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23J">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23K">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23L">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23M">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23N">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23O">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23P">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23Q">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23R">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23S">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23T">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23U">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23V">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23W">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23X">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23Y">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23Z">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23AA">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23BB">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23CC">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23DD">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23EE">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref><figref num="23FF">An exemplary user interface for providing various unlock modes according to some embodiments is shown.</figref>
<figref num="24A">It is a flow diagram which shows the method which provides various unlocking modes which concerns on some embodiments.</figref><figref num="24B">It is a flow diagram which shows the method which provides various unlocking modes which concerns on some embodiments.</figref><figref num="24C">It is a flow diagram which shows the method which provides various unlocking modes which concerns on some embodiments.</figref><figref num="24D">It is a flow diagram which shows the method which provides various unlocking modes which concerns on some embodiments.</figref>
<figref num="25">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="26A">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26B">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26C">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26D">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26E">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26F">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26G">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26H">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26I">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26J">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26K">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26L">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26M">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26N">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26O">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26P">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26Q">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26R">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26S">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26T">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26U">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26V">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26W">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref><figref num="26X">Shown will be an exemplary user interface for controlling access to device information and functions and unlocking the device, according to some embodiments.</figref>
<figref num="27A">FIG. 5 is a flow diagram illustrating a method of controlling access to device information and functions and unlocking a device, according to some embodiments.</figref><figref num="27B">FIG. 5 is a flow diagram illustrating a method of controlling access to device information and functions and unlocking a device, according to some embodiments.</figref><figref num="27C">FIG. 5 is a flow diagram illustrating a method of controlling access to device information and functions and unlocking a device, according to some embodiments.</figref><figref num="27D">FIG. 5 is a flow diagram illustrating a method of controlling access to device information and functions and unlocking a device, according to some embodiments.</figref>
<figref num="28">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
<figref num="29A">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29B">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29C">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29D">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29E">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29F">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29G">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29H">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29I">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29J">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29K">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29L">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29M">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29N">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29O">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29P">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29Q">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29R">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29S">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29T">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29U">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29V">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29W">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29X">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref><figref num="29Y">Shown will be an exemplary user interface for unlocking an application or device in a context-dependent manner, according to some embodiments.</figref>
<figref num="30A">FIG. 5 is a flow diagram illustrating a context-dependent method of unlocking an application or device, according to some embodiments.</figref><figref num="30B">FIG. 5 is a flow diagram illustrating a context-dependent method of unlocking an application or device, according to some embodiments.</figref><figref num="30C">FIG. 5 is a flow diagram illustrating a context-dependent method of unlocking an application or device, according to some embodiments.</figref><figref num="30D">FIG. 5 is a flow diagram illustrating a context-dependent method of unlocking an application or device, according to some embodiments.</figref>
<figref num="31">It is a functional block diagram of an electronic device which concerns on some embodiments.</figref>
Description of the embodiment
These methods, devices, and GUIs described herein respond to inputs on the fingerprint sensor in place of or in addition to inputs on touch-sensitive surfaces or other input devices. In some implementations, a touch-sensitive surface having a spatial resolution high enough to detect the fingerprint features formed by the individual fingerprint ridges is used as the fingerprint sensor. When using a fingerprint sensor without a separate touch-sensitive surface, the fingerprint sensor can detect the movement of contact on the fingerprint sensor, even when the fingerprint area is larger than the fingerprint sensor area. Can serve as a substitute for many of the touch-sensitive surface features with a much smaller form factor. When the fingerprint sensor is used in addition to the individual touch sensitive surface, the fingerprint sensor accurately detects the twisting motion of the contact, identifies the different fingerprints of the finger used when performing the gesture on the fingerprint sensor, and the device. The touch-sensitive surface can be enhanced by identifying the current user of. In addition, if the fingerprint sensor is used in addition to a separate touch screen display, in situations where it is convenient for the finger not to obscure a portion of the display (eg, while watching a map, video or game). , The fingerprint sensor may detect the touch input. When the touch-sensitive surface is used as a fingerprint sensor, the touch-sensitive surface optionally touches the touch-sensitive surface (or area of the touch-sensitive surface) in low-resolution and high-resolution modes without user intervention. It optionally has a spatial resolution setting that can be defined to automatically switch between. In many situations, the low resolution mode consumes less power than the high resolution mode. The benefits of operating the touch-sensitive surface in low-resolution mode when fingerprint detection is not needed and switching one area of the touch-sensitive surface or touch-sensitive surface to high-resolution mode as needed are necessary while saving power. Correspondingly, it senses fingerprint features at high resolution to enhance the user experience of using the device. In implementations where the touch sensitive surface is used as a fingerprint sensor, the term
Many different methods are described below that provide an intuitive user interface in which input from one or more fingerprint sensors is used to manipulate the user interface of an electronic device. Using one or more of these methods (optionally, in combination with each other) helps to provide a user interface that intuitively provides the user with additional information or functionality, and therefore. , Reduce the cognitive burden on the user and enhance the human-machine interface. Such improvements in the human-machine interface will allow users to use the device faster and more efficiently. For battery-powered devices, these improvements save power and increase the interval between battery charges. To simplify the description, systems, methods, and user interfaces, including exemplary embodiments of some of these methods, are described below.
FIGS. 5A-5EE below show an exemplary user interface for registering fingerprints using a device. 6A to 6D are flow charts showing a method of registering a fingerprint using a device. The user interface of FIGS. 5A-5EE is used to illustrate the process of FIGS. 6A-6D.
Figures 8A-8W show exemplary user interfaces for performing fingerprint-based actions. 9A-9B are flow diagrams showing how to perform a fingerprint-based operation. The process of FIGS. 9A-9B is shown using the user interface of FIGS. 8A-8W.
Figures 11A-11D and 14A-14C below provide an exemplary user interface for adding credentials to the credential field and displaying an unorganized version of the credential, depending on the user's fingerprint-based authentication. show. 12A-12B and 15A-15B are flow diagrams illustrating how to allow automatic addition of credential fields and / or display of unorganized credentials using authentication based on the user's fingerprint. The processes of FIGS. 12A-12B and 15A-15B are shown using the user interfaces of FIGS. 11A-11D and 14A-14C.
FIGS. 17A-17J below show an exemplary user interface for managing the automatic use of credentials stored on an electronic device (eg, device 100 or 300). 18A-18C are flow diagrams illustrating how to manage the automatic use of credentials stored on an electronic device (eg, device 100 or 300). The process of FIGS. 18A-18C is shown using the user interface of FIGS. 17A-17J.
Figures 20A to 20T below show an exemplary user interface for revealing organized information. 21A to 21C are flow charts showing a method of clarifying the organized information. The process in FIGS. 21A-21C is shown using the user interface of FIGS. 20A-20T.
Figures 23A-23FF below show exemplary user interfaces for providing various unlock modes on electronic devices. 24A-24D are flow diagrams illustrating how to provide various unlock modes on an electronic device. The process of FIGS. 24A to 24D is shown using the user interface of FIGS. 23A to 23FF.
Figures 26A-26X below show exemplary user interfaces for controlling access to device information and features and for unlocking devices. 27A-27D are flow diagrams showing how to unlock access to devices and device functions. Using the user interface in FIGS. 26A-26X, the process in FIGS. 27A-27D is shown.
Figures 29A-29Y below show exemplary user interfaces for unlocking an application or device depending on the context. 30A to 30D are flow charts showing how to unlock an application or device depending on the context. The process in FIGS. 30A-30D is shown using the user interface in FIGS. 29A-29Y.
Illustrative device
Here, the embodiments in which the embodiments are shown in the accompanying drawings will be referred to in detail. The detailed description below provides a number of specific details to provide a complete understanding of the various embodiments described. However, it will be apparent to those skilled in the art that the various embodiments described may be practiced without these specific details. In other examples, well-known methods, procedures, components, circuits, and networks are not described in detail so as not to unnecessarily obscure aspects of embodiments.
In the present specification, terms such as first and second are used to describe various elements in some embodiments, but these elements should not be limited by those terms. It will also be understood. These terms are used only to distinguish one element from another. For example, without departing from the scope of the various embodiments described, the first contact can be referred to as the second contact and similarly, the second contact can be referred to as the first contact. .. The first contact and the second contact are both contacts, but they are not the same contact.
The terminology used in the description of the various embodiments described herein is intended solely to describe a particular embodiment and is not intended to be limiting. As used in the various described embodiments and in the appended claims, the singular forms "a", "an", and "the" also include the plural, unless the context clearly indicates otherwise. Is intended. As used herein, it is also understood that the term "and / or" refers to, and includes, any possible combination of one or more of the relevant listed items. sea bream. Further, the terms "includes", "including", "comprises", and / or "comprising", as used herein, are features, integers described. , Steps, actions, elements, and / or the existence of components, but excludes the existence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof. It will be understood that it is not something to do.
As used herein, the term "if" is optionally context dependent on "when", "upon", and "". It is interpreted to mean "in response to determining" or "in response to detecting". Similarly, the phrase "if it is determined" or "if (a stated condition or event) is detected". Is optionally "upon determining" or "in response to determining" or "upon detecting (the stated condition or)" depending on the context. event) or in response to detecting (the stated condition or) event) (depending on the detection of (the condition or event described)) ".
Embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices will be described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA function and / or a music playback function. Exemplary embodiments of portable multifunction devices include, without limitation, iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, Calif. Other portable electronic devices such as laptops or tablet computers with touch sensitive surfaces (eg, touch screen displays and / or touchpads) can also be optionally used. Also, it should be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch sensitive surface (eg, a touch screen display and / or a touch pad).
The following discussion describes an electronic device with a display and a touch sensitive surface. However, it should be understood that this electronic device optionally includes one or more other physical user interface devices such as physical keyboards, mice, and / or joysticks.
The device is typically drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, gaming applications, phone applications, video conferencing applications, email applications, instant messaging applications, training. Supports a variety of applications, including one or more of support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music playback applications, and / or digital video playback applications.
Various applications running on this device optionally use at least one common physical user interface device, such as a touch sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or from one application to the next and / or within the corresponding application. Be changed. In this way, the device's common physical architecture (such as touch-sensitive surfaces) optionally supports a variety of applications with user interfaces that are intuitive and transparent to the user.
Here, attention is paid to an embodiment of a portable device including a touch-sensitive display. FIG. 1A is a block diagram showing a portable multifunction device 100 with a touch-sensitive display 112, according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes known or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122, one or more processing units (CPU) 120, peripheral interface 118, RF circuit 108, audio circuit. Includes 110, speaker 111, microphone 113, input / output (I / O) subsystem 106, other input or control device 116, and external port 124. Device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more strength sensors 165 for detecting the strength of contact on the device 100 (eg, a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100). The device 100 generates a tactile output on the touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100 or the touchpad 355 of the device 300. Includes one or more tactile output generators 167, optionally. These components optionally communicate via one or more communication buses or signal lines 103.
As used herein and in the claims, the term "strength" of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact (eg, finger contact) on the touch-sensitive surface. ), Or an alternative to the force or pressure of contact on the touch-sensitive surface. The contact strength has a range of numbers, including at least four different numbers, and more typically hundreds of different numbers (eg, at least 256). Contact strength is optionally determined (or measured) using different methods and different sensors, or combinations of sensors. For example, one or more sensors placed below or adjacent to the touch sensing surface are optionally used to measure forces at various points on the touch sensing surface. In some implementations, force measurements from multiple force sensors are combined (eg, weighted average) to determine the estimated force of contact. Similarly, the pressure sensitive tip of the stylus is optionally used to determine the pressure of the stylus on the touch sensitive surface. Alternatively, the size and / or its change in the contact area detected on the touch-sensitive surface, the capacitance and / or its change in the touch-sensitive surface close to the contact, and / or the touch-sensing close to the contact. Surface resistance and / or changes thereof are optionally used as a substitute for contact force or pressure on the touch-sensitive surface. In some implementations, alternative measurements of contact force or pressure are used directly to determine if an intensity threshold is exceeded (eg, intensity thresholds are described in units corresponding to the alternative measurements. Will be). In some implementations, alternative measurements of contact force or pressure are converted to an estimated force or pressure and this estimated force or pressure is used to determine if the intensity threshold is exceeded (eg,). , The intensity threshold is the pressure threshold measured in units of pressure).
As used herein and in the claims, the term "tactile output" is the physical displacement of the device with respect to the previous position of the device, the configuration of the device, which will be detected by the user by the user's tactile sensation. Refers to the physical displacement of an element (eg, a touch-sensitive surface) with respect to another component of the device (eg, housing), or the displacement of the component with respect to the center of mass of the device. For example, the tactile sensation generated by physical displacement in a situation where the device or a component of the device is in contact with a touch-sensitive user's surface (eg, the finger, palm, or other part of the user's hand). The output is interpreted by the user as a tactile sensation that corresponds to a perceived change in the physical properties of the device or its components. For example, the movement of a touch-sensitive surface (eg, a touch-sensitive display or trackpad) is optionally interpreted by the user as a "down-click" or "up-click" of a physical actuator button. In some cases, the user "down-clicks" or "up-clicks" even when there is no physical actuator button movement associated with the touch-sensitive surface physically pressed (eg, displaced) by the user's movement. I feel the tactile sensation. As another example, the movement of the touch-sensitive surface is optionally interpreted or perceived by the user as the "roughness" of the touch-sensitive surface, even when the smoothness of the touch-sensitive surface does not change. Such interpretation of touch by the user depends on the individual sensory recognition of the user, but there are many sensory perceptions of touch common to the majority of users. Therefore, if the tactile output is described as corresponding to a particular sensory perception of the user (eg, "up-click", "down-click", "roughness"), the generated tactile sensation, unless otherwise stated. Intellectual output corresponds to the physical displacement of a device, or component of a device, that produces a typical (or average) user's described sensory cognition.
The device 100 is merely an embodiment of a portable multifunctional device, the device 100 optionally having more or less components than those shown, or optionally having two or more components. It should be understood that they may be combined or optionally have different configurations or arrangements of components. The various components shown in FIG. 1A are implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
Memory 102 optionally includes fast random access memory and optionally also non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile semiconductor memory devices. .. Access to memory 102 by other components of device 100, such as CPU 120 and peripheral interface 118, is optionally controlled by memory controller 122.
Peripheral interface 118 can be used to connect the input and output peripherals of this device to the CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions for device 100 and to perform data processing. Or something.
In some embodiments, the peripheral interface 118, CPU 120, and memory controller 122 are optionally mounted on a single chip, such as chip 104. In some other embodiments, they are optionally mounted on individual chips.
The RF (radio frequency) circuit 108 sends and receives RF signals, also called electromagnetic signals. The RF circuit 108 converts an electrical signal into an electromagnetic signal, or converts an electromagnetic signal into an electrical signal, and communicates with a communication network and other communication devices via the electromagnetic signal. The RF circuit 108 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identification module (SIM) card, memory, etc. It optionally includes, but is not limited to, a well-known circuit for performing the above functions. The RF circuit 108 includes networks such as the Internet, also known as Internet Information Search Systems (WWW), intranet and / or wireless networks such as cellular telephone networks, wireless local area networks (LAN) and / or metropolitan area networks (MAN), and others. It communicates arbitrarily and selectively with the device of. Wireless communication includes global system for mobile communication (GSM (registered trademark)), enhanced data GSM environment (EDGE (registered trademark)), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data. -Only (EV-DO), HSPA, HSPA +, Double Cell HSPA (DC-HSPDA), Long Term Evolution (LTE®), Short Range Wireless Communication (NEC), Wideband Code Division Multiple Access (W-CDMA) ), Code division multiple access (CDMA), Time division multiple access (TDMA), Bluetooth<u style="Single">(Registered trademark)</u>, Wireless Fidelity (Wi-Fi) (eg IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), Voice Over Internet Protocol (VoIP), Wi-MAX®, for email Protocols (eg, Internet Message Access Protocol (IMAP) and / or Post-Office Protocol (POP)), Instant Messaging (eg, extensible messaging and presence protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE)) , Instant Messaging and Presence Service (IMPS)) and / or short message service (SMS), or any other suitable communication protocol including, but not limited to, communication protocols that have not yet been developed as of the filing date of this application. Use any of the communication standards, protocols, and techniques arbitrarily.
The audio circuit 110, the speaker 111, and the microphone 113 provide an audio interface between the user and the device 100. The voice circuit 110 receives voice data from the peripheral device interface 118, converts the voice data into an electric signal, and transmits the electric signal to the speaker 111. The speaker 111 converts an electrical signal into a human audible sound wave. The voice circuit 110 also receives an electrical signal converted from sound waves by the microphone 113. The voice circuit 110 converts the electrical signal into voice data and sends the voice data to the peripheral device interface 118 for processing. The audio data is optionally taken from the memory 102 and / or the RF circuit 108 by the peripheral interface 118 and / or sent to the memory 102 and / or the RF circuit 108. In some embodiments, the audio circuit mechanism 110 further comprises a headset jack (eg, 212 in FIG. 2). The headset jack is a removable audio input / output peripheral such as an audio circuit 110 and an output-only headphone or a headset that has both an output (eg, headphones for one or both ears) and an input (eg, a microphone). Provides an interface with.
The I / O subsystem 106 connects the input / output peripherals of the device 100, such as the touch screen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. .. One or more input controllers 160 receive / transmit electrical signals from / to other inputs or control devices 116. The other input control device 116 optionally includes physical buttons (eg, push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and the like. In some alternative embodiments, the input controller (s) 160 is optionally coupled (or optionally) to any of pointer devices such as keyboards, infrared ports, USB ports, and mice. , Not concatenated to either). One or more buttons (eg, 208 in FIG. 2) optionally include up / down buttons for volume control of the speaker 111 and / or the microphone 113. One or more buttons optionally include a push button (eg 206 in FIG. 2).
The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives and / or transmits an electrical signal from / to the touch screen 112. The touch screen 112 displays the visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to a user interface object.
The touch screen 112 comprises a touch sensing surface, a sensor, or a set of sensors that accept input from the user based on tactile and / or tactile contact. The touch screen 112 and the display controller 156 (along with any relevant module and / or instruction set in memory 102) detect a contact (and any action or interruption of contact) on the touch screen 112 and make the detected contact. Convert to a interaction with a user interface object (eg, one or more softkeys, icons, web pages, or images) displayed on the touch screen 112. In one exemplary embodiment, the contact between the touch screen 112 and the user corresponds to the user's finger.
The touch screen 112 optionally uses LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but in other embodiments, other display technologies are used. Ru. The touch screen 112 and display controller 156 are capacitive technology, resistance technology, infrared technology, and surface ultrasonic technology, as well as other proximity sensor arrays for determining one or more points of contact with the touch screen 112. Contact and any movement or interruption thereof are optional, including, but not limited to, using any of a number of currently known or later developed touch sensing techniques, including, but not limited to, other elements. To detect. In one exemplary embodiment, a projected mutual capacitance detection technique, such as that found on iPhone®, iPod Touch®, iPad®, etc. from Apple Inc. in Cupertino, Calif. It is used.
The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally contacts the touch screen 112 using any suitable object or accessory such as a stylus or finger. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, and due to the large finger contact area on the touch screen, it may be less accurate than stylus-based input. be. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform the action desired by the user.
In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating a particular function. In some embodiments, the touchpad, unlike a touchscreen, is a touch-sensitive area of the device that does not display visual output. The touchpad is optionally a touch sensing surface separate from the touch screen 112, or an extension of the touch sensing surface formed by the touch screen.
The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (eg, battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (eg, light emission). Diodes (LEDs)), as well as any other components associated with power generation, management, and distribution within portable devices.
Device 100 also optionally includes one or more optical sensors 164. Figure IA shows the optical sensor coupled to the optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge coupling device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In combination with the imaging module 143 (also referred to as the camera module), the optical sensor 164 optionally captures a still image or video. In some embodiments, the optical sensor is on the opposite side of the touchscreen display 112 on the front of the device, so that the touchscreen display is enabled as a viewfinder for still image and / or video acquisition. It is located on the back of 100. In some embodiments, another optical sensor is placed on the front of the device so that the user's image is optional while the user views other video conference participants on the touch screen display. Obtained for video conferences.
Device 100 also optionally includes one or more contact strength sensors 165. FIG. 1A shows a contact strength sensor coupled to a strength sensor controller 159 in the I / O subsystem 106. The contact strength sensor 165 may be one or more piezo resistance strain gauges, capacitive force sensors, electrical forces sensors, pressure power sensors, optical force sensors, capacitive touch sensing surfaces, or other intensity sensors (eg, touch sensing surfaces). A sensor used to measure the force (or pressure) of the above contact) is optionally included. The contact strength sensor 165 receives contact strength information (eg, pressure information or pressure information proxy) from the environment. In some embodiments, at least one contact strength sensor is juxtaposed or in close proximity to a touch-sensitive surface (eg, touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.
Device 100 also optionally includes one or more proximity sensors 166. FIG. 1A shows the proximity sensor 166 coupled to the peripheral interface 118. Alternatively, the proximity sensor 166 is coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, if the multifunction device is placed close to the user's ear (eg, the user is making a phone call), the proximity sensor turns off and disables the touch screen 112. ..
Device 100 also optionally includes one or more tactile output generators 167. FIG. 1A shows the tactile output generator coupled to the tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 is one or more electroacoustic devices such as a speaker or other audio component and / or a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output configuration. It optionally includes electromechanical devices that convert energy into linear motion, such as elements (eg, components that convert electrical signals to tactile outputs on the device). The contact strength sensor 165 receives a tactile feedback generation command from the tactile feedback module 133 and generates a tactile output perceptible to the user of the device 100 on the device 100. In some embodiments, at least one tactile output generator is juxtaposed with or in close proximity to a touch-sensitive surface (eg, a touch-sensitive display system 112), optionally with a touch-sensitive surface. It produces a tactile output by moving vertically (eg, inside / outside the surface of the device 100) or laterally (eg, anteroposteriorly in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.
Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows the accelerometer 168 coupled to the peripheral interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, the information is displayed on a touch screen display in portrait or landscape view based on the analysis of data received from one or more accelerometers. The device 100, as needed, to obtain information about the accelerometer (s) 168, as well as the magnetometer (not shown) and the position and orientation of the device 100 (eg, portrait or landscape). GPS (or GLONASS or other global navigation system) receiver (not shown) is optionally included.
In some embodiments, the device 100 also includes (or communicates with) one or more fingerprint sensors 169. FIG. 1A shows the fingerprint sensor 169 coupled to the peripheral interface 118. Alternatively, the fingerprint sensor 169 is optionally coupled to the input controller 160 in the I / O subsystem 106. However, in one common embodiment, the fingerprint identification operation is protected dedicated hardware (eg, one or more) with additional security features to enhance the security of the fingerprint information determined by the fingerprint sensor. Performed using a processor, memory and / or communication bus). The fingerprint sensor used herein is a sensor that can distinguish (also referred to as "minusia function") the fingerprint features of the ridges and valleys of the skin, such as those found on the fingers and toes of human hands. Fingerprint sensors feature fingerprints using any of a variety of techniques including, but not limited to, visual fingerprint image processing, ultrasonic fingerprint image processing, active capacitive fingerprint image processing, and passive capacitive fingerprint image processing. Can be distinguished. In addition to distinguishing fingerprint features in a fingerprint, in some embodiments, the fingerprint sensor 169 can track the movement of fingerprint features over time, thereby moving the fingerprint on the fingerprint sensor over time. Can be judged / characterized. The fingerprint sensor of FIG. 1A (eg, fingerprint sensor 169) is shown separately from the touch-sensitive surface (eg, touch-sensitive display system 112), but in some implementations, the touch-sensitive surface (eg, touch). The sensing display system 112) has a spatial resolution high enough to detect the fingerprint features formed by the individual fingerprint ridges, and instead of a separate fingerprint sensor (eg, fingerprint sensor 169), Or, in addition to that, it will be understood that it is used as a fingerprint sensor. In some embodiments, the device 100 determines the orientation of a finger or hand on or near the device (eg, the orientation of the finger above the fingerprint sensor 169). Includes a set of one or more orientation sensors used for. In addition, in some embodiments, a set of one or more orientation sensors is used to detect the rotation of the contact interacting with the device in addition to or instead of the fingerprint sensor (eg,). Instead of using a fingerprint sensor to detect fingerprint / contact rotation in one or more of the methods below, a set of one or more orientation sensors, with or without detection of fingerprint features, may or may not be detected. Used to detect rotation of contacts, including fingerprints).
In some embodiments, the comparison of the fingerprint feature with the detected fingerprint feature and the stored fingerprint feature enhances the security of the fingerprint data generated, stored and processed by the fingerprint sensor 169. It is run by dedicated, protected hardware (eg, one or more processors, memory, and / or communication bus) separate from the processor 120. In some embodiments, the comparison of the fingerprint feature and the detected fingerprint feature with the registered fingerprint and feature is performed by the processor 120 using the fingerprint analysis module 131.
In some embodiments, during the enrollment process, a device (eg, a separate secure module 146 that connects to a fingerprint analysis module 131 or a fingerprint sensor (s) 169) biometrics about one or more fingerprints of a user. Gather metric information (eg, identify the relative positions of multiple miniature points on a user's fingerprint). After the registration process is complete, the biometric information is stored on the device (eg, in the secure fingerprint module 146) for later use when authenticating the detected fingerprint. In some embodiments, the biometric information stored on the device excludes the fingerprint image and also the fingerprint image so that the fingerprint image is not inadvertently made available when the device is compromised. Also excludes information that can be reconstructed. In some embodiments, during the authentication process, the device (eg, the fingerprint analysis module 131 or a separate secure model 146 that communicates with the fingerprint sensor (s) 169) receives finger input detected by the fingerprint sensor. Gather biometric information about fingerprints detected on the fingerprint sensor to see if they contain fingerprints that match the registered fingerprints (eg, the relative location of multiple miniature points on the fingerprint detected on the fingerprint sensor). Is identified), and the biometric information corresponding to the detected fingerprint is compared with the biometric information corresponding to the registered fingerprint (s). In some embodiments, comparing the biometric information corresponding to the detected fingerprint with the biometric information corresponding to the registered fingerprint (s) is the biometric corresponding to the detected fingerprint. Includes comparing the type and location of the minissure point in the information with the type and location of the minissure point in the biometric information corresponding to the registered fingerprint. However, the determination of whether the finger input contains a fingerprint that matches a previously registered fingerprint registered using the device optionally determines that the detected fingerprint matches the registered fingerprint. To determine
In some embodiments, the software components stored in the memory 102 are the operating system 126, the communication module (or instruction set), the contact / motion module (or instruction set) 130, and the fingerprint analysis module 131. It includes a graphic module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Further, in some embodiments, memory 102 stores device / global internal state 157, as shown in FIGS. 1A and 3. Device / Global Internal State 157 includes one or more of the following: Touch screen display with active application state, which application, view, or other information indicating which application is currently active, if any. Display state, sensor state, including information obtained from various sensors and input control devices 116 of the device, and location information regarding the position and / or orientation of the device, indicating whether it occupies various areas of 112.
In some embodiments, the credential information is stored as secure credential information 145. The secure credential information optionally includes credentials for the user account (eg, username and password, billing information, address information). In some embodiments, the credential information about one or more different applications is stored in a secure central location on the device so that the credential information is accessible to the various applications. In some embodiments, credential information associated with a particular application (eg, username and password or billing information entered within a particular application) is stored with that particular application (eg,). The username and password to authorize the purchase in the store application are stored with the store application for easy access by the store application). In some embodiments, other security information (eg, a decryption key for decrypting encrypted content stored on the device) is with secure credential information 145 or another secure location on the device. It is memorized at.
Operating system 126 (eg, Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS, or VxWorks®, etc. (Embedded operating system) includes various hardware and software for controlling and managing common system tasks (eg, memory management, storage device control, power management, etc.), including various software components and / or drivers. Facilitates communication with components.
The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing the data received by the RE circuit 108 and / or the external port 124. .. External port 124 (eg, Universal Serial Bus (USB), FIREWIRE®, etc.) should be connected to other devices either directly or indirectly via a network (eg, Internet, Wireless LAN, etc.). Is adapted to. In some embodiments, the external port is a multi-pin (eg, 30-pin) that is the same as or similar to and / or compatible with the 30-pin connector used on iPod (Apple Inc. trademark) devices. It is a connector.
The contact / move module 130 optionally detects contact with the touch screen 112 (together with the display controller 156) and with other touch sensing devices (eg, touchpad or physical click wheel). The contact / motion module 130 determines whether a contact has occurred (eg, detection of a finger down event), the strength of the contact (eg, a contact force or pressure, or a synonym for contact force or pressure). , Determining if there is contact movement and tracking of movement across the touch-sensitive surface (eg, detection of one or more finger drag events), and whether contact has been aborted (eg, finger-up event or interruption of contact). Includes various software components for performing various actions related to contact detection, such as detection) determination. The contact / motion module 130 receives contact data from the touch sensing surface. Determining the movement of a contact point represented by a series of contact data is the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. Is optionally included. These actions optionally apply to a single contact (eg, one-finger contact) or multiple simultaneous contacts (eg, "multi-touch" / multiple finger contacts). In some embodiments, the contact / move module 130 and the display controller 156 detect contact on the touchpad.
In some embodiments, the contact / move module 130 determines whether an action has been performed by the user (eg, to determine if the user has "clicked" on the icon). Use one or more sets of intensity thresholds. In some embodiments, at least a subset of intensity thresholds are determined according to software parameters (eg, intensity thresholds are not determined by the activation threshold of a particular physical actuator and modify the physical hardware of device 100. Can be adjusted without). For example, the mouse "click" threshold for a trackpad or touchscreen display can be set to one of a wide range of default thresholds without changing the trackpad or touchscreen display hardware. In addition, in some implementations, the user of the device adjusts multiple intensity thresholds (eg, by adjusting individual intensity thresholds and / or immediately after a system-level click on the "intensity" parameter. Software settings are provided to adjust one or more of the set of intensity thresholds (by doing so).
The contact / move module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (eg, different movements, timings, and / or detected contact intensities). Therefore, the gesture is optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture detects a finger-lowering event, followed by a finger at the same position (or substantially the same position) as the finger-lowering event (eg, at the position of the icon). Includes detecting an event that raises (lifts off). As another embodiment, the detection of a finger wipe gesture on the touch sensitive surface detects a finger down event, followed by one or more finger drag events, followed by a finger up (lift off) event. including.
The fingerprint analysis module 131 arbitrarily detects the finger input by the user on the fingerprint sensor, determines whether the finger input includes the registered fingerprint registered using the device and the corresponding fingerprint, and determines whether the finger input includes the fingerprint corresponding to the registered fingerprint. And / or detect the movement of the fingerprint corresponding to the finger gesture. In some embodiments, fingerprint registration and comparison of the detected fingerprint with the registered fingerprint is performed by a secure fingerprint analysis module 146 that communicates with the fingerprint sensor (s) 169 and is a secure fingerprint. The analysis module 146 maintains the security of the biometric information about the detected and registered fingerprints without providing the biometric information about the fingerprints detected or registered by the fingerprint analysis module 131 (eg, the fingerprint analysis module 131). Therefore, the fingerprint analysis module 131 is provided with information indicating whether or not the detected fingerprint matches the registered fingerprint. In some embodiments, information about the movement of the fingerprint during finger input and the number of finger-up or finger-down events is also provided by the secure fingerprint analysis module 146 to the fingerprint analysis module 131. In some embodiments, the information about the finger input is previously organized by the fingerprint analysis module 131 (eg, unlocking the device, unlocking the function of the device, etc.) to respond to the finger input. Is used (by performing an action based on the action of the fingerprint on the fingerprint sensor).
The graphic module 132 includes components for changing the visual effect of the displayed graphic (eg, brightness, transparency, saturation, contrast, or other visual characteristics) on the touch screen 112 or other display. Includes various known software components for rendering and displaying graphics in. As used herein, the term "graphic" includes any object that can be displayed to the user, such as text, web pages, icons (user interface objects including softkeys, etc.). ), Digital images, videos, animations, etc., but not limited to these.
In some embodiments, the graphic module 132 stores data representing the graphic used. Corresponding code is optionally assigned to each graphic. The graphic module 132 receives, if necessary, one or more codes that specify the graphic to be displayed, along with coordinate data and other graphic property data, from an application or the like, and outputs screen image data to the display controller 156. Generate.
The tactile feedback module 133 is used by the tactile output generator (s) 167 to generate tactile outputs at one or more locations on the device 100 in response to user interaction with the device 100. Includes various software components for generating instructions.
The text input module 134 is optionally a component of the graphic module 132 and various applications (eg, contacts 137, email 140, IM 141, browser 147, and any other that requires text input). Provides a soft keyboard for entering text in the application).
The GPS module 135 determines the location of the device and provides this information for use in various applications (eg, to the phone 138 for use in location-based dial calls, camera as picture / video metadata. To 143, and to applications that provide location-based services such as weather widgets, rural yellow page widgets, and map / navigation widgets).
Application 136 optionally includes the following modules (or sets of instructions), or subsets or supersets thereof.
Contact module 137 (also known as address book or contact list), Phone module 138, Video conferencing module 139, Email client module 140, Instant messaging (IM) module 141, Training support module 142 , Camera module 143 for still images and / or video images, Image management module 144, Browser module 147, Calendar module 148, Weather widget 149-1, Stock widget 149-2, Computer widget 149-3, Widget module 149, which optionally contains one or more of alarm clock widget 149-4, dictionary widget 149-5, and other user-acquired widgets, as well as user-created widget 149-6, user-created widget 149 -6 Widget creation module for creating 150, Search module 151, Video and music playback module 152, Memo module 153, Map module 154, optionally composed of video playback module and music playback module , And / or Online video module 155.
Examples of other applications 136 that are optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA®-enabled applications, encryption, and digital. Examples include copyright management, voice recognition, and voice duplication.
Along with the touch screen 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the contact module 137 (eg, the application internal state 192 of the contact module 137 in memory 102 or memory 370). Used arbitrarily to manage an address book or contact list (remembered in), such as adding a name (s) to an address book, a name (s) from an address book. To remove, to associate a phone number (s), email address (s), address (s), or other information with a name, to associate an image with a name, to name Includes sorting and sorting, providing a phone number or email address to initiate and / or facilitate communication by phone 138, video conference 139, mail 140, or IM 141.
Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the telephone module 138 is a set corresponding to the telephone number. Enter the letters to access one or more phone numbers in Address Book 137, correct the phone number entered, dial the corresponding phone number, complete the conversation, and when the conversation is complete. Used optionally to hang up or hang up. As mentioned above, wireless communication optionally uses any one of a plurality of communication standards, protocols, and techniques.
RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact module 130, graphic module 132, text input module 134, contact list 137, and Along with the telephone module 138, the video conference module 139 contains executable instructions for initiating, conducting, and ending a video conference between the user and one or more other participants according to the user's instructions. ..
Together with the RF circuit 108, touch screen 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the email client module 140 creates and sends email according to user instructions. Includes executable instructions for receiving, receiving, and managing. The e-mail client module 140, in combination with the image management module 144, makes it very easy to create still images or videos taken by the camera module 143 and send e-mail.
Together with the RF circuit 108, touch screen 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the instant message module 141 can be used to enter or have entered a string corresponding to an instant message. Correct text, send the corresponding instant message (for example, using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone-based instant messaging, or Internet-based instant. Includes executable instructions for receiving an instant message and displaying the received instant message (using XMPP, SIMPLE, or IMPS for the message). In some embodiments, the transmitted and / or received instant message is a graphic, photo, audio file, video file, and / or other, as supported by MMS and / or Enhanced Messaging Service (EMS). Attachments are optionally included. As used herein, "instant messaging" refers to telephone-based messages (eg, messages sent using SMS or MMS) and Internet-based messages (eg, using XMPP, SIMPLE or IMPS). (Message sent by).
Along with RF circuit 108, touch screen 112, display controller 156, contact module 130, graphic module 132, text input module 134, GPS module 135, map module 154, and music playback module 146, the training support module 142 (eg, (Has time, distance, and / or calorie consumption targets) Generate training, communicate with training sensors (sports devices), receive training sensor data, measure sensors used to monitor training, training Includes executable instructions for selecting and playing music for, as well as displaying, storing, and transmitting training data.
Along with the touch screen 112, display controller 156, optical sensor (s) 164, optical sensor controller 158, contact module 130, graphic module 132, and image management module 144, the camera module 143 is a still image or video (one or more). Includes executable instructions for capturing (including video streams) and storing them in memory 102, changing the characteristics of still images or videos, or deleting still images or videos from memory 102. ..
Together with the touch screen 112, display controller 156, contact module 130, graphic module 132, text input module 134, and camera module 143, the image management module 144 arranges and modifies still images and / or video (eg,). , Edit), and include executable instructions for otherwise manipulating, labeling, deleting, presenting (eg, in a digital slide show or album), and storing.
Along with the RF circuit 108, touch screen 112, display system controller 156, contact module 130, graphic module 132, and text input module 134, the browser module 147 is linked to a web page or parts thereof, as well as a web page. Includes executable instructions for browsing the Internet, following user instructions, including searching, linking, receiving, and displaying attachments and other files.
Along with the RF circuit 108, touch screen 112, display system controller 156, contact module 130, graphic module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 follows the user's instructions. Includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with them (eg, calendar entries, to-do lists, etc.).
Widget module 149 is optionally downloaded and used by the user in connection with RF circuit 108, touch screen 112, display system controller 156, contact module 130, graphic module 132, text input module 134, and browser module 147. Mini-applications (eg, Weather Widget 149-1, Stock Widget 149-2, Calculator Widget 149-3, Alarm Clock Widget 149-4, and Dictionary Widget 149-5), or user-created mini-applications (eg) , User-created widget 149-6). In some embodiments, the widget includes an HTML (hypertext markup language) file, a CSS (cascading style sheet) file, and a JavaScript file. In some embodiments, the widget includes an XML (extensible markup language) file and a JavaScript (registered trademark) file (eg, a Yahoo! (registered trademark) widget).
Together with the RF circuit 108, touch screen 112, display system controller 156, contact module 130, graphic module 132, text input module 134, and browser module 147, the widget creation module 150 creates widgets (eg, for web pages). Used arbitrarily by the user to (turn a user-specified part into a widget).
Together with the touch screen 112, display system controller 156, contact module 130, graphic module 132, and text input module 134, the search module 151 follows user instructions and follows one or more search criteria (eg, one or more users). Includes executable instructions to search for text, music, sounds, images, videos, and / or other files in memory 102 that match the specified search term).
Along with the touch screen 112, display system controller 156, contact module 130, graphic module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music playback module 152 can be an MP3 or AAC file, etc. Executable instructions that allow the user to download and play recorded music or other sound files stored in one or more file formats, as well as video connected (on the touch screen 112 or via an external port 124). Includes actionable instructions to display, present, or otherwise play (on an external display). In some embodiments, the device 100 optionally includes the functionality of an MP3 player such as an iPod (a registered trademark of Apple Inc.).
Along with the touch screen 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the memo module 153 is executable for creating and managing memos, to-do lists, etc. according to user instructions. Includes instructions.
Together with the RF circuit 108, touch screen 112, display system controller 156, contact module 130, graphic module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 maps, according to user instructions. And receive, display, modify, and receive data associated with maps (eg, driving directions, data about stores in or near a particular location and other points of interest, and other location-based data). Used arbitrarily to memorize.
Online video module along with touch screen 112, display system controller 156, contact module 130, graphic module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147. The 155 allows the user to access, browse, receive (eg, by streaming and / or download), play (eg, on the touch screen, or) online video in one or more file formats such as H.264. Includes instructions to send an email containing a link to a particular online video (on an external display connected via external port 124 ) so that it can be managed in another way. In some embodiments, an instant messaging module 141, rather than an email client module 140, is used to send a link to a particular online video.
Each of the modules and applications identified above is an executable instruction set for performing one or more of the above functions and the methods described in this application (eg, methods performed by a computer and herein. Corresponds to other information processing methods described in). These modules (ie, instruction sets) do not need to be implemented as separate software programs, procedures, or modules, so various subsets of these modules are optional, in various embodiments. Combined or rearranged. In some embodiments, memory 102 optionally stores a subset of the identified modules and data structures described above. Further, the memory 102 optionally stores additional modules and data structures not described above.
In some embodiments, the device 100 is a device in which the operation of a default set of features on the device is performed exclusively via the touch screen and / or touch pad. Arbitrary number of physical input control devices (push buttons, dials, analogs, etc.) on the device 100 by using the touch screen and / or touchpad as the primary input control device for the operation of the device 100. Selectively reduce.
A set of default features, performed exclusively via the touch screen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such an embodiment, the "menu button" is implemented using a touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.
FIG. 1B is a block diagram showing exemplary components for event processing, according to some embodiments. In some embodiments, memory 102 (in FIG. 1A) or 370 (in FIG. 3) is an event sorter 170 (eg, in operating system 126) and a corresponding application 136-1 (eg, applications 137-13, described above). 155, and any of 380-390).
The event sorter 170 determines the application view 191 of the application 136-1 and the application 136-1 that receive the event information and distribute the event information. The event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 has an application internal state 192 showing the current application view (s) displayed above on the touch-sensitive display 112 when the application is active or running. include. In some embodiments, the event sorter 170 uses the device / comprehensive internal state 157 to determine the currently active application (s) and the event sorter 170 uses the application internal state 192. Then, the application view 191 that distributes the event information is determined.
In some embodiments, the application internal state 192 is the resume information used when application 136-1 resumes execution, that information has been displayed or is ready for display by application 136-1. One of the user interface state information that indicates, the state queue that allows the user to return to the previous state or view of application 136-1, and the redo / undo queue for actions that the user has previously performed. Contains additional information, such as one or more.
The event monitor 171 receives event information from the peripheral device interface 118 or optionally from the fingerprint analysis module 131. Event information includes information about sub-events (eg, user touches on the touch-sensitive display 112 as part of a multi-touch gesture or finger input on the fingerprint sensor 169). Peripheral interface 118 receives from sensors such as I / O subsystem 106 or proximity sensor 166 (via audio circuit 110), accelerometer (s) 168, fingerprint sensor 169, and / or microphone 113. Send information. The information received by the peripheral interface 118 from the I / O subsystem 106 includes information from the touch-sensitive display 112 or the touch-sensitive surface.
In some embodiments, the event monitor 171 sends a request to the peripheral interface 118 at predetermined intervals. In response to this, the peripheral device interface 118 transmits event information. In another embodiment, the peripheral device 118 transmits event information only when there is a significant event (eg, accepting an input that exceeds a predetermined noise threshold and / or accepts an input longer than a predetermined time).
In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173.
The hit view determination module 172 provides software procedures for determining where in one or more views a subevent occurred when the touch-sensitive display 112 displays one or more views. The view consists of controls and other elements that the user can see on the display.
Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, within which information is displayed and touch-based gestures. Is carried out. The application view (of the corresponding application) where the touch is detected optionally corresponds to the program level of the application or the program level within the view hierarchy. For example, the lowest level view where a touch is detected is optionally called a hit view, and a set of events that are recognized as appropriate input, at least in part, is the first touch to initiate a touch-based gesture. Judgment is optional based on the hit view of.
The hit view determination module 172 receives the information associated with the touch-based gesture subevent. If the application has multiple views organized as a hierarchy, the hit view determination module 172 identifies the hit view as the lowest view in the hierarchy to handle subevents. In most situations, a hit view is the lowest level view at which the first subevent (ie, the first subevent in a sequence of events or subevents that form a potential event) occurs. When a hit view is identified by the hit view determination module, the hit view typically receives all subevents associated with the same touch or input source that it was identified as a hit view.
The active event recognizer determination module 173 determines which view (one or more) in the view hierarchy should receive a particular sequence of subevents. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In another embodiment, the active event recognizer determination module 173 determines that all views, including the physical position of the subevent, are views that are involved in the active, and therefore all views that are involved in the active. Determines that a particular sequence of subevents should be received. In other embodiments, even if the touch subevent is completely confined to the area associated with a particular view, the views above the hierarchy will remain the views that are actively involved.
The event dispatcher module 174 transmits event information to an event recognition unit (for example, event recognition unit 180). In the embodiment including the active event recognition unit determination module 173, the event dispatcher module 174 distributes event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information acquired by the corresponding event receiver module 182 in the event queue.
In some embodiments, the operating system 126 comprises an event sorter 170. Alternatively, application 136-1 includes event sorter 170. In yet another embodiment, the event sorter 170 is a stand-alone module or part of another module stored in memory 102, such as the contact / move module 130.
In some embodiments, application 136-1 has multiple event handlers 190 and one or more application views, each containing instructions for handling touch events that occur within each view of the application's user interface. Includes 191. Each application view 191 of application 136-1 contains one or more of event recognizers 180. Typically, the corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are separate modules, such as user interface kits (not shown) or higher level objects for which application 136-1 inherits methods and other properties. Is part of. In some embodiments, each event handler 190 comprises one or more of event data 179 received from a data updater 176, an object updater 177, a GUI updater 178, and / or an event sorter 170. The event handler 190 optionally uses or calls the data updater 176, the object updater 177, or the GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views 191 contains one or more event handlers 190 for each. Also, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 is included within the corresponding application view 191.
The corresponding event recognition unit 180 receives event information (for example, event data 179) from the event sorter 170, and identifies an event from the event information. The event recognition unit 180 includes an event reception unit 182 and an event comparison unit 184. In some embodiments, the event recognizer 180 further comprises at least a subset of metadata 183 and event distribution instructions 188 (optionally including sub-event distribution instructions).
The event receiving unit 182 receives event information from the event sorter 170. Event information includes, for example, information on sub-events such as touch or touch movement, or finger input or fingerprint movement. Depending on the sub-event, the event information also includes additional information such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally further includes the speed and direction of the sub-event. In some embodiments, the event involves rotation of the device from one direction to another (eg, from portrait to landscape, or vice versa), and event information is the current orientation of the device (device orientation). Also contains the corresponding information about).
The event comparison unit 184 compares the event information with the definition of the default event or sub-event, and determines the event or sub-event, or determines or updates the state of the event or sub-event by the comparison. In some embodiments, the event comparison unit 184 includes an event definition 186. Event definition 186 includes event definitions (eg, the default sequence of subevents), such as event 1 (187-1), event 2 (187-2). In some embodiments, the sub-event at event 187 includes, for example, touch start, touch end, touch move, touch cancel, multiple touch, fingerprint start, fingerprint end, fingerprint move, fingerprint authentication, and fingerprint authentication failure. In one embodiment, the definition of event 1 (187-1) is a double tap on the displayed object. Double tapping is, for example, a first touch (touch start) for a given step on a displayed object, a first lift-off (touch end) for a given step, or a given step on a displayed object. Includes a second touch (start of touch) and a second lift-off (end of touch) for a given stage. In another embodiment, the definition of event 2 (187-2) is to drag the displayed object. Dragging includes, for example, touching (or touching) a given step on a displayed object, moving the touch across the touch-sensitive display 112, and lifting off the touch (end of touch). In some embodiments, the event also contains information about one or more associated event handlers 190.
In some embodiments, the event definition 187 includes an event definition for each user interface object. In some embodiments, the event comparison unit 184 performs a hit test to determine which user interface object is associated with the subevent. For example, in an application view where three user interface objects are displayed on the touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, the event comparison unit 184 may touch any of the three user interface objects. Perform a hit test to determine if it was associated with (sub-event). If each of the displayed objects is associated with a corresponding event handler 190, the event comparison unit uses the result of the hit test to determine which event handler 190 needs to be activated. For example, the event comparison unit 184 selects an event handler associated with an object that triggers a subevent and a hit test.
In some embodiments, the definition for each event 187 also includes a delay effect that delays the delivery of event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognizer. ..
If the corresponding event recognizer 180 determines that the set of sub-events does not match any of the events in event definition 186, the corresponding event recognizer 180 enters the event impossible, event failure, or event end state. , Then ignore the next subevent of the touch-based gesture. In this situation, other event recognizers, if any, that remain active for the hit view continue to track and process sub-events of the touch-based gesture in progress.
In some embodiments, the corresponding event recognizer 180 performs configurable properties, flags, and / Or it contains metadata 183 with a list. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether subevents are distributed to different levels within the view hierarchy or program hierarchy.
In some embodiments, the corresponding event recognizer 180 activates the event handler 190 associated with the event when one or more specific subevents of the event are recognized. In some embodiments, the corresponding event recognizer 180 distributes event information associated with the event to the event handler 190. There is a distinction between activating event handler 190 and sending (and deferring) subevents to the corresponding hit view. In some embodiments, the event recognizer 180 throws the flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and performs the default process.
In some embodiments, the event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about the sub-event without activating the event handler. Instead, the sub-event distribution instruction distributes event information to the event handlers or views involved in the activity associated with the set of sub-events. The event handler associated with a set of sub-events or views involved in the activity receives event information and performs a predetermined process.
In some embodiments, the data updater 176 creates and updates the data used by application 136-1. For example, the data updater 176 updates the phone number used by the contact module 137 and stores the video file used by the video playback module 145. In some embodiments, the object updater 177 creates and updates the objects used by application 136-1. For example, the object updater 176 creates a new user interface object or updates the position of the user interface object. The GUI updater 178 updates the GUI. For example, the GUI updater 178 prepares the display information and sends the display information to the graphic module 132 for display on the touch-sensitive display.
In some embodiments, the event handler (s) 190 includes or has access to a data updater 176, an object updater 177, and a GUI updater 178. In some embodiments, the data updater 176, the object updater 177, and the GUI updater 178 are contained in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
The above discussion of user touch event handling on touch-sensitive displays also applies to other forms of user input for operating the multifunction device 100 using input devices, all of which are touch. It will be understood that it does not start on the screen. For example, mouse movement and mouse button pressing, touch movement such as tapping, dragging, scrolling, etc. on the touchpad, pen stylus input, device Movement, verbal commands, detected eye movements, biometric inputs, and / or any combination thereof are optionally used as inputs corresponding to the subevents that define the recognized event.
FIG. 2 shows a portable multifunction device 100 with a touch screen 112, according to some embodiments. The touch screen optionally displays one or more graphics within the user interface (UI) 200. In embodiments described below as well as in this embodiment, the user may see, for example, one or more fingers 202 (not drawn at the correct scale in the figure) or one or more stylus 203 (correct in the figure). You can select one or more of the graphics by making gestures on the graphic using (not drawn at scale). In some embodiments, the choice of one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture is with one or more taps, one or more swipes (left to right, right to left, up and / or down), and / or device 100. Includes rolling of touching fingers (right-to-left, left-to-right, upward, and / or downward), optionally. In some implementations or situations, accidental contact with a graphic does not select the graphic. For example, if the selection and corresponding gesture is a tap, swipe over the application icon. Swipe gesture will select the corresponding application. Optional, do not select.
Device 100 also optionally includes one or more physical buttons, such as "Home" or Menu Button 204. As mentioned above, the menu button 204 is optionally used to navigate to any application 136 within a set of applications running arbitrarily on device 100. Alternatively, in some embodiments, the menu button is implemented as a softkey in the GUI displayed on the touch screen 112. In some embodiments, the button 204 includes an integrated fingerprint sensor 169-1 for identifying the fingerprint interacting with the button 204 and / or for detecting the movement of the fingerprint on the button 204. Also, the device is separate from the button 204 and replaces or / or the fingerprint sensor 169-1 built into the button 204 to identify the user interacting with the device and / or to detect the movement of the fingerprint. Optionally includes one or more other fingerprint sensors 169-2 used in combination. In addition, one or more of the other fingerprint sensors 169-2 are added by a button (eg, a pressure sensitive area activated by detecting an input having an intensity above the activation intensity threshold, or by the user. It is optionally associated with a physical actuator that moves according to the force applied). In implementations where the touch-sensitive surface (eg, touch screen 112) has a spatial resolution high enough to detect the fingerprint features formed by the individual fingerprint ridges, the touch-sensitive surface (eg, touch screen 112). ) Are optionally used as an alternative to or as an additional fingerprint sensor for a separate fingerprint sensor (eg, fingerprint sensor 169-1 or 169-2). In some embodiments, the device 100 comprises a set of one or more orientation sensors used to determine the orientation of the hand on the device 100.
In one embodiment, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on and off to lock the device, a volume control button (s) 208, a receiver. Includes identification module (SIM) card slot 210, headset jack 212, and external docking / charging port 124. The bush button 206 optionally presses the button to hold the button in a pressed state for a specified time interval to turn the device on and off, pressing the button to hold the button for a specified time interval. Used to lock the device and / or unlock the device or initiate the unlocking process by releasing the button before the lapse of time. In an alternative embodiment, the device 100 also accepts verbal input to activate or deactivate some functions through the microphone 113. The device 100 also has one or more contact strength sensors 165 for detecting the strength of contact with the touch screen 112 and / or one or more tactile outputs for generating a user tactile output of the device 100. Includes generator 167, optionally.
FIG. 3 is a block diagram of an exemplary multifunction device with a display and a touch sensitive surface, according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (eg, home). Or a commercial controller). The device 300 is typically one for interconnecting one or more processing units (CPUs) 310, one or more networks or other communication interfaces 360, memory 370, and these components. Including the above communication bus 320. The communication bus 320 optionally includes circuits (sometimes referred to as chipsets) that interconnect and control communication between system components. The device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 is also for generating tactile outputs on the keyboard and / or mouse (or other pointing device) 350 and touchpad 355, device 300 (eg, see above in connection with FIG. 1A). Tactile output generator (similar to one or more) 167) Tactile output generator 357, sensor 359 (eg, optical sensor, acceleration sensor, proximity sensor, touch sensing sensor, and / or in Figure 1A. A contact strength sensor similar to the contact strength sensor (s) 165 described above in connection with it, and / or a fingerprint sensor similar to the fingerprint sensor (s) 169 described above in connection with FIG. 1A. ) Is optionally included. In addition, in implementations where the touch-sensitive surface (eg, touchpad 355) has a spatial resolution high enough to detect the fingerprint features formed by the individual fingerprint ridges, the touch-sensitive surface (eg, eg, touchpad 355). The touchpad 355) is a separate fingerprint sensor (eg For example, it can be optionally used as an alternative to (for example, one of the sensors 359) or as an additional fingerprint sensor. In some embodiments, the device 300 is used to determine the orientation of a finger or hand (eg, the orientation of a finger above the fingerprint sensor 169) on or near the device1 Includes a set of one or more orientation sensors. In addition, in some embodiments, a set of one or more orientation sensors is used in addition to or in place of the fingerprint sensor to detect the rotation of the contact interacting with the device. For example, in one or more of the methods described above, instead of using a fingerprint sensor to detect the rotation of the fingerprint / contact, the rotation of the contact containing the fingerprint is detected with or without the detection of fingerprint features. A set of one or more orientation sensors is used for this purpose.
Memory 370 is DRAM, SRAM, DDR One or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid storage devices, including high-speed random access memory such as RAM, or other random access solid-state memory devices. Includes non-volatile memory such as. The memory 370 optionally includes one or more storage devices located remote from the CPU (s) 310. In some embodiments, memory 370 is a program, module, and data structure similar to, or a subset of, a program, module, and data structure stored in memory 102 of portable multifunction device 100 (FIG. 1A). Remember. Further, the memory 370 optionally stores additional programs, modules, and data structures that do not exist in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores the drawing module 380, the presentation module 382, the document creation module 384, the website creation module 386, the disk authoring module 388, and / or the spreadsheet module 390. The memory 102 of the portable multifunction device 100 (FIG. 1) does not optionally store these modules.
Each of the elements of FIG. 3 identified above is optionally stored in one or more of the aforementioned memory devices. Each of the modules identified above corresponds to an instruction set for performing the functions described above. The identified modules or programs (ie, instruction sets) described above do not need to be implemented as separate software programs, procedures, or modules, and thus, in various embodiments, various subsets of these modules. Optionally combined or otherwise rearranged. In some embodiments, the memory 370 optionally stores a subset of the identified modules and data structures described above. Further, the memory 370 optionally stores additional modules and data structures not described above.
Here, attention is paid to an embodiment of a user interface (UI) optionally implemented on the portable multifunction device 100.
FIG. 4A shows an exemplary user interface for a menu of applications on a portable multifunction device 100, according to some embodiments. A similar user interface is optionally implemented on the device 300. In some embodiments, the user interface 400 includes the following elements, or a subset or superset thereof.
Signal strength indicator (one or more) related to wireless communication (one or more) such as cellular signal and Wi-Fi signal (one or more) 402, Time 404, Bluetooth indicator 405, Battery status indicator 406, Tray 408 containing icons for frequently used applications, Icon 416 for phone module 138, labeled "phone", optionally including a number indicator 414 for missed calls or answering machine messages, Icon 418 for the email client module 140, labeled "mail", optionally including the indicator 410 for the number of unread emails, For the browser module 147, labeled "browser" Icon 420, and the iPod (Apple) labeled "iPod" Inc.) Icon 422 for video and music playback module 152, also known as module 152, and Icon for other applications, such as: for IM module 141 labeled "text" Icon 424, labeled Calendar, icon 426 for calendar module 148, labeled photo, icon 428 for image management module 144, labeled camera, Icon 430 for camera module 143, Icon 432 for online video module 155, labeled "online video", Icon 434 for stock widget 149-2, labeled "stock", " Icon 436 for map module 154, labeled "Map", Icon 438 for Weather Widget 149-1, labeled "Weather", Alarm Clock Widget 149 labeled "Clock" -4 Icon 440, Labeled Training Support, Icon 442 for Training Support Module 142, Labeled Memo, Icon 444 for Memo Module 153, and Device 100 and Icon 446 for a configuration application or module that provides access to settings for that various application 136.
It will be appreciated that the icon labels shown in Figure 4A are merely exemplary. For example, the icon 422 for the video and music playback module 152 is labeled as "music" or "music player". Other labels are optionally used for various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to each application icon. In some embodiments, the label of a particular application icon is different from the name of the application that corresponds to the particular application icon.
FIG. 4B shows a display 450 (eg, one or more of sensors 359 operating in a manner similar to the fingerprint sensor 169 in FIG. 1A) with an integrated 359-1 (or separate 359-2) fingerprint sensor (eg, one or more of the sensors 359). Shown is an exemplary user interface on a device (eg, device 300 in FIG. 3) having a touch sensing surface 451 (eg, tablet or touchpad 355 in FIG. 3) separate from the touch screen 112). In addition, in an implementation in which the touch sensing surface 451 has a spatial resolution high enough to detect the fingerprint features formed by the individual fingerprint ridges, the touch sensing surface 451 is a different fingerprint sensor (eg, eg). It is optionally used as a fingerprint sensor in place of or in addition to the integrated fingerprint sensor 359-1 or the separate fingerprint sensor 359-2). The device 300 may also include one or more contact strength sensors (eg, one or more of sensors 359-3) for detecting the strength of contact with the touch sensing surface 451 and / or the user's touch of the device 300. Optionally include one or more tactile output generators 357 to generate the intellectual output.
Some of the following examples will be described with reference to the inputs on the touch screen display 112 (when the touch sensitive surface and the display are combined), but in some embodiments the device is , Detects the input on a touch-sensitive surface separate from the display, as shown in Figure 4B. In some embodiments, the touch sensitive surface (eg, 451 in FIG. 4B) has a spindle (eg, 452 in FIG. 4B) that corresponds to a spindle on the display (eg, 450) (eg, 453 in FIG. 4B). Have. According to these embodiments, the device is with a touch sensing surface 451 at a position corresponding to each position on the display (eg, in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470). Detect contacts (eg, 460 and 462 in Figure 4B). Thus, when the touch-sensitive surface is separate from the display, user inputs (eg, contacts 460 and 462, and their movements) detected by the device on the touch-sensitive surface (eg, 451 in FIG. 4B). ) Is used by the device to manipulate the user interface on the display of the multifunctional device (eg, 450 in Figure 4B). It should be appreciated that similar methods are optionally used for the other user interfaces described herein.
In addition, the following description is primarily described with reference to finger inputs (eg, finger contact, finger tap gestures, finger swipe gestures), but in some embodiments, those finger inputs. It should be understood that one or more of them will be replaced by input from another input device (eg, mouse-based input or stylus input). For example, a swipe gesture is optionally replaced with a mouse click (eg, instead of a contact), after which the cursor is moved along the swipe path (eg, instead of a touch move). As another embodiment, the tap gesture optionally replaces a mouse click while the cursor is hovering over the position of the tap gesture (for example, instead of stopping contact detection following contact detection). Be done. Similarly, it will be appreciated that when multiple user inputs are detected simultaneously, multiple computer mice are optionally used simultaneously, or mouse and finger contact are optionally used simultaneously.
As used herein, the term "focus selector" refers to an input element that refers to the current part of the user interface with which the user is interacting. In implementations that include a cursor or other location marker, the cursor is when an input (eg, a pressing input) is detected on a touch-sensitive surface (eg, touchpad 355 in FIG. 3 or touch-sensitive surface 451 in FIG. 4B). , Acts as a "focus selector" when the cursor is over a particular user interface element (eg, a button, window, slider, or other user interface element), and the particular user interface element follows the detected input. It will be adjusted. In some implementations, including touch screen displays (eg, touch-sensitive display system 112 in Figure 1A, or touch screen 112 in Figure 4A) that allow direct interaction with user interface elements on the touch screen display. Because the touch detected on the touch screen acts as a "focus selector", the input (eg, touch-pressed input) is a specific user interface element (eg, a button, window, slider, or, on the touch screen display). When detected at the location of another user interface element), that particular user interface element is adjusted according to the detected input. In some implementations, without moving the corresponding cursor or touch on the touch screen (for example, by using the tab key or arrow keys to move the focus from one button to another). Focus is moved from one area of the user interface to another area of the user interface. In these implementations, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the particular form the focus selector takes, the focus selector as a whole is intended with the user's user interface (eg, the user interface that the user wants to interact with). A user interface element (or contact on a touch screen display) controlled by the user to convey a dialogue (by directing the element to the device). For example, when a press input is detected on a touch sensitive surface (eg, touchpad or touchscreen), the position of the focus selector (eg, cursor, touch or selection box) above each button is (device). Indicates that the user is trying to activate each button (as opposed to the other user interface elements shown on the display).
Figure 4C shows the associated fingerprints LP (left small finger fingerprint), LR (left drug finger fingerprint), LM (left middle finger fingerprint), LI (left index finger fingerprint), LT (left thumb). Two with fingerprint), RT ("right thumb" fingerprint), RI ("right index finger" fingerprint), RM ("right middle finger" fingerprint), RR ("right medicine finger" fingerprint) RP ("right small finger" fingerprint) A schematic of the hand is shown. These abbreviations are used with reference to other fingers that provide examples of dialogue with the fingerprint sensor. For some of the methods described herein, one or more fingerprints of a user are registered by collecting information about the fingerprint that allows the fingerprint to be identified. These registered fingerprints, or pre-registered fingerprints, may also be referred to as registered fingerprints. In many situations described below, the fingerprint detected on the fingerprint sensor is compared to a previously registered fingerprint (eg, a registered fingerprint).
FIG. 4D shows two different types of rotation of the fingerprint on the fingerprint sensor (eg, the fingerprint sensor 169 built into the button 204). The left side of FIG. 4D is an example of "swirl" of the fingerprint around the fingerprint sensor, and the center of gravity of the fingerprint moves around the center of the fingerprint sensor by a swivel motion (for example, a circular motion). The right side of Figure 4D is an example of a "twist" of a fingerprint on a fingerprint sensor, where the main axis of the fingerprint changes direction with respect to the fingerprint sensor. These terms (eg, "swirl" and "twist") are used to describe different directions of rotation of the fingerprint on the fingerprint sensor with reference to other fingers that show examples of interactions with the fingerprint sensor. ..
As shown in FIG. 4D, in some embodiments, the fingerprint sensor is smaller or about the same size as the average fingerprint. Thus, in some embodiments, the fingerprint sensor moves the fingerprint (eg, fingerprint gesture) by detecting the movement of the fingerprint feature instead of or in addition to detecting the movement of the edge of the fingerprint. Is detected. In other words, in some implementations, the fingerprint sensor does not determine the movement of the fingerprint contour (eg, contact), but the movement of the fingerprint ridge on the fingerprint sensor (eg, specific ridge). The movement of the fingerprint is detected by detecting the miniature point). Whether the fingerprint sensor is larger or smaller than the fingerprint, it replaces or adds to the detection of the fingerprint based on the movement of the edge or contour of the fingerprint, and the movement of the fingerprint based on the movement of the fingerprint features (eg,). By detecting the fingerprint gesture), the movement of the fingerprint can be tracked in much more detail, and the movement of the fingerprint can be tracked even if the fingerprint covers all or most of the fingerprint sensor.
Register your fingerprint using the user interface and related process devices
Many electronic devices provide a way to unlock the device. For example, the user enters a passcode or personal identification number (PIN) and swipes with a default pattern or slides affordances to unlock the device to access personal user information and applications. There is a need to. However, the widespread use of e-commerce and mobile phone purchases requires stronger security to unlock devices. The devices described below improve the existing method of registering fingerprints of each finger using the device after collecting fingerprint information from multiple individual and separate static finger gestures. In turn, the device performs a restricted action when the detected fingerprint matches the registered fingerprint (eg, unlocks the purchase on the device or mobile phone).
The device displays a fingerprint registration interface and detects multiple individual and distinct static finger gestures performed on the corresponding finger on the fingerprint sensor. The device collects fingerprint information from multiple individual and separate static finger gestures performed on the corresponding finger. After collecting the fingerprint information, the device determines, based on the fingerprint information collected for that corresponding finger, whether the collected fingerprint information is sufficient to enroll the fingerprint of the corresponding finger with the device. .. According to the determination that the fingerprint information collected for the corresponding finger is sufficient to register the fingerprint of the corresponding finger, the device uses the device to register the fingerprint of the corresponding finger. According to the determination that the fingerprint information collected for the corresponding finger is not sufficient to register the fingerprint of the corresponding finger, the device displays a message on the fingerprint registration interface to the user with the corresponding finger. Encourage one or more additional static finger gestures to be performed on the fingerprint sensor.
In some embodiments, the device is an electronic device comprising a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 5A-5EE and 6A-6D include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with one or more integrated fingerprint sensors 359-1 (eg, a separate touch sensing surface 451 or touch sensing display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 5A-5EE and 6A-6D are discussed with reference to a device having a touch screen 112 and a separate touch sensing surface 359-2, but with similar behavior. , The integrated fingerprint sensor in response to detecting the input described in FIGS. 5A-5EE on the integrated fingerprint sensor 359-1 while displaying the user interface shown in FIGS. 5A-5EE on the display 450. It is optionally executed on the device at 359-1. Further, a similar operation is optionally a device having a display 450 and a separate touch sensing surface 451 instead of the touch screen 112, with a fingerprint sensor 169 (eg, integrated fingerprint sensor 359-1 or separate fingerprint sensor 359). -2) The contact shown in Fig. 5A to Fig. 5EE was detected above. And / or on a separate touch sensing surface 451 while displaying the user interface shown in FIGS. 5A-5EE on the display 450. In such an embodiment, the contacts shown in FIGS. 5A-5EE are optionally made on a focus selector corresponding to the position of the display 450 and a separate touch sensing surface (eg, touch sensing surface 451). Or represent both the contacts corresponding to the position of the gesture, and the focus selector optionally represents the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or the point associated with the corresponding contact). ), Or the centroid of two or more contacts detected on the touch screen 112, optionally replaced with the displayed cursor.
FIGS. 5A-5M show part of the device configuration process in which the first fingerprint is registered using the portable multifunction device 100.
FIG. 5A shows a portable multifunction device 100 (sometimes referred to herein as device 100) displaying a user interface 400 on a touch screen 112. In FIG. 5A, the user interface 400 includes a "set Touch ID" interface that prompts the user to register a fingerprint to act as the user's Touch ID. A registered fingerprint (eg, Touch ID) can be used to unlock the device in lieu of a passcode or personal identification number (PIN), and optionally to purchase goods or services. .. In Figure 5A, the Set Touch ID interface is displayed during the device setup process. For example, the device configuration process occurs the first time a user powers on a device. For example, the device configuration process includes at least an optional fingerprint enrollment process (eg, shown in FIGS. 5B-5K and 5N-5T) and a passcode configuration process (eg, shown in FIG. 5M). .. "Touch The "Set ID" interface is the "Set Now" box 502, which causes the device 100 to start the fingerprint registration process when activated, and the passcode setting interface, which causes the device 100 to skip the fingerprint registration process when activated ( For example, it contains a "Set Later" box 504 to display (shown in Figure 5M). For example, the "set now" box 502 may include a fingerprint when a contact (eg, touch input or tap gesture) is detected in or above the "set now" box 502, or on the fingerprint sensor 169. It is activated when it is detected. For example, the "set later" box 504 is activated when a touch input is detected in or above the "set later" box 504. FIG. 5A also shows that the device 100 detects a contact 506 (eg, a tap gesture) at a position on the touch screen 112 corresponding to the "set now" box 502. Alternatively, FIG. 5A detects the fingerprint 508 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169 as part of a first finger gesture (eg, first touch and placement gesture) and fingerprints. Shown is a device 100 that collects information from the first finger gesture.
FIG. 5B shows device 100 displaying a first fingerprint registration interface for the fingerprint registration process on the touch screen 112 in response to the detection of contact 506 in FIG. 5A. In some embodiments, the fingerprint registration process involves at least a first fingerprint registration interface (eg, shown in FIGS. 5B-5G and 5O-5Q), and a second fingerprint registration interface (eg, FIG. 5H). ~ Fig. 5J and Fig. 5R ~ (shown in Fig. 5S) are included. In FIG. 5B, the first fingerprint registration interface prompts the user to perform multiple individual and separate static finger gestures with the corresponding finger on the fingerprint sensor 169, instructing the user to register the fingerprint of the corresponding finger. include. In FIG. 5B, the first fingerprint registration interface also includes a progress indicator 510 in the first state 510-a. For example, in the first state 510-a, the progress indicator 510 is an imitation fingerprint with elongated ridges. The first state 510-a indicates that fingerprint information has not been collected. Figure 5B also shows the "Touch" of Figure 5A on device 100 when activated. Shows a "back" affordance 509 that redisplays the "Set ID" interface. FIG. 5B further shows that the device 100 detects the fingerprint 512 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169 as part of the first finger gesture and collects fingerprint information from the first finger gesture. Show to do.
FIG. 5C shows a device 100 that changes the appearance of the progress indicator 510 in response to the detection of the first finger gesture. For example, the first finger gesture corresponds to the fingerprint 508 of FIG. 5A or the fingerprint 512 of FIG. 5B. In Figure 5C, device 100 displays the progress indicator 510 in the second state 510-b. In FIG. 5C, at least a portion of the ridge of the progress indicator 510 is thicker (or darker) in the second state 510-b than in the first state 510-a of FIG. 5B. The second state 510-b of the progress indicator 510 collects some fingerprint information, but one or more changes to register the first fingerprint (eg, the fingerprint corresponding to the user's right index finger). Indicates that a finger gesture is needed. FIG. 5C also shows device 100 detecting fingerprint 514 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169 as part of a second finger gesture (eg, second touch and placement gesture). And show that fingerprint information is collected from the second finger gesture.
FIG. 5D shows device 100 displaying a message on the touch screen 112 prompting the user to perform a subsequent finger gesture different from the second finger gesture detected in FIG. 5C. In FIG. 5D, the device 100 displays the message 516 first registration interface (progress indicator 510 in second state 510-b) on the touch screen 112 in response to detecting the second finger gesture in FIG. 5C. Includes). In FIG. 5D, message 516 includes instructions instructing the user to move each finger between each finger gesture to collect fingerprints and corresponding fingerprint information in different regions of each finger. In some embodiments, the message 516 is closed and the fingerprint is closed when the contact is detected in the message 516 at the position corresponding to the "OK" affordance, or when the fingerprint sensor 169 detects the next finger gesture. The registration process is restarted. FIG. 5D also shows device 100 detecting fingerprint 518 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169 as part of a third finger gesture (eg, third touch and placement gesture). And show that fingerprint information is collected from the third finger gesture.
FIG. 5E shows a device 100 that changes the appearance of the progress indicator 510 in response to detecting a third finger gesture in FIG. 5D. In Figure 5E, device 100 displays the progress indicator 510 in the third state 510-c. In FIG. 5E, the larger amount of ridges on the advance indicator 510 is thicker than in the second state 510-b of FIG. 5B. The third state 510-c of the progress indicator 510 collects more fingerprint information, but one or more additions to register the first fingerprint (eg, corresponding to the user's right index finger). Indicates that a finger gesture is needed. FIG. 5E also shows that device 100 detects fingerprint 520 (eg, corresponding to the user's right index finger) on fingerprint sensor 169 as part of a fourth finger gesture (eg, fourth touch and placement gesture). Then, it is shown that fingerprint information is collected from the fourth finger gesture.
FIG. 5F shows device 100 displaying a message on the touch screen 112 prompting the user to perform a subsequent finger gesture different from the fourth finger gesture detected in FIG. 5E. In FIG. 5F, device 100 includes a first registration interface (progress indicator 510 in third state 510-c) on the touch screen 112 in response to detecting a fourth finger gesture in FIG. 5E. ) Is displayed with message 522. In FIG. 5F, message 522 includes an instruction instructing the user to keep his finger on the fingerprint sensor 169 for a longer period of time to collect fingerprint information. In some embodiments, the message 522 comprises an instruction indicating that the user feels a vibration signaling when the user's finger may be lifted from the fingerprint sensor 169. In some embodiments, the message 522 is closed and the fingerprint is closed when the contact is detected in the message 522 at the position corresponding to the "OK" affordance, or when the fingerprint sensor 169 detects the next finger gesture. The registration process is restarted. FIG. 5F also shows device 100 detecting contact 524 at a position on the touch screen 112 corresponding to the "OK" affordance in message 522.
FIG. 5G shows a device 100 displaying a first fingerprint registration interface with a progress indicator 510 in a third state 510-c in response to detecting contact 524 in FIG. 5F. FIG. 5G also shows that device 100 detects fingerprint 526 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169 as part of a fifth finger gesture (eg, fifth touch and placement gesture). And show that fingerprint information is collected from the fifth finger gesture.
FIG. 5H displays a second fingerprint registration interface on the touch screen 112 for the fingerprint registration process in response to the detection of the fifth finger gesture in Figure 5G, changing the appearance of the progress indicator 510. Indicates device 100. In FIG. 5H, the second fingerprint registration interface presents one or more additional individual and separate static finger gestures to the user on the fingerprint sensor 169 with the corresponding finger (eg, the user's right index finger). Prompt to do so, collect fingerprint information about the corresponding finger fingerprint area (eg, the edge) that is missing from the previously collected fingerprint information, and put it on the first fingerprint (eg, the user's right index finger). Includes an order to complete the registration (corresponding). In FIG. 5H, device 100 displays the progress indicator 510 in the fourth state 510-d. In FIG. 5H, the progress indicator 510 is magnified in the fourth state 510-d to show a thin ridge around a larger ellipse that surrounds the internal region of the thickened ridge. In FIG. 5H, the internal area of the progress indicator 510 corresponds to the unmagnified progress indicator 510 included in the first registration interface displayed in FIGS. 5B-5G. In this example, a larger amount of ridges in the internal region of the progress indicator 510 are thicker in the fourth state 510-d compared to the third state 510-c in FIG. 5G. The fourth state 510-d of the progress indicator 510 collects more fingerprint information, but one or more to register the first fingerprint (eg, the fingerprint corresponding to the user's right index finger). Indicates that further finger gestures are needed. FIG. 5H also shows that the device 100 detects the fingerprint 528 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169 as part of the sixth finger gesture (eg, the sixth touch and placement gesture). Then, it is shown that fingerprint information is collected from the sixth finger gesture.
FIG. 5I shows a device 100 that changes the appearance of the progress indicator 510 in response to detecting the sixth finger gesture of FIG. 5H. In FIG. 5H, the device 100 displays the progress indicator 510 in the fifth state 510-e. In FIG. 5I, a part of the ridge line on the outer circumference of the progress indicator 510 is thicker in the fifth state 510-e as compared with the fourth state 510-d in FIG. 5H. The fifth state 510-e of the progress indicator 510 collects more fingerprint information, but one or more to register the first fingerprint (eg, the fingerprint corresponding to the user's right index finger). Indicates that further finger gestures are needed. FIG. 5I also shows that device 100 detects fingerprint 530 (eg, corresponding to the user's right index finger) on fingerprint sensor 169 as part of a seventh finger gesture (eg, fourth touch and placement gesture). And show that fingerprint information is collected from the 7th finger gesture.
FIG. 5J shows a device 100 that changes the appearance of the progress indicator 510 in response to detecting the seventh finger gesture of FIG. 5I. In FIG. 5J, device 100 displays the progress indicator 510 in the sixth state 510-f. In FIG. 5J, all the ridges on the outer circumference of the progress indicator 510 are thickened in the fifth state 510-f. In this example, the sixth state 510-f of the progress indicator 510 indicates that no additional finger gesture is required to register the first fingerprint (eg, the fingerprint corresponding to the user's right index finger).
FIG. 5K shows the device 100 displaying a third fingerprint registration interface on the touch screen 112 after changing the appearance of the progress indicator 510 of FIG. 5J. In FIG. 5K, the third fingerprint registration interface indicates that the first fingerprint (eg, the fingerprint corresponding to the user's right index finger) has been successfully registered using the device 100. In Figure 5K, the third fingerprint registration interface, when activated, includes a "continue" box 534 that causes device 100 to display the interface for the next step in the device configuration process. FIG. 5K also shows that the device 100 detects a contact 536 (eg, a tap gesture) at a position on the touch screen 112 corresponding to the "continue" box 534.
FIG. 5L shows device 100 displaying a "Set up Purchase Touch ID" interface on the touch screen 112 in response to the detection of contact 536 at FIG. 5K. The "Set up Touch ID for purchase" interface will allow the user to associate the fingerprint registered in Figures 5B-5K with the purchase credentials (eg, store login ID and password, credit card information, billing address, etc.). To urge. "Touch for purchase The Set ID interface, when activated, initiates a purchase setup process that associates the purchase credential with a previously enrolled fingerprint on device 100 in the Set Now box 538, and when activated. Includes a "Set Later" box 540, which causes device 100 to skip the purchase setup process and display the passcode setup interface. For example, the "Set Now" box 538 is activated when a touch input is detected in or above the "Set Later" box 538, and the "Set Later" box 540 is "Set Later". It is activated when a touch input is detected in or above the "Set" box 540. FIG. 5L also shows that the device 100 detects a contact 542 (eg, a tap gesture) at a position on the touch screen 112 corresponding to the "set later" box 540.
FIG. 5M shows device 100 displaying a passcode setting interface on the touch screen 112 in response to the detection of contact 542 in FIG. 5L. In Figure 5M, the passcode setting interface contains multiple softkeys that allow the master passcode or PIN to be set for the device.
FIGS. 5N-5T show that a second fingerprint is registered using the portable multifunction device 100 from the configuration interface.
FIG. 5N shows the device 100 displaying the fingerprint setting interface on the touch screen 112. In Figure 5N, the fingerprint configuration interface has a "back" affordance 544 that causes device 100 to redisplay a previous configuration interface that is different from the fingerprint configuration interface when activated, and fingerprints on device 100 when activated. Includes an "Edit" affordance 546 that changes the appearance of the configuration interface to allow users to remove or edit their registered fingerprints. In Figure 5N, the fingerprint configuration interface is also configured to turn on / off the passcode unlock feature, which allows the user to unlock the device using a registered fingerprint instead of the passcode. Includes a toggle switch 548 and a toggle switch 550 configured to turn on / off the ability to purchase goods and services with a registered fingerprint. In Figure 5N, the passcode unlock feature is turned on and the ability to purchase goods and services with a registered fingerprint is turned off.
In Figure 5N, the fingerprint configuration interface also includes a list of registered fingerprints. In Figure 5N, the list of registered fingerprints contains the "Fingerprint 1" box 552, which, when activated, changes the appearance of the "Fingerprint 1" box 552 on device 100 to the user's registered fingerprints. Allows the name to be edited and includes an "Add Fingerprint" box 554, which, when activated, causes device 100 to initiate the fingerprint registration process. For example, the registered "fingerprint 1" corresponds to a first fingerprint (eg, the fingerprint corresponding to the user's right index finger) registered during the registration process shown in FIGS. 5B-5K. FIG. 5N also shows that the device 100 detects a contact 556 (eg, a tap gesture) at a position on the touch screen 112 corresponding to the "Add Fingerprint" box 554.
FIG. 5O shows device 100 displaying a first fingerprint registration interface for the fingerprint registration process on the touch screen 112 in response to detecting contact 556 in FIG. 5N. In Figure 5O, the first fingerprint registration interface prompts the user to perform multiple individual and separate static finger gestures with the corresponding finger on the fingerprint sensor 169, instructing the user to register the fingerprint of the corresponding finger. include. In FIG. 5O, the first fingerprint registration interface also includes a progress indicator 558 in the first state 558-a. For example, in the first state 558-a, the progress indicator 558 is an imitation fingerprint with elongated ridges. The first state, 558-a, indicates that fingerprint information has not been collected. Figure 5O also shows a "back" affordance 557 that causes device 100 to redisplay the fingerprinting interface of Figure 5N when activated. FIG. 5O further shows that the device 100 detects the fingerprint 560 (eg, corresponding to the user's left index finger) on the fingerprint sensor 169 as part of the first finger gesture (eg, the first touch and placement gesture). And show that fingerprint information is collected from the first finger gesture.
FIG. 5P shows a device 100 that changes the appearance of the progress indicator 558 in response to detecting the first finger gesture of FIG. 5O. In Figure 5P, device 100 displays the progress indicator 558 in the second state 558-b. In FIG. 5P, at least some of the ridges of the progress indicator 558 are thicker (or darker) in the second state 558-b compared to the first state 558-a in FIG. 5O. The second state 558-b of the progress indicator 558 collects some fingerprint information, but one or more to register the second fingerprint (eg, the fingerprint corresponding to the user's left index finger). Indicates that further finger gestures are needed. FIG. 5P also shows that the device 100 places the fingerprint 562 (eg, corresponding to the index finger of the user's left hand) on the fingerprint sensor 169 as part of a second finger gesture (eg, a second touch and placement gesture). Indicates that it detects and collects fingerprint information from the second finger gesture.
FIG. 5Q shows device 100 displaying a message on the touch screen 112 prompting the user to perform a subsequent finger gesture different from the second finger gesture detected in FIG. 5P. In FIG. 5Q, device 100 includes a first registration interface (progress indicator 558 in second state 558-b) on the touch screen 112 in response to detecting a second finger gesture in FIG. 5P. ) Is displayed with message 564. In Figure 5Q, message 564 clicks / presses the home button 204 until the user feels a finger vibration on the fingerprint sensor 169 (eg, integrated with the home button 204) to collect fingerprint information. Includes instructions to instruct to load without. In some embodiments, the message 564 is closed and fingerprinted when the contact is detected in the message 564 at the position corresponding to the "OK" affordance, or when the fingerprint sensor 169 detects a subsequent finger gesture. The registration process is restarted. FIG. 5Q also shows that the device 100 detects the fingerprint 566 (eg, corresponding to the user's left index finger) on the fingerprint sensor 169 as part of a third finger gesture (eg, a third touch and placement gesture). And show that fingerprint information is collected from the third finger gesture.
FIG. 5R displays a second fingerprint registration interface on the touch screen 112 for the fingerprint registration process in response to the detection of the third finger gesture in Figure 5Q, changing the appearance of the progress indicator 558. The device 100 is shown. In FIG. 5R, the second fingerprint registration interface presents one or more additional individual and separate static finger gestures to the user with the corresponding finger (eg, the user's left index finger) on the fingerprint sensor 169. Prompt to do so, collect fingerprint information about the corresponding finger fingerprint area (eg, the edge) that is missing from the previously collected fingerprint information, and then collect the second fingerprint (corresponding to the user's left index finger). Includes an order to complete the registration of. In Figure 5R, device 100 displays the progress indicator 558 in the third state 558-c. For example, the progress indicator 510 is magnified in the third state 558-c to show a thin ridge around a larger ellipse that surrounds the internal region of the thickened ridge. In FIG. 5R, the internal area of the progress indicator 558 corresponds to the unmagnified progress indicator 558 contained in the first registration interface displayed in FIGS. 5O-5Q. In this example, a larger amount of ridges in the internal region of the progress indicator 558 are thicker in the third state 558-c compared to the second state 510-b in FIG. 5P. The third state 558-c of the progress indicator 558 collects more fingerprint information, but one or more to register the second fingerprint (eg, the fingerprint corresponding to the user's left index finger). Indicates that further finger gestures are needed. FIG. 5R also shows device 100 detecting fingerprint 568 (eg, corresponding to the user's left index finger) on the fingerprint sensor 169 as part of a fourth finger gesture (eg, fourth touch and placement gesture). Then, it is shown that fingerprint information is collected from the fourth finger gesture.
FIG. 5S shows the device 100, which has changed the appearance of the progress indicator 558 in response to the detection of the fourth finger gesture in FIG. 5R. In Figure 5S, device 100 displays the progress indicator 558 in the fourth state 510-d. In FIG. 5S, a part of the ridge line on the outer circumference of the progress indicator 558 is thicker in the fourth state 510-d as compared with the third state 510-c in FIG. 5R. The fourth state 510-d of the progress indicator 558 collects more fingerprint information, but one or more to register the second fingerprint (eg, the fingerprint corresponding to the user's left index finger). Indicates that further finger gestures are needed. In other words, the fourth state 510-d of the progress indicator 558 is not perfect and does not indicate completion, thus requiring one or more additional finger gestures to register the second fingerprint. show. FIG. 5S also shows that device 100 detects fingerprint 569 (eg, corresponding to the user's left index finger) on fingerprint sensor 169 as part of a fifth finger gesture (eg, fifth touch and placement gesture). And show that fingerprint information is collected from the fifth finger gesture.
FIG. 5T shows device 100 displaying a third fingerprint registration interface on the touch screen 112 in response to detecting a fifth finger gesture in FIG. 5S. In FIG. 5T, the third fingerprint registration interface shows that the second fingerprint (eg, the fingerprint corresponding to the user's left index finger) has been successfully registered with device 100. In Figure 5T, the third fingerprint registration interface includes a "continue" box 570 that causes device 100 to redisplay the fingerprint configuration interface when activated. FIG. 5T also shows that the device 100 detects a contact 572 (eg, a tap gesture) at a position on the touch screen 112 corresponding to the "continue" box 570.
FIGS. 5U to 5W show that when a registered fingerprint is detected, the registered fingerprint is highlighted in the fingerprint setting interface.
FIG. 5U shows a device 100 displaying a fingerprint configuration interface on a touch screen 112 in response to detecting a contact 570 in FIG. 5T. In Figure 5U, the list of registered fingerprints includes the "Fingerprint 1" box 552, the "Fingerprint 2" box 574, and the "Add fingerprint" box 554, and the "Fingerprint 1" box 552 is the device when activated. Change the appearance of the "Fingerprint 1" box 552 to 100 to make the name of the registered fingerprint by the user editable, and the "Fingerprint 2" box 574 will be activated to the device 100 to have the "Fingerprint 2" bookkeeping box. Modifying the appearance of the 574 to allow the user to edit the name of the registered fingerprint, the Add Fingerprint box 554 provides a fingerprint registration process to register more fingerprints on the device 100 when activated. Let it start. For example, the registered "fingerprint 1" corresponds to the first fingerprint registered during the registration process shown in FIGS. 5B-5K (eg, the fingerprint corresponding to the user's right index finger) and the registered "fingerprint". 2 corresponds to a second fingerprint (eg, corresponding to the user's left index finger) registered during the registration process shown in FIGS. 5N-5T.
FIG. 5U also shows device 100 detecting fingerprint 576 (eg, corresponding to the user's left index finger) on fingerprint sensor 169. In response to the detection of fingerprint 576, the device 100 highlights the registered fingerprint corresponding to the detected fingerprint (if any) in the list of registered fingerprints. In FIG. 5U, for example, device 100 informs the user that the detected fingerprint 576 corresponds to the registered "fingerprint 2" by increasing the thickness of the border of the "fingerprint 2" box 574.
FIG. 5V shows a device 100 that detects a fingerprint 578 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169. In response to the detection of the fingerprint 578, the device 100 highlights the registered fingerprint corresponding to the detected fingerprint (if any) in the list of registered fingerprints. In Figure 5V, for example, device 100 informs the user that the detected fingerprint 578 corresponds to the registered "fingerprint 1" by increasing the thickness of the border of the "fingerprint 1" box 552.
FIG. 5W shows a device 100 that detects a fingerprint 580 (eg, corresponding to the user's left thumb). In response to the detection of the fingerprint 580, if the device 100 determines that the detected fingerprint 580 does not correspond to any of the registered fingerprints, it highlights any of the registered fingerprints in the list of registered fingerprints. Do not show. In FIG. 5W, for example, device 100 maintains the display of the fingerprint setting interface to indicate that the detected fingerprint 580 does not correspond to any of the registered fingerprints.
FIGS. 5X to 5AA show that a restricted operation is performed when a registered fingerprint is detected.
FIG. 5X shows a device 100 displaying a lock screen on a touch screen 112. In Figure 5X, for example, device 100 is in locked or restricted access mode. FIG. 5X also shows that the device 100 detects the fingerprint 582 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169.
FIG. 5Y shows the device 100 displaying a home screen on the touch screen 112 in response to the detection of the fingerprint 582 in FIG. 5X and in accordance with the determination that the fingerprint 582 corresponds to the registered fingerprint. For example, the fingerprint 582 corresponds to the right index finger of the user registered as the first fingerprint of FIGS. 5B-5K. In FIG. 5Y, for example, device 100 is in unlocked or unlimited access mode.
FIG. 5Z shows a device 100 displaying a lock screen on a touch screen 112. In Figure 5Z, for example, device 100 is in locked or restricted access mode. FIG. 5Z also shows that the device 100 detects the fingerprint 584 (eg, corresponding to the user's right thumb) on the fingerprint sensor 169.
FIG. 5AA shows a device 100 that maintains a lock screen display on the touch screen 112 in response to the detection of the fingerprint 584 in FIG. 5Z and in accordance with the determination that the fingerprint 584 does not correspond to a registered fingerprint. In Figure 5AA, for example, device 100 is in locked or restricted access mode.
Figures 5BB to 5EE show that the appearance of the progress indicator changes in response to a series of individual and separate static finger gestures.
FIG. 5BB shows the appearance of a progress indicator after multiple individual and separate stationary finger gestures (eg, touch and placement gestures). In Figure 5BB, the progress indicator is an imitation fingerprint with multiple ridges. In Figure 5BB, the ridge of the progress indicator becomes thicker (or darker) as fingerprint information is collected from the finger gesture. In some embodiments, the ridges of the progress indicator are thickened according to a predetermined pattern. In FIG. 5BB, for example, the appearance of the progress indicator after finger gesture 5 is the same as after finger gesture 4. This is because fingerprint information was not collected during finger gesture 5. In this embodiment, the user clicked the home button because the fingerprint information was not placed on the fingerprint sensor long enough (eg, message 522 in FIG. 5F) during the finger gesture 5. It was not collected because of message 564) in Figure 5Q or because the user failed to move his finger between finger gestures (message 516 in Figure 5D). In Figure 5BB, the progress indicator is magnified after the finger gesture 7 to show that more fingerprint information needs to be collected for the edge of the fingerprint in order to register the fingerprint.
FIG. 5CC shows the appearance of a progress indicator after multiple individual and separate stationary finger gestures (eg, touch and placement gestures). In Figure 5CC, the progress indicator contains multiple concentric circles (eg, mimicking the center of the target). In Figure 5CC, the progress indicator circle (or ring) fills from the innermost circle as fingerprint information is collected from the finger gesture. In FIG. 5CC, for example, the appearance of the progress indicator after finger gesture 5 is the same as after finger gesture 4. This is because fingerprint information was not collected during finger gesture 5. In this embodiment, the user clicked the home button because the fingerprint information was not placed on the fingerprint sensor long enough (eg, message 522 in FIG. 5F) during the finger gesture 5. It was not collected because of message 564) in Figure 5Q or because the user failed to move his finger between finger gestures (message 516 in Figure 5D). In Figure 5CC, the progress indicator is magnified after the finger gesture 7 to show that more fingerprint information needs to be collected in order to register the fingerprint.
FIG. 5DD shows the appearance of a progress indicator after multiple individual and separate stationary finger gestures (eg, touch and placement gestures). In Figure 5DD, the progress indicator includes multiple progress indicator parts (eg, hexagonal geometry in a honeycomb layout). In FIG. 5DD, the progress indicator portion (eg, hexagon) of the progress indicator is filled with respect to the position of the fingerprint information collected from the previous finger gesture. In FIG. 5DD, for example, after the finger gesture 1 is performed, the progress indicator portion in the lower left region of the progress indicator is filled to show that fingerprint information for the lower left region of the fingerprint is collected from the finger gesture 1. In Figure 5DD, the progress indicator is magnified after the finger gesture 6 to show that more fingerprint information needs to be collected for the edge of the fingerprint in order to register the fingerprint. In FIG. 5DD, for example, the appearance of the progress indicator after finger gesture 10 is the same as after finger gesture 9. This is because the fingerprint method was not collected during the finger gesture 10. In this embodiment, the user clicked the home button because the fingerprint information was not placed on the fingerprint sensor long enough (eg, message 522 in FIG. 5F) during the finger gesture 10. It was not collected because of message 564) in Figure 5Q or because the user failed to move his finger between finger gestures (message 516 in Figure 5D).
FIG. 5EE shows the appearance of a progress indicator after multiple individual and separate stationary finger gestures (eg, touch and placement gestures). In FIG. 5EE, the progress indicator (eg, a partially displayed sphere) includes a plurality of progress indicator parts (eg, a partially displayed spherical framed area). In Figure 5EE, the progress indicator portion of the progress indicator (eg, the framed area) is filled with the position of the fingerprint information collected from the previous finger gesture. In FIG. 5EE, for example, after the finger gesture 1 is performed, the progress indicator portion near the equatorial source of the progress indicator is filled to show that fingerprint information about the center of the fingerprint is collected from the finger gesture 1. In FIG. 5EE, for example, the appearance of the progress indicator after finger gesture 9 is the same as after finger gesture 8. This is because fingerprint information was not collected during finger gesture 9. In this embodiment, the user clicked the home button because the fingerprint information was not placed on the fingerprint sensor long enough (eg, message 522 in FIG. 5F) during the finger gesture 9. It was not collected because of message 564) in Figure 5Q or because the user failed to move his finger between finger gestures (message 516 in Figure 5D).
6A-6D are flow diagrams illustrating a method 600 for registering a fingerprint using a device, according to some embodiments. Method 600 is performed on an electronic device with a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the fingerprint sensor is on the display. In some embodiments, the display is separate from the fingerprint sensor. Some actions of the method 600 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 600 provides an intuitive method for enrolling fingerprints using the device. This method reduces the user's cognitive burden when registering fingerprints using the device, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, allowing users to register their fingerprints faster and more efficiently with the device saves power and extends the battery charge time interval.
The device displays the fingerprint registration interface (602). In some embodiments, the fingerprint registration interface is displayed as part of the device setup process. For example, FIGS. 5A-5M show a device configuration process including the fingerprint registration process of FIGS. 5B-5K, the purchase setup process of FIG. 5L, and the passcode setup process of FIG. 5M. In FIGS. 5B-5K, the fingerprint registration process is the first registration interface of FIGS. 5B-5G with the unmagnified progress indicator, the second registration of FIGS. 5H-5J with the magnified progress indicator, And includes a third registration interface in Figure 5K with text indicating that the fingerprint registration process was successful. In some embodiments, the fingerprint registration interface is displayed during the device configuration process before displaying the passcode configuration interface. For example, the fingerprint registration process shown in FIGS. 5B-5K displays the passcode setting interface of Figure 5M in response to detecting contact 506 at the location corresponding to the "Set Now" box 502 in Figure 5A. Occurs before the password.
In some embodiments, when the fingerprint registration interface is closed without registering a fingerprint, the passcode setting interface is displayed. For example, the device displays the passcode setting interface of Figure 5M in response to detecting a contact at the location corresponding to the "Set Later" box 504 in Figure 5A.
In some embodiments, the fingerprint registration interface is displayed as part of the device configuration user interface. For example, FIGS. 5O-5T show the fingerprint registration process initiated in response to the detection of contact 556 at the location corresponding to the "Add Fingerprint" box 554 in FIG. 5N's fingerprint configuration interface. In FIGS. 5O-5T, the fingerprint registration process has a first registration interface in FIGS. 5O-5Q with an unmagnified progress indicator, a second registration in FIGS. 5R-5S with an enlarged progress indicator, And includes a third registration process in Figure 5T with text indicating that the fingerprint registration process was successful.
The device detects multiple individual and distinct static finger gestures made on the corresponding finger on the fingerprint sensor (604). For example, a plurality of individual and separate stationary finger gestures are gestures in which the corresponding finger does not move across the fingerprint sensor, such as a tap and hold gesture on the fingerprint sensor. Thus, in some embodiments, the plurality of finger gestures is not a swipe gesture on the fingerprint sensor. For example, device 100 detects seven individual and distinct finger gestures (eg, touch and placement gestures) on the fingerprint sensor 169 during the fingerprint registration process shown in FIGS. 5B-5K. As another embodiment, device 100 detects five individual and distinct finger gestures (eg, touch and placement gestures) on the fingerprint sensor 169 during the fingerprint registration process shown in FIGS. 5N-5K.
The device collects fingerprint information from multiple individual and separate static finger gestures made with the corresponding finger (606). For example, the device 100 obtains fingerprint information from the fingerprint detected on the fingerprint sensor 169 into seven individual and separate finger gestures (eg, touch and placement gestures) during the fingerprint registration process shown in FIGS. 5B-5K. Collect (or try to collect) as part of each of them. As another embodiment, the device 100 obtains fingerprint information from the fingerprint detected on the fingerprint sensor 169 into seven individual and separate finger gestures (eg, touch) during the fingerprint registration process shown in FIGS. 5N-5T. And collect (or try to collect) as part of each of the placement gestures).
In some embodiments, the fingerprint information from multiple individual and separate quiescent finger gestures is at least twice as large as the area that can be captured by the fingerprint sensor in a single quiescent finger gesture, the area of the corresponding finger fingerprint. Is collected (608). For example, the entire fingerprint cannot be captured based on a single static finger gesture. This is because the fingerprint sensor is substantially smaller than the area to which the fingerprint is associated. In some embodiments, the fingerprint information collected from multiple individual and separate static finger gestures is 100 mm of the corresponding finger fingerprint.<sup>2</sup>The fingerprint sensor is 50mm, while it accommodates larger areas.<sup>2</sup>Or 25mm<sup>2</sup>It has a smaller sensor area such as:
In some embodiments, the device collects fingerprint information (610) while the corresponding finger is on the fingerprint sensor during the corresponding stationary gesture, and provides tactile feedback on the device after the fingerprint information is collected. Indicates that fingerprint information has been collected. For example, the device vibrates lightly to indicate to the user that fingerprint information about the current stationary finger gesture can be collected to perform the next finger gesture. In some embodiments, the device takes some corresponding time to collect the fingerprint information, and tactile feedback is given after the finger rests on the fingerprint sensor for at least that some time. For example, message 522 in Figure 5F fingerprints from the fourth finger gesture detected in Figure 5E because the user did not rest his finger on the fingerprint sensor 169 for long enough to collect fingerprint information. Indicates that the information could not be collected. In some embodiments, the message 522 is light to indicate to the user that the fingerprint is collected on the fingerprint sensor 169 integrated with the home button 204 and the user may speak a finger from the fingerprint sensor 169. Includes instructions to instruct the user to rest his finger until the user feels the vibration. In some implementations, the corresponding time to collect fingerprint information from each fingerprint gesture is less than 1 second. In some implementations, the corresponding time to collect fingerprint information from each fingerprint gesture is less than 1 second and longer than 0.1 seconds. In some implementations, the corresponding time to collect fingerprint information from each fingerprint gesture is at least 0.25 seconds and less than 0.75 seconds.
In some embodiments, the fingerprint registration interface includes a progress indicator (612), and the device detects the corresponding stationary finger gesture made with the corresponding finger on the fingerprint sensor, and the device looks like the progress indicator. To indicate that more fingerprint information was collected from the corresponding stationary finger gesture. In FIGS. 5B-5K, the fingerprint registration process has a first registration interface of FIGS. 5B-5G with an unmagnified progress indicator and a second registration of FIGS. 5H-5J with an enlarged progress indicator. including. In this example, when fingerprint information is collected from multiple individual and separate finger gestures (eg, touch and placement gestures), the appearance of the progress indicator changes (eg, the ridges become thick).
In some embodiments, the fingerprint registration interface also includes a message prompting the user to place a finger on the fingerprint sensor in a typical manner, and the progress indicator is a fake / stock fingerprint. For example, the first registration interface of FIGS. 5B-5G directs the user to perform multiple finger gestures (eg, touch and placement gestures) on the fingerprint sensor 169 integrated with the home button 204. including. In FIGS. 5B to 5J, for example, the progress indicator 510 is an imitation fingerprint.
In some embodiments, the change in appearance of the progress indicator indicates the amount of fingerprint information collected relative to the amount of fingerprint information required to enroll the fingerprint. FIGS. 5BB-5EE show changes in the appearance of various progress indicators after multiple individual and distinct finger gestures (eg, touch and placement gestures). Each of the progress indicators of FIGS. 5BB to 5EE shows the amount of fingerprint information collected in comparison with the amount of fingerprint information required to register the fingerprint. In FIG. 5BB, for example, a thick ridge indicates the amount of fingerprint information collected and a thin ridge indicates the amount of fingerprint information not collected. In Figure 5CC, for example, a filled (or shaded) circle / ring indicates the fingerprint information collected, and the total number of circles / rings is the total amount of fingerprint information required to register the fingerprint. Is shown. In Figure 5DD, for example, a filled (or shaded) hexagon indicates the fingerprint information collected, and the total number of hexagons indicates the total amount of fingerprint information required to register the fingerprint. .. In Figure 5EE, for example, a partially displayed spherical filled (or shaded) box area indicates the fingerprint information collected, and the total number of partially displayed spherical box areas is , Indicates the total number of fingerprint information required to register the fingerprint.
In some embodiments, as more fingerprint information is collected, the progress indicator portions are filled in a default order, regardless of which fingerprint portion was detected. In FIGS. 5B to 5J, for example, the ridge of the progress indicator 510 becomes thicker according to a predetermined pattern regardless of which fingerprint portion is detected. In some embodiments, the portion of the progress indicator is filled based on the portion of the fingerprint from which fingerprint information has been collected. In FIG. 5DD, for example, the progress indicator includes a plurality of progress indicator portions (eg, hexagonal geometry in a honeycomb layout). In FIG. 5DD, the progress indicator portion (eg, hexagon) of the progress indicator is filled with respect to the position of the fingerprint information collected from the previous finger gesture. In FIG. 5EE, the progress indicator (eg, a partially displayed sphere) includes a plurality of progress indicator parts (eg, a partially displayed spherical framed area). In Figure 5EE, the progress indicator portion of the progress indicator (eg, the framed area) is filled with the position of the fingerprint information collected from the previous finger gesture.
In some embodiments, the progress indicator comprises a portion of the surface of a three-dimensional object (eg, a sphere or other ellipse) (614). In Figure 5EE, the progress indicator mimics a sphere that shows a portion of the surface of the sphere.
In some embodiments, the progress indicator takes the form of a fingerprint (eg, a stock or imitation fingerprint) (616), includes a line representing the ridge of the fingerprint, and changing the appearance of the progress indicator is a plurality of ridges. Includes coloring part of. In Figure 5BB, for example, the progress indicator is an imitation fingerprint with multiple ridges. In this example, the ridge of the progress indicator becomes thicker or colored as fingerprint information is collected from multiple finger gestures.
In some embodiments, the progress indicator comprises a plurality of concentric circles (618), and changing the appearance of the progress indicator fills one of the plurality of concentric circles with a default fill (eg, a default color and / or). Includes filling with pattern). In Figure 5CC, the progress indicator contains multiple concentric circles (eg, mimicking the center of the target). In some embodiments, the concentric circles are filled with a default fill, starting with the innermost circle and ending with the outermost circle. In Figure 5CC, the progress indicator circle (or ring) fills from the innermost circle as fingerprint information is collected from the finger gesture. In some embodiments, the concentric circles are filled with a default fill, from the outermost circle to the innermost circle.
In some embodiments, the progress indicator comprises a plurality of progress indicator portions corresponding to the fingerprint portion of the corresponding fingerprint (620), and when fingerprint information from the corresponding fingerprint portion is collected, the device has the corresponding progress. The appearance of the indicator portion is changed to indicate that fingerprint information has been collected from the corresponding fingerprint portion. In some embodiments, the progress indicator portion is a depiction of a fingerprint ridge. For example, after each finger gesture, the user's fingerprint corresponding to the fingerprint information collected from the previous finger gesture is presented by the progress indicator. In this example, the progress indicator mimics a typical image of a user's fingerprint constructed from multiple finger gestures (eg, an image of the user's fingerprint or a patchwork of scans). In this example, once a complete representative image of the user's fingerprint is presented, the user's fingerprint is registered using the device. In some embodiments, a typical image of the user's fingerprint is removed from the device after enrolling the fingerprint. In some embodiments, the progress indicator portion is a geometric shape (eg, a hexagon in a honeycomb layout). In FIG. 5DD, the progress indicators mimic a honeycomb layout with multiple progress indicator portions, each progress indicator portion having a hexagonal geometry. In Figure 5DD, the hexagon of the progress indicator is filled with respect to the position of the fingerprint information collected from the previous finger gesture. In FIG. 5EE, the progress indicator mimics a partially displayed sphere with multiple progress indicator parts, and each progress indicator part is a partially displayed spherical framed area. In Figure 5EE, the framed area of the progress indicator is filled with respect to the position of the fingerprint information collected from the previous finger gesture.
After collecting the fingerprint information, the device determines, based on the fingerprint information collected for that corresponding finger, whether the collected fingerprint information is sufficient to enroll the fingerprint of the corresponding finger with the device. (622). In some embodiments, the maximum number of images captured from each finger gesture can be combined to generate the required fingerprint information. For example, in some implementations, up to 15 images from each of the 15 finger gestures may be combined to generate the required fingerprint information.
In some embodiments, the collected fingerprint information is sufficient to register the corresponding finger fingerprint when the collected fingerprint information meets a predetermined criterion. In some embodiments, the default criteria include a threshold amount of fingerprint information (eg, a threshold amount of surface area). In some embodiments, the fingerprint information threshold amount is the default minimum amount of non-overlapping fingerprint area. For example, 15 images collected from each of the 15 finger gestures are 200 mm.<sup>2</sup>Combined to produce a non-overlapping area of fingerprints, 200mm<sup>2</sup>Is the default minimum area required to register a fingerprint. In some embodiments, the threshold amount of fingerprint information is a multiple of the surface area of the fingerprint sensor. For example, the fingerprint sensor is 25mm<sup>2</sup>When is, a sufficient amount of fingerprint information is the amount of non-superimposed fingerprint area that is eight times the surface area of the fingerprint sensor (eg 200 mm).<sup>2</sup>). In some embodiments, the default criteria include the quality of the default image collected from multiple finger gestures. For example, if a user's fingerprint from the corresponding finger gesture is too dirty, too thin, or does not meet other default criteria, the quality of the image collected from that finger gesture may meet the quality criteria. There is no. In some embodiments, the default criteria require a default degree of engagement attribute between images collected from multiple finger gestures. In some embodiments, the default criteria require that the fingerprint information be collected from the same finger.
According to the determination that the fingerprint information collected for the corresponding finger is sufficient to register the fingerprint of the corresponding finger, the device uses the device to register the fingerprint of the corresponding finger (624). .. In FIG. 5K, for example, device 100 determines that the first fingerprint (eg, the fingerprint corresponding to the user's right index finger) was successfully registered using device 100 after the seventh finger gesture of FIG. 5I. do. In FIG. 5T, for example, device 100 succeeds in enrolling with device 100 after the second fingerprint (eg, the fingerprint corresponding to the user's left index finger) detects the fifth finger gesture in FIG. 5S. Is determined.
According to the determination that the fingerprint information collected for the corresponding finger is not sufficient to register the fingerprint of the corresponding finger, the device displays a message on the fingerprint registration interface (626) to the user. , Encourage one or more additional static finger gestures on the fingerprint sensor with its corresponding finger. In FIGS. 5C-5I, for example, device 100 determines that the fingerprint information collected for the corresponding finger is not sufficient to register the fingerprint of the corresponding finger. In FIGS. 5C-5G, for example, device 100 causes the first fingerprint registration interface to perform one or more additional finger gestures to the user on the fingerprint sensor 169 integrated with the home button 204. Displaying instructions to indicate, in FIGS. 5H-5I, for example, the device 100 has a second fingerprint registration interface, a fingerprint sensor 169 that integrates one or more finger gestures for the user with the home button 204. When doing above, adjust the grip to display instructions instructing you to capture the edge of the fingerprint.
In some embodiments, the message prompting the user to make one or more further finger gestures (628) includes a displayed instruction to perform a subsequent finger gesture different from the corresponding finger gesture. In some embodiments, the device 100 displays one or more default messages or warning notifications to allow the user to make subsequent finger gestures in such a way that fingerprint information can be properly collected. prompt.
In some embodiments, the display message (628) comprises a displayed instruction on the fingerprint sensor that moves a finger between each finger gesture to collect information from the fingerprint with less finger gestures (eg,). "Move your finger. Move your finger a little between scans."). For example, message 516 in FIG. 5D provides fingerprint information because device 100 did not move the finger slightly from the second finger gesture detected in FIG. 5C compared to the position of the first finger gesture. Indicates that it could not be collected. In some embodiments, the device 100 provides negative tactile feedback (eg, two consecutive vibrations) while displaying instructions on the fingerprint sensor to move the user's finger more between each finger gesture. Provided to draw the user's attention and to notify the user that the device 100 was unable to collect fingerprint information from previous finger gestures.
In some embodiments, the message comprises a displayed instruction to leave the finger on the fingerprint sensor for a longer period of time (eg, "keep your finger on the sensor"). For example, message 522 in Figure 5F fingerprints from the fourth finger gesture detected in Figure 5E because the user did not rest his finger on the fingerprint sensor 169 for long enough to collect fingerprint information. Indicates that the information could not be collected. In some embodiments, the device 100 displays negative tactile feedback (eg, two consecutive) while displaying a message containing a displayed instruction to keep the user's finger on the fingerprint sensor 169 for a long time. Provides vibration) to draw the user's attention and inform the user that the device 100 was unable to collect fingerprint information from previous finger gestures.
In some embodiments, the message contains a displayed instruction to apply less pressure on the fingerprint sensor (eg, "Oops. You clicked. Home button until you feel a vibration without clicking." Place your finger on it. "). For example, in message 564 in FIG. 5Q, the device 100 was detected in FIG. 5P because the user clicked on the home button 204 instead of placing his finger on the fingerprint sensor 169 integrated with the home button 204. Indicates that fingerprint information could not be collected from the finger gesture. In some embodiments, the device 100 provides negative tactile feedback (eg, two consecutive vibrations) to attract the user's attention while displaying instructions on the fingerprint sensor 169 to apply less pressure. Pull to notify the user that the finger needs to rest on the fingerprint sensor 169 without clicking or pressing the home button 204.
In some embodiments where the fingerprint registration process relies on placement, the message comprises a displayed instruction to properly place the finger on the fingerprint sensor 169, with a depiction of the proper finger placement. In some of such embodiments, the device 100 provides negative tactile feedback (eg, two consecutive vibrations) while displaying instructions for proper finger placement on the fingerprint sensor 169. However, in some of the other embodiments, the registration process is placement independent.
In some embodiments, the message urging the user to make one or more further finger gestures is one or more parts of the corresponding fingerprint that have insufficient or not yet collected fingerprint information. Includes location indication (630) (eg, the message indicates that the edge of the fingerprint is missing from the collected fingerprint information). In some embodiments, the message changes the portion of the fingerprint that comes into contact with the fingerprint sensor, allowing the device to capture a specific portion of the fingerprint (eg, the tip of a finger on the fingerprint sensor). Includes instructions to put), displayed instructions that allow the device to capture more types of fingerprint information (eg, instructions to move the finger more between finger gestures). In FIGS. 5H-5I and 5R-5S, for example, the device 100 has one or more fingerprint sensors 169 integrated with the home button 204 for the user at the second fingerprint registration interface. Instructs the grip to be adjusted for further finger gestures and displays an instruction to capture the edge of the fingerprint. In some embodiments, the message changes the portion of the fingerprint that comes into contact with the fingerprint sensor so that the device can better combine information from multiple quiescent finger gestures (eg, a displayed instruction). Includes instructions to move the finger less between finger gestures).
In some embodiments, after changing the appearance of the plurality of progress indicator parts (eg, by coloring the plurality of progress indicator parts with the corresponding colors), and after the fingerprint information collected for the corresponding finger corresponds. According to the determination that it is sufficient to enroll the fingerprint of the finger, the device will display the appearance of one or more unchanged progress indicator parts with multiple progress indicator parts (eg, in the form of a fingerprint in the progress indicator). Change the appearance to match (by coloring the whole with its corresponding color) (632). In FIG. 5J, for example, device 100 makes a ridge of progress indicator 510 according to the determination that the fingerprint information collected after detecting the seventh finger gesture in FIG. 5I is sufficient to register the fingerprint. Thicken or thicken everything (compared to Figure 5I). In FIG. 5CC, for example, the device 100 floods after detecting the finger gesture 12 with a progress indicator according to the determination that the fingerprint information collected after detecting the finger gesture 12 is sufficient to register the fingerprint. (Flood fill).
In some embodiments, after enrolling the corresponding finger fingerprint with the device, the device has limited behavior (eg, unlocking the device, purchasing content or application for the device, or an individual on the device. Upon receiving a request to do (display information) (634), the device detects the fingerprint on the fingerprint sensor. In FIG. 5X, for example, FIGS. 5B-5K correspond to the first fingerprint (eg, corresponding to the user's right index finger) and FIGS. 5N-5T correspond to the second fingerprint (eg, corresponding to the user's left index finger). ), The device 100 receives a request to perform a restricted operation (eg, unlock the device 100) while the lock screen is displayed on the touch screen 112. In this example, the request for performing restricted operation includes a fingerprint 582 on the fingerprint sensor 169 (eg, corresponding to the user's right index finger). In FIG. 5Z, for example, FIGS. 5B-5K correspond to the first fingerprint (eg, corresponding to the user's right index finger) and FIGS. 5N-5T correspond to the second fingerprint (eg, corresponding to the user's left index finger). ), The device 100 receives a request to perform a restricted operation (eg, unlock the device 100) while the lock screen is displayed on the touch screen 112. In this example, the request includes a fingerprint 584 on the fingerprint sensor 169 (eg, corresponding to the user's right thumb).
In some embodiments, the device performs the restricted operation (638) in response to receiving a request to perform the restricted operation (636) and according to the determination that the fingerprint was registered with the device (638). .. In FIG. 5Y, for example, upon receiving a request to unlock device 100 in FIG. 5X, and according to the determination that fingerprint 582 is a registered fingerprint, device 100 (eg, restricted). The lock (of operation) is unlocked and a home screen with multiple application icons is displayed on the touch screen 112.
In some embodiments, the device performs the restricted operation in response to a request to perform the restricted operation (636) and according to the determination that the fingerprint has not been registered with the device. Cancel (640). In FIG. 5AA, the device 100 is locked on the touch screen 112, for example, in response to receiving a request to unlock device 100 in FIG. 5Z, and according to the determination that fingerprint 584 is not a registered fingerprint. Keep the screen visible and cancel unlocking (eg restricting operations).
In some embodiments, after registering the fingerprint of the corresponding finger with the device, the device with the fingerprint of each finger and the corresponding entry and other registered fingerprints of the other finger other than the corresponding finger. Displays a fingerprint configuration interface with multiple entries (eg, listing multiple entries), including one or more other entries corresponding (642) and corresponds to the corresponding finger fingerprint on the fingerprint sensor. Detects a second finger gesture and highlights the fingerprint of the corresponding finger and the corresponding entry in response to the detection of the second finger gesture (eg, a frame around the entry, the line of the entry). Increase the thickness, change the text or fill color of the entry, etc.). In FIGS. 5U-5W, for example, the device 100 displays a list of registered fingerprints on the fingerprint setting interface on the touch screen 112. In this example, the list of registered fingerprints is the "fingerprint 1" box 552 associated with the first fingerprint registered in FIGS. 5N-5T (eg, corresponding to the user's right index finger), and Figure 5B. ~ Includes a "fingerprint 2" box 574 associated with a second fingerprint registered in Figure 5K (eg, corresponding to the user's left index finger). In FIG. 5U, the device 100 increases the line thickness of the "fingerprint 2" box 574, for example, in response to detecting fingerprint 576 (eg, corresponding to the user's left index finger) on the fingerprint sensor 169. (Or highlight it separately) indicates that the detected fingerprint 576 corresponds to the registered "fingerprint 2". In FIG. 5V, the device 100 increases the line thickness of the "fingerprint 1" box 552, for example, in response to detecting fingerprint 578 (eg, corresponding to the user's right index finger) on the fingerprint sensor 169. By (or highlighting it separately), it is shown that the detected fingerprint 578 corresponds to the registered "fingerprint 1". In FIG. 5W, the device 100 maintains the display of the fingerprint setting interface, for example, in response to detecting a fingerprint 580 (eg, corresponding to the user's left thumb) on the fingerprint sensor 169.
In some embodiments, a given entry is renamed (eg, by typing a new name into the entry while the fingerprinting interface is in edit mode) and / or swiped across the entry (eg, swipe across the entry). You can delete it (by selecting the delete affordance that appears by detecting a swipe across the entry). In FIG. 5N, for example, device 100 displays a fingerprint configuration interface with an "edit" affordance 546 on a touch screen 112. When activated, the "Edit" affordance 546 causes device 100 to change the appearance of the fingerprinting interface (for example, display a deleted affordance next to each registered fingerprint) and the user is registered on device 100. Enter edit mode where you can delete the fingerprint or edit its name. In some embodiments, a limited number of fingerprints (eg, 3, 5, 10, or a significant number) can be enrolled at one time. This is to limit the time required to determine whether the fingerprint detected on the fingerprint sensor matches the registered fingerprint. For example, in some implementations, the number of registered fingerprints is limited so that the determination of whether the fingerprint detected on the fingerprint sensor matches the registered fingerprint can be completed in 0.5 seconds.
Understand that the specific order described for the actions in Figures 6A-6D is merely exemplary and is not intended to indicate that the order is the only order in which the actions can be performed. I want to be. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, the details of other processes described herein with respect to the methods described herein (eg, those described in paragraph [0080]) are in a manner similar to Method 600 described above in connection with FIGS. 6A-6D. Note that it is applicable in. For example, the fingerprints and gestures described above with reference to Method 600 are described herein with reference to other methods described herein (eg, methods described in paragraph [0080]). Optionally have one or more of the fingerprint and gesture features described. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 7 shows a functional block diagram of an electronic device 700 configured according to the principles of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 7 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 7, the electronic device 700 includes a display unit 702 configured to display a fingerprint registration interface and a fingerprint sensor unit 704. In some embodiments, the electronic device 700 optionally comprises a touch sensing surface unit 706 configured to receive one or more touch inputs and a tactile feedback unit configured to provide tactile feedback. And with. The electronic device 700 also includes a processing unit 710 that is coupled to the display unit 702 and the fingerprint sensor unit 704 and optionally coupled to the touch sensing surface unit 706 and the tactile feedback unit 708. In some embodiments, the processing unit 710 is highlighted with a detection unit 712, a collection unit 714, a determination unit 716, a registration unit 718, a display enablement unit 720, a receive unit 722, and an execution unit 724. It includes a display unit 726 and an appearance change unit 728.
The processing unit 710 detects multiple individual and separate static finger gestures performed on the corresponding finger on the fingerprint sensor unit 704 (eg, on the detection unit 712) and multiple individual performances performed on the corresponding finger. It is configured to collect fingerprint information (eg, with the collection unit 714) from a separate static finger gesture. After collecting the fingerprint information, the processing unit 710 determines whether the collected fingerprint information is sufficient to register the fingerprint of the corresponding finger using the device, based on the fingerprint information collected for the corresponding finger (eg,). , Judgment unit 716). According to the determination that the fingerprint information collected for the corresponding finger is sufficient to register the fingerprint of the corresponding finger, the processing unit 710 uses the electronic device 700 to register the fingerprint of the corresponding finger (eg, the registration unit). Configured to register (at 718). According to the determination that the fingerprint information collected for the corresponding finger is insufficient to register the fingerprint of the corresponding finger, the processing unit 710 enters the fingerprint registration interface with one or more of the corresponding fingers to the user. It is configured to enable the display of a message prompting further static finger gestures to be performed on the fingerprint sensor unit 704 (eg, on the display enablement unit 720).
In some embodiments, fingerprint information from multiple individual and separate static finger gestures is collected for the area of the corresponding finger fingerprint that is at least twice as large as the area that can be captured by the fingerprint sensor unit 704. Will be done.
In some embodiments, the processing unit 710 receives a request to perform restricted operation (eg, on the receiving unit 722) and detects a fingerprint on the fingerprint sensor 704 (eg, on the detection unit 712). It is composed of. Upon receiving the request to perform the restricted operation, the processing unit 710 performs the restricted operation (for example, in the execution unit 724) according to the determination that the fingerprint is registered using the device, and the fingerprint is generated. Cancels the execution of the restricted operation according to the determination that it is not registered using the device.
In some embodiments, the message prompting the user to perform one or more further finger gestures comprises a displayed instruction to perform a subsequent finger gesture as opposed to the corresponding finger gesture.
In some embodiments, the message prompting the user to perform one or more further finger gestures indicates one or more parts or locations of the corresponding fingerprint for which fingerprint information is inadequate or not collected. including.
In some embodiments, the processing unit 710 is configured to collect fingerprint information (eg, in the collection unit 714) while the corresponding finger is on the fingerprint sensor unit 704 during the corresponding stationary gesture. The electronic device 700 includes a tactile feedback unit 708 configured to provide tactile feedback to indicate that the electronic device 700 has collected fingerprint information after the fingerprint information has been collected.
In some embodiments, after registering the corresponding finger fingerprint on the electronic device 700, the processing unit 710 corresponds to the corresponding registered fingerprint, the corresponding entry corresponding to the corresponding finger fingerprint, and the corresponding entry thereof. Enable and support a fingerprint configuration interface with multiple entries (eg, on the display enablement unit 720), including one or more other entries that correspond to other registered fingerprints on other fingers than the finger. The second finger gesture corresponding to the fingerprint of the finger to be fingerprinted is detected on the fingerprint sensor unit 704 (for example, by the detection unit 712), and the fingerprint of the corresponding finger is detected in response to the detection of the second finger gesture. Highlight the corresponding entry (for example, on highlighting unit 726).
In some embodiments, the fingerprint registration interface includes a progress indicator, and in response to detection on the fingerprint sensor 704, the processing unit 710 changes the appearance of the progress indicator (eg, in the appearance change unit 728). Indicates that further fingerprint information has been collected from the corresponding stationary finger gesture.
In some embodiments, the progress indicator comprises a portion of the surface of the 3D object.
In some embodiments, the progress indicator takes the form of a fingerprint and includes a line representing the ridge of the fingerprint, and changing the appearance of the progress indicator may result in some of the ridges (eg, appearance changing unit 728). Including) coloring.
In some embodiments, the progress indicator contains a plurality of concentric circles, and changing the appearance of the progress indicator can fill one of the plurality of concentric circles with a default fill (eg, with the appearance change unit 728). include.
In some embodiments, the progress indicator comprises a plurality of progress indicator portions corresponding to the fingerprint portion of the corresponding fingerprint, and when fingerprint information is collected from the corresponding fingerprint portion, the processing unit 710 has the corresponding progress indicator portion. Is configured to vary in appearance (eg, in the appearance change unit 728) to indicate that fingerprint information has been collected from the corresponding fingerprint portion.
In some embodiments, the processing unit 710 has sufficient fingerprint information collected for the corresponding finger after changing the appearance of the plurality of progress indicator portions and for registering the fingerprint of the corresponding finger. It is configured to change the appearance of one or more unchanged progress indicator parts (eg, in the appearance change unit 728) to match the appearance of multiple (already changed) progress indicator parts according to the determination of. To.
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. Is executed arbitrarily by running.
The operations described above with reference to FIGS. 6A-6D are optionally performed by the components shown in FIGS. 1A, 1B, or 7. For example, the detection operation 602, the collection operation 606, the determination operation 622, and the registration operation 624 are arbitrarily executed by the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those of skill in the art how other processes will be carried out based on the components shown in FIGS. 1A-1B.
Perform fingerprint-based actions
Many electronic devices are configured to perform various actions. Existing methods for performing actions typically require performing the corresponding action in response to the corresponding input. For example, in existing methods, the user typically provides some input to perform a single action. When a user wants to perform a different action, the user needs to navigate through the menu or provide different inputs in order to perform the different action. In addition, certain secure actions involve personal information (eg, credit card information, passwords, etc.) or restricted functionality. Such secure operation typically requires user authentication (eg, using a passcode). Therefore, it is cumbersome and inefficient to perform a plurality of actions, including secure actions. In the embodiments described below, an improved method for performing an operation is obtained by performing a plurality of operations in response to a single input. Non-secure actions (eg resetting the display dimming timer) are performed in response to fingerprint input, regardless of the fingerprint's identification information (eg, whether the fingerprint belongs to an authorized user). On the other hand, secure actions (eg, revealing personal information) are performed in response to a fingerprint input when it contains a fingerprint that matches a pre-registered (eg, registered) fingerprint. Will be done. This method streamlines the execution of multiple actions in response to fingerprint input, thereby eliminating the need for additional and separate steps to perform multiple actions.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 8A-8W and 9A-9B include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 8A-8W and 9A-9B will be discussed with reference to a display 450, a separate touch sensing surface 451 and a separate fingerprint sensor 359-2. A similar operation responds by detecting the input described in FIGS. 8A-8W on the integrated fingerprint sensor 359-1 while displaying the user interface shown in FIGS. 8A-8B on the display 450. It is optionally executed on the device by the integrated fingerprint sensor 359-1. Further, similar behavior is optionally on a device with a touch screen 112, on a fingerprint sensor 169 (eg, an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-2), FIGS. 8A-8W. The user interface shown in FIGS. 8A to 8W is displayed according to the detection of the contact shown in FIG.
8A-8W show exemplary user interfaces for performing fingerprint-based operations, according to some embodiments.
FIG. 8A shows an exemplary user interface for a shopping web page. An exemplary user interface includes representations of information in multiple input fields (eg, 802-1 to 802-8) and corresponding input fields (eg, 804). The representation of the information in the corresponding input field is distinguished from the information in the corresponding input field. These representations are sometimes referred to as organized representations, and the information in these input fields is sometimes referred to as organized information. For example, as shown, a organized representation of information in the corresponding input field indicates that the corresponding input field contains information, but does not reveal the information in the corresponding input field. The organized information in the corresponding input field is represented in Figure 8A by a black circle (for example, a single black circle represents the corresponding character in the corresponding input field), but the organized information in the corresponding input field is , May be represented by any other character, shape, or visual representation that does not directly convey information in the corresponding input. In some implementations, one or more input fields in the corresponding user interface contain unorganized information, while these input fields show information in these input fields, while others in the input fields are organized. Includes organized information as indicated by a completed representation.
FIG. 8A also shows the display dimming timer 896-1 and the credential permit timer 898-1. The display dimming timer 896-1 and the credential permit timer 898-1 in FIG. 8A indicate that the display dimming timer 896-1 and the credential permit timer 898-1 are in the corresponding reset positions. In some embodiments, the display dimming timer 896-1 is a timer used to determine when to dimm the display of device 100. In some embodiments, the credential grant timer 898-1 is a timer used to determine when a registered fingerprint is no longer allowed to authenticate a user on device 100. The display dimming timer 896-1 and the credential permit timer 898-1 are shown in Figure 8A to illustrate the specific behavior of the device 100, but the display dimming timer 896-1 and the credential permit timer 898-1. Does not necessarily have to be shown on the touch screen 112. In some embodiments, the display dimming timer 896-1 is shown on the touch screen 112. In other embodiments, the display dimming timer 896-1 is not shown on the touch screen 112. In some embodiments, the credential grant timer 898-1 is shown on the touch screen 112. In other embodiments, the credential grant timer 898-1 is not shown on the touch screen 112.
FIG. 8B shows the display dimming timer 896-2 and the credential permit timer 898-2, indicating that time has passed. As shown in FIG. 8B, in some embodiments, the display dimming timer 896-1 expires earlier than the credential permit timer 898-1. For example, in some embodiments, the display dimming timer 896-1 expires in less than 1 minute and the credential permit timer 898-1 expires in 24 or 48 hours. In some implementations, the dimming timer has an expiration date that the user can choose for any of the default dimming timer expiration sets, for example 1 minute, 2 minutes, 5 minutes, and 10 minutes. Have. In some embodiments, the credential grant timer has a default expiration date (eg, 48 hours) that can be overridden by a user or a corporate policy that includes overriding one or more default settings. When overridden, the permission timer expiration time is set to a shorter period than the default expiration time (eg, 24 hours, 12 hours, 6 hours, 4 hours, or 2 hours).
Figure 8C shows that more time has passed and the display dimming timer 896-3 has expired. The touch screen 112 is automatically dimmed (the brightness of the touch screen 112 is reduced) according to the determination that the display dimming timer has expired.
FIG. 8C also shows that input 812 (eg, finger contact or contact with an object) is detected on the fingerprint sensor 169 while the touch screen 112 is dimmed. In some embodiments, the input 812 is ignored (eg, performed in response to the input 812) according to the determination that the input 812 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 812 contains a fingerprint.
8D-8F show a set of three corresponding actions that can be performed in response to the input 812, according to some embodiments, according to the determination that the input 812 contains a fingerprint.
FIG. 8D shows an exemplary set of actions performed according to input 812 including fingerprints (FIG. 8C), according to some embodiments. In Figure 8D, the display dimming timer 896-4 is reset and the touch screen 112 ceases to be dimmed (for example, the brightness of the touch screen 112 increases to the brightness of the touch screen 112 before dimming). In Figure 8D, the credential permission timer 898-4 is not reset. Also in FIG. 8D, the representation of information (eg, 804) in the corresponding input field (eg, 802-1 to 802-8) remains on the touch screen 112.
FIG. 8E shows a set of alternative actions performed in response to an input 812 including a fingerprint (FIG. 8C), according to some embodiments. In Figure 8E, the display dimming timer 896-5 is reset and the touch screen 112 stops dimming. In addition, the representation of the information in the corresponding input field (eg 802-1 to 802-8) (sometimes referred to as the organized representation) (eg 804 in Figure 8C) is the corresponding input. Replaced with information in the field (sometimes called unorganized information). For example, in Figure 8E, the representation of information in the corresponding input field is replaced with payment information (eg, credit card number, expiration date, security code, card name, billing address, etc.). In Figure 8F, the credential permission timer 898-5 is not reset.
FIG. 8F shows yet another set of alternative actions performed in response to an input 812 including a fingerprint (FIG. 8C), according to some embodiments. In Figure 8F, the display dimming timer 896-6 is reset and the touch screen 112 stops dimming. In addition, the representation of the information in the corresponding input field (eg 802-1 to 802-8) (sometimes referred to as the organized representation) (eg 804 in Figure 8C) is the corresponding input. Replaced with information in the field (sometimes called unorganized information). In addition, the credential permission timer 898-6 is reset.
In some embodiments, the corresponding set of actions shown in FIGS. 8E-8F is performed according to the determination that the fingerprint at input 812 matches the registered fingerprint. However, in some embodiments, the operation shown in FIG. 8D is performed regardless of whether the fingerprint at input 812 matches the registered fingerprint (eg, in some embodiments, FIG. 8D). The operation shown in is also performed when the fingerprint at input 812 does not match the registered fingerprint).
8G-8H show operations performed while the touch screen 112 is not dimmed, according to some embodiments.
FIG. 8G shows a user interface similar to the user interface shown in FIG. 8B. In Figure 8G, the display dimming timer 896-7 and the credential permit timer 898-7 have not expired yet. FIG. 8G also shows that input 814 is detected on the fingerprint sensor 169. In some embodiments, the input 814 is ignored (eg, performed in response to the input 814) according to the determination that the input 814 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 814 contains a fingerprint.
FIG. 8H shows that the display dimming timer 896-8 is reset in response to input 814 including fingerprints. In Figure 8H, the credential permission timer 898-4 is not reset. Also in FIG. 8H, the representation of information (eg, 804) in the corresponding input field (eg, 802-1 to 802-8) remains on the touch screen 112.
8I-8K show the actions performed before the credential adjustment timer 898 expires, according to some embodiments.
FIG. 8I shows a lock screen displayed on the touch screen 112. In Figure 8I, the credential adjustment timer 898-9 has not expired yet. The display dimming timer (eg, 896-8 in Figure 8G) is not shown in Figure 8I for brevity. However, those skilled in the art will appreciate that in some implementations the actions associated with the display dimming timer 896 can be performed from the lock screen. For example, in some embodiments, the device 100 automatically touches the touch screen 112 while displaying the lock screen according to the determination that the display dimming timer 896 has expired while the touch screen 112 displays the lock screen. Dimming the screen 112. In some embodiments, the display dimming timer 896 is reset according to the determination that an input containing a fingerprint has been detected on the fingerprint sensor 169.
In FIG. 8I, the input 816 is detected on the fingerprint sensor 169. In some embodiments, the input 816 is ignored (eg, performed in response to the input 816) according to the determination that the input 816 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 816 contains a fingerprint.
FIG. 8J shows an exemplary user interface displayed in response to a determination that the fingerprint at input 816 does not match the registered fingerprint. FIG. 8J also shows that an input 818 separate from the input 816 is detected on the fingerprint sensor 169. In some embodiments, the input 818 is ignored (eg, performed in response to the input 818) according to the determination that the input 818 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 818 contains a fingerprint.
FIG. 8K, in some embodiments, unlocks the device 100 according to the determination that the fingerprint at input 818 matches the registered fingerprint. In some embodiments, unlocking the device 100 involves displaying a home screen.
FIGS. 8L-8M show the operations executed while the credential permission timer 898 has expired.
FIG. 8L shows a lock screen displayed on the touch screen 112. In Figure 8L, the credential adjustment timer 898-9 has expired. FIG. 8L also shows that the input 820 is detected on the fingerprint sensor 169. In some embodiments, the input 820 is ignored (eg, performed in response to the input 820) according to the determination that the input 820 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 820 contains a fingerprint.
FIG. 8M shows that a passcode screen (shown in FIG. 8M) is displayed on the touch screen 112 in response to input 820, according to some embodiments. In some embodiments, even if the fingerprint at input 820 (FIG. 8L) matches the registered fingerprint, according to the determination that input 820 (FIG. 8L) was received while the credential permission timer 898 has expired. , The passcode screen is displayed.
In some embodiments, the passcode screen determines whether the fingerprint in the input matches the registered fingerprint, according to the determination that the input containing the fingerprint was received while the credential permission timer 898 has expired. It is displayed regardless.
8N-8O show exemplary behavior for providing access to restricted functionality, according to some embodiments.
FIG. 8N shows a user interface containing one or more selectable user interface objects (eg, buttons labeled "Network Settings", "Bluetooth", and "Sound"). Compared to FIG. 8O, one or more selectable user interface objects (eg, the button labeled "Credential Manager" 806 in FIG. 8O) are not visible on the touch screen 112. FIG. 8N also shows that input 822 is detected on the fingerprint sensor 169. In some embodiments, the input 822 is ignored (eg, performed in response to the input 822) according to the determination that the input 822 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 822 contains a fingerprint.
FIG. 8O shows that the selectable user interface object 806 is displayed on the touch screen 112 according to the determination that the input 822 matches the registered fingerprint. FIG. 8O also shows that the touch input 824 is detected on the touch screen 112 at the position corresponding to the selectable user interface object 806.
FIG. 8P shows an exemplary user interface (eg, a credential manager user interface) that is displayed in response to the touch input 824 being detected at the location corresponding to the selectable user interface object 806. The exemplary user interface in Figure 8P includes multiple fields and representations of information within the corresponding fields.
Figure 8P also counts the number of unauthorized attempts to perform one or more default secure actions (eg, revealing personal information or providing access to restricted functionality), unauthorized. The trial counter 894-1 is also shown.
The unauthorized attempt counter 894-1 is shown in FIGS. 8P-8V to illustrate the specific behavior of the device 100, but the unauthorized attempt counter 894-1 is not necessarily shown on the touch screen 112. In some embodiments, the unauthorized attempt counter 894-1 is shown on the touch screen 112. In other embodiments, the unauthorized attempt counter 894-1 is not shown on the touch screen 112.
FIG. 8P shows that input 826 is detected on the fingerprint sensor 169. In some embodiments, the input 826 is ignored (eg, performed in response to the input 826) according to the determination that the input 826 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 826 contains a fingerprint. In some embodiments, there is no action performed according to the determination that the fingerprint at input 826 does not match the registered fingerprint.
FIG. 8Q is for performing one or more default secure actions on the unauthorized attempt counter 894-1 in some embodiments according to the determination that the fingerprint of input 826 does not match the registered fingerprint. Indicates that the number of unauthorized attempts in is increasing (eg, from zero to one). In some embodiments, the representation of the information in the corresponding field (sometimes referred to as the organized representation) remains on the touch screen 112, as shown in FIG. 8Q. FIG. 8Q shows that input 826 (FIG. 8P) is no longer detected on the fingerprint sensor 169. In some embodiments, the number of unauthorized attempts to perform one or more default secure actions on the unauthorized attempt counter 894-1 is the lift-off of input 826 (FIG. 8P) from the fingerprint sensor 169. It increases according to the detection and according to the determination that the fingerprint at input 826 (FIG. 8P) does not match the registered fingerprint.
FIG. 8R shows that the input 828 is detected on the fingerprint sensor 169. In some embodiments, the input 828 is ignored (eg, performed in response to the input 828) according to the determination that the input 828 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 828 contains a fingerprint. In some embodiments, there is no action performed according to the determination that the fingerprint at input 828 does not match the registered fingerprint.
FIG. 8S illustrates one or more default secure actions on the unauthorized attempt counter 894-3 according to the determination that the fingerprint at input 828 does not match the registered fingerprint in some embodiments. Indicates that the number of unauthorized attempts in is increasing (eg, from 1 to 2). In some embodiments, the representation of the information in the corresponding field remains on the touch screen 112, as shown in FIG. 8S. In FIGS. 8S-8U, the number of unauthorized attempts at the unauthorized attempt counter 894-3 satisfies (eg, matches or exceeds) a predetermined number of unauthorized attempts (eg, 2, 3, 4, or 5). ).
FIG. 8S also shows that input 828 (FIG. 8R) is no longer detected on the fingerprint sensor 169. In some embodiments, the number of unauthorized attempts to perform one or more default secure actions on the unauthorized attempt counter 894-3 lifts off input 828 (FIG. 8R) from the fingerprint sensor 169. It increases according to the detection and according to the determination that the fingerprint at input 828 (FIG. 8R) does not match the registered fingerprint.
FIG. 8T shows that the input 830 is detected on the fingerprint sensor 169. In some embodiments, the input 830 is ignored (eg, performed in response to the input 830) according to the determination that the input 830 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 830 contains a fingerprint. In some embodiments, there is no action performed according to the determination that the fingerprint at input 830 does not match the registered fingerprint.
In Figure 8U, even if the fingerprint at input 830 matches the registered fingerprint, the representation of the information in the corresponding field (sometimes referred to as the organized representation) remains on the touch screen 112 (eg, for example). No information is given in the corresponding field). In some embodiments, the number of unauthorized attempts at unauthorized attempt counter 894-3 is the default number of unauthorized attempts at once unauthorized attempt counter 894-3, as shown in Figure 8U. If the number of times (for example, 2) is satisfied, it does not increase. In some embodiments, the number of unauthorized attempts on the unauthorized attempt counter 894-3 does not match the registered fingerprint for fingerprints on the corresponding input of unauthorized attempts on the unauthorized attempt counter 894-3. Increases regardless of whether the number of times meets the default number of unauthorized attempts.
In some embodiments, once the number of unauthorized attempts in the unauthorized attempt counter 894-3 meets the default number of unauthorized attempts, the unauthorized attempt counter 894-3 gives the correct passcode on the passcode screen. It is reset by providing (eg Figure 8M).
Figures 8V-8W show the operations performed while the number of unauthorized attempts at the unauthorized attempt counter 894-3 does not meet the default number of unauthorized attempts.
FIG. 8V shows that input 832 is detected on the fingerprint sensor 169. In some embodiments, the input 832 is ignored (eg, performed in response to the input 832) according to the determination that the input 832 does not contain a fingerprint (eg, contact with an object such as a pen). No action). In some embodiments, one or more actions are performed according to the determination that the input 832 contains a fingerprint. In some embodiments, there is no action performed according to the determination that the fingerprint at input 832 does not match the registered fingerprint.
In Figure 8W, according to the determination that the fingerprint at input 832 matches the registered fingerprint, the representation of the information in the corresponding field (sometimes referred to as the organized representation) is the information in the corresponding field (sometimes called). , Called unorganized or unorganized information). For example, as shown in Figure 8W, the representation of information in the corresponding field is replaced with one or more sets of usernames and passwords (sometimes referred to as unorganized or unorganized usernames and passwords). In some embodiments, the fingerprint on input 832 matches the registered fingerprint while the number of unauthorized attempts at the unauthorized attempt counter 894-4 (FIG. 8V) is less than the default number of unauthorized attempts. The unauthorized attempt counter 894-4 (Fig. 8V) is reset according to the judgment of.
9A-9B are flow diagrams illustrating a method 900 for performing a fingerprint-based operation, according to some embodiments. Method 900 is performed on an electronic device having a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some actions of Method 900 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 900 provides an intuitive way to perform fingerprint-based actions. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when performing fingerprint-based actions. For battery-powered electronic devices, enabling users to perform fingerprint-based actions faster and more efficiently saves power and increases the time between battery charging.
The device uses a fingerprint sensor to detect the first input (902). For example, as shown in FIG. 8C, the input 812 is detected on the fingerprint sensor 169.
In response to detecting the first input, the device determines if the first input contains a fingerprint (904).
According to the determination that the first input contains a fingerprint, the device performs the first action based on the presence of the fingerprint, regardless of the fingerprint identification information (906). In some embodiments, the first operation involves resetting the display dimming timer. For example, as shown in FIG. 8E, the display dimming timer 896-5 is reset according to the determination that the first input contains a fingerprint. Typically, resetting the display dimming timer has the effect that the brightness of the display is not automatically dimmed because the dimming timer has not expired (because it is not in the expired state). Typically, the brightness of the display is not automatically dimmed as long as the fingerprint continues to be detected on the fingerprint sensor.
In some embodiments, the device comprises a display (908). The device also includes a display dimming timer (eg, 896-1 in Figure 8A) that starts at the dimming timer start value (eg, 0 seconds). The device automatically dims the display according to the determination that the display dimming timer has expired (eg, the display dimming timer reaches a predetermined expiration value such as 60 seconds, 120 seconds, etc.). In some embodiments, the display dimming timer stores the time elapsed since the display dimming timer was reset. For example, when one second has passed since the display dimming timer was reset, the display dimming timer stores one second. When 2 seconds have passed since the display dimming timer was reset, the display dimming timer remembers 2 seconds. In some embodiments, the first operation involves resetting the display dimming timer to the dimming timer start value. In another embodiment, the dimming timer is a countdown timer, the dimming timer expiration value is 0 seconds, and the dimming start value is a value such as 60 seconds, 120 seconds, 300 seconds, and the like. In this embodiment, the display is not dimmed as long as the dimming timer is non-zero.
In some embodiments, the device collects information about the fingerprint in contact with the fingerprint sensor at predetermined intervals, which is shorter than the time required for the dimming timer to expire, so that the fingerprint is placed on the fingerprint sensor. While maintained, the device repeatedly detects the fingerprint and resets the dimming timer, resulting in the display brightness being automatic as long as the fingerprint continues to be detected on the fingerprint sensor in such cases. Not dimmed.
According to the determination that the fingerprint on the first input matches the registered fingerprint, the device conditionally performs a second action based on the registered fingerprint (910). For example, as shown in FIG. 8E, the device reveals personal information (eg, credit card information) according to the determination that the fingerprint at input 812 (FIG. 8C) matches the registered fingerprint. In some embodiments, conditionally performing the second action comprises performing the second action in accordance with the determination that the second action is not prevented. In some embodiments, conditional execution of the second operation comprises canceling the second operation as determined to prevent the second operation. In some implementations, the second operation is prevented according to the determination that the credential permission timer 898 has expired.
In some embodiments, the second action is to reveal personal information (eg, reveal credit card information as shown in Figure 8E), and to provide access to restricted functionality (eg, revealing credit card information). For example, it contains one or more of (displays a selectable user interface object 806) that, when selected, initiates the display of a user interface with restricted features such as the credential manager function, as shown in Figure 8O (912). ).
In some embodiments, in response to detecting the first input, the device determines that the first input contains a fingerprint, and the fingerprint in the first input does not match the registered fingerprint. The execution of the second action is canceled according to the judgment of (914). For example, as shown in FIGS. 8G-8H, in response to the detection of input 814 (FIG. 8G), and the determination that input 814 contains a fingerprint, and the fingerprint of input 814 does not match the registered fingerprint. According to the determination, the device cancels the execution of the second operation (for example, in FIG. 8H, personal information such as credit card information is not revealed).
In some embodiments, in response to detecting the first input, the device determines that the first input contains a fingerprint, and the fingerprint in the first input does not match the registered fingerprint. According to the determination of, the first operation is executed without executing the second operation (916). For example, as shown in FIGS. 8G-8H, in response to the detection of input 814 (FIG. 8G), and the determination that input 814 contains a fingerprint, and the fingerprint of input 814 does not match the registered fingerprint. According to the determination, the device performs the first operation (for example, resetting the display dimming timer 896-8 in FIG. 8H) without performing the second operation (for example, in FIG. 8H, the credit card information. Personal information such as is not disclosed).
In some embodiments, the first and second actions are both performed according to the determination that the first input contains a fingerprint that matches the registered fingerprint (918). For example, as shown in FIGS. 8C and 8E, the first operation (eg, the display dimming timer 896-5) is reset according to the determination that the input 812 (FIG. 8C) contains a fingerprint that matches the registered fingerprint. ) And the second action (eg, revealing personal information such as credit card information, as shown in Figure 8E) are both performed.
In some embodiments, the device performs a third action, separate from the second action, based on the registered fingerprint, according to the determination that the first input contains a fingerprint that matches the registered fingerprint. Run (920). For example, as shown in FIGS. 8C and 8F, the device performs a third operation (eg, the credential of FIG. 8F) according to the determination that the input 812 (FIG. 8C) contains a fingerprint that matches the registered fingerprint. Reset the permission timer 898-6).
In some embodiments, the device has a credential permission timer (eg, a registered fingerprint that has a registered fingerprint, a device unlock credential, such as a passcode, or a credit card number, or the like, which starts from the permission timer start value (eg, zero). Includes a timer that measures the time allowed to use purchase credentials, such as a password for a store account linked to a credit card number or other source of payment (922). In some embodiments, the credential grant timer stores the elapsed time since the credential grant timer was reset. For example, when one hour has passed since the credential permission timer was reset, the credential permission timer stores one hour. When two hours have passed since the credential allow timer was reset, the credential allow timer remembers two hours.
In some embodiments, the device has a fingerprint (a fingerprint that matches a registered fingerprint) after the credential grant timer has expired (eg, reaching a predetermined expiration value such as 12 hours, 24 hours, or 48 hours). ) To prevent the device from being unlocked. In another embodiment, the credential allow timer is a countdown timer, the credential allow timer expiration value is zero seconds, and the credential allow timer start value is any of the authorization timer expirations described elsewhere herein. For example, the permission timer expires (or corresponds to it). In this embodiment, the device does not prevent the device from unlocking (using a fingerprint that matches the registered fingerprint) as long as the credential grant timer has a non-zero value.
In some embodiments, using a fingerprint to prevent unlocking the device comprises disabling the unlocking of the device with a fingerprint. For example, as shown in Figures 8L-8M, according to the determination that the credential permission timer 898-12 (Figure 8L) has expired, the device unlocks the device even if the input 820 matches the registered fingerprint. To prevent. In some embodiments, in response to input 820, the device displays a passcode screen (FIG. 8M) instead of unlocking the device. In comparison, in some embodiments, the device is with a registered fingerprint according to the determination that the credential permission timer 898-10 (FIG. 8J) has not expired, as shown in FIGS. 8J-8K. The lock is unlocked in response to the fingerprint on the matching input 818 (eg, stop displaying the unlock screen shown in FIG. 8J and display the home screen shown in FIG. 8K).
In some embodiments, the third operation involves resetting the credential permit timer to the permit timer start value. For example, as shown in FIGS. 8C and 8F, the device performs a third operation (eg, the credential of FIG. 8F) according to the determination that the input 812 (FIG. 8C) contains a fingerprint that matches the registered fingerprint. Reset the permission timer 898-5).
In some embodiments, the first input comprises the corresponding fingerprint on the fingerprint sensor (924). The device detects the corresponding fingerprint lift-off from the fingerprint sensor. In response to detecting a fingerprint lift-off from the fingerprint sensor, and according to the determination that the corresponding fingerprint does not match the registered fingerprint, the device performs an unauthorized attempt (eg, for example) to perform a second operation. Increment the count of unauthorized attempts to unlock the device). For example, as shown in FIGS. 8P and 8Q, in response to detecting lift-off of input 826 (FIG. 8P) from fingerprint sensor 169 (FIG. 8Q), and the fingerprint at input 826 does not match the registered fingerprint. According to the determination, the device increments the count of unauthorized attempts to perform the second operation (eg, the count of the unauthorized attempt counter 894-2) from zero to one. In some embodiments, the count of unauthorized attempts is incremented only after detecting individual fingerprint gestures, including fingerprint touchdown and liftoff from the fingerprint sensor. As a result, long continuous fingerprint gestures are counted only as a single attempt to perform the second action.
In some embodiments, after incrementing the count of unauthorized attempts to perform the second operation, the device determines if the fingerprint invalidation criteria are met (926). The fingerprint invalidation criteria include the criteria that are met when the count of unauthorized attempts to perform the second action meets a predetermined number of unauthorized attempts to perform the second action. In some embodiments, the count of unauthorized attempts performed in the second operation is the count of unauthorized attempts to perform the second operation, but the count of unauthorized attempts to perform the second operation. It is considered to be satisfied when it matches the specified number of times. For example, the default number of unauthorized attempts to perform the second operation is set to 2, and the unauthorized attempt counter 894-3 (Figure 8T) counts unauthorized attempts to perform the second operation. When is 2, the count of unauthorized attempts meets the default number of unauthorized attempts to perform the second operation. In some embodiments, the count of unauthorized attempts to perform the second operation is the count of unauthorized attempts to perform the second operation, but the count of unauthorized attempts to perform the second operation is unauthorized. When the default number of attempts is exceeded, it is considered to meet the default number of unauthorized attempts to perform the second action.
In some embodiments, according to the determination that the fingerprint invalidation criteria have been met, the device is based on the fingerprint (eg, by the fingerprint sensor, which disables the fingerprint sensor or matches a previously registered fingerprint). Prevents the second action from being performed (by ignoring the detected fingerprints). For example, as shown in FIGS. 8T-8U, the fingerprint invalidation criteria were met (eg, the count of unauthorized attempts to perform the second action counts unauthorized attempts to perform the second action). According to the determination (satisfied with the predetermined number of times), the device reveals personal information such as a user name and password in response to the fingerprint at the input 830 that matches the registered fingerprint. (That) is prevented from being executed (for example, in FIG. 8U, the fingerprint of personal information is maintained on the touch screen 112, and in FIG. 8U, the personal information is not displayed on the touch screen 112).
In some embodiments, the first action is performed while detecting the presence of a fingerprint on the fingerprint sensor (928), and the second action matches a previously registered fingerprint from the fingerprint sensor. It is executed according to the detection of the lift-off of the fingerprint. For example, in some embodiments, the first operation (eg, resetting the display dimming timer 896-3 in FIG. 8C) is an input 812 containing a fingerprint on the fingerprint sensor 169 (FIG. 8C) (FIG. 8C). ) Is executed while it is detected. In comparison, in some embodiments, the second action (eg, revealing personal information such as credit card information) is of input 812 (FIG. 8C) from fingerprint sensor 169 (FIG. 8E). Only executed after a lift-off is detected.
Understand that the specific order described for the actions in FIGS. 9A-9B is merely exemplary and is not intended to indicate that the order is the only order in which the actions can be performed. I want to be. Those of skill in the art will be aware of the various methods of reordering the operations described herein. For example, in some embodiments, the device uses a fingerprint sensor to detect the first input. In response to detecting the first input, the device determines if the first input contains a fingerprint and, according to the determination that the first input contains a fingerprint, the fingerprint, regardless of the fingerprint identification information. The first action is performed based on the presence of, and the second action is conditionally performed based on the registered fingerprint according to the determination that the fingerprint in the first input matches the registered fingerprint.
In addition, details of other processes described herein with respect to the other methods described herein (eg, those listed in paragraph [0080]) are shown in FIGS. 9A-9B. Note that the method 900 described above can be applied in a similar manner. For example, the inputs, actions, and credentials described above with reference to Method 900 may refer to other methods described herein (eg, methods described in paragraph number [0080]). It optionally has one or more of the input, behavior, and credential features described herein. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 10 shows a functional block diagram of an electronic device 1000 configured according to the principles of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 10 will be optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 10, the electronic device 1000 includes a fingerprint sensor unit 1006 configured to detect a first input and a processing unit 1008 coupled to the fingerprint sensor unit 1006. In some embodiments, the electronic device 1000 comprises a display unit 1002 coupled to a processing unit 1008 and configured to display a graphical user interface. In some embodiments, the display unit 1002 is coupled to the fingerprint sensor unit 1006. In some embodiments, the electronic device 1000 comprises a touch sensing surface unit 1004 coupled to a processing unit 1008 and configured to receive touch inputs. In some embodiments, the processing unit 1008 includes a determination unit 1010, a first action execution unit 1012, a second action execution unit 1014, a third action execution unit 1016, and a credential permit timer unit 1018. It includes a prevention unit 1020, a reset unit 1022, a display dimming timer unit 1024, a dimming unit 1026, a personal information clarification unit 1028, an access providing unit 1030, and an increment unit 1032.
The processing unit 1008 is configured to determine if the first input contains a fingerprint (eg, using the determination unit 1010) in response to detecting the first input. The processing unit 1008 also determines that the first input contains a fingerprint, and is based on the presence of the fingerprint (eg, using the first action execution unit 1012), regardless of the fingerprint identification information. It is also configured to perform the actions of. The processing unit 1008 is based on the registered fingerprint (eg, the second action execution unit 1014) according to the determination that the fingerprint in the first input matches the registered fingerprint (eg, using the determination unit 1010). Is further configured to conditionally perform the second action (using).
In some embodiments, the processing unit 1008 determines that the first input contains a fingerprint in response to detecting the first input, and the fingerprint in the first input matches the registered fingerprint. According to the determination not to do so, it is configured to cancel the execution of the second action (eg, using the prevention unit 1020).
In some embodiments, the processing unit 1008 determines that the first input (eg, using the determination unit 1010) contains a fingerprint in response to detecting the first input, and the first. According to the determination that the fingerprint in the input does not match the registered fingerprint, the first operation (for example, using the first operation execution unit 1012) is performed without performing the second operation. It is composed.
In some embodiments, the first and second actions are both according to the determination that the first input contains a fingerprint that matches the registered fingerprint (eg, using determination unit 1010). It is executed (for example, using the first operation execution unit 1012 and the second operation execution unit 1014).
In some embodiments, the processing unit 1008 has registered a third action, separate from the second action, according to the determination that the first input contains a fingerprint that matches the registered fingerprint. It is configured to perform based on fingerprints (eg, using a third action execution unit 1016).
In some embodiments, the device comprises a credential permit timer unit 1018 that is started from a permit timer start value. The processing unit 1008 is configured to prevent the device from being fingerprinted unlocked (eg, using the prevention unit 1020) after the credential permission timer unit 1018 has expired. The third operation involves resetting the credential permit timer unit 1018 to the allow timer start value (eg, using the reset unit 1022).
In some embodiments, the device comprises a display unit 1002 coupled to a processing unit 1008. The device comprises a display dimming timer unit 1024 starting from the dimming timer start value. The processing unit 1008 automatically dims the display unit 1002 (eg, using the dimming unit 1026) according to the determination that the display dimming timer unit 1024 has expired (eg, using the determination unit 1010). Configured to enable. The first operation involves resetting the display dimming timer unit 1024 to the dimming timer start value (eg, using the reset unit 1022).
In some embodiments, the second action is to reveal personal information (eg, using the personal information manifestation unit 1028), and to access restricted functionality (eg, access providing unit 1030). Includes one or more of the provisions (using).
In some embodiments, the first input comprises a corresponding fingerprint on the fingerprint sensor unit 1006. The fingerprint sensor unit 1006 is configured to detect the corresponding fingerprint lift-off from the fingerprint sensor unit 1006, and the processing unit 1008 responds to and responds to the detection of the fingerprint lift-off from the fingerprint sensor unit 1006. Increases the count of unauthorized attempts to perform the second operation (eg, using increment unit 1032) according to the determination that the fingerprint does not match the registered fingerprint (eg, using decision unit 1010). It is configured to let you.
In some embodiments, the processing unit 1008 uses the determination unit 1010 to determine if the fingerprint invalidation criteria are met after incrementing the count of unauthorized attempts to perform the second operation. It is configured to determine. The fingerprint invalidation criteria include the criteria that are met when the count of unauthorized attempts to perform the second action meets a predetermined number of unauthorized attempts to perform the second action. According to the determination that the fingerprint invalidation criteria have been met (eg, using the determination unit 1010), the processing unit 1008 will perform a second action based on the fingerprint (eg, the prevention unit 1020 and / or). It is configured to prevent (using a second action execution unit 1014).
In some embodiments, the first action is performed while detecting the presence of a fingerprint on the fingerprint sensor unit 1006 (eg, using the first action execution unit 1012) and the second action. Is executed (eg, using a second action execution unit 1014) in response to detecting a fingerprint lift-off from the fingerprint sensor unit 1006 that matches a previously registered fingerprint.
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. Is executed arbitrarily by running.
The operations described above with reference to FIGS. 9A, 9B are optionally performed by the components shown in FIGS. 1A, 1B, or 10. For example, the detection operation 902, the first operation execution operation 906, and the second operation execution operation 910 are arbitrarily executed by the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes are performed based on the components shown in FIGS. 1A-1B.
Automatically add data to credential fields and reveal organized credentials
Many uses of modern electronic devices require the provision of credentials to users in order to access specific information and / or services. For example, e-commerce websites or applications often require the user to enter a credit card number, billing address, and shipping address to make a payment. In another embodiment, the user is often required to enter a user ID and / or password (eg, an email website or application) before access to a secure service or other secure information is granted. , Social networks, etc.). Because users often need to provide credentials when using electronic devices, the credentials are stored in the memory of such devices so that they can be inserted into the credential field without the need for manual input by the user. Can be done. However, this presents some security and privacy risks. For example, an unauthorized user could pick up a device that does not belong to that user, make a purchase with stored credit card information, or gain access to an individual and / or sensitive data, applications, websites, etc. There is.
Also, to protect the privacy and / or security of the credentials, they may be displayed in a pre-organized format so that they cannot be read or duplicated. However, this makes it difficult for the user to verify that the credentials are entered correctly, or to review and / or edit the stored credentials that typically appear only in pre-organized format (eg,). As in the credential manager interface for the user to enter, edit, and otherwise manage the stored credentials on the device).
In the embodiments described below, fingerprint recognition grants permission to access the credential and, more specifically, grants permission to add data to the credential field and / or gives the user unorganized credential. Used to display the version. For example, if the user navigates to a form with credential fields (credit card number, billing address, etc.), the user can provide fingerprint input by placing a finger on the fingerprint sensor. If the fingerprint detected on the fingerprint sensor matches the user's previously registered fingerprint (and optionally, other conditions are met), the credential field is stored associated with the user. Your credential will be added automatically. In this way, manual entry of credentials, which is tedious and prone to text entry errors, is avoided. As another embodiment, when organized credentials are displayed (eg, on a web page or in the credential manager interface), the user provides fingerprint input to make the credentials in an unorganized (ie, human readable) format. It can be displayed with. Thus, while credentials are accessible to browse and / or enter credential fields quickly and intuitively, unauthorized access to such credentials can be prevented.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 11A-11D, 14A-14C, 12A-12B, and 15A-15B include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of description, embodiments described with reference to FIGS. 11A-11D, 14A-14C, 12A-12B, and 15A-15B include a touch screen 112 and a separate touch sensing surface 359-2. Although discussed with reference to devices having, similar behaviors are shown in FIGS. 11A-11D and 14A-14C while the user interface shown in FIGS. 11A-11D and 14A-14C is displayed on the display 450, FIGS. 11A-11D and 14A. ~ In response to the input described in FIG. 14C being detected on the integrated fingerprint sensor 359-1, it is optionally executed on the device by the integrated fingerprint sensor 359-1. In addition, similar behavior optionally replaces the touch screen 112 with the display 450 and separate touch sensing. A device having a surface 451 on a fingerprint sensor 169 (eg, an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-2) and / or on a separate touch-sensitive surface 451 with FIGS. 11A-11D and FIGS. This is done while displaying the user interfaces shown in FIGS. 11A-11D and 14A-14C on the display 450 in response to the detection of the contacts shown in FIGS. 14A-14C. In such an embodiment, the contacts shown in FIGS. 11A-11D and 14A-14C optionally have a focus selector corresponding to the position of the display 450 and a separate touch sensing surface (eg, touch sensing surface). 451) Represents both the contact made on or the contact corresponding to the position of the gesture, and the focus selector optionally represents the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or The point associated with the corresponding contact), or the centroid of two or more contacts detected on the touch screen 112, optionally replaced by the displayed cursor.
FIG. 11A shows an exemplary user interface displayed on the display of the portable multifunction device 100, where the user interface is a form with fields 1102 (1102-1, ..., 1102-8) corresponding to multiple credentials. Display 1101. Field 1102 shown in Figure 11A is a credit card information field (eg, credit card number field 1102-1, expiration field 1102-2, etc.) and a billing address information field (eg, street field 1102-5, city field 1102). -Corresponding to the types of fields that sometimes exist in the "Registration" form of e-commerce websites or applications, including (-6, etc.). The fields 1102 displayed on Form 1101 are merely exemplary, and more or less fields may be displayed in various embodiments. Also, other fields, including other types of fields not shown in FIG. 11A, may be included in lieu of or in addition to those shown.
As shown in FIG. 11A, the device 100 detects the fingerprint input 1110 on the fingerprint sensor 169 while displaying the form 1101. In some embodiments, the fingerprint entry 1110 responds to the request to automatically fill in the fields on Form 1101. For example, in some embodiments, when the device 100 displays a form with a credential field, the device 100 detects the permitted fingerprint on the fingerprint sensor 169 to field the stored credential in the device 100. To be added to. On the other hand, as described below, if an unauthorized fingerprint is detected on the fingerprint sensor 169, the stored credentials are not added to the field.
FIG. 11B shows Form 1101 after the credential has been added to field 1102 (eg, after fingerprint 1110 has been determined to be associated with a user authorized to use the credential). As shown in Figure 11B, the credentials are displayed in a pre-organized format that is not readable by the user of the device. In this embodiment, the organized credentials are displayed as a series of black circles. However, one of ordinary skill in the art will recognize that other organizing methods may also be performed in various embodiments (eg, exclusion of arbitrary characters such that the credentials are unreadable to the user of the device). , Replacement, or obscuring).
In some embodiments, the credentials that are automatically added to the credential field are organized by default. In some embodiments, instead of the organized form shown in FIG. 11B, one or more automatically inserted credentials are unorganized or partially organized (ie, organized and unorganized). It is displayed in the format (including the part). For example, in some embodiments, the last four digits of the credit card credential 1104 are displayed in a human-readable format (not shown). In some embodiments, other credentials, such as billing addresses, names on credit cards, etc., are displayed in a partially or unorganized form. In some embodiments where multiple credential fields are displayed, any combination of organized, partially organized, and unorganized credentials may be displayed. For example, in some embodiments, credit card number credentials are displayed in a partially organized format, expiration dates and credit card security codes are displayed in a pre-organized format, and billing addresses are displayed in an unorganized format. Is displayed. In some embodiments, whether a credential is displayed in a organized, partially organized, or unorganized form is based on the confidentiality and / or security level associated with the credential. For example, credit card numbers, bank account numbers, etc. can be associated with higher confidentiality and / or security levels than usernames and mailing addresses.
As mentioned above, FIG. 11B shows that after fingerprint 1110 was determined to be associated with a user authorized to use the credential, and device 100 filled in the credential on Form 1101 (eg, added the credential to field 1102). ) Later, form 1101 is shown. On the other hand, if fingerprint 1110 is determined not to be associated with a user authorized to use the credential, the device will stop filling out Form 1101 with the credential (not shown). In some embodiments, if finger input (eg, finger input 1110) is detected, but the fingerprint does not match that of the authorized user, device 100 automatically adds data to the credential field. Issue a prompt indicating that the request has been rejected.
In some embodiments, once Form 1101 is completed, additional finger input can be used to display the credentials in a non-organized format, as described for FIGS. 11C-11D. In this way, the user can review the credentials to ensure they are correct and / or correspond to the particular credentials the user wants to use. In some implementations, further finger input is achieved by the user raising a finger from the fingerprint sensor 169 to exit the first fingerprint 1110 and then lowering the finger to the fingerprint sensor 169 again. After authenticating the second fingerprint, for example, matching one or more registered fingerprints of an authorized user to reveal one or more credentials would display one or more in a previously organized format. Credentials are displayed in unorganized format. The finger input 1112 shown in FIG. 11C is an example of the second fingerprint described above.
As shown in FIG. 11C, the device 100 detects the finger input 1112 on the fingerprint sensor 169 while displaying the form 1101 with the organized credentials displayed in the credential field 1102.
An unorganized version of one or more credentials, in response to finger input 1112, and according to the determination that the fingerprint corresponding to finger input 1112 was associated with a user authorized to reveal one or more credentials. It appears in field 1102 of Form 1101, as shown in Figure 11D. For example, FIG. 11D shows all of the credentials in Form 1101 in plain text.
In the process shown and described for FIGS. 11A-11D, the first finger input (eg, finger input 1110) allows the form to be filled out with pre-organized credentials and the second finger input (eg, eg). Finger input 1112) displays the unorganized version of the credentials instead of the organized version. In some embodiments, continuous finger input increases the amount of one or more credentials displayed in unorganized form. For example, after receiving the first finger input (and after the fingerprint of the input is determined to be associated with an authorized user), the organized credentials are added to the credential field in the form. When a second finger input from an authorized user is received, a subset of the organized credentials are replaced with an unorganized version of the credentials, and the other organized credentials remain unchanged (eg, organized). It remains in the completed format). Alternatively, after the second finger input, all or some of the organized credentials are replaced with a partially organized version of the credentials. Finally, after the third finger input, all credentials are displayed in unorganized format. Therefore, each successive finger input of an authorized user causes the organized credentials to be replaced by a less organized (ie, more readable) version. In this way, the user can easily adjust the degree to which the user's confidential information is revealed in plain text, while reviewing the automatically filled credentials and they are correct and / or intended. It can be confirmed that it is credential.
In some embodiments, the above-mentioned contiguous inputs must be received and / or detected without intervening inputs (eg, finger inputs, touch events, etc.). In some embodiments, successive inputs do not need to be received and / or detected without an intervening input.
In some embodiments, the order of the credentials displayed in a non-organized format in response to successive finger inputs depends on the security level for the credentials. For example, in some embodiments, an unorganized version of the shipping address is displayed in response to a finger input earlier than a series of finger inputs (eg, because it is associated with a lower security and / or privacy level). ), The unorganized version of the credit card number is displayed in response to the finger input later in the sequence of finger inputs (eg, because it is associated with a higher security and / or privacy level).
12A-12B are flow diagrams illustrating a method 1200 for adding a credential to a credential field, according to some embodiments. Method 1200 is performed on an electronic device having a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some actions of the method 1200 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 1200 provides an intuitive way to enter credentials in the credential field displayed on the form, displaying the unorganized version after the organized version of the credential is first displayed. To. This method reduces the user's cognitive burden when presented with a credential field to which data must be added, thereby creating a more efficient human-machine interface. Battery-powered electronic devices allow users to add data to the credential field faster and more efficiently, and by enabling the display of unorganized versions of credential information, power is saved and during battery charging. Increase your time.
The device stores one or more sets of credentials (1202). In some embodiments, the credential is a secure credential associated with the user of the device. In some embodiments, the set of one or more credentials is stored in the memory of the device (eg, memory 102 in FIG. 1A). In some embodiments, the credentials are stored in a secure area of memory 102 and / or encrypted to prevent unauthorized access to it.
In some embodiments, the set of one or more credentials includes one or more of a user ID, password, credit card number, bank account number, address, phone number, and / or shopping credentials (1204). .. In some implementations, a set of credentials contains a subset of multiple credentials, each subset corresponding to or associated with a separate application, payment method, user, shipping address, online resource, set of online resources, and so on. Be done. In one embodiment, the set of credentials is the user ID and password for the first specific online resource (eg, email website) and the user ID, password, shipping address for the second specific online resource. , Billing address, and telephone number, and for shopping, include user ID, credit card number, shipping address, billing address, and telephone number.
The device displays a form with fields corresponding to one or more credentials in a set of one or more credentials (1206). In some embodiments, the form is a web page, such as a cash register page for an e-commerce website, a login page for a secure web page (eg, a social network, an email provider, etc.). In some embodiments, the form is associated with the application's user interface, such as the application's (or operating system's) login screen. An exemplary form 1101 shown in FIGS. 11A-11D shows an example of the "Registration" page of an e-commerce website and is a field for credentials typical of a "Registration" or purchase authorization page (eg, credit card information). Includes fields, billing information fields, etc.).
The device receives a request that includes finger input on the fingerprint sensor to automatically fill out a form with one or more credentials in one or more sets of credentials (1208). For example, when a form with a credential field is displayed, the user places his finger on the fingerprint sensor 169 as shown in FIG. 11A, requesting that the form be automatically filled with the appropriate credentials. In some embodiments, the request to fill out the form automatically corresponds to a request to add credentials to all displayed fields (or all fields where credentials are stored). In some embodiments, the request to fill out the form automatically corresponds to a request to add credentials to all fields of the form, whether it is displayed when the request is received (eg, "off". Hidden fields on forms, such as those on the screen, are also added on demand).
In some embodiments, when the device detects that a form with the appropriate credential field is displayed or is displayed, the device requires the user to fill out the form automatically, for example. Prompt for input by presenting the text "Scan your fingerprint to fill out this form automatically".
One or more devices are determined to contain a fingerprint associated with a user who is authorized to use one or more sets of credentials in response to a request to fill out the form automatically. Fill out the form with one or more credentials, and the device fills out the form with one or more credentials according to the determination that the finger input contains a fingerprint that is not associated with a user authorized to use one or more sets of credentials. Cancel (1210).
In some embodiments, the determination that a fingerprint is associated with a user authorized to use one or more sets of credentials matches the fingerprint with at least one of one or more registered sets of fingerprints. Includes a determination to do (1212). For example, if the fingerprint corresponding to finger input 1110 (FIG. 11A) matches the registered fingerprint, the device fills out the form (ie, the field of the form) with the stored credentials, as shown in Figure 11B. .. On the other hand, if the fingerprint corresponding to finger input 1110 does not match the registered fingerprint, the device will not fill out the form. In some embodiments, the device provides notification that the fingerprint does not match the registered fingerprint, for example with an audible or visible alarm. For example, the device will display a prompt with the text "Autofill permission denied, please try again".
In some implementations, one or more registered fingerprints are associated with a user who is authorized to use one or more sets of credentials, while one or more other registered fingerprints are 1 Not associated with a user who is authorized to use one or more sets of credentials. In some implementations, the determination that a fingerprint was associated with a user who was authorized to use one or more sets of credentials was associated with a user whose fingerprint was authorized to use one or more sets of credentials. Includes a determination that it matches at least one registered fingerprint.
In some implementations, different registered fingerprints are associated with different sets of credentials stored on the device, or different subsets of the set of credentials. In one embodiment, one or more registered fingerprints are with a user authorized to use all credentials in one or more sets of credentials, or a first subset of credentials with less than all credentials. While associated, one or more other registered fingerprints are less than all credentials and are different from the first subset of credentials, another that is only allowed to use the second subset of credentials. Associated with the user. Other embodiments are possible in which different registered fingerprints are associated with different sets or subsets of credentials. In some such implementations, the determination that a fingerprint in finger input was associated with a user authorized to use one or more sets of credentials is determined that the fingerprint is one or more registered fingerprint sets. It includes both determining that it matches at least one of them, and in that case, whether the fingerprint is allowed to use one or more corresponding credentials in one or more sets of credentials.
In some embodiments, the fingerprint is determined to be associated with a user authorized to use one or more sets of credential information and / or the fingerprint is out of one or more registered sets of fingerprints. The determination to match at least one of is made by the device (eg, using the fingerprint analysis module 131 of device 100). In some embodiments, the determination is made on behalf of the device, or in addition to it, by one or more additional devices.
In some embodiments, the device performs one or more actions when a predetermined number of consecutive requests for autofill are rejected (eg, 2, 3, 4, 5, or more rejections). .. For example, to protect confidential information from unauthorized access and / or use, the device disables the autofill feature (eg, for a given time or until a valid override password is entered by the user) or memory. Delete the credential stored from.
Referring to FIG. 12B, in some embodiments, filling out a form with one or more credentials involves displaying an organized version of one or more credentials in one or more fields of the form ( 1214). In some embodiments, the corresponding credentials are organized (eg, stripping, replacing, obscuring, or responding) when at least a portion of the corresponding credentials is unreadable to the user of the device. By blocking all or part of the characters in the credentials to do). For example, the credentials in Figure 11B (eg, credit card credentials 1104) are indicated by a series of circles.
In some embodiments, the device detects the corresponding fingerprint on the fingerprint sensor and detects the corresponding fingerprint while displaying the organized version of one or more credentials in one or more fields of the form. And according to the determination that the corresponding fingerprint was associated with a user who was allowed to reveal one or more sets of credentials, no organization of one or more sets of credentials in the fields of the form. Display the version (1216). For example, FIG. 11D shows a device displaying an unorganized version of a credential in response to a finger input 1112 (shown in FIG. 11C) corresponding to an authorized user's fingerprint.
In some embodiments, the same fingerprint authorized to use a set of credentials is also permitted to reveal one or more sets of credentials. In some embodiments, one or more fingerprints that are authorized to use the credentials are not authorized to reveal the credentials.
As shown in FIGS. 11A-11D, the device first displays the credentials in pre-organized format, followed by an unorganized version of the credentials if certain conditions are met. In some embodiments, the organized version of the corresponding credential contains an indication of the length of the corresponding credential, and the unorganized version of the corresponding credential includes a human-readable version of the corresponding credential ( 1218). A pre-organized credential can indicate the length of its original credential in several ways. For example, in some embodiments, the organized version of the corresponding credential comprises a symbol (eg, black circle, asterisk, letter, etc.) for each character in the corresponding credential. Credentials 1104 in FIGS. 11B-11D show an example of this, with one circle for each number in the credit card number. In some embodiments, the organized version of the corresponding credential comprises a symbol or graphic of length proportional to the length of the corresponding credential (eg, black bar, horizontal line, etc.). In some embodiments, the human-readable version of the corresponding credential is the plain text version of the credential (ie, the actual text, symbols, numbers, letters, etc. of the credential).
In some embodiments, or in some situations, the organized version of the corresponding credential contains an unorganized portion of the corresponding credential, and the unorganized version of the corresponding credential is human by the entire corresponding credential. Includes a readable version (1220). In some embodiments, certain unorganized parts of the organized credentials are by credential. For example, for credit card numbers, the last four digits of the organized version are displayed in plain text. For address credentials, the pre-organized version displays the street address (and / or city, or state) in plain text, and the rest of the address (eg, street name and zip code) is organized. Other parts of these credentials are displayed in unorganized form in various embodiments.
Devices are sometimes used by different users, each with a different set of credentials that they will use. For example, each user may have a unique username and password for an email account, a unique credit card number, unique login credentials for social network services, and so on. Also, in some embodiments, the device fingerprints a plurality of users so that the device can identify the requesting user by comparing the received fingerprint with the registered fingerprints of the plurality of users. You can register. Therefore, in some embodiments, in response to receiving a request to fill out the form automatically, the device determines which user issued the request (eg, the fingerprint of finger input 1110, the registered fingerprint). Identifies (as compared to) and automatically fills out the form with the corresponding credential for the identified user. Thus, for a plurality of different users of a single device, personalized autofill based on fingerprint recognition is provided.
Similarly, the user of the device may have multiple different instances of a particular type of credential. For example, a user may have multiple email accounts, each with a unique email address and password. The user may also have multiple credit cards associated with each unique credit card information. In addition, the user may have a plurality of different mailing addresses (eg, home and work addresses). In some embodiments, the corresponding set of one or more credentials of the user is associated with the different corresponding fingerprints of the user. For example, the credential information of the first credit card and billing address is associated with the fingerprint of the user's right thumb (RT), and the second credit card and billing address is associated with the fingerprint of the right index finger (RI). As another example, credit card credentials are associated with the fingerprint of the user's right thumb (RT), and login credentials for social network services are associated with the fingerprint of the right index finger (RI). Therefore, in some embodiments, the device selects (from a plurality of sets) one or more sets of credentials corresponding to a particular fingerprint detected by the fingerprint sensor and one or more selected. Automatically fill out the form with a set of credentials. Other than the above, associations with finger-credential sets are also possible. For example, any credential or set of credentials described herein may be associated with any unique fingerprint, whether it is a different finger of the same user or a finger of a different user.
Understand that the particular order described for the actions in FIGS. 12A-12B is merely exemplary and is not intended to indicate that the order is the only order in which the actions can be performed. I want to be. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, details of other processes described herein with respect to the other methods described herein (eg, the processes listed in paragraph number [0080]) are also described in FIGS. 12A-. Note that a method similar to Method 1200 described above in connection with 12B is also applicable. For example, the fingerprints, contacts, and user interface objects described above with reference to Method 1200 may optionally refer to other methods described herein (eg, those listed in paragraph [0080]). It has one or more of the characteristics of the fingerprints, contacts, and user interface objects described herein. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 13 shows a functional block diagram of the electronic device 1300 configured according to the ideas of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 13 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 13, the electronic device 1300 receives contact with a display unit 1302 configured to display a form with fields corresponding to one or more credentials in one or more sets of credentials. Optional touch sensing surface unit 1304 configured to store, fingerprint sensor unit 1306, credential storage unit 1307 configured to store one or more sets of credentials, and display unit 1302, optional. The touch sensing surface unit 1304, the credential storage unit 1307, and the processing unit 1308 connected to the fingerprint sensor unit 1306 are provided. In some embodiments, the processing unit 1308 includes a request receiving unit 1310, a form filling unit 1312, a display enabling unit 1314, and a fingerprint matching unit 1316.
Processing unit 1308 requests (eg, fingerprint sensor unit 1306) including finger input to automatically fill out a form with one or more credentials in one or more sets of credentials (eg, fingerprint sensor unit 1306). For example, a fingerprint associated with a user who is authorized to use one or more sets of credentials for finger input in response to a request received (on request receiving unit 1310) and automatically filling out the form. Fill out the form with one or more credentials (eg, in the form filling unit 1312) and fingerprints that are not associated with a user who is authorized to use one or more sets of credentials for finger input, as determined to include. According to the determination to include, it is configured to stop filling out the form with one or more credentials (eg, in the form filling unit 1312).
In some embodiments, the set of one or more credentials includes one or more of a user ID, password, credit card number, bank account number, address, telephone number, and shopping credentials.
In some embodiments, filling out a form with one or more credentials displays an organized version of one or more credentials in one or more fields of the form (eg, display enablement unit 1314). Includes enabling).
In some embodiments, the fingerprint sensor unit 1306 will detect the corresponding fingerprint on the fingerprint sensor while the organized version of one or more credentials is displayed in one or more fields of the form. The processing unit 1308 is configured and associated with a user who is authorized to detect the corresponding fingerprint and to reveal one or more credentials for the corresponding fingerprint (eg, fingerprint matching unit). According to the determination (using 1316), it is further configured to enable the display of unorganized versions of one or more credentials in the fields of the form (eg, display enablement unit 1314).
In some embodiments, the organized version of the corresponding credential includes an indication of the length of the corresponding credential, and the unorganized version of the corresponding credential includes a human-readable version of the corresponding credential.
In some embodiments, the organized version of the corresponding credential comprises an unorganized portion of the corresponding credential, and the unorganized version of the corresponding credential includes a human-readable version of the entire corresponding credential. ..
In some embodiments, the determination that a fingerprint is associated with a user authorized to use one or more sets of credentials matches the fingerprint with at least one of one or more registered sets of fingerprints. Including the judgment that. In some embodiments, the device 1300 determines that the fingerprint matches at least one of one or more registered fingerprint sets (eg, using the fingerprint matching unit 1316).
FIG. 14A shows an exemplary user interface displayed on the display of the portable multifunction device 100. The user interface displays a selection page 1402 containing one or more selectable user interface objects, including the credential manager icon 1404. Page selection 1402 is an example of an interface in which the user can request the display of stored credentials (eg, by requesting activation and / or display of the credential manager interface).
As shown in FIG. 14A, device 100 receives a request to display one or more sets of credentials (eg, contact 1406 indicating user selection of the credential manager icon 1404).
FIG. 14B shows an exemplary configuration manager interface 1403, which is displayed in response to contact 1406. The configuration manager interface 1403 contains fields 1408 (1408-1, ..., 1408-6) that correspond to one or more credentials. Field 1408 corresponds to an embodiment of the credential stored in device 100, according to some embodiments. For example, field 1408 is a username field 1408-1 and a password field 1408-2 associated with an email account, a user ID field 1408-3 and a password field 1408-4 associated with a shopping website / application account, and Includes user ID field 1408-5 and password field 1408-6 associated with the social network account. Other credential fields such as credit card information are also possible.
Device 100 displays the organized version of the credential in each field 1408. In this embodiment, the organized credentials are displayed as a series of black circles. However, other organizing methods are also considered (eg, exclusion, replacement, or obfuscation of any character so that the credentials are unreadable to the user of the device).
As shown in FIG. 14B, device 100 detects a finger input 1406 on the fingerprint sensor 169 while displaying the organized credentials in the credential field 1408 of configuration manager interface 1403. The device 100 detects the fingerprint contained in the finger input 1406, and if the fingerprint is detected and associated with a user who is authorized to fingerprint, the device 100 will be in the field 1406, as shown in FIG. 14C. Displays fingerprints in unorganized format. Specifically, FIG. 14C shows a configuration manager interface 1403 in which the credentials are displayed in plain text so that they are readable (and / or editable) by the user of the device.
FIGS. 15A to 15B are flow charts showing a method 1500 for revealing organized information according to some embodiments. Method 1500 is performed on an electronic device having a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some actions of the method 1500 may be optionally combined and / or the order of some actions may be optionally changed.
As described below, Method 1500 provides an intuitive way to reveal the organized credentials. This method creates a more efficient human-machine interface to reduce the cognitive burden on the user when attempting to review or edit the credentials displayed in pre-organized format. For battery-powered electronic devices, enabling users to reveal pre-organized credentials faster and more efficiently saves power and increases battery charging intervals.
The device stores one or more sets of credentials (1502). As mentioned above, in some embodiments, the credential is a secure credential associated with the user of the device and is stored in the memory of the device (eg, memory 102 of FIG. 1A). In some embodiments, the credentials are stored in a secure area of memory and / or encrypted to prevent unauthorized access to the credentials.
In some embodiments, one or more sets of credentials include credentials corresponding to multiple different accounts of users of the device (1504). For example, a user may have one or more email accounts, one or more payment accounts (eg, credit cards, bank accounts, online payment accounts, etc.), shopping credentials (eg, electronic commerce websites and / or) on the device. Credentials may be stored for multiple different accounts, such as usernames and passwords for applications), credentials for social network accounts, and so on. FIG. 14B shows an example of credentials corresponding to multiple different accounts of a user on the device.
In some embodiments, one or more sets of credential information includes passwords for a plurality of different accounts of users of the device (1506). For example, as shown in Figure 14B, one or more sets of credentials include a webmail account password (eg, credential field 1408-2), a shopping site password (eg, credential field 1408-4), and a social network. Includes the account password (eg, credential field 1408-6).
In some embodiments, one or more sets of credentials include payment authorization information for a plurality of different payment accounts for users of the device (1508). Payment permission information includes, for example, credit card information (eg, credit card number, expiration date, security code, billing address, etc.), online payment account information (eg, account number, user identification number, password, etc.), bank account. Includes information (eg, bank account number, routing number, user identification number, password, etc.).
In some embodiments, the set of one or more credentials includes one or more of a user ID, password, credit card number, bank account number, address, phone number, and / or shopping credentials (1510). .. Examples of these credentials are described above and are shown in FIGS. 11A-11D and 14B-14C.
The device receives a request to display one or more sets of credentials (1512). In some embodiments, the request comprises a user selection of selectable user interface objects (eg, icons). For example, FIG. 14A shows a contact 1406 indicating a user selection of the credential manager icon 1404. In response to a request to display one or more sets of credentials (eg, contact 1406), the display shows the organized version of one or more sets of credentials (1514). In some embodiments, the organized version of one or more sets of credentials is displayed in the "credential manager" interface, as shown in Figure 14B.
In some embodiments, the organized version of the credential is identified (eg, near or otherwise associated) by unorganized human-readable text (ie, a label) indicating the type of credential. Is displayed). Non-limiting examples of credential labels include usernames, user identification information, email addresses, passwords, credit card numbers, expiration dates, and the like. In some embodiments, the organized version of the credential is identified by unorganized human-readable text (ie, a label) indicating which account was associated with the particular organized credential. For example, FIG. 14B shows the webmail credentials (webmail account) that are displayed in association with the text indicating the account, as well as the text (username and password) indicating the type of each credential.
The device detects a fingerprint on the fingerprint sensor while displaying the organized version of one or more sets of credentials (1516). For example, FIG. 14B shows a finger input 1406 (including a fingerprint) on the fingerprint sensor 169 while displaying the organized version of the credential information to the credential manager 1403.
Depending on the detection of the fingerprint and the determination that the fingerprint was associated with a user authorized to reveal one or more sets of credentials, the device will not have one or more sets of credentials. Display the version of the organization (1518). FIG. 14C displays the plain text version of the credentials organized in FIG. 14B in response to the detection of a fingerprint (eg, finger input 1406) and the determination that the fingerprint was associated with an authorized user. Is shown. In some embodiments, the determination that a fingerprint is associated with a user who is allowed to reveal one or more sets of credentials is with at least one of one or more registered fingerprint sets. Includes a determination to match (1520).
In some embodiments, the fingerprint is determined to be associated with a user authorized to reveal one or more sets of credentials, and / or the fingerprint is out of one or more registered sets of fingerprints. The determination to match at least one of is made by the device (eg, using the fingerprint analysis module 131 of device 100). In some embodiments, the determination is made on behalf of the device, or in addition to it, by one or more additional devices.
With reference to FIG. 15B, in some embodiments, the organized version of the corresponding credential contains an indication of the length of the corresponding credential, and the unorganized version of the corresponding credential is the human of the corresponding credential. Includes a readable version (1522). For example, in some implementations, the organized version of the corresponding credential contains a symbol (eg, black circle, asterisk, letter, etc.) for each character . Credentials 1104 in FIGS. 11B-11D show an example of this, with one black circle for each number in the credit card number. In some embodiments, the organized version of the corresponding credential comprises a symbol or graphic of length proportional to the length of the corresponding credential (eg, black bar, horizontal line, etc.). In some embodiments, the human-readable version of the corresponding credential is the plain text version of the credential (ie, the actual text, symbols, numbers, letters, etc. of the credential).
In some embodiments, the organized version of the corresponding credential contains an unorganized portion of the corresponding credential, and the unorganized version of the corresponding credential includes a human-readable version of the entire corresponding credential ( 1524). In some embodiments, certain unorganized parts of the organized credentials are by credential. For example, for credit card numbers, the last four digits of the organized version are displayed in plain text. For address credentials, the pre-organized version displays the street address (and / or city, or state) in plain text, and the rest of the address (eg, street name and zip code) is organized. Other parts of these credentials are displayed in unorganized form in various embodiments.
Understand that the specific order described for the actions in FIGS. 15A-15B is merely exemplary and is not intended to indicate that the order is the only order in which the actions can be performed. I want to be. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, details of other processes described herein in connection with other methods described herein (eg, those listed in paragraph [0080]) are also described in FIGS. 15A ~. Note that it is applicable in a manner similar to Method 1500 described above in relation to 15B. For example, the fingerprints, contacts, and user interface objects described above with reference to Method 1500 may optionally refer to other methods described herein (eg, those listed in paragraph [0080]). It has one or more of the characteristics of the fingerprints, contacts, and user interface objects described herein. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 16 shows a functional block diagram of an electronic device 1600 configured according to the principles of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 16 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 16, the electronic device 1600 includes a display unit 1602, an optional touch sensing surface unit 1604 configured to receive contact, a fingerprint sensor unit 1606, and a set of one or more credentials. It includes a credential storage unit 1607 configured to store, a display unit 1602, an optional touch sensing surface unit 1604, a credential storage unit 1607, and a processing unit 1608 coupled to the fingerprint sensor unit 1606. In some embodiments, the processing unit 1608 includes a request receiving unit 1610, a display enabling unit 1612, and a fingerprint matching unit 1614.
Processing unit 1608 receives a request to display one or more sets of credentials (eg, using request receiving unit 1610) and receives a request to display one or more sets of credentials. Enables display of the organized version of one or more credential sets (for example, on the display enablement unit 1612) and on the fingerprint sensor while the organized version of one or more credential sets is displayed. According to the determination that the fingerprint was detected and that the fingerprint was associated with a user authorized to reveal one or more sets of credentials (eg, using the fingerprint matching unit 1614). It is configured to enable the display of an unorganized version of one or more sets of credentials (eg, using the display enablement unit 1612).
In some embodiments, one or more sets of credentials include credentials corresponding to a plurality of different accounts of users of the device.
In some embodiments, one or more sets of credentials include passwords for a plurality of different accounts of users of the device.
In some embodiments, one or more sets of credentials include payment authorization information for a plurality of different payment accounts for users of the device.
In some embodiments, the set of one or more credentials includes one or more of a user ID, password, credit card number, bank account number, address, telephone number, and shopping credentials.
In some embodiments, the organized version of the corresponding credential includes an indication of the length of the corresponding credential, and the unorganized version of the corresponding credential includes a human-readable version of the corresponding credential.
In some embodiments, the organized version of the corresponding credential comprises an unorganized portion of the corresponding credential, and the unorganized version of the corresponding credential includes a human-readable version of the entire corresponding credential. ..
In some embodiments, the determination that a fingerprint is associated with a user who is allowed to reveal one or more sets of credentials is at least one of the registered fingerprints. Includes a determination to match one. In some embodiments, the device 1600 determines that the fingerprint matches at least one of one or more registered fingerprint sets (eg, using the fingerprint matching unit 1614).
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. Is executed arbitrarily by running.
The operations described above with reference to FIGS. 12A-12B and 15A-15B are optionally performed by the components shown in FIGS. 1A, 1B, or 13 or 16. For example, the display operation 1206, the request reception operation 1208, and the form filling operation 1210 (Fig. 12A), and the request reception operation 1512, the credential display operation, 1514, the fingerprint detection operation 1516, and the credential clarification operation 1518 (Fig. 15A) are performed. It is optionally executed by the event sorter 170, the event recognizer 180, and the event handler 190. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those of skill in the art how other processes will be carried out based on the components shown in FIGS. 1A-1B.
Manage the use of stored credentials
Many electronic devices provide services that require specific credentials that are used by the device or service provider to determine a user's eligibility to receive the service. Such credentials often consist of information that is not readily accessible to anyone other than the specific user (s) associated with the credential. Examples of credentials include passcodes, registered username and password combinations, memorized answers to security questions, credit card information, social security numbers, and the like. Security can be promoted by requiring the user to enter the correct credentials each time the user wants to access a particular service, but such requests are also cumbersome and cumbersome. As described herein, it automatically stores the credentials previously provided on the device to access the function or service, and then allows access to that function or service through a registered fingerprint. Doing so helps streamline access to a user's features or services without significantly compromising the level of access security requirements. In addition, as described herein, in some embodiments, the device can have multiple registered fingerprints at any given time, and the user can leave the device in an unlocked state. In the meantime, one or more additional fingerprints may be registered. Therefore, it is important to have a way to securely manage the automatic use of stored credentials when one or more additional fingerprints are registered since the last credential was used.
As described herein, in some embodiments, after the fingerprint registration process has been successfully completed and one or more fingerprints have been registered, the device will automatically receive the credentials manually entered by the user. Save each automatically. When any of the stored credentials on the device are subsequently needed (eg, by a software application or online service provider), the device automatically prompts the user to manually enter the required credentials. Instead, encourage them to provide their registered fingerprints. When the user provides a valid fingerprint, the device automatically retrieves and uses the appropriate stored credentials on behalf of the user. When one or more additional fingerprints are later enrolled (or, in some embodiments, if an attempt is made to add more fingerprints), the automatic use of previously stored credentials is It is automatically disabled (for example, by destroying previously saved credentials or changing the default usage settings). Thus, when the credential is subsequently needed on the device, the device prompts the user to manually enter the credential instead of accepting any fingerprint input. After the user provides the correct credentials, the device saves the credentials and re-enables automatic use of the saved credentials through the registered fingerprint. Automatic management of such stored credentials improves access security on the device. For example, if a second user adds (or, in some embodiments, attempts to add) the second user's fingerprint to a set of registered fingerprints, until the credentials are re-entered. The registered fingerprint cannot be used to authorize the use of previously stored credentials.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 17A-17J and 18A-18C include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 17A-17J and 18A-18C will be discussed with reference to a device having a touch screen 112 and a separate touch sensing surface 359-2, but with similar behavior. However, while the user interface shown in FIGS. 17A to 17J is displayed on the display 450, the integrated fingerprint is detected in response to the input described in FIGS. 17A to 17J being detected on the integrated fingerprint sensor 359-1. It is optionally executed on the device by the sensor 359-1. Further, a similar behavior is optionally on a device having a display 450 and a separate touch sensing surface 451 instead of the touch screen 112, while displaying the user interface shown in FIGS. 17A-17J on the display 450. , Fingerprint sensor 169 ( For example, it is performed in response to detecting the contact described in FIGS. 17A-17J on the integrated fingerprint sensor 359-1 or the separate fingerprint sensor 359-2) and / or the separate touch sensing surface 451. In such an embodiment, the contacts shown in FIGS. 17A-17J are optionally performed on a focus selector corresponding to the position of the display 450 and a separate touch sensing surface (eg, touch sensing surface 451). Representing both the contact being made or the contact corresponding to the position of the gesture, the focus selector is optionally associated with the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or the corresponding contact). Point), or the center of gravity of two or more contacts detected on the touch screen 112, optionally replaced with the displayed cursor.
FIGS. 17A-17J illustrate exemplary processes that occur on an electronic device (eg, device 100), according to some embodiments, how automatic use of stored credentials through a registered fingerprint. Indicates whether it is controlled (eg, allowed and prevented). FIGS. 17A-17D show the automatic acquisition and use of stored credentials through previously registered fingerprints. 5E-5H show the subsequent enrollment of further fingerprints and the consequent invalidation of stored credentials. 5H-5J show the user's manual entry of credentials and automatic storage and revalidation of the credentials, and the revalidated credentials are made available for subsequent acquisition and use through the registered fingerprint.
In the exemplary scenario shown in FIGS. 17A-17D, a user of an electronic device (eg, device 100) has already registered one or more sets of fingerprints (eg, through the process described in Method 600) and registered. Occurs after automatic use of saved credentials through a pre-printed fingerprint is enabled (eg, through the fingerprint usage settings described in Method 600). In addition, the user manually enters the credentials during the first opportunity after registration of the fingerprint set, which requires a specific credential (eg, the passcode of a registered online shopping account) on the device. Prompted to. In response to manually receiving the credentials, the device will use the credentials to provide access to features or services (eg, to shop at an online store) and in the future through a set of registered fingerprints. Automatically save a duplicate of the credential for use.
Prior to the start of the exemplary scenario shown in Figure 17A, 100 on the device stores a copy of the credential (eg, the passcode of the online shopping account) and the user can see that the previous shopping session (eg, timed out or officially). After being terminated (through leaving), they are returning to the same online store again.
As shown in FIG. 17A, a user identifies an item (eg, software application 1702) to purchase from an online store (eg, an Apple store) and is presented with a user interface 1704 showing a detailed description of the item. User interface 1704 includes user interface elements 1706 for purchasing items using a registered online shopping account. In some embodiments, the online store stores the required payment information (eg, mailing address, billing address, credit card information, store credit, etc.) associated with a registered shopping account. , The stored payment information is applied when the passcode associated with the registered shopping account is received from the user at the time of purchase.
As shown in FIGS. 17A-17B, when the user selects the user interface element 1706 (eg, using touch input 1708) and proceeds to purchase the software application 1702, the device 100 receives (eg, receives from the online store). (Through notice), determine that a particular registered count passcode is required from the online store to complete the purchase. The device 100 further determines that the registered account passcode has been previously entered and stored on the device. Following such a determination, the device 100 prompts the user to provide a registered fingerprint to use the saved passcode to proceed with the purchase (eg, pop-up window 1710). To present. In some embodiments, the device 100 activates a fingerprint sensor 169 separate from the touch screen 112 to detect and capture any fingerprint input provided on the home button 204. In some embodiments, the device selectively activates a high resolution area 1712 on the touch screen 112 within the pop-up window 1710 to act as a fingerprint sensor. In some embodiments, the device displays an animation (eg, a glowing fingerprint graphic) to visually indicate to the user the activated high resolution area 1712.
In some embodiments, as shown in FIG. 17B, the pop-up window 1710 further displays a user interface element 1714 that cancels the current operation and returns to the user interface 1704 shown in FIG. 17A. In some embodiments, as shown in FIG. 17B, the pop-up window 1710 also displays a user interface element 1716 for manually entering the required account passcode using the keypad. Although not shown in this exemplary two-way scenario, those skilled in the art would require the user to use the device instead of providing a registered fingerprint if the user selects the user interface element 1716. You will understand that it presents an alternative user interface that allows you to type in a passcode or switch to another online shopping account.
As shown in FIG. 17C, the user is providing the fingerprint input 1718 through the fingerprint sensor 169 on the home button 204. The device 100 captures the fingerprint input 1718 and determines that the received fingerprint matches one of the set of fingerprints currently registered on the device 100. Device 100 further determines that the required account passcode is currently stored on device 100 and is not currently invalidated (eg, an exemplary scenario showing invalidation of a saved passcode is shown in Figure 17E ~. It will be shown later in Fig. 17H). According to such a determination, the device obtains the saved account passcode and provides the saved account passcode to the online store on behalf of the user. In some embodiments, the auto-filling of the saved account passcode into the online store passcode interface is presented to the user through animation. In some embodiments, as shown in Figure 17D, the saved passcode is provided to the online store in the background and the user is given a successful transaction after the saved passcode has been accepted by the online store. The user interface 1720 shown is presented. In this embodiment, the purchase of the selected item is confirmed and the download of the purchased application is started.
FIGS. 17A-17D show how stored credentials (eg, an account passcode) can be used on behalf of a user through a registered fingerprint provided by the user. FIGS. 17E-17H show how a saved credential can be used and invalidated after further fingerprints have been registered after the credential was saved. Disabling the automatic use of stored credentials after enrolling one or more additional fingerprints warns the user (implicitly or explicitly) that additional fingerprints have been enrolled. If further fingerprint registration is not controversial to the user, the user manually re-enables the automatic use of credentials through any of the sets of fingerprints currently registered on device 100. Can be provided.
Figure 17E-Figure 17F As shown, a new fingerprint on device 100 after the user exits the shopping interface of the online store and while the account passcode for the online store remains the stored credentials on device 100. Registration is successful. A specific description of an exemplary process for enrolling additional fingerprints is provided with reference to Method 600. As a result of enrolling the new fingerprint, the device 100 will have at least one fingerprint (eg, a new fingerprint) in the set of fingerprints currently enrolled on the device 100 enrolled after the saved account passcode was last used. It is determined. According to this determination, the device 100 disables the automatic use of the saved account passcode.
In other words, in some embodiments, automatic use of the saved account passcode, even if it provides the same fingerprint that the user previously used to apply the account passcode stored in the online store. This fingerprint will not give the same result thereafter because is disabled. In some embodiments, the automatic use of saved account passcodes (or other credentials) is not disabled for previously enrolled fingerprints, but the user manually enters the account passcode for that account. Newly registered fingerprints are disabled until the passcode is associated / connected with the newly registered fingerprint.
As shown in Figures 17G to 17H, when a user later returns to the same online store and wants to make another purchase using the same online shopping account, the device 100 is registered with the user. Instead of prompting you to provide a fingerprint, it prompts the user to manually enter the required passcode.
As shown in FIG. 17G, the user has identified an item to purchase in the same online store (eg, an interactive book 1724) and is presented with a user interface 1726 showing a detailed description of the item. User interface 1726 includes user interface element 1728 for purchasing items using a registered online shopping account. When the user selects user interface element 1728 (eg, using touch input 1730) to proceed with the purchase of the interactive book 1724, the device 100 again (eg, through a notification received from the online store) to complete the purchase. Determines that a particular registered account passcode is required by the online store. Device 100 further determines that the automatic use of the previously stored account passcode has been disabled on the device (eg, by further fingerprint registration, as shown in FIGS. 17E-17F). In some embodiments, the previously saved account passcode is removed from the device 100 through invalidation, and the device 100 simply determines that there is no saved account passcode at this time. With any of these decisions, as shown in Figure 17H, device 100 prompts the user to manually enter the required account passcode to proceed with the purchase (eg, pop-up window 1730). do.
FIG. 17I shows that the user provided the required passcode to pop-up window 1730 (eg, using the softkeypad 1732 provided with pop-up window 1730). The device 100 sends the received passcode to the online store as usual (eg, in encrypted form). When the online store confirms and accepts the passcode entered by the user, device 100 provides a user interface 1738 indicating that the purchase has been confirmed and the purchased interactive book has started downloading, as shown in Figure 17J. Present.
At this point, once the manually entered passcode is accepted by the online store, the device 100 will automatically save the account passcode and again with a set of registered fingerprints (eg, a set of currently registered fingerprints). Activate the automatic acquisition and use of saved account passcodes in the next transaction that requires an account passcode. For example, the next purchase transaction can proceed in a manner similar to that shown in FIGS. 17A to 17D.
18A-18C are flow diagrams illustrating a method 1800 for managing the automatic use of stored credential information through registered fingerprints, according to some embodiments. Method 1800 is performed on an electronic device (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A) comprising a display, a fingerprint sensor and optionally a touch sensing surface. In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. In some embodiments, the fingerprint sensor is integrated with a touch sensitive surface (eg, a touch sensitive surface separate from the touch screen or display). In some embodiments, the fingerprint sensor is separate from the touch sensitive surface. Some actions of Method 1800 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 1800 provides an efficient and intuitive way to provide automated use of stored credentials through registered fingerprints, while considering the possibility of unauthorized new fingerprint registration. Provides security. The method improves the security of using stored credentials while allowing multiple fingerprints to be enrolled on the device at the same time.
As shown in FIG. 18A, in an electronic device having one or more processors, memory, and a fingerprint sensor, the electronic device stores the corresponding credentials of the user of the device on the device (1802).
In some embodiments, the corresponding credential includes a credential selected from a set consisting of a user ID, password, credit card number, bank account number, address, telephone number, and shopping credential (1804). For example, in some embodiments, as shown in FIGS. 17A-17G, the corresponding credential is an account passcode for a registered shopping account at an online store (eg, an Apple store or an e-commerce store). .. The online store uses an account passcode to identify and / or authenticate the shopper and / or to obtain previously stored information associated with the shopper. In some embodiments, the corresponding credential is a user ID associated with a device, a user ID associated with an email account, or a user associated with an online service account (eg, an online gaming account, a document storage account, etc.). ID. In some embodiments, the corresponding credentials include a set of user information that is frequently used during online shopping, including credit card numbers, shipping addresses, billing addresses, credit card expiration dates, phone numbers, and /. Or credit card security code etc. are included. In some embodiments, the corresponding credentials include personal authentication information used to confirm the user's identification information. In some embodiments, the corresponding credential further includes other user data associated with the credentials (eg, address, birthday, age, preferences, etc.).
In some embodiments, the corresponding credential is a credit card transaction on an e-commerce website that applies to the corresponding context (eg, making a purchase using a shopping application, unlocking a locked screen). To complete). In some embodiments, the device stores the corresponding credential in association with the applicable corresponding context so that the device can obtain and use the correct credential in a given context. In some embodiments, the device stores the corresponding credentials in a secure form, eg, an encrypted form.
In some embodiments, the device allows the user to place the corresponding credentials in context (eg, using an account passcode for a registered online shopping account to complete a purchase transaction in an online store). Automatically remembers the corresponding credentials entered by the user when successfully used. In some embodiments, the device stores the corresponding credential through a user-initiated process of setting the corresponding credential.
In some embodiments, the context for using the corresponding credentials is a software application running on an electronic device (eg, a shopping application, a browser application presenting an online shopping portal, a device operating system, a security application, an email). Associated with applications, banking applications, etc.).
While running the software application (eg, while running the software application with fingerprint permission for automatic use of the corresponding credential currently enabled on the device) (1806), the device is of the device. The fingerprint is received by the fingerprint sensor (1808). According to the determination that the credential usage criteria have been met, the device is in the software application, depending on the receipt of the fingerprint and the determination that the received fingerprint matches at least one of the registered fingerprint sets. Automatically use the user's corresponding credentials (1810) (eg, without the user entering any additional authorization information other than the fingerprint). For example, in some embodiments, the user requests the execution of certain actions secured by the credential (eg, logs in to the secure user interface of the application, or takes a purchase procedure), and the credential. Automatically provided to the application for use in performing certain requested actions).
For example, as shown in FIGS. 17A-17D, in some embodiments, while running an online store software application, the device has the corresponding credentials (eg, account passcode) associated with the user by the software application. Determine what was requested. The device determines if the required credentials are currently stored on the device, in which case automatic use of the stored credentials through at least one of the registered fingerprint sets is currently enabled. Determine if it has been done. As described with reference to Method 600, automatic use of saved credentials through registered fingerprints can be enabled by the user with default fingerprint usage settings. If automatic use of saved credentials through a registered fingerprint is enabled and the appropriate credentials (eg account passcode) are already remembered on the device, the device is required for the user. Prompt to provide the registered fingerprint input (eg, using the pop-up window 1710 in Figure 17B) instead of providing the credential itself. In some embodiments, the device temporarily activates a fingerprint sensor (eg, fingerprint sensor 169 or 1712 in FIG. 17C) to capture the fingerprint input provided by the user. The device receives a fingerprint input on the fingerprint sensor (eg, fingerprint 1718 in Figure 17C) and checks to see if the received fingerprint matches one of the currently registered fingerprint sets on the device.
In some embodiments, the device provides fingerprint input with a fingerprint sensor (ie, automatically uses stored credentials), or manually inputs the credentials that the user wants to use for current secure behavior. Present a pop-up window that prompts the user to do so. For example, in some embodiments, the fingerprint sensor is activated at the same time as presenting a softkeypad with a text input field that allows the user to directly enter the required credentials. By giving the user these two choices at the same time, it is possible for the user to easily enter something other than the credentials stored on the device.
In some embodiments, the determination that the credential usage criteria have been met includes a determination that the use of the corresponding credential has not been invalidated (1812). For example, in some embodiments, the automatic use of the corresponding credential is optionally disabled when the total number of failed attempts to enter the registered fingerprint exceeds a predetermined threshold. In some embodiments, the automatic use of the corresponding credential is optionally disabled when further fingerprints are registered after the corresponding credential was last used. In some embodiments, the device also maintains a cumulative counter of non-matching fingerprint inputs provided so far. In some embodiments, the device disables the automatic use of stored credentials through the fingerprints when the number of mismatched fingerprints exceeds a predetermined threshold. For example, if the user provides more than the threshold number of mismatched fingerprints in response to a prompt for registered fingerprints (eg pop-up window 1710 in Figure 17C), the saved credentials (eg account passcode) will be automatic. Use is invalidated. In response, the device presents a different prompt to the user asking the user to manually enter the required credentials.
In some embodiments, the determination that the received fingerprint matches at least one of the registered fingerprints is any of all fingerprints currently registered on the device. Further includes the determination that it matches one of. In some embodiments, the determination that the received fingerprint matches at least one of the registered fingerprint sets is a subset of all fingerprints that the received fingerprint is currently registered on the device. A subset of registered fingerprints, further including a determination to match one of them, is one or more fingerprints specifically associated with the software application and / or the corresponding credential.
In some embodiments, the automatic use of the corresponding credential in a software application automatically adds data to one or more text fields provided by the software application with the corresponding credential. Including that. In some embodiments, automatically using the corresponding credential in a software application automatically sends the corresponding credential to the software application or through the software application to a remote server in plain or encrypted form. Including doing. For example, as shown in FIGS. 17C-17D, the device provides the saved credentials (eg, the saved account passcode) to the online store through the App Store application to complete the purchase transaction at the online store.
After automatically using the user's corresponding credentials in response to receiving the fingerprint, the device receives a request to enroll further fingerprints with the device (1814). Upon request for additional fingerprints to be registered using the device, the device adds additional fingerprints to the set of registered fingerprints (1816). For example, as shown in Figures 17D to 17F, using the registered fingerprint instead of manually entering the required account passcode, after the user closes the shopping transaction, the user has a new fingerprint on the device 100. Is requested to register, and an additional fingerprint (for example, finger 2 in FIG. 17F) is registered in the currently registered set of fingerprints on the device.
In some embodiments, in response to adding more fingerprints to the set of registered fingerprints, the device prevents the registered fingerprints from being used to authorize the automatic use of the corresponding credentials ( 1818). In some other embodiments, for improved security, the device automatically performs the corresponding credential for the registered fingerprint in response to detecting a request to register further fingerprints with the device. Prevents it from being used for permission of use, whether or not additional fingerprints are actually registered. Thus, in some other embodiments, the mere request to enroll further fingerprints (eg, activating "Add Finger" in Figure 17E) causes the device to automatically use the corresponding credential. Prevents registered fingerprints from being used to allow. Disabling the automatic use of stored credentials after attempting to enroll further fingerprints provides the user with a (implicit or explicit) warning of the attempted enrollment.
In some embodiments, the device enables the software application to automatically use the user's corresponding credentials when the device receives a fingerprint that matches at least one of the registered fingerprint sets. Remember the default fingerprint usage settings on your device (1820). For example, exemplary embodiments of default fingerprint usage settings for enabling automatic use of stored credentials are described with reference to Method 600.
In some embodiments, preventing a registered fingerprint from being used to authorize the automatic use of the corresponding credential involves removing or changing the value of the default fingerprint usage setting (1822). .. In some embodiments, removing or changing the value of the default fingerprint usage setting removes the previous permission from the user to enable automatic use of stored credentials through the registered fingerprint. , Or to change the fingerprint usage setting (eg, Touch ID payment setting 550 in Figure 5U) from enabled to disabled.
In some embodiments, preventing a registered fingerprint from being used to authorize the automatic use of the corresponding credential involves removing the default set of concealed values containing the corresponding credential (1824). ). For example, in some embodiments, the device deletes all currently stored stored credentials on the device so that no stored credentials are automatically used through the registered fingerprint. In such an embodiment, when the user manually enters the credential in context, the device automatically saves the manually entered credential and re-enables automatic use of the credential through the registered fingerprint. .. In some embodiments, if the device supports different sets of registered fingerprints for use with different sets of stored credentials, the device will support registered fingerprints with additional fingerprints added. Delete all saved credentials associated with the set.
In some embodiments, preventing the registered fingerprint from being used to authorize the automatic use of the corresponding credential removes the corresponding credential (eg, in the embodiments shown in FIGS. 5A-5J). Includes (removing the Apple ID) (1826). In some embodiments, the device deletes the corresponding credential along with one or more other stored credentials that have the same level of security on the device.
In some embodiments, the device tracks the number of failed attempts to provide a registered fingerprint to unlock the device. In some embodiments, if the device registers too many failed attempts to unlock the device with a registered fingerprint, the device keeps the device locked and through the registered fingerprint. It also disables the automatic use of saved credentials. In such an embodiment, even if the device is subsequently unlocked (eg, through the use of an unlock passcode), the user manually enters the auto-use of the saved credentials and the saved credentials. And / or required to be re-enabled by reconfiguring the default fingerprint usage settings. In some embodiments, the device receives N consecutive attempts to unlock the device via fingerprint permission (1828). Note that N is a default integer greater than a predetermined number of thresholds (eg, 1, 2, 3, 4, 5, or a considerable number of arbitrary trial failures). In response to receiving N consecutive failed unlock attempts through fingerprint authorization, the device prevents the enrolled fingerprint from being used to authorize the automatic use of the corresponding credential (1830). ..
In some embodiments, the device re-allows automatic use of stored credentials through a registered fingerprint after automatic use has been prevented or disabled (eg, through any of the above methods). Alternatively, a method for reactivating is provided. In some embodiments, after preventing the registered fingerprint from being used to authorize the automatic use of the corresponding credential (1832), the device receives a request to use the corresponding credential in a software application. (1834) (For example, as shown in Figure 17G, the device is an App. Receive a request from the Store application to complete the purchase transaction using your account passcode). If the automatic use of stored credentials is disabled, the device requests the corresponding credentials from the user (1836) (eg, pop-up window 1730 and softkeypad 1732, as shown in Figure 17H). By presenting). The device receives the corresponding credentials (eg, account passcode) from the user (1838) (eg, through the text entry field shown in pop-up window 1730 in Figure 17I). In some embodiments, in response to receiving the corresponding credential from the user (1740), the device uses the corresponding credential in a software application (eg, as shown in FIGS. 17I-17J) (1742). ), Enable the registered fingerprint to be used to authorize the automatic use of the corresponding credential (1744). For example, in some embodiments, once the automatic use of the corresponding credential is re-enabled, the user is the same software application (eg, App). If you go back to the Store application) and try to activate the same secure operation (for example, try to take another purchase procedure), the operation may proceed in a manner similar to that shown in Figures 17A-17D. Yes (ie, the user can provide a registered fingerprint instead of credentials to complete the purchase).
The particular order in which the actions in FIGS. 18A-18C are described is merely exemplary and is intended to show that the order described is the only order in which those actions can be performed. Please understand that it is not something that you do. Those of skill in the art will be aware of the various methods of reordering the operations described herein. Further, details of other processes described herein in connection with other methods described herein (eg, those listed in paragraph [0080]) are also shown in FIGS. 18A-18C. Note that it is applicable in a manner similar to Method 1800 described above in relation to. For example, the finger inputs (eg, including fingerprints), requirements, actions, credentials, and requirements described above with reference to Method 1800 are other methods described herein (eg, paragraph [0080]]. Any one or more of the finger input (including, for example, fingerprints), requirements, actions, credentials, and requirements described herein with reference to (methods listed in). Have. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 19 shows a functional block diagram of an electronic device 1900 configured according to the principles of the various embodiments described. The functional blocks of the device are optionally implemented by hardware, software, or a combination of hardware and software to implement the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 19 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 19, the electronic device 1900 has a display unit 1902 configured to display a graphic user interface, a touch sensor surface unit 1904 configured to receive contact, and a fingerprint input. It includes a configured fingerprint sensor unit 1906, a display unit 1902, a touch sensing surface unit 1904, and a processing unit 1908 connected to the fingerprint sensor unit 1906. In some embodiments, the processing unit 1908 includes a credential storage unit 1910, a determination unit 1912, a credential use unit 1914, a fingerprint registration unit 1916, a permission unit 1918, a configuration storage unit 1920, and a lock unit 1922. The request receiving unit 1924 and the credential receiving unit 1926 are provided.
According to some embodiments, the credential storage unit 1910 is configured to store the corresponding credential of the user of the device on the device. The fingerprint sensor unit 1906 is configured to receive fingerprints on the device's fingerprint sensor while the software application is running on the device. The determination unit 1912 is said to have met the credential usage criteria, including determining that the fingerprint received matches at least one of the set of registered fingerprints while the software application is running on the device. It is configured to determine. The credential use unit 1914 responds to the fingerprint received by the fingerprint sensor unit 1906 while the software application is running on the device, and the received fingerprint is at least one of the set of registered fingerprints. The software application is configured to automatically use the user's corresponding credential according to the determination by the determination unit 1912 that the credential usage criteria are met, including the determination to match. The fingerprint registration unit 1916 requests that the credential use unit 1914 use the device to register further fingerprints after the fingerprint sensor unit 1906 automatically uses the user's corresponding credential in response to the fingerprint being received by the fingerprint sensor unit 1906. Configured to receive. The fingerprint registration unit 1916 is further configured to add additional fingerprints to the set of registered fingerprints in response to a request to register additional fingerprints using the device. The license unit 1718 will use the registered fingerprints to authorize the automatic use of the corresponding credentials as the fingerprint registration unit 1916 adds more fingerprints to the set of registered fingerprints. Configured to prevent.
In some embodiments, determining that the credential usage criteria have been met includes determining that the use of the corresponding credential has not been invalidated.
In some embodiments, the corresponding credential includes a credential selected from a set consisting of a user ID, password, credit card number, bank account number, address, telephone number, and shopping credential.
In some embodiments, the configuration storage unit 1920 causes the device to automatically use the user's corresponding credentials in a software application when it receives a fingerprint that matches at least one of the registered fingerprint sets. It is configured to remember the default fingerprint usage settings on the device to enable it.
In some embodiments, the authorization unit 1918 prevents the registered fingerprint from being used to authorize the automatic use of the corresponding credential by removing or changing the value of the default fingerprint usage setting. As such.
In some embodiments, the authorization unit 1918 prevents the registered fingerprint from being used to authorize the automatic use of the corresponding credential by removing the default set of concealed values containing the corresponding credential. It is configured to do so.
In some embodiments, the authorization unit 1918 is configured to prevent the registered fingerprint from being used to authorize the automatic use of the corresponding credential by deleting the corresponding credential.
In some embodiments, the lock unit 1922 receives an attempt to unlock the device N times in a row, where N is the default integer, via fingerprint authorization, N times through fingerprint authorization. It is configured to prevent the registered fingerprint from being used to authorize the automatic use of the corresponding credential in response to receiving attempts to fail to unlock the device in a row.
In some embodiments, the request receiving unit 1924 makes a request to use the corresponding credential in a software application after the registered fingerprint is prevented from being used to authorize the automatic use of the corresponding credential. Configured to receive. The credential receiving unit 1926 requests the corresponding credential from the user (for example, after the request receiving unit 1924 receives the request and prevents the registered fingerprint from being used to authorize the automatic use of the corresponding credential). As such. In some embodiments, the credential use unit 1914 is further configured to use the corresponding credential in a software application in response to the credential receiving unit receiving the corresponding credential from the user. In addition, in some embodiments, the authorization unit 1918 uses the registered fingerprint to authorize the automatic use of the corresponding credential in response to the receipt of the corresponding credential from the user by the credential receiving unit. Further configured to enable.
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. Is executed arbitrarily by running.
The operations described above with reference to FIGS. 18A-18J are optionally performed by the components shown in FIGS. 1A, 1B, or 19. For example, the storage operation 1802, the reception operation 1808, the use operation 1810, the additional operation 1816, and the preventive operation 1818 are arbitrarily executed by the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes are performed based on the components shown in FIGS. 1A-1B.
Reveal organized information
Many electronic devices have a graphical user interface that contains personal information (eg, information that the user of the device does not want others to see). Organizing personal information prevents others from viewing it. However, organizing the personal information also prevents the user of the device from viewing the personal information. Some methods require the user to perform a complex set of steps (eg, navigate to the configuration menu and / or enter a passcode or password) to reveal the organized information. (For example, by unlocking the device or changing the organization settings). This makes it difficult and time-consuming for the user to quickly see the unorganized version of the information. Therefore, it provides the user with a quick and intuitive way to remove the organization from the information displayed by the device so that the personal information is hidden from others but still easily accessible to the user of the device. It would be advantageous to do. In some embodiments described below, a fingerprint sensor is used to determine whether to reveal the organized information to obtain an improved method of revealing the organized information. In particular, while the device displays information that has a organized portion, the device previously determines whether to display an unorganized version of the organized portion of the information on the device's fingerprint sensor. Judgment is made based on whether or not a fingerprint matching the registered fingerprint is detected. This method streamlines the process of revealing organized information by allowing the user to reveal the organized information by simply placing it on the device's fingerprint sensor with a finger. Eliminate the need for additional and separate steps to reveal organized information.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 20A-20T and 21A-21C include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 20A-20T and 21A-21C will be discussed with reference to a device having a touch screen 112 and a separate touch sensing surface 359-2, but with similar behavior. Responds to detecting the input described in FIGS. 20A-20T on the integrated fingerprint sensor 359-1 while displaying the user interface shown in FIGS. 20A-20T on the display 450. It is optionally executed on the device by the sensor 359-1. Further, a similar behavior is optionally on a device having a display 450 and a separate touch sensing surface 451 instead of the touch screen 112, while displaying the user interface shown in FIGS. 20A-20T on the display 450. , Fingerprint sensor 169 ( For example, it is executed in response to detecting the contact shown in FIGS. 20A-20T on the integrated fingerprint sensor 359-1 or the separate fingerprint sensor 359-2) and / or on the separate touch sensing surface 451. To. In such an embodiment, the contacts shown in FIGS. 20A-20T are optionally performed on a focus selector corresponding to the position of the display 450 and a separate touch sensing surface (eg, touch sensing surface 451). Representing both the contact being made or the contact corresponding to the position of the gesture, the focus selector is optionally associated with the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or the corresponding contact). Point), or the center of gravity of two or more contacts detected on the touch screen 112, optionally replaced with the displayed cursor.
FIG. 20A shows the locked device user interface displayed on the touch screen 112 of device 100 while the device is in locked operating mode. In some embodiments, the locked device user interface is displayed while one or more features of device 100 are locked (eg, private compared to when the device is in unlocked operating mode). Limited access to data and applications). In some embodiments, when the device detects a swipe gesture involving a left-to-right touch movement across the touch screen 112, the device is unlocked or an unlocking sequence is initiated (eg,). The user is prompted to enter the passcode, as shown in Figure 20G). In some embodiments, the device is unlocked when a swipe gesture is detected on the unlocked image 2001 (eg, the text "> Slide to unlock" in Figure 20A).
In Figure 20B, while the device is in locked operating mode, the device receives the mail and the organized part 2004, which corresponds to a fragment of the content of the mail, and the unorganized part, including the sender, subject, and time of the mail. Generate notification 2002 including 2006.
In FIG. 20C, the device detects a finger gesture including finger contact 2008 on the fingerprint sensor 169. Fingerprint 2008 contains fingerprints that match previously registered fingerprints, and the device displays an unorganized version 2010 of the email content in response to detecting finger touch 2008. In this embodiment, the device continues to display the unorganized portion 2006 of notification 2002 while displaying the unorganized version 2010 of the content.
Figure 20D shows that the device received different email notifications, including, for example, compressed versions 2012-4 of email notifications 2002, calendar notifications 2012-1, phone notifications 2012-2, and email notifications 2012-3, as shown in FIGS. 20B-20C. After generating multiple notifications corresponding to a communication or event, the device indicates a locked device user interface that is displayed on the touch screen 112 of device 100 while in the locked operating mode. In Figure 20D, the contents of email notifications 2012-3 and 2012-4 are organized, the names of the callers of telephone notifications 2012-2 are organized, but none of the information in calendar notifications 2012-1 is organized. In some embodiments, the name or location of the calendar notice is organized. In some embodiments, none of the information in Telephone Notification 2012-2 is organized. In some embodiments, one or more of these notifications 2012 in FIG. 20D contain only organized information.
In FIGS. 20E-20F, the device detects contact 2020 on the touch screen 112 and detects contact 2020 movement 2022-a and 2022-b across the touch screen 112. In response to detecting contact 2020 at or near the location of the icon 2024 corresponding to email notification 2012-3, the device has descriptive information about email notification 2012-3 (eg, organized and unorganized corresponding to the notification). Stop displaying (organization information) and instead display instructions to access the email corresponding to the notification (eg, "Slide to unlock" 2026). In response to detecting the movement of contact 2020, the device moves icon 2024 across the display (eg, gives a visual confirmation that the notification corresponding to icon 2024 has been selected, and / or of the device. To show progress towards unlocking and displaying emails corresponding to Email Notification 2012-3). In some embodiments, when at least part of the corresponding notification is organized, the device is associated with the corresponding notification by requesting further authentication from the user (eg, as shown in Figure 20G). Respond to attempts to unlock the device to access more information (eg, swipe gesture at the position corresponding to the corresponding notification, as shown in Figures 20E-20F). In some embodiments, when the corresponding notification is not organized, the device relates to the corresponding notification by displaying additional information related to the corresponding notification (eg, as shown in FIG. 20L). Respond to attempts to unlock the device to access more information (eg, swipe gesture at the location corresponding to the corresponding notification, as shown in Figures 20J-20K).
In Figure 20G, the device displays an unlock user interface for unlocking the device. In Figure 20G, the device unlocks the device in response to detecting the input of the device's passcode or in response on the fingerprint sensor 169 to detect a fingerprint that matches a previously registered fingerprint on the fingerprint sensor 169. do. For example, when the correct passcode is entered into the passcode entry user interface 2028 (eg, by detecting a tap gesture on the number corresponding to the correct passcode entry), and / or with a previously registered fingerprint. When a matching fingerprint is detected on the fingerprint sensor 169, the device displays an email copy corresponding to the activated notification 2012-3 in Figure 20D (eg, as shown in Figure 20L) in the email application. ..
In Figure 20H, the device fingerprints finger touch 2030, including a fingerprint that matches a previously registered fingerprint, while the device is displaying multiple notifications 2012, both of which contain both organized and unorganized information. Displays an unorganized version of previously organized notifications (eg, as shown in Figure 20D) in response to detection on sensor 169. In this example, the device continues to display the unorganized portion of Notification 2012 while displaying the unorganized portion of multiple notifications that previously contained the organized portion (eg Notifications 2012-2, 2012). -3 and 2012-4 previously include the organized portion in Figure 20D and do not include the organized portion in Figure 20H after finger contact 2030 is detected). In some embodiments, the organized version of the notification is redisplayed in response to detecting a lift-off of finger touch 2030 (eg, returning to the user interface shown in Figure 20D). In some embodiments, the device is unlocked in response to detecting a lift-off of finger contact 2030 (eg, as shown in FIG. 201). In some embodiments, after detecting a lift-off of finger contact 2030, the unorganized version of the notification is for a predetermined time period (eg, 5, 10, 15, 30, 60 seconds, or some other equivalent time). (Period) or until certain criteria are met (eg, the device's display disappears due to a screen dimming timer or a screen dimming input from the user by activating the device's sleep / power button). , Continues to be displayed. Here, in FIG. 20J, an unorganized version of the notifications 2012-2 and 2012-4 is displayed even though the device has not detected a fingerprint on the fingerprint sensor 169 at this time.
In Figure 20I, in response to the fingerprint sensor 169 detecting a lift-off of finger contact 2030 (Figure 20H), the device transitions from operating in locked mode to operating in unlocked mode, with several differences. The device displays the application launch interface for launching the application (eg, the device detects a tap gesture on the corresponding icon of the icons displayed on the touch screen 112 in Figure 20I, Figure 4A. Open the application corresponding to the corresponding icon, as described in more detail above). In some embodiments, when the device is unlocked, the most recently opened application (eg, the application that was open when the device was locked) is displayed instead of displaying the application launch user interface. (For example, if the mail application was open when the device was last locked, the mail application user interface, such as the interface shown in Figure 20L, will appear on the display).
In FIGS. 20J-20K, while the unorganized version of Notification 2012 is displayed (eg, as shown in Figure 20H), the device touches 2032 on the touch screen 112, and touch 2032 across the touch screen 112. Detects movements 2034-a and 2034-b. In response to detecting contact 2032 at or near the location of the icon 2024 corresponding to email notification 2012-3, the device has detailed information about email notification 2012-3 (eg, organized and unorganized corresponding to notification). Stop displaying information) and instead display instructions to access the email corresponding to the notification (eg, "Slide to unlock" 2026). In response to detecting the movement of contact 2032, the device moves icon 2024 across the display (eg, gives a visual confirmation that the notification corresponding to icon 2024 has been selected, and / or of the device. To show progress towards unlocking and displaying emails corresponding to Email Notification 2012-3).
In FIG. 20L, the device displays the mail received by the device, corresponding to Notification 2012-3 in FIGS. 20D and 20H. As shown in Figure 20L, the full version of the email contains additional content that was not included in the fragment shown in the notification corresponding to the email. The mail interface in Figure 20L also contains multiple controls 2036 that allow the user to perform or initiate various actions, eg, navigation to different mail (eg, tap control 2036-1). To display an inbox view with multiple email representations, tap 2036-3 to navigate to the previous email in the current folder, or tap control 2036-2 in the current folder Navigate to the next email), flag / star the displayed email (eg tap control 2036-4), store the displayed email folder (eg tap control 2036-5) ), Delete / archive the displayed email (eg tap control 2036-6), reply / forward the displayed email (eg tap control 2036-7), and Includes drafts of new emails (for example, tap control 2036-8).
In FIGS. 20M-20O, the device detects contact 2040 on the touch screen 112 and movements 2042-a and 2042-b across the touch screen 112. In response to detecting the downward movement of the contact 2040 from the top edge of the touch screen 112, the device slides the notification interface 2044 down on the touch screen 112, eg, according to the movement 2042 of the contact 2040. , Display gradually. As shown in FIG. 20P, the notification interface 2044 includes a plurality of notifications including organized and unorganized information, as well as a plurality of notifications containing only unorganized information.
In Figure 20P, calendar notifications 2046-1 and 2046-2 are unorganized, and email notifications 2046-3 and 2046-4 include unorganized senders, subject, and time, as well as organized content, and telephone notifications. 2046-5 and 2046-6 include organized callers and unorganized times, and message notifications 2046-7 and 2046-8 include unorganized senders and times as well as organized content. In Figure 20P, while the organized version of some notifications is displayed, contact 2048 near the bottom edge of the touchscreen 112 (as shown in Figure 20P), and above contact 2048 on the touchscreen 112. In response to detecting an upward swipe gesture, including detecting a directional movement 2048, the device returns to the display of a locked device user interface, such as the user interface shown in Figure 20M.
In Figure 20Q, in response to detecting finger touch 2052 on the fingerprint sensor 169, including fingerprints that match previously registered fingerprints, the devices are often organized (eg, as shown in Figure 20P). Display multiple, unorganized versions of previously organized notification 2046, including both completed and unorganized information. In this embodiment, the device continues to display the unorganized parts of notification 2046 while displaying the unorganized parts of multiple notifications that previously contained the organized parts (eg, notifications 2046-3, 2046-). 4, 2046-5, 2046-6, 2046-7, and 2046-8 include pre-knitted parts in Figure 20P previously and do not include pre-knitted parts in Figure 20Q after finger contact 2052 was detected). .. In some embodiments, the organized version of the notification is redisplayed in response to detecting a lift-off of finger contact 2052 (eg, returning to the user interface shown in Figure 20P). In some embodiments, the device is unlocked (eg, as shown in FIG. 20I) in response to detecting a lift-off of finger contact 2052. In some embodiments, after detecting a lift-off of finger contact 2030, the unorganized version of the notification is for a predetermined time period (eg, 5, 10, 15, 30, 60 seconds, or some other equivalent time). (Period) or until certain criteria are met (eg, the device's display disappears due to a screen dimming timer or a screen dimming input from the user by activating the device's sleep / power button). , Continues to be displayed. Figure 20Q detects a contact 2054 near the bottom edge of the touchscreen 112 and an upward movement 2056 on the touchscreen 112, as shown in Figure 20Q, while the organized version notification is displayed. In response to detecting an upward swipe gesture, the device has an unlocked device user interface (eg, an application launch user interface such as the application launch user interface shown in Figure 20I).
Figures 20R-20T show alternative ways to organize notifications. In FIG. 20R, the content fragment is replaced with the organized text string 2058 (eg <message content>) indicating that the email content fragment is organized. In Figure 20S, the email content fragment is obscured by placing a black box 2060 above each word to show that the email content fragment is organized. In Figure 20T, the default organization object 2062 is placed on top of the content fragment to show that the email content fragment is organized. Any suitable method of making organized content unreadable, including those shown in FIGS. 20R-20T, where the organization shown in FIGS. 20A-20Q contains blurred organization text, is shown in FIGS. 20A-20Q. It can be used in place of or in addition to the blur shown.
21A-21C are flow diagrams illustrating a method 2100 for revealing organized information for some embodiments. Method 2100 is performed on an electronic device having a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some actions of Method 2100 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 2100 provides an intuitive way to reveal organized information. This method reduces the user's cognitive burden in revealing organized information, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, enabling users to reveal pre-organized information faster and more efficiently saves power and increases battery charging intervals.
In some embodiments, the device displays a locked device user interface (2102). In some embodiments, the device receives a request to display information (2104) (eg, detects activation of a button corresponding to a request to power on the display of the device, or is shown in FIGS. 20M-20P. Detect requests to display the notification user interface so that). In some embodiments, the device detects the occurrence of a default event (2106) (eg, the device receives a new communication and generates a notification of the new communication as described above with reference to FIGS. 20A-20B. do).
The device has an organized version of the first information on the display (eg, Notification 2002 in Figure 20B, Notification 2012-2, 2012-3, 2012-4 in Figure 20D, or Notification 2046-3, 2046- in Figure 20P. 4, 2046-5, 2046-6, 2046-7, 2046-8) is displayed (2108). In some embodiments, the organized version of the first information is displayed in response to receiving a request to display the information and / or in detecting the occurrence of a default event.
In some embodiments, the first organized information is a plurality of individual information items (eg, Notification 2012-2, 2012-3, 2012-4 in FIG. 20D, or Notification 2046-3 in Figure 20P, Includes 2046-4, 2046-5, 2046-6, 2046-7, 2046-8) (2110), and each information item in multiple information items contains organized and unorganized parts (eg, Figure 20D). Although the time and description of the telephone notification 2012-2 are not organized, the name of the caller is organized, and the subject, sender, and time of the email notifications 2012-3 and 2012-4 are not organized. The content of the mail is organized). In some embodiments, the information item is a set of relevant information (eg, related to a single event or communication). For example, an information item for an electronic message includes two or more of the sender's name, subject, time when the message was received, and the content of the message. As another embodiment, information items about a calendar event include two or more of the event name, participant list, location, event time, and event description. As another embodiment, information items about a telephone include two or more of the caller, the calling telephone number, and the time of the telephone.
In some embodiments, the first information includes a notice containing identification information (eg, the sender and time of the message) and content (subject and / or fragment or portion of the message body) (2112), identifying. The information is not organized and the content is organized (eg, as shown in Notices 2002 in Figure 20B and Notices 2012-3 and 2014 in Figure 20D). In some embodiments, the first information includes one or more notifications of communications received by the device (eg, notifications of out-of-office messages, emails, telephones, etc.) (2114). For example, in Figure 20D, the first information includes telephone notifications 2012-2 and email notifications 2012-3 and 2012-4. In some embodiments, the first piece of information includes one or more notifications of updates on social networks (2116). (For example, messages and notifications of events generated by users being followed by friends or users of the device).
In some embodiments, the organized version of the first information is unreadable (eg, blurs the word as shown in FIGS. 20B, 20D and 20P, fills the word as shown in FIG. 20S, or Includes a copy of the first information (by obscuring the text in another way) (2118). In some embodiments, the organized version of the first information is the default organization object that is displayed instead of the text in the first information (eg, <message content> shown in FIG. 20R or as shown in FIG. 20T. Includes a string or default form that is described as <organized content> (2120).
In some embodiments, the organized version of the first information is displayed (eg, as shown in FIGS. 20B and 20D) on the locked device user interface of the device (eg, the lock screen) (eg, as shown in FIGS. 20B and 20D). 2122). In some embodiments, the first information includes a plurality of organized individual information items (eg, multiple notifications about different messages or events occurring on the device) (2124). In some embodiments, the information items of the plurality of information items in the first information include organized parts (eg, content) and unorganized parts (eg, identification information), respectively. For example, in Figure 20D, notices 2012-2, 2012-3, and 2012-4 include organized and unorganized parts, respectively, and in Figure 20P, notices 2046-3, 2046-4, 2046-5, 2046. -6, 2046-7, 2046-8 include the organized part and the unorganized part, respectively. In some embodiments, the device displays an unorganized version of the second information while displaying the organized version of the first information (2128) (eg, in Figure 20D, notification 2012-1). Not organized, and in Figure 20P, notices 2046-1 and 2046-2 are unorganized). In some embodiments, the device displays multiple notifications, including one or more organized notifications and one or more unorganized notifications (eg, email message notifications are organized, but Notifications from the game are not organized). Providing multiple notifications, each containing a pre-organized part and an unorganized part, allows the user to quickly browse at least some information about multiple different events or communications and to get an unorganized version of the notification. Gives the ability to browse and / or unlock the device to determine if additional information corresponding to the notification needs to be displayed. Thus, by providing multiple notifications with both organized and unorganized content, personal information (eg, email messages, te) can be maintained while maintaining the ease of use of the device for the user.
While displaying the organized version of the first information on the display, the device is fingered on a fingerprint sensor (eg, fingerprint sensor 169 in FIGS. 20A-20T) (eg, finger touch 2008 in FIG. 20C, FIG. Detects finger touch 2030 at 20H or finger touch 2052) in Figure 20Q (2130).
In response to the detection of the finger print on the fingerprint sensor (2132), according to the determination that the finger print contains a fingerprint that matches the previously registered fingerprint allowed to reveal the first piece of information. , The device replaces the organized version of the display of the first information with the unorganized version of the first information (2134) (eg, FIGS. 20B-20C, 20D-20H, and 20P-20P). As shown in 20Q, the device removes the organization from one or more notifications in response to detecting a registered fingerprint on the fingerprint sensor 169).
In some embodiments, the first is when the first organized information contains a plurality of individual information items, and when each information item in the plurality of information items contains a organized part and a viewing part. Replacing the display of the organized version of information with that of the unorganized version of the first information displays the organized part of multiple information items while maintaining the display of the unorganized part of multiple information items. Includes replacement with the corresponding unorganized content (2136). For example, in FIG. 20D, notifications 2012-2, 2012-3, and 2012-4 include pre-organized and un-organized parts, respectively, and in FIG. 20H, after detecting finger contact 2030 on the fingerprint sensor 169, The organized parts of these notifications are replaced with the unorganized parts, while the previously unorganized parts are still displayed. Similarly, in Figure 20P, notifications 2046-3, 2046-4, 2046-5, 2046-6, 2046-7, 2046-8 each contain pre-organized parts, and in Figure 20Q, finger contact on the fingerprint sensor 169. After detecting 2052, the organized parts of these notifications are replaced with the unorganized parts, while the previously unorganized parts are still displayed.
In response to detecting a finger input on the fingerprint sensor, the device will display on the display according to the determination that the finger input does not contain a fingerprint that matches the registered fingerprint that is allowed to reveal the first information. Maintains the display of the organized version of the first information in (2138). For example, if Fingerprint 2008 (Figure 20C) does not contain a fingerprint that matches a previously registered fingerprint, the device will continue to display the user interface shown in Figure 20B (rather than the user interface shown in Figure 20C), or Displays a fingerprint match error user interface indicating that a mismatched fingerprint has been detected. As another embodiment, if finger touch 2030 (FIG. 20H) does not contain a fingerprint that matches a previously registered fingerprint, the device displays the user interface shown in Figure 20D (rather than the user interface shown in Figure 20H). Continue to or display a fingerprint match error user interface indicating that a non-matching fingerprint has been detected. As another embodiment, if the finger touch 2052 (FIG. 20Q) does not contain a fingerprint that matches the previously registered fingerprint, the device will use the user interface shown in Figure 20P (rather than the user interface shown in Figure 20Q). Continue to display or display a fingerprint match error user interface indicating that a non-matching fingerprint has been detected. The display of the organized version of the information is maintained when an unregistered fingerprint is detected on the fingerprint sensor, preventing unauthorized users from viewing the organized personal information.
In some embodiments, after displaying an unorganized version of the first piece of information, the device continues to detect fingerprints on the fingerprint sensor (2140). In some embodiments, the device maintains an unorganized version of the first piece of information displayed on the display while continuing to detect the fingerprint on the fingerprint sensor (2142). In some embodiments, the device detects the fingerprint on the fingerprint sensor (eg, detects the lift-off of the fingerprint from the fingerprint sensor) while maintaining the display of the unorganized version of the first information. (2144). In some embodiments, the device redisplays the organized version of the first piece of information in response to stopping to detect the fingerprint on the fingerprint sensor (2146). For example, in FIG. 20C, if the device detects a contact 2008 lift-off, the device redisplays the user interface shown in FIG. 20B. As another embodiment, in FIG. 20H, if the device detects a lift-off of contact 2030, the device redisplays the user interface shown in FIG. 20D. As another example, in Figure 20Q, if the device detects a lift-off of contact 2052, the device will redisplay the user interface shown in Figure 20P.
In some embodiments, the device displays a locked device user interface (eg, a user interface corresponding to the locked operating mode of the device shown in FIG. 20D) on the display prior to detecting the first input (eg, the user interface corresponding to the locked operating mode of the device shown in FIG. 20D). 2102). In some embodiments, after displaying an unorganized version of the first piece of information, the device continues to detect the fingerprint on the fingerprint sensor (2140) (eg, as shown in Figure 20H). In some embodiments, the device maintains an unorganized version of the first information on the display while continuing to detect the fingerprint on the fingerprint sensor (2142) (eg, as shown in Figure 20H). In some embodiments, the device detects the fingerprint on the fingerprint sensor (eg, lifts off the fingerprint from the fingerprint sensor, as shown in Figure 20I) while maintaining the display of the unorganized version of the first information. (Detect) is stopped (2144). In some embodiments, in response to stopping detecting fingerprints on the fingerprint sensor, the device stops displaying the first information (2148) and displays the unlocked device user interface on the display. (Display the user interface corresponding to the unlocked operating mode of the device, for example, the application launch user interface shown in Figure 20I, or the user interface for the end-user application such as the mail application user interface shown in Figure 20L). Thus, in some embodiments, the device detects an unorganized version of the content (eg, by replacing the organized version of the content with an unorganized version of the content) in response to detecting the fingering down portion of the first input. The device displays the unlocked device user interface in response to detecting the finger-up portion of the first input. Reveal organized information according to the finger input finger down part detected, and unlocked device user interface according to the finger input finger up part.
In some embodiments, the unlocked device user interface has a finger input finger-down portion (eg, the time when the finger was detected on the fingerprint sensor) and finger input in response to detecting a finger touch lift-off. The time between the finger-up portion of the finger (eg, the time when the finger has finished being detected on the fingerprint sensor) is the first time threshold (eg, 0.05, 0.1, 0.2, 0.5, 1 second, or some). Displayed when it is greater than the other corresponding time thresholds), the locked device user interface has the finger input fins down and the finger input finger up in response to detecting a finger touch lift-off. If the time between is less than the first time threshold, it will continue to be displayed (for example, the user unlocks the device by releasing the finger touch on the fingerprint sensor before the first time threshold time elapses. The operation can be canceled).
In some embodiments, the unlocked device user interface has a finger input fluffing down portion (when the finger is detected on the fingerprint sensor) and finger input in response to detecting a lift-off of the finger touch. The time between the finger-up portion of the finger (the time when the finger is no longer detected on the fingerprint sensor) is less than the second time threshold (eg 0.05, 0.1, 0.2, 0.5, 1 second, or some other). Displayed in the case of (corresponding time threshold), the locked device user interface detects a lift-off of finger touch, and the time between the finger-input finger-down portion and the finger-input finger-up portion is the second. If it is greater than the time threshold of, it continues to be displayed (eg, the user can cancel the device unlock operation by keeping the finger touch on the fingerprint sensor longer than the second time threshold time).
In some embodiments, the device receives a request to display the first information before displaying the organized version of the first information (2104). For example, the device detects a swipe gesture in a first direction (eg, downwards) starting at or near the first (eg, top) edge of the display (eg, as shown in FIGS. 20M-20O). Contact 2040 is detected near the top edge of the touch screen 112 and moves downward 2042), or the default input (eg, device button activation, in response to a request to wake the device from low power mode). Detects a request to turn on the device's display and / or a request to display a locked device user interface). In some embodiments, upon receiving a request to display the first information, the device displays an organized version of the first information on the display (2108). For example, in FIG. 20P, the device comprises a notification user interface 2044 with multiple notifications 2046-3, 2046-4, 2046-5, 2046-6, 2046-7, 2046-8, each containing a pre-organized portion. Display according to the detection of a swipe gesture in the direction of 1. In some embodiments, after displaying the first information, the device makes a swipe gesture (eg, movement 2050 of contact 2048 in FIG. 20P, or movement 2056 of contact 2054 in FIG. 20Q) with respect to the first direction. Detect in a second direction starting from different, different (eg, bottom) edges of the display, or near it. In response to detecting a swipe gesture in the second direction, the device stops displaying the organized version of the first information on the display. In some embodiments, whether or not the first information (eg, notifications in the notification user interface 2044) is organized depends on whether the device is in locked or unlocked operating mode (eg, device). Detects a request to display the first information while in locked operating mode
In some embodiments, the device detects the occurrence of a default event (2106) before displaying the organized version of the first information, and the device detects the occurrence of a default event. Show organized version of the first information on the display (2108) (received communication such as email or phone, detected that the reminder time for the calendar appointment has been reached, or from a third party application In response to receiving the notification, the device will display a pop-up notification corresponding to that event). For example, in Figure 20B, the device is Johnny. Receives emails from Appleseed, generates notifications containing information from the emails, and displays the organized version of Notification 2002 on the touch screen 112. In some embodiments, whether or not the first piece of information is organized depends on whether the device is in locked or unlocked operating mode (eg, while the device is in locked operating mode). In response to detecting the occurrence of a default event, the device displays the organized version of the first information as shown in Figure 20B, and the device displays the occurrence of the default event while in the unlocked operating mode. Depending on what it detects, the device will display an unorganized version of the first information). In some embodiments, the organized version of the first information is displayed in a default position on the display (eg, in the center of the display) when first received, and one or more other notifications later (eg, in the center of the display). For example, it appears in the notification list along with one or more unorganized notifications and / or one or more organized notifications). For example, in Figure 20B, Johnny Notifications about emails from Appleseed 2002 are first displayed in the center of the touchscreen 112 in Figure 20B after being received, and notifications about the same emails from Johnny Appleseed 2012-4 are on the touchscreen 112. Figure 20D shows a list of other notifications generated by the device (eg, notifications corresponding to communications or events that have occurred since the last time the device was unlocked).
It should be noted that the particular order described for the actions in FIGS. 21A-21C is merely exemplary and is not intended to indicate that the order in which the actions can be performed is the only order in which the actions can be performed. I want you to understand. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, details of other processes described herein with respect to the methods described herein (eg, those listed in paragraph [0080]) are similar to Method 2100 described above in connection with FIGS. 21A-21C. Please note that it is applicable in mode. For example, fingerprints, contacts, knitting, and animations described with reference to Method 2100 may optionally refer to other methods described herein (eg, those listed in paragraph [0080]). And have one or more of the fingerprint, contact, knitting, and animation characteristics described herein. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 22 shows a functional block diagram of the electronic device 2200 configured according to the ideas of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 22 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 22, the electronic device 2200 includes a display unit 2202 configured to display an organized version of the first information, optionally a touch sensing surface unit 2204, a fingerprint sensor unit 2206, and a display. It includes a unit 2202, an optional touch sensing surface unit 2204, and a processing unit 2208 coupled to the fingerprint sensor unit 2206. In some embodiments, the processing unit 2208 includes a display enablement unit 2210, a detection unit 2212, a replaying unit 2214, a maintenance unit 2216, a stop unit 2218, and a receive unit 2220.
Processing unit 2208 enables finger input on the fingerprint sensor (eg, detection unit) while enabling display of the organized version of the first information on display unit 2202 (eg, on display enablement unit 2210). Configured to detect (in 2212). The processing unit 2208 further determines that the fingerprint sensor contains a fingerprint that matches a previously registered fingerprint in response to the finger print being detected on the fingerprint sensor. Therefore, the display of the organized version of the first information is replaced with the unorganized version of the first information (eg, using the replaging unit 2214) so that the fingerprint reveals the first information. Maintains the display of the organized version of the first information on the display unit 2202 (eg, using maintenance unit 2216) according to the determination that it does not contain fingerprints that match the permitted previously registered fingerprints. As such.
In some embodiments, the first organized information includes a plurality of individual information items, and each information item in the plurality of information items includes a organized part and an unorganized part.
In some embodiments, replacing the display of the organized version of the first information with the unorganized version of the first information is plural while maintaining the display of the unorganized portion of the plurality of information items. Includes replacing the display of the organized part of the information item in with the corresponding unorganized content.
In some embodiments, the first information includes identification information and a notification containing the content, the identification information is not organized, and the content is organized.
In some embodiments, the first information comprises one or more notifications of communication received by the device.
In some embodiments, the first information includes one or more notifications of updates on social networks.
In some embodiments, the organized version of the first piece of information comprises a copy of the first piece of information that has been made unreadable.
In some embodiments, the organized version of the first information includes a default organization object that is displayed instead of the text in the first information.
In some embodiments, the organized version of the first information is displayed on the locked device user interface of the device.
In some embodiments, the first information comprises a plurality of individual information items to be organized.
In some embodiments, the processing unit 2208 displays the unorganized version of the second information (eg, the display enablement unit 2210) while enabling the display of the organized version of the first information. Configured to enable (using).
In some embodiments, the processing unit 2208 continues to detect the fingerprint (eg, using the detection unit 2212) on the fingerprint sensor after enabling the display of an unorganized version of the first information. While continuing to detect fingerprints on the fingerprint sensor, it maintains an unorganized version of the first information on the display unit 2202 (eg, using maintenance unit 2216), and the unorganized information of the first information. In response to stopping the detection of fingerprints on the fingerprint sensor (eg, using the detection unit 2212) and stopping the detection of fingerprints on the fingerprint sensor, while maintaining the display of Enable redisplay of the organized version (eg, using the display enablement unit 2210).
In some embodiments, the processing unit 2208 enables display of the locked device user interface on the display unit 2202 (eg, using the display enablement unit 2210) before detecting the first input. After displaying the unorganized version of the first information, the display unit 2202 continues to detect fingerprints on the fingerprint sensor (eg, using the detection unit 2212) and continues to detect fingerprints on the fingerprint sensor. Maintaining the display of the unorganized version of the first information above (eg, using maintenance unit 2216) and maintaining the display of the unorganized information of the first information on the fingerprint sensor (eg, using the maintenance unit 2216). In response to stopping the detection of fingerprints (using the detection unit 2212) and stopping detecting the fingerprints on the fingerprint sensor, the display of the first information (eg, using the stop unit 2218) It is configured to abort and enable the display of the unlocked device user interface on the display unit 2202 (eg, using the display enablement unit 2210).
In some embodiments, the processing unit 2208 receives a request (eg, using the receiving unit 2220) to display the first information before displaying the organized version of the first information, and the first. Is configured to enable the display of an organized version of the first information on the display unit 2202 (eg, using the display enablement unit 2210) in response to a request to display the information in. ..
In some embodiments, the processing unit 2208 detects the occurrence of a default event (eg, using the detection unit 2212) and prints the first fingerprint before displaying the organized version of the first information. Depending on the detection, it is configured to enable the display of the organized version of the first information on the display unit 2202 (eg, using the display enablement unit 2210).
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. Is executed arbitrarily by running.
The operations described above with reference to FIGS. 21A-21C are optionally performed by the components shown in FIGS. 1A, 1B, or 22. For example, display operations 2102 and 2108, receive operations 2104, detection operations 2106 and 2130, replacement operations 2134, and maintenance operations 2138 are optionally executed by the event sorter 170, event recognizer 180, and event handler 190. To. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those of skill in the art how other processes will be carried out based on the components shown in FIGS. 1A-1B.
Offers various unlocked modes
Many electronic devices have a locked mode, which has a different set of enabled features than the unlocked mode on the corresponding device. Locked mode provides a certain level of security against unauthorized access to electronic devices, as many users want to keep the content of their electronic devices private. The user may wish to have one or more ways to unlock while the electronic device is in locked mode. The devices described below are existing by providing various unlock modes that unlock while the device is in the locked operating mode, including one or more unlock modes associated with the fingerprint sensor. Improve the method.
While the device's mode of operation is in the locked mode, where access to the corresponding feature set of the electronic device is locked, the device receives a first input on the fingerprint sensor that corresponds to the request to initiate unlocking of the device. To detect. In response to the fingerprint sensor detecting the first input, the device determines that the first input has one of an unlock criteria, a first unlock failure criterion, or a second unlock failure criterion. Determine if it meets. Upon determining that the first input meets the unlock criteria, the device transitions the device from locked mode to unlocked mode in which the corresponding feature set of the electronic device is unlocked. According to the determination that the first input meets the first unlock failure criterion, the device keeps the device in locked mode and the device performs the unlock action in the first one or more unlock action sets. Adjust the unlock settings to enable unlocking through. Finally, according to the determination that the first input meets the second unlock failure criterion, the device keeps the device in locked mode and the device is different from the first unlock action set. Adjust the unlock settings to enable unlocking through unlocking actions in one or more unlocking action sets of 2.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 23A to 23FF and 24A to 24D include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 23A-23FF and 24A-24D are discussed with reference to a device having a touch screen 112 and a separate touch sensing surface 359-2, but with similar behavior. However, while the user interface shown in FIGS. 23A to 23FF is displayed on the display 450, the integrated fingerprint is detected in response to the input described in FIGS. 23A to 23FF being detected on the integrated fingerprint sensor 359-1. It is optionally executed on the device by the sensor 359-1. Further, a similar operation is optionally a device having a display 450 and a separate touch sensing surface 451 instead of the touch screen 112, with a fingerprint sensor 169 (eg, integrated fingerprint sensor 359-1 or separate fingerprint sensor 359). -2) Above And / or performed while displaying the user interface shown in FIGS. 23A to 23FF on the display 450 in response to detecting the contact shown in FIGS. 23A to 23FF on the separate touch sensing surface 451. The interface. In such an embodiment, the contacts shown in FIGS. 23A to 23FF are optionally performed on a focus selector corresponding to the position of the display 450 and a separate touch sensing surface (eg, touch sensing surface 451). Representing both the contact being made or the contact corresponding to the position of the gesture, the focus selector is optionally associated with the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or the corresponding contact). Point), or the center of gravity of two or more contacts detected on the touch screen 112, optionally replaced with the displayed cursor.
FIGS. 23A to 23FF show a portable multifunction device 100 that provides various unlock modes and responds to the success and failure of various unlock operations. While in the locked mode, the portable multifunction device 100 provides various operations associated with the unlock .
FIGS. 23A to 23C show the portable multifunction device 100 that has been successfully unlocked. FIG. 23A shows an exemplary unlock initiation user interface 2302 displayed on the touch screen 112 of a device (eg, device 100). In some embodiments, the unlock initiation user interface 2302 is the user interface of the operating system running on device 100. In some embodiments, the unlock initiation user interface 2302 is displayed by device 100 in response to device 100 detecting user input, such as a click on the menu button 204. This exemplary unlock initiation user interface 2302 displays a first visual signal 2304 for one unlock mode. In some embodiments, the unlock initiation user interface 2302 displays two or more visual cues, each of which corresponds to a different unlock mode. In some embodiments, the device 100 has two or more unlock modes, even when only one visual signal is displayed for one unlock mode, as in the unlock start user interface 2302. It is possible to provide. In some embodiments, the first visual signal 2304 is textual, graphical, or any combination thereof. In Figure 23A, the first visual signal 2304 appears to instruct the user to perform a left-to-right slide gesture on the touch screen 112 to unlock the device 100. Ru.
FIG. 23B shows that input 2306-1 is detected by the fingerprint sensor 169. In this embodiment, the detected fingerprint 2306-1 matches the registered fingerprint of device 100. In embodiments where the device 100 has more than one fingerprint sensor 169, the fingerprint 2306-1 is detected by any one of the device's fingerprint sensors.
Figure 23C shows the unlocked user interface 2308. In some embodiments, the locked mode user interface 2308 is displayed by the device 100 in response to detecting user input that meets one or more unlocking criteria while the device 100 is in the locked mode. .. In some embodiments, the locked mode user interface 2308 is displayed in response to device 100 detecting fingerprint 2306-1 that matches the registered fingerprint of device 100, as shown in Figure 23B. .. In some embodiments, device 100 has no security measures to enable locking the phone, or locks the phone for a given amount of time after a successful attempt to unlock the phone1 Disable one or more security measures. In such an embodiment, the unlocked user interface 2308 is displayed by the device 100 without the user input satisfying one or more unlock criteria.
FIGS. 23D to 23K show the device 100 that fails to unlock due to repeated attempts. FIG. 23D shows the same unlocking initiation user interface 2302 and the first visual signal 2304 as shown in FIG. 23B. However, in the exemplary FIG. 23D, the 2310-1 detected by the fingerprint sensor 169 does not match any of the registered fingerprints of the device 100.
Throughout this specification, the term "any of the registered fingerprints of the device 100" means any registered fingerprint of the device 100 that can be used to unlock the device 100. In some implementations, all registered fingerprints on device 100 can be used to unlock device 100. However, in some other implementations, or in some cases, one or more of the registered fingerprints of the device 100 are configured so that they cannot be used to unlock the device 100. For ease of discussion, such registered fingerprints are referred to as "fingerprints that are not allowed to unlock device 100", and registered fingerprints that can be used to unlock the device are referred to as "device 100". Fingerprints allowed to unlock ".
FIG. 23E shows an exemplary response by device 100 to the detection of fingerprint 2310-1, which does not match any of the registered fingerprints of device 100. In FIG. 23E, the first visual signal 2304 is displayed to vibrate laterally for a given time, a given number of times, and / or a given speed. In some embodiments, the device 100 plays a voice message, displays a different visual signal, or warns the user that the detected fingerprint is not recognized as a registered fingerprint. Use another method, such as any combination of audio and visual feedback.
FIG. 23F shows an exemplary response to device 100's detection of one or more fingerprints 2310-1 that do not match any of the device 100's registered fingerprints. FIG. 23F shows a second visual signal 2312 in which the device instructs the user to try unlocking the device again by fingerprint detection in this embodiment, and the user unlocks the device 100. A right-pointing arrow indicating that a slide gesture can be performed on the touch screen 112 as an alternative is displayed on the unlock start user interface 2302. In some embodiments, the second visual signal 2312 is identical to the first visual signal 2304. In some embodiments, the device 100 maintains a counter for attempts that fail to unlock the device due to a particular type of unlocking operation or any type of unlocking operation. In some embodiments, the second visual signal 2312 is how many times the device 100 fails by entering a passcode, fails by a fingerprint sensor, or fails by any kind of unlocking operation. Is detected. In some embodiments, the second visual signal 2312 is how many times a particular means or arbitrary before the device makes no further attempts for an undefaulted or predetermined length of time. Indicates whether the means allow attempts to unlock the device. In some embodiments, the second visual signal 2312 provides information associated with the most recent failed attempt to unlock device 100, such as a time stamp.
Figures 23G to 23H show an exemplary response to device 100's detection of fingerprint 2310-2 that does not match any of the device 100's registered fingerprints after displaying the second visual signal 2312. show. In FIG. 23G, the second visual signal 2312 appears to vibrate laterally (or equally) at a given number of times and / or a given speed for a given time. Will be done. In some embodiments, the device 100 uses another method, such as playing a voice message, displaying different visual cues, or any combination of voice and visual feedback, to detect the fingerprint. Warns the user that is not recognized as a registered fingerprint. In some embodiments, the device 100 unlocks the device 100 by fingerprint detection with another visual signal separate from the first visual signal 2304 and the second visual signal 2312. Display according to the detection of two or more failed attempts. In some embodiments, after displaying the second visual signal 2312 as a vibration, the device has an unlocked start user interface 2302 with a stationary second visual signal 2312, as shown in FIG. 23H. Is displayed.
FIG. 23I shows a third attempt to unlock device 100 when fingerprint 2310-3 is detected by the device in a series of unlocking attempts shown in FIGS. 23D to 23J. In this embodiment, fingerprint 2310-3 does not match any of the registered fingerprints of device 100.
FIGS. 23J to 23K show an exemplary response by the device 100 to the detection of the first specified number of failed attempts to unlock the device 100. In some embodiments, the first predetermined number of failed attempts (eg, three) simply corresponds to a failed attempt to unlock the device with an unrecognized fingerprint. For example, FIGS. 23J-23K show the response of Device 100 to the detection of a third attempt by Device 100 to unlock Device 100 with an unrecognized fingerprint 2312 as shown in FIG. 23I. FIG. 23J shows the transition display on the touch screen 112, where the device 100 switches from displaying the unlock start user interface 2302 to displaying the passcode input user interface 2314 shown in FIG. 23K. In some embodiments, the device 100 transitions from the unlock initiation user interface 2302 to the passcode input user interface 2314 through a lateral sliding motion, as shown in FIGS. 23J and 23K. In some embodiments, the overlay icon 2315 and the second visual signal 2312 or the first visual signal 2304 are performed while the device 100 transitions from the unlock start user interface 2302 to the passcode input user interface 2314. Other user interface objects that were displayed on the unlock start user interface 2302, such as, also gradually deviate from the display on the touch screen 112. Figure 23K shows an exemplary passcode input user interface 2314 that the device 100 migrates in response to detecting the first default number of failed attempts to unlock the device 100. In some embodiments, the passcode input user interface 2314 comprises a third visual signal 2316 and a progress indicator 2318. In FIG. 23K, the exemplary third visual cues 2316 contains the same text as the second visual cues 2312, but in some embodiments. , The third visual cues 2316 contains text separate from the text in any of the other visual cues. In some embodiments, the third visual signal 2316 is textual, graphical, or any combination thereof.
FIGS. 23L-23P show that device 100 has detected the first default number of failed unlock attempts for the device (eg, by repeatedly detecting fingerprints that do not match any of the registered fingerprints on device 100). Later, an exemplary response of the device 100 to the user input of the correct sequence of numbers (eg, passcode) to unlock the device is shown. In FIG. 23L, device 100 detects finger input 2320-1 on the touch screen 112, which corresponds to the input of the keypad number "1" displayed on the passcode input user interface 2314. The progress indicator 2318 changes to indicate that the first shape of the set of geometric shapes (eg, circles) changes from "blank" to "fill". In Figure 23L, the progress indicator 2318 has four circles, indicating that one or more passcodes for unlocking the device consist of four digits. In some embodiments, the progress indicator 2318 has more than four geometries to accommodate more than four digits of valid passcode for unlocking device 100, or of device 100. Has less than 4 geometries to accommodate less than 4 valid passcodes for unlocking. In Figure 23M, device 100 detects another finger input 2320-2, and the progress indicator 2318 is updated accordingly to indicate that two finger inputs have been detected. In Figure 23N, device 100 detects another finger input 2320-3, and the progress indicator 2318 is updated accordingly to indicate that three finger inputs have been detected. In Figure 23O, device 100 detects another finger input 2320-4, and the progress indicator 2318 is updated accordingly to indicate that four finger inputs have been detected. FIG. 23P shows the unlock mode user interface 2308, which is displayed in response to the detection that a valid passcode has been input to the device 100 in FIGS. 23L to 23O.
Figure 23Q shows that device 100 repeatedly detects the first default number of failed device unlock attempts (eg, fingerprints that do not match any of the registered fingerprints that are allowed to unlock the device). ) Shows an exemplary response of the device 100 to user input of an incorrect sequence of digits (eg, an incorrect passcode) to unlock the device after detection. FIG. 23Q is displayed after FIGS. 23L to 23O, for example, if the passcode entered in FIGS. 23L to 23O is determined to be invalid for unlocking the device 100. In FIG. 23Q, the progress indicator 2318 is displayed to vibrate laterally at a predetermined time, a predetermined number of times, and / or a predetermined speed. In some embodiments, the device 100 plays a voice message to warn the user that the passcode entered is not recognized as an authorized passcode to unlock the device 100, with different vision. Display specific cues, or use alternative methods such as any combination of audio and visual feedback. In some embodiments, the device 100 displays a third visual signal, 2316, to vibrate laterally at a predetermined time, a predetermined number of times, and / or a predetermined speed. In FIG. 23Q, the geometry of the progress indicator 2318 changes from the filled state shown in FIG. 23O to the unfilled state.
23R to 23T show a further exemplary failed attempt to unlock the device 100 by fingerprint detection in the series of unlocking attempts shown in FIGS. 23D to 23J. In Figure 23R, the detected fingerprint 2310-4 does not match any of the registered fingerprints on device 100. In FIG. 23S, the progress indicator 2318 is displayed to vibrate laterally at a predetermined time, a predetermined number of times, and / or a predetermined speed. In some embodiments, the device 100 plays a voice message to warn the user that the detected fingerprint is not recognized as a registered fingerprint authorized to unlock the device 100, differently. Display a visual signal, or use another method, such as any combination of audio and visual feedback. In some embodiments, the progress indicator 2318 remains stationary and displays a third visual signal 2316 differently to any of the registered fingerprints that are allowed to unlock the device 100. Indicates detection of non-matching fingerprints. For example, the third visual signal 2316 is displayed to vibrate laterally for a given time, a given number of times, and / or a given speed. FIG. 23T shows an exemplary fourth visual signal 2322 displayed on passcode input interface 2314 in response to a failed attempt to unlock device 100 detected at a second default threshold. In some embodiments, a fourth visual signal 2322 is displayed to indicate that device 100 has disabled the ability to unlock the device through fingerprint detection. In some embodiments, failed attempts at the second default threshold for unlocking correspond only to fingerprint detection attempts.
FIG. 23U shows an exemplary unlock initiation user interface 2302. In some embodiments, the unlock start user interface 2302 has a menu button while the device's display is in low power mode (eg, the display is off and / or the display's backlight is off). Displayed in response to detecting a default user action such as pressing 204. In some embodiments, the unlock initiation user interface 2302 is also defaulted by device 100 while the device is in locked mode and an idle state is detected (eg, there is no user input for a given time). Is displayed after the time has passed.
Figure 23V shows an exemplary response of device 100 to the detection of fingerprint 2310-5 detected while displaying the unlock initiation user interface 2302 (Figure 23U), where fingerprint 2310-5 unlocks device 100. It does not match any of the registered fingerprints of the device 100 allowed for. In this embodiment, the device 100 is previously registered with the device 100 authorized to unlock the device 100 before detecting the fingerprint 2310-5 on the unlock start user interface 2302, as shown in FIG. 23U. Detected at least one fingerprint 2310 that did not match any of the fingerprints in. FIG. 23V shows an exemplary response of device 100 to the detection of fingerprint 2310-5 (which does not match any of the registered fingerprints of device 100 authorized to unlock device 100) in FIG. 23U. In Figure 23V, device 100 displays the passcode input user interface 2314 with a fifth visual signal 2324 to warn the user that the detected fingerprint cannot be recognized. In some embodiments, the fifth visual signal 2324 warns the user of at least one previous unsuccessful attempt to unlock device 100 with fingerprint detection, and in some embodiments the fifth. The visual signal 2324 consists of information about one or more previous failed attempts to unlock device 100.
23W and 23X show that the device 100 transitions from the unlock initiation user interface 2302 to the passcode input user interface 2314 in response to detecting the device unlock finger gesture 2326 on the touch screen 112. In this embodiment, the device unlock finger gesture 2326 is a lateral movement from left to right on the unlock initiation user interface 2302, eg, from position 2326-1 to position 2326-2. In some embodiments, the orientation of the device unlock finger gesture 2326 is from right to left. The exemplary finger gesture 2326 corresponds to the instruction displayed by the first visual signal 2304. FIG. 23X shows the transition to the passcode input user interface 2314 shown in FIG. 23Y.
FIG. 23Y shows an exemplary passcode input user interface 2314 displayed by device 100 in response to detecting device unlock finger gesture 2326 in FIG. 23W. FIG. 23W shows a sixth visual signal 2328 (eg, Enter passcode) and a progress indicator 2318. In some embodiments, the sixth visual signal 2328 indicates to the user that the device can be unlocked by entering a passcode. In some implementations, the sixth visual cues 2328 show additional ways to unlock the device, such as fingerprint detection, another method, or a combination of methods. In FIG. 23Y, fingerprint 2306-2 is detected on the fingerprint sensor 169. In this embodiment, fingerprint 2306-2 matches a registered fingerprint that is allowed to unlock device 100.
FIGS. 23Z to 23DD show an exemplary response to the detection of fingerprint 2306-2 on the fingerprint sensor 169 by device 100 while displaying the passcode input user interface 2314. In FIGS. 23Z to 23CC, the progress indicator 2318 is progressively changed by filling the geometric shapes of the progress indicator 2318 one by one. In some embodiments, the progress indicator 2318 is progressive while device 100 determines whether the detected fingerprint 2306-2 matches a registered fingerprint that is allowed to unlock device 100. Will be changed to. In some embodiments, the progress is made after the fingerprint 2306-2 received while displaying the passcode input user interface 2314 is determined to match a registered fingerprint that is allowed to unlock device 100. Indicator 2318 is instantaneously modified so that all geometry is filled and displayed. FIG. 23DD determines that after the device 100 displays the user interface shown in FIGS. 23Y to 23CC, and that the device 100 matches the detected fingerprint with the registered fingerprint authorized to unlock the device 100. Shows the unlocked mode user interface 2308 that is displayed after you have done so.
23EE and 23FF show the exemplary response of the device 100 to the detection of fingerprint 2310-6 by the fingerprint sensor 169 while displaying the passcode input user interface 2314. For example, FIG. 23EE follows from FIGS. 23W to 23X after device 100 detects finger gesture 2326 on the touch screen 112. FIG. 23FF shows an exemplary response to Device 100's detection of fingerprint 2310-6 (shown in Figure 23EE) that does not match any of the registered fingerprints allowed to unlock Device 100. In Figure 23FF, a visual signal, such as a third visual signal 2316 (eg, "try again"), is displayed and the progress indicator 2318 is set for a given time, a given number of times, and / or a given. It is displayed to vibrate from side to side at the speed of.
24A-24D are flow diagrams illustrating method 2400 to provide various unlock modes according to some embodiments. Method 2400 is performed on an electronic device with a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some actions of Method 2400 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 2400 provides an intuitive way to provide various unlock modes. This method reduces the user's cognitive burden in providing various unlock modes, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, allowing the user to unlock the electronic device faster and more efficiently saves power and increases the interval between charging the battery.
While the device's operating mode is in the locked mode, where access to the corresponding feature set of the electronic device is locked, the device receives a first input, which corresponds to a request to initiate unlocking of the device, on the fingerprint sensor. Is used to detect (2406). In some embodiments, the device displays an unlock initiation user interface (eg, slide unlock user interface, as shown in FIG. 23U) that does not include a passcode input user interface before detecting the first input (eg, slide unlock user interface). 2402). While this unlock initiation user interface is displayed, the device is enabled to unlock with a fingerprint, but not with a passcode. For example, in the slide unlock user interface, the passcode input user interface is not displayed, so there is no choice but to enter the passcode to unlock the device. In some embodiments, the device is in low power mode (eg, the display is off and / or the display backlight is off) before the first input is detected. Enables the device to unlock the device using a fingerprint (2404) without enabling the device to unlock using a passcode. For example, if the display is off and the display backlight is off, the passcode entry user interface is not visible, so there is no choice but to enter the passcode to unlock the device.
The device performs several actions in response to the first input detected by the fingerprint sensor in Method 2400 (2408). In response to the fingerprint sensor detecting the first input (2408), the device determines that the first input is one of the unlock criteria, the first unlock failure criterion, or the second unlock failure criterion. Determine if one is met (2410). Upon determining that the first input meets the unlock criteria, the device transitions the device from locked mode to unlocked mode in which the corresponding feature set of the electronic device is unlocked (2412). In some embodiments, the unlock criterion comprises a criterion that the first input is met when the fingerprint detected using the fingerprint sensor contains a fingerprint that matches the fingerprint registered using the device. (2414). For example, if the first input corresponds to a registered fingerprint that is allowed to unlock the device, the device will transition from locked mode to unlocked mode, as seen in FIGS. 23B and 23C. do.
In some embodiments, the device displays a passcode input user interface according to the determination that the first input does not meet the unlock criteria (2416). For example, if the first input is fingerprint 2310-3 in Figure 23I, which determines that the device does not match any of the registered fingerprints allowed to unlock device 100, the device is exemplary in Figure 23K. Passcode input Displays the user interface 2314. In some embodiments, the device uses a first unlock interface, including a passcode input user interface, and the device uses a fingerprint, according to the determination that the first input meets the first unlock failure criteria. Show a visual suggestion that unlocking is enabled (2418).
In some embodiments, the device uses a second unlock interface, including a passcode input user interface, and the device uses a fingerprint, according to the determination that the first input meets the second unlock failure criteria. Display a visual suggestion that unlocking has been disabled (2420). For example, FIG. 23T shows an exemplary second unlock interface, including the passcode input user interface 2314, and a visual indication that the device has been disabled for fingerprint unlocking (eg, fourth). The visual signal 2322) and is shown.
In some cases, the device receives the passcode through the passcode input user interface while the device displays the passcode input user interface (2422). For example, FIGS. 23K to 23O show a device 100 that receives a passcode entered via the passcode entry user interface 2314. Upon receiving the passcode, and according to the determination that the passcode matches the device's current passcode, the device changes the device from locked operating mode to unlocked operating mode (eg, Figure 23P). Migrate. According to the determination that the passcode does not match the device's current passcode, the device keeps the device in locked mode (eg, Figure 23Q).
In some embodiments, depending on the receipt of the passcode, the device makes at least the first failed passcode unlock attempt (eg, 1 to 4 passcode unlock attempts). Determines if passcode timeout criteria, including criteria that are met when passed, are met (2424). Alternatively, the passcode timeout criteria include criteria that are met when at least the first failed passcode unlock attempt is made within a predetermined time period. According to the determination that the passcode timeout criteria have been met, the device disables unlocking the device using the passcode for the timeout period. For example, the device may stop displaying the passcode input user interface, stop accepting input for the passcode input user interface, and / or even if the current passcode is entered in the passcode input user interface. Enter passcode Disable unlocking through the user interface.
In some embodiments, depending on the receipt of the passcode, the device fails at least a second passcode unlock attempt (eg, 5-20 failed passcode unlock attempts). Determines if data exclusion criteria are met, including criteria that are met when the is done (2426). Alternatively, the data exclusion criteria include criteria that are met when at least a second failed passcode unlock attempt is made within a predetermined time period. According to the determination that the data exclusion criteria are met, the device shall not be able to use the private data stored on the device. For example, the device removes, encrypts, or otherwise removes the ability to access private data such as user communications, contact information, financial information, account information, and optionally other data on the device. In some embodiments, the device performs a device invalidation operation that disables the device when the data exclusion criteria are met.
In some embodiments, the passcode input user interface includes a progress indicator that provides a visual indication of progress towards the passcode input when characters are entered through the passcode input user interface. (2428). For example, a progress indicator is a set of progress indicators that correspond to each character in the passcode and are filled or highlighted as the character is entered in the passcode input user interface (eg, as in Figures 23K to 23O). A circle or other geometric shape.
In some embodiments, the device detects a fingerprint on the fingerprint sensor (2430) while the passcode input user interface is displayed on the display, and the device detects the fingerprint on the fingerprint sensor. Shows an animation in the progress indicator that shows the progress towards unlocking. For example, an animation that shows the progress towards unlocking a device (eg, as in Figures 23Y to 23CC) will show the individual characters in the passcode at the moment when the user detects a fingerprint. It is provided even if you do not type using the keyboard.
In some embodiments, the device receives an unlock request containing authentication information to unlock the device (2432). For example, the device receives a passcode entered through the passcode input user interface or a fingerprint detected on a fingerprint sensor. While receiving the authentication information, the device changes from the first state (eg, the progress indicator consists of a series of empty circles or other geometric shapes, as in Figure 23Y) to the second state (eg, for example). The progress indicator displays an animation of the progress indicator that changes into a series of filled circles or other geometric shapes, as shown in Figure 23CC. Upon receiving the unlock request, the device determines if the credentials are sufficient to unlock the device. The credentials are sufficient to unlock the device (for example, a passcode that matches a pre-established passcode, or a fingerprint that matches a previously registered fingerprint that was allowed to unlock the device). According to the determination, the device moves the device from the locked operating mode to the unlocked operating mode, and the credentials are not sufficient to unlock the device (eg, a passcode that does not match the pre-established passcode). , Or a fingerprint that does not match the previously registered fingerprint that was allowed to unlock the device), the device keeps the device in the locked operating mode and the progress indicator goes from the second state to the first. Display an authentication denial animation (for example, reverting or resetting) that changes to the state of (for example, vibrating the progress indicator sideways). In some embodiments, the same authentication denial animation is displayed regardless of whether the authentication information is a passcode or a fingerprint.
Method 2400 determines that the first input meets the first unlock failure criterion, the device keeps the device in lock mode (2434), and the device is the first one or more unlock actions. Further includes adjusting the unlock settings of the device to enable unlocking through the unlocking action in the set. For example, the device enables passcode entry by displaying a passcode interface in addition to allowing the use of the fingerprint sensor to unlock in the first unlock action set. In some embodiments, the first unlocking action set includes an unlocking action that unlocks the device using a fingerprint and another unlocking action that unlocks the device using a passcode. (2436). In some embodiments, the device switches from the locked operating mode to the unlocked operating mode with a fingerprint previously registered on the fingerprint sensor (eg, a registered fingerprint that is allowed to unlock the device). When configured to migrate in response to the detection of a fingerprint that matches the fingerprint, it is enabled to unlock using the fingerprint. In some embodiments, the device is configured to transition from a locked operating mode to an unlocked operating mode in response to detecting the entry of a passcode that matches a pre-established passcode. At that time, it is enabled to unlock using a passcode.
According to the determination that the first input meets the second unlock failure criterion, the device keeps the device in locked mode (2438) and the device is different from the first unlock action set. Adjust the unlock settings to enable unlocking through unlocking actions in one or more unlocking action sets of 2. For example, in the second unlocking action set, the device enables passcode entry but disables fingerprint authentication. In some embodiments, the second unlocking action set includes an unlocking action that unlocks the device using a passcode and excludes an unlocking action that unlocks the device using a fingerprint ( 2440). For example, FIG. 23T corresponds to a second unlocking action set that includes an unlocking action that unlocks the device using a passcode and excludes an unlocking action that unlocks the device using a fingerprint. Shows the user interface.
In some embodiments, the first input includes a fingerprint input on the fingerprint sensor, and the first unlock failure criterion is that the device has one or more unrecognized fingerprints (eg, any of the registered fingerprints). Includes criteria that are met when at least the first threshold number of failed attempts is detected (2442), which attempts to unlock the device with a detected fingerprint that also turns out to be inconsistent (2442), and a second unlock failure. Criteria include criteria that are met when the device detects at least a failed attempt with a second threshold greater than the first threshold that attempts to unlock the device with one or more unrecognized fingerprints. .. For example, the second unlock failure criterion is met when the device detects five fingerprint authentication failure attempts. In some embodiments, the device maintains a counter for the number of failed attempts to unlock the device, but such recordings are reset only after the device has been successfully unlocked. In some embodiments, the device maintains a counter for the number of failed attempts to unlock the device by fingerprint detection, but such recordings are reset only after the device has been successfully unlocked.
In some embodiments, the first unlock failure criterion is that the device attempts to unlock the device with one or more unrecognized fingerprints from the second number of failed attempts. Includes criteria that are met when less is detected (2444). For example, the first unlock failure criterion is met when the device detects one to four fingerprint authentication failure attempts.
Understand that the specific order described for the actions in FIGS. 24A-24D is merely exemplary and is not intended to indicate that the order is the only order in which the actions can be performed. I want to be. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, details of other processes described herein with respect to other methods described herein (eg, processes listed in paragraph number [0080]) are also described in FIGS. 24A-. Note that it is applicable in a manner similar to Method 2400 described above in relation to 24D. For example, the fingerprints, contacts, gestures, and user interface objects described above in connection with Method 2400 are the fingerprints, contacts, and contacts described herein in connection with other methods described herein. , Gestures, and optionally one or more of the characteristics of a user interface object (eg, those listed in paragraph number [0080]). For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 25 shows a functional block diagram of an electronic device 2500 configured according to the ideas of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 25 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 25, the electronic device 2500 includes a display unit 2502 configured to display a graphical user interface, a fingerprint sensor unit 2506, and a processing unit 2508 coupled to the display unit 2502 and the fingerprint sensor unit 2506. And. In some embodiments, the electronic device 2500 comprises a processing unit 2508, a fingerprint sensor unit 2506, and a touch sensing surface unit 2504 configured to receive contact, coupled to a display unit 2502. In some embodiments, the processing unit 2508 renders the decision unit 2510, the transition unit 2512, the maintenance unit 2514, the adjustment unit 2516, the enable unit 2518, the receive unit 2520, the invalidation unit 2522, and so on. It includes a unit 2524 and a detection unit 2526.
When the operating mode of the device is in the locked mode where access to the corresponding feature set of the electronic device is locked, the fingerprint sensor unit 2508 detects the first input corresponding to the request to initiate unlocking of the device. do. In response to the fingerprint sensor unit 2506 detecting the first input, the processing unit 2508 determines that the first input is of the unlock criteria, the first unlock failure criterion, or the second unlock failure criterion. It is configured to determine whether one of the above is satisfied (eg, using the determination unit 2510). Processing unit 2508 transitions the device from locked mode to unlocked mode in which the corresponding feature set of the electronic device is unlocked, as determined by the determination that the first input meets the unlock criteria (eg, transition). Further configured to migrate (using unit 2512). Processing unit 2508 keeps the device in locked mode (eg, using maintenance unit 2514) according to the determination that the first input meets the first unlock failure criteria, and the device is the first one. Further configured to adjust the unlock setting (eg, using the adjustment unit 2516) to enable unlocking through the unlocking action in one or more unlocking action sets. Processing unit 2508 keeps the device in locked mode (eg, using maintenance unit 2514) according to the determination that the first input meets the second unlock failure criterion, and the device locks first. To adjust the unlock settings (eg, using adjustment unit 2516) to enable unlocking through unlocking actions in a second or more unlocking action sets that are different from the unlocking action set. Further configured.
In some embodiments, the first input comprises a fingerprint input on the fingerprint sensor unit 2506 and the first unlock failure criterion is that the device locks the device with one or more unrecognized fingerprints. The second unlock failure criterion includes a criterion that is met when it detects at least the first threshold number of failed attempts to unlock, the second unlock failure criterion, where the device uses one or more unrecognized fingerprints to lock the device. Includes criteria that are met when at least a failed attempt with a second threshold number greater than the first threshold number to be released is detected.
In some embodiments, prior to detecting the first input, the device uses the display unit 2502 to display an unlock initiation user interface that does not include a passcode input user interface. Further, while the unlock start user interface is displayed, the device is enabled to be unlocked using a fingerprint, but not unlocked using a passcode.
In some embodiments, the processing unit 2508 enables the device to be unlocked with a passcode before detecting the first input when the device's display is in low power mode. Instead, it is further configured to enable unlocking of the device using fingerprints (eg, using activation unit 2518).
In some embodiments, the device uses the display unit 2502 to provide a passcode input user interface in response to the detection of the first input and according to the determination that the first input does not meet the unlock criteria. indicate.
In some embodiments, according to the determination that the first input meets the first unlock failure criterion, the device uses the display unit 2502 with a first unlock interface, including a passcode input user interface. Shows a visual indication that the device is enabled for fingerprint unlocking. In some embodiments, according to the determination that the first input meets the second unlock failure criterion, the device uses the display unit 2502 with a second unlock interface, including a passcode input user interface. Shows a visual suggestion that the device has been disabled for fingerprint unlocking.
In some embodiments, prior to detecting the first input, the device uses the display unit 2502 to display an unlock initiation user interface that does not include a passcode input user interface. Further, while the unlock start user interface is displayed, the device is enabled to be unlocked using a fingerprint, but not unlocked using a passcode.
In some embodiments, the processing unit 2508 enables the device to be unlocked with a passcode before detecting the first input when the device's display is in low power mode. Instead, it is further configured to enable unlocking of the device using fingerprints (eg, using activation unit 2518).
In some embodiments, the device uses the display unit 2502 to provide a passcode input user interface in response to the detection of the first input and according to the determination that the first input does not meet the unlock criteria. indicate.
In some embodiments, according to the determination that the first input meets the first unlock failure criterion, the device uses the display unit 2502 with a first unlock interface, including a passcode input user interface. Shows a visual indication that the device is enabled for fingerprint unlocking.
In some embodiments, the processing unit 2508 receives the passcode entered through the passcode input user interface (eg, the receive unit) while the device displays the passcode input user interface with the display unit 2502. Received (using 2520) and moved the device from locked operating mode to unlocked operating mode, depending on the receipt of the passcode, and according to the determination that the passcode matches the current passcode for the device. Migrate (using the migration unit 2512, for example) and put the device into locked mode in response to receiving the passcode and according to the determination that the passcode does not match the current passcode for the device. Further configured to maintain (eg, using maintenance unit 2514).
In some embodiments, has the processing unit 2508 met the passcode timeout criteria, including the criteria that are met when the passcode unlock attempt fails at least the first time in response to receiving the passcode? (For example, using the determination unit 2510), and according to the determination that the passcode timeout criterion is met, the device is unlocked using the passcode for the timeout period (for example, the invalidation unit). Further configured to invalidate (using 2522).
In some embodiments, whether the processing unit 2508 meets the data exclusion criteria, including the criteria that are met when the passcode unlock attempt fails at least a second time in response to receiving the passcode. Is determined (eg, using the determination unit 2510), and in response to receiving the passcode, the private data stored on the device is rendered (eg, rendered) according to the determination that the data exclusion criteria have been met. Further configured to be disabled (using unit 2524).
In some embodiments, the device uses the fingerprint sensor unit 2506 to detect the fingerprint on the fingerprint sensor unit 2506 and the fingerprint on the fingerprint sensor unit 2506 while the passcode input user interface is displayed on the display. In response to the detection, the display unit 2502 is used to display an animation of the progress indicator showing the progress towards unlocking the device (eg, the progress towards entering the passcode).
In some embodiments, the processing unit 2508 is further configured to receive an unlock request (eg, using the receiving unit 2520) to unlock the device containing the authentication information. In such an embodiment, the display unit 2502 displays an animation of a progress indicator that changes from the first state to the second state while receiving authentication information. In response to receiving the unlock request, processing unit 2508 determines if the credentials are sufficient to unlock the device (eg, using decision unit 2510) and locks the device out of locked operating mode. Migrate to the unlocked operating mode according to the determination that the credentials are sufficient to unlock the device (eg, using migration unit 2512), and the credentials are sufficient to unlock the device. According to the determination that it is not, the device is put into the locked operation mode (for example, using the maintenance unit 2514) while the display unit 2502 displays the authentication refusal animation that changes from the second state to the first state of the progress indicator. ) Further configured to maintain.
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. It is carried out arbitrarily by operating.
The operations described above with reference to FIGS. 24A-24D are optionally performed by the components shown in FIGS. 1A, 1B, or 25. For example, the detection operation 2406, the determination operation 2410, and the activation operation 2404 are optionally executed by the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those of skill in the art how other processes will be carried out based on the components shown in FIGS. 1A-1B.
Control access to device information and features, and unlock devices
Many electronic devices have a graphical user interface that is displayed while the device is locked. For example, the notification and configuration user interface can be displayed while the device is locked. However, displaying notifications or settings while the device is locked can endanger the device and / or user data. This is because an unauthorized user who has a device at hand can read notifications or change device settings even though he is an unauthorized user. However, suppressing control of the display and settings of all notifications while the device is locked is inconvenient for authorized users of the device.
The following method describes an improved way to control access to device information and features and unlock the device. While the device with the fingerprint sensor is locked, user interfaces such as those for viewing notifications, changing settings, or viewing photos are launched in limited access mode. In limited access mode, the notification, settings, or photo viewer user interface provides less than complete access to device information and features. For example, notifications are partially or completely organized, changeable device settings are limited, or previously stored digital photos cannot be viewed. While browsing the user interface in limited access mode, the user attempts to authenticate the user with the fingerprint on the device's fingerprint sensor. If the authentication is successful, the user interface will be put into full access mode and the device will be unlocked. The device remains unlocked when the full access user interface is closed. If the authentication is unsuccessful, the user interface remains in limited access mode and the device remains locked. The device remains locked when the limited access user interface is closed. This method improves security by controlling access to device information and controls prior to fingerprint authentication, seamlessly provides immediate access to more device information and features, and locks the device after successful fingerprint authentication. To cancel.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 26A-26X and 27A-27D include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 26A-26X and 27A-27D are discussed with reference to a device having a touch screen 112 and a separate touch sensing surface 359-2, but with similar behavior. However, while the user interface shown in FIGS. 26A to 26X is displayed on the display 450, the integrated fingerprint is detected in response to the input described in FIGS. 26A to 26X being detected on the integrated fingerprint sensor 359-1. It is optionally executed on the device by the sensor 359-1. Further, a similar operation is optionally a device having a display 450 and a separate touch sensing surface 451 instead of the touch screen 112, with a fingerprint sensor 169 (eg, integrated fingerprint sensor 359-1 or separate fingerprint sensor 359). -2) Above and / Alternatively, it is executed while the user interface shown in FIGS. 26A to 26X is displayed on the display 450 in response to detecting the contact shown in FIGS. 26A to 26X on the separate touch sensing surface 451. In such an embodiment, the contacts shown in FIGS. 26A-26X are optionally performed on a focus selector corresponding to the position of the display 450 and a separate touch-sensitive surface (eg, touch-sensitive surface 451). Representing both the contact being made or the contact corresponding to the position of the gesture, the focus selector is optionally associated with the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or the corresponding contact). Point), or the center of gravity of two or more contacts detected on the touch screen 112, optionally replaced with the displayed cursor.
FIG. 26A shows a locked device interface 2600 displayed on the device's display (eg, on the touch screen 112 of device 100). The locked device interface 2600 gives the user of device 100 access to one or more functions of device 100 because the device 100 is in locked mode (that is, the device 100 is locked). A user interface that indicates that it is locked. For example, while device 100 is locked, user interface 400 is inaccessible (thus, the user cannot launch at least some applications on device 100). In some embodiments, the locked device interface 2600 provides user-specific information. For example, the locked device interface 2600 contains the current date and time 2602, as well as instructions or hint 2604 on how to unlock the device 100.
The locked device interface 2600 also includes one or more user interface objects for displaying the corresponding user interface or launching a particular application. For example, the locked device interface 2600 includes handles 2606 and 2608, as well as icon 2610. The handle 2606 is adjacent to the top edge of the touch screen 112 and the 2608 is adjacent to the bottom edge of the touch screen 112. The user makes a gesture starting with handle 2606 (eg, swipe gesture) to activate the display of the notification interface (eg, notification interface 2616 in FIG. 26C). The user makes a gesture starting with handle 2608 (eg, swipe gesture) to activate the display of the configuration management interface (eg, configuration management interface 2650 in Figure 26N). The user makes a gesture (eg, swipe gesture) on the icon 2610 to activate the display of the camera interface (eg, camera interface 2678 in FIG. 26U).
FIG. 26A shows the gesture detected on the touch screen 112 while the device 100 is in locked mode. Gestures (eg, swipe gestures) include contact 2612 detected on handle 2606 and contact 2612 moving in direction 2614 while being detected on handle 2606. In response to detecting the gesture, the device 100 displays the notification interface 2616 on the touch screen 112 shown in FIG. 26C, and the device 100 remains in locked mode.
In some embodiments, the transition from displaying the locked device interface 2600 to displaying on the notification interface 2616 is such that the notification interface 2616 follows the movement of the contact 2612 as shown in FIGS. 26A-26C. The contact 2612 swipes the notification interface 2616 onto the touch screen 112, including an animation that slides onto the 112.
In the animation, the notification interface 2616 slides over the locked screen interface 2600. In some embodiments, the notification interface 2616 is translucent and the locked device interface 2600 is partially visible under the notification interface 2616, as shown in FIG. 26C (eg, although visible). Blurred or blurry). For example, the current time and date 2602 and the unlock instruction 2604 are visible but obscured under the notification interface 2616. In some other embodiments, the notification interface 2616 is opaque and the locked device interface 2600 is not visible under the notification interface 2616.
Notification interface 2616 is a user interface for displaying notifications 2620 associated with the corresponding application on device 100. In some embodiments, the notification interface 2616 comprises one or more sections 2618. Each corresponding section 2618 is associated with a corresponding application on device 100 and displays one or more notifications 2620 associated with that corresponding application. The corresponding notification 2620 contains one or more pieces for displaying the corresponding fields of information. For example, a notification for a message or email includes parts corresponding to the sender, date / time, and content indicators (eg, subject and / or fragment of message / email body). As another example, the notification about a calendar event invitation includes the name and / or description of the event, the source of the invitation (eg, the contact who sent the invitation), and the part corresponding to the date / time of the event. The parts and information contained in Notification 2620 are typically determined by the corresponding associated application.
In some embodiments, the notification interface 2616 also includes two or more browsing filters 2638. The corresponding browsing filter 2638 corresponds to the corresponding set of criteria for filtering notifications 2620 displayed on notification interface 2616, showing notifications 2620 that meet the criteria and hiding notifications 2620 that do not meet the criteria. .. For example, in Figure 5C, the browsing filter "All" 2638-1 is active and all outstanding notifications 2620 (notations hidden according to restrictions on access to notification interface 2616 as described below). Other than) is displayed. The inactive browsing filter 2638 is activated by a gesture (eg, a tap gesture) performed on the browsing filter. For example, in response to detecting a tap gesture made on the browsing filter "Absent" 2638-2, device 100 issues a notification 2620 that has not been addressed within a given time period (eg, the previous 24 hours). Display on notification interface 2616 and omit display of notification 2620 that does not meet the criteria that have not been addressed within this time period.
Since device 100 is locked when a gesture using contact 2612 is detected, the notification interface 2616 is displayed in limited access mode. Access to the notification interface 2616 is restricted while the notification interface 2616 is in restricted access mode. In some embodiments, restricting access to the notification interface 2616 is an omission from the organization of information in one or more notifications 2620, the display of one or more sections 2618 with otherwise open notifications ( For example, hiding on the display), and including one or more of the omissions from the display of one or more browsing filters 2638. For example, FIG. 26C shows a notification 2620 organized in the notification interface 2616. As an alternative example. FIG. 26D shows the omission of the organized notifications 2620 and section 2618-2 in the notification interface 2616. Also, both FIGS. 26C and 26D show that the browsing filter "Today" 2638-3 (FIG. 26H) is hidden.
In some embodiments, the organization of Notification 2620 comprises replacing all or some parts of the notification with generic, placeholder text. For example, in FIG. 5C, notification 2620-1 is a notification of a message received by the messaging application on device 100. Notification 2620-1 is the part 2622 to identify the sender of the message, the part 2624 about the time stamp of the message (eg, the date / time when the message was sent and received), and the part about all or some of the content of the message. Including 2626. When notification 2620-1 is not organized, parts 2622, 2624, and 2626 contain the actual corresponding content (ie, the actual sender name, the actual time stamp, and the actual message content, respectively). .. When Notification 2620-1 is organized, one or more of parts 2622, 2624, and 2626 are replaced with the corresponding generic text. As shown in Figure 26C, notifications 2620-1 are partially organized. Part 2622 shows the actual sender name, part 2624 shows the generic text "time" instead of the actual time stamp, and part 2626 shows the generic text "message" instead of the actual message fragment.
As another example, Notification 2620-2 in Figure 26C is a notification about a calendar event invitation received by the calendar application on device 100. Notice 2620-2 includes part 2628 about the name or description of the event, part 2630 about the source of the invitation (eg, the invitee), and part 2632 about the time of the event. In Figure 26C, parts 2628, 2630, and 2632 are replaced with the generic texts "event", "contact invitation", and "time", respectively.
In some other embodiments, the organization of Notification 2620 visually fails all or some parts of Notification 2620, as opposed to replacing all or some parts of Notification 2620 with the corresponding generic text. Includes clarification. Visual obscuring includes, for example, blackening (eg, using the delete bar), blurring, or pixelation (eg, as described above with reference to Method 2100).
In some embodiments, restrictions on access to the notification interface 2616 further include the inability of the user to open or otherwise access the original content or application corresponding to the notification. For example, while the notification interface 2616 is displayed in full access mode, the user makes a gesture (eg, tap gesture) on the notification 26201 to open the messaging application and view the entire message corresponding to the notification 2620-1. Make a gesture on Notification 2620-2 to open the calendar application, view the entire event invitation corresponding to Notification 2620-2, and make a gesture on Notification 2620-3 or 2620-4 to open the Mail application. , You can view the entire message corresponding to Notification 2620-3 or 2620-4, respectively. Conversely, while notification interface 2616 is displayed in limited access mode, these full access features are disabled and gestures detected by notification 2620 activate access to the entire content or launch the corresponding application. I don't do it.
A gesture may be made by the user to close the notification interface 2616 while the notification interface 2616 is displayed in limited access mode. For example, FIGS. 26C and 26D show gestures detected on the touch screen 112, respectively. Gestures (eg, swipe gestures) include contact 2634 detected on handle 2606 and contact 2634 moving in direction 2636 while being detected on handle 2606. In response to detecting the gesture, device 100 displays the locked device interface 2600 on the touch screen 112, as shown in FIG. 26F. Since no user has successfully authenticated since device 100 entered locked mode, device 100 remains in locked mode (and thereby displays the locked device interface 2600 on the touch screen 112. ).
In some embodiments, the transition from displaying the notification interface 2616 to displaying the locked device interface 2600 follows the movement of the notification interface 2616 to the contact 2634, as shown in FIGS. 26D-26F. Includes an animation that slides off the touch screen 112 to reveal the locked device interface 2600, and the contact 2634 swipes off the notification interface 2616 from above the touch screen 112.
Subsequently, in FIG. 26G, which includes the user interface shown in FIG. 26C, fingerprint 2640 is detected on the fingerprint sensor 169. The device 100 determines if the fingerprint 2640 is one of one or more fingerprints registered with the device 100. If device 100 determines that fingerprint 2640 is not one of the registered fingerprints (for example, the user applying fingerprint 2640 is not authenticated), device 100 displays notification interface 2616 in limited access mode. Maintain and device 100 keeps itself in locked mode.
If device 100 determines that fingerprint 2640 is one of the registered fingerprints (for example, the user who applied fingerprint 2640 successfully authenticates), device 100 then displays the notification interface 2616 in full access mode. , Device 100 transitions itself from locked mode to unlocked mode, as shown in FIG. 26H. Displaying notification interface 2616 in full access mode unorganizes notifications 2620 organized while notification interface 2616 is displayed in limited access mode, notification interface 2616 is displayed in limited access mode. A browsing filter that displays any of the sections 2618 that were omitted from the display in between, and was omitted from the display (and thereby made inaccessible) while the notification interface 2616 was displayed in limited access mode. Includes displaying (and making accessible) 2638. Therefore, for example, as shown in FIG. 26H, the notification 2620 is not organized, and the part in the corresponding notification 2620 displays the actual content. Also, section 2618-2 is displayed (compared to device 100 illustrated in Figure 26D). Further, when the browsing filter "Today" 2638-3 is displayed and the browsing filter "Today" 2638-3 is activated, the notification 2620 displayed on the notification interface 2616 becomes a notification about the current date (eg,). Messages or emails received on the current date, calendar events about the current date).
As mentioned above, if fingerprint 2640 is one of the registered fingerprints, device 100 transitions itself from locked mode to unlocked mode. The migration involves migrating from the locked device interface 2600 to the user interface 400, which is under the notification interface 2616 because the notification interface 2616 is overlaid on the locked device interface 2600 and the user interface 400. It is done in. In some embodiments, this migration is not visible to the user (eg, because the notification interface 2616 is opaque). In some embodiments, the notification interface 2616 is translucent, thereby making the transition visible to the user (eg, as an animation), but blurry or blurry. As shown in FIGS. 26G to 26H, when the transition to unlocked mode occurs, user interface elements in the locked device interface 2600, such as date / time 2602 and instruction 2604, are displayed below the notification interface 2616. Instead, the application icon in user interface 400 is displayed under notification interface 2616.
FIG. 261 shows the notification interface 2616 displayed in full access mode and the device 100 in unlocked mode. Gestures are detected on the touch screen 112 while notification interface 2616 is displayed in full access mode and device 100 is in unlocked mode. Gestures (eg, swipe gestures) include contact 2642 detected on handle 2606 and contact 2642 moving in direction 2644 while being detected on handle 2606. In response to detecting the gesture, the device 100 closes the notification interface 2616 from the touch screen 112, as shown in FIG. 26J. The user interface 400 appears on the touch screen 112 because the device 100 remains in unlocked mode after closing the notification interface 2616, and the user previously inaccessible because the user interface 400 was inaccessible. You can access the applications that were possible.
FIG. 26K summarizes the transition of device 100 (devices 100-a to 100d) from the locked mode when the notification interface 2616 is displayed, as shown in FIGS. 26A to 26J, to the unlock mode. Device 100-a is in locked mode, locked device interface 2600 is displayed, notification interface 2616 is not displayed. When the display of notification interface 2616 is activated, the locked device interface 2600 is partially visible under the translucent notification interface 2616 displayed in limited access mode, as shown for Figure 100-b. Is. When a registered fingerprint is detected, device 100 will transition from locked mode to unlocked mode, notification interface 2616 will be displayed in full access mode (device 100-b to device 100-c), and locked device. Interface 2600 transitions to user interface 400. When the notification interface 2616 displayed in full access mode is closed, the user interface 400 is displayed on the display of device 100-d.
FIG. 26L shows the locked device interface 2600 displayed on the touch screen 112 of the device 100, where the device 100 is in locked mode. FIG. 26L also shows the gestures detected on the touch screen 112. Gestures (eg, swipe gestures) include contact 2646 detected on handle 2608 and contact 2646 moving in direction 2648 while being detected on handle 2608. In response to detecting the gesture, device 100 displays the configuration management interface 2650 on the touch screen 112, as shown in Figure 26N, and device 100 remains in locked mode.
In some embodiments, the transition from displaying the locked device interface 2600 to displaying it on the configuration management interface 2650 is that the configuration management interface 2650 moves the contact 2646 as shown in FIGS. 26L-26N. The contact 2646 swipes the configuration management interface 2650 onto the touch screen 112, including an animation that slides onto the touch screen 112 according to.
In the animation, the configuration management interface 2650 slides over the locked screen interface 2600. In some embodiments, the notification interface 2616 is opaque and any part of the locked device interface 2600 superimposed by the configuration management interface 2650 is invisible under the configuration management interface 2650 and the configuration management interface. The locked device interface 2600, which is not overlaid by the 2650, is clearly visible, or blurry or blurry, as shown, for example, in FIG. 26N. In some other embodiments, the configuration management interface 2650 is translucent and the locked device interface 2600 is visible under the configuration management interface 2650 but is blurry or blurry (eg, in Figure 26C). Similar to the notification interface 2616 shown).
The configuration management interface 2650 is a user interface associated with one or more device configurations on device 100. The configuration management interface 2650 contains a user interface object 2652 for changing the corresponding configuration. For example, the configuration management interface 2650 has an airplane mode icon 2652-1 to toggle airplane mode on / off (device 100 does not send wireless signals when airplane mode is on) and Wi-Fi on. / Wi-Fi icon 2652-2 to toggle off, Bluetooth icon 2652-3 to toggle Bluetooth on / off, toggle sleep mode on / off (device 100 is in sleep mode) When, the voice alert for notification 2620 is suppressed, but the notification itself is optionally displayed on the touch screen 112) with the sleep mode icon 2652-4 and screen rotation lock on / off. Includes screen rotation lock icon 2652-5, for toggle. The corresponding icon 2652 shows the current state of each of the corresponding settings and toggles each corresponding setting in response to activation of the corresponding icon 2652 (eg, by a tap gesture on it). The configuration management interface 2650 also optionally includes a brightness control 2654 for controlling the brightness level of the touch screen 112.
In some embodiments, the configuration management interface 2650 also has a music playback control 2656 for controlling music playback and an icon 2658 for initiating a process for wirelessly sharing files with another device. Includes an icon 2660 to initiate the process for wirelessly streaming media content to another device, and one or more icons 2662 to launch a given application or activate a given function. For example, the configuration management interface 2650 launches an icon 2662-1 for launching a flashlight application or activating a flashlight function, an icon 2662-2 for launching a clock / timer application, and a computer application. Includes an icon 2662-3 for launching an icon 2662-4 for launching a camera application (eg, camera module 143).
The configuration management interface 2650 is displayed in limited access mode because device 100 was locked when a gesture with contact 2646 was made. While the configuration management interface 2650 is in limited access mode, icons, controls, etc. for changing settings, launching applications, or activating features (eg, Icon 2652, Brightness Control 2654, Music Control 2656, Icon 2658, 2660, And one or more of 2662) are invalidated. For example, in Figure 26N, the icon 2652-1 is disabled. Tap Gesture 2664 on Icon 2652-1 does not toggle and thereby does not affect airplane mode. In some embodiments, the disabling of Icon 2652 is visually indicated by icon graying out or shading (as in Icon 2652-1 in Figure 26N).
A gesture can be made by the user to close the configuration management interface 2650, similar to closing the notification interface 2616 shown in Figures 26C to 26F, while the configuration management interface 2650 is displayed in limited access mode. Is. For example, a gesture on handle 2608 (eg, a swipe gesture), as opposed to a gesture with contact 2646, is detected on the touch screen 112 while the configuration management interface 2650 is displayed in limited access mode (not shown). ), The gesture is detected on the handle 2608 and the corresponding contact moves in the opposite direction of direction 2648. In response to detecting the gesture, device 100 displays the locked device interface 2600 on the touch screen 112, as shown in Figure 26L. Since no user has successfully authenticated since device 100 entered locked mode, device 100 remains in locked mode (and thereby displays the locked device interface 2600 on the touch screen 112. ).
In some embodiments, the transition from displaying the configuration management interface 2650 to displaying the locked device interface 2600 is similar to the animation shown to close the notification interface 2616 shown in FIGS. 26D-26F. Following the contact movement in the close gesture, the configuration management interface 2650 includes an animation (not shown) that slides off the touch screen 112 to reveal the locked device interface 2600, and the close gesture is from the touch screen 112. Swipe off the configuration management interface 2650.
Returning to FIG. 26N, fingerprint 2666 is detected on the fingerprint sensor 169. The device 100 determines if the fingerprint 2666 is one of one or more fingerprints registered with the device 100. If device 100 determines that fingerprint 2666 is not one of the registered fingerprints, device 100 keeps the display of configuration management interface 2650 in limited access mode and device 100 keeps itself in locked mode. ..
If device 100 determines that fingerprint 2666 is one of the registered fingerprints, device 100 then displays the configuration management interface 2650 in full access mode, which device 100 displays as shown in Figure 26O. , Moves itself from locked mode to unlocked mode. The display of the configuration management interface 2650 in full access mode includes any icons, controls, etc. that were disabled while the configuration management interface 2650 was displayed in limited access mode (eg, icon 2652, brightness control 2654, music control). Includes enabling one of 2656, icons 2658, 2660, and 2662). For example, in Figure 26O, icon 2652-1 is enabled and icon 2652-1 is no longer grayed out. Tap gesture 2668 on icon 2652-1 toggles airplane mode as shown in Figure 26P, and in Figure 26P icon 2652-1 changes the contrast (compared to icon 2652-1 in Figure 26O). ), Indicates that the airplane mode setting has been toggled from the setting in Figure 26O.
As mentioned above, if fingerprint 2666 is one of the registered fingerprints, device 100 transitions itself from locked mode to unlocked mode. The migration optionally involves migrating from the locked device interface 2600 to the user interface 400 and is performed under the configuration management interface 2650 superimposed on the locked device interface 2600 and the user interface 400. In some embodiments, this migration is not visible to the user. In some embodiments, this transition is visible to the user as an animation transitioning from the locked device interface 2600 to the user interface 400, the configuration management interface 2650 is translucent, and / or at most partial. Covers the locked device interface 2600 / user interface 400, so the animation and interfaces 2600 and 400 are visible but optionally blurry or blurry under the configuration management interface 2650. As shown in FIGS. 26N to 26O, when the transition to unlocked mode occurs, the user interface elements in the locked device interface 2600, such as date / time 2602, disappear and the application icon in the user interface 400 is displayed. The interface. In some embodiments, the user interface 400 is a user interface that is displayed just before the device enters locked mode and may be different from the interface that displays the application icon. In other words, the interface displaying the application icon in FIGS. 26H-26K and 26O-26R is merely an example of the unlocked mode user interface.
Figure 26Q shows the configuration management interface 2650 displayed in full access mode and the device 100 in unlocked mode. Gestures are detected on the touch screen 112 while configuration management interface 2650 is displayed in full access mode and device 100 is in unlocked mode. Gestures (eg, swipe gestures) include contact 2670 detected on handle 2608 and contact 2670 moving in direction 2672 while being detected on handle 2608. In response to detecting the gesture, the device 100 closes the configuration management interface 2650 from the touch screen 112, as shown in Figure 26R. The user interface 400 appears on the touch screen 112 because the device 100 remains in unlock mode after closing the configuration management interface 2650, and the user previously inaccessible because the user interface 400 was inaccessible. You can access the applications that were possible.
FIG. 26S shows the locked device interface 2600 displayed on the touch screen 112 of the device 100, where the device 100 is in locked mode. FIG. 26S also shows the gestures detected on the touch screen 112. Gestures (eg, swipe gestures) include contact 2674 detected on icon 2610 and contact 2674 moving in direction 2676 while being detected on icon 2610. In response to detecting the gesture, the device 100 displays the camera interface 2678 on the touch screen 112 shown in Figure 26U, and the device 100 remains in locked mode.
In some embodiments, the transition from displaying the locked device interface 2600 to displaying the camera interface 2678 follows the movement of the contact 2674, as shown in FIGS. 26S-26U. Includes an animation that slides onto the touch screen 112, and the contact 2674 swipes the camera interface 2678 onto the touch screen 112.
In the animation, the camera interface 2678 slides over the locked screen interface 2600. In some embodiments, the camera interface 2678 is opaque, and the locked device interface 2600 is not visible under the camera interface 2678, for example as shown in FIG. 26U.
In some other embodiments, the transition from displaying the locked device interface 2600 to displaying the camera interface 2678 is such that the locked device interface 2600 slides off the touch screen 112 according to the movement of the contact 2674. Includes an animation that reveals the camera interface 2678.
Camera interface 2678 is an interface associated with a camera application on device 100 (eg, camera module 143). The camera interface 2678 includes a camera preview 2680, a flash control 2682, a front / back camera toggle 2684, a shutter / capture button 2686, an image effect control 2688, and a camera roll icon 2690. Upon detecting a gesture 2692 (eg, tap gesture) on the camera roll icon 2690, device 100 stops displaying camera interface 2678 and displays camera roll interface 2693 (Figure 26V). Photo 2697 (Fig. 26W) captured on device 100 or otherwise stored is displayed on camera roll interface 2693. The camera roll interface 2693 also includes the icon 2694. In response to activation of icon 2694 (eg, by tap gesture on camera icon 2694), device 100 displays camera interface 2678. Therefore, the camera icon 2694 and the camera roll icon 2690 are similar controls, and by activating the camera roll icon 2690, the device 100 can be switched to display the camera roll interface 2693 and the icon 2694 can be activated. Switch device 100 to display camera interface 2678.
The camera interface 2678 is displayed in limited access mode because device 100 was locked when the gesture using contact 2674 was performed. In response to the detection of gesture 2692 on the camera roll icon 2690, the device 100 displays the camera interface 2678 in limited access mode while the camera interface 2678 is in limited access mode. Replace with display. While the camera roll interface 2693 is displayed in limited access mode, the display of images captured or otherwise stored on device 100 is restricted. In some embodiments, the limitation is that the device 100 views the captured and / or stored images on the device 100 until the user successfully authenticates and before the device enters locked mode. The device 100 suppresses the display of images captured or stored in the camera roll before the device 100 enters the locked mode in the camera roll interface 2693. So, for example, in Figure 26V, all photos are not displayed while the camera roll interface 2693 is displayed in limited access mode, and device 100 should be unlocked to view hidden photos. A warning message 2695 is displayed warning that it is (for example, authenticating itself).
While the camera interface 2678 or camera roll interface 2693 is displayed in limited access mode, both can be closed by pressing button 204 on device 100. Either Camera Interface 2678 or Camera Roll Interface 2693 displays in limited access mode unless the finger pressing the button has a registered fingerprint detected by the fingerprint sensor 169 while pressing the button. Upon detecting the press of the button 204 on the device 100, the device 100 provides a locked device interface 2600 on the touch screen 112, as shown in FIG. 26S, or a passcode input interface (figure). Not shown) is displayed. Since no user has successfully authenticated since the device 100 entered locked mode, the device 100 remains in locked mode (and thereby the locked device interface 2600 or passcode input interface on the touch screen 112. Is displayed). If the pressing finger has a registered fingerprint detected by the fingerprint sensor 169 while pressing the button, the user is authenticated and device 100 displays user interface 400 instead of locked device interface 2600.
Returning to device 100 shown in Figure 26V, fingerprint 2696 is detected on fingerprint sensor 169. The device 100 determines if the fingerprint 2696 is one of one or more fingerprints registered with the device 100. If device 100 determines that fingerprint 2696 is not one of the registered fingerprints, device 100 keeps the camera roll interface 2693 display in limited access mode and device 100 keeps itself in locked mode. .. Similarly, if the fingerprint is detected on the fingerprint sensor 169 while the camera interface 2678 is being detected, the device 100 determines if the fingerprint is one of the registered fingerprints. If the fingerprint is not one of the registered fingerprints, device 100 keeps the display of camera interface 2678 in limited access mode and device 100 keeps itself in locked mode.
If the device 100 determines that the fingerprint 2696 is one of the registered fingerprints, the device 100 then displays the camera roll interface 2693 in full access mode, and the device 100 is shown in Figure 26W. In addition, it shifts itself from locked mode to unlocked mode. Displaying the camera roll interface 2693 in full access mode involves displaying image 2697, which was not displayed when the camera roll interface 2693 was displayed in limited access mode.
Device 100 activates camera interface 2678 in full access mode in response to camera icon 2694 being activated (eg by tap gesture 2698 on camera icon 2694) while camera roll interface 2693 is displayed in full access mode. Displaying, device 100 remains in unlock mode, switching to camera interface 2678 while camera roll interface 2693 is displayed in full access mode puts camera interface 2678 in full access mode.
While either camera interface 2678 or camera roll interface 2693 is displayed in full access mode (and device 100 is in unlock mode), both can be closed by pressing button 204 on device 100. .. Button 204 on device 100 while either camera interface 2678 or camera roll interface 2693 is displayed in full access mode (eg, camera roll interface 2693 is displayed in full access mode, as shown in Figure 26W). In response to detecting the press 2699, the device 100 displays the user interface 400 on the touch screen 112 as shown in FIG. 26X, while the device 100 remains in unlocked mode.
27A-27D are flow diagrams illustrating a method 2700 for controlling access to device information and functions and unlocking the device, according to some embodiments. Method 2700 is performed on an electronic device having a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some actions of Method 2700 are optionally combined and / or the order of some actions is optionally changed.
As described below, Method 2700 provides an intuitive and secure way to control access to device information and features and unlock the device. This method controls access to device information and features, reduces the cognitive burden on the user when unlocking the device, thereby creating a more efficient human-machine interface.
While the device is in locked mode (2702) where access to the corresponding feature set of the electronic device is locked, the device displays the first user interface on the display (2704) and the first input (2704). Detects the first gesture in the first user interface, such as a downward swipe gesture starting from the upper area of the display or near or near the edge of the display (2706). In FIGS. 26A and 26L, for example, the locked device interface 2600 is displayed while the device 100 is in locked mode. Swipe gestures with contacts 2612 and 2646, respectively, are detected on the touch screen 112, starting at handles 2606 and 2608, respectively.
As another example, in FIG. 26U, camera interface 2678 is displayed while device 100 is in locked mode. The tap gesture 2692 is detected on the touch screen 112 and on the camera roll icon 2692.
In response to detecting the first input, the device displays a second user interface on the display (2708), and the second user interface restricts access to the second user interface according to the restriction criteria. Is in a limited access mode (eg, at least a portion of one or more notifications is organized, and the entire message corresponding to the notification cannot be accessed without unlocking the device, and / or One or more displayed controls cannot be changed). For example, in response to detecting a gesture with contact 2612, device 100 displays the notification interface 2616 in limited access mode (FIG. 26C or 26D) and notification 2620 is organized. As another embodiment, in response to detecting a gesture with contact 2646, device 100 displays configuration management interface 2650 in limited access mode (Figure 26N) and the airplane mode icon 2652-1 is disabled. .. As another embodiment, in response to detecting gesture 2692, device 100 displays camera roll interface 2693 in limited access mode (FIG. 26V) and photo 2697 is hidden from the display.
In some embodiments, the second user interface is the user interface selected according to the first input (2710). According to the determination that the first input starts from the first end of the device in response to the detection of the first input, the second user interface is the notification interface and the second input is the first of the devices. The second interface is the configuration management interface, according to the determination that it starts at the second end of the device that is different from (eg, opposite to) the end of (2712). For example, the notification interface 2616 is displayed in limited access mode in response to detecting a gesture with contact 2612 starting at handle 2606 (eg, starting at the top of the touch screen 112) (FIGS. 26A-26D). Conversely, the configuration management interface 2650 is displayed in limited access mode in response to detecting a gesture with contact 2646 starting at handle 2608 (eg, starting at the bottom edge of the touch screen 112) (Figures 26L-26N). ..
While displaying the second user interface in limited access mode (2714), the device detects the first fingerprint on the fingerprint sensor (2716). For example, fingerprint 2640 (FIG. 26G), 2666 (FIG. 26N), or 2696 (FIG. 26V) is detected on the fingerprint sensor 169.
According to the determination that the first fingerprint is one of multiple registered fingerprints registered with the device (2718), the device is not restricted to access to the second user interface according to the restriction criteria. Display a second user interface in full access mode (eg, one or more notifications are unorganized) (2720) and unlock the device from locked mode with the corresponding set of electronic device features. Go to unlocked mode (2722). In some embodiments, the subject and preview of the notification are displayed in unorganized mode. For example, if fingerprint 2640 (Figure 26G) is determined to be one of the registered fingerprints, the notification interface 2616 will be displayed in full access mode, device 100 will be unlocked (Figure 26H) and the notification will be made. 2620 is displayed unorganized. As another example, if fingerprint 2666 (Figure 26N) is determined to be one of the registered fingerprints, the configuration management interface 2650 will be displayed in full access mode and device 100 will be unlocked (device 100). Figure 26O), Airplane mode icon 2652-1 is enabled. As another embodiment, if fingerprint 2696 (FIG. 26V) is determined to be one of the registered fingerprints, the camera roll interface 2693 will be displayed in full access mode and device 100 will be unlocked (device 100). Figure 26W), Photo 2697 is displayed.
In some embodiments, the second user interface is translucent and the second user interface is displayed above the first user interface (2724). According to the determination that the first fingerprint is one of multiple registered fingerprints registered using the device, the device is locked under the translucent second user interface. Shows an animation in which the first user interface of the mode transitions to the unlocked mode user interface of the device (2726). For example, the first user interface is the device lock screen when the device is in locked mode, and the first user interface transitions to the home screen, which is the screen with the application icon for launching the application. Or, shortly before the device enters locked mode, it transitions to the last screen displayed by the device in unlock mode. This animated transition is typically blurry because this transition occurs under a semi-transparent second user interface. This animated migration signals the user that the device has been unlocked while the device maintains the display of the second user interface. As shown in FIG. 26C, for example, the notification interface 2616 is translucent and is displayed above the locked device interface 2600. If fingerprint 2640 (Figure 26G) is determined to be one of the registered fingerprints, an animation migrating the locked device interface 2600 to user interface 400 will notify you, as shown in Figures 26G-26H. Displayed under Interface 2616.
Upon determining that the first fingerprint is not one of multiple registered fingerprints, the device keeps the display of the second user interface in limited access mode and keeps the device in locked mode (2728). ). For example, if fingerprint 2640 (Figure 26G) is determined to be not one of the registered fingerprints, device 100 keeps the notification interface 2616 in limited access mode and keeps itself in locked mode. Notification 2620 remains organized. As another example, when fingerprint 2666 (Figure 26N) is determined to be not one of the registered fingerprints, device 100 keeps configuration management interface 2650 in limited access mode and locks itself in locked mode. The in-flight mode icon 2652-1 remains disabled. As another embodiment, when fingerprint 2696 (FIG. 26V) is determined to be not one of the registered fingerprints, device 100 maintains camera roll interface 2693 (and camera interface 2678) in limited access mode. Keeping itself in locked mode, Photo 2697 remains hidden on the display.
In some embodiments, the device detects the second input after detecting the first input and while displaying the second user interface (2730). In response to detecting the second input (2732), the device stops displaying the second user interface (2734) and displays the corresponding user interface instead of the second user interface (2736). ). When the device is in unlocked mode (eg, according to the determination that the first fingerprint is one of multiple registered fingerprints registered with the device), the corresponding user interface is electronic. A user interface with unlimited access to the corresponding set of device features (eg, an application launch user interface for launching multiple different applications, or most recently used applications) (2738). When the device is in locked mode (eg, according to the determination that the first fingerprint is not one of multiple registered fingerprints), the corresponding user interface is to the corresponding set of features of the electronic device. It is the first user interface with restricted access (2740). While device 100 is displaying notification interface 2616 or configuration management interface 2650, device 100 detects the corresponding input to close the corresponding interface. When the device 100 is in unlocked mode and the corresponding interface is closed, the device 100 displays the user interface 400. When device 100 is in locked mode and the corresponding interface is closed, device 100 displays locked device interface 2600.
For example, in response to detecting a gesture with contact 2634 to close notification interface 2616 (FIG. 26C or 26D), device 100 maintains locked mode and displays locked device interface 100. However, in response to detecting a gesture with contact 2642 to close notification interface 2616 (FIG. 26I), device 100 maintains unlocked mode and displays user interface 400 (FIG. 26J).
As another embodiment, the device 100 detects a gesture to close the configuration management interface 2650 while the configuration management interface 2650 is displayed in limited access mode and the device 100 is in locked mode. Maintains locked mode to display locked device interface 2600. However, in response to detecting a gesture with contact 2670 to close configuration management interface 2650 (Fig. 26Q), device 100 maintains unlocked mode and displays user interface 400 (Fig. 26R).
In some embodiments, the second user interface is a notification interface associated with multiple notifications (2742), and in limited access mode, the corresponding information contained in one or more notifications is inaccessible. And in full access mode, the corresponding information is accessible. Notification interface 2616 is displayed with notification 2620, as shown in FIGS. 26C and 26H. When notification 2616 is displayed in limited access mode, the actual message or email content (eg, message or email fragment) is inaccessible and is replaced by generic text in notification 2620, as shown in Figure 26C. .. However, when the notification interface 2616 is displayed in full access mode, the actual message or email content is included in the notification 2620, as shown in FIG. 26H.
In some embodiments, the corresponding information that is inaccessible in limited access mode includes organized information (2744). In limited access mode, the corresponding notification representation includes a first part (eg, sender identification information) and a second part (eg, subject or fragment of content), the first part being unorganized. Yes, the second part is already organized. In full access mode, the corresponding notification representation includes the first and second parts, the first and second parts being unorganized. Notification 2620-1 in FIG. 26C is, for example, a pre-organized notification, where part 2622 (sender) is not organized, but part 2624 (message timestamp) and part 2626 (message fragment) are generic placeholder texts. It is organized by replacing with.
In some embodiments, the notice is not organized, even in limited access mode, if the notice does not contain or is accompanied by personal or private information. For example, sports updates or news updates do not need to be organized.
In some embodiments, the corresponding information inaccessible in limited access mode includes information from a given section of the notification interface (2746). In limited access mode, the notification interface omits a predetermined section, and in full access mode, the notification interface includes a predetermined section. For example, in Figure 26D, section 2618-2 for calendar notifications is omitted while the notification interface 2616 is in limited access mode. In Figure 6H, section 2618-2 on calendar notifications is displayed when notification interface 2616 is in full access mode.
In some embodiments, the second user interface is a configuration management interface associated with multiple device configurations (2748). In limited access mode, the device prevents at least one corresponding setting from being changed (for example, the corresponding setting is pinned to a previously selected value such as "on" or "off" and the device is Unless / the second user interface is transitioned to full access mode, it will not respond to user input by changing the settings). In full access mode, the corresponding setting is enabled for that change (for example, the setting is enabled for changes in response to user input, such as tapping on the settings toggle or sliding the settings slider. Ru). For example, the configuration management interface 2650 is an interface associated with multiple settings (airplane mode on / off, Wi-Fi on / off, etc.). When the configuration management interface 2650 is in restricted access mode, the airplane mode icon 2652-1 is disabled (Figure 26N) and the current airplane mode setting is regardless of the tap gesture 2664 on the airplane mode icon 2652-1. Not changed. However, when the configuration management interface 2650 is in full access mode, the airplane mode icon 2652-1 is enabled and the tap gesture 2668 on the airplane mode icon 2652-1 changes the airplane mode setting (Fig. 26O).
In some embodiments, the second user interface is a camera playback interface for viewing images taken by the device's camera (2750). In limited access mode, the device prevents one or more previously captured images from being viewed on the camera playback interface (for example, the device is captured before the user enters locked operating mode). Prevents users from viewing images stored in a virtual "camera roll" until the user successfully authenticates). However, in full access mode, one or more previously captured images will be enabled for viewing on the camera playback interface (eg, after the user successfully authenticates, the virtual "camera roll" will be unlocked. The user is then given access to the image in the virtual "camera roll"). For example, FIGS. 26V-26W show a camera roll interface 2693 for viewing photos captured by device 100 or otherwise stored on the touch screen 112. Photo 2697 is displayed when the camera roll interface 2693 is in full access mode (Figure 26W). Photo 2697 is not displayed when the camera roll interface 2693 is in limited access mode (Figure 26V).
The specific order described for the actions in FIGS. 27A-27D is merely exemplary and is not intended to indicate that the order in which the actions can be performed is the only order in which the actions can be performed. I want you to understand. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, details of other processes described herein with respect to the other methods described herein (eg, the processes listed in paragraph number [0080]) are also described in FIGS. 27A-. Note that a method similar to Method 2700 described above in relation to 27D is also applicable. For example, the inputs, user interfaces, user interface objects or elements, and animations described above with reference to Method 2700 are optionally listed in other methods described herein (eg, in paragraph [0080]). Have one or more of the inputs, user interfaces, user interface objects or elements, and animation characteristics described herein with reference to. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 28 shows a functional block diagram of the electronic device 2800 configured according to the ideas of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 28 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly , the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 28, the electronic device 2800 includes a display unit 2802, optionally a touch sensing surface unit 2804, a fingerprint sensor unit 2806, a display unit 2802, and optionally a touch sensing surface unit 2804, And a processing unit 2808 connected to the fingerprint sensor unit 2806. In some embodiments, the processing unit 2808 comprises a display enablement unit 2810, a detection unit 2812, a transition unit 2814, a maintenance unit 2816, and a discontinuation unit 2818.
Processing unit 2808 displays the display of the first user interface on display unit 2802 (eg, display enablement) while the device is in locked mode where access to the corresponding set of features of the electronic device is locked. Activated (using unit 2810), detected the first input (eg, using detection unit 2812), and depending on the detection of the first input, its access is restricted on the display unit 2802. While enabling the display of the second user interface in the limited access mode restricted according to (eg, using the display enablement unit 2810) and enabling the display of the second user interface in the limited access mode. The first fingerprint is detected on the fingerprint sensor 2806 (eg, using the detection unit 2812) and the first fingerprint is one of a plurality of registered fingerprints registered using the device. According to the determination, access to the second user interface is not restricted according to the restriction criteria. In full access mode, the display of the second user interface is enabled (for example, using the display enablement unit 2810), and the device is locked. From the completed mode to the unlocked mode where the corresponding set of electronic device features is unlocked (eg, using the migration unit 2814), the first fingerprint is of multiple registered fingerprints. According to the determination that there is not one, the display of the second user interface is maintained in the limited access mode, and the device is maintained in the locked mode (for example, by using the maintenance unit 2816).
In some embodiments, the second user interface is a notification interface associated with multiple notifications, and in limited access mode, the corresponding information contained in one or more notifications is inaccessible and complete. In access mode, the corresponding information is accessible.
In some embodiments, the corresponding information that is inaccessible in the limited access mode includes the organized information, and in the limited access mode, the representation of the corresponding notification is in the first and second parts. Including, the first part is unorganized, the second part is organized, and in full access mode, the corresponding notification representation contains the first and second parts, the first The part and the second part are unorganized.
In some embodiments, the corresponding information that is inaccessible in limited access mode includes information from a predetermined section of the notification interface, in limited access mode the notification interface omits the predetermined section and is in full access mode. Now, the notification interface contains a given section.
In some embodiments, the second user interface is a configuration management interface associated with multiple device configurations, and in limited access mode, the device prevents at least one corresponding configuration from being altered and is complete. In access mode, the corresponding settings change is enabled.
In some embodiments, the second user interface is a camera playback interface for viewing images taken by the device's camera, and in limited access mode the device captures one or more previously captured images. Prevents viewing on the playback interface, and in full access mode, one or more previously captured images are enabled for viewing on the camera playback interface.
In some embodiments, the processing unit 2808 uses a second input (eg, a detection unit 2812) after detecting the first input and while enabling the display of the second user interface. In response to the detection and detection of the second input, the display of the second user interface is stopped (for example, using the stop unit 2818), and the display of the corresponding user interface is displayed in the second user interface. When enabled (eg, using the display enablement unit 2810) instead of, and the device is in unlocked mode, the corresponding user interface is a user interface that has unlimited access to the corresponding set of electronic device features. Yes, when the device is in locked mode, the corresponding user interface is the first user interface with restricted access to the corresponding set of electronic device features.
In some embodiments, the second user interface is the user interface selected according to the first input, with the first input coming from the first end of the device in response to detecting the first input. According to the determination that it starts, the second user interface is the notification interface, and according to the determination that the second input starts from the second end of the device that is different from the first end of the device, the second interface is set. It is a management interface.
In some embodiments, the second user interface is translucent, the second user interface is displayed above the first user interface, and the processing unit 2808 is where the first fingerprint is registered using the device. Under the semi-transparent second user interface, the first user interface in the device's locked mode is the device's unlocked mode, as determined to be one of multiple registered fingerprints. Enables the display of the animation that transitions to the user interface of (eg, using the display enablement unit 2810).
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. It is carried out arbitrarily by operating.
The operations described above with reference to FIGS. 27A-27D are optionally performed by the components shown in FIGS. 1A, 1B, or 28. For example, detection actions 2706 and 2716, display actions 2704, 2708, and 2720, migration action 2722, and maintenance action 2728 are optionally performed by event sorter 170, event recognizer 180, and event handler 190. .. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those of skill in the art how other processes will be carried out based on the components shown in FIGS. 1A-1B.
Unlock an application or device depending on the context
Many electronic devices have a locked mode that prevents access to most applications on the device. While in locked mode, such devices may still allow limited access to certain applications, but most applications on the device will be locked.
In some cases, it may be more efficient to unlock the entire device so that the user can navigate to any application on the device in response to the unlock request. In other cases, in response to an unlock request, unlocking only certain applications operating in limited access mode without unlocking all applications on the device, more of a particular application. It can be more efficient to allow users access to features. Therefore, depending on the context, it may be more efficient to unlock the application rather than unlocking the entire device.
The methods described herein provide a method of unlocking an application or device depending on the context of use, depending on the detection of an authorized fingerprint on the fingerprint sensor.
If an allowed fingerprint is detected while the lock screen for the entire device is displayed, the device goes into unlocked mode, which is accessible to applications on most, if not all, devices. In this unlock mode, the display will display on the home screen with the application icon for launching the application, or the screen that was last displayed by the device in unlocked mode just before the device entered locked mode. It changes arbitrarily.
On the other hand, if a allowed fingerprint is detected while the user interface of a particular application used in limited access mode is displayed, the device will be removed from locked mode and previously locked for that particular application. The function that was was unlocked, but other applications on the device remain locked, transitioning to a single application unlocked mode.
For example, the device may allow limited access to the camera application without user authentication to allow the user to take a picture immediately. Depending on the user's fingerprint authentication, the unlocked camera application may also be able to display photos previously stored by the camera or send photos to other devices.
As another embodiment, the device provides a personal digital assistant (eg, Siri® Personal Digital Assistant from Apple Inc., Cupertino, Calif.) To access private information about a particular user without user authentication. May be allowed to answer questions that do not require. Depending on the user's fingerprint authentication, the personal digital assistant may also be able to answer questions that require access to private information about a particular user.
In some embodiments, the device is an electronic device with a separate display (eg, display 450) and a separate touch-sensitive surface (eg, touch-sensitive surface 451). In some embodiments, the device is a portable multifunction device 100, the display is a touch screen 112, and the touch sensitive surface comprises a tactile output generator 167 on the display (FIG. 1A). The devices described below with reference to FIGS. 29A-29Y and 30A-30D include one or more fingerprint sensors 169. In some embodiments, the one or more fingerprint sensors are integrated with a touch sensitive surface (eg, a separate touch sensitive surface 451 or a touch sensitive display system 112). 4B) is included. In some embodiments, the one or more fingerprint sensors are separate fingerprint sensors 359-2 (FIG. 4B) that are separate from the touch sensitive surface (eg, separate touch sensitive surface 451 or touch sensitive display system 112). )including. Unless otherwise specified, the fingerprint sensor 169 described below may optionally be an integrated fingerprint sensor 359-1 or a separate fingerprint sensor 359-, depending on the hardware and software configuration of the device, including the fingerprint sensor 169. It is 2. For convenience of explanation, embodiments described with reference to FIGS. 29A-29Y and 30A-30D are discussed with reference to a device having a touch screen 112 and a separate touch sensing surface 359-2, but with similar behavior. In response to detecting the input described in FIGS. 29A-29Y on the integrated fingerprint sensor 359-1 while displaying the user interface shown in FIGS. 29A-29Y on the display 450, It is optionally executed on the device by the sensor 359-1. Further, a similar operation is optionally a device having a display 450 and a separate touch sensing surface 451 instead of the touch screen 112, with a fingerprint sensor 169 (eg, integrated fingerprint sensor 359-1 or separate fingerprint sensor 359). -2) Above and / Alternatively, it is executed while the user interface shown in FIGS. 29A to 29Y is displayed on the display 450 in response to detecting the contact shown in FIGS. 29A to 29Y on the separate touch sensing surface 451. In such an embodiment, the contacts shown in FIGS. 29A-29Y are optionally performed on a focus selector corresponding to the position of the display 450 and a separate touch-sensitive surface (eg, touch-sensitive surface 451). Representing both the contact being made or the contact corresponding to the position of the gesture, the focus selector is optionally associated with the corresponding contact, the representative point corresponding to the contact (eg, the center of gravity of the corresponding contact, or the corresponding contact). Point), or the center of gravity of two or more contacts detected on the touch screen 112, optionally replaced with the displayed cursor.
FIG. 29A shows the locked device interface 29000 displayed on the display of the device (eg, on the touch screen 112 of device 100). The locked device interface 29000 tells the user of device 100 that device 100 is in locked mode (ie, device 100 is locked) and thereby to the functionality of multiple applications on device 100. A user interface that indicates that access is blocked. For example, user interface 400 (FIG. 29B) is inaccessible while device 100 is locked. Therefore, the user cannot launch some plurality of applications on the device 100. In some embodiments, the locked device interface 29000 provides user-specific information. For example, the locked device interface 29000 contains the current date and time 29002, as well as instructions or hint 29004 on how to unlock device 100.
The locked device interface 29000 also includes one or more user interface objects for displaying the corresponding user interface or launching a particular application. For example, the locked device interface 29000 includes handles 29006 and 29008, as well as icon 29010. The user makes a gesture starting with handle 29006 (eg, a swipe gesture) to activate the display of the notification interface. The user makes a gesture starting with handle 29008 (eg, a swipe gesture) to activate the display of the configuration management interface. The user makes a gesture (eg, swipe gesture) on the icon 29010 to activate the display of the camera interface.
FIG. 29A shows that the fingerprint 29012 is detected on the fingerprint sensor 169. In response to detecting the fingerprint 29012 on the fingerprint sensor 169, the device 100 determines if the fingerprint 29012 is one of one or more fingerprints registered with the device 100. If fingerprint 29012 is not one of the registered fingerprints, device 100 will remain in locked mode and locked device interface 29000 will remain visible or the passcode entry interface (not shown) will be visible. Will be done.
If fingerprint 29012 is one of the registered fingerprints, device 100 transitions to multi-application unlocked mode, which unlocks the functionality of multiple applications, and the user interface, as shown in Figure 29B. 400 is displayed. With the user interface 400 displayed and the device 100 in multi-application unlocked mode, the user can launch any of the applications on the device 100 with full access. For example, FIG. 29B shows a gesture 29014 (eg, a tap gesture) detected on the "photo" icon 428. In response to detecting gesture 29014, device 100 launches a content presentation application with full access (eg, a photo viewer application) to display the corresponding photo viewer interface 29016, as shown in FIG. 29C. In some embodiments, the photo viewer interface 29016 corresponds to a camera application in addition to or instead of a content presentation application.
The photo viewer interface 29016 displays photos 29018 stored on device 100, including photos previously captured in a past session of the camera application on device 100 and / or photos received by device 100. To. In some embodiments, the photo viewer interface 29016 initiates a process for sharing any of the photos 29018 by message, email, social network upload, or any other suitable method. Includes 29020. The share icon 29020 is enabled because device 100 is in multi-application unlock mode.
While the photo viewer interface 29016 is displayed (ie, the photo viewer application is open), the button press 29022 on the button 204 is detected by the device 100. Button press 29022 includes button down (activation) of button 204 and button up (deactivation) of button 204. Upon detection of the button press 29022, the photo viewer interface 29016 stops displaying (eg, the photo viewer application is closed in the background), the user interface 400 is displayed, and the device 100 is displayed as shown in FIG. 29D. , Remains in multi-application unlocked mode.
FIG. 29E shows a device 100 in locked mode with the locked device interface 29000 displayed on the touch screen 112. Gestures are detected on the touch screen 112. Gestures (eg, swipe gestures) include contact 29024, which is detected on icon 29010 and moves in direction 29526 while being detected on icon 29010. In response to detecting the gesture, the device 100 displays the camera interface 29028 on the touch screen 112 in limited access mode, as shown in FIG. 29F, and the device 100 remains in the locked mode.
Camera interface 29028 is an interface associated with a camera application on device 100 (eg, camera module 143). The camera interface 29028 includes a camera preview 29034, a flash control 29030, a front / back camera toggle 29032, a shutter / capture button 29038, an image effect control 29040, and a camera roll icon 29036. The device 100 stops displaying the camera interface 29028 and displays the camera roll interface 29044 in limited access mode (Fig. 29G) in response to the detection of the gesture 29042 (eg, tap gesture) on the camera roll icon 29036. .. While the camera roll interface 29044 is displayed in limited access mode, photos captured on device 100 in a previous session of the camera application will not be displayed in the camera roll interface 29044. For example, in Figure 29G, instead of displaying a photo on the camera roll interface 29044, a message 29046 is displayed instructing the user to unlock the device in order to view the captured photo. ..
The camera roll interface 29044 also includes the disabled shared icon 29020 and camera icon 29048. In some embodiments, the shared icon 29020 is grayed out or shaded when disabled. In response to detecting a gesture (eg, tap gesture) on the camera icon 29048, device 100 stops displaying camera roll interface 29044 and displays camera interface 29028 that has not been disabled.
In Figure 29G, the fingerprint 29050 is detected on the fingerprint sensor 169. If the device 100 determines that the fingerprint 29050 is one of the registered fingerprints, the device 100 transitions to a single application unlock mode for the application corresponding to the camera roll interface 29044 and of the camera application. Unlock features of camera roll interface 29044, including viewing photos captured on device 100 in previous sessions. Photo 29018 is displayed on the unlocked camera roll interface 29044, as shown in Figure 29H. Also, the shared icon 29020 is enabled in single application unlocked mode, as shown in Figure 29H. If fingerprint 29050 is not one of the registered fingerprints, the functionality of camera roll interface 29044 remains limited.
In some embodiments, transitioning device 100 to a single application unlocked mode for camera roll interface 29044 unlocks the application that device 100 only unlocks the camera application supported by camera roll interface 29044. Includes making other applications on the device 100 unlocked and accessible while leaving those features inaccessible.
In some other embodiments, moving device 100 to single application unlocked mode for camera roll interface 29044 puts device 100 into unlocked mode for multiple applications (ie, camera). Although the role interface 29044 involves unlocking the functionality of multiple applications, including the corresponding camera application, device 100 also transitions back to locked mode as soon as the camera application is closed (ie). , Functions of multiple applications are locked and inaccessible). Thus, in these embodiments, even if a plurality of applications are unlocked, only the camera and camera roll are accessible, resulting in a substantially single application unlocked mode.
Returning to FIG. 29H, the button press 29052 on the button 204 is detected by the device 100 while the function of the camera roll interface 29044 is unlocked. Button press 29052 includes button down (activation) of button 204 and button up (deactivation) of button 204. In response to detecting the button press 29052, the camera roll interface 29044 stops displaying (eg, the camera application or content presentation application is closed), the locked device interface 29000 is displayed, and the device 100 is shown in Figure 29I. Return to locked mode as shown in.
FIG. 29J illustrates another embodiment of transitioning device 100 to single application locked mode for camera roll interface 29044. In Figure 29J, the camera roll interface 29044 is in limited access mode (ie its functionality is limited), device 100 is in locked mode, and photo 29054 captured in the current session of the camera application is in camera roll. Displayed on interface 29044. In Figure 29J, no other photos stored on device 100 are shown, other than the photo 29054 captured in the current session of the camera application. Also, the shared icon 29020 is disabled, and gestures on the shared icon 29020 (eg, tap gesture 29055) have no effect.
Fingerprint 29056 (Fig. 29J) is detected on the fingerprint sensor 169. If device 100 determines that fingerprint 29056 is one of the registered fingerprints, device 100 goes into single application unlocked mode and activates the shared icon 29020, including camera roll. Unlock the functionality of interface 29044. As shown in Figures 29K to 29L, the device 100 is one that appears on the camera roll interface 29044 (eg Photo 29054) in response to detecting a gesture (eg, tap gesture) 29058 on the shared icon 29020. Start the process for sharing the above photos. (For simplicity, in this example, it is assumed that the captured photos 29054-1 to 29054-4 are all the photos stored on the device.) The sharing process is, for example, shared by the user. Show the photo selection interface 29060 (Figure 29L) to select the photos you want to play, and show the interface to let the user choose a sharing method (eg email, message, social network, microblog) (not shown). include. If fingerprint 29056 is not one of the registered fingerprints, the functionality of camera roll interface 29044 remains limited.
Before the sharing process is complete, the user can close the corresponding content presentation application or camera application, and thereby cancel the sharing process. For example, in FIG. 29L, the button press 29066 on the button 204 is detected by the device 100 while the photo selection interface 29060 is displayed. Button press 29066 includes button down (activation) of button 204 and button up (deactivation) of button 204. In response to detecting button press 29066, the photo selection interface 29060 stops displaying (eg, the camera application or content presentation application is closed), the locked device interface 29000 is displayed, and the device 100 is shown in Figure 29M. As shown, it is in locked mode.
FIG. 29N shows the passcode input interface 29068 displayed on the touch screen 112 while the device 100 is in locked mode. In some embodiments, the passcode input interface 29068 is displayed, for example, in response to detecting a horizontal swipe gesture near the unlock instruction 29004 while the locked device interface 29000 is displayed. The passcode input interface 29068 includes a passcode field 29070 and a keypad 29072. The keypad 29072 includes an "emergency call" key 29073. In response to detecting a gesture (eg, tap gesture, virtual key press gesture) 29074 on the "emergency call" key 29073, device 100 displays the emergency call interface 29076 and device 100, as shown in Figure 29O. Remains in locked mode.
The emergency telephone interface 29076 is an interface corresponding to the telephone application on the device 100. The user is designated by the emergency telephone interface 29076 as a known public emergency telephone number, such as 911, 999, or an "emergency" ("ICE") contact on device 100. You can make a call to a contact you have, but you cannot make a non-emergency call (for example, a call to a non-emergency phone number). Also, other features of the phone application (eg contacts, phone history, answering machines, favorite contacts or speed dials) are not accessible from the emergency interface 29076. The emergency call interface 29076 includes, for example, a telephone number field 29078, a keypad 29080, a cancel icon 29082, and a call icon 29084.
Fingerprint 29086 is detected on fingerprint sensor 169 while emergency call interface 29076 is displayed. As shown in FIGS. 29O-29P, fingerprint 29086 includes fingerprint down 29086-a and fingerprint lift off 29086-b. If device 100 determines that fingerprint 29086 is one of the registered fingerprints, device 100 transitions to single application unlock mode for phone applications in response to detecting fingerprint liftoff 29086-b. , Unlock the features of the phone application. As a result of unlocking the functionality of the phone application, the emergency phone interface 29076 is no longer displayed and instead, as shown in Figure 29Q, a fully accessible phone application interface (eg, a keypad interface with the phone icon 29096). 29088) is displayed. If fingerprint 29086 is not one of the registered fingerprints, the functionality of the phone application remains locked and the emergency call interface 29076 remains visible.
Figure 29Q shows the device 100 displaying the keypad interface 29088 after the functionality of the telephone application is unlocked. The keypad interface 29088 includes, for example, a telephone number field 29078, a keypad 29090, and an icon 29096 for accessing the functionality of a telephone application. The keypad 29090 includes a conference telephone key 29092 that was not present on the keypad 29080 on the emergency telephone interface 29076. Icon 29096 includes, for example, favorite icon 29096-1, phone history icon 29096-2, contact icon 29096-3, keypad icon 29096-4, and answering machine icon 29096-5. In response to detecting a gesture (tap gesture) 29098 on the contact icon 29096-3, device 100 stops displaying keypad interface 29088 and displays contact interface 29100 as shown in Figure 29R. The contact interface 29100 is now accessible because the functions of the communication interface have been unlocked. The contact interface 29100 includes, for example, a list of contacts 29102 that the user can view and edit.
Following FIG. 29R, button press 29104 on button 204 is detected by device 100 while contact interface 29100 is displayed. Button press 29104 includes button down (activation) of button 204 and button up (deactivation) of button 204. In response to detecting the button press 29104, the contact interface 29100 stops displaying (ie, the phone application is closed), the locked device interface 29000 is displayed, and the device 100 displays the device 100, as shown in Figure 29S. You are in locked mode.
FIG. 29T shows the device 100 in locked mode with the locked device interface 29000 displayed on the touch screen 112. The button press 29106 is detected on the button 204 and the fingerprint corresponding to the button press 29106 is detected on the fingerprint sensor 169 integrated with the button 204. Button presses include button down 29106-a and button up 29106-b (Fig. 29V). During button down 29106-a, the fingerprint sensor 169 detects the fingerprint corresponding to the button press 29106 and determines if the fingerprint is one of the registered fingerprints. Also, as the button down 29106-a continues for more than a given time (eg, 2 seconds) in a row, the personal assistant interface 29108 appears in limited access mode, as shown in FIG. 29U. Some features of the corresponding personal assistant application are locked.
The personal assistant interface 29108 supports personal assistant applications. The personal assistant application is voice controlled and can perform various actions in response to voice commands from the user. For example, a personal assistant application can perform web searches, display news, weather, and sports scores, read emails and messages, notify users of incomplete appointments or events, and emails and messages according to the user's dictation. Can be created. The personal assistant interface 29108 optionally includes a prompt 29109 prompting the user to speak a command or request.
Button-up 29106-b is detected after the personal assistant interface 29108 is displayed. If, in response to detecting button-up 29106-b, the fingerprint corresponding to button press 29106 is determined by device 100 to be one of the registered fingerprints, device 100 is a single application for the personal assistant application. When the device enters unlocked mode, the functions of the Personal Assistant application are unlocked, and the device 100 determines that the fingerprint corresponding to the button press 29106 is not one of the registered fingerprints, the Personal Assistant. Some features of the application remain locked.
While the personal assistant interface 29108 is displayed, and after button-up 29106-b, the personal assistant application stands by to receive a command or request from the user, and as shown in Figure 29V, the user issues the command or request. Talk to device 100. The command / request 29110 from the user and the response 29112 from the personal assistant application are displayed on the personal assistant interface 29108 for the user to view.
If some features of the Personal Assistant application remain locked in response to a button-up 29106-b, a command or request with personal or private information (eg, play answering machine, compose a message, make a call) ) Is not done by personal assistant applications (because the functionality of these personal assistant applications is locked). For example, in Figure 29W, in response to command 29110-1 "Play answering machine", response 29112-1 from the personal assistant application becomes "I'm sorry, I can't". In some embodiments, if the command or request is not accompanied by personal or private information (eg, the command is to display a sports score), the personal assistant interface responds to the command or request.
If a feature of the Personal Assistant application is unlocked in response to a button-up 29106-b, the Personal Assistant application may have a command or request with personal or private information in addition to a command or request without personal or private information. For example, play an answering machine, compose a message, make a call). For example, in Figure 29X, in response to command 29110-2 "Play answering machine", the response 29112-2 from the personal assistant application becomes "There are two answering machines. Play ..." and the device. Answering machine is played by 100.
The personal assistant application can be closed by pressing button 204. For example, in response to detecting button press 29114 (Fig. 29W) or button press 29116 (Fig. 29X), the personal assistant interface 29108 stops displaying and the locked device interface 29000 is displayed, as shown in Figure 29Y. The interface. In both Figure 29W and Figure 29X, Device 100 is not fully locked (in Figure 29W, the functionality of multiple applications is still locked, in Figure 29X, Device 100 is a single application for a personal assistant application. (In unlock mode), which displays the lock screen interface 29000.
30A-30D are flow diagrams illustrating a context-dependent method 3000 for unlocking an application or device, according to some embodiments. Method 3000 is performed on an electronic device having a display and a touch sensitive surface (eg, device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the display is a touch screen display and the touch sensitive surface is on the display. In some embodiments, the display is separate from the touch sensitive surface. Some of the actions of Method 3000 are optionally combined and / or the order of some of the actions is optionally changed.
As described below, Method 3000 provides an intuitive way to unlock an application or device in a context-dependent manner. This method reduces the user's cognitive burden in unlocking, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, allowing the user to unlock more efficiently saves power and increases the interval between charging the battery.
The device displays the first user interface on the display (3004) while the electronic device is in locked mode (3002), which prevents access to the features of several different applications on the electronic device. The first user interface is one of a locked device user interface for electronic devices and a limited access user interface for the corresponding application in a plurality of different applications. In some embodiments, the functionality of the application on the electronic device includes the functionality of the first application and the functionality of the second application. In some embodiments, the functionality of the corresponding application is the ability to access and interact with the content associated with the application (eg, a contact in the address book application, viewing photos in the camera roll of the camera application). Ability to view messages, view messages within a messaging application), instruct the application to perform application-specific actions on the device (eg, take a picture with a camera application, web browser or App Includes one or more of (downloading content in the Store application, playing media in the Media Player application, sending and receiving messages in the Messages application). For example, device 100 displays locked device interface 29000 (FIG. 29A). Alternatively, the device displays a limited access user interface for an application such as camera roll interface 29044 (Fig. 29G or Fig. 29J), emergency telephone interface 29076 (Fig. 29O-Fig. 29P), or personal assistant interface 29108 (Fig. 29U). .. While these interfaces are displayed, the inputs that initiate the device unlock function (Fingerprint 29012 in Figure 29A, Fingerprint 29050 in Figure 29G, Fingerprint 29056 in Figure 29J, Fingerprint 29086 in Figures 29O-29P, Figure 29U, respectively). The fingerprint corresponding to the button press 29106) is detected using the fingerprint 169.
The device uses the fingerprint sensor to initiate the unlocking of one or more functions of the device (and meet the unlocking criteria) for the first input (eg, fingerprint 29012 in FIG. 29A, respectively). Detects the fingerprint 29050 of 29G, the fingerprint 29056 of FIG. 29J, the fingerprint 29086 of FIGS. 29O-29P, or the fingerprint corresponding to the button press 29106 of FIG. 29U (3006). For example, the first input includes a fingerprint that matches a pre-registered fingerprint pre-registered with the device. In some embodiments, when the device detects an input that contains a fingerprint that does not match a pre-registered registered fingerprint with the device, the device keeps the input (eg, keeping the device in locked operating mode). Ignore and / or display an alternative way to allow the device to be unlocked, such as a passcode input user interface.
The fingerprint sensor was used to detect a first input (3008) that corresponds to a request to initiate unlocking of one or more functions of the device, and the first user interface is locked for the electronic device. Upon determining that it is a device user interface, the device transitions the device from locked mode to multi-application unlocked mode in which the functionality of several different applications is unlocked (3010). For example, in FIGS. 29A-29B, when the displayed interface is the locked device interface 29000, the device 100 shifts to the multi-application unlocked mode in response to detecting the fingerprint 29012, which is a registered fingerprint. Then the user interface 400 is displayed and the device 100 is completely unlocked.
However, in response to the fingerprint sensor being used to detect a first input that corresponds to a request to initiate unlocking of one or more functions of the device (3008), for the application to which the first user interface corresponds. According to the determination that it is a limited access user interface, the device unlocks the device from locked mode to one or more previously locked features of the corresponding application in single application unlocked mode. Migrated to (3012), one or more previously locked features of other applications in multiple different applications (eg, other applications other than the corresponding application that are locked when the device is in locked mode). Continue to prevent access to (features).
For example, in Figure 29G, device 100 displays camera roll interface 29044 in limited access mode and unlocks the functionality of camera roll interface 29044 in response to detecting fingerprint 29050, which is a registered fingerprint. However, access to the functions of other applications is prevented (Fig. 29H).
As another embodiment, in FIG. 29J, device 100 displays camera roll interface 29044 in limited access mode and locks the function of camera roll interface 29044 in response to detecting fingerprint 29056, which is a registered fingerprint. Is released, but access to the functions of other applications is prevented (Fig. 29K).
As another embodiment, in FIGS. 29O-29P, the device 100 displays the emergency telephone interface 29076 of the telephone application in limited access mode and detects the fingerprint 29050, which is a registered fingerprint, in response to the telephone application. Features are unlocked (for example, the keypad interface 29088 in Figure 29Q is displayed), but access to other application features is prevented.
As another embodiment, in FIG. 29U, device 100 displays the personal assistant interface 29108 of the personal assistant application in limited access mode and responds to the button press 29106 in response to detecting a fingerprint, which is a registered fingerprint. The functionality of the Personal Assistant application is then unlocked (for example, access to private information is unlocked so that command 29110-2 with personal or private information in Figure 29X is executed). However, access to the functions of other applications is prevented.
In some embodiments, moving the device from locked mode to single application unlocked mode and continuing to prevent other applications from accessing previously locked features is one of the corresponding applications. Unlock all previously locked features in multiple different applications without unlocking one or more previously locked features in other applications (unlocking all features in different applications) Including releasing (without) (3014). For example, only the functionality of the corresponding application is unlocked, while the functionality of other applications in multiple different applications is not unlocked. In FIGS. 29G-29H or 29J-29K, for example, the functionality of the content presentation application or camera application is unlocked, but other applications on device 100 are still locked. In FIGS. 29O-29Q, the functionality of the telephone application is unlocked, but the functionality of the other applications on device 100 remains locked. In FIGS. 29T-29V and 29X, the functions of the personal assistant application are unlocked, but the functions of other applications on the device 100 remain locked.
In some embodiments, moving a device from locked mode to single application unlocked mode and preventing access to previously locked features of other applications can be done by moving the device from locked mode. Goes into unlocked mode where access to the features of different applications is unlocked, and the device goes from unlocked mode to locked mode upon detecting a request to close its corresponding application. Includes configuring to (for example, when the device is in single application unlocked mode, the entire device is in unlocked mode, but the user requests to exit the corresponding application / hour. , The device transitions back to locked mode and is restricted to the user performing unlocking actions within the corresponding application) (3016). Thus, in FIGS. 29G-29H or 29J-29K, instead, device 100 is unlocked in response to fingerprints 29050 and 29056, respectively, and device 100 is when the content presentation application or camera application is closed. It will be locked again. In FIGS. 29O-29Q, instead, device 100 is unlocked in response to fingerprint 29086, and device 100 is relocked when the phone application is closed. In FIGS. 29T-29V and 29X, instead, the device 100 is unlocked in response to the fingerprint corresponding to the button press 29106, and the device 100 is relocked when the personal assistant application is closed.
In some embodiments, after detecting the first input, the device detects the second input, including a request to close the corresponding application, while displaying the user interface for the corresponding application (3018). In response to detecting a second input (3020), when the device is in single application unlock mode, the device returns the device to locked operating mode (3022) and the device goes into multi-application unlock mode. At one point, the device closes the corresponding application (3024) and keeps the device in unlocked operating mode. For example, while the photo viewer interface 29016 is displayed in multi-application unlock mode, the corresponding content presentation application is closed and device 100 remains unlocked in response to detecting button press 29022 (). Figures 29C to 29D). On the other hand, while the camera roll interface 29044 is displayed in single application unlock mode, the corresponding content presentation application or camera application is closed and the device 100 is locked in response to detecting the button press 29052. Return to completed mode (Fig. 29H ~ Fig. 29I). As another embodiment, while the photo selection interface 29060 is displayed in single application unlock mode, the corresponding content presentation application or camera application is closed and the device 100 responds to the detection of the button press 29066. Return to locked mode (Fig. 29L-Fig. 29M). As another embodiment, while the contact interface 29100 is displayed in single application unlock mode, the corresponding phone application is closed and the device 100 is in locked mode in response to detecting button press 29104. Return to (Fig. 29R ~ Fig. 29S). As another example, the personal assistant interface 29108 is a single application lock solution.
In some embodiments, detecting the first input involves detecting a fingerprint lift-off from the fingerprint sensor, and the response to the first input depends on detecting the fingerprint lift-off from the fingerprint sensor. Is executed (3026). For example, in FIGS. 29O-29Q, the transition to the single application unlock mode corresponding to the telephone application is performed in response to the fingerprint lift-off 29086-b.
In some embodiments, the fingerprint sensor is integrated with the button (3028), detecting the first input is detecting the activation of the button (eg, detecting the button down signal), the fingerprint sensor. First input, including detecting the fingerprint on and detecting the deactivation of the button (eg, detecting the button-up signal) (eg, while continuing to detect the fingerprint on the fingerprint sensor). The reaction to is performed in response to the detection of button deactivation (eg, the reaction to the first input is performed in response to the detection of a button-up signal). For example, FIGS. 29T-29V show the fingerprint sensor 169 integrated into the button 204. In FIGS. 29T-29V, the inputs include button press 29106-a to activate button 204, fingerprint detection corresponding to button press 29106, and button up 29106-b to deactivate the button. Is. The transition to (or not) single application unlock mode is performed in response to the detection of button-up 29106-b.
In some embodiments, the corresponding application is opened in response to detecting button activation (3030) (eg, the device detects a button down event or detects a button down event). After that, open the Personal Digital Assistant application depending on whether you continue to detect button downs longer than a given time threshold, such as 0.2, 0.5, 1, 2 seconds, or any other significant time threshold). For example, device 100 opens a personal assistant application (eg, displays personal assistant interface 29108) in response to detecting button down 29106-a for at least a given time (FIGS. 29T-29U).
In some embodiments, along with detecting button activation (eg, immediately before, during, and / or immediately after detecting button activation), the device is a finger fingerprint on a fingerprint sensor. Obtains fingerprint information about (3032) and determines if the fingerprint information matches a pre-registered pre-registered fingerprint using the device. For example, in FIG. 29T, during button down 29106-a, device 100 acquires information about the fingerprint corresponding to button press 29106 and determines if the fingerprint is a registered fingerprint.
In some embodiments, the corresponding application is a personal assistant application (eg, a voice controlled personal assistant application launched with a long press of a button that integrates a fingerprint sensor) (3034), a single application unlocked mode. One or more previously locked features of the corresponding application that is unlocked in include features that the personal assistant application needs to access data about a particular user stored on the device (eg,). While the device is in locked mode, the personal assistant application can perform certain functions, such as performing a web search or providing instructions that do not require access to private information about a particular user, but message. Accessing calendar information that requires reading, access to an address book, and / or access to private information about a particular user is prevented / disabled). For example, in FIGS. 29T to 29X, the application is a personal assistant application, and the function of unlocking according to the determination that the fingerprint corresponding to the button press 29106 is a registered fingerprint is provided by the personal assistant application. Being able to access personal or private information (and thereby perform requests and commands such as playing an answering machine).
In some embodiments, the corresponding application is a camera application (3036), and one or more previously locked features of the corresponding application that are unlocked in single application unlock mode are devices. Includes the ability to enable the device to display images previously captured by the device's camera (eg, photos in the device's camera "photoroll"). For example, in FIGS. 29G-29H, the application is a camera application, and the feature unlocked in response to determining that the fingerprint 29050 is a registered fingerprint is a previously captured or stored photo. 29018 is to be displayed on the camera roll interface 29044.
In some embodiments, the corresponding application is a content presentation application (eg, a camera application with media viewer functionality, such as a photo roll that displays a photo previously captured by the camera) (3038), a single application. One or more previously locked features that are unlocked in unlocked mode, share the content associated with the content presentation application (for example, a photo in the camera's "photo roll", Includes the ability to enable sharing) via email, MMS messages, or messages on social networking services. For example, in FIGS. 29J-29K, the application is a content presentation application (or camera application), and the function of unlocking according to the determination that the fingerprint 29056 is a registered fingerprint is shared in the camera roll interface 29044. The icon 29020 is to be activated.
In some embodiments, the corresponding application is a communication application (eg, a telephone application) (3040) and is unlocked in single application unlock mode, one or more previously locked of the corresponding application. Features include the ability to enable a user of the device to communicate with any contact identified by the user (eg, dial a non-emergency phone number). For example, in FIGS. 29O-29Q, the application is a telephone application, and the function that unlocks according to the determination that the fingerprint 29086 is a registered fingerprint allows the user to call any telephone number. The keypad interface 29088 will be accessible.
In some embodiments, the corresponding application is a communication application (telephone application) (3042), which is unlocked in single application unlocked mode, one or more previously locked of the corresponding application. Features include the ability to enable the device to access a user-specific directory of communication information (for example, access to the user's phone book is disabled while the device is locked). For example, in FIGS. 29O-29R, the application is a telephone application, and the function that unlocks according to the determination that the fingerprint 29086 is a registered fingerprint is accessible to the contact interface 29100. be.
The specific order described for the actions in FIGS. 30A-30D is merely exemplary and is not intended to indicate that the order in which the actions can be performed is the only order in which the actions can be performed. I want you to understand. Those of skill in the art will be aware of the various methods of reordering the operations described herein. In addition, details of other processes described herein with respect to the other methods described herein (eg, the processes listed in paragraph number [0080]) are also described in FIGS. 30A. Note that a method similar to Method 3000 described above in relation to 30D is also applicable. For example, the fingerprints, contacts, and user interface objects described above with reference to Method 3000 may optionally refer to other methods described herein (eg, those listed in paragraph [0080]). It has one or more of the characteristics of the fingerprints, contacts, and user interface objects described herein. For the sake of brevity, these details are not repeated here.
According to some embodiments, FIG. 31 shows a functional block diagram of the electronic device 3100 configured according to the ideas of the various embodiments described. Functional blocks of the device are optionally performed by hardware, software, or a combination of hardware and software in order to carry out the ideas of the various embodiments described. It will be appreciated by those skilled in the art that the functional blocks described in FIG. 31 are optionally combined or separated into sub-blocks in order to implement the ideas of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation, or any further definition of a functional block described herein.
As shown in FIG. 31, the electronic device 3100 includes a display unit 3102 configured to display a first user interface, and optionally a touch sensing surface unit 3104 configured to receive contact. It includes a fingerprint sensor unit 3106, a display unit 3102, an optional touch sensing surface unit 3104, and a processing unit 3108 connected to the fingerprint sensor unit 3106. In some embodiments, the processing unit 3108 includes a display enablement unit 3110, a detection unit 3112, a transition unit 3114, an access prevention unit 3116, a return unit 3118, an termination unit 3120, and an acquisition unit 3122. Includes determination unit 3124.
The processing unit 3108 is on the display unit 3102 while the electronic device is in a locked mode in which access to the functions of multiple various applications on the electronic device is prevented. Enable display (eg, using the display enablement unit 3110) of one first user interface and the limited access user interface of the corresponding application in multiple different applications, and use the fingerprint sensor to device. It is configured to detect a first input (eg, using the detection unit 3112) that corresponds to a request to initiate unlocking of one or more of the functions of. The processing unit 3108 uses a fingerprint sensor to detect a first input that corresponds to a request to initiate unlocking of one or more functions of the device, and the first user interface is the lock device user of the electronic device. To move the device from locked mode to multi-application unlocked mode (eg, using migration unit 3114) where the features of several different applications are unlocked, as determined to be an interface. , Further configured. Processing unit 3108 also locks the device from locked mode to one or more previous of the corresponding application, as determined that the first user interface is the limited access user interface for the corresponding application. Migrate to a single application unlocked mode with unlocked features (eg, using migration unit 3114) to access one or more previously locked features of other applications in multiple different applications. Is configured to continue to be prevented (eg, using the access prevention unit 3116).
In some embodiments, moving the device from locked mode to single application unlock mode and continuing to prevent other applications from accessing previously locked features is one or more of the corresponding applications. Includes unlocking a previously locked feature of one or more previously locked features of another application in multiple different applications without unlocking.
In some embodiments, moving the device from locked mode to single application unlocked mode and preventing access to previously locked features of other applications can be done by moving the device from locked mode. To move to unlock mode, which unlocks access to the features of multiple different applications, and to move the device from unlocked mode to locked mode after detecting a request to close the corresponding application. Consists of and includes.
In some embodiments, the processing unit 3108 receives a second input (after detecting the first input) that includes a request to close the corresponding application while enabling the display of the corresponding application's user interface. When the device is in single application unlock mode, the device is put into the locked operating mode (eg, the return unit 3118) in response to the detection (using the detection unit 3112) and the detection of the second input. Reverted (using), and when the device is in multi-application unlock mode, it is configured to close the corresponding application (eg, with the exit unit 3120) and keep the device in unlocked operating mode. ..
In some embodiments, detecting the first input involves detecting the fingerprint lift-off from the fingerprint sensor, even though the response to the first input detects the fingerprint lift-off from the fingerprint sensor. It will be executed accordingly.
In some embodiments, the fingerprint sensor is integrated with the button to detect the first input, to detect the activation of the button, to detect the fingerprint on the fingerprint sensor, and to detect the button inactivity. The reaction to the first input, including detecting the activation, is performed in response to the detection of the button deactivation.
In some embodiments, the corresponding application is opened in response to detecting button activation.
In some embodiments, the processor 3108 acquires fingerprint information about a finger fingerprint on a fingerprint sensor (eg, using acquisition unit 3122) in conjunction with detecting button activation. It is configured to determine if the fingerprint information matches a pre-registered registered fingerprint using the device (eg, using the determination unit 3124).
In some embodiments, the corresponding application is a personal assistant application, and one or more previously locked features that are unlocked in a single application unlock mode are the personal assistant application on the device. Includes features that require access to data about a particular user stored in.
In some embodiments, the corresponding application is a camera application, and one or more previously locked features of the corresponding application that are unlocked in single application unlock mode are on the device, on the device. Includes the ability to enable viewing of previously captured images by the camera.
In some embodiments, the corresponding application is a content presentation application, and one or more previously locked features of the corresponding application unlocked in single application unlocked mode are content on the device. Includes the ability to enable sharing of content associated with the presentation application.
In some embodiments, the corresponding application is a communication application, and one or more previously locked features of the corresponding application that are unlocked in single application unlocked mode are to the user of the device. Includes the ability to enable communication with any contact identified by the user.
In some embodiments, the corresponding application is a communication application, and one or more previously locked features of the corresponding application that are unlocked in single application unlocked mode are user-specific communication. Includes the ability to enable devices to access the information directory.
The operation in the above information processing method is one or more functional modules in the information processing device, such as a general purpose processor (eg, as described above in connection with FIGS. 1A and 3) or a special purpose chip. It is carried out arbitrarily by operating.
The operations described above with reference to FIGS. 30A-30D are optionally performed by the components shown in FIGS. 1A, 1B, or 31. For example, the display operation 3004, the detection operation 3006, the migration operation 3010, and the migration and access prevention operation operation 3012 are optionally executed by the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 of the event sorter 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to the application 136-1. Each event recognizer 180 of application 136-1 compares the event information with each event definition 186, and the first contact of the first position on the touch sensitive surface is the selection of an object on the user interface, etc. Determine if it corresponds to a default event or subevent. When each default event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 arbitrarily uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those of skill in the art how other processes will be carried out based on the components shown in FIGS. 1A-1B.
The above description is described with reference to specific embodiments for purposes of explanation. However, the above exemplary description is not intended to be exhaustive or to limit the invention to the disclosed, identical form. Many modifications and modifications are possible given the above teachings. The principles of the invention and their practical applications are best described, thereby best of the invention and various embodiments with various modifications suitable for those skilled in the art and for the particular application conceived. These embodiments have been selected and described to allow them to be used in the form.
As mentioned above, one aspect of the Techniques collects and uses data available from various sources to improve the delivery of invitation-only content or any other content that may be of interest to users. Is to let. The disclosure may, in some cases, include personal information data in which this collected data can be used to uniquely identify, contact or locate a particular person. Such personal information data can include artificial statistical data, location-based data, telephone numbers, email addresses, home addresses, or any other identification information.
The present disclosure recognizes that the use of such personal information data in this technique may be used for the benefit of the user. For example, personal information data can be used to deliver targeted content that is of greater interest to the user. Therefore, the use of such personal information data allows for calculated control of the transmitted content. In addition, other uses for personal information data that benefit users are also conceived from this disclosure.
This disclosure further envisions that the entity responsible for the collection, analysis, disclosure, transfer, storage, or other uses of such personal information data comply with established privacy policies and / or privacy practices. .. In particular, such entities should implement and always use privacy policies and practices that are generally recognized to meet or exceed the industrial or administrative requirements for keeping personal information data private and secure. Is. For example, personal information from users should be collected for the legitimate and legitimate use of that entity and should not be shared or sold except for their legitimate use. Furthermore, such collections should only be performed after notifying and consenting to the user. Furthermore, such entities protect and secure access to such personal information data and ensure that others with access to that personal information data comply with their privacy policies and procedures. All necessary steps should be taken to do so. Moreover, such entities may be subject to third party evaluation to prove their compliance with widely accepted privacy policies and practices.
Despite the above, the disclosure also envisions embodiments that selectively prevent users from using personal information data or accessing private data. That is, it is conceivable that the present disclosure may provide hardware and / or software elements to prevent or prevent access to such personal information data. For example, in the case of an ad delivery service, the technique is configured to allow the user to select "opt in" or "opt out" to participate in the collection of personal information data while registering for the service. Can be done. In another embodiment, the user may choose not to provide location information for the targeted content delivery service. In yet another embodiment, the user may choose not to provide accurate location information, but to allow the transfer of location zone information.
Therefore, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure covers those various embodiments. It is also conceivable that it is possible to carry out such personal information data without the need to access it. That is, various embodiments of this technique are not impractical due to the lack of all or part of such personal information data. For example, the content may be requested by the user, the content may be requested by the device associated with the user, other non-personal information may be available to the content delivery service, or may be publicly available. It can be selected by inferring preferences based on personal information data or a minimal amount of personal information.
217 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117 Sheet 118 Sheet 119 Sheet 120 Sheet 121 Sheet 122 Sheet 123 Sheet 124 Sheet 125 Sheet 126 Sheet 127 Sheet 128 Sheet 129 Sheet 130 Sheet 131 Sheet 132 Sheet 133 Sheet 134 Sheet 135 Sheet 136 Sheet 137 Sheet 138 Sheet 139 Sheet 140 Sheet 141 Sheet 142 Sheet 143 Sheet 144 Sheet 145 Sheet 146 Sheet 147 Sheet 148 Sheet 149 Sheet 150 Sheet 151 Sheet 152 Sheet 153 Sheet 154 Sheet 155 Sheet 156 Sheet 157 Sheet 158 Sheet 159 Sheet 160 Sheet 161 Sheet 162 Sheet 163 Sheet 164 Sheet 165 Sheet 166 Sheet 167 Sheet 168 Sheet 169 Sheet 170 Sheet 171 Sheet 172 Sheet 173 Sheet 174 Sheet 175 Sheet 176 Sheet 177 Sheet 178 Sheet 179 Sheet 180 Sheet 181 Sheet 182 Sheet 183 Sheet 184 Sheet 185 Sheet 186 Sheet 187 Sheet 188 Sheet 189 Sheet 190 Sheet 191 Sheet 192 Sheet 193 Sheet 194 Sheet 195 Sheet 196 Sheet 197 Sheet 198 Sheet 199 Sheet 200 Sheet 201 Sheet 202 Sheet 203 Sheet 204 Sheet 205 Sheet 206 Sheet 207 Sheet 208 Sheet 209 Sheet 210 Sheet 211 Sheet 212 Sheet 213 Sheet 214 Sheet 215 Sheet 216 Sheet 217
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| WO2012129231A1 | Cites | World Intellectual Property Organization (WIPO) |
| US20030141959A1 | Cites | United States of America |
| KR1020090011323A | Cites | Republic of Korea |
| WO2005048832A1 | Cites | World Intellectual Property Organization (WIPO) |
| JP2010165012A | Cites | Japan |
| JP2006203858A | Cites | Japan |
116 members in 11 offices
Members116
| Document | Office | Kind | |
|---|---|---|---|
| US2015074615A1 | United States of America | A1 | |
| WO2015057320A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2015146945A1 | United States of America | A1 | |
| TW201528120A | Taiwan Province of China | A | |
| WO2015057320A9 | World Intellectual Property Organization (WIPO) | A9 | |
| TW201610826A | Taiwan Province of China | A | |
| AU2014334869A1 | Australia | A1 | |
| AU2016201310A1 | Australia | A1 | |
| TWI526918B | Taiwan Province of China | B | |
| KR20160048215A | Republic of Korea | A | |
| KR20160054573A | Republic of Korea | A | |
| CN105659522A | China | A | |
| EP3044903A1 | European Patent Office (EPO) | A1 | |
| DE112014004134T5 | Germany | T5 | |
| EP3044903A4 | European Patent Office (EPO) | A4 | |
| CN106095247A | China | A | |
| EP3101868A1 | European Patent Office (EPO) | A1 | |
| JP2016224960A | Japan | A | |
| JP2017500656A | Japan | A | |
| HK1224107A | Hong Kong, China | A | |
| HK1224107A1 | Hong Kong, China | A1 | |
| AU2014334869B2 | Australia | B2 | |
| TWI614667B | Taiwan Province of China | B | |
| US9898642B2 | United States of America | B2 | |
| AU2016201310B2 | Australia | B2 | |
| TW201810011A | Taiwan Province of China | A | |
| AU2018202712A1 | Australia | A1 | |
| US2018144178A1 | United States of America | A1 | |
| US2018173928A1 | United States of America | A1 | |
| US2018173929A1 | United States of America | A1 | |
| US2018173930A1 | United States of America | A1 | |
| JP6356249B2 | Japan | B2 | |
| KR101888609B1 | Republic of Korea | B1 | |
| KR20180091970A | Republic of Korea | A | |
| US10055634B2 | United States of America | B2 | |
| TWI634475B | Taiwan Province of China | B | |
| TW201833753A | Taiwan Province of China | A | |
| EP3044903B1 | European Patent Office (EPO) | B1 | |
| KR101918672B1 | Republic of Korea | B1 | |
| KR20180123596A | Republic of Korea | A | |
| JP2018195316A | Japan | A | |
| CN109101155A | China | A | |
| CN109117044A | China | A | |
| TWI646459B | Taiwan Province of China | B | |
| EP3422231A1 | European Patent Office (EPO) | A1 | |
| JP6457978B2 | Japan | B2 | |
| TW201909029A | Taiwan Province of China | A | |
| ES2705581T3 | Spain | T3 | |
| US10262182B2 | United States of America | B2 | |
| KR101973923B1 | Republic of Korea | B1 | |
| KR101984148B1 | Republic of Korea | B1 | |
| KR20190060883A | Republic of Korea | A | |
| AU2016201310C1 | Australia | C1 | |
| US2019220647A1 | United States of America | A1 | |
| US10372963B2 | United States of America | B2 | |
| CN105659522B | China | B | |
| US10410035B2 | United States of America | B2 | |
| TWI679587B | Taiwan Province of China | B | |
| AU2019268070A1 | Australia | A1 | |
| CN110580121A | China | A | |
| CN110633034A | China | A | |
| KR102104652B1 | Republic of Korea | B1 | |
| KR20200044991A | Republic of Korea | A | |
| US2020234027A1 | United States of America | A1 | |
| US10803281B2 | United States of America | B2 | |
| EP3422231B1 | European Patent Office (EPO) | B1 | |
| CN110633034B | China | B | |
| EP3770782A1 | European Patent Office (EPO) | A1 | |
| KR102245091B1 | Republic of Korea | B1 | |
| KR20210046862A | Republic of Korea | A | |
| JP2021099817A | Japan | A | |
| CN109101155B | China | B | |
| CN109117044B | China | B | |
| JP6955642B2 | Japan | B2 | |
| CN113741751A | China | A | |
| JP6991932B2 | Japan | B2 | |
| JP6999855B1 | Japan | B1 | |
| EP3770782B1 | European Patent Office (EPO) | B1 | |
| JP2022025070A | Japan | A | |
| AU2022200617A1 | Australia | A1 | |
| JP2022046615A | Japan | A | |
| US11287942B2 | United States of America | B2 | |
| KR102393920B1 | Republic of Korea | B1 | |
| JP7064049B2This record | Japan | B2 | |
| KR20220062424A | Republic of Korea | A | |
| EP3998744A1 | European Patent Office (EPO) | A1 | |
| AU2022200617B2 | Australia | B2 | |
| JP2022115877A | Japan | A | |
| AU2022209019A1 | Australia | A1 | |
| JP7137728B2 | Japan | B2 | |
| US11494046B2 | United States of America | B2 | |
| JP2022188025A | Japan | A | |
| US2023021247A1 | United States of America | A1 | |
| AU2019268070B2 | Australia | B2 | |
| US11768575B2 | United States of America | B2 | |
| KR20230141944A | Republic of Korea | A | |
| AU2022209019B2 | Australia | B2 | |
| KR102612723B1 | Republic of Korea | B1 | |
| US2023409160A1 | United States of America | A1 | |
| AU2024200563A1 | Australia | A1 |
9 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 | |
| Explanation of circumstances concerning accelerated examinationJAPANESE INTERMEDIATE CODE: A871A871 | A871 |
Numbers
- Publication
- 7064049
- Application
- 208395
Titles2
- Japanese
- アンロック入力に基づいてユーザインタフェースを操作するためのデバイス、方法、及びグラフィカルユーザインタフェース
- English
- Devices, methods, and graphical user interfaces for manipulating the user interface based on unlock input
Classification
- CPC, 20
- G06F3/0481
- G06F21/32
- G06F3/04883
- G06F21/31
- H04L63/0861
- H04W12/06
- H04L9/3231
- H04L63/083
- H04L63/105
- G06F2221/2113
- H04W88/02
- G06F21/41
- H04L63/0815
- H04W12/68
- G06F2221/032
- G06F2221/2149
- G06V40/1335
- G06V40/67
- G06Q10/40
- G06V40/1353
- IPC, 1
- G06F21 32
