Method for accessing applications, portable multifunction device, and computer readable storage medium

Method for accessing application program, portable multifunctional device and computer readable storage medium

METHOD FOR ACCESSING APPLICATIONS, PORTABLE MULTIFUNCTION DEVICE, AND COMPUTER READABLE STORAGE MEDIUM

The present invention generally relates to an electronic device with a touch-sensitive surface, including (but not limited to) an electronic device with a touch-sensitive surface that enables access to applications when the device is locked.

In recent years, there has been a significant increase in the use of portable devices with touch-sensitive surfaces as input devices. These portable devices have greatly increased the number of applications (ie, "apps") for various situations. For example, image and video camera applications increase opportunities for users to generate content, such as taking photos or recording images. The memo application allows users to read or write memos while running. Time can be of the utmost importance in these opportunities for content generation. For example, when an event occurs, the user may only have a short time to capture an image or video of the event.

However, existing methods for accessing applications are slow and hinder quick use, especially when the device is locked and password protected. When the device is locked, accessing the application on the device (including different modes of accessing the application) requires multiple steps. This hinders immediate or quick storage when it is advantageous or ideal for the immediate or quick access of the application. Pick.

Therefore, there is a need for an electronic device that has a faster and more effective method and interface for accessing applications when the device is locked. These methods and interfaces can supplement or replace conventional methods for accessing applications when the device is locked. These methods and interfaces reduce the cognitive burden of users and produce a more effective human-machine interface. For battery-powered devices, these methods and interfaces save power and extend the time between battery charging.

The above deficiencies and other problems associated with user interfaces for electronic devices with touch-sensitive surfaces are reduced or eliminated by the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (for example, a notebook computer, a tablet computer, or a handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a "touch screen" or "touch screen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules and programs stored in the memory for performing multiple functions Or instruction set. In some embodiments, the user interacts with the GUI mainly through finger contact and gestures on the touch-sensitive surface. In some embodiments, these functions may include image editing, graphics, presentation, word processing, website creation, CD production, spreadsheet generation, games, phone calls, video conferencing, email, instant messaging, fitness support, digital Photography, digital video, web browsing, digital music playback and/or digital video playback. Executable instructions for performing these functions may be included in non-transitory computer-readable storage media or other computer program products configured for execution by one or more processors.

According to some embodiments, a method is performed on a portable multifunction device having a touch-sensitive display and a plurality of applications including a camera application. The method includes: when the device is in a locked password protection state: displaying a lock screen interface on the touch-sensitive display, the lock screen interface including a camera access mark; and detecting one of the touch-sensitive displays Gesture action; in response to a determination that the gesture is started on the camera access mark: stop displaying the lock screen interface and start the camera application A restricted operation stage that displays an interface of the camera application without displaying a password input interface, and maintains the device in the locked password-protected state for applications other than the camera application on the device ; And in response to a determination that the gesture starts at a location on the touch-sensitive display other than the camera access mark, a password keying interface is displayed, and the response is to a correct password in the password keying interface Key in, the password keying interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

According to some embodiments, a method is performed on a portable multifunction device having a touch-sensitive display and a plurality of applications including a camera application. The method includes: when the device is in a locked password protection state: displaying a lock screen interface on the touch-sensitive display, the lock screen interface including a camera access mark and an unlock mark; in response to the detection of the start And end a gesture on the camera access mark: stop displaying the lock screen interface, start a restricted operation phase of the camera application, display an interface of the camera application without displaying a password input interface, And maintaining the device in the locked password-protected state for applications other than the camera application in the device; and responding to detecting that it starts at a position on the touch-sensitive display that is associated with the unlock mark A gesture at, displays a password typing interface, where in response to the typing of a correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlock with access to the plurality of applications state.

According to some embodiments, a method is executed on a portable multifunction device having a touch-sensitive display and a plurality of applications including a camera application. The method includes: when the device is in a locked password protection state: displaying a lock screen interface on the touch-sensitive display, the lock screen interface including an unlock mark and a camera access mark; in response to the detection of the end A gesture on the camera access mark: stop displaying the lock screen interface, start a restricted operation phase of the camera application, display an interface of the camera application without displaying a password input interface, and The device An application program other than the camera application program maintains the device in the locked password-protected state; and responds to detecting a signal ending at a position associated with the unlocking mark on the touch-sensitive display Action, displaying a password typing interface, wherein in response to the typing of a correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

According to some embodiments, a method is performed on a portable multifunction device having a touch-sensitive display and a plurality of applications including a camera application. The method includes: when the device is in a locked password protection state: displaying a lock screen interface on the touch-sensitive display, the lock screen interface including a camera access mark; and detecting one of the touch-sensitive displays A gesture; responding to a determination that the gesture starts on the camera access mark and is a first type, partially reveals an interface of the camera application; responds to the gesture starts on the camera access mark and For a judgment that is different from one of the first type and the second type, stop displaying the lock screen interface, start a restricted operation phase of the camera application, display one of the camera application interfaces without displaying a password key-in Interface, and maintain the device in the locked password-protected state for applications other than the camera application in the device; and responding to the signal action to start on the touch-sensitive display except for the camera access mark A determination at a location outside, a password typing interface is displayed, wherein in response to the typing of a correct password in the password typing interface, the password typing interface stops displaying and the device enters with access to the plurality of applications An unlocked state.

According to some embodiments, a portable multifunctional device includes: a touch-sensitive display, one or more processors, memory, a plurality of applications including a camera application, and one or more programs; the one or A plurality of programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing operations of any one of the methods described above. According to some embodiments, there is a touch-sensitive display, a memory, a plurality of applications including a camera application, and executions stored in the memory. The graphical user interface on the portable multifunctional device with one or more processors of one or more programs in the memory includes one or more of the elements displayed in any of the above methods, and these elements Update in response to input as described in any of the above methods. According to some embodiments, a computer-readable storage medium stores instructions that when executed by a portable multifunctional device having a touch-sensitive display and a plurality of applications including a camera application Perform any of the above methods. According to some embodiments, a portable multifunctional device includes: a touch-sensitive display; a plurality of applications including a camera application; and means for performing any of the above-mentioned methods. According to some embodiments, an information processing device for use in a portable multifunction device having a touch-sensitive display and a plurality of applications including a camera application includes operations for performing any of the above-mentioned methodsofComponents.

According to some embodiments, an electronic device includes: a touch-sensitive display unit configured to display a lock screen interface when the device is in a locked password protected state, the lock screen interface including a camera access mark, And the touch-sensitive display unit receives a gesture; a plurality of application programs including a camera application program; and a processing unit coupled to the touch-sensitive display unit and the plurality of application programs. The processing unit is configured to: when the device is in the locked password protection state: detect a gesture on the touch-sensitive display unit, and respond to a determination that the gesture starts on the camera access mark : Stop displaying the lock screen interface, start a restricted operation phase of the camera application, realize the display of an interface of the camera application without displaying a password input interface, and for the device except for the camera application The external application program maintains the device in the locked password protection state; and in response to a determination that the gesture starts at a location on the touch-sensitive display unit other than the camera access mark, a password is realized The display of the key-in interface, wherein in response to the key-in of a correct password in the password key-in interface, the password key-in interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

According to some embodiments, an electronic device includes: a touch-sensitive display unit configured to display a lock screen interface when the device is in a locked password protection state, the lock screen interface including a camera access mark and An unlocking mark, and the touch-sensitive display unit receives a gesture; a plurality of application programs including a camera application program; and a processing unit coupled to the touch-sensitive display unit and the plurality of application programs. The processing unit is configured to: when the device is in the locked password-protected state: in response to detecting the start and end of a gesture on the camera access mark, stop displaying the locked screen interface and start the camera A restricted operation stage of the application, which realizes the display of an interface of the camera application without displaying a password input interface, and maintains the device in the lock for applications other than the camera application in the device Password protection status; and in response to detecting a gesture starting at a position associated with the unlocking mark on the touch-sensitive display unit, a password keying interface is displayed, wherein the response to the password keying interface is When a correct password is entered, the password entry interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

According to some embodiments, an electronic device includes: a touch-sensitive display unit configured to display a lock screen interface when the device is in a locked password protected state, the lock screen interface including a camera access mark and An unlocking mark, and the touch-sensitive display unit receives a gesture; a plurality of application programs including a camera application program; and a processing unit coupled to the touch-sensitive display unit and the plurality of application programs. The processing unit is configured to: when the device is in the locked password protection state: in response to detecting a gesture ending on the camera access mark: stop displaying the locked screen interface, and start the camera application A restricted operation stage that realizes the display of an interface of the camera application without displaying a password input interface, and maintains the device in the locked password for applications other than the camera application in the device Protection state; and in response to detecting a gesture ending at a position associated with the unlock mark on the touch-sensitive display unit, a password keying interface is displayed, wherein the password keying interface is responded to Entering one of the correct passwords, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

According to some embodiments, an electronic device includes: a touch-sensitive display unit configured to display a lock screen interface when the device is in a locked password protected state, the lock screen interface including a camera access mark, And the touch-sensitive display unit receives a gesture; a plurality of application programs including a camera application program; and a processing unit coupled to the touch-sensitive display unit and the plurality of application programs. The processing unit is configured to: when the device is in the locked password protection state: to detect a gesture on the touch-sensitive display; in response to the gesture, it starts on the camera access mark and is a first A determination of a type, partially revealing an interface of the camera application; in response to a determination that the gesture starts on the camera access mark and is different from the first type of a second type, stop displaying the lock The screen interface starts a restricted operation phase of the camera application, and realizes the display of an interface of the camera application without displaying a password input interface, and it will be used for applications other than the camera application on the device. The device is maintained in the locked password protection state; and in response to a determination that the gesture starts at a position on the touch-sensitive display other than the camera access mark, a password key-in interface is displayed, wherein In response to the typing of one of the correct passwords in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

According to some embodiments, a method is executed on a portable device having a touch-sensitive display and a plurality of applications including a first application. The method includes: when the device is in a locked password protection state: displaying a lock screen interface on the touch-sensitive display, the lock screen interface including a first application access mark; detecting the touch-sensitive display The previous gesture is in response to a determination that the gesture starts on the first application access mark and is a first type of gesture: stop displaying the lock screen interface; start one of the first applications The first application in the first mode A restricted operation phase of the application; display an interface of the first application in the first mode without displaying a password input interface; and change the interface of the device except for the first application The device is maintained in the locked password protected state; and in response to a determination that the gesture starts on the first application access mark and is a second type of gesture that is different from the first type of gesture : Stop displaying the lock screen interface; start a restricted operation phase of the first application in the second mode that is different from the first mode of the first application; display the first application An interface of the first application program in the second mode does not display a password input interface; and for applications other than the first application program in the device, the device is maintained in the locked password protection state.

According to some embodiments, a method is executed on a portable device having a touch-sensitive display and a plurality of applications including a first application. The method includes: when the device is in a locked password protection state: displaying a lock screen interface on the touch-sensitive display, the lock screen interface including a first storage in a first mode in a first application program Fetching a mark and a second access mark of a second mode in the first application program that are different from the first access mark; detecting a gesture on the touch-sensitive display; responding to the start of the gesture A determination on the first access mark that is a first type of gesture: stop displaying the lock screen interface; start one of the first applications, one of the first applications in the first mode is restricted Mode operation stage; displaying an interface of the first application in the first mode without displaying a password input interface; and maintaining the device in the lock for applications other than the first application in the device And respond to a determination that the gesture starts on the second access mark and is a gesture of the second type: stop displaying the lock screen interface; start the different from the first application One of the first applications in the first mode A restricted operation stage of the first applications in the second mode; displaying an interface of the first application in the second mode without displaying a password key-in Interface; and for the device in addition to the first application Use an application other than the program to maintain the device in the locked password-protected state.

According to some embodiments, a portable device includes: a touch-sensitive display, one or more processors, memory, a plurality of application programs including a first application program, and one or more programs; the one or more A program is stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing the operations of any of the methods described above. According to some embodiments, a portable device having a touch-sensitive display, a memory, a plurality of application programs including a first application program, and one or more processors that execute one or more programs stored in the memory The graphical user interface on the type device includes one or more of the elements displayed in any of the above methods, and the elements are updated in response to input as described in any of the above methods. According to some embodiments, a computer-readable storage medium stores instructions that, when executed by a portable device having a touch-sensitive display and a plurality of application programs including a first application program, execute the device Operation of any of the above methods. According to some embodiments, a portable device includes: a touch-sensitive display; a plurality of application programs including a first application program; and means for performing operations of any of the above methods. According to some embodiments, an information processing device for use in a portable device having a touch-sensitive display and a plurality of application programs including a first application program includes a device for performing operations of any of the above-mentioned methods member.

According to some embodiments, a portable device includes: a touch-sensitive display unit configured to display a lock screen interface when the device is in a locked password protected state, the lock screen interface including a first application Access mark, and the touch-sensitive display unit receives a signal action; a plurality of application programs including a first application program; and a processing unit coupled to the touch-sensitive display unit and the plurality of application programs. The processing unit is configured to detect a gesture on the touch-sensitive display unit when the device is in a locked password protection state, respond to the gesture to start on the first application access mark, and A determination for a gesture of the first type: stop the lock screen interface Display, start a restricted operation phase of the first application in a first mode of the first application, and realize the display of an interface of the first application in the first mode without displaying a A password input interface, and maintain the device in the locked password-protected state for applications other than the first application in the device; and in response to the gesture, start on the first application access mark and A determination of a second type of gesture that is different from the first type of gesture: stop the display of the lock screen interface, and start the first application that is different from the first mode of the first application A restricted operation phase of the first application in a second mode realizes the display of an interface of the first application in the second mode without displaying a password keying interface, and for the device except An application program other than the first application program maintains the device in the locked password protection state.

According to some embodiments, a portable device includes: a touch-sensitive display unit configured to display a lock screen interface when the device is in a locked password protected state, the lock screen interface including a first application A first access mark in one of the first mode and a second access mark in a second mode of the first application that is different from the first access mark, and the touch-sensitive display unit receives Schematic action; a plurality of application programs including a first application program; and a processing unit, which is coupled to the touch-sensitive display unit and the plurality of application programs. The processing unit is configured to detect a gesture on the touch-sensitive display when the device is in a locked password protection state, and respond to the gesture to start on the first access mark and be a first A determination of a type of gesture: stop displaying the lock screen interface, start a restricted operation phase of the first application in a first mode of the first application, and realize the operation in the first mode The display of an interface of the first application program does not display a password input interface, and for applications other than the first application program in the device, the device is maintained in the locked password protection state; and in response to the signal The action starts on the second access mark and is a determination of a second type of gesture: stop displaying the lock screen interface and start to be different from the first A restricted operation stage of the first application in the first mode of the application program in the second mode to realize the display of an interface of the first application program in the second mode It does not display a password input interface, and maintains the device in the locked password protection state for applications other than the first application in the device.

Therefore, portable multifunctional devices with touch-sensitive displays are provided with faster and more effective methods and interfaces for accessing applications in the locked device, thereby improving the effectiveness, efficiency, and user satisfaction of these devices. These methods and interfaces can supplement or replace conventional methods for accessing applications in a locked device.

<p>100Portable Multifunctional Device</p><p>102Memory</p><p>103Communication bus/signal line</p><p>104chip</p><p>106Input/Output (I/O) Subsystem</p><p>108Radio Frequency (RF) Circuit</p><p>110Audio Circuit</p><p>111Speaker</p><p>112Touch sensitive display system/touch screen/touch screen display</p><p>113Microphone</p><p>116Other input or control device/other input control device</p><p>118Peripheral device interface</p><p>120Processing unit</p><p>122Memory Controller</p><p>124Connecting/charging external port</p><p>126operating system (or instruction set)</p><p>128Communication module (or command set)</p><p>130Contact/Motion module (or instruction set)</p><p>132Graphics module (or instruction set)</p><p>134Text input module (or command set)</p><p>135Global Positioning System (GPS) module (or command set)</p><p>136application (or instruction set)</p><p>136-1Application</p><p>137Contact/Contact Module</p><p>138Telephone Module</p><p>139Video Conference Module</p><p>140Email/Email Client Module</p><p>141Instant Message (IM) Delivery Module/IM</p><p>142Fitness Support Module</p><p>143Imaging Module/Camera Module</p><p>144Image Management Module</p><p>147Browser/Browser Module</p><p>148Calendar Module</p><p>149Interface Tool Set Module</p><p>149-1Weather Interface Tool Set</p><p>149-2Stock Interface Toolkit</p><p>149-3Calculator interface tool set</p><p>149-4Alarm Clock Interface Tool Set</p><p>149-5 Dictionary interface tool set</p><p>149-6User-created interface toolset</p><p>150Interface Tool Set Builder Module</p><p>151Search Module</p><p>152Video and music player module</p><p>153Memorandum Module</p><p>154Map Module</p><p>155Online Video Module</p><p>156Display Controller/Display System Controller</p><p>157Device/Global Internal Status</p><p>158Optical Sensor Controller</p><p>159Camera Album</p><p>160Other input controllers</p><p>161Digital Imaging Pipeline</p><p>162Power System</p><p>163Voice/Audio Recorder Module</p><p>164Optical Sensor</p><p>165Notification Module</p><p>166Proximity Sensor</p><p>168Accelerometer</p><p>170Event Classifier</p><p>171Event Monitor</p><p>172Click on the Hit View Judgment Module</p><p>173Active Event Identifier Judgment Module</p><p>174Event Dispatcher Module</p><p>176Data Update Program</p><p>177Object Update Program</p><p>178 Graphical User Interface (GUI) Update Program</p><p>179Event data</p><p>180Event Recognizer</p><p>182Event Receiver</p><p>183 Metadata</p><p>184Event Comparator</p><p>186Event Definition</p><p>187-1 Incident 1 </p><p>187-2 Incident 2 </p><p>188Event Delivery Command</p><p>190Event handling routine</p><p>191Application View</p><p>192Application internal state</p><p>200User Interface (UI)</p><p>202Finger</p><p>203Stylus</p><p>204 "Home"or menu button</p><p>206Press the button</p><p>208Volume adjustment button</p><p>210Subscriber Identification Module (SIM) card slot</p><p>212Headphone jack</p><p>300Electronic device</p><p>300-1Portable electronic device</p><p>310Processing Unit (CPU)</p><p>320Communication bus</p><p>330Input/Output (I/O) Interface</p><p>340Display</p><p>350Keyboard and/or mouse (or other pointing device)</p><p>355Touchpad</p><p>360Internet or other communication interface</p><p>370Memory</p><p>380Drawing Module</p><p>382Presentation Module</p><p>384Word Processing Module</p><p>386Website Creation Module</p><p>388Disk Creation Module</p><p>390Spreadsheet Module</p><p>400User Interface</p><p>402Signal Strength Indicator</p><p>404Time</p><p>405Bluetooth indicator</p><p>406Battery status indicator</p><p>408System Tray</p><p>410An indicator of the number of unread emails</p><p>412Setting</p><p>414Indicator of the number of missed calls or voice mail messages</p><p>1200Electronic device</p><p>1202Touch-sensitive display unit</p><p>1204Application</p><p>1205Camera application</p><p>1206Processing unit</p><p>1208Detection unit</p><p>1210Stop unit</p><p>1212Start Unit</p><p>1214Display realization unit</p><p>1216Maintenance Unit</p><p>1218initialization unit</p><p>1220Prevention unit</p><p>1222Translation unit</p><p>1224Exposure Unit</p><p>1300Electronic device</p><p>1302Touch sensitive display unit</p><p>1304Application</p><p>1305Camera application</p><p>1306Processing unit</p><p>1308Detection unit</p><p>1310Stop Unit</p><p>1312Start Unit</p><p>1314Display realization unit</p><p>1316Maintenance Unit</p><p>1318Exposure Unit</p><p>5000-ALocking device interface</p><p>5000-BLocking device interface</p><p>5000-CLocking device interface</p><p>5000-DLocking device interface</p><p>5000-ELocking device interface</p><p>5000-FLocking device interface</p><p>5000-GLocking device interface</p><p>5000-HLocking device interface</p><p>5000-ILocking device interface</p><p>5000-JLocking device interface</p><p>5000-KLocking device interface</p><p>5000-LLocking device interface</p><p>5000-MLocking device interface</p><p>5006Camera access mark</p><p>5008 icon</p><p>5010 icon</p><p>5012area</p><p>5014Give action</p><p>5016Mobile</p><p>5018Give action</p><p>5020Mobile</p><p>5022Password input user interface</p><p>5024Keypad</p><p>5026Camera interface</p><p>5028Viewfinder area</p><p>5030Shutter icon</p><p>5032still image/video mode switch</p><p>5034Camera Album Icon</p><p>5036Real-time image preview</p><p>5037 gesture</p><p>5038Click to indicate action</p><p>5039 gesture</p><p>5040Click to indicate action</p><p>5041 gesture</p><p>5042Camera Album Image Viewer Interface</p><p>5044Image</p><p>5046Control Item</p><p>5048Camera interface icon</p><p>5050Guide icon</p><p>5052Click to indicate action</p><p>5054Click to indicate action</p><p>5056Camera photo album thumbnail interface</p><p>5058-1Thumbnail</p><p>5058-2Thumbnail</p><p>5058-3Thumbnail</p><p>5060Type selection icon</p><p>5062Click to indicate action</p><p>5064Virtual Channel</p><p>5066Unlocking objects</p><p>5068Unlock camera objects</p><p>5070Give action</p><p>5072Mobile</p><p>5074Give action</p><p>5076Mobile</p><p>5078Unlocked objects</p><p>5080Virtual Channel</p><p>5082 gesture</p><p>5084Mobile</p><p>5086area</p><p>5088-AIndicator</p><p>5088-BIndicator</p><p>5088-CIndicator</p><p>5090Signed action</p><p>5091Volume indicator bar</p><p>5092Mobile</p><p>5093Media playback control</p><p>5094 gesture</p><p>5096Mobile</p><p>5098 icon</p><p>5100Click to indicate action</p><p>5102area</p><p>5104-APage indicator</p><p>5104-BPage indicator</p><p>5104-CPage indicator</p><p>5106 gesture</p><p>5108Mobile</p><p>5110 gesture</p><p>5112Corresponding movement</p><p>5114area</p><p>5116Unlock camera objects</p><p>5118Give action</p><p>5119Virtual Channel</p><p>5220direction</p><p>5222Virtual Channel</p><p>5224Unlock camera objects</p><p>5226Still camera icon</p><p>5228Video camera icon</p><p>5230 gesture</p><p>5232Mobile</p><p>5234Mobile</p><p>5236Channel</p><p>5238Unlock camera objects</p><p>5240Still camera icon</p><p>5242 and video camera icon</p><p>5244Virtual Channel</p><p>5246Unlocking objects</p><p>5248Unlock camera objects</p><p>5250 gesture</p><p>5252Mobile</p><p>5254 gesture</p><p>5256Virtual Channel</p><p>5258Mobile</p><p>5260Virtual Channel</p><p>5262Unlocking objects</p><p>5264 gesture</p><p>5266Corresponding movement</p><p>5268Camera icon</p><p>5270Mobile</p><p>5272area</p><p>5274Virtual Channel</p><p>5276Unlocking objects</p><p>5278 gesture</p><p>5280Mobile</p><p>5282 gesture</p><p>5284Mobile</p><p>5286Camera icon</p><p>5288Click to indicate action</p><p>5290Virtual Channel</p><p>5292Unlocking objects</p><p>5294Camera icon</p><p>5296Lock icon</p><p>5298 gesture</p><p>5300Mobile</p><p>5302Mobile</p><p>5304Click to indicate action</p><p>5306 Pan up</p><p>5308 Pan down</p><p>5402area</p><p>5406Application Access Mark</p><p>5408 icon</p><p>5412 gesture</p><p>5414Mobile</p><p>5416Camera icon</p><p>5418Video icon</p><p>5422 gesture</p><p>5424Mobile</p><p>5432 gesture</p><p>5434Mobile</p><p>5436Mobile</p><p>5438 gesture</p><p>5444Give action</p><p>5446Visual instructions</p><p>5448Visual instructions</p><p>5450 gesture</p><p>5452Mobile</p><p>5454 gesture</p><p>5456Mobile</p><p>5457area</p><p>5458First access token</p><p>5460 icon</p><p>5462Second Access Mark</p><p>5464Second Access Mark</p><p>5466 gesture</p><p>5468Mobile</p><p>5470Give action</p><p>5472Mobile</p><p>5474Mobile</p><p>5476Signing action</p><p>5478Mobile</p><p>5480Signing action</p><p>5482 gesture</p><p>5484direction</p><p>5486direction</p><p>5488direction</p><p>5490direction</p><p>5492 gesture</p><p>5494Mobile</p>

In order to better understand the above-mentioned embodiments of the present invention and additional embodiments of the present invention, the following [Embodiments] should be referred to in conjunction with the accompanying drawings. In the drawings, similar reference numerals refer to corresponding parts throughout the drawings.

FIG. 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

Figure 1B is a block diagram illustrating exemplary components for event handling according to some embodiments.

Figure 2 illustrates a portable multifunctional device with a touch screen according to some embodiments.

Figure 3 is a block diagram of an exemplary multifunctional device with a display and a touch-sensitive surface according to some embodiments.

FIG. 4 illustrates an exemplary user interface of a menu of applications on a portable multifunction device according to some embodiments.

5A to 5TTT illustrate an exemplary user interface for accessing a camera application in a locking device according to some embodiments.

6A to 6B illustrate a flowchart of a method for accessing a camera application in a locked device according to some embodiments.

Figure 7 illustrates a camera application used in an access lock device according to some embodiments Flow chart of the method.

FIG. 8 illustrates a flowchart of a method for accessing a camera application in a locked device according to some embodiments.

FIG. 9 illustrates a flowchart of a method for accessing a camera application in a locked device according to some embodiments.

10A to 10C illustrate a flowchart of a method for accessing different modes of an application in a locked device according to some embodiments.

11A-11C illustrate a flowchart of a method for accessing different modes of an application in a locked device according to some embodiments.

FIG. 12 is a functional block diagram of an electronic device according to some embodiments.

FIG. 13 is a functional block diagram of an electronic device according to some embodiments.

Generally, the application in the access lock device adopts several steps and corresponding user input. For example, the steps may include unlocking the device with a password, navigating to the icon corresponding to the application, and activating the icon. Although the device must first be unlocked with a password to provide device security, sometimes it becomes a hindrance to having to unlock the device first to access the application, such as when trying to capture the fleeting moment as a static image or video with a camera application. The embodiments described below enable the user to access the first application (for example, the camera application), including different modes of the first application, without the user having to type a password; the password protection is bypassed. In some embodiments, when the device is locked, an interface with a camera access mark is displayed. In some embodiments, when the gesture starts on the camera access mark, the camera application is started in the restricted operation phase, and when the same gesture starts away from the camera access mark, the password input interface is displayed. In some embodiments, when the gesture is ended on the camera access mark, the camera application is started in the restricted operation phase, and when the gesture ends on the unlock mark, the password input interface is displayed. The gesture on the camera access mark enables quick access to the camera (for example, by bypassing Password input) and although the password input is bypassed, the security of the device is still maintained (for example, by restricting the use of the camera application and keeping the device in a locked state with respect to other applications). Quick camera application access when the device is locked and password protected is particularly suitable for portable devices (e.g., smart phones, tablets, laptops), and can also be used on other devices (e.g., desktops) Type computer).

In some other embodiments, when the device is locked, an interface with an application access mark is displayed. When the gesture starts on the application access tag, depending on the type of the gesture, the application associated with the application access tag is activated in one of multiple modes in a restricted operation phase . In some other embodiments, when the device is locked, an interface with both the first access mark and the second access mark is displayed. The first access mark and the second access mark are associated with an application program. When the gesture starts on the first access mark, in the first mode of the application, the application is started in the restricted operation phase. When the gesture starts on the second access mark, in the second mode of the application, the application is started in the restricted operation phase. The gestures on the access mark enable quick access to different modes of the application (for example, by bypassing the password input) and although the password input is bypassed, the security of the device is still maintained (for example, by being restricted to the activated The use of the application, and for other applications to keep the device in a locked state).

Hereinafter, FIG. 1A to FIG. 1B, FIG. 2 and FIG. 3 provide descriptions of exemplary devices. 4 and 5A to 5TTT illustrate an exemplary user interface for accessing applications in the locking device. 6A to 6B, FIG. 7 to FIG. 9, FIG. 10A to FIG. 10C, and FIG. 11A to FIG. 11C are flowcharts illustrating the method of accessing the application program in the locking device. The user interface in Figures 5A to 5TTT is used to illustrate the procedures in Figures 6A to 6B, Figure 7, Figure 8, Figure 9, Figure 10A to Figure 10C, and Figure 11A to Figure 11C.

<b>Exemplary device</b>

Reference will now be made to the embodiments in detail, and the accompanying drawings illustrate some of the second examples of the embodiments. In In the following detailed description, numerous specific details are stated in order to provide a thorough understanding of the present invention. However, it will be obvious to those skilled in the art that the present invention can be practiced without such specific details. In other cases, well-known methods, procedures, components, circuits, and networks are not described in detail so as not to unnecessarily obscure the aspect of the embodiments.

It should also be understood that although the terms "first", "second", etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first contact can be referred to as the second contact, and similarly, the second contact can be referred to as the first contact without departing from the scope of the present invention. Both the first contact and the second contact are contacts, but they are not the same contact.

The terms used in the description of the present invention herein are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the description of the present invention and the scope of the appended patent applications, the singular form "a" and "the" are intended to also include the plural form, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It should be further understood that when used in this specification, the terms "including" and/or "including" designate the existence of stated features, wholes, steps, operations, elements and/or components, but do not exclude one or more other The existence or addition of features, wholes, steps, operations, elements, components, and/or groups thereof.

As used in this article, the term "if" can be interpreted as meaning "when", "after", "responding to judgment..." or "responding to detection" depending on the context. ..". Similarly, the phrase "If it is determined..." or "If [the stated condition or event] is detected" can be interpreted as meaning "at the time of determining..." depending on the context. , "Respond to the judgment...", "After the [condition or event stated] is detected" or "Respond to the detection of [condition or event stated]".

Describe electronic devices, the user interface of these devices, and the use of these devices Examples of associated programs. In some embodiments, the device is a portable communication device such as a mobile phone, and the portable communication device also includes other functions such as a PDA and/or a music player function. Illustrative examples of portable multifunctional devices include, but are not limited to, iPhone®, iPod Touch®, and iPad® devices available from Apple Inc. of Cupertino, California. Other portable electronic devices may also be used, such as laptop computers or tablet computers with touch-sensitive surfaces (eg, touch screen displays and/or touch pads). It should also be understood that, in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (for example, a touch screen display and/or a touch pad).

In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may include one or more other physical user interface devices, such as a physical keyboard, mouse, and/or joystick.

The device usually supports various applications such as one or more of the following applications: drawing applications, rendering applications, word processing applications, website creation applications, CD creation applications, spreadsheet applications, game applications , Phone application, video conferencing application, email application, instant messaging application, fitness support application, photo management application, digital camera application, digital video camera application, web browsing application, digital music player Player application and/or digital video player application.

Various applications that can be executed on the device can use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device can be adjusted and/or changed due to different applications, and/or adjusted and/or changed within individual applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) can support various applications with a user interface that is intuitive and clear to the user.

Attention is now directed to an embodiment of a portable device with a touch-sensitive display. Figure 1A illustrates a portable multifunctional device with a touch-sensitive display 112 according to some embodiments Set 100 block diagram. For convenience, the touch-sensitive display 112 is sometimes referred to as a "touch screen", and may also be referred to or referred to as a touch-sensitive display system. The device 100 may include a memory 102 (which may include one or more computer-readable storage media), a memory controller 122, one or more processing units (CPU) 120, a peripheral interface 118, an RF circuit 108, and an audio circuit 110, a speaker 111, a microphone 113, an input/output (I/O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 may include one or more optical sensors 164. These components can communicate via one or more communication buses or signal lines 103.

It should be understood that the device 100 is only an example of a portable multifunctional device, and the device 100 may have more or less components than the components shown, may combine two or more components, or may have different component configurations or Configuration. The various components shown in FIG. 1A can be implemented by hardware, software, or a combination of both hardware and software (including one or more signal processing circuits and/or special application integrated circuits).

The memory 102 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. The access of other components of the device 100 (such as the CPU 120 and the peripheral device interface 118) to the memory 102 can be controlled by the memory controller 122.

The peripheral device interface 118 can be used to couple the input and output peripheral devices of the device to the CPU 120 and the memory 102. One or more processors 120 run or execute various software programs and/or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the one or more processors 120 include image signal processors and dual-core or multi-core processors.

In some embodiments, the peripheral interface 118, the CPU 120, and the memory controller 122 may be implemented on a single chip such as the chip 104. In some other embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 may be implemented on separate chips.

The RF (Radio Frequency) circuit 108 receives and transmits RF signals (also referred to as electromagnetic signals). The RF circuit 108 converts electrical signals into electromagnetic signals/converts electromagnetic signals into electrical signals, and through electromagnetic The signal communicates with the communication network and other communication devices. The RF circuit 108 may include well-known circuits for performing these functions, including (but not limited to) antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, Decoder (CODEC) chipset, subscriber identification module (SIM) card, memory, etc. The RF circuit 108 can communicate with wireless networks such as the Internet, also known as the World Wide Web (WWW), corporate intranet, and/or wireless networks (such as cellular telephone networks, wireless local area networks (LAN)) through wireless communication. And/or the Metropolitan Area Network (MAN)) network and other device communication. Wireless communication can use any of a plurality of communication standards, protocols and technologies, including (but not limited to) Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA) ), High Speed Uplink Packet Access (HSUPA), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (for example, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, Email Protocol (for example, Internet Message Access Protocol (IMAP) and/or Post Office Protocol (POP)), instant messaging ( For example, Extensible Messaging and Presence Leveraging Extensions (XMPP), Instant Messaging and Presence Leveraging Extensions (Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions, SIMPLE), instant messaging and presence information services ( IMPS)) and/or short message service (SMS), or any other suitable communication protocol including communication protocol that has not been developed as of the application date of this document.

The audio circuit 110, the speaker 111 and the microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts electrical signals into sound waves that can be heard by humans. The audio circuit 110 also receives the electrical signal converted from the sound wave by the microphone 113. The audio circuit 110 converts the electrical signal into audio data, and transmits the audio data to the peripheral device interface 118 for processing. You can use the peripheral device interface 118 to The memory 102 and/or the RF circuit 108 retrieves audio data, and/or transmits the audio data to the memory 102 and/or the RF circuit 108. In some embodiments, the audio circuit 110 also includes a headphone jack (for example, 212 in FIG. 2). The headphone jack provides the audio circuit 110 and removable audio input/output peripherals (such as headphones with only output, or with output (such as monaural or binaural headphones) and input (such as , Microphone) the interface between the two headsets).

The I/O subsystem 106 couples input/output peripheral devices (such as the touch screen 112 and other input control devices 116) on the device 100 to the peripheral device interface 118. The I/O subsystem 106 may include a display controller 156 and one or more input controllers 160 of other input or control devices. One or more input controllers 160 receive electrical signals from other input or control devices 116 / send electrical signals to other input or control devices 116. Other input control devices 116 may include physical buttons (for example, push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, and the like. In some alternative embodiments, the input controller 160 may be coupled to any of the following (or not to each of the following): a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., 208 in FIG. 2) may include an increase/decrease button for volume control of the speaker 111 and/or the microphone 113. The one or more buttons may include a push button (for example, 206 in FIG. 2).

The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and/or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. Visual output can include graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output may correspond to user interface objects.

The touch screen 112 has a touch-sensitive surface, a sensor, or a collection of sensors that accepts input from the user based on tactile and/or tactile contact. The touch screen 112 and the display controller 156 (together with any associated modules and/or command sets in the memory 102) detect the contact on the touch screen 112 (and any movement or interruption of the contact), and will detect The contact to Interaction with user interface objects (for example, one or more screen buttons, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the contact point between the touch screen 112 and the user corresponds to the user's finger.

The touch screen 112 may use LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies may be used in other embodiments. The touch screen 112 and the display controller 156 can use any of a plurality of touch sensing technologies (including (but not limited to) capacitive, resistive, infrared and surface acoustic wave technologies) that are currently known or later developed, and Other proximity sensor arrays or other elements used to determine one or more points of contact with the touch screen 112 detect the contact and any movement or interruption thereof. In an exemplary embodiment, a projected mutual capacitance sensing technology is used, such as the projected mutual capacitance sensing technology found in Apple Inc. of Cupertino, California, iPhone®, iPod Touch®, and iPad®.

The touch screen 112 can have a video resolution exceeding 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user can use any suitable objects or accessories (such as a stylus pen, fingers, etc.) to contact the touch screen 112. In some embodiments, the user interface is designed to mainly act on finger-based touch and gesture actions. Because the finger's contact area on the touch screen is larger, compared with stylus-based input, finger-based touch And the accuracy of the gesture is low. In some embodiments, the device translates rough finger-based input into precise pointer/cursor positions or commands for performing actions desired by the user.

In some embodiments, in addition to the touch screen, the device 100 may also include a touch pad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device. Unlike a touch screen, the touch-sensitive area does not display visual output. The touchpad may be a touch-sensitive surface separate from the touch screen 112, or an extension of the touch-sensitive surface formed by the touch screen.

The device 100 also includes a power system 162 that supplies power to various components. Power system 162 available Including power management systems, one or more power sources (e.g., batteries, alternating current (AC)), recharging systems, power failure detection circuits, power converters or inverters, power status indicators (e.g., light-emitting two Polar body (LED), and any other components associated with the generation, management and distribution of electricity in portable devices.

The device 100 may also include one or more optical sensors 164. FIG. 1A shows the optical sensor coupled to the optical sensor controller 158 in the I/O subsystem 106. The optical sensor 164 may include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) photoelectric crystal. The optical sensor 164 receives the light projected through one or more lenses from the environment, and converts the light into data representing an image. Combined with the imaging module 143 (also referred to as a camera module), the optical sensor 164 can capture still images or videos. In some embodiments, the optical sensor is located on the back of the device 100, opposite to the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for capturing still images and/or video images. In some embodiments, another optical sensor is located on the front of the device, so that while the user views other video conference participants on the touch screen display, an image of the user can be obtained for the video conference.

The device 100 may also include one or more proximity sensors 166. FIG. 1A shows the proximity sensor 166 coupled to the peripheral interface 118. Alternatively, the proximity sensor 166 may be coupled to the input controller 160 in the I/O subsystem 106. In some embodiments, when the multifunctional device is placed close to the user's ear (for example, when the user is making a call), the proximity sensor cuts off the touch screen 112 and disables the touch screen 112.

The device 100 may also include one or more accelerometers 168. FIG. 1A shows the accelerometer 168 coupled to the peripheral interface 118. Alternatively, the accelerometer 168 may be coupled to the input controller 160 in the I/O subsystem 106. In some embodiments, the information is displayed on the touch screen display in a portrait view or a landscape view based on analysis of data received from one or more accelerometers. In addition to the accelerometer 168, the device 100 optionally includes a magnetometer (not shown) and a magnetometer for obtaining information related to the position and orientation (for example, vertical or horizontal) of the device 100. Global Positioning System (GPS) (or GLONASS or other global navigation system) receiver (not shown).

In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact/motion module (or instruction set) 130, and a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application program (or instruction set) 136. In addition, in some embodiments, as shown in FIGS. 1A and 3, the memory 102 stores the device/global internal state 157. The device/global internal state 157 includes one or more of the following: active application state, which indicates which application (if any) is currently active; display state, which indicates which application, view, or other information Occupies various areas of the touch screen display 112; sensor status, which includes information obtained from various sensors of the device and the input control device 116; and location information related to the location and/or posture of the device.

The operating system 126 (for example, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks) includes general system tasks for control and management (for example, memory management, storage device control, power management Etc.) various software components and/or drivers, and promote the communication between various hardware and software components. In addition, in some embodiments, the memory 102 stores the camera album 159 and the digital image pipeline 161.

The communication module 128 facilitates communication with other devices via one or more external ports 124, and also includes various software components for processing the data received by the RF circuit 108 and/or the external ports 124. The external port 124 (e.g., universal serial bus (USB), FIREWIRE, etc.) is adapted for direct coupling to other devices or indirectly coupling to other devices via a network (e.g., Internet, wireless LAN, etc.) Device. In some embodiments, the external port is a multi-pin (eg, 30-pin) connector that is the same or similar and/or compatible with the 30-pin connector used on the iPod (trademark of Apple Inc.) device.

The contact/motion module 130 can detect and touch the screen 112 (in combination with the display controller 156) and Contact with other touch-sensitive devices (for example, a touchpad or a physical click-type dial). The contact/motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (for example, detecting a finger downward event), and determining whether there is a contact movement And track the movement across the touch-sensitive surface (for example, detect one or more finger drag events) and determine whether the contact has stopped (for example, detect the finger upward event or the interruption of the contact). The contact/motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point represented by a series of contact data may include determining the speed (quantity), velocity (quantity and direction) and/or acceleration (change in magnitude and/or direction) of the contact point. These operations can be applied to a single contact (e.g., single-finger contact) or to multiple simultaneous contacts (e.g., "multi-touch"/multiple finger contact). In some embodiments, the contact/motion module 130 and the display controller 156 detect contact on the touch panel.

The contact/motion module 130 can detect gestures input by the user. Different gestures on the touch-sensitive surface have different contact patterns. Therefore, gestures can be detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger downward event, and then at the same position (or substantially the same position) as the finger downward event (for example, at the position shown in the figure) Detect finger up (lift) events. As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger downward event, subsequently detecting one or more finger drag events, and then subsequently detecting finger upward (File) the incident.

The graphics module 132 includes various known software components for presenting and displaying graphics on the touch screen 112 or other displays, including components for changing the intensity of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to the user, including (but not limited to) text, web pages, icons (such as user interface objects including screen buttons), digital images, videos, Animation and the like.

In some embodiments, the graphics module 132 stores data representing the graphics to be used. A corresponding code can be assigned to each graphic. The graphics module 132 receives designated waiting One or more codes of the displayed graphics together with coordinate data and other graphics attribute data (if necessary), and then generate screen image data to output to the display controller 156.

The text input module 134, which can be a component of the graphics module 132, is provided for typing in various applications (for example, contact 137, email 140, IM 141, browser 147, and any other applications that require text input) On-screen keypad for text.

The GPS module 135 determines the location of the device, and provides this information for use by various applications (for example, to the phone 138 for use in location-based dialing, to the camera 143 as picture/video post-data, and to provide To applications that provide location-based services, such as weather interface tool set, local yellow page interface tool set and map/navigation interface tool set).

The application 136 can include the following modules (or command sets) or a subset or superset thereof: Contact module 137 (sometimes called address book or contact list) Phone module 138; Video conferencing module 139; E-mail client module 140; Instant messaging (IM) module 141; Fitness support module 142; Camera module 143 for static and/or video images; Image management module 144 ; Browser module 147; Calendar module 148; Interface tool set module 149, which can include one or more of the following: Weather interface tool set 149-1, Stock interface tool set 149- 2. Calculator interface tool set 149-3, alarm clock interface tool set 149-4, dictionary interface tool set 149-5, and other interface tool sets obtained by users and user-created interface tools set 149-6; Interface tool set builder for generating user-created interface tool set 149-6 Module 150; Search module 151; Video and music player module 152, which can be composed of a video player module and a music player module; Memo module 153; Map module 154; Online video Module 155; Voice/Audio Recorder Module 163; and/or Notification Module 165.

Examples of other applications 136 that can be stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, applications with JAVA capabilities, encryption, digital rights management, and voice recognition And voice copy.

Combined with the touch screen 112, the display controller 156, the contact module 130, the graphics module 132 and the text input module 134, the contact module 137 can be used to manage the address book or contact list (for example, stored in the memory 102 or The contact module 137 in the memory 370 in the internal state of the application 192), including: adding a name to the address book; deleting a name from the address book; making the phone number, e-mail address, physical address, or other information combined with one Associate names; associate an image with a name; classify and classify names; provide phone numbers or email addresses to initiate and/or facilitate communication via phone 138, video conference 139, email 140, or IM 141 ;and many more.

Combining the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the telephone module 138 can be used for typing corresponding to The character sequence of the phone number, access one or more phone numbers in the address book 137, modify the entered phone number, dial individual phone numbers, make a call, and disconnect or hang up when the call is completed. As mentioned above, Wireless communication can use any of a plurality of communication standards, protocols, and technologies.

Combine RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact module 130, graphics module 132, text The input module 134, the contact list 137, and the telephone module 138. The video conferencing module 139 includes executable instructions for performing the following operations: initiating, proceeding, and terminating the user and one or more other Video conference between participants.

In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the email client module 140 includes executable commands for performing the following operations: Create, send, receive and manage emails based on user instructions. Combined with the image management module 144, the email client module 140 makes it very easy to create and send emails with static images or video images captured by the camera module 143.

Combining the RF circuit 108, the touch screen 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for performing the following operations: type corresponding In the character sequence of instant messages, modify previously typed characters, transmit individual instant messages (for example, use SMS or Multimedia Messaging Service (MMS) protocol for telephone-based instant messages, or for Internet-based Use XMPP, SIMPLE or IMPS for instant messaging, receive instant messages and view received instant messages. In some embodiments, the transmitted and/or received instant messages may include graphics, photos, audio files, video files, and/or other attachments such as those supported in MMS and/or enhanced messaging services (EMS). As used in this article, "instant messaging" refers to both phone-based messages (for example, messages sent using SMS or MMS) and Internet-based messages (for example, messages sent using XMPP, SIMPLE, or IMPS) .

Combine RF circuit 108, touch screen 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module 146. The fitness support module 142 includes executable instructions for performing the following operations: Create a fitness plan ( For example, regarding time, distance, and/or calorie burn goals), communicating with fitness sensors (exercise devices), receiving fitness sensor data, calibrating sensors for monitoring fitness, selecting and playing music for fitness, and Display, store and transmit fitness data.

Combines the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact module 130, the graphics module 132, and the digital image pipeline 161 (which will come from the original optical sensor Data is converted into a final image or video) and an image management module 144. The camera module 143 includes executable instructions for performing the following operations: capture still images or videos (including video streams) and store them in the memory 102 (For example, in the camera album 159), modify the characteristics of the still image or video, or delete the still image or video from the memory 102 (for example, from the camera album 159).

Combined with the touch screen 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, and the camera module 143, the image management module 144 includes executable instructions for performing the following operations: , Modify (e.g., edit) or otherwise manipulate, mark, delete, present (e.g., use digital slide show or album) and store still images and/or video images (including still images stored in camera album 159) Images and/or video images).

Combined with the RF circuit 108, the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134, the browser module 147 includes executable instructions for performing the following operations: User commands to browse the Internet, including searching, linking to, receiving and displaying webpages or parts thereof, and attachments and other files linked to webpages.

Combines the RF circuit 108, the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser The browser module 147. The calendar module 148 includes executable instructions for performing the following operations: creating, displaying, modifying, and storing calendars and data associated with the calendars (for example, calendar entries) according to user instructions , To-do list, etc.).

Combined with the RF circuit 108, the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the interface tool set module 149 can be downloaded and Micro applications used (for example, weather interface tool set 149-1, stock interface tool set 149-2, calculator interface tool set 149-3, alarm clock interface tool set 149-4, and dictionary interface tool set 149-5), Or a mini-application created by the user (for example, the interface tool set 149-6 created by the user). In some embodiments, the interface tool set includes HTML (hypertext markup language) files, CSS (hierarchical style sheet) files, and JavaScript files. In some embodiments, the interface tool set includes XML (Extensible Markup Language) files and JavaScript files (for example, Yahoo! Widgets).

Combined with the RF circuit 108, the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the interface tool set builder module 150 can be used by the user To create an interface tool set (for example, to turn a user-specified part of the web page into an interface tool set).

In combination with the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134, the search module 151 includes executable instructions for performing the following operations: search memory according to user instructions The text, music, sound, image, video, and/or other files in the body 102 that match one or more search criteria (for example, one or more search terms specified by the user).

Combined with the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108 and the browser module 147, the video and music player module 152 includes permission to use Can download and play executable commands for recorded music and other sound files stored in one or more file formats (such as MP3 or AAC files), and display, present, or play video in other ways (for example, in touch control Executable commands on the screen 112 or on an external display connected via the external port 124). In some embodiments, the device 100 may include the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

Combined with the touch screen 112, the display controller 156, the contact module 130, the graphics module 132 and the text input module 134, the memo module 153 includes executable instructions for performing the following operations: creation and management according to user instructions Memos, to-do lists, and the like.

Combining the RF circuit 108, the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the GPS module 135 and the browser module 147, the map module 154 can be used to The user commands to receive, display, modify, and store the map and the data associated with the map (for example, driving directions; information about shops and other points of interest in or near a specific location; and other location-based data).

Combines the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108, the text input module 134, the email client module 140 and the browser module Group 147, the online video module 155 includes executable instructions for performing the following operations: allowing users to access, browse, receive (for example, by streaming and/or download), and play (for example, on the touch screen, Or on an external display connected via external port 124), send emails with links to specific online videos, and manage online videos in one or more file formats (such as H.264) in other ways. In some embodiments, the instant messaging module 141 (instead of the email client module 140) is used to send a link to a specific online video.

Combined with the touch screen 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111 and the microphone 113, the voice/audio recorder module 163 includes allowing the user to access one or more files Executable commands for recording audio (for example, voice) in formats (such as MP3 or AAC files), and executable commands for presenting or otherwise playing recorded audio files.

Combined with the touch screen 112, the display system controller 156, the contact module 130, and the graphics module 132, the notification module 165 includes displaying notifications or warnings (such as incoming messages or calls, reminders of calendar events on the touch screen 112). , Application events, etc.).

Each of the modules and application programs identified above corresponds to the method used to perform one or more of the functions described above and the method described in this application (for example, the computer-implemented method and the method described in this article) Other information processing methods) executable instruction set. These modules (ie, instruction sets) do not need to be implemented as independent software programs, procedures or modules, and therefore various subsets of these modules can be combined or otherwise reconfigured in various embodiments. In some embodiments, the memory 102 can store a subset of the modules and data structures identified above. In addition, the memory 102 can store additional modules and data structures not described above.

In some embodiments, the device 100 is a device dedicated to performing operations of a predefined set of functions on the device via a touch screen and/or a touch pad. By using the touch screen and/or touch pad as the main input control device for the operation of the device 100, the number of physical input control devices (such as push buttons, dials, and the like) on the device 100 can be reduced.

The set of predefined functions that can be exclusively executed via the touch screen and/or touch pad includes navigation between user interfaces. In some embodiments, the touchpad navigates the device 100 from any user interface that can be displayed on the device 100 to the main menu, the start menu, or the root menu when touched by the user. In these embodiments, the touchpad can be referred to as a "function table button." In some other embodiments, the menu button may be a physical push button or other physical input control device instead of a touchpad.

Figure 1B is a block diagram illustrating exemplary components for event handling according to some embodiments. In some embodiments, the memory 102 (in FIG. 1A) or 370 (FIG. 3) includes an event classifier 170 (e.g., in the operating system 126) and a respective application program 136-1 (e.g., the application program 137 described above). To any of 151, 155, 380 to 390).

The event classifier 170 receives the event information, and determines the application view 191 of the application 136-1 and the application 136-1 to which the event information is delivered. Event classifier 170 includes events The software monitor 171 and the event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192, which indicates the current application view displayed on the touch-sensitive display 112 while the application is active or running. In some embodiments, the device/global internal state 157 is used by the event classifier 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event classifier 170 to determine the event information to be delivered Application view 191.

In some embodiments, the internal state of the application 192 includes additional information, such as one or more of the following: resume information to be used when the application 136-1 resumes execution, indicating information is being used by the application 136 -1 Displays or prepares the user interface status information displayed by the application 136-1, the status queue used to enable the user to return to the previous state or view of the application 136-1; and the status queue adopted by the user Redo/undo queue of previous actions.

The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (for example, a user's touch as part of a multi-touch gesture on the touch-sensitive display 112). The peripheral device interface 118 transmits information received from the I/O subsystem 106 or sensors (such as the proximity sensor 166), the accelerometer 168, and/or the microphone 113 (via the audio circuit 110). The information received by the peripheral device interface 118 from the I/O subsystem 106 includes information from the touch-sensitive display 112 or touch-sensitive surface.

In some embodiments, the event monitor 171 sends the request to the peripheral device interface 118 at predetermined time intervals. In response, the peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits the event information only when there is a major event (for example, receiving an input exceeding a predetermined noise threshold and/or receiving input for more than a predetermined duration).

In some embodiments, the event classifier 170 also includes a hit view determination module 172 and/or an active event recognizer determination module 173.

The click-hit view determination module 172 is provided for displaying one on the touch-sensitive display 112 The above view is a software program that determines where sub-events occur in one or more views. The view is composed of controls and other elements that the user can see on the display.

Another aspect of the user interface associated with an application is a collection of views sometimes referred to herein as an application view or a user interface window, in which information is displayed and touch-based gestures occur. The application view where the touch is detected (application view of each application) can correspond to the programming of the application or the programming level within the view hierarchy. For example, the lowest-level view in which a touch is detected may be referred to as a click hit view, and the set of events recognized as a correct input may be determined based at least in part on the click hit view of the initial touch based on the gesture of the touch.

The click-hit view determination module 172 receives information related to the child event of the touch-based gesture. When the application has multiple views organized in a hierarchical structure, the click-hit view determination module 172 recognizes the click-hit view as the lowest view in the hierarchy that should handle the sub-event. In most cases, the click-hit view is the lowest level view of the occurrence of the initial sub-event (that is, the first sub-event in the sequence of sub-events forming the event or potential event). Once the click-hit view is identified by the click-hit view determination module, the click-hit view usually receives all related to the same touch or input source (for the touch or input source, the view is recognized as a click-hit view) Sub-event.

The active event recognizer determination module 173 determines which view or views in the view hierarchy should receive a specific sequence of sub-events. In some embodiments, the active event recognizer determination module 173 determines that only clicking on the hit view should receive a specific sequence of sub-events. In other embodiments, the active event recognizer determination module 173 determines that all views including the physical location of the sub-event are the active views involved, and therefore determines that all the active views involved should receive a specific sub-event sequence. In other embodiments, even if the touch sub-event is completely confined to the area associated with a particular view, the higher view in the hierarchy will remain the active view involved.

The event dispatcher module 174 dispatches the event information to the event recognizer (for example, event recognition Recognizer 180). In the embodiment including the active event recognizer determination module 173, the event dispatcher module 174 delivers the event information determined by the active event recognizer determination module 173 to the event recognizer. In some embodiments, the event dispatcher module 174 stores the event information retrieved by the respective event receiver modules 182 in the event queue.

In some embodiments, the operating system 126 includes an event classifier 170. Alternatively, the application 136-1 includes the event classifier 170. In other embodiments, the event classifier 170 is a stand-alone module or part of another module stored in the memory 102 (such as the contact/motion module 130).

In some embodiments, the application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes a separate view for handling in the user interface of the application The instruction of the touch event that occurred. Each application view 191 of the application 136-1 includes one or more event recognizers 180. Generally, each application view 191 includes a plurality of event identifiers 180. In other embodiments, one or more of the event recognizers 180 are independent modules (such as a user interface set (not shown) or a higher-level object, and the application 136-1 is derived from the higher-level object). Inheritance methods and other properties) part. In some embodiments, each event processing routine 190 includes one or more of the following: data update program 176, object update program 177, GUI update program 178, and/or event data received from event classifier 170 179. The event handler 190 can use or call the data update program 176, the object update program 177, or the GUI update program 178 to update the internal state 192 of the application. Alternatively, one or more of the application views 191 includes one or more individual event handling routines 190. Also, in some embodiments, one or more of the data update program 176, the object update program 177, and the GUI update program 178 are included in the respective application view 191.

Each event recognizer 180 receives event information (for example, event data 179) from the event classifier 170, and recognizes the event based on the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes At least a subset of each of the following: meta data 183, and event delivery instructions 188 (which may include sub-event delivery instructions).

The event receiver 182 receives event information from the event classifier 170. The event information includes information about sub-events (for example, touch or touch movement). Depending on the sub-event, the event information also includes additional information such as the location of the sub-event. When the sub-event is related to the movement of the touch, the event information may also include the speed and direction of the sub-event. In some embodiments, the event includes the rotation of the device from one orientation to another orientation (for example, from a vertical orientation to a horizontal orientation, or a horizontal orientation to a vertical orientation), and the event information includes information about the current orientation of the device (also referred to as device orientation). Corresponding information of posture).

The event comparator 184 compares the event information with predefined event or sub-event definitions, and determines the event or sub-event based on the comparison result, or determines or updates the state of the event or sub-event. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 contains the definition of an event (for example, a predefined sequence of sub-events), for example, event 1 (187-1), event 2 (187-2), and other events. In some embodiments, the child events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double tap on the displayed object. Double-click (for example) the first touch on the displayed object lasts for a predetermined period (touch start), the first lift lasts for a predetermined period (touch end), the second touch on the displayed object lasts for a predetermined period (touch start) ), and the second lifting lasts a predetermined stage (touch end). In another example, event 2 (187-2) is defined as dragging on the displayed object. Dragging includes, for example, a touch (or contact) on the displayed object for a predetermined period, the movement of the touch across the touch-sensitive display 112, and the lifting of the touch (touch end). In some embodiments, the event also includes information about one or more associated event handlers 190.

In some embodiments, the event definition 187 includes event definitions of individual user interface objects. In some embodiments, the event comparator 184 performs a click hit test to determine which user interface object is associated with the sub-event. For example, in the three user media The surface object is displayed in the application view on the touch-sensitive display 112. When a touch on the touch-sensitive display 112 is detected, the event comparator 184 performs a click-hit test to determine which of the three user interface objects is Which one is associated with the touch (sub-event). If each displayed object is associated with a respective event processing routine 190, the event comparator uses the result of the click hit test to determine which event processing routine 190 should be activated. For example, the event comparator 184 selects the event processing routines associated with the child events and objects that trigger the hit test.

In some embodiments, the definition of each event 187 also includes a delayed action, which delays the delivery of event information until it is determined whether the sub-event sequence corresponds to the event type of the event recognizer or does not correspond to the event of the event recognizer After the type.

When the individual event identifier 180 determines that the series of sub-events do not match any of the events in the event definition 186, the individual event identifier 180 enters the status of event impossible, event failure, or event end, here After that, the individual event recognizer 180 ignores the subsequent sub-events based on the touch-based gesture. In this case, other event recognizers (if any) that are still active for the clicked hit view continue to track and process the ongoing touch-based gesture sub-events.

In some embodiments, each event recognizer 180 includes configurable attributes, flags and/or list post data 183 that indicate how the event delivery system should perform the delivery of child events to the active event recognizer involved. In some embodiments, the meta data 183 includes configurable attributes, flags, and/or lists that indicate how event recognizers can interact with each other. In some embodiments, the meta data 183 includes configurable attributes, flags, and/or lists that indicate whether to deliver sub-events to different levels in the view or programming hierarchy.

In some embodiments, when one or more specific sub-events of the event are recognized, each event recognizer 180 activates the event processing routine 190 associated with the event. In some embodiments, each event recognizer 180 delivers event information associated with the event to the event location Normal formula 190. Starting the event handler 190 is different from sending (and deferring sending) the sub-events to the respective click hit view. In some embodiments, the event recognizer 180 throws a flag associated with the recognized event, and the event processing routine 190 associated with the flag captures the flag and executes a predefined procedure.

In some embodiments, the event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about the sub-event without activating the event handler. In fact, the sub-event delivery command delivers event information to the event processing routine associated with the series of sub-events or delivers the event information to the active view involved. Event processing routines associated with the series of sub-events or associated active views receive event information and execute predetermined procedures.

In some embodiments, the data update program 176 creates and updates the data used in the application program 136-1. For example, the data update program 176 updates the phone number used in the contact module 137, or saves the video file used in the video player module 145. In some embodiments, the object update program 177 creates and updates objects for use in the application 136-1. For example, the object update program 176 creates a new user interface object or updates the location of the user interface object. The GUI update program 178 updates the GUI. For example, the GUI update program 178 prepares to display information and sends it to the graphics module 132 for display on the touch-sensitive display.

In some embodiments, the event handler 190 includes or has access to a data update program 176, an object update program 177, and a GUI update program 178. In some embodiments, the data update program 176, the object update program 177, and the GUI update program 178 are included in a single module of the respective application 136-1 or the application view 191. In other embodiments, the update programs are included in two or more software modules.

It should be understood that the foregoing discussion on the event handling of user touch on a touch-sensitive display is also applicable to other forms of user input to operate the multifunction device 100 through the input device (not all inputs are initiated on the touch screen). Device), for example: coordinate mouse movement with Mouse button press (with or without single or multiple keyboard presses or presses); user movement on the touchpad to click, drag, scroll, etc.; stylus input; device Movement; verbal instruction; detected eye movement; biometric input; and/or any combination thereof, these actions can be used as input corresponding to the sub-events that define the event to be recognized.

FIG. 2 illustrates a portable multifunction device 100 with a touch screen 112 according to some embodiments. The touch screen can display one or more graphics in the user interface (UI) 200. In this embodiment and other embodiments described below, the user can use, for example, one or more fingers 202 (not drawn to scale in the figure) or one or more stylus 203 (in the (The figure is not drawn to scale) Make a gesture on the graph and select one or more of the graphs. In some embodiments, when the user interrupts contact with one or more graphics, the selection of the one or more graphics occurs. In some embodiments, the gesture may include one or more clicks, one or more toggles (from left to right, from right to left, up and/or down), and/or those that have been in contact with the device 100 Finger scrolling (left to right, right to left, up and/or down). In some embodiments, unintentional contact with the graphic may not select the graphic. For example, when the gesture corresponding to the selection is click, the swiping gesture of sliding over the application icon may not select the corresponding application.

The device 100 may also include one or more physical buttons, such as "home" or a menu button 204. As previously described, the menu button 204 can be used to navigate to any application 136 in the set of applications that can be executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a screen button in the GUI displayed on the touch screen 112.

In one embodiment, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for powering on/off the device and locking the device, a volume adjustment button 208, and a SIM card slot 210 , Earphone jack 212 and connection/charging external port 124. Pressing the button 206 can be used to depress the button and keep the button in the depressed state for a long time The device is powered on/off at a predefined time interval; the device is locked by pressing the button and the button is released before the predefined time interval has expired; and/or the device is unlocked or the unlocking procedure is initiated. In an alternative embodiment, the device 100 may also receive verbal input about activating or deactivating some functions through the microphone 113.

Figure 3 is a block diagram of an exemplary multifunctional device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not need to be portable. In some embodiments, the device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as children's learning toys), a game system or a control device (for example, Household or industrial controller). The device 300 generally includes one or more processing units (CPU) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. In some embodiments, the processing unit 310 includes an image signal processor and a dual-core or multi-core processor. The communication bus 320 may include a circuit (sometimes referred to as a chipset) that interconnects system components and controls communication between the system components. The device 300 includes an input/output (I/O) interface 330. The I/O interface 330 includes a display 340, which is usually a touch screen display. The I/O interface 330 may also include a keyboard and/or a mouse (or other pointing device) 350 and a touchpad 355. The device 300 also includes an optical sensor 164 and an optical sensor controller 158. The memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid-state memory devices; and may include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 may optionally include one or more storage devices located at the remote end of the CPU 310 (etc.). In some embodiments, the memory 370 stores and stores programs, modules, and data structures similar to the programs, modules, and data structures in the memory 102 of the portable multifunction device 100 (FIG. 1), or a subset thereof . In addition, the memory 370 can store additional programs, modules, and data structures that do not exist in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 can store a drawing module 380, a presentation module 382, a word processing module 384, The website creation module 386, the optical disc creation module 388, and/or the spreadsheet module 390, and the memory 102 (FIG. 1) of the portable multifunction device 100 may not store these modules.

Each of the above-identified elements in Figure 3 can be stored in one or more of the previously mentioned memory devices. Each of the modules identified above corresponds to a set of instructions for performing the functions described above. The modules or programs (ie, instruction sets) identified above need not be implemented as independent software programs, procedures, or modules, and therefore, in various embodiments, various subsets of these modules can be combined or otherwise Reconfigure. In some embodiments, the memory 370 can store a subset of the modules and data structures identified above. In addition, the memory 370 can store additional modules and data structures not described above.

Attention is now turned to an embodiment of a user interface ("UI") that can be implemented on the portable multifunctional device 100.

FIG. 4A illustrates an exemplary user interface of a function table of an application program on the portable multifunction device 100 according to some embodiments. A similar user interface can be implemented on the device 300. In some embodiments, the user interface 400 includes the following components or a subset or superset of them: Signal strength indicator 402 for wireless communication, such as cellular and Wi-Fi signals; Time 404; Bluetooth indicator 405; Battery status indicator 406; Tray 408 with icons for frequently used applications such as the following: Phone 138, which can include missed calls or voice mail messages Number indicator 414; Email client 140, which may include an indicator 410 of the number of unread emails; Browser 147; and Video and music player 152 also known as iPod (trademark of Apple Inc.) module 152; and Icons for other applications, such as: IM 141; Image management 144 Camera 143; Weather 149-1; Stock 149-2; Fitness support 142; Calendar 148; Alarm clock 149-4; Map 154; Memo 153; Setting 412, which is provided to device 100 Access to the settings of its various applications 136; and Online video module 155 also known as YouTube (a trademark of Google Inc.) module 155.

In addition, although the following examples are mainly given with reference to finger input (for example, finger contact, finger click gesture, finger gesture gesture), it should be understood that in some embodiments, one or more of the finger inputs are replaced by It is an input from another input device (for example, a stylus).

<b>User interface and associated procedures</b>

Attention is now turned to an embodiment of a user interface ("UI") and associated programs that can be implemented on an electronic device with a display and a touch-sensitive surface (such as the device 300-1 or the portable multifunction device 100) .

5A to 5TTT illustrate an exemplary user interface for accessing applications in a locking device according to some embodiments. The user interface in these figures is used to illustrate the procedures described below, including the procedures in FIGS. 6A to 6B, 7, 8, 9, 9, 10A to 10C, and 11A to 11C.

FIG. 5A illustrates the locking device interface 5000-A displayed on the touch screen 112 of the device 100. As shown in FIG. When the device 100 is in the locked state, when the physical buttons on the device 100 (for example, pressing the button 206, the home page or the menu button 204) are activated by the user, the locked device interface 5000-A can be displayed. The locked device interface 5000-A may include a message informing the user that the device is locked and other information (for example, the current time and date).

The device 100 may be in a locked password-protected state or a locked non-password-protected state. When the device 100 is in a locked password protection state, a password is required to unlock the device 100. When the device 100 is in a locked and non-password protected state, a password is not required to unlock the device 100.

The locking device interface 5000-A includes a camera access mark 5006. In some embodiments, the camera access mark includes: an icon 5008, which indicates the camera application; and a "handle" icon 5010, which indicates that the camera access mark 5006 can interact with the user (for example, when dragging or sliding "Obtained" during the gesture). In some embodiments, the camera access mark 5006 is displayed in a predefined area (eg, area 5012) of the locking device interface 5000-A.

The gesture can be detected on the touch screen 112 as starting at a certain position in the area 5012 on the touch screen 112. In FIG. 5A, the gesture may start on the camera access mark 5006 or at a position in the area 5012 excluding the camera access mark 5006, and move in a certain direction. For example, the gesture 5014 starts on the camera access mark 5006 and moves with a movement 5016. The gesture 5018 starts at a position in the area 5012 excluding the camera access mark 5006 and moves with a movement 5020.

The detection in response to the gesture 5018 and the gesture 5018 start in addition to the camera access The determination at a position in the area 5012 outside the mark 5006, the area 5012 expands according to the direction of the movement 5020, as shown in FIG. 5B, and if the device 100 is in a locked password protection state, it will be converted to a password keying user interface 5022 (Figure 5C). When the movement 5020 is completed (for example, when it reaches the top of the touch screen 112), the lock device interface 5000-A stops displaying, and the password input user interface 5022 with the keypad 5024 is displayed on the touch screen 112 (Figure 5C) Shown). If the device 100 is in a locked and non-password protected state, the device 100 is unlocked when the movement 5020 is completed.

In response to the detection of the gesture 5014 and the determination that the gesture 5014 starts on the camera access mark 5006, if the device 100 is locked and password protected, the area 5012 expands according to the direction of the movement 5016 (for example, in the form of an animation) , As shown in FIG. 5B, and transformed into the camera interface 5026 of the camera application 143 in the restricted operation stage (FIG. 5D). When the movement 5016 is completed (for example, reaching the top of the touch screen 112) and the action 5014 is released, the locking device interface 5000-A stops displaying, and the camera interface 5026 is displayed on the touch screen 112. If the device 100 is in a locked password-protected state when the gesture 5014 is released, the locked password-protected state is maintained for applications other than the camera application 143 on the device 100, and the camera application 143 is in a restricted operation stage middle. Therefore, the camera application 143 starts in the restricted operation phase in response to the detection of the gesture 5014.

In some embodiments, when the device 100 is in a locked password-protected state, it responds to a detection on the touch screen 112 that is not similar to the gesture 5018 or 5014, preventing the device 100 from performing pre-processing in response to the detection of these contacts. Define the action set. For example, the predefined action set includes displaying the password and typing in the user interface 5022 and unlocking the device 100.

If the device 100 is in a locked and non-password protected state, in response to the detection of the gesture 5014 and the determination that the gesture 5014 starts on the camera access mark 5006, the area 5012 expands according to the direction of the movement 5016 (for example, in the form of an animation) ), as shown in Figure 5B, and transformed into the camera interface 5026 of the camera application 143 in the unrestricted operation phase (Figure 5D). When the movement 5016 is completed (for example, reaching the top of the touch screen 112) and the action 5014 is released, the locked device interface 5000-A stops displaying, the camera interface 5026 is displayed on the touch screen 112, and the device 100 is unlocked (that is, The camera application 143 is fully functional, and other applications on the device 100 are accessible and fully functional).

FIG. 5D shows the camera interface 5026 of the camera application 143 displayed on the touch screen 112. The camera interface 5026 includes a viewfinder area 5028, a shutter icon 5030, a still image/video mode switch 5032, and a camera album icon 5034. The live image preview 5036 can be displayed in the viewfinder area 5028. In response to the detection of the gesture on the shutter icon 5030 (for example, click on the gesture 5038), a still image is captured and saved in the camera album 159, and the thumbnail preview of the image just captured is displayed on the camera. Book icon 5034. In response to the activation of the switch 5032, the camera application 143 switches between the still image capturing mode and the video capturing mode (while remaining in the restricted operation phase, if the camera application 143 starts in the restricted operation phase).

In response to the detection of a gesture (for example, clicking gesture 5040) on the camera photo album icon 5034, the camera photo album image viewer interface 5042 of the camera application 143 and the camera photo album 159 meet one or more presets. The images 5044 defining the presentation criteria are displayed together, as shown in FIG. 5E. The camera album image viewer interface 5042 includes control items 5046 for, for example, browsing and traversing the images and videos in the camera album 159 that meet the presentation criteria or deleting the currently displayed image. The camera album image viewer interface 5042 also includes a camera interface icon 5048 and a navigation icon 5050. In response to the detection of the gesture on the camera interface icon 5048 (for example, click gesture 5052), the display of the camera album image viewer interface 5042 is replaced with the display of the camera interface 5026 (Figure 5D), and if the camera is used The program 143 starts in the restricted operation phase, and the camera application 143 remains in the restricted operation phase. In response to the detection of the gesture on the navigation icon 5050 (for example, click gesture 5054), the display of the camera album image viewer interface 5042 is replaced with the display of the camera album thumbnail interface 5056 of the camera application 143 , As shown in Figure 5F.

In FIG. 5F, the camera album thumbnail interface 5056 includes images (that is, still images and/or videos) in the camera album 159 that are captured by the camera application 143 and meet one or more predefined presentation criteria. Zero or more thumbnails 5058. In response to the selection of the thumbnail 5058 (for example, by performing a gesture on each thumbnail 5058 in the thumbnail interface 5056), the camera album image viewer interface 5042 is displayed, and in the camera album image viewer interface 5042 The image corresponding to the selected thumbnail 5058 is displayed. The thumbnail interface 5056 also includes a camera interface icon 5048 and a type selection icon 5060. In response to the detection of a gesture (for example, click gesture 5062) on the camera interface icon 5048, the camera interface 5026 is displayed, as shown in FIG. 5D, and the camera application 143 remains in the restricted operation phase. In response to the selection of the type selection icon ("All", "Photo", "Video"), the thumbnail 5058 displayed in the thumbnail interface 5056 can be in both photo (still image) and video, photo only or video only Switch between.

Images and videos (for example, image 5044) and thumbnail images 5058 displayed or presented in image viewer interface 5042 and thumbnail interface 5056, respectively, meet one or more predefined presentation criteria. In some embodiments, the rendering criterion is: an image or video (or for a thumbnail, an image or video corresponding to the thumbnail) in order to be displayed on the image viewer interface 5042 and the thumbnail interface when in a restricted operation phase In 5056, it must be generated (ingested) by the camera application 143 when it is in the restricted operation phase (and, in some embodiments, when it is in the current restricted operation phase). In other words, the images and videos captured in the camera application 143 only in the restricted operation phase are presented in the image viewer interface 5042 and the thumbnail interface 5056 respectively when in the restricted operation phase, and are unlocked by the device 100 The images and videos and corresponding thumbnails generated in the camera application 143 at the time are not presented in the image viewer interface 5042 and the thumbnail interface 5056, and therefore cannot be accessed for viewing during the restricted operation phase. When the device 100 is unlocked, images and corresponding thumbnails captured during any restricted operation stage can be accessed for viewing in the camera application 143. The presentation criteria are further described in the application on September 23, 2011 and titled "Applications for accessing locked devices" Device, Method, and Graphical User Interface for Accessing an Application in a Locked Device" US application 13/243,045, the entire content of which is incorporated herein by reference middle.

When the camera application 143 is active in the restricted operation phase, when the camera interface 5026, the camera album image viewer interface 5042, or the thumbnail interface 5056 is displayed on the touch screen 112, it can be activated (for example, ) Press the button 206 or the home/menu button 204 to deactivate the camera application 143 and end the restricted operation phase. In response to the activation of the pressing button 206 or the home/function button 204, the restricted operation phase ends, and the camera interface 5026, the camera photo album image viewer interface 5042, or the thumbnail interface 5056 stop displaying.

In some embodiments, when the camera interface 5026 is displayed, it responds to one of the toggle gestures on the touch screen 112 (for example, substantially horizontally and to the right, as shown in gesture 5037 (FIG. 5D)). For detection, the display of the camera interface 5026 is replaced with the display of the camera album image viewer interface 5042. When displaying the camera album image viewer interface 5042 or the camera album thumbnail interface 5056, it responds in the opposite direction on the touch screen 112 (for example, substantially horizontal and to the left, such as gesture 5039 (Figure 5E) or gesture In action 5041 (shown in FIG. 5F), the toggle signal is detected, and the display of the camera photo album image viewer interface 5042 is replaced with the display of the camera interface 5026.

It should be understood that although FIGS. 5D to 5F are described above regarding the still image capturing mode of the camera application 143, the description of these figures is similarly applicable to the video capturing mode of the camera application 143.

In some embodiments, when the gesture 5014 is detected on the camera access mark 5006, one or more hardware components related to the operation of the camera application 143 are initialized. For example, as the gesture 5014 is moved by the movement 5016, the optical sensor 164 and the optical sensor controller 158 are initialized. In some embodiments, when the gesture 5014 is detected on the camera access mark 5006, one or more software and memory components related to the operation of the camera application 143 are also initialized or preloaded. For example, as shown The motion 5014 is moved by the motion 5016, which can be pre-loaded into the camera album 159 and the digital image pipeline 161. Other details and examples of the initialization or pre-loading of the hardware and software components related to the operation of the camera application 143 are described in the application on September 23, 2011 and are titled "Device for accessing applications in locked devices , Method, and Graphical User Interface (Device, Method, and Graphical User Interface for Accessing an Application in a Locked Device)" US application 13/243,045, the entire content of the case is incorporated herein by reference.

FIG. 5G illustrates the locked device interface 5000-B displayed on the touch screen 112 when the device 100 is in the locked state. In the locked device interface 5000-B, a virtual channel 5064 is displayed, which has an unlocked object 5066 (also known as "unlocked image" or "unlocked image object") and an unlocked camera object 5068 (also known as "unlocked camera image" or "Unlock camera image objects"). In some embodiments, the unlocked object 5066 and the unlocked camera object 5068 are displayed in the opposite ends of the virtual channel 5064. For example, as shown in FIG. 5G, the unlocked object 5066 is displayed at the left end of the virtual channel 5064, and the unlocked camera object 5068 is displayed at the right end of the virtual channel 5064.

In some embodiments, the unlocked object 5066 and the unlocked camera object 5068 can be dragged to a position adjacent to each other object in the virtual channel 5064, respectively. For example, FIG. 5G shows a gesture 5070 detected on an unlocked object 5066. The gesture 5070 is to move toward the right end of the virtual channel 5064 with a movement 5072. In response to the gesture 5070 and the detection of the corresponding movement 5072, the unlocked object 5066 moves in the virtual channel 5064 toward the unlocked camera object 5068 until it is adjacent to the position of the unlocked camera object 5068, as shown in FIG. 5H.

FIG. 5I shows a schematic action 5074 detected on the unlocked camera object 5068. The gesture 5074 is to move 5076 toward the right end of the virtual channel 5064. In response to the detection of the gesture 5074 and the corresponding movement 5076, the unlocked camera object 5068 moves in the virtual channel 5064 toward the unlocked object 5066 until it is adjacent to the position of the unlocked object 5066, as shown in FIG. 5J.

When the unlocked object 5066 is adjacent to the unlocked camera object 5068, a gesture 5070 can be released, as shown in FIG. 5H. If the device 100 is in a locked password protection state when the action 5070 is released, in response to the release of the action 5070, a password key-in user interface 5022 is displayed (as shown in FIG. 5C), and the user must enter the correct password to unlock the device 100. If the device 100 is in a locked and non-password protected state when the action 5070 is released, then in response to the release of the action 5070, the device 100 is unlocked, and the user interface displayed when the device is in the locked state (for example, the user interface 400, FIG. 4A) can be displayed on the touch screen 112.

Similarly, when the unlocked camera object 5068 is adjacent to the unlocked object 5066, a gesture 5074 can be released, as shown in FIG. 5J. In response to the release of the gesture 5074, if the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed, as shown in FIG. 5D. If the device 100 is in a locked and non-password protected state, the device 100 is unlocked, the camera application 143 starts in the unrestricted operation phase, and the camera interface 5026 is displayed (as shown in FIG. 5D) without the restricted operation phase The limit.

In some other embodiments, the unlocked object 5066 and the unlocked camera object 5068 can each be dragged to a position previously occupied by another object (wherein the other object ceases to be displayed). For example, in response to the detection of the gesture 5070 and the corresponding movement 5072, the unlocked object 5066 moves in the virtual channel 5064 toward the unlocked camera object 5068 until the right end of the virtual channel 5064 of the unlocked camera object 5068 is previously positioned, as shown in Figure 5K to Shown in 5L. On the contrary, in response to the detection of the gesture 5074 and the corresponding movement 5076, the unlocked camera object 5068 moves in the virtual channel 5064 toward the unlocked object 5066 until the left end of the virtual channel 5064 of the unlocked object 5066 is previously positioned, as shown in FIGS. 5M to 5N .

In some embodiments, as the gesture 5070 and movement 5072 are detected, the unlocked camera object 5068 fades out, as shown in FIG. 5K. On the contrary, as the gesture 5074 and the movement 5076 are detected, the unlocked object 5066 fades out, as shown in FIG. 5M.

In some other embodiments, the unlocked object 5066 and the unlocked camera object 5068 move in unison. As the unlocked object 5066 moves to the right end of the virtual channel 5064, the unlocked camera object 5068 does not fade out, but moves to the right. As the unlocked object 5066 moves to the right, it crosses the boundary of the virtual channel 5064 and leaves the view, as shown in FIG. 50 Shown. On the contrary, as the unlocked camera object 5068 moves to the left end of the virtual channel 5064, the unlocked object 5066 does not fade out, but moves to the left, so that as the unlocked camera object 5068 moves to the left, it crosses the boundary of the virtual channel 5064 and leaves the view. As shown in Figure 5P.

In some other embodiments, as the unlocked object 5066 moves to the right end of the virtual channel 5064, the unlocked camera object 5068 remains in place, and as the unlocked object 5066 moves to the right end of the virtual channel 5064, it overlaps with the unlocked camera object 5068 ( And swipe to unlock the camera object 5068) (not shown). As the unlocked camera object 5068 moves to the left end of the virtual channel 5064, the unlocked object 5066 remains in place, and as the unlocked camera object 5068 moves to the left end of the virtual channel 5064, it overlaps with the unlocked object 5066 (and passes over the unlocked object 5066) (Not shown).

When the unlocked object 5066 is at the right end of the virtual channel 5064, the gesture 5070 can be released, as shown in FIG. 5L. If the device 100 is in the locked password protection state, in response to the gesture 5070 to release, a password keying user interface 5022 is displayed (as shown in FIG. 5C), and the user must key in the correct password to unlock the device 100. If the device 100 is in a locked non-password protected state, in response to the release of the gesture 5070, the device 100 is unlocked, and the user interface displayed when the device is in the locked state (for example, the user interface 400, FIG. 4A) can be displayed on Touch screen 112.

When the unlocked camera object 5068 is at the left end of the virtual channel 5064, a gesture 5074 can be released, as shown in FIG. 5N. In response to the release of the gesture 5074, if the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed, as shown in FIG. 5D. If the device 100 is in a locked and non-password protected state, the device 100 is unlocked and the camera application 143 starts to operate in an unrestricted manner During the stage, and the camera interface 5026 is displayed (as shown in FIG. 5D), there is no limitation of the restricted operation stage.

From the camera interface 5026, the camera album image viewer interface 5042 and the camera album thumbnail interface 5056 can be accessed, as described above with reference to FIGS. 5D to F. For the sake of simplicity, these details are not repeated here.

FIG. 5Q illustrates the locking device interface 5000-C displayed on the touch screen 112 when the device 100 is in the locked state. In the locking device interface 5000-C, a virtual channel 5080 is displayed, and the unlocking object 5078 is displayed at the left end of the virtual channel 5080. The gesture 5082 and its corresponding movement 5084 can be detected on the unlocked object 5078. In response to the gesture 5082 and the detection of the movement 5084, the unlocked object 5078 moves in the virtual channel 5080 according to the direction of the movement 5084 to the right end of the virtual channel 5080.

When the unlocked object 5078 is at the right end of the virtual channel 5084, the gesture 5084 can be released. If the device 100 is in the locked password protection state, in response to the gesture 5082 to release, a password keying user interface 5022 is displayed (as shown in FIG. 5C), and the user must key in the correct password to unlock the device 100. If the device 100 is in a locked and non-password protected state, in response to the release of the gesture 5082, the device 100 is unlocked, and the user interface displayed when the device is in the locked state (for example, the user interface 400, FIG. 4A) can be displayed on Touch screen 112.

The locking device interface 5000-C includes a predefined area 5086. A plurality of page indicators 5088 are displayed in the area 5086. The page indicator 5088 indicates that the user can perform gesture actions on the area 5086 to switch between "pages". For example, the "page" shown in Figure 5Q is the second of the three "pages". The indicator 5088-B is different from the other indicators 5088-A and 5088-C and is colored or eye-catching. . In some embodiments, the second "page" includes information such as the current time and date, as shown in FIG. 5Q.

In some embodiments, one or more of the page indicators 5088 are shaped to indicate association with respective applications. For example, the indicator 5088-C is shaped as a camera It shows that the third "page" is related to the camera application 143 or camera functionality on the device 100 in a certain way.

A gesture of roughly horizontal movement can be detected on the area 5086. For example, in FIG. 5Q, when the second "page" is displayed, the gesture 5090 and the movement 5092 can be detected on the area 5086. In response to the detection of the gesture 5090 and the corresponding movement 5092, the second "page" is replaced, and the first "page" is displayed on the touch screen 112, as shown in FIG. 5R. According to the page change, the indicators 5088-A and 5088-B change color or highlight to indicate that the first "page" is currently displayed. In some embodiments, the first "page" includes media playback control items 5093 (for example, play/pause, next track, previous track, etc.) and a volume indicator column 5091. When the first "page" is displayed, if a gesture similar to the gesture 5090 but moving in the opposite direction to the movement 5092 is detected, the second "page" is displayed in response.

Returning to FIG. 5Q, when the second "page" is displayed, the gesture 5094 and the movement 5096 can be detected on the area 5086. Movement 5096 has the opposite direction of movement 5090. In response to the detection of gesture 5094 and corresponding movement 5096, the second "page" is replaced and the third "page" is displayed, as shown in FIG. 5S. According to the page change, the indicators 5088-B and 5088-C change color or highlight to indicate that the third "page" is currently displayed. When the third "page" is displayed, if a gesture similar to gesture 5094 but moving in the opposite direction to movement 5096 is detected, the second "page" is displayed in response.

The third "page" displayed on the touch screen 112 includes a camera icon 5098, as shown in FIG. 5S. The gesture can be detected on the camera icon 5098 (for example, click gesture 5100). In response to the detection of the gesture 5100 on the diagram 5098, if the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed, as shown in FIG. 5D. If the device 100 is in a locked and non-password protected state, the device 100 is unlocked, the camera application 143 starts in the unrestricted operation phase, and the camera interface 5026 is displayed (as shown in FIG. 5D) without the restricted operation phase Limit system. From the camera interface 5026, the camera album image viewer interface 5042 and the camera album thumbnail interface 5056 can be accessed, as described above with reference to FIGS. 5D to F. For the sake of simplicity, these details are not repeated here.

FIG. 5T illustrates the locked device interface 5000-D displayed on the touch screen 112 when the device 100 is in the locked state. In the locking device interface 5000-D, a virtual channel 5080 is displayed, and the unlocked object 5078 is displayed at the left end of the virtual channel 5080. The unlocking object 5078 can interact with a gesture of use (eg, gesture 5082, FIG. 5Q) to unlock the device 100. For the sake of simplicity, these details are not repeated here.

The locking device interface 5000-D includes a predefined area 5102. A plurality of page indicators 5104 are displayed in the area 5102. The page indicator 5104 indicates that the user can perform gesture actions on the area 5102 to switch between "pages". For example, the "page" shown in FIG. 5T is the second of the three "pages". The indicator 5104-B is different from the other indicators 5104-A and 5104-C and is colored or eye-catching. . In some embodiments, the second "page" includes information such as the current time and date, as shown in FIG. 5T.

In some embodiments, one or more of the page indicators 5104 are shaped to indicate the association with respective applications. For example, the indicator 5104-A is shaped as a camera to indicate that the first "page" is associated with the camera application 143 or camera functionality on the device 100 in a certain way.

A gesture of substantially horizontal movement can be detected on the area 5102. For example, in FIG. 5T, when the second "page" is displayed, the gesture 5106 and the movement 5108 can be detected on the area 5102. In response to the gesture 5106 and the detection of the corresponding movement 5108, the camera application 143 starts in the restricted operation phase, and replaces the locking device interface 5000-D, and the camera interface 5026 is displayed, as shown in FIG. 5D. In some embodiments, when the camera interface 5026 is displayed, if a gesture similar to the gesture 5106 but moving in the opposite direction to the movement 5108 is detected, the second "page" (that is, Locking device interface 5000-D, as shown in Figure 5T).

Returning to FIG. 5T, when the second "page" is displayed, the gesture 5110 and the movement 5112 can be detected on the area 5102. In response to the detection of the gesture 5110 and the corresponding movement 5112, the second "page" is replaced, and the third "page" is displayed on the touch screen 112, as shown in FIG. 5U. According to the page change, the indicators 5104-B and 5104-C change color or highlight to indicate that the third "page" is currently displayed. In some embodiments, the third "page" includes media playback control items 5090 (for example, play/pause, next track, previous track, etc.) and a volume indicator column 5091. When the third "page" is displayed, if a gesture similar to gesture 5110 but moving in the opposite direction to movement 5112 is detected, the second "page" is displayed in response.

FIG. 5V illustrates the locking device interface 5000-E displayed on the touch screen 112. The locking device interface 5000-E includes an unlocking object 5078 and a channel 5080, both of which have been described above with reference to FIG. 5Q, and these details are not repeated here. The locking device interface 5000-E also includes an area 5114, where information such as the current date and time can be displayed.

The area 5114 also includes the unlocked camera object 5116, as shown in FIG. 5V. FIG. 5V also shows the contact corresponding to the gesture 5118 detected on the unlocked camera object 5116. In response to the detection of the contact corresponding to the gesture 5118, a virtual channel 5119 is displayed, in which the unlocked camera object 5116 is located at the left end to indicate that the unlocked camera object 5116 can be dragged to the right end of the channel 5119, as shown in FIG. 5W. In response to the gesture 5118 of moving in the direction 5220 toward the right end of the channel 5119, the unlocked camera object 5116 moves toward the right end of the channel 5119 according to the movement 5220. When the unlocked camera object 5116 is at the right end of the channel 5119 and the action 5118 is released, if the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed, as shown in FIG. 5D Shown. If the device 100 is in a locked and non-password protected state, the device 100 is unlocked, the camera application 143 starts in the unrestricted operation phase, and the camera interface 5026 is displayed (as shown in FIG. 5D) without the restricted operation phase The limit.

Figure 5X illustrates the locking device interface 5000-F. Locking device interface 5000-F includes unlocking Object 5078 and virtual channel 5080, and unlock camera object 5224 and virtual channel 5222. The unlocked camera object 5224 is initially located near the channel 5222 or in the center of the channel 5222. At the end of the channel 5222, there are a still camera icon 5226 and a video camera icon 5228. The still camera icon 5226 corresponds to the still image capturing mode of the camera application 143. The video camera icon 5228 corresponds to the video capture mode of the camera application 143.

The gesture 5230 can be detected on the unlocked camera object 5222, and the gesture 5230 can be moved with a movement 5232 toward the still camera icon 5226, or with a movement 5234 toward the video camera icon 5228. In response to the detection of the gesture 5230 and the movement 5232, the unlocked camera object 5224 moves in the channel 5222 toward the still camera icon 5226 according to the movement 5232. In response to the detection of the gesture 5230 and the movement 5234, the unlocked camera object 5224 moves in the channel 5222 toward the video camera icon 5228 according to the movement 5234.

When the unlocked camera object 5224 is at any end of the channel 5222, the gesture 5230 can be released. If the unlocking camera object 5224 is located at the end of the channel 5222 with the still camera icon 5226, the gesture 5230 is released and the device 100 is locked and password protected, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed in the still image capture mode, as shown in Figure 5D. If the unlocking camera object 5224 is located at the end of the channel 5222 with the still camera icon 5226, the gesture 5230 is released and the device 100 is in a locked and non-password protected state, the device 100 is unlocked and the camera application 143 starts to operate in an unrestricted manner In the stage, and the camera interface 5026 is displayed (as shown in FIG. 5D) in the still image capturing mode, without the restriction of the restricted operation stage. If the unlocking camera object 5224 is at the end of the channel 5222 with the video camera icon 5228 and the gesture 5230 is released and the device 100 is locked and password protected, the camera application 143 starts in the restricted operation phase and the camera interface 5026 is displayed in the image capture mode. If the unlocking camera object 5224 is at the end of the channel 5222 with the video camera icon 5228 and the gesture 5230 is released and the device 100 is in a locked and non-password protected state, the device 100 is unlocked and the camera application 143 starts to operate in an unrestricted manner Stage, and the camera interface 5026 is displayed (as shown in Figure 5D) in the video capture mode without the restriction of the restricted operation phase.

5Y illustrates the locking device interface 5000-G, which is similar to the locking device interface 5000-F, but with a smaller unlocked camera object 5238, a channel 5236, a still camera icon 5040, and a video camera icon 5242. The unlocked camera object 5238 can interact in a similar manner to the unlocked camera object 5224 (FIG. 5X) to access the camera interface 5026 in the still image capture mode or the video capture mode.

Figure 5Z illustrates the locking device interface 5000-H. The locking device 5000-H includes a virtual channel 5244, an unlocking object 5246 at the left end of the virtual channel 5244, and an unlocking camera object 5248.

The gesture 5250 and the corresponding movement 5252 can be detected on the unlocked object 5246. In response to the motion 5250 and the detection of the movement 5252, the unlocking object 5246 moves toward the right end of the channel 5244. When the unlocking object 5246 is located at the right end of the channel 5244 and the action 5250 is released, if the device 100 is in the locked password protection state, the password input user interface 5022 is displayed, as shown in FIG. 5C.

In comparison, a gesture 5254 can be detected when the camera object 5248 is unlocked, as shown in FIG. 5AA. In response to the detection of the contact corresponding to the gesture 5254 on the unlocked camera object 5248, an animation showing the following situation can be displayed: the length of the channel 5244 is reduced, and the virtual channel 5256 appears and extends. An example of this animation is illustrated in Figure 5BB middle. As long as the contact corresponding to the gesture 5254 is continuously detected on the unlocked camera object 5248, the animation continues. When the animation is completed, the channel 5244 stops displaying, and the channel 5256 is displayed with its full length, and the unlocked camera object 5248 is located at the right end of the channel 5256, as shown in FIG. 5CC.

When the gesture 5254 is detected on the unlocked camera object 5248, the gesture 5254 can move toward the left end of the channel 5256, as shown in FIG. 5CC. In response to the detection of the movement 5258, the unlocked camera object 5248 moves toward the left end of the channel 5256 according to the movement 5258. When the unlocked camera object 5248 is located at the left end of the channel 5256 and gesture 5254 is released, if it is installed Set 100 to the locked password protection state, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed, as shown in FIG. 5D. If the device 100 is in a locked and non-password protected state, the device 100 is unlocked, the camera application 143 starts in the unrestricted operation phase, and the camera interface 5026 is displayed (as shown in FIG. 5D) without the restricted operation phase The limit.

FIG. 5DD illustrates the locking device interface 5000-I displayed on the touch screen 112. The locking device interface 5000-I includes a virtual channel 5260 and an unlocking object 5262 located at the left end of the virtual channel 5260.

The gesture 5264 and the corresponding movement 5266 can be detected on the unlocked object 5262. In response to the detection of the gesture 5264 and the corresponding movement 5266, the unlocked object 5262 moves toward the right end of the channel 5260 according to the movement 5266, as shown in FIG. 5EE.

When the unlocked object 5264 moves from the left end of the channel 5260 to about the middle of the channel 5260, the camera icon 5268 can be displayed at the left end of the channel 5260. At this time, the gesture 5264 can be moved toward the right end of the channel 5260 or in the opposite direction by a movement 5266, and toward the left end of the channel 5260 by a movement 5270.

When the unlocked object 5264 is located at the right end of the channel 5260 after moving to the right end of the channel 5260 according to the movement 5266 and then gestures action 5264 to release, if the device 100 is in the locked password protection state, the password input user interface 5022 is displayed, as shown in the figure Shown in 5C.

When the unlocked object 5264 moves to the left end of the channel 5260 according to the movement 5270 and then returns to the left end of the channel 5260 and then gestures action 5264 to release, if the device 100 is in the locked password protection state, the camera application 143 starts to operate in a restricted mode In the stage, and the camera interface 5026 is displayed, as shown in FIG. 5D. If the device 100 is in a locked and non-password protected state, the device 100 is unlocked, the camera application 143 starts in the unrestricted operation phase, and the camera interface 5026 is displayed (as shown in FIG. 5D) without the restricted operation phase The limit.

FIG. 5GG illustrates the locking device interface 5000-J displayed on the touch screen 112 of the device 100. When the device 100 is in the locked state, when the physical buttons on the device 100 (for example, pressing the button 206, the home page or the menu button 204) are activated by the user, the locking device interface 5000-J can be displayed, which is the same as the other locking device interfaces mentioned above Same as 5000. The locked device interface 5000-J may include a message informing the user that the device is locked and other information (for example, the current time and date).

The locking device interface 5000-J includes an unlocked object 5276, a virtual channel 5274, and a camera access mark 5006. The camera access mark 5006 includes icons 5008 and 5010, which have been described above with reference to FIG. 5A. The unlocked object 5276, the channel 5274, and the camera access mark 5006 can be displayed in the predefined area 5272.

A gesture 5278 can be detected on the unlocked object 5276. Show action 5278 to move 5280. In response to the detection of the gesture 5278 and the corresponding movement 5280, the unlocked object 5276 moves in the virtual channel 5274 toward the right end of the channel 5274. When the unlocked object 5276 moves to the right end of the channel 5274 and then gestures 5278 to release, in response to the detection of the release of gesture 5278, if the device 100 is in the locked password protection state, the password input user interface 5022 is displayed, as shown in the figure Shown in 5C.

The gesture 5282 can be detected on the camera access mark 5006. Instruct action 5282 to move with movement 5284. In response to the detection of the gesture 5282 and the determination that the gesture 5282 starts on the camera access mark 5006, if the device 100 is locked and password protected, the area 5272 expands according to the direction of the movement 5284 (for example, in the form of an animation) , As shown in FIG. 5HH, and transformed into the camera interface 5026 of the camera application 143 starting in the restricted operation phase (FIG. 5D). When the movement 5284 is completed (for example, reaching the top of the touch screen 112) and the gesture 5282 is released, the lock device interface 5000-J stops displaying, and the camera interface 5026 is displayed on the touch screen in the restricted operation phase for the camera application 143. Control screen 112. In response to the detection of the gesture 5282 and the determination that the gesture 5282 starts on the camera access mark 5006, if the device 100 is in a locked and non-password protected state, the zone The domain 5272 expands according to the direction of the movement 5284 (for example, in an animation form), as shown in FIG. 5HH, and transforms into the camera interface 5026 of the camera application 143 starting in the unrestricted operation phase (FIG. 5D). When the movement 5284 is completed (for example, reaching the top of the touch screen 112) and the gesture 5282 is released, the lock device interface 5000-J stops displaying, and the camera interface 5026 is displayed in the unrestricted operation stage for the camera application 143 Touch screen 112.

In some embodiments, a gesture can be performed on the camera access mark 5006 (FIG. 5KK) (for example, click the gesture 5304, FIG. 5KK). In response to the detection of a click gesture on the camera access mark 5006, an animation of the locking device interface 5000-J can be displayed (for example, FIG. 5LL to FIG. 5NN). In the form of animation, the locking device interface 5000-J moves or pans as if it pops off the bottom edge of the touch screen 112 to partially reveal the interface corresponding to the camera application 143 (for example, the camera interface 5026, Fig. 5MM) and then returns to Its position before the animation. The portion exposed in response to the detection of the gesture action provides the user with an instruction that the user can interact with the camera access mark 5006 (for example, by executing the gesture action 5016 or 5282) to activate the camera application 143.

Alternatively, the locking device interface 5000-J may include a camera icon 5286 instead of the camera access mark 5006, as shown in FIG. 5II. In response to the detection of the gesture on the camera icon 5286 (for example, click gesture 5288), if the device 100 is locked and password protected, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 is displayed, as shown in Figure 5D. In response to the detection of the gesture on the camera icon 5286 (for example, click gesture 5288), if the device 100 is in a locked and non-password protected state, the camera application 143 starts in an unrestricted operation phase, and The camera interface 5026 is displayed (as shown in FIG. 5D) without the restriction of the restricted operation stage.

FIG. 5JJ illustrates the locking device interface 5000-K displayed on the touch screen 112. The locking device interface 5000-K includes a virtual channel 5290 and an unlocking object 5292 located near or in the middle of the virtual channel 5290. At the end of channel 5290, there are camera icons 5294 and lock icon 5296.

The gesture 5298 can be detected on the unlocked object 5292, and the gesture 5298 can be moved toward the camera icon 5294 by the movement 5302, or moved toward the lock icon 5296 by the movement 5300. In response to the motion 5298 and the detection of the movement 5302, the unlocked object 5292 moves in the channel 5290 toward the camera icon 5294 according to the movement 5302. In response to the detection of the gesture 5298 and the movement 5300, the unlocked object 5292 moves in the channel 5290 toward the lock icon 5296 according to the movement 5300.

When the unlocking object 5292 is at any end of the channel 5290, the gesture 5298 can be released. If the unlocked object 5292 is at the end of the channel 5290 with the camera icon 5294 and the gesture 5298 is released and the device 100 is in a locked password protected state, the camera application 143 starts in the restricted operation phase, and the camera interface 5026 displays In the still image capturing mode, as shown in Figure 5D. If the unlocking object 5292 is located at the end of the channel 5290 with the camera icon 5294 and the device 100 is in a locked and non-password protected state, the device 100 is unlocked and the camera application 143 starts in the unrestricted operation stage when the gesture 5298 is released , And the camera interface 5026 is displayed (as shown in FIG. 5D) without the restriction of the restricted operation stage. If the unlocked object 5292 is located at the end of the channel 5290 with the lock icon 5296 and the device 100 is in the locked password protection state, the password input user interface 5022 is displayed, as shown in FIG. 5C.

FIG. 5OO illustrates the locking device interface 5000-L displayed on the touch screen 112 of the device 100. When the device 100 is in the locked state, when the physical buttons on the device 100 (for example, pressing the button 206, the home page or the menu button 204) are activated by the user, the locking device interface 5000-L can be displayed, which is the interface of the other locking devices mentioned above Same as 5000. The locked device interface 5000-L may include a message informing the user that the device is locked and other information (for example, the current time and date).

The locking device interface 5000-L includes an unlocked object 5276, a virtual channel 5274, and an application program access mark 5406. The application access mark 5406 includes icons 5408 and 5010. picture The indication 5408 indicates the application program associated with the application program access flag 5406. For example, the icon 5408 shown in FIG. 5OO depicts a camera; the application access flag 5406 is associated with the camera application 143. Other applications that can be associated with the application access flag 5406 include, for example, a notification application 165, an email application 140, or a phone application 138. Diagram 5010 has been described above with reference to FIG. 5A. The unlocked object 5276, the channel 5274, and the application access mark 5406 can be displayed in the predefined area 5402. In some embodiments, the camera icon 5416 and the video icon 5418 are also displayed in the locking device interface 5000-L.

FIG. 5OO shows a schematic action 5412 detected on the touch screen 112. The gesture 5412 is detected as starting from the application access flag 5406. Indicates action 5412 to move 5414 toward the illustration 5416. In response to the detection of the gesture 5412 and the determination that the gesture 5412 starts on the application access mark 5406, the lock device interface 5000-L stops displaying. If the device 100 is in the locked password protection state, the camera application 143 (the application associated with the application access mark 5406) starts in the still image capturing mode (if set to switch the still image mode) in the restricted operation phase The switch 5032 indicates), and the corresponding interface 5026 is displayed, as shown in FIG. 5QQ, and other applications except the camera application 143 are maintained in a locked password protection state. If the device 100 is in the locked and non-password protected state, the camera application 143 starts in the still image mode in the unrestricted operation phase, and the corresponding interface 5026 is displayed. In some embodiments, the interface 5026 may be displayed in the form of an animation, where the locking device interface 5000-L pans out of the screen according to the direction of the movement 5414, and the interface 5026 pans out of the screen as more and more parts of the interface 5000-L pan out of the screen. Revealed, as shown in Figure 5OO to Figure 5QQ.

FIG. 5RR shows the gesture 5422 detected on the touch screen 112. The gesture 5422 is detected as starting from the application access flag 5406. Indicate action 5422 to move 5424 toward the illustration 5418. In response to the detection of the gesture 5422 and the determination that the gesture 5422 starts on the application access mark 5406, the lock device interface 5000-L stops displaying. If the device 100 is in the locked password protection state, the camera application 143 (the application associated with the application access mark 5406) will start in the video capture mode during the restricted operation phase (for example, the switch 5032 is set to the video mode) Indicated), and the corresponding interface 5026 is displayed, as shown in FIG. 5TT, and other applications except the camera application 143 are maintained in a locked password protection state. For example, in FIG. 5TT, the button 5030 in the interface 5026 is now a video recording start/pause button. If the device 100 is in a locked and non-password protected state, the camera application 143 starts in the image mode during the unrestricted operation phase, and the corresponding interface 5026 is displayed. In some embodiments, the interface 5026 may be displayed in the form of an animation, where the locking device interface 5000-L pans out of the screen according to the direction of movement 5424, and the interface 5026 pans out of the screen as more and more parts of the interface 5000-L pan out of the screen. Reveal, as shown in Figure 5RR to Figure 5TT.

In FIGS. 5OO to 5TT, the camera application 143 starts in different modes, that is, starts in the still image mode in FIG. 5QQ, and starts in the video mode in FIG. 5TT. The starting mode of the camera application 143 is determined by the type of gesture detected as starting on the application access mark 5406. The gesture 5412 (FIG. 5OO) and the gesture 5422 (FIG. 5RR) are different types of gestures. In some embodiments, different types of gestures include different paths of movement of contacts in the gesture. For example, gesture 5412 includes movement 5414, which is a substantially vertical path, and gesture 5422 includes movement 5424, which has a diagonal path different from the substantially vertical path of movement 5414. In response to the determination that the gesture 5412 is a type with a vertical path, the camera application 143 starts in the still image mode. In response to the determination that the gesture 5422 is a type with a diagonal path, the camera application 143 starts in the video mode. As another example, the movement 5414 of the gesture 5412 may have a substantially vertical path as shown in the figure, and the movement 5424 of the gesture 5422 may have a substantially horizontal path (for example, to the left or to the left depending on the specific implementation). Drag to the right).

In some other embodiments, different types of gestures include one of the gestures The different positions where the movement of the contact ends. For example, in the gesture 5412 (FIGS. 5OO-5PP), the contact is shown as moving toward the camera icon 5416, and the contact ends at the area of the camera icon 5416 (for example, on the camera icon 5416) When touching the position of the screen 112), it indicates that the action 5412 is completed. In schematic action 5422 (FIGS. 5RR to 5SS), the contact is shown as moving toward the video icon 5418, and the contact ends at the area of the camera icon 5418 (for example, the touch screen 112 on the camera icon 5418 Position), signal that Action 5422 is complete.

In some other embodiments, different types of gestures include different numbers of contacts in the gesture. For example, the gesture 5412 (FIGS. 5OO-5PP) includes a contact. On the other hand, the gesture 5454 (FIG. 5FFF to FIG. 5GGG) includes two contacts, which move together in movement 5456. In response to the detection of the gesture 5454 and the determination that the gesture 5454 starts on the application access mark 5406, the lock device interface 5000-L stops displaying. If the device 100 is in the locked password protection state, the camera application 143 starts in the video mode during the restricted operation phase, and the corresponding interface 5026 is displayed, as shown in FIG. 5TT, and other than the camera application 143 The application remains in a locked password protected state. If the device 100 is in a locked and non-password protected state, the camera application 143 starts in the image mode during the unrestricted operation phase, and the corresponding interface 5026 is displayed. In some embodiments, the interface 5026 may be displayed in the form of an animation, where the locking device interface 5000-L pans out of the screen according to the direction of the movement 5454, and the interface 5026 pans out of the screen as more and more parts of the interface 5000-L pan out of the screen. Revealed.

In some embodiments, the icon 5408 may change its appearance based on the type of gesture detected on the application access mark 5406 (for example, the movement path of the contact in the gesture, the number of contacts, etc.). For example, when a contact is detected on the application access mark 5406, as shown in FIG. 5412), the camera application 143 will start in the still image mode). When in the app access tag 5406 When two contacts are detected on the upper side, as shown in Figure 5FFF, icon 5408 can be animated to show a video camera instead of a still image camera (indicating if a gesture with these contacts is detected (for example, gesture 5454) , The camera application 143 will start the video mode). As another example, when the contact movement 5424 is detected instead of the contact 5414, the icon 5408 changes its appearance to show the video camera, as shown in FIGS. 5RR to 5SS. The appearance of icon 5408 can be animated.

FIG. 5UU shows a schematic action 5432 detected on the application access flag 5406. The gesture 5432 is a different type of gesture from the gesture 5412 and the gesture 5422. In some embodiments, the gesture 5432 is a click gesture. In response to the detection of the gesture 5432 on the application access mark 5406, the animation of the locking device interface 5000-L can be displayed (for example, Figure 5VV to Figure 5XX). In the form of animation, lock the device interface 5000-L to move or translate to partially reveal the interface corresponding to the camera application 143 in the first mode (for example, the camera interface 5026 in the still image mode) and then return to it in the animation The previous position. The portion exposed in response to the detection of the gesture 5432 provides the user with instructions that the user can interact with the application access flag 5406 (for example, by executing the gesture 5412) to activate the camera application 143 in the still image mode.

Figure 5YY shows a schematic action 5438 detected on the application access token 5406. The gesture 5438 is also a different type from the gesture 5412 and the gesture 5422, and may be the same type as the gesture 5432 (FIG. 5UU). In response to the detection of the gesture 5438 on the application access mark 5406, the animation of the locking device interface 5000-L can be displayed (for example, Figure 5ZZ to Figure 5BBB). In the form of animation, lock the device interface 5000-L to move or translate to partially reveal the interface corresponding to the camera application 143 in the second mode (for example, the camera interface 5026 in the video mode) and then return to it before the animation s position. The portion exposed in response to the detection of the gesture 5438 provides the user with an instruction that the user can interact with the application access flag 5406 (for example, by executing the gesture 5422) to activate the camera application 143 in the video mode.

In some embodiments, the animation of the locking device interface 5000-L includes the translation of the locking device interface 5000-L in one direction (for example, moving 5434, Figure VV or Figure 5ZZ) to partially reveal the interface 5026, and includes Translation in the opposite direction (for example, move 5436, Figure 5XX or Figure 5BBB) to hide interface 5026.

In some embodiments, the alternate click gesture on the application access mark 5406 partially reveals the interface 5026 in an alternate sequence in the still image mode and the video mode. For example, the detection of the gesture 5432 on the application access flag 5406 and the partial exposure of the interface 5026 in the static image mode in response can then be the detection of the gesture 5438 on the application access flag 5406 and In response, part of interface 5026 in the video mode is revealed. Therefore, clicking once on the application access mark 5406 will partially reveal the interface 5026 in the still image mode, and then clicking on the application access mark 5406 a second time will partially reveal the interface 5026 in the video mode. In some other embodiments, the click gesture with one touch on the application access mark 5406 will partially reveal the interface 5026 in the still image mode, and the application access mark 5406 has multiple touches (for example, The gesture of two touches will partially reveal the interface 5026 in the video mode.

Fig. 5CCC shows a schematic action 5444 detected on the application access flag 5406. The gesture 5444 is a different type of gesture from the gesture 5412 and the gesture 5422. In some embodiments, the gesture 5444 is a click and hold gesture. In response to the detection of the gesture 5444 on the application access mark 5406, the gesture of starting the camera application 143 in the still image mode (for example, gesture 5412) and the gesture of starting the camera application 143 in the video mode are respectively displayed Visual indications 5446 and 5448 for gestures (e.g. gesture 5414). The visual indicators 5446 and 5448 may include text, graphics (for example, arrows), or any combination of text and graphics.

FIG. 5EEE shows the schematic motion 5450 detected on the unlocked object 5276. Indicate action 5450 to move with movement 5452. Responding to the detection of gesture 5450 and corresponding movement 5452 Measured, the unlocked object 5276 moves in the virtual channel 5274 toward the right end of the channel 5274. When the unlocked object 5276 moves to the right end of the channel 5274 and then gestures action 5450 to release, in response to the detection of gesture 5450 release, if the device 100 is in the locked password protection state, the password input user interface 5022 is displayed, as shown in the figure Shown in 5C.

5HHH illustrates the locking device interface 5000-M displayed on the touch screen 112 of the device 100. When the device 100 is in the locked state, when the physical buttons on the device 100 (for example, pressing the button 206, the home page or the menu button 204) are activated by the user, the locking device interface 5000-M can be displayed, which is the same as the other locking device interfaces mentioned above Same as 5000. The locked device interface 5000-M may include a message informing the user that the device is locked and other information (for example, the current time and date).

The locking device interface 5000-M includes an unlocked object 5276 and a virtual channel 5274, a first access mark 5458, and a second access mark 5462. The first access mark 5458 includes the figures 5460 and 5010. Both the first access token 5458 and the second access token 5462 are associated with an application. As shown in the figure, the first access token 5458 and the second access token 5462 are associated with the camera application 143. Other applications that can be associated with the first access token 5458 and the second access token 5462 include, for example, a notification application 165, an email application 140, or a phone application 138. The icon 5460 indicates the first mode of the camera application 143 associated with the first access tag 5406. For example, the icon 5460 shown in FIG. 5HHH depicts a still image camera; the first access mark 5406 is associated with the still image capturing mode of the camera application 143. Diagram 5010 has been described above with reference to FIG. 5A. The unlocked object 5276, the channel 5274, and the application access mark 5406 can be displayed in the predefined area 5457. In some embodiments, the camera icon 5416 and the video icon 5418 are also displayed in the locking device interface 5000-M. In some embodiments, the camera icon 5416 and the video icon 5418 are not displayed in the locking device interface 5000-M.

FIG. 5HHH shows the gesture 5466 detected on the touch screen 112. The gesture 5466 is detected as starting from the first access flag 5458. Signal 5466 to move 5468 move. In response to the detection of the gesture 5466 and the determination that the gesture 5466 starts on the first access mark 5458, the locking device interface 5000-M stops displaying. If the device 100 is in the locked password protection state, the camera application 143 (the application associated with the first access mark 5458) starts in the still image capture mode (if set to switch the still image mode) in the restricted operation phase The switch 5032 indicates), and the corresponding interface 5026 is displayed, as shown in FIG. 5JJJ, and other applications except the camera application 143 are maintained in a locked password protection state. If the device 100 is in the locked and non-password protected state, the camera application 143 starts in the still image mode in the unrestricted operation phase, and the corresponding interface 5026 is displayed. In some embodiments, the interface 5026 may be displayed in the form of an animation, where the locking device interface 5000-M pans out of the screen according to the direction of movement 5468, and the interface 5026 pans out of the screen as more and more parts of the interface 5000-M pan out of the screen. Reveal, as shown in Figure 5HHH to Figure 5JJJ.

FIG. 5KKK shows the gesture 5470 detected on the touch screen 112. The gesture 5470 is detected as starting from the second access mark 5462. Signal action 5470 to move with movement 5472. In response to the detection of the gesture 5470 and the determination that the gesture 5470 starts on the second access mark 5462, the locking device interface 5000-M stops displaying. If the device 100 is in the locked password protection state, the camera application 143 (the application associated with the application access mark 5406) will start in the video capture mode in the restricted operation phase (for example, the switch 5032 is set to the video mode) Instructed), and the corresponding interface 5026 is displayed, as shown in FIG. 5MMM, and other applications except the camera application 143 are maintained in a locked password protection state. If the device 100 is in a locked and non-password protected state, the camera application 143 starts in the image mode during the unrestricted operation phase, and the corresponding interface 5026 is displayed. In some embodiments, the interface 5026 may be displayed in the form of animation, where the locking device interface 5000-M pans out of the screen according to the direction of movement 5472, and the interface 5026 pans out of the screen as more and more parts of the interface 5000-M pan out of the screen. Revealed, as shown in Figure 5KKK to Figure 5MMM.

In FIGS. 5HHH to 5MMM, the camera application 143 starts in different modes, that is, starts in the still image mode in FIG. 5HHH, and starts in the video mode in FIG. 5MMM. The start mode of the camera application 143 is determined by the detected access flag indicating the start of the action. The gesture 5466 (FIG. 5HHH) starts with the first access flag 5458, and therefore, the camera application 143 starts in the still image mode. The gesture 5470 (FIG. 5KKK) starts with the second access mark 5462, and therefore, the camera application 143 starts in the video mode.

FIG. 5NNN illustrates another example for launching the camera application 143 in the video mode with a gesture of detecting on the second access mark 5462. Figure 5NNN shows a schematic action 5470 starting on the second access mark 5462 and a generally horizontal movement 5474, rather than a generally vertical movement 5472 (Figure 5KKK). In response to the detection of gesture 5470 and movement 5474, the lock device interface 5000-M stops displaying. If the device 100 is in the locked password protection state, the camera application 143 (the application associated with the application access mark 5406) will start in the video capture mode in the restricted operation phase (for example, the switch 5032 is set to the video mode) Indicated), and the corresponding interface 5026 is displayed, as shown in FIG. 5MMM, and other applications except the camera application 143 are maintained in a locked password protection state. If the device 100 is in a locked and non-password protected state, the camera application 143 starts in the image mode during the unrestricted operation phase, and the corresponding interface 5026 is displayed. In some embodiments, the interface 5026 may be displayed in the form of animation, where the locking device interface 5000-M pans out of the screen according to the direction of movement 5472, and the interface 5026 pans out of the screen as more and more parts of the interface 5000-M pan out of the screen. Revealed, as shown in Figure 5000.

The gestures 5466 and 5470 can be of different types. In some embodiments, different types of gestures include different paths of movement of contacts in the gesture. For example, the gesture 5470 shown in FIG. 5NNN includes a substantially horizontal movement 5474, and the gesture 5466 in FIG. III includes a substantially vertical movement 5468.

In some other embodiments, different types of gestures include one of the gestures The different positions where the movement of the contact ends. For example, in gesture 5466 (FIGS. 5HHH to FIG. 5III), the contact is shown as moving toward the camera icon 5416, and the contact ends at the area of the camera icon 5416 (for example, on the camera icon 5416) When touching the position of the screen 112), it indicates that the action 5466 is completed. In gesture 5470 (FIGS. 5KKK to FIG. 5LLL), the contact is shown as moving toward the video icon 5418, and the contact ends at the area where the video icon 5418 ends (for example, the touch screen 112 on the video icon 5418 Position), signal action 5470 to complete.

In some other embodiments, different types of gestures include different numbers of contacts in the gesture. For example, gesture 5466 (Figure 5PPP) includes a contact. On the other hand, gesture 5476 (FIG. 5PPP) includes two contacts that move together in movement 5478. In a similar way to the way of responding to gesture 5470 (FIG. 5KKK), in response to the detection of gesture 5476, the camera application 143 is activated, and the interface 5026 is displayed in the video mode.

FIG. 5QQQ illustrates a schematic action 5480 detected on the first access token 5458. The gesture 5480 is a different type of gesture from the gesture 5466. In some embodiments, the gesture 5480 is a click gesture. In response to the detection of the gesture 5480 on the first access mark 5458, the animation of the locking device interface 5000-M can be displayed (for example, FIG. 5RRR). In the form of animation, the locking device interface 5000-M moves or pans in one direction (for example, direction 5484) to partially reveal the interface corresponding to the camera application 143 in the first mode (for example, the camera interface in the still image mode) 5026) and then return to its position before the animation in the opposite direction (for example, direction 5486). The portion exposed in response to the detection of the gesture 5480 provides the user with an instruction that the user can interact with the first access flag 5458 (for example, by executing the gesture 5466) to activate the camera application 143 in the still image mode.

FIG. 5QQQ also illustrates the schematic action 5482 detected on the second access token 5462. Gesture 5482 is a type of gesture that is different from gesture 5470 or gesture 5476. do. In some embodiments, the gesture 5482 is a click gesture. In response to the detection of the gesture 5482 on the second access mark 5462, the animation of the locking device interface 5000-M can be displayed (for example, FIG. 5SSS). In the form of animation, the locking device interface 5000-M moves or pans in one direction (for example, direction 5488) to partially reveal the interface corresponding to the camera application 143 in the second mode (for example, the camera interface 5026 in the video mode) ) And then return to its position before the animation in the opposite direction (for example, direction 5490). In some embodiments, direction 5488 is orthogonal to direction 5484, and direction 5490 is orthogonal to direction 5486. The portion exposed in response to the detection of the gesture 5482 provides the user with instructions that the user can interact with the second access marker 5462 (for example, by executing the gesture 5470) to activate the camera application 143 in the video mode.

Figure 5 TTT shows the motion 5492 detected on the unlocked object 5276. Indicate action 5492 to move with movement 5494. In response to the detection of the gesture 5492 and the corresponding movement 5494, the unlocked object 5276 moves in the virtual channel 5274 toward the right end of the channel 5274. When the unlocked object 5276 moves to the right end of the channel 5274 and then gestures the release of action 5492, in response to the detection of the release of gesture 5492, if the device 100 is in the locked password protection state, the password input user interface 5022 is displayed, as shown in the figure Shown in 5C.

In the above-mentioned FIG. 5OO to FIG. 5TTT, the application program access flag 5406, the first access flag 5458, and the second access flag 5462 are associated with the camera application program 143. It should be understood that in some embodiments, these access tokens may be associated with other applications, such as notification application 165, email application 140, or phone application 138. In the embodiment where the access tag is associated with the notification application 165, the first mode may be an incoming message notification mode, in which notifications of incoming messages (for example, text messages, emails, voice mails, missed calls) are displayed ; And the second mode can be a summary notification mode, which displays notifications of incoming messages and other notifications (for example, calendar appointments, tasks, reminders, notifications from other applications).

In the embodiment where the access tag is associated with the email application 140, the first mode The mode can be an inbox mode, which displays the received email messages in one or more email inboxes; and the second mode can be an email composition mode, which displays an interface for composing email messages.

In the embodiment where the access mark is associated with the phone application 138, the first embodiment may be a keypad mode, in which a keypad for typing in the dialed phone number is displayed; and the second mode may be a recent call list or a call Record mode, which displays the records of received calls, dialed calls, and missed calls. Alternatively, the second mode may be a voice mail mode, in which a list of voice mails is displayed and voice mails can be played.

6A to 6B illustrate a flowchart of a method 600 for accessing a camera application in a locked device according to some embodiments. The method 600 is executed on a portable multi-function device (for example, the device 300 in FIG. 3 or the portable multi-function device 100 in FIG. 1), which has a display, a touch-sensitive surface, and multiple applications ( Including the camera application). In some embodiments, the display is a touch screen display, and the touch-sensitive surface is located on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 600 may be combined, and/or the order of some operations may be changed.

As described below, the method 600 provides an intuitive way to quickly access the camera application in the locked device. The method can reduce the cognitive burden of the user when accessing the camera application in the locked device, thereby generating a more effective human-machine interface. For battery-powered electronic devices, enabling users to quickly and efficiently access the camera application in the locked device will save power and extend the time between battery charging.

When the device is in a locked password protection state (602), the device displays a lock screen interface on the touch-sensitive display. The lock screen interface includes a camera access mark (for example, an icon or other graphic indicating the camera application) , Such as reference 5006) (604) in FIG. 5A. For example, when the device 100 is in a locked password protection state, the locked device interface 5000-A is displayed on the touch screen 112, as shown in FIG. 5A. The locking device interface 5000-A includes a camera access mark 5006.

In some embodiments, the camera access mark is displayed in a predefined area of the lock screen interface (606). For example, as shown in FIG. 5A, the camera access mark 5006 is displayed in an area 5012 in the locking device interface 5000-A.

The device detects the gesture on the touch-sensitive display (608). For example, in FIG. 5A, the gestures are detected (the gestures 5014 and 5018, which are gestures of the same type and the same direction of movement but starting from different positions).

In some embodiments, the gesture is a single finger sliding gesture (610). For example, the gesture 5014 (FIG. 5A) of moving by moving 5016 may be a single finger sliding gesture.

In some embodiments, the gesture includes continuous movement of a single finger in a predefined direction (612). For example, the gesture 5014 (FIG. 5A) is a gesture with a continuous movement 5016 of a single finger in a predefined direction (vertically upward on the display 112).

In some embodiments, the gesture includes continuous movement of a single finger along any desired path (614).

In some embodiments, the gesture is a single-finger click gesture (616). For example, instead of gestures 5014 and 5016 or gestures 5018 and 5020, gestures may be a single-finger click gesture on the camera access mark 5006 or away from the camera access mark 5006 (not shown).

The response to the gesture starts on the camera access mark (or in some embodiments, starts from the hidden click hit area of the camera access mark (such as the hidden click hit area surrounding the camera access mark) (Top) determination (618), the device stops displaying the lock screen interface (620), starts the restricted operation phase of the camera application (622), displays the camera application interface without displaying the password input interface (624) ), and maintain the device in the locked password protection state for applications other than the camera application in the device (626). For example, returning to FIG. 5A, in response to the determination that the gesture (signal action 5014) starts on the camera access mark 5006, if the device 100 is in a locked secret In the code protection state, the camera application 143 starts in the restricted operation phase, and the locking device interface 5000-A is replaced with the camera interface 5026 without displaying the password and typing in the user interface 5022 (FIG. 5C). Other applications on the device 100 (for example, the memo 153, the browser 147, etc.) are maintained in a locked password protection state.

In some embodiments, stopping the display of the lock screen interface and displaying the interface of the camera application includes an animation transition, such as sliding the lock screen interface out of the screen to reveal the interface of the camera application. While sliding the interface into the screen, slide the locked screen interface out of the screen, or flip the locked screen interface to the interface of the camera application. For example, the display area 5012 may be displayed expanded (FIG. 5B) and transformed into an animation of the camera interface 5026.

In response to the determination that the gesture started at a location other than the camera access mark on the touch-sensitive display, the device displays a password entry interface (628). In response to the typing of the correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications. For example, returning to FIG. 5A, in response to the determination that the gesture (for example, gesture 5018) starts at a position other than the camera access mark 5006, if the device 100 is in the locked password protection state, the password is displayed Type in the user interface 5022 (Figure 5C). If the correct password is entered in the password entry user interface 5022, the device 100 is unlocked.

Therefore, the same gesture will produce two different results depending on the starting position of the gesture. For example, the single-finger sliding gesture 5014 (FIG. 5A) starting on the camera access mark 5006 bypasses the password input interface and causes the camera application to be displayed immediately in the restricted operation phase. In contrast, a single-finger sliding gesture 5018 (FIG. 5A) started away from the camera access mark 5006 causes the password input interface to be displayed immediately.

In some embodiments, in response to the determination that the gesture starts at a location on the touch-sensitive display other than the camera access mark, a password key-in interface is displayed instead of the camera application interface (630) . For example, in response to gesture 5018 (Figure In the detection of 5A), display the password and enter the user interface 5022, but not display the camera interface 5026.

In some embodiments, in response to the determination that the gesture starts on the camera access flag, the device initializes one or more hardware components in a camera controlled by the camera application (632). For example, in response to the detection of the gesture 5014 on the camera access mark 5006, the hardware components of the camera on the device 100 (for example, the optical sensor 164) can be initialized.

In some embodiments, when the camera application is in the restricted operation phase (634), the camera application can present one or more generated by the camera application in the restricted operation phase. Images (636), and the camera application cannot present any images in the camera application that were not generated during the restricted operation phase (638). When the camera application 143 is in a restricted operation phase, the images and videos captured during the restricted operation phase can be viewed in the interface of the camera application 143 (for example, in the camera album image viewer interface 5042) , It is impossible to view images and videos captured outside the restricted operation phase (for example, images and videos captured when the device 100 is unlocked).

In some embodiments, when the device is in a locked password protected state, the device prevents the device from performing a predefined set of actions in response to detecting any contact with the touch-sensitive display that does not correspond to the gesture (For example, use the application on the device to perform actions) (640).

It should be understood that the specific order in which the operations in FIGS. 6A to 6B have been described is only exemplary, and it is not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the details of the other procedures described in the methods 700, 800, 900, 1000, and 1100 (for example, FIGS. 7 to 9, 10A to 10C, and 11A to 11C) are also applicable in a similar manner. The method 600 described above with reference to FIGS. 6A to 6B. For simplicity, These details are not repeated here.

FIG. 7 illustrates a flowchart of a method 700 for accessing a camera application in a locked device according to some embodiments. The method 700 is performed on a portable multi-function device (for example, the device 300 in FIG. 3 or the portable multi-function device 100 in FIG. 1), which has a display, a touch-sensitive surface, and multiple applications ( Including the camera application). In some embodiments, the display is a touch screen display, and the touch-sensitive surface is located on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 700 may be combined, and/or the order of some operations may be changed.

As described below, the method 700 provides an intuitive way to quickly access the camera application in the locked device. The method can reduce the cognitive burden of the user when accessing the camera application in the locked device, thereby generating a more effective human-machine interface. For battery-powered electronic devices, enabling users to quickly and efficiently access the camera application in the locked device will save power and extend the time between battery charging.

When the device is in a locked password protection state (702), the device displays a lock screen interface on the touch-sensitive display. The lock screen interface includes a camera access mark (for example, an icon or other graphic indicating a camera application) , Such as unlocking the camera object 5068 in FIG. 5G or the camera icon 5286 in FIG. 5II) and an unlocking mark (for example, an icon or other graphic indicating the unlocking functionality of the device, such as the unlocking object 5066 in FIG. 5G) (704 ). For example, when the device 100 is in a locked password protection state, the locked device interface 5000-B is displayed on the touch screen 112, as shown in FIG. 5G. The locking device interface 5000-B includes an unlocking object 5066 and an unlocking camera object 5068.

In response to detecting that it starts and ends on the camera access mark (or in some embodiments, starts and ends on the hidden click hit area of the camera access mark (such as the hidden point around the camera access mark) Select the gesture (706) on the hit area), the device stops displaying the lock screen interface (708), starts the restricted operation phase of the camera application (710), displays the interface of the camera application without displaying Password input interface (712), And for applications other than the camera application in the device, the device is maintained in the locked password protection state (714). In some embodiments, the gestures starting and ending on the camera access mark are click gestures on the camera access mark. In some embodiments, the gestures starting and ending on the camera access mark are drag gestures on the camera access mark, which move the camera access mark by itself or by other objects on the lock screen .

For example, in FIG. 5I, in response to the detection of the gesture 5074 on unlocking the camera object 5068 and the detection corresponding to the gesture 5076 (that is, the gesture starting on the unlocking of the camera object 5068), and when the camera is unlocked After the object 5068 moves to a predefined position (for example, adjacent to the unlocked object 5066 (Figure 5J) or the left end of the channel 5064 (Figure 5N)), the gesture 5074 of unlocking the camera object 5068 (that is, ending on unlocking the camera object 5068) If the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase, and the locked device interface 5000-B is replaced with the camera interface 5026 without displaying the password. Interface 5022 (Figure 5D). Other applications on the device 100 (for example, the memo 153, the browser 147, etc.) are maintained in a locked password protection state.

As another example, in FIG. 5II, in response to the detection of the click gesture 5288 on the camera icon 5286, if the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase , And the locking device interface 5000-J is replaced with the camera interface 5026 without displaying the password key-in user interface 5022 (Figure 5D). Other applications on the device 100 (for example, the memo 153, the browser 147, etc.) are maintained in a locked password protection state.

In some embodiments, stopping the display of the lock screen interface and displaying the interface of the camera application includes an animation transition, such as sliding the lock screen interface out of the screen to reveal the interface of the camera application. While sliding the interface into the screen, slide the locked screen interface out of the screen, or flip the locked screen interface to the photo The interface of the machine application program.

In response to detecting a gesture starting at the location associated with the unlocking mark on the touch-sensitive display, the device displays a password keying interface (716). In response to the typing of the correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

For example, returning to FIG. 5G to FIG. 5N, in response to the detection of the gesture 5070 on the unlocked object 5066 (that is, starting on the unlocked object 5066) and the movement of the unlocked object 5066 to a predefined position (for example, channel The right end of 5064, FIG. 5L, or adjacent to unlocking camera object 5068, FIG. 5H), indicates the subsequent release of action 5070. If the device 100 is in the locked password protection state, the password key-in user interface 5022 (FIG. 5C) is displayed. If the correct password is entered in the password entry user interface 5022, the device 100 is unlocked. (A similar response occurred in response to the gesture on the unlocked object 5276 in Figure 5II.)

Therefore, the single-finger sliding gesture 5074 (FIG. 5I) starting and ending on the unlocking camera icon 5068 bypasses the password input interface and causes the camera application to be displayed immediately in the restricted operation phase. In contrast, the single-finger sliding gesture 5070 (FIG. 5G) starting from the unlocked object 5066 causes the password typing interface to be displayed immediately.

It should be understood that the specific order in which the operations of FIG. 7 have been described is only illustrative, and it is not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the details of other procedures described herein regarding methods 600, 800, 900, 1000, and 1100 (for example, FIGS. 6A to 6B, 8 to 9, 10A to 10C, and 11A to 11C) The same applies to the method 700 described above with reference to FIG. 7 in a similar manner. For example, the locking device interface 5000-B described above with respect to the method 700 may have one or more of the characteristics of the locking device interface 5000-A described above with respect to the method 600. For the sake of simplicity, these details are not repeated here.

Figure 8 illustrates a camera application used in an access lock device according to some embodiments A flowchart of the method 800. The method 800 is executed on a portable multi-function device (for example, the device 300 in FIG. 3 or the portable multi-function device 100 in FIG. 1), which has a display, a touch-sensitive surface, and multiple applications ( Including the camera application). In some embodiments, the display is a touch screen display, and the touch-sensitive surface is located on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 800 may be combined, and/or the order of some operations may be changed.

As described below, the method 800 provides an intuitive way to quickly access the camera application in the locked device. The method can reduce the cognitive burden of the user when accessing the camera application in the locked device, thereby generating a more effective human-machine interface. For battery-powered electronic devices, enabling users to quickly and efficiently access the camera application in the locked device will save power and extend the time between battery charging.

When the device is in a locked password protection state (802), the device displays a lock screen interface on the touch-sensitive display. The lock screen interface includes a camera access mark (for example, an icon or other graphic indicating the camera application) , Such as the camera icon 5294 in FIG. 5JJ) and an unlock mark (for example, an icon indicating the unlocking functionality of the device or other graphics, such as the unlock icon 5296 in FIG. 5JJ) (804). For example, when the device 100 is in a locked password protection state, the locked device interface 5000-K is displayed on the touch screen 112, as shown in FIG. 5JJ. The locking device interface 5000-K includes a camera icon 5294 and an unlocking icon 5296.

In response to detecting that it ends on the camera access mark (or in some embodiments, ends on the hidden click hit area of the camera access mark (such as the hidden click hit area surrounding the camera access mark) In the gesture (806) of the above), the device stops displaying the lock screen interface (808), starts the restricted operation phase of the camera application (810), displays the interface of the camera application without displaying the password input interface ( 812), and maintain the device in the locked password protection state for applications other than the camera application in the device (814). For example, in FIG. 5JJ, a signal is detected on the unlocked object 5292 Action 5298. The gesture 5298 may move 5302 toward the camera icon 5294. In response to the detection of the movement 5302, the unlocked object 5292 moves toward the camera icon 5294. In response to the release of the gesture 5298 from the unlocked object 5292 after the unlocked object 5292 moves to the position of the camera icon 5294 (that is, the gesture ended on the camera icon 5294), if the device 100 is in the locked password protection state, Then the camera application 143 starts in the restricted operation phase, and the locking device interface 5000-K is replaced with the camera interface 5026 without displaying the password key-in user interface 5022 (FIG. 5D). Other applications on the device 100 (for example, the memo 153, the browser 147, etc.) are maintained in a locked password protection state.

In some embodiments, stopping the display of the lock screen interface and displaying the interface of the camera application includes an animation transition, such as sliding the lock screen interface out of the screen to reveal the interface of the camera application. While sliding the interface into the screen, slide the locked screen interface out of the screen, or flip the locked screen interface to the interface of the camera application.

In response to detecting a gesture ending at the location associated with the unlock mark on the touch-sensitive display, the device displays a password keying interface (816). In response to the typing of the correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications. Returning to FIG. 5JJ, the gesture 5298 can be moved 5300 toward the unlocking diagram 5296. In response to the detection of the movement 5300, the unlocking object 5292 moves toward the unlocking icon 5296. In response to the release of the gesture 5298 from the unlocking object 5292 after the unlocking object 5292 moves to the position of the unlocking icon 5296 (that is, the gesture ending on the unlocking icon 5296), if the device 100 is in the locked password protection state, The password is displayed and the user interface 5022 is entered (Figure 5C). If the correct password is entered in the password entry user interface 5022, the device 100 is unlocked.

Therefore, the single-finger sliding gesture 5298 (FIG. 5JJ) that ends on the camera icon 5294 by moving 5302 bypasses the password input interface and causes the camera application to be displayed immediately in the restricted operation phase. In contrast, it ends at unlocking icon 5296 to move The single-finger sliding gesture 5298 (Figure 5JJ) to move at 5300 causes the password input interface to be displayed immediately.

It should be understood that the specific order in which the operations of FIG. 8 have been described is only illustrative, and it is not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the details of other procedures described herein regarding methods 600, 700, 900, 1000, and 1100 (for example, Figures 6A to 6B, Figure 7, Figure 9, Figure 10A to Figure 10C, Figure 11A to Figure 11C) The same applies to the method 800 described above with reference to FIG. 8 in a similar manner. For example, the locking device interface 5000-K described above with respect to the method 800 may have one or more of the characteristics of the locking device interface 5000-A described above with respect to the method 600. For the sake of simplicity, these details are not repeated here.

FIG. 9 illustrates a flowchart of a method 900 for accessing a camera application in a locked device according to some embodiments. The method 900 is performed on a portable multi-function device (for example, the device 300 in FIG. 3 or the portable multi-function device 100 in FIG. 1), which has a display, a touch-sensitive surface, and multiple applications ( Including the camera application). In some embodiments, the display is a touch screen display, and the touch-sensitive surface is located on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 900 may be combined, and/or the order of some operations may be changed.

As described below, the method 900 provides an intuitive way to quickly access the camera application in the locked device. The method can reduce the cognitive burden of the user when accessing the camera application in the locked device, thereby generating a more effective human-machine interface. For battery-powered electronic devices, enabling users to quickly and efficiently access the camera application in the locked device will save power and extend the time between battery charging.

When the device is in a locked password-protected state (902), the device displays a lock screen interface on the touch-sensitive display. The lock screen interface includes a camera access mark (for example, an icon or other graphic indicating a camera application) , Such as the mark in Figure 5KK 5006)(904). For example, when the device 100 is in a locked password protection state, the locked device interface 5000-J is displayed on the touch screen 112, as shown in FIG. 5KK. The locking device interface 5000-J includes a camera access mark 5006.

The device detects the gesture on the touch-sensitive display (906). For example, in FIG. 5GG, the gesture 5278 or 5282 is detected, and in FIG. 5KK, 5304 is detected.

The response to the gesture starts on the camera access mark (or in some embodiments, starts from the hidden click hit area of the camera access mark (such as the hidden click hit area surrounding the camera access mark) (Top) and is the first type (for example, click to indicate an action), the device partially reveals the interface of the camera application program (908). In some embodiments, in response to the determination that the gesture starts on the camera access mark and is the first type, the device translates the lock screen interface (for example, to partially reveal the interface of the camera application) (909) . For example, in FIG. 5KK, in response to the determination that the gesture (action 5304) starts on the camera access mark 5006 and is the first type (for example, click the gesture), the screen interface 5000-J is locked Pan 5306 upwards to reveal part of the camera interface 5026, as shown in Figure 5LL. The upward translation of the locked screen interface 5000-J reaches the top, as shown in FIG. 5MM, and the locked screen interface 5000-J returns to its original position on the display 112 and shifts downward 5308, as shown in Figure 5NN. For example, the upward panning and the downward panning can be part of the animation of the lock screen interface 5000-J that bounces off the bottom edge of the display 112.

In some embodiments, the device translates the lock screen interface in a first direction to partially reveal the interface of the camera application, and then translates the lock screen interface in a direction opposite to the first direction to eliminate the The display of the partially exposed interface of the camera application. This movement provides the user with a quick glance at the interface of the camera application, and indicates (implies) that a drag or flick gesture on the camera access mark will enable the user to immediately access the camera application.

The response to the gesture starts on the camera access mark (or in some embodiments, starts from the hidden click hit area of the camera access mark (such as the hidden click hit area surrounding the camera access mark) (Top) and is different from the first type of the second type (for example, drag or toggle gestures) determination (910), the device stops displaying the lock screen interface (912), and starts the restricted mode of the camera application In operation stage (914), display the interface of the camera application without displaying the password input interface (916), and maintain the device in the locked password protection state for applications other than the camera application on the device ( 918). For example, returning to FIG. 5GG, the response to the gesture (action 5282) starts on the camera access mark 5006 and is a second type different from the first type (for example, compared to the gesture 5304, which is a click gesture If the device 100 is in the locked password protection state, the camera application 143 starts in the restricted operation phase, and the locked device interface 5000-J is replaced by the camera. The interface 5026 does not display the password to enter the user interface 5022 (FIG. 5C). Other applications on the device 100 (for example, the memo 153, the browser 147, etc.) are maintained in a locked password protection state.

In response to the determination that the gesture started at a location other than the camera access mark on the touch-sensitive display (for example, started by a drag or flick gesture on an unlocked object), the device displays a password keying interface ( 920). In response to the typing of the correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications. For example, returning to FIG. 5GG, in response to the determination that the gesture (for example, gesture 5278) starts at a position other than the camera access mark 5006 (for example, on the unlocked object 5276), if the device 100 is locked If the password is protected, the password is displayed on the user interface 5022 (Figure 5C). If the correct password is entered in the password entry user interface 5022, the device 100 is unlocked.

It should be understood that the specific order in which the operations of FIG. 9 have been described is only illustrative, and it is not intended to indicate that the described order is the only order in which the operations can be performed. Generally familiar with this technology Various ways of reordering the operations described herein will be recognized. In addition, it should be noted that the details of other procedures described herein regarding methods 600, 700, 800, 1000, and 1100 (eg, Figures 6A to 6B, Figure 7, Figure 8, Figure 10A to Figure 10C, Figure 11A to Figure 11C) The same applies to the method 900 described above with reference to FIG. 9 in a similar manner. For example, the locking device interface 5000-J described above with respect to the method 900 may have one or more of the characteristics of the locking device interface 5000-A described above with respect to the method 600. For the sake of simplicity, these details are not repeated here.

10A to 10C illustrate a flowchart of a method 1000 for accessing different modes of an application in a locked device according to some embodiments. The method 1000 is performed on a portable multifunction device (for example, the device 300 of FIG. 3 or the portable multifunction device 100 of FIG. 1), which has a display, a touch-sensitive surface, and multiple applications ( Including the first application). In some embodiments, the display is a touch screen display, and the touch-sensitive surface is located on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1000 may be combined, and/or the order of some operations may be changed.

As described below, the method 1000 provides an intuitive way to quickly access different modes of applications in the locked device. The method can reduce the cognitive burden of the user when accessing different modes of the application program in the locking device, thereby generating a more effective human-machine interface. For battery-powered electronic devices, enabling users to access different modes of applications in the locked device faster and more efficiently saves power and prolongs the time between battery charging.

When the device is in a locked password protection state (1002), the device displays a lock screen interface on the touch-sensitive display, and the lock screen interface includes the first application access mark (for example, the user interacts with it to save Take the icon or other graphic element of the first application) (1004). For example, FIG. 5OO shows the application access flag 5406 displayed in the locking device interface 5000-L.

The device detects the gesture on the touch-sensitive display (1006). FIG. 5OO and FIG. 5RR show schematic actions 5412 and 5422 detected on the touch screen 112, respectively.

In response to the gesture, the gesture starts on the first application access mark and is the first type of gesture (for example, the vertical swipe gesture 5412 in FIG. 5OO, or the swipe left with movement 5232 in FIG. 5X Initiate the determination (1008) of action 5230), the device stops displaying the lock screen interface (1010), and starts the restricted operation stage (1012) of the first application in the first mode of the first application, Display the interface of the first application in the first mode without displaying the password input interface (1014) and maintain the device in the locked password protection state for applications other than the first application in the device (1016). For example, in response to the determination that the detection of the gesture 5412 and the gesture 5412 started on the application access mark 5406 and is the first type of gesture, the screen interface 5000-L is locked and the display of the camera application 143 is stopped. The restricted operation phase starts in the still image mode, and the corresponding interface 5026 is displayed in the still image mode, and the password protection state is maintained for other applications in the device, as shown in FIGS. 5OO to 5QQ.

In response to the gesture that starts on the first application access mark and is a second type of gesture that is different from the first type of gesture (for example, the gesture of horizontal flicking, the diagonal line in FIG. 5RR The determination (1018) of toggle gesture 5422, or toggle gesture to the right (for example, gesture 5230 and movement 5234 in Figure 5X) (1018), the device stops displaying the lock screen interface (1020), and starts to be different from the The restricted operation stage (1022) of the first application in the first mode of the first application in the second mode of the first application, displaying the interface of the first application in the second mode, and The password input interface (1024) is not displayed, and the device is maintained in the locked password protection state for applications other than the first application in the device (1026). For example, the detection and signaling action 5422 (or the signaling action 5454) in response to the gesture 5422 (or the gesture 5454, Figures 5FFF to Figure 5GGG) starts on the application access flag 5406 and is different from the first The second type of gesture is judged, the screen interface 5000-L is locked and the display stops, and the camera application 143 starts in the video during the restricted operation phase. In the mode, and the corresponding interface 5026 is displayed in the video mode, and the password protection state is maintained for other applications in the device, as shown in FIG. 5RR to FIG. 5TT (or FIG. 5FFF to FIG. 5GGG).

In some embodiments, the response to the gesture starts on the first application access tag and is a third type of gesture that is different from the first type of gesture and the second type of gesture (e.g., Click the gesture action) to determine that the device partially reveals the first mode interface of the first application program or partially reveals the second mode interface of the first application program (1028). For example, in response to the detection of the click gestures 5432 and 5438, the interface 5026 is partially exposed in the still image mode and the video mode, respectively, as shown in FIGS. 5UU to 5BBB.

In some embodiments, the interface partially exposing the first mode of the first application or partially exposing the interface of the second mode of the first application includes displaying an animation (1030) that translates the locked screen interface. For example, as shown in FIGS. 5UU to 5BBB, the partial display of the interface 5026 may include an animation of the translation of the locking device interface 5000-L.

In some embodiments, the animation translates the lock screen interface in a first direction to partially reveal the interface of the first mode or the second mode of the first application, and then moves in a direction opposite to the first direction Shift the lock screen interface to eliminate the display of the partially exposed interface of the first application (1032). For example, as shown in FIGS. 5UU to 5BBB, the partial exposure of the interface 5026 may include an animation of the locking device interface 5000-L panning in the direction 5434 and then in the opposite direction 5436.

In some embodiments, the response to the gesture starts on the first application access tag and is a third type of gesture that is different from the first type of gesture and the second type of gesture (for example, Click and hold the gesture), the device displays one or more visual cues of the first type of gesture and the second type of gesture (1034). The visual cue(s) provide the user with hints or reminders about the first type of gesture and the second type of gesture. These visual cues can be text, pictures shape or any combination thereof. For example, FIGS. 5CCC to 5DDD show visual indications 5446 and 5448 of the gesture displayed in response to the detection of the gesture 5444 (for example, click and hold the gesture) on the application access mark 5406.

In response to the determination that the gesture action starts at a location on the touch-sensitive display other than the first application access mark, the device displays a password keying interface, wherein the device responds to the typing of the correct password in the password keying interface , The password input interface stops displaying and the device enters an unlocked state with access to the plurality of applications (1036). For example, in response to the gesture 5450 on the unlocked object 5276 and the detection of the movement 5452, as shown in FIG. 5EEE, a password key-in user interface 5022 is displayed (FIG. 5C).

In some embodiments, the first type of gesture includes a contact moving in a first path on the touch-sensitive surface, and the second type of gesture includes a gesture that is different from the touch-sensitive surface on the touch-sensitive surface. The contact moving in the second path of the first path (1038). For example, gesture 5412 (FIG. 5OO) has a substantially vertical path, and gesture 5422 (FIG. 5RR) has a diagonal path.

In some embodiments, the first type of gesture includes moving to a first area on the touch-sensitive surface and ending in contact at the first area, and the second type of gesture includes touching on the touch-sensitive surface. The formula surface moves to a second area different from the first area and ends at the contact at the second area (1040). For example, in some embodiments, the gesture 5412 ends on the camera icon 5416, and the gesture 5422 ends on the video icon 5418.

In some embodiments, the first type of gesture includes a first number of contacts, and the second type of gesture includes a second number of contacts different from the first number of contacts (1042). For example, gesture 5412 (FIG. 5OO) has one contact, and gesture 5454 (FIG. 5FFF) has two contacts.

In some embodiments, the first application is a camera application, the first mode is a still image capturing mode, and the second mode is a video capturing mode (1044). For example In other words, FIGS. 5OO to 5GGG show the interface 5026 of the camera application 143 displayed in the still image mode and the video mode.

In some embodiments, the first application is a notification application, the first mode is an incoming message notification mode, and the second mode is a summary notification mode (1046). The application associated with the application access flag 5406 may be the notification application 165, and the different modes that can be accessed from the locked device interface 5000-L may include an incoming message notification mode and a summary notification mode.

In some embodiments, the first application is an email application, the first mode is an inbox mode, and the second mode is an email composition mode (1048). The application associated with the application access flag 5406 may be the email application 140, and the different modes that can be accessed from the lock device interface 5000-L may include an inbox mode and an email composing mode.

In some embodiments, the first application is a phone application, the first mode is a keypad mode, and the second mode is a recent call list mode (1050). The application associated with the application access flag 5406 may be the phone application 138, and the different modes that can be accessed from the locking device interface 5000-L may include a keypad mode and a recent call list (for example, call history) mode.

In some embodiments, the first application is a phone application, the first mode is a keypad mode, and the second mode is a voice mail mode (1052). The application program associated with the application program access flag 5406 may be the phone application program 138, and the different modes that can be accessed from the locking device interface 5000-L may include a keypad mode and a voice mail mode.

In some embodiments, the device displays an animation that changes the first application access mark from a first graphic corresponding to the first mode to a second graphic corresponding to the second mode that is different from the first graphic (For example, change the camera mark from a still camera graphic to an animation of a video camera graphic, as shown in Figures 5RR to 5SS) (1054).

It should be understood that the specific order in which the operations of FIG. 10 have been described is only illustrative, and is not intended to Indicates that the order described is the only order in which these operations can be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the details of other procedures described in this article about methods 600, 700, 800, 900, and 1100 (for example, FIGS. 6A to 6B, 7 to 9, and 11A to 11C) are also applicable in a similar manner The method 1000 described above with reference to FIG. 10. For example, the locking device interface 5000-L described above with respect to the method 1000 may have one or more of the characteristics of the locking device interface 5000-A described above with respect to the method 600. For the sake of simplicity, these details are not repeated here.

11A-11C illustrate a flowchart of a method 1100 for accessing different modes of an application in a locked device according to some embodiments. The method 1100 is performed on a portable multi-function device (for example, the device 300 in FIG. 3 or the portable multi-function device 100 in FIG. 1), which has a display, a touch-sensitive surface, and multiple applications ( Including the first application). In some embodiments, the display is a touch screen display, and the touch-sensitive surface is located on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1100 may be combined, and/or the order of some operations may be changed.

As described below, the method 1100 provides an intuitive way to quickly access different modes of applications in the locked device. The method can reduce the cognitive burden of the user when accessing different modes of the application program in the locking device, thereby generating a more effective human-machine interface. For battery-powered electronic devices, enabling users to access different modes of applications in the locked device faster and more efficiently saves power and prolongs the time between battery charging.

When the device is in a locked password protection state (1102), a lock screen interface is displayed on the touch-sensitive display, and the lock screen interface includes the first access mark of the first mode in the first application (user and The interaction is to access the icon or other graphical elements of the first mode in the first application) and the second access mark of the second mode in the first application that is different from the first access mark (using Interact with it to access the icon or other graphic elements of the second mode in the first application) (1104). For example, FIG. 5HHH shows the first access mark 5458 and the second access mark displayed in the locking device interface 5000-M Mark 5462.

The device detects the gesture on the touch-sensitive display (1106). 5HHH, FIG. 5KKK, and FIG. 5NNN show the schematic actions 5466 and 5470 detected on the touch screen 112, respectively.

In response to the gesture, the gesture starts on the first access mark and is the first type of gesture (for example, the vertical flick gesture 5466 in Figure 5HHH or Figure 5PPP, or the flick to the left gesture (e.g., figure In 5X, the gesture 5230 and movement 5232)) are determined (1108), the device stops displaying the lock screen interface (1110), and starts the restricted mode of the first application in the first mode of the first application Operation stage (1112), displaying the interface of the first application in the first mode without displaying the password input interface (1114) and maintaining the device in the device for applications other than the first application in the device The password protection status of the lock (1116). For example, in response to the determination that the detection and gesture 5466 of the gesture 5466 starts on the first access mark 5458 and is the first type of gesture, the screen interface 5000-M is locked and the display of the camera application 143 is stopped. The restricted operation phase starts in the still image mode, and the corresponding interface 5026 is displayed in the still image mode, and the password protection state is maintained for other applications in the device, as shown in FIG. 5HHH to FIG. 5JJJ and FIG. 5PPP.

In response to the gesture, the gesture starts on the second application access mark and is a gesture of the second type (for example, the vertical slide gesture 5470 in Figure 5KKK, the horizontal slide gesture 5470 in Figure 5NNN, and the figure In 5PPP, the two-point contact vertical flicking gesture 5476 or the right flicking gesture (for example, gesture 5230 and movement 5234 in Figure 5X) are determined (1118), and the device stops displaying the lock screen interface (1120) ), start the restricted operation phase of the first application in the second mode of the first application that is different from the first mode of the first application (1122), and display the first application in the second mode The interface of an application program does not display the password input interface (1124), and the device is maintained in the locked password protection state for applications other than the first application program in the device State (1126). For example, in response to the detection and gesture action 5470 (Figure 5KKK or Figure 5NNN) or 5476 (Figure 5PPP) in response to the determination that the detection and gesture action 5470 or 5476 starts on the second access mark 5464 and is a gesture of the second type , The lock screen interface 5000-M stops displaying, the camera application 143 starts in the video mode during the restricted operation phase, and the corresponding interface 5026 is displayed in the video mode, and the password protection status is maintained for other applications in the device , As shown in Figure 5KKK to Figure 5PPP.

In some embodiments, in response to the determination that the gesture starts on the first access mark and is a different type of gesture (for example, click gesture) of the first type of gesture, the device partially reveals The interface of the first mode of the first application program; and in response to the gesture that the gesture starts on the second access mark and is a different type of gesture from the second type of gesture (for example, click on gesture) According to the determination, the device partially reveals the interface of the second mode of the first application (1128). For example, in response to the detection of the click gesture 5480, the interface 5026 is partially exposed in the static image mode by shifting the locking device interface 5000-M in the direction 5484, as shown in FIGS. 5QQQ to 5RRR. In response to the detection of the click gesture 5482, the interface 5026 is partially exposed in the video mode by shifting the locking device interface 5000-M in the direction 5488, as shown in FIG. 5QQQ and FIG. 5SSS.

In some embodiments, a gesture of a type different from the first type of gesture is a click gesture, and a gesture of a type different from the second type of gesture is a click gesture (1130). For example, both gestures 5480 and 5482 may be click gestures.

In some embodiments, the interface that partially reveals the first mode of the application includes displaying an animation of the lock screen interface panning in the first direction, and the interface that partially displays the second mode of the application includes displaying the lock screen interface in the first direction. Animation of translation in two directions (1132). For example, as shown in FIG. 5RRR, the partial exposure of the interface 5026 in the still image mode may include an animation of the locking device interface 5000-M panning in the direction 5484. For example In other words, as shown in FIG. 5SSS, the partial display of the interface 5026 in the video mode may include an animation of the locking device interface 5000-M panning in a direction 5488 different from the direction 5484.

In some embodiments, the second direction is orthogonal to the first direction (1134). For example, directions 5484 (Figure 5RRR) and 5488 (Figure 5SSS) are orthogonal to each other.

In some embodiments, the second type of gesture is different from the first type of gesture (1136). For example, the gesture 5466 (FIG. 5HHH) and the gesture 5470 (FIG. 5NNN) are different types of gestures, that is, the gesture 5466 is a vertical toggle gesture, and the gesture 5470 in FIG. 5NNN is a horizontal toggle. Gesture.

In some embodiments, in response to the determination that the signaling action starts at a location other than the first access mark and the second access mark on the touch-sensitive display, the device displays a password keying interface, where the response Enter the correct password in the password keying interface, the password keying interface stops displaying and the device enters an unlocked state with access to the plurality of applications (1138). For example, in response to the gesture 5492 on the unlocked object 5276 and the detection of the movement 5494, as shown in FIG. 5TTT, a password input user interface 5022 is displayed (FIG. 5C).

In some embodiments, the first type of gesture includes a contact moving in a first path on the touch-sensitive surface, and the second type of gesture includes a gesture that differs from the touch-sensitive surface on the touch-sensitive surface. The contact moving in the second path of the first path (1140). For example, gesture 5466 has a substantially vertical path, and gesture 5470 in FIG. 5NNN has a diagonal path.

In some embodiments, the first type of gesture includes moving to a first area on the touch-sensitive surface and ending in contact at the first area, and the second type of gesture includes touching on the touch-sensitive surface. The formula surface moves to a second area different from the first area and ends in contact at the second area (1142). For example, in some embodiments, the action 5466 in FIGS. 5HHH to 5III ends on the camera icon 5416, and the action 5470 in FIGS. 5KKK to 5LLL ends on the video icon 5418.

In some embodiments, the first type of gesture includes a first number of contacts, and the second type of gesture includes a second number of contacts different from the first number of contacts (1144). For example, gesture 5466 has one contact, and gesture 5476 (Figure 5PPP) has two contacts.

In some embodiments, the first application is a camera application, the first mode is a still image capturing mode, and the second mode is a video capturing mode (1146). For example, FIGS. 5HHH to 5TTT show the interface 5026 of the camera application 143 displayed in the still image mode and the video mode.

In some embodiments, the first application is a notification application, the first mode is an incoming message notification mode, and the second mode is a summary notification mode (1148). For example, the application associated with the first access token 5458 and the second access token 5462 can be the notification application 165, and the different modes that can be accessed from the locked device interface 5000-M can include incoming message notification Mode and summary notification mode.

In some embodiments, the first application is an email application, the first mode is an inbox mode, and the second mode is an email composition mode (1150). For example, the application associated with the first access mark 5458 and the second access mark 5462 can be the email application 140, and the different modes that can be accessed from the lockable device interface 5000-M can include the inbox Mode and email composing mode.

In some embodiments, the first application is a phone application, the first mode is a keypad mode, and the second mode is a recent call list mode (1152). For example, the application associated with the first access mark 5458 and the second access mark 5462 may be the phone application 138, and the different modes that can be accessed from the lock device interface 5000-M may include the keypad mode and Recent call list (for example, call history) mode.

In some embodiments, the first application is a phone application, the first mode is a keypad mode, and the second mode is a voice mail mode (1154). For example, the application associated with the first access token 5458 and the second access token 5462 can be a phone The application program 138, and the different modes that can be accessed from the locking device interface 5000-M can include the keypad mode and the voice mail mode.

It should be understood that the specific order in which the operations of FIG. 11 has been described is only illustrative, and it is not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the details of other procedures described in this article about methods 600, 700, 800, 900, and 1000 (for example, FIGS. 6A to 6B, 7 to 9, and 10A to 11C) are also applicable in a similar manner Refer to the method 1000 described above with reference to FIG. 11. For example, the locking device interface 5000-M described above with respect to the method 1000 may have one or more of the characteristics of the locking device interface 5000-A described above with respect to the method 600. For the sake of simplicity, these details are not repeated here.

According to some embodiments, FIG. 12 shows a functional block diagram of an electronic device 1200 configured according to the principles of the present invention as described above. The functional blocks of the device can be implemented by hardware, software, or a combination of hardware and software to implement the principles of the present invention. Those familiar with the art should understand that the functional blocks described in FIG. 12 can be combined or separated into sub-blocks to implement the principles of the present invention as described above. Therefore, the description herein can support any possible combination or separation or further definition of the functional blocks described herein.

As shown in FIG. 12, the electronic device 1200 includes a touch-sensitive display unit 1202, which is configured to display a locked screen interface when the device is in a locked password protection state, the locked screen interface includes a camera access mark, and the The touch-sensitive display unit receives a gesture; a plurality of applications 1204 including a camera application 1205; and a processing unit 1206, which is coupled to the touch-sensitive display unit 1202 and the plurality of applications 1204. In some embodiments, the processing unit includes a detection unit 1208, a stop unit 1210, a start unit 1212, a display realization unit 1214, a maintenance unit 1216, an initialization unit 1218, and a prevention unit 1220.

The processing unit 1206 is configured to: when the device is in the locked password protection state: to detect the gesture on the touch-sensitive display unit (for example, by the detection unit 1208); in response to the determination that the gesture started on the camera access mark: stop displaying the locked screen interface (for example, by the stop unit 1210), and start the restricted operation phase of the camera application (for example, by The start unit 1212) realizes the display of the interface of the camera application without displaying the password input interface (for example, by the display realizing unit 1214), and the device is used for applications other than the camera application in the device Maintain the locked password protection state (for example, by the maintaining unit 1216); and in response to the determination that the gesture starts at a position on the touch-sensitive display unit other than the camera access mark, the password entry is realized The display of the interface (for example, by the display realization unit 1214), where in response to the input of the correct password in the password input interface, the password input interface stops displaying and the device enters the unlock with access to the plurality of applications state.

In some embodiments, the camera access mark is displayed in a predefined area of the lock screen interface.

In some embodiments, the gesture is a single-finger sliding gesture.

In some embodiments, the gesture includes continuous movement of a single finger in a predefined direction.

In some embodiments, the gesture includes continuous movement of a single finger along any desired path.

In some embodiments, the gesture is a single-finger click gesture.

In some embodiments, the processing unit is configured to initialize one or more hardware components in a camera controlled by the camera application program (e.g., By the initialization unit 1218).

In some embodiments, when the camera application is in the restricted operation stage, the camera application can present one or more images generated by the camera application while in the restricted operation stage, And the camera application cannot present any images in the camera application that are not generated during the restricted operation phase.

In some embodiments, in response to the determination that the gesture starts at a location other than the camera access mark on the touch-sensitive display unit, the password key-in interface is displayed instead of the camera application interface.

In some embodiments, the processing unit is configured to prevent the device from responding to detecting any contact with the touch-sensitive display unit that does not correspond to the gesture when the device is in a locked password protected state And perform a predefined set of actions (for example, by the prevention unit 1220).

In some other embodiments, the electronic device 1200 includes a touch-sensitive display unit 1202, which is configured to display a locked screen interface when the device is in a locked password protected state, the locked screen interface including a camera access mark and an unlock Mark, and the touch-sensitive display unit receives a gesture; a plurality of applications 1204 including a camera application 1205; and a processing unit 1206, which is coupled to the touch-sensitive display unit 1202 and the plurality of applications 1204. In some embodiments, the processing unit includes a detection unit 1208, a stop unit 1210, a start unit 1212, a display realization unit 1214, and a maintenance unit 1216.

The processing unit 1206 is configured to: when the device is in the locked password-protected state: in response to detecting the start and end of the camera access mark on the indication action (for example, by the detection unit 1208), stop Display the lock screen interface (for example, by the stop unit 1210), start the restricted operation phase of the camera application (for example, by the start unit 1212), realize the display of the camera application interface without displaying the password input Interface (for example, by displaying the realization unit 1214), and maintaining the device in the locked password protection state for applications other than the camera application in the device (for example, by the maintaining unit 1216); and respond Upon detecting a gesture starting at the position associated with the unlocking mark on the touch-sensitive display unit (for example, by the detection unit 1208), display a password keying interface (for example, by the display realization unit 1214) , Wherein in response to the typing of the correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

In some other embodiments, the electronic device 1200 includes a touch-sensitive display unit 1202, which is configured to display a locked screen interface when the device is in a locked password protected state, the locked screen interface including a camera access mark and an unlock Mark, and the touch-sensitive display unit receives a gesture; a plurality of applications 1204 including a camera application 1205; and a processing unit 1206, which is coupled to the touch-sensitive display unit 1202 and the plurality of applications 1204. In some embodiments, the processing unit includes a detection unit 1208, a stop unit 1210, a start unit 1212, a display realization unit 1214, and a maintenance unit 1216.

The processing unit 1206 is configured to: when the device is in the locked password-protected state: in response to detecting a gesture ending on the camera access mark (for example, by the detecting unit 1208): stop displaying the Lock the screen interface (for example, by the stop unit 1210), start the restricted operation phase of the camera application (for example, by the start unit 1212), realize the display of the camera application interface without displaying the password input interface ( For example, by displaying the realization unit 1214), and maintaining the device in the locked password protection state for applications other than the camera application in the device (for example, by the maintaining unit 1216); and responding to the detection Measure the gesture ending at the position associated with the unlocking mark on the touch-sensitive display unit (for example, by the detection unit 1208), and realize the display of the password keying interface (for example, by the display realization unit 1214) , Wherein in response to the typing of the correct password in the password typing interface, the password typing interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

In some other embodiments, the electronic device 1200 includes: a touch-sensitive display unit 1202 configured to display a locked screen interface when the device is in a locked password protected state, the locked screen interface includes a camera access mark, and The touch-sensitive display unit receives gestures; a plurality of applications 1204 including a camera application 1205; and a processing unit 1206, which is coupled to the touch-sensitive display unit 1202 and the plurality of applications 1204. In some embodiments, the processing unit includes a detection unit 1208, a stop unit 1210, a start unit 1212, a display realization unit 1214, a maintenance unit 1216, a translation unit 1222, and a display unit. Yuan 1224.

The processing unit 1206 is configured to: when the device is in the locked password protection state: detect a gesture on the touch-sensitive display unit (for example, by the detection unit 1208); respond to the gesture start at The camera access mark is the first type of determination, partially revealing the interface of the camera application program (for example, by the revealing unit 1224); in response to the gesture, it starts on the camera access mark and is different from the camera access mark. The first type of the second type of determination, stop displaying the lock screen interface (for example, by the stop unit 1210), and start the restricted operation phase of the camera application (for example, by the start unit 1212) to realize the camera The interface of the application program is displayed without displaying the password input interface (for example, by the display realization unit 1214), and the device is maintained in the locked password protection state for applications other than the camera application in the device ( For example, by maintaining unit 1216); and in response to the determination that the gesture starts at a position on the touch-sensitive display unit other than the camera access mark, the display of the password keying interface is realized (for example, by displaying The realization unit 1214), wherein in response to the input of the correct password in the password input interface, the password input interface stops displaying and the device enters an unlocked state with access to the plurality of applications.

In some embodiments, the processing unit is configured to translate the lock screen interface (for example, by the translation unit 1222) in response to the determination that the gesture starts on the camera access mark and is the first type.

According to some embodiments, FIG. 13 shows a functional block diagram of an electronic device 1300 configured according to the principles of the present invention as described above. The functional blocks of the device can be implemented by hardware, software, or a combination of hardware and software to implement the principles of the present invention. Those familiar with the art should understand that the functional blocks described in FIG. 13 can be combined or separated into sub-blocks to implement the principles of the present invention as described above. Therefore, the description herein can support any possible combination or separation or further definition of the functional blocks described herein.

As shown in FIG. 13, the electronic device 1300 includes: a touch-sensitive display unit 1302, which is It is configured to display a lock screen interface when the device is in a locked password protection state, the lock screen interface includes a first application program access mark, and the touch-sensitive display unit receives a gesture; including a plurality of the first application program 1305 Application programs 1304; and a processing unit 1306, which is coupled to the touch-sensitive display unit 1302 and a plurality of application programs 1304. In some embodiments, the processing unit 1306 includes a detection unit 1308, a stop unit 1310, a start unit 1312, a display realization unit 1314, a maintenance unit 1316, and a reveal unit 1318.

The processing unit 1306 is configured to: when the device is in a locked password protection state: detect a gesture on the touch-sensitive display unit 1302 (for example, by the detection unit 1308); respond to the gesture start at The first application program access mark is on the determination of the first type of gesture action, the display of the lock screen interface is stopped (for example, by the stop unit 1310), and the first application program 1305 in the first mode is started. The restricted operation phase of an application 1305 (for example, by the start unit 1312), realizes the display of the interface of the first application 1305 in the first mode without displaying the password input interface (for example, by displaying the realization unit) 1314), and maintain the device in the locked password-protected state for applications 1304 other than the first application 1305 in the device (for example, by the maintaining unit 1316); and respond to the signal that the action starts at the The first application access mark is on the second type of gesture that is different from the first type of gesture, the display of the lock screen interface is stopped (for example, by the stop unit 1310), and the start is different from the first type of gesture. An application 1305 in the first mode of the first application 1305 in the second mode of the restricted operation phase of the first application 1305 in the second mode (for example, by the start unit 1312), to realize the first application in the second mode The interface of an application 1305 is displayed without displaying the password input interface (for example, by the display realization unit 1314), and the device is maintained in the locked state for the application 1304 of the device except the first application 1305 Password protection state (for example, by maintaining unit 1316).

In some embodiments, the processing unit 1306 is configured to: in response to the gesture, start on the first application access flag and be different from the first type of gesture and The determination of the second type of gestures of the third type of gestures reveals the interface of the first application 1305 in the first mode or partially reveals the interface of the second mode of the first application 1305 (for example, by revealing the unit 1318).

In some embodiments, partly revealing the interface of the first mode of the first application 1305 or partly revealing the interface of the second mode of the first application 1305 includes displaying an animation that translates the locked screen interface.

In some embodiments, the animation translates the lock screen interface in the first direction to partially reveal the interface of the first mode or the second mode of the first application 1305, and then in a direction opposite to the first direction The locked screen interface is shifted to eliminate the display of the partially exposed interface of the first application 1305.

In some embodiments, the processing unit 1306 is configured to respond to the gesture start on the first application access flag and be different from the first type of gesture and the second type of gesture. The determination of the three types of gestures enables the display of one or more visual cues of the first type of gestures and the second type of gestures (for example, by the display realization unit 1314).

In some embodiments, the processing unit 1306 is configured to: respond to the determination that the gesture starts at a location other than the first application access mark on the touch-sensitive display, and realize the display of the password keying interface (For example, by the display realization unit 1314), in response to the input of the correct password in the password input interface, the password input interface stops displaying and the device enters an unlocked state with access to a plurality of applications 1304.

In some embodiments, the first type of gesture includes a contact moving in a first path on the touch-sensitive surface, and the second type of gesture includes a gesture that differs from the touch-sensitive surface on the touch-sensitive surface. The contact moving in the second path of the first path.

In some embodiments, the first type of gesture includes moving to a first area on the touch-sensitive surface and ending in contact at the first area, and the second type of gesture includes touching on the touch-sensitive surface. Move to a second area different from the first area on the surface and End the contact at this second area.

In some embodiments, the first type of gesture includes a first number of contacts, and the second type of gesture includes a second number of contacts different from the first number of contacts.

In some embodiments, the first application 1305 is a camera application, the first mode is a still image capturing mode, and the second mode is a video capturing mode.

In some embodiments, the first application 1305 is a notification application, the first mode is an incoming message notification mode, and the second mode is a summary notification mode.

In some embodiments, the first application 1305 is an email application, the first mode is an inbox mode, and the second mode is an email composition mode.

In some embodiments, the first application 1305 is a phone application, the first mode is a keypad mode, and the second mode is a recent call list mode.

In some embodiments, the first application 1305 is a phone application, the first mode is a keypad mode, and the second mode is a voice mail mode.

In some embodiments, the processing unit 1306 is configured to: change the first application access flag from the first graphic corresponding to the first mode to the first graphic corresponding to the second mode different from the first graphic The second graphic animation display (for example, by the display realization unit 1314).

In some other embodiments, the electronic device 1300 includes a touch-sensitive display unit 1302, which is configured to display a locked screen interface when the device is in a locked password-protected state, the locked screen interface including the first application 1305 The first access mark of the first mode and the second access mark of the second mode of the first application 1305 are different from the second access mark of the first access mark, and the touch-sensitive display unit 1302 receives the indication action; A plurality of application programs 1304 of an application program 1305; and a processing unit 1306, which is coupled to the touch-sensitive display unit 1302 and the plurality of application programs 1304. In some embodiments, the processing unit 1306 includes a detection unit 1308, a stop unit 1310, a start unit 1312, and a display implementation unit. The element 1314, the maintaining unit 1316, and the revealing unit 1318.

The processing unit 1306 is configured to: when the device is in a locked password protection state: detect a gesture on the touch-sensitive display (for example, by the detection unit 1308); respond to the gesture start at the The first access mark is on the first access mark and is the determination of the first type of gesture, stop displaying the lock screen interface (for example, by the stop unit 1310), and start the first application 1305 in the first mode of the first application 1305 The restricted operation stage (for example, by the start unit 1312), realizes the display of the interface of the first application 1305 in the first mode without displaying the password input interface (for example, by the display realization unit 1314), and For applications 1304 other than the first application 1305 in the device, the device is maintained in the locked password protection state (for example, by the maintaining unit 1316); and in response to the signal operation, the second access is started It is marked on the second type of gesture determination, stop displaying the lock screen interface (for example, by the stop unit 1310), and start the first application 1305 of the first mode different from the first application 1305 The restricted operation phase of the first application 1305 in the second mode (for example, by the start unit 1312) realizes the display of the interface of the first application 1305 in the second mode without displaying the password input interface (for example, The implementation unit 1314 is displayed), and the device is maintained in the locked password protection state for applications 1304 other than the first application 1305 in the device (for example, by the maintaining unit 1316).

In some embodiments, the processing unit 1306 is configured to: in response to the determination that the gesture starts on the first access flag and is a different type of gesture from the first type of gesture, partially reveals the first gesture. The interface of the first mode of the application 1305 (for example, by the reveal unit 1318), and responds to the gesture that starts on the second access mark and is a gesture that is different from the gesture of the second type ( For example, the determination of clicking a gesture) partially reveals the interface of the second mode of the first application 1305 (for example, by the revealing unit 1318).

In some embodiments, a gesture of a type other than the first type of gesture The action is a click gesture, and a gesture different from the second type of gesture is a click gesture.

In some embodiments, the interface that partially reveals the first mode of the application includes displaying an animation of the lock screen interface panning in the first direction, and the interface that partially displays the second mode of the application includes displaying the lock screen interface in the first direction. Animation of panning in two directions.

In some embodiments, the second direction is orthogonal to the first direction.

In some embodiments, the second type of gesture is different from the first type of gesture.

In some embodiments, the processing unit 1306 is configured to: respond to the determination that the gesture starts at a location other than the first access mark and the second access mark on the touch-sensitive display to implement a password The display of the key-in interface (for example, by the display realization unit 1314), where in response to the key-in of the correct password in the password key-in interface, the password key-in interface stops displaying and the device enters a computer with access to a plurality of applications 1304 Unlocked state.

In some embodiments, the first type of gesture includes a contact moving in a first path on the touch-sensitive surface, and the second type of gesture includes a gesture that differs from the touch-sensitive surface on the touch-sensitive surface. The contact moving in the second path of the first path.

In some embodiments, the first type of gesture includes moving to a first area on the touch-sensitive surface and ending in contact at the first area, and the second type of gesture includes touching on the touch-sensitive surface. The formula surface moves to a second area different from the first area and ends in contact at the second area.

In some embodiments, the first type of gesture includes a first number of contacts, and the second type of gesture includes a second number of contacts different from the first number of contacts.

In some embodiments, the first application 1305 is a camera application, the first mode is a still image capturing mode, and the second mode is a video capturing mode.

In some embodiments, the first application 1305 is a notification application, the first mode is an incoming message notification mode, and the second mode is a summary notification mode.

In some embodiments, the first application 1305 is an email application, the first mode is an inbox mode, and the second mode is an email composition mode.

In some embodiments, the first application 1305 is a phone application, the first mode is a keypad mode, and the second mode is a recent call list mode.

In some embodiments, the first application 1305 is a phone application, the first mode is a keypad mode, and the second mode is a voice mail mode.

The operations in the above-mentioned information processing method can be implemented by executing one or more functional modules in an information processing device (such as a general-purpose processor or a special application chip). These modules, combinations of these modules, and/or their combinations with general hardware (for example, as described above with reference to FIGS. 1A and 3) are all included in the protection scope of the present invention.

The operations described above with reference to FIGS. 6A to 6B, FIGS. 7 to 9, FIGS. 10A to 10C, and FIGS. 11A to 11C can be implemented by the components depicted in FIGS. 1A to 1B. For example, the detection operation 608, the stop operation 620, the start operation 622, the display operation 624, and the maintenance operation 626 can be implemented by the event classifier 170, the event recognizer 180, and the event processing routine 190. The event monitor 171 in the event classifier 170 detects the contact on the touch-sensitive display 112, and the event dispatcher module 174 delivers the event information to the application 136-1. The respective event identifier 180 of the application 136-1 compares the event information with the respective event definition 186, and determines whether the first contact at the first position on the touch-sensitive surface corresponds to a predefined event or sub-event (such as, Selection of objects on the user interface). When each predefined event or sub-event is detected, the event recognizer 180 activates an event processing routine 190 associated with the detection of the event or sub-event. The event handler 190 can use or call the data update program 176 or the object update program 177 to update the internal state 192 of the application. In some embodiments, the event handler 190 accesses the respective GUI update program 178 to update the content displayed by the application program. Similarly, other procedures can be implemented based on the components depicted in FIGS. 1A to 1B The formula will be clear to those who are familiar with this technique.

For the purpose of explanation, the above description has been described with reference to the specific embodiment. However, the illustrative discussion above is not intended to be exhaustive, nor is it intended to limit the invention to the precise form disclosed. In view of the above teachings, many modifications and changes are possible. The embodiments are selected and described in order to best explain the principle of the present invention and its practical application, so that those familiar with the technology can make the best use of various modifications suitable for the specific intended use. The invention and various embodiments.