Selective input signal rejection and modification

The present invention generally relates to processing a signal from a user input device, and more specifically to selectively rejecting a particular type of signal received from the user input device.

Many types of input devices are now available to perform operations in computing systems, such as buttons or keys, mice, trackballs, joysticks, touch sensor panels, touch screens, and the like. In particular, touch panels are becoming more and more popular due to their ease of operation and versatility, as well as their declining prices. The touch screen can include a clear panel with a touch sensitive surface. Another type of computer or electronic device can process the signal generated by the touch panel to determine how and where the user is touching the touch panel.

The multi-touch panel is a high-performance type touch panel that enables the touch panel to detect a plurality of touch events at the same time. The multi-touch panel allows the electronic device to detect the entire area of the panel being touched at any given time, allowing for more complex user interactions. Thus, the electronic device can acquire an "image" showing the position and shape of all touches that occur on the panel at any given time. In addition, the multi-touch panel or device connected to it should track the movement of one or more touch events (eg, one or more fingers moving along the surface of the panel) over time. Can be done. This can allow tracking of more complex "touch gestures".

Various types of multi-touch panels can be designed. One type allows the sensing of touch events based on sensing changes in capacitance caused by the finger touching the panel or another object. An exemplary multi-touch panel of this type is described in US Patent Application No. 11 / 649,998 and Patent Publication No. 20080158172, filed January 3, 2007, the content of which is in its entirety for all purposes. Is incorporated herein by reference.

<p num="0005"><patcit num="1"><text>U.S. Patent Application No. 11 / 649,998</text></patcit><patcit num="2"><text>U.S. Patent Publication No. 20080158172</text></patcit><patcit num="3"><text>U.S. Pat. No. 6,323,846</text></patcit><patcit num="4"><text>U.S. Patent Publication No. 20080158145</text></patcit><patcit num="5"><text>U.S. Patent Publication No. 2008158185</text></patcit><patcit num="6"><text>U.S. Pat. No. 7,046,230</text></patcit><patcit num="7"><text>U.S. Patent Application No. 10 / 643,256</text></patcit></p>

<p num="0006"> Touch sensing (whether single or multi-touch) is certainly an advantage, and in certain situations touch sensing can gather more information. For example, the user may touch the panel or move the user's finger along the panel unintentionally, or at least unintentionally transmitting the action to a computer or device. If the device responds to an unintended action by the user, it can confuse the user or misunderstand the command or other transmitted information received from the user.</p>

<p num="0007"> An embodiment of the present invention relates to a user input device that accepts composite user inputs, including a combination of touch and push (or pick) inputs. These devices provide much more user input than many existing user input devices. However, this can have some unintended consequences. Since the devices of the present invention can detect user behaviors that were not detectable by previous devices, these devices also detect some user behaviors that were not intended to be machine interface behaviors by the user. be able to.</p><p num="0008"> Accordingly, embodiments of the present invention allow for the selective ignorance or rejection of input received from such devices in order to avoid interpreting unintended user actions as commands. In addition, some input signals can be modified. Selective denial or modification can be performed by the user interface device itself, or by a computing device that includes or is attached to the user interface device. Selective rejection or modification can be performed by a module that processes the input signal, implements the necessary rejections and modifications, and then sends the modified input signal to a higher level module.</p>

<figref num="1">FIG. 5 illustrates an exemplary laptop trackpad according to one embodiment of the present invention.</figref><figref num="2">It is a figure which shows the exemplary computer mouse by one Embodiment of this invention.</figref><figref num="3A">It is a figure which shows the combination of a plurality of exemplary touch panels and the touch sensed on them.</figref><figref num="3B">It is a figure which shows the combination of a plurality of exemplary touch panels and the touch sensed on them.</figref><figref num="3C">It is a figure which shows the combination of a plurality of exemplary touch panels and the touch sensed on them.</figref><figref num="4A">It is a figure which shows the combination of a plurality of exemplary touch panels and the touch sensed on them.</figref><figref num="4B">It is a figure which shows the combination of a plurality of exemplary touch panels and the touch sensed on them.</figref><figref num="4C">It is a figure which shows the combination of a plurality of exemplary touch panels and the touch sensed on them.</figref><figref num="5">It is a figure which shows the graph of the example switch state and the clock memory variable by one Embodiment of this invention.</figref><figref num="6">It is a figure which shows the graph of an exemplary initial speed vs. correction speed according to one embodiment of the present invention.</figref><figref num="7">It is an exemplary block diagram showing one embodiment of the present invention.</figref><figref num="8">FIG. 6 is a schematic diagram showing an exemplary touchpad and display according to one embodiment of the present invention.</figref><figref num="9">It is a perspective view which shows the exemplary input device by one Embodiment of this invention.</figref><figref num="10A">FIG. 6 is a schematic side view showing an exemplary input device having a button touchpad according to one embodiment of the present invention.</figref><figref num="10B">FIG. 6 is a schematic side view showing an exemplary input device having a button touchpad according to one embodiment of the present invention.</figref><figref num="10C">FIG. 6 is a schematic side view showing an exemplary input device having a button touchpad according to one embodiment of the present invention.</figref><figref num="10D">FIG. 6 is a schematic side view showing an exemplary input device having a button touchpad according to one embodiment of the present invention.</figref><figref num="11">FIG. 6 is a schematic block diagram showing an exemplary input device connected to a computing device according to one embodiment of the invention.</figref><figref num="12">FIG. 6 is a side sectional view showing an exemplary input device according to one embodiment of the present invention.</figref><figref num="13">FIG. 2 is another side sectional view showing an exemplary input device of FIG.</figref>

The following description of preferred embodiments will illustrate accompanying drawings that form a portion of the embodiment and illustrate specific embodiments in which the invention can be practiced. It should be understood that other embodiments may be used and structural changes may be made without departing from the scope of the embodiments of the present invention.

The present invention generally relates to devices that provide a surface characterized by a combination of touch sensing and mechanical pick sensing. Touch sensing means sensing a finger or another object that simply touches a surface, and mechanical pick sensing means a surface that records a push that actually physically moves or deforms the surface. The touch sensing can be multi or single touch sensing. Embodiments of the invention detect a particular combination of mechanical and touch sensing data that fits into a pattern that is often found to result from unintended user input, and data to eliminate or mitigate the effects of unintended input. Can be modified.

Embodiments of the invention are often described and illustrated herein from the perspective of a laptop trackpad and computer mouse, but embodiments of the invention are not limited thereto, with touch sensing and mechanical pick sensing. Please understand that it is further applicable to any input device that combines. Further, although the present specification often describes and illustrates embodiments related to devices that perform multi-touch sensing, certain embodiments may also include devices that perform only single-touch sensing.

FIG. 1 shows an exemplary user input device according to some embodiments of the present invention. The device can include a top surface 101. The upper surface can be a multi-touch or single-touch compatible surface. The top surface can be connected to the base 102 via a hinge 103. The hinge 103 is shown in the embodiment of FIG. 1 as being at the tip of the top surface 101 and the base 102, but in other embodiments, the hinge is placed closer to the center of the top surface and the base, a "rocker switch". You can create a pivot point that can provide movement. The hinge can be spring-loaded, or another spring or similar mechanism can be used to elastically separate the top surface from the base.

The upper surface can be masculinely movable downward. The switch 104 is located on the base and can be activated when the top surface is pressed. The switch can be a microswitch or other operable device. The hinge can ensure that the top surface returns to its original position after the user has stopped pushing the surface downwards under pressure.

The user can interact with the touch surface by simply touching the surface without necessarily pressing it to activate the switch. The user can provide a multi-touch signal by touching different parts of the surface with, for example, two or more fingers. The user can also enter gestures by moving one or more fingers along the surface. This type of input is called touch input. In addition, the user can push the surface downwards to activate the microswitch. It can be used as another type of user input called a pick. In addition, the user can combine the two types of inputs. For example, if the user pushes the top surface down, the user can push down while placing a particular configuration of the finger on the surface, perhaps at a special location on the surface, and this particular configuration and location , Can have a specific meaning in the user interface. The user can also add gestures while pushing the top surface downwards, and these gestures can also have a particular meaning within the user interface. This meaning can be the same as or different from the meaning produced by making a similar gesture when the top surface is not pushed downwards.

The device 100 can be included as a user interface device for various other devices. For example, the device can be included as a trackpad on a laptop computer 110. In addition, device 100 includes a trackpad for a stand-alone keyboard connected to a personal computer or the like, a stand-alone trackpad, a trackpad for a toy or stand-alone game console, a trackpad for a vending machine, an ATM machine. , Or can be included in other electronic devices, such as another type of electronic kiosk.

FIG. 2 shows another exemplary device that includes a combination of touch and pick sensing. The device 200 can be a computer mouse, a stand-alone trackpad or other input device, or the like. The device 200 can include a top surface 201 that can be a multi-touch surface. The base 202 can be mounted on the top surface via one or more spring elements 203. A guide (not shown) can be used to hold the top surface in place on the base. The switch 204 can be placed on the base and is pressed by the top surface when it is pushed downwards. The device 200 can also include a position tracking module 205 that tracks the movement of the device. The position tracking module 205 can be conventional, including, for example, a ball or laser tracking system.

Similar to the trackpad described above, the user is attached to the device 200 by simply touching (without pressing) the surface of the device, by pressing the surface to activate switch 203, or both. Can convey commands or information to the device. When adding multi-touch input, the user creates a multi-touch combination by touching different parts of the top surface at the same time and / or moves one or more fingers and / or other objects along the surface. By doing so, you can create gestures.

Mouse embodiments can be used with various existing computer systems, such as computer system 210, or in any other application where the computer mouse can be considered a useful user input device.

Other types of input devices can combine multi-touch and pick-type interfaces by allowing the user to provide touch and pick inputs on the same surface as described above. Some of these devices feature more than one switch that allows for more types of pick inputs.

The above types of devices provide more user input than many existing user input devices. However, this can have some unintended consequences. Since the devices of the present invention can detect user behaviors that were not detectable by previous devices, these devices can also detect specific user behaviors that were not intended by the user to be mechanical interface behaviors. it can. For example, the user often leaves the user's palm on a traditional laptop trackpad between types, which does not give any command to the laptop. However, some versions of the trackpad 100 may be pressed as a result of placing the user's palm and register a pick.

Accordingly, embodiments of the present invention allow selective ignorance or rejection of inputs received from devices 100 and 200 so that unintended user actions are not interpreted as commands. In addition, some input signals can be modified. Selective denial or modification is performed by the user interface device itself (eg, by the mouse 200), or by a computing device that includes or is attached to the user interface device (eg, laptop 110 or computer 210). be able to. Selective rejection or modification can be performed by a module that processes the input signal, performs the necessary rejections and modifications, and then sends the modified input signal to a higher level module. This will be described in more detail below with respect to FIG.

In some embodiments, the pick input is rejected if a particular type of touch input is present. This refusal can be made because the user may accidentally push the top surface, and in many cases the method by which the user pushes the top surface can indicate whether the pick is intentional or not.

3 and 4 show a plurality of touch panels and possible touch combinations on them. Therefore, these figures show the current state of the touch panel. The touch is indicated by the touched area in each figure. Embodiments of the invention can be configured to recognize specific touch patterns by the methods in which they are normally triggered. For example, a small circle or ellipse can be recognized as a finger or fingertip, a larger ellipse can be recognized as a thumb, and a larger ellipse with a minor axis above a certain threshold (eg 11 mm) can be recognized as a palm. Recognition of other parts of the finger or hand is described in more detail in US Pat. No. 6,323,846, which is incorporated herein by reference in its entirety for all purposes. This subject also covers U.S. Patent Application No. 11 / 619,464 with U.S. Patent Publication No. 20080158145, entitled "MULTI-TOUCH DISCRIMINATION," filed January 3, 2007, and May 2007. "MULTI-TOUCH" filed on March 31 It is explained in detail by US Patent Application No. 11 / 756,211 with US Patent Publication No. 2008158185 entitled "DISCRIMINATION". These two patent applications are incorporated herein by reference in their entirety for all purposes.

Referring to FIGS. 3A-C, panel 300 of FIG. 3A shows a pattern that can be produced by touching three fingertips on the panel. When such a touch is sensed and the pick is sensed at the same time, the embodiment of the present invention makes it possible to recognize (ie, not reject) the pick. This pattern usually indicates that the user is intentionally pushing the surface with the user's finger, so picking can be tolerated. Picks can be tolerated in other similar conditions where there are different numbers of finger touches and / or finger touches are arranged in different ways. In some embodiments, picks can be ignored if more than a predetermined number of fingers (eg, eight) appear. Many fingers may indicate that the user is resting his hand on the trackpad.

The pattern of panel 301 in FIG. 3B shows a portion of thumb touch 303 appearing in the lower part of the panel. Pick events that occur while this touch is appearing are acceptable as this usually indicates an intentional pick. In fact, all touches that are recognized as or part of the thumb touch and appear near the edge of the panel can trigger pick events that occur while these touches are allowed. In some embodiments, all finger touches or parts thereof appearing near the edge of the panel can be allowed to allow simultaneous picking events, whether or not they are recognized as thumbs.

Panel 302 in FIG. 3C shows two patterns (304 and 305) that can be identified as palm touches. Picks are registered when one or both of these patterns (or similar patterns) appear in these or similar positions (ie, near the sides of the panel and relatively parallel to the sides). If so, the pick is rejected or ignored. This pick refusal is based on the fact that this pattern tends to indicate that the user is simply resting his hand on the trackpad and has no intention of raising the pick. Picks can also be rejected if only parts of patterns 304 and 305 appear on the sides of the panel, as long as these parts are so recognized.

Panel 400 in FIG. 4A shows a portion of the palm pattern 401 and the thumb pattern 402. The pattern on the panel 400 can also indicate that the user is resting his hand on the trackpad, so that any picks sensed at the same time can be rejected. The pattern on the panel 400 can be made to reject the pick even if the pattern 402 is not recognized as a thumb touch. In general, when a part of the palm touch is detected in combination with the palm touch (pattern 401, etc.) or any finger touch on the upper part of the panel, the picks detected at the same time can be ignored. The upper part of the panel is defined, for example, as the top 1/5 of the panel (defined by line 403 in Figure 4A). The mirror image of panel 400 can also result in pick refusal.

Panel 404 in FIG. 4B shows finger touch 406 along with palm touch 405 near the side. In pattern 404, the finger touch is not on the top of the panel. This pattern can result in allowing pick registration as the finger touch 406 indicates an intentional push. Picks can also be tolerated if the palm touch 405 is a partial palm touch. A pattern that mirrors the pattern 404 can result in a pick-tolerant result.

In some embodiments, palm touches such as palm touch 305 appear, ignoring detected picks, and then fingers such as fingers 406 appear while the multi-touch surface is being pushed downwards. , Picks can be ignored consecutively. Further, if a finger touch such as pattern 402 appears first and the detected picks are registered, and a palm touch such as palm touch 401 appears while the multi-touch surface is pressed downwards. Picks can be registered continuously. In a broader sense, in some embodiments, if a pick occurs during a pattern that gives rise to a decision to register or ignore the pick, and if the pattern continues to change while the pick is occurring, then Even if the pattern of the above results in different judgments, it can still be controlled by the first judgment.

Some embodiments allow the user to enter a touch gesture by moving one or more fingers along the panel. In some embodiments, it is detected that a predetermined multi-touch gesture is in progress, and if a pick is detected while the multi-touch gesture is in progress, the pick can be ignored. This can be done because the user can accidentally press the panel while trying to perform the gesture.

In other embodiments, gestures and picks can be detected simultaneously and, in some cases, different behaviors can be provided in such an event. For example, in some embodiments, the user performs a pick to "pick up the object" and then moves the object while the pick is being performed (ie, the panel is being pushed down). By performing gestures, it is possible to move objects around the desktop.

When processing gestures, the concept of minimum path can be defined. In some embodiments, the lowest path can simply be selected as the lowest touch on the panel (ie, has the lowest y coordinate). In other embodiments, the lowest path can be selected as a touch that is relatively low and relatively fixed. In one embodiment of the latter embodiment, the lowest path can be selected based on the height and speed of each touch. If there are multiple touches on the panel at a given time, the following parameters can be measured for each touch, i.e. the height y of the touch and the touch move over a predetermined time period. Distance d. (The predetermined time period can be a relatively short period such as 0.1 seconds.) The lowest route can be a touch with the smallest (d + y). In other embodiments, the equation (ad + by) can be used, where a and b are predetermined constants. The lowest path is usually the thumb, but may be another finger or object.

In some embodiments, touch events may be ignored as well. One such example is shown in panel 407 of FIG. 4C. In the embodiment shown by this panel, the thumb rest zone can be defined in the lower portion of the panel underline 408. The thumb rest zone can be, for example, 1 cm thick. If the lowest route (eg, lowest route 409) appears in the thumb rest zone, any pick received can be registered, but the touch input of the lowest route can be rejected or ignored. This can occur because the user may be touching the panel just to place a finger or perform a pick and is not willing to perform any touch input. Ignoring touches in the various rest zones has the agent reference number 106842017800, which is incorporated herein by reference in its entirety for all purposes, and is the name of the invention and the simultaneous application "SELECTIVE REJECTION OF TOUCH CONTACTS IN". AN EDGE REGION OF A TOUCH It is described in more detail in the US patent application for SURFACE (Selective Rejection of Touch Contact in the Edge Region of the Touch Surface). If the lowest path moves away from the thumb rest zone, that touch input can be enabled. However, there is another finger touch detected on the panel (such as finger touch 410), and other finger touches are pre-existing from the time the finger touch 410 appears to the time the lowest path 409 leaves the thumb rest zone. If moved more than a defined distance (eg 1 cm), the minimum path 409 can be permanently ignored regardless of where it was moved (ie, ignored until the user lifts his finger). .. This can be done because the user can focus on performing finger gestures (ie, touch 410) and unintentionally lift the thumb (ie, lowest path 409) from the rest zone.

In some embodiments, if the lowest path is moving for at least a predetermined time period before another finger touches, the lowest path is ignored after the other finger touches. The predetermined time can be, for example, 1/4 second.

In some embodiments, if there is a pick detected when there is more than one finger touch currently detected, the lowest path is selected from the current touch and while the pick is in progress. (Ie, while the user is pushing the panel down) is ignored. Note that in these embodiments, if only one touch is detected when the pick is detected, this touch will be ignored.

If the lowest path is rejected under the above scenario, the memory flag will be set until the lowest path is completely lifted off the surface, leaving the lowest path as the only remaining touch, or until all other touches are lifted from the surface, or The lowest path can be set to continue to be rejected until the pick is released and the lowest path is no longer identified as the thumb path.

The path or touch can be identified as a thumb path by examining the external quality of the touch pattern to determine if the pattern originated from the thumb touch. For example, the thumb touch can be larger and oval than a normal finger touch. In the above case, if the lowest path is identified as the thumb path and is not the only one, it will continue to be rejected after the pick is released. The minimum path motion described above can be distinguished from the thumb rest zone motion described with FIG. 4C above and need not depend on it.

In some situations, the user's finger intentionally touches the surface of the panel when the user pushes the panel down (ie, performs a pick) and when the user can return the panel to its original state. Please understand that it may slide without. This is especially true for curved panels such as the mouse panel in Figure 2, but can also occur for flat panels such as those shown in Figure 1.

Graph 500 in FIG. 5 shows the switch state of the mechanical switch during the pick execution. Switch state 0 can indicate that the top surface is not pushed downwards with respect to the switch. Switch state 1 can indicate that the top surface is being pushed down or a pick is being performed. At time 501, the user pushes the top surface down, changing the state from 0 to 1. The user keeps pushing the top surface down until point 502. At point 502, the user releases the top surface and either returns it to its original position or returns it to zero.

The user does not have to remove his finger from the top when released. The user can release the surface simply by relieving pressure from the surface and keeping the finger touching the surface. The user may wish to release the surface without removing the finger from the surface in order to perform or continue to perform the desired touch input or gesture. However, as mentioned above, the user may unintentionally move his or her finger along the multi-touch panel when first pressed down and when the top surface is released. This can occur as a result of changes in pressure between the user's finger and the surface. This can interfere with the touch input or gesture that the user intends to perform. Further, if the user has already moved his finger along the surface of the touch panel, the push or release action of the touch panel may cause an unintended change in moving speed. Therefore, embodiments of the present invention make it possible to remove the effects of this unintended finger movement by modifying the detected touch input.

This modification can be made based on a click memory variable, or an internal variable called CMV. Graph 503 of FIG. 5 shows the state of CMV according to some embodiments over a period of time. The click memory variable can have a value between 1 and 0. This can be reset to 1 each time the switch state changes. This CMV can be set to 1 at points 501 and 502. At non-zero values, CMV can exponentially decay over time until it reaches zero. This can be achieved, for example, by periodically performing the following calculations.

[Equation 1]<img id="000002" he="9" wi="45" file="JP5259474B2_D0001.tif" img-format="tif" img-content="drawing" />

In various embodiments, the coefficients of calculation (0.9) and duration can be varied. Due to the rounding inherent in electronic calculations, Equation 1 will result in CMV attenuation to 0 at some time after the change in switch state until a new change in switch state resets CMV to 1.

Each touch pattern that forms a separate geometric object can be considered a touch object. Thus, for example with respect to the panel 300, the finger touch patterns 306-308 can be considered as separate touch objects. The palm touch patterns 304 and 305 on panel 302 can also be considered as separate touch objects. You can calculate the velocity of each touch object on the panel. In some embodiments, this velocity calculation needs to be performed only when the CMV value is non-zero. The speed of the touch object can be changed according to the following formula.

[Equation 2]<img id="000003" he="22" wi="96" file="JP5259474B2_D0001.tif" img-format="tif" img-content="drawing" />

Where V_INIs the initial speed or sensing speed, V_RIs the resulting speed or correction speed, and K is a predetermined constant. An appropriate constant K can be selected experimentally.

The result of Equation 0 is shown in Figure 6. FIG. 6 is a graph of the correction speed associated with the initial speed for a predetermined value of CMV. As can be seen from the figure, the correction speed is generally proportional to the initial speed except for the dead zone range 601 defined by K · CMV. Therefore, speed correction is similar to dead zone filtering. The dead zone represents the speed range in which the perceived initial velocities of the various touch objects are likely to be entirely due to the result of an unintended top surface push or release by the user.

Thus, embodiments of the present invention can slow down the speed of a faster touch object based on the value of CMV, while allowing the slower touch object to stop (ie, make its speed equal to 0). ) Provide that.

The graph of FIG. 6 can show the relationship of velocity for only one moment. Over time, the value of CMV changes and the relationship in Figure 6 can change. More specifically, in the absence of new panel push or release events, the value of CMV can be attenuated, which can result in a reduction in dead zones. Therefore, the touch object velocity modification will decrease as the value of CMV decreases, or as time elapses from the last push or release event. Eventually, the CMV can be 0 and there is no speed correction at this point. This can reflect the fact that any unintended push or release effect on the top surface also diminishes over time and eventually disappears.

In some embodiments, Equation 2 can be calculated for the vertical and horizontal (x and y) components of the velocity of each object. Therefore, V_{R, x}And V_{R, y}Is V_{IN, x}And V_{IN, y}It can be calculated based on each. In some embodiments, the touch object modification speed can be sent to higher level modules. Alternatively, or in addition to this, the modification speed can be used to later determine the modification positions of the various touch objects, and these modification positions can be sent to higher level modules.

The speed correction described above is particularly useful for input devices with non-flat top surfaces and can be performed on the input device and / or similar devices of FIG. However, the same can be done for devices with a flat top surface, such as laptop trackpads.

The various input signal rejection and correction methods described above can be combined if they are not mutually exclusive. Thus, any device can feature a combination of one or more of the methods described above.

FIG. 7 is a block diagram showing a modular representation of an embodiment of the present invention. FIG. 7 can represent various embodiments such as the laptop of FIG. 1, the computer of FIG. 2, and the like. Block 700 represents a user input device. This can be a combination device of touch (or multi-touch) and mechanical pick input as described above. The user input device can be the trackpad of FIG. 1, the mouse of FIG. 2, or another device that combines touch sensing with mechanical pick sensing. Block 701 is a deny and fix module. This module accepts user input data from user input devices, modifies it as described above and / or rejects various sets of data, and further modifies the modified data into higher level modules 702-705. Can be sent.

Rejection and correction modules can be implemented on application-specific hardware. Alternatively, it can be implemented as software running on a programmable processor. In the latter alternative, the deny and fix module can include a processor, memory, and software stored in memory that is read and executed by the processor. The deny and fix module does not necessarily have to be directly connected to the user input device. Instead, there can be one or more intervening modules between blocks 700 and 701. These are modules that digitize, normalize and / or compress the input data of the input device, modules that perform error correction of other types of input data, or are touched with raw pixel-based input touch data. It can include modules that process input data from other perspectives, such as segmentation modules that organize into separate touch objects that define a particular area. Rejection and modification modules can be referred to as modification modules, as denial can be considered a type of modification.

The modified input data created by the reject and modify modules can be used by higher level modules. For example, higher level modules can carry out further processing and modification of the input data. Alternatively, higher level modules can actually use the input data to interact with the user. Thus, some higher level modules can be applications such as web browsers, email clients and others. Higher level modules can also be implemented as software running on programmable processors or as applicational hardware. When implemented as software, higher level modules can include software that is stored in the same memory as the deny and fix modules, or software that is stored separately. In addition, higher level modules can run on the same or different processors as the reject and modify modules. The devices described above, whether they are laptop computers, desktop computers, or other types of devices, are made more by providing a rich user input interface without the need to focus the user on preventing unintended user input. It can be characterized by better and more intuitive user interaction.

Although some of the embodiments described above are mostly described for rectangular panels, these embodiments can also be used in the context of non-rectangular or curvilinear panels. Embodiments with curved panels are characterized by having a "flat" or two-dimensional display of touch data perceived on the panel and can therefore be associated with the panels described in FIGS. 3 and 4.

Various user input devices that can be used according to embodiments of the present invention have already been described above with respect to FIGS. 1 and 2. The text below and Figure 8-13 provide some additional detailed description of these types of user input devices. The present invention is not limited to the user input devices described below.

The touch-sensitive trackpad 10 will be described in detail with reference to FIG. A trackpad is generally a small (often rectangular) area containing a protective / decorative shield 12 and a plurality of electrodes 14 located beneath the protective shield 12. The electrodes 14 can be placed on a circuit board, such as a printed circuit board (PCB). For simplicity, a portion of the protective shield 12 has been removed so that the electrodes 14 are visible. Different electrodes 14 or combinations thereof can represent different x, y positions. In one configuration, as the finger 16 (or stylus, not shown) approaches the electrode grid 14, the finger forms a capacitance with one or more electrodes in close proximity to the finger. It is possible, or it is possible to change the existing capacitance between one or more of these electrodes. The circuit board / sensing electrode (not shown) measures such a change in capacitance and produces an input signal 18 to be sent to a host device 20 (eg, a computing device) having a display screen 22. The input signal 18 is used to control the movement of the cursor 24 on the display screen 22. As shown, the input pointer moves in the same x and y directions as the detected x and y finger movements. FIG. 9 is a simplified perspective view of the input device 30 according to one embodiment of the present invention. The input device 30 is generally configured to transmit information or data to an electronic device (not shown) in order to perform operations on the display screen (eg, via a graphical user interface (GUI)). .. For example, moving an input pointer, making a selection, providing an instruction, and so on. The input device can interact with the electronic device via a wired (eg, cable / connector) or wireless connection (eg, IR, Bluetooth, etc.).

The input device 30 can be a stand-alone unit or can be integrated into an electronic device. When a stand-alone unit, the input device usually has its own housing. When integrated into an electronic device, the input device typically uses the housing of the electronic device. In either case, the input device can be structurally coupled to the housing via, for example, screws, snaps, fixtures, adhesives, and the like. In some cases, the input device can be detachably coupled to the electronic device, for example via a docking station. The electronic device to which the input device is combined can correspond to any consumer-related electronic product. By way of example, electronic devices can accommodate desktop computers, laptop computers or PDAs, media players such as music players, communication devices such as mobile phones, other input devices such as keyboards, and computers such as the like. it can.

As shown in FIG. 9, the input device 30 includes a frame 32 (or support structure) and a trackpad 34. The frame 32 provides a structure for supporting the components of the input device. Also, the frame 32 in the form of a housing can enclose or accommodate components of the input device. The components including the trackpad 34 can correspond to electronic, optical and / or mechanical components for operating the input device 30.

The trackpad 34 provides an intuitive interface configured to provide one or more control functions for controlling various applications associated with the attached electronic device. As an example, the touch activation control function can be used to move an object, perform an action on a display screen, or make a selection or issue a command associated with the action of an electronic device. To implement the touch activation control function, the trackpad 34 identifies on the trackpad 34 from a finger (or object) that moves across the surface of the trackpad 34 (eg, linear, radial, angular, etc.). It can be configured to receive input from a finger holding the position of and / or a finger tapping a specific position on the trackpad 34. As will be appreciated, the touchpad 34 can facilitate one-handed operation, i.e., allow the user to interact with the electronic device with one or more fingers.

The trackpad 34 can be varied over a wide range. For example, the touchpad 34 can be a conventional trackpad based on a Cartesian coordinate system, or the trackpad 34 can be a touchpad based on a polar coordinate system. An example of a touchpad based on polar coordinates is incorporated herein by reference in its entirety for all purposes with the name "TOUCH PAD FOR HANDHELD DEVICE" filed on 1 July 2002. ) , Can be found in US Pat. No. 7,046,230 granted to Zadesky et al.

The trackpad 34 can be used in relative or absolute mode. In absolute mode, the trackpad 34 records the absolute coordinates of where it is touched. For example, x, y in the case of a Cartesian coordinate system, or (r, θ) in the case of a polar coordinate system. In relative mode, the trackpad 34 records the direction and / or distance of change. For example, left / right, top / bottom, and so on. In most cases, the signal generated by the trackpad 34 directs movement on the display screen in the same direction as the finger as it travels across the surface of the trackpad 34.

The shape of the trackpad 34 can be varied over a wide range. For example, the trackpad 34 can be circular, elliptical, square, rectangular, triangular, and the like. Generally, the outer circumference of the trackpad 34 defines the working boundary of the trackpad 34. In the illustrated embodiment, the trackpad is rectangular. Rectangular trackpads are common on laptop computers. The circular trackpad allows the user to continuously and freely rotate the finger, i.e., rotate the finger 360 degrees without interruption. In addition, the user can rotate the finger tangentially from all sides, thus giving a larger range of finger positions. Both of these features helped in implementing the crawling feature, favoring the use of circular trackpads in portable media players (eg, iPod media players manufactured by Apple Inc. in Cupertino, CA). Become. Further, the size of the trackpad 34 generally corresponds to a size that can be facilitated by the user (eg, the size of a fingertip or larger).

The trackpad 34, which generally takes the form of a solid flat platform, includes a touchable outer track surface 36 for receiving fingers (or objects) for the operation of the trackpad. Although not shown in FIG. 9, below the touchable outer track surface 36 is a sensor configuration that senses such things as finger pressure and / or movement above it. A sensor configuration typically includes a plurality of sensors, which are configured to operate when a finger rests, taps, or passes over it. In the simplest case, an electronic signal is generated each time the finger is positioned above the sensor. The number of signals in a given time frame can indicate the location, direction, velocity, and acceleration of the finger on the trackpad 34, that is, the more signals the user is moving the finger more. Become. In most cases, signals are monitored by electronic interfaces that convert the number, combination, and frequency of signals into location, direction, velocity, and acceleration information. This information can then be used by the electronic device to perform the desired control function on the display screen. The sensor configuration can be varied over a wide range. As an example, the sensor may be based on resistance sensing, surface acoustic wave sensing, pressure sensing (eg strain gauge), infrared sensing, light sensing, distributed signaling technology, acoustic pulse recognition, capacitance sensing, and the like. it can.

In the illustrated embodiment, the trackpad 34 is based on capacitance sensing. As is commonly known, capacitance-based trackpads are configured to detect changes in capacitance as the user moves an object, such as a finger, around the trackpad. Capacitive trackpads often include related electronics including protective shields, one or more electrode layers, circuit boards and application specific integrated circuits (ASICs). A protective shield is placed over the electrodes, the electrodes mounted on the top surface of the circuit board, and the ASIC mounted on the bottom surface of the circuit board. The protective shield serves to protect the underlying layer and provide a surface that allows the fingers to slide. The surface is generally smooth so that the fingers do not stick to the surface when moving. The protective shield also provides an insulating layer between the finger and the electrode layer. The electrode layer comprises a plurality of spatially distinct electrodes. Any suitable number of electrodes may be used. In most cases it is desirable to increase the number of electrodes in order to increase the resolution, i.e. more information can be used for things such as acceleration.

Capacitance sensing operates according to the principle of capacitance. As is understood, whenever two conductive members come close to each other without actual touch, these electric fields interact to form a capacitance. In the above configuration, the first conductive member is one or more of the electrodes and the second conductive member is, for example, a user's finger. Therefore, when the finger approaches the touchpad, a small capacitance is formed between the finger and the electrodes in close proximity to the finger. The capacitance at each of the electrodes is measured by an ASIC located on the back of the circuit board. By detecting changes in capacitance at each of the electrodes, the ASIC can determine the location, direction, velocity, and acceleration of the finger as it travels across the touchpad. The ASIC can also record this information in a format that can be used by electronic devices.

According to one embodiment, the trackpad 34 is movable relative to frame 32 to activate another set of signals (other than tracking signals). As an illustration, the trackpad 34 in the form of a solid flat platform can rotate, pivot, slide, translate, bend and / or do the same with respect to the frame 32. The trackpad 34 can be coupled to and / or held movably by the frame 32. By way of example, the trackpad 34 can be coupled to the frame 32 via screws, accelerators, pin joints, slider joints, ball socket joints, flex joints, magnets, cushions, and / or the like. The trackpad 34 can also be floated within the space of the frame (eg gimbal). The input device 30 additionally includes a combination of joints such as pivot / translation joints, pivot / flex joints, pivot / ball socket type joints, translation / flex joints, and the like to extend the range of motion. Note that it can (for example, increase the degree of freedom). Upon movement, the touchpad 34 is configured to activate a circuit that produces one or more signals. Circuits generally include one or more movement indicators such as switches, sensors, encoders, and the like. Examples of gimbaled trackpads are incorporated herein by reference in their entirety for all purposes, under the name "MOVABLE TOUCH PAD WITH ADDED FUNCTIONALITY", August 18, 2003. It can be found in US Patent Application Sequential No. 10 / 643,256 filed on the same day.

In the illustrated embodiment, the trackpad 34 takes the form of a pressable button that performs a "picking" operation. That is, a portion of the entire trackpad 34 behaves like a single or multiple buttons, so that one or more additional button functions can be tapped on the trackpad or separate buttons / separate zones. This can be achieved by pressing the trackpad 34 instead of using. As shown in FIGS. 10A and 10B, according to one embodiment of the invention, the trackpad 34 is subjected to force from a finger 38, palm, hand, or other object to the trackpad 34. , Can move between an upright (or neutral) position (Fig. 10A) and a pressed (actuated) position (Fig. 10B). The force need not be small enough to allow accidental activation of the button signal, but should not be large enough to make the user feel uncomfortable by requiring excessive pressure. The trackpad 34 is usually urged in an upright position via, for example, a bending hinge, a spring member, or a magnet. The trackpad 34 moves to the working position when the object pushing the trackpad 34 overcomes the bias. As shown in FIG. 10C, the trackpad 34 can be pivoted at one end so that the working position is slightly tilted with respect to the neutral position. When the finger (or other object) is removed from the trackpad 34, the urging member pushes the trackpad 34 back toward the neutral position. A shim or other structure (not shown) can prevent the trackpad 34 from overshooting the neutral position when returning. For example, a portion of the frame 32 may extend outward over a portion of the trackpad 34 to keep the trackpad 34 in the neutral position. In this way, the track surface can be kept coplanar with the frame 32, if desired. For example, in a laptop computer or handheld media device, the trackpad can be a computer or device housing.

In the upright / neutral position, as shown in FIG. 10A, the trackpad 34 produces a tracking signal when an object, such as the user's finger, moves on the upper surface of the touchpad in the x, y plane. FIG. 10A shows the neutral position as an upright position, but the neutral position can be positioned in any direction. As shown in FIG. 10B, at the pressed position (z direction), the trackpad 34 generates one or more button signals. Button signals can be used for a variety of functions, including, but not limited to, making selections or sending commands associated with operating an electronic device. As an example, in the case of a music player, the button function can be associated with opening a menu, playing a song, fast-forwarding a song, searching in a menu, and the like. For laptop computers, button functions can be associated with opening menus, selecting text, selecting icons, and the like. As shown in FIG. 10D, the input device 30 can be configured to provide both tracking and button signals simultaneously, i.e., tangentially along the track surface (ie, in the x, y directions). While moving, press the touch pad 34 in the z direction at the same time. In other cases, the input device 30 can be configured to provide only the button signal when the touchpad 34 is pressed and to provide the track signal when the touchpad 34 is upright.

More specifically, the trackpad 34 is configured to activate one or more movement indicators, which can generate a button signal when the trackpad 34 moves to the actuating position. The movement indicator is typically located within the frame 32 and can be coupled to the trackpad 34 and / or the frame 32. The movement indicator can be any combination of switches and sensors. Switches are generally configured to provide pulsed or binary data such as activated (on) or inactive (off). As an illustration, the underside portion of the trackpad 34 can be configured to contact or engage (and thus act) the switch when the user presses the trackpad 34. Sensors, on the other hand, are generally configured to provide continuous or analog data. As an example, when the user presses the trackpad 34, the sensor can be configured to measure the position or tilt of the touchpad 34 with respect to the frame. Any suitable mechanical, electrical and / or optical switch or sensor can also be used. For example, tact switches, force sensing resistors, pressure sensors, proximity sensors, and the like can be used.

The trackpads 10 and 30 shown in FIGS. 8-10 can be multi-touch trackpads in some embodiments. Multi-touch is multiple, as opposed to a touch surface (screen, table, wall, etc.) or touch pad, as well as a standard touch screen that recognizes only one touch point (eg, computer touch pad, ATM). Consists of software that recognizes simultaneous touchpoints. This action includes, but is not limited to, capacitance sensing, resistance sensing, surface acoustic wave sensing, heat, finger pressure, high capture rate cameras, infrared light, light capture, tuned electromagnetic induction, and shadow capture. Achieved through a variety of means. An example of a multi-touch mobile phone is an iPhone manufactured by Apple Inc., located in Cupertino, California. An example of a multi-touch media device is the iPod Touch manufactured by Apple Inc. Examples of laptop computers with multi-touch trackpads are MacBook Air and MacBook manufactured by Apple Inc. Pro. All of the input devices described herein can utilize multi-touch technology in some embodiments, or the input devices described herein utilize a single touch trackpad. May be good.

FIG. 11 is a schematic block diagram of a computing system 39 according to one embodiment of the present invention. A computing system generally includes an input device 40 operably connected to a computing device 42. As an example, the input device 40 can generally correspond to the input device 30 shown in FIGS. 9 and 10, and the computing device 42 is a laptop computer, desktop computer, PDA, media player, mobile phone, smartphone. , Video games, or similar. As shown, the input device 40 includes a pressable trackpad 44 and one or more movement indicators 46. When the trackpad 44 is pressed, the trackpad 44 is configured to generate a tracking signal and the movement indicator 46 is configured to generate a button signal. The trackpad 44 can be varied over a wide range, but in this embodiment the trackpad 44 collects the capacitance sensor 48 and the position signal from the sensor 48 and supplies that signal to the computing device 42. Including control system 50 for. The control system 50 monitors the signal from the sensor 48, calculates the location (orthogonal or angle), direction, velocity, and acceleration of the monitored signal, and records this information in the processor of the computing device 42. It can include an application specific integrated circuit (ASIC) that is configured. The movement indicator 46 can also be changed over a wide range. However, in this embodiment, the movement indicator 46 takes the form of a switch that generates a button signal when the trackpad 44 is pressed. The switch 46 can accommodate mechanical, electrical or optical style switches. In one particular embodiment, the switch 46 is a mechanical style switch that includes a protruding actuator 52 that can be pressed by the trackpad 44 to generate a button signal. As an example

Both the trackpad 44 and the switch 46 are operably coupled to the computing device 42 via the communication interface 54. The communication interface provides a connection point for direct or indirect connection between the input device and the electronic device. The communication interface 54 can be wired (wires, cables, connectors) or wireless (eg, transmitter / receiver).

The computing device 42 generally includes a processor 55 (eg, a CPU or microprocessor) that is configured to execute instructions and perform operations associated with the computing device 42. For example, using instructions retrieved from memory, the processor can control the receipt and operation of input and output data between the components of computing device 42. In most cases, processor 55 executes instructions under the control of the operating system or other software. The processor 55 can be a single-chip processor or can implement a plurality of components.

The computing device 42 also includes an input / output (I / O) controller 56 operably coupled to the processor 54. The I / O controller 56 can be integrated with the processor 54 or can be a separate component as shown. The I / O controller 56 is generally configured to control interaction with one or more I / O devices that can be coupled to the computing device 42, such as the input device 40. The I / O controller 56 generally operates by exchanging data between the computing device 42 and the I / O device that wants to communicate with the computing device 42.

The computing device 42 also includes a display controller 58 operably coupled to the processor 54. The display controller 58 can be integrated with the processor 54 or can be a separate component as shown. The display controller 58 is configured to process display commands for generating text and graphics on the display screen 60. As an example, the display screen 60 is a monochrome display, a color graphics adapter (CGA) display, an extended graphics adapter (EGA) display, a variable graphics array (VGA) display, a super VGA display, a liquid crystal display (LCD) (eg, an active matrix, etc.). It can be a passive matrix and the like), a cathode ray tube (CRT), a plasma display, a backlit light emitting diode (LED) LCD display, or the like.

In one embodiment (not shown), the trackpad 44 can include a glass surface that functions not only as a touch-sensitive surface but also as a display screen, in which case the display screen 60 shown in FIG. , Can be integrated with the glass surface of the trackpad 44. This can be useful in computing devices with touch-sensitive displays (eg, media players or mobile phones). An example of a media player with a touch-sensitive display is the iPod Touch manufactured by Apple Inc., located in Cupertino, California. An example of a mobile phone with a touch-sensitive display is an iPhone manufactured by Apple Inc., located in Cupertino, California.

In most cases, the processor 54 with an operating system operates to execute computer code to create and use data. The computer code and data can reside in the program storage area 62 operably coupled to the processor 54. The program storage area 62 generally provides a place to hold the data used by the computing device 42. As an example, the program storage area can include read-only memory (ROM), random access memory (RAM), hard disk drive and / or the like. Computer code and data can reside on removable program media and can be loaded or installed on computing devices when needed. In one embodiment, the program storage area 62 is configured to store information for controlling how the tracking and button signals generated by the input device 40 are used by the computing device 42. There is.

FIG. 12 shows one embodiment of an input device entirely shown at 70, including a trackpad 72 connected to frame 76. The frame 76 can be a housing for a stand-alone input device, or for another device that incorporates a trackpad 72, such as a laptop computer, desktop computer, handheld media device, PDA, mobile phone, smartphone, etc. It can be a case. The trackpad 72 includes various layers including a touch-sensitive outer track surface 74 for tracking finger movements. The track surface 74 can also provide a low friction decorative surface. In one embodiment, the trackpad 72 is based on capacitance sensing and thus includes an electrode layer 80 that can be mounted on a PCB, for example. For capacitance sensing, the track surface 74 is a dielectric material. The stiffener 84 is positioned below the electrode layer 80. Reinforcing material 84 is shown in FIGS. 12 and 13, but may be omitted in some embodiments. The stiffener 84 can be used to compensate for the inherent flexibility of the electrode layer 80. The electrode layer 80 responds to finger movements along the track surface 74 by sending a signal to the sensor 82. In the case of capacitance sensing, the electrode layer 80 registers changes in capacitance based on finger movement, and the sensor 82 is a capacitance sensor. In this way, the trackpad 72 incorporates a touch sensor configuration. Although the sensor 82 is shown located below the electrode layer 80, it can be located elsewhere in other embodiments. When the sensor 82 is located on the moving part of the trackpad 72, as in the illustrated embodiment, the input device can incorporate a flexible electrical connection (not shown) that can be moved with the system. ..

The movement indicator 78 is located at the bottom of the trackpad 72. The movement indicator 78 can be varied over a wide range, but in this embodiment it takes the form of a mechanical switch normally located between the trackpad 72 and the frame 76. In other embodiments, the movement indicator 78 can be a sensor, such as an electrical sensor. The movement indicator 78 can be attached to the frame 76 or trackpad 72. In the illustrated embodiment, the movement indicator 78 is attached to the lower side of the electrode layer 80. As an example, if the electrode layer 80 is located on the PCB, the movement indicator 78 can be located on the bottom of the PCB. In another embodiment, the movement indicator 78 can take the form of a tact switch, more specifically an SMT dome switch (a dome switch packaged for SMT).

The trackpad 72 is shown in the neutral position in FIG. 12, where the movement sensor 78 is not in contact with the frame 76. When the user applies downward pressure to the track surface 74, the trackpad 72 moves downward, causing the movement sensor 78 to register this change in position. In the illustrated embodiment, the mobile sensor 78 (tact switch) comes into contact with either the frame 76 or, in this case, the set screw 88. The set screw 88 can be manually adjusted to change the distance between the neutral position and the operating position. In one embodiment (not shown), the set screw 88 can be in direct contact with the movement sensor 78 in the neutral position without loosening or prior movement in the system. The flex hinge 86 connects the trackpad 72 to the frame 76. The bending hinge 86 is an elastic material that bends when a force is applied, but exerts a restoring force that attempts to return the trackpad 72 to the neutral position. In one embodiment, the flex hinge 86 can be thin spring steel.

As shown in FIG. 13, the bending hinge 86 bends when the user pushes the track surface 74 downward. The flex hinge 86 attempts to push the trackpad 72 back into the neutral position, which is horizontal in the illustrated embodiment shown in FIG. In this way, the user can push virtually anywhere on the track surface 74 downwards to trigger a "pick" which means that the movement indicator 78 registers this push. This is in contrast to traditional trackpads that incorporate separate track zones and pick zones. Being able to pick anywhere on the track surface 74 provides the user with a more intuitive and comfortable interface. For example, the user can generate tracking and button signals with a single finger without having to remove the finger from the track surface 74. In contrast, users operating trackpads with separate tracks and pick zones use, for example, the right hand for tracking and the left hand for picking, or the index finger for tracking and the thumb for picking. there is a possibility.

The shoulder portion 90, which can be an extension or a separate member of the frame 76, prevents the trackpad 72 from overshooting the neutral position by contacting a portion of the trackpad 72, such as the stiffener 84. In this way, the track surface 74 can be kept substantially coplanar with the upper surface of the frame 76. A shock absorber or upstop (not shown) can be incorporated with the shoulder 90 to soften the contact between the trackpad 72 and the shoulder 90.

As will be appreciated, picks generated by pressing track surface 74 can select items on the screen, open a file or document, execute instructions, start a program, browse menus, and / or the same. Can include. Button functions also perform keyboard-related actions such as zooming, scrolling, opening various menus, putting the input pointer back in place, enter, delete, insert, page up / down, and so on. , Can include features that facilitate navigation of electronic systems.

The flex hinge 86 allows a movable trackpad within the smallest vertical space feasible. Since the flex hinge 86 is thin and generally positioned parallel to the lower layer of the trackpad 72, a minimum vertical space is achieved, so that the flex hinge 86 does not significantly increase the thickness of the trackpad 72. Therefore, this configuration is suitable for use in ultra-thin laptop computers. Vertical space is extremely limited in such ultra-thin laptop computer applications. So far, the size of electronic components has often been a limited feature in terms of how small an electrical device can be made. Today, electronic components are becoming smaller and smaller, which means that mechanical components (eg, movable trackpads) can be important size-restricting components. This understanding makes it easier to understand why linear actuation (eg, supporting a movable trackpad with a coil spring or the like) is not ideal for some applications. In addition, the use of springs can add unnecessary complexity to the manufacturing process (increased component count, high cost, increased failure rate, etc.). Another drawback of the spring is that, in some embodiments, the spring can block or impair the force distribution of the tactile switch. In contrast, the bend 86 can provide a substantially constant sensation across the track surface 74, giving the user a more faithful representation of the tactile switch force distribution.

Referring now to FIG. 13, according to one embodiment of the invention, when the user presses the track surface 74 of the trackpad 72, the trackpad 72 is placed beneath it by pivoting downward. Switch 78 is activated. When activated, switch 78 produces a button signal that can be used by an electronic device connected to input device 70. The bend 86 can constrain the trackpad 72 to move substantially only around one axis. This can be achieved, for example, by using a plurality of bends arranged along an axis on one side of the trackpad 72, such as the back side. Further, if the trackpad 72 is made rigid (eg, by including reinforcement 84 if necessary), a uniform architecture is achieved. In other words, the flex hinge 86 attempts to push the trackpad 72 back towards the neutral position, and further moves around substantially only one axis, the axis in which the flex hinge 86 is connected to the frame 76. to enable.

Although embodiments of the present invention have been described in detail with reference to the accompanying drawings, it should be noted that various changes and modifications will be apparent to those skilled in the art. Such changes and amendments should be understood to be within the scope of the embodiments of the invention as defined by the appended claims.

100 devices 101 multi-touch trackpad 102 base 103 hinge 104 switch 110 laptop computer