Motion-based input system for handheld devices
Summary by NHIP
Tap and Position Command System
The motion-based input system distinguishes between tap and position commands to execute different device actions. The processor detects taps by computing power spectral density and comparing energy levels against a threshold within a frequency range greater than or equal to 5 Hz.
Claim Score by NHIP
Abstract
A motion-based input system including a motion sensor coupled to a device. The motion sensor provides a motion signal corresponding to the movement of the device. The system further includes a processor responsive to the motion signal and configured to distinguish between a tap command and a position command and provides, in response to a tap command, one or more actions, and in response to a position command, one or more different actions to control and operate the device.

Term
Term ended
Expired 28 March 2021, 5.5 years ago.
- Priority
- Filed
- Granted
- Expired
- Today
18 claims: 2 independent, 16 dependent
- 1A motion-based input system comprising:a motion sensor coupled to a device, the motion sensor providing a motion signal corresponding to the movement of the device;and a processor responsive to the motion signal and configured to: distinguish between a tap command and a position command and to provide, in response to a tap command, one or more actions, and in response to a position command, one or more different actions to control and operate the device, wherein the processor detects a tap command by computing the power spectral density of the motion signal and comparing the energy level of the computed power spectral density of the motion signal with a predetermined threshold energy level for a predetermined threshold frequency range.
- 17Broadest claimClaim Score 64, broad(NHIP)A motion-based input system comprising:a motion sensor coupled to a device, the motion sensor providing a motion signal corresponding to the movement of the device;and a processor, responsive to the motion signal and configured to: detect a tap command;and provide, in response to the tap command, one or more actions to operate and control the device, wherein the processor detects a tap command by computing the power spectral density of the motion signal and comparing the energy level of the computed power spectral density of the motion signal with a predetermined threshold energy level for a predetermined threshold frequency range.
Independent claims2
62 paragraphs in 6 sections, as filed
RELATED APPLICATIONS
This application claims as a continuation-in-part of U.S. utility application Ser. No. 09/572,801 filed May 17, 2000 is pending; Ser. No. 09/773,165 filed Jan. 31, 2001 now is U.S. Pat. No. 6,721,738; and Provisional Application No. 60/286,860 filed Apr. 26, 2001. All of these applications are incorporated by reference herein.
FIELD OF THE INVENTION
This invention relates to a motion-based input system and more particularly, to a motion-based input system for use with electronic devices.
BACKGROUND OF THE INVENTION
Modem electronic devices are become increasingly smaller in size. There are now personal data assistants (PDAs), handheld personal computers, cellular telephones, televisions, pagers, and computerized Rolodexes which fit in the palm of the hand. Typical prior art devices employ a mouse to position a pointer over an icon, and a “double click” is required to select the desired program associated with the icon. Other prior art devices use a combination of stylus and/or an “enter” key or button to select a desired program or to perform other actions. Other prior art devices employ a combination of position commands (e.g., tilting) to move the cursor and an “enter” key to select and activate the desired program. However, as these devices get increasingly smaller and the screensize requirements get relatively larger, traditional input buttons, enter keys, keypads and pointing devices are becoming more and more difficult for users to use and for manufacturers to incorporate into the devices.
One attempt to eliminate the need for keys, keypads and pointing devices is found in U.S. Pat. No. 6,347,290, herein incorporated in its entirety by this reference. This proposed motion-based input system, however, actually complicates the control and operation of the device by requiring a combination of different position commands (e.g., a particular orientation of the hand) and gesture commands (e.g., a time varying position expressed as a unique pattern of movement over an interval of time) to control and operate the device. Further, the apparatus and method as disclosed in the '290 patent requires the cumbersome task of inputting the various gesture commands into the system, storing the commands in a database, and memorizing them. Moreover, the gesture commands are typically complex patterns of movement which require physical dexterity of the hand.
Such a device is cumbersome and complicated because it requires both a position command and a gesture command to control and operate the device and requires the user to memorize each of the various gesture motions associated with the commands stored in the database. Moreover, because the gesture commands require dexterity of the hand, operation of this device is difficult and/or impossible for handicapped persons with limited hand motion.
In addition, application of the device and method disclosed in the '290 patent to mice technology would require lifting and tilting of the mouse to position the pointer (i.e. “point”) over the desired icon, then performing a gesture command to activate the program associated with the icon (i.e. “click”). Clearly, this is an inefficient and cumbersome way to operate a mouse.
Other motion detection systems, such as those disclosed in U.S. Pat. Nos. 5,477,236 and 5,910,797, also incorporated herein in their entirety by this reference, suffer from the same or similar problems.
SUMMARY OF THE INVENTION
It is therefore an object of this invention to provide an improved motion-based input system.
It is a further object of this invention to provide such a motion-based input system which can be made to perform a combination of one or more actions or commands to control and operate a device by simply moving and tapping the device.
It is a further object of this invention to provide such a motion-based input system which eliminates the need for complicated gesture commands.
It is a further object of this invention to provide such a motion-based input system which is simple and easy to operate.
It is a further object of this invention to provide such a motion-based input system which can be used by persons with limited hand dexterity.
It is a further object of this invention to provide such a motion-based input system which eliminates the need for buttons for performing select and execute actions on handheld devices.
This invention results from the realization that a truly innovative motion-based input system which is simple and easy to operate requires only a tap on a device for one type of action (e.g., “enter”) and motion of the device for a different action (e.g., cursor movement) or a combination of motions and taps in order to completely control and operate the device.
This invention features a motion-based input system comprising a motion sensor coupled to a device, the motion sensor providing a motion signal corresponding to the movement of the device, and a processor responsive to the motion signal and configured to distinguish between a tap command and a position command and to provide, in response to a tap command, one or more actions, and in response to a position command, one or more different actions to control and operate the device.
In one embodiment of this invention, the processor detects a tap command by computing the power spectral density of the motion signal and comparing the energy level of the computed power spectral density of the motion signal with a predetermined threshold energy level for a predetermined threshold frequency range. Ideally, the predetermined threshold levels are configurable to adjust the sensitivity of the tap detected by the processor. In one preferred embodiment, the predetermined threshold frequency detected by the processor is greater than or equal to 5 Hz. In one example, the predetermined threshold levels are stored in a memory. Preferably, the processor of the motion-based input system of this invention is a microprocessor.
In one design, the motion-based input system of this invention may further include an interface between the processor an operating system resident on the device. In a preferred embodiment, the motion-based input system further includes controlling software to control and operate the device based on the processor actions. Ideally, the motion sensor of the motion-based input system of this invention is an accelerometer and is coupled to an electronic device.
In one preferred design of this invention, the controlling software is programmed to display a graphical representation which indicates the direction of a current or a proposed position command. In one example, a continuous input mode provides continuous cursor or pointer movement in the direction of the current position command. Typically, the rate of cursor or pointer movement provided by the continuous input mode is proportional to the magnitude of the position command. Preferably, the controlling software may be programmed to display a graphical representation to indicate the direction of the continuous cursor or pointer movement.
In one preferred embodiment if this invention, a stepped input mode indicates the direction of a proposed position command and moves the cursor or pointer in the direction of the proposed position command in response to a tap command. Ideally, the controlling software is programmed to display a graphical representation to indicate the direction of the proposed position command.
In one design, the processor of the motion-based input system of this invention is configured to select a continuous input mode or a stepped input mode depending on the active software application.
This invention also features a motion-based input system comprising a motion sensor coupled to a device, the motion sensor providing a motion signal corresponding to the movement of the device, and a processor, responsive to the motion signal and configured to detect a tap command, and provide, in response to the tap command, one or more actions to operate and control the device.
In one example, the processor is responsive to the motion signal and may be configured to detect an impulse command, and provide, in response to the impulse command, one or more actions to control and operate the device. In other designs of this invention, the processor responsive to the motion signal may be configured to distinguish between a tap command and a tilt command and to provide, in response to the tap command one or more actions and in response to the tilt command, one or more different actions to control and operate the device.
This invention further features a motion-based input system comprising a motion sensor coupled to a device, the motion sensor providing a series of motion signals corresponding to movements of the device, and a processor, responsive to the series of motion signals, configured to detect a series of tap commands, and to provide, in response to the series of tap commands, one or more actions to operate and control the device.
In one example, the processor responsive to the motion signals may be configured to distinguish between a series of tap commands and a series of position commands on the device, and to provide in response to the series of tap commands, one or more actions, and in response to the series of position commands, one or more different actions to operate and control the device.
This invention further features a motion-based input system comprising motion sensing means coupled to a device for sensing motion and providing a motion signal corresponding to the movement of the device, and processing means responsive to the motion signal and configured to distinguish between tap commands and position commands and to provide, in response to the tap commands one or more actions and in response to the position commands one or more different actions to control and operate the device.
This invention also features a method for processing input commands for a device. The method includes detecting a motion signal corresponding to movement of the device, analyzing the motion signal to distinguish between a tap command and a position command, and providing, in response to a tap command, one or more actions and providing in response to a position command, one or more different action, to control and operate the device.
In one design, the motion-based input system of this invention typically includes a motion sensor coupled to a device, the motion sensor providing a motion signal corresponding to the movement of the device, and a first action or series of actions associated with a tap on the device, a second action or series of actions associated with other movement of the device, a processor responsive to the motion signal and configured to distinguish between a tap on the device and other movement of the device; and to provide, in response to a tap, said first action or series of actions and in response to the other movement, said second action or series of actions to control and operate the device.
BRIEF DESCRIPTION OF THE DRAWINGS
Other objects, features and advantages will occur to those skilled in the art from the following description of a preferred embodiment and the accompanying drawings, in which:
<figref idref="DRAWINGS">FIGS. 1A-1F</figref> are schematic three-dimensional views of a typical prior art motion based input system employed in a PDA;
<figref idref="DRAWINGS">FIGS. 2A-2D</figref> are schematic three-dimensional views showing one example of the motion based input system of the subject invention also employed in a PDA;
<figref idref="DRAWINGS">FIGS. 3A-3E</figref> are schematic three-dimensional views of another example of the motion based input system of this invention employed in a cellular telephone.
<figref idref="DRAWINGS">FIG. 4</figref> is a partially broken away schematic view showing the primary components associated with the motion based input system of this invention when employed in a PDA;
<figref idref="DRAWINGS">FIGS. 5A and 5B</figref> are schematic three-dimensional views of another example of the motion based input system in accordance with this invention employed in PDA;
<figref idref="DRAWINGS">FIG. 6</figref> is a partially broken away schematic view showing the primary components associated with the motion based input system of the subject invention when employed in a computer mouse;
<figref idref="DRAWINGS">FIG. 7</figref> is graph showing a waveform representing a tilt of a device, gesture motion of the device, and a tap on the device;
<figref idref="DRAWINGS">FIGS. 8A-8C</figref> are graphs showing in greater detail the waveforms for the motion events shown in <figref idref="DRAWINGS">FIG. 7</figref>;
<figref idref="DRAWINGS">FIGS. 9A-9C</figref> are graphs showing frequency content in terms of spectral density for each motion event shown in <figref idref="DRAWINGS">FIGS. 8A-8C</figref>; and
<figref idref="DRAWINGS">FIG. 10</figref> is a flow chart of one embodiment of the motion-based method for processing commands for an electronic device in accordance with the present invention.
DISCLOSURE OF THE PREFERRED EMBODIMENT
Aside from the preferred embodiment or embodiments disclosed below, this invention is capable of other embodiments and of being practiced or being carried out in various ways. Thus, it is to be understood that the invention is not limited in its application to the details of construction and the arrangements of components set forth in the following description or illustrated in the drawings.
As explained in the Background section above, prior art motion-based input system <b>10</b>, <figref idref="DRAWINGS">FIG. 1</figref> as employed in handheld electronic device <b>12</b> such as a PDA, requires a combination of position commands (which relate to a particular angular orientation of electronic device <b>12</b>) and gesture commands (time varying positions expressed as a unique pattern of movement in an interval of time) to control and operate electronic device <b>12</b>. See U.S. Pat. No. 6,347,290. As shown in <figref idref="DRAWINGS">FIG. 1A</figref>, icon <b>18</b> on screen <b>16</b> of electronic device <b>12</b> is not highlighted or selected. In order to select the desired program associated with icon <b>18</b> a user typically performs a position command by tilting electronic device <b>12</b>, as shown in <figref idref="DRAWINGS">FIG. 1B</figref> to highlight or focus on icon <b>18</b>. After returning electronic device <b>12</b> to its original position as shown in <figref idref="DRAWINGS">FIG. 1C</figref>, prior art motion-based input system <b>10</b> requires a gesture command to invoke the “enter” command and to select the desired program associated with icon <b>18</b>. This gesture command is a time varying position expressed by a unique memorized pattern of movement, such as the somewhat cumbersome pattern between <figref idref="DRAWINGS">FIGS. 1D and 1E</figref> over a specific interval of time to activate the selected program associated with icon <b>18</b>, such as calendar program <b>20</b>, FIG. <b>1</b>F. Moreover, prior art motion-based input system <b>10</b> requires a user to first input all the user's gesture commands into the system, store the various gesture commands associated with the unique patterns of movements in a database, and then memorize the patterns of movements associated with the user's selected gesture commands.
Thus, system <b>10</b> suffers from several distinct disadvantages. First, the device is cumbersome and complicated to operate because it requires both position commands to perform selections and gesture commands to enter or activate the selection. Second, system <b>10</b> requires the user to input and memorize the patterns of movements associated with chosen gesture commands stored in a database. Third, as shown in the example above, prior art motion-based input system <b>10</b> employs gesture commands which require hand dexterity, and therefore system <b>10</b> is not useful by handicapped persons with limited hand dexterity.
In sharp contrast, motion-based input system <b>50</b>, <figref idref="DRAWINGS">FIG. 2</figref> of the subject invention is much easier to use. System <b>50</b> includes a motion sensor (not shown in <figref idref="DRAWINGS">FIG. 2</figref>) coupled to (e.g., directly within, on, or indirectly attached to) device <b>54</b>, such as a PDA, a hand held computer, or any other small handheld electronic or other device. The motion sensor provides a motion signal corresponding to movement of device <b>54</b>. A processor (also not shown in <figref idref="DRAWINGS">FIG. 2</figref>) is responsive to the motion signal and is configured to distinguish between a tap on device <b>54</b> and other motion of device <b>54</b> and to provide, in response to a tap, one or more actions or commands (for example an “enter” command), and, in response to other motions (e.g., tilts, rotational motions, and/or translational motions), one or more different action or commands (e.g., cursor movement) to fully control and easily operate device <b>54</b>. Thus, there are tap commands and motion commands. Because motion-based input system <b>50</b> is designed and configured to respond to tap commands as well as motion commands, a user, in one example, need only tilt device <b>54</b> to select a desired action or position command, then simply tap the device <b>54</b> to “enter” or activate the selected action. The result is a motion-based input system which is simple and easy to operate, which eliminates the need to memorize patterns of movement (e.g., gesture commands) to select commands stored in a database, and a unique system can be more easily used by persons with limited hand dexterity.
For example, in one embodiment of this invention as shown in <figref idref="DRAWINGS">FIGS. 2A-2D</figref>, a user can highlight or focus on icon <b>60</b> located on screen <b>59</b> of device <b>54</b> to select the particular application associated with icon <b>60</b> (such as a calendar program, or any other of the vast array of software programs available on hand held electronic devices) by tilting device <b>54</b> down to the right as shown in FIG. <b>2</b>B. The motion sensor detects this motion of device <b>54</b> and provides a motion signal to the processor which responds by providing the appropriate commands to focus or highlight icon <b>60</b>, as shown by icon <b>60</b> now being highlighted. Once icon <b>60</b> is focused or highlighted, the user simply taps electronic device <b>54</b>, as shown at <b>55</b>, FIG. <b>2</b>C. The uniquely configured processor, responsive to the motion signal output by the sensor, detects the tap command and provides the appropriate actions to activate, in this example, calendar program <b>62</b>, <figref idref="DRAWINGS">FIG. 2D</figref>, that is, an “enter” command is invoked, but without an enter button, mouse click, or gesture command.
Because the robust design of the motion-based input system of this invention detects a tap on device <b>54</b> and in response to the tap provides one or more actions to control and operate a device <b>54</b>, a vast array of actions based on a simple tap or a series of taps can be invoked on a wide variety of electronic and even other devices.
For example, in another embodiment of the subject invention, motion-based input system <b>50</b>′, <figref idref="DRAWINGS">FIG. 3A</figref> also includes a motion sensor coupled to electronic device <b>70</b>, here a cellular telephone. The motion sensor provides a motion signal corresponding to movement of electronic device <b>70</b> and the processor detects a tap command as shown at <b>71</b>, FIG. <b>313</b> and provides, in response to the tap command, action <b>72</b> which causes the cellular phone to dial the user's workplace. In another example, the processor detects a different tap command, for example a tap with more intensity, as shown at <b>73</b> in FIG. <b>3</b>C and provides, in response to the tap command, action <b>74</b>, which invokes the wireless phone to check a user's voice mail. Alternatively, the processor of motion-based input system <b>50</b>′ may be configured to detect a series of tap commands, shown at <b>75</b> in FIG. <b>3</b>D and at <b>77</b> in <figref idref="DRAWINGS">FIG. 3E</figref>, and respond to the series of tap commands by providing, in this example, action <b>76</b> which causes the cellular telephone to dial and check a user's e-mail.
The result is a motion-based input system which provides the ability to perform a wide range of actions or commands based on a simple tap or series of taps on the device without the need for buttons, a mouse, a keyboard, and without the need to perform gesture commands, to store the gesture commands in a database, or to memorize the gesture commands. Moreover, any device which employs the motion based input system of this invention can be easily used by persons having limited hand dexterity.
As shown in detail in <figref idref="DRAWINGS">FIG. 4</figref>, motion-based input system <b>50</b> of this invention typically includes motion sensor <b>80</b> coupled to device <b>54</b>. Ideally, motion sensor <b>80</b> is an accelerometer, such as multi-axis MEMS accelerometer (for example part no. ADXL 202 available from Analog Devices, Inc., Wilmington, Mass.). Motion sensor <b>80</b> provides a motion signal corresponding to movement of device <b>54</b>. As stated supra, processor <b>82</b> is uniquely configured to distinguish between tap commands (e.g., “enter”) on device <b>54</b> and position commands (e.g., tilting) of device <b>54</b> and provides, in response to a tap command, one or more actions, and provides in response to position commands, one or more different actions to control and operate device <b>54</b>.
In one design of this invention, motion-based input system <b>50</b> may include interface <b>84</b> which provides the interconnection between processor <b>82</b> and operating system <b>86</b> of the particular device <b>54</b>. Typically, motion-based input system <b>50</b> includes controlling software <b>88</b> which controls and operates device <b>54</b> in response to commands issued by processor <b>82</b>. Processor <b>82</b> may be a separate processor or a processor already associated with the electronic device.
In one preferred embodiment of this invention, controlling software <b>88</b> is programmed to display a small compass like icon on the screen with graphical elements such as arrows, to indicate the direction of the current position command (e.g., tilting). Tilt based position commands are performed by rotating device <b>54</b> to cause an angular deflection with respect to a reference orientation “neutral”. When a tilt of a sufficient magnitude occurs the compass will show a graphical arrow in the direction of that tilt and will move the cursor, pointer, or equivalent software entity in the same direction. The rate of cursor motion may optionally be proportional to the angle of deflection. This example is typically referred to as a “continuous” input mode. If a tap command occurs while the device is tilted, the neutral reference orientation will be redefined to be the current orientation. If a tap command occurs while device <b>54</b> is in its neutral orientation, a select, enter, or equivalent software action will be performed.
In another example of this invention, called “stepped” input mode, the compass like icon on the screen will display the same graphical elements, such as arrows and the like, to indicate the direction of the proposed position command. In this example, a tilt motion of sufficient magnitude will cause the compass to show a graphical arrow in the direction of that tilt, but software <b>88</b> will not move the cursor or pointer until a tap command is performed while device <b>54</b> is tilted. If a tap command occurs while device <b>54</b> is tilted, software <b>88</b> moves the cursor. If a tap command occurs while device <b>54</b> is in neutral, software <b>88</b> performs a select or enter action. Optionally, a new neutral reference orientation may be set by tilting device <b>54</b> to the desired neutral orientation and not tapping it for a predetermined length of time. In one design of this invention, processor <b>82</b> is configured to select a continuous input mode or a stepped input mode depending on the active software application on device <b>54</b>. Alternatively, in another design, as discussed below, software <b>88</b> may be programmed select a continuous input mode or a stepped input mode depending on the active software application on device <b>54</b>.
As an illustrative example of stepped input mode in accordance with this invention, if active program <b>200</b>, <figref idref="DRAWINGS">FIG. 5A</figref> is an electronic spreadsheet and a user desires to move the active cell <b>202</b> from location B<b>3</b> one cell to the left (cell A<b>3</b>), the position command of tilting device <b>54</b> to the left, as shown in <figref idref="DRAWINGS">FIG. 5B</figref>, causes controlling software <b>88</b> to display compass <b>204</b> on screen <b>206</b>. Arrow <b>208</b> of compass <b>204</b> indicates the direction of the proposed movement of the active cell. A tap command as shown at <b>212</b> is detected by the motion sensor, and as discussed supra, processor <b>82</b> detects the tap command and provides, in response to the tap command, the action of moving the active cell to the left one cell, or to cell <b>210</b> at location A<b>3</b>. Similarly, though not shown, position commands, such as tilting electronic device to the right, down, or up will cause controlling software <b>88</b> to display compass <b>204</b> with arrow <b>208</b> pointing in the direction of the proposed movement which will be completed after the tap command is performed.
In another embodiment of this invention, controlling software <b>88</b> is programmed to detect the current application or program being used on device <b>54</b>. Controlling software <b>88</b> is further uniquely programmed to determine the best motion-based input method for the application active on device <b>54</b>. For example, if a flight simulator game is active on device <b>54</b>, the best motion-based input system is the continuous mode. In this example, position commands (e.g., tilting) of the device provide the actions associated with controlling the simulated airplane and tap commands fire weapons. In another example, such as an electronic phone book, the stepped input mode, which uses a combination of tap commands and position commands, is the best motion-based input method to issue the appropriate actions of scrolling through the phone book.
In another example, motion-based input system <b>50</b>″, <figref idref="DRAWINGS">FIG. 6</figref> of this invention is employed in buttonless computer mouse <b>90</b>, where a tap on mouse <b>90</b> serves as the “click” button and movement of the mouse (i.e., position commands) serve as the “point”. Motion sensor <b>80</b> provides a motion signal corresponding to movement of mouse <b>90</b> and processor <b>82</b> is responsive to the motion signal and configured to distinguish between a tap command on mouse <b>90</b> and a position command (e.g., movement) of mouse <b>90</b> and to provide, in response to a tap command, a click action and, in response to the position command, point actions to operate computer <b>100</b>.
Motion-based input system <b>50</b>″ typically includes interface <b>84</b>′, such as a serial link, which is remotely located from motion sensor <b>80</b> and processor <b>82</b>, and provides an interconnection between processor <b>82</b> and operating system <b>86</b>′ of computer <b>100</b>. Although, in this example interface <b>84</b>′ is remotely located from mouse <b>90</b>, in other examples interface <b>84</b>′ may be coupled within mouse <b>90</b>. The result is a completely buttonless mouse which can be operated by simple tap commands and position commands of mouse <b>90</b>, hence eliminating the need for any buttons which significantly extends the lifetime of mouse <b>90</b> and provides for simple operation of the mouse.
As shown in <figref idref="DRAWINGS">FIG. 7</figref>, graph <b>250</b> depicts three signals corresponding to motion input events or commands, e.g., a tilt, a gesture and a tap, which can be detected by a typical motion sensor. A tilt, as shown by section <b>252</b>, is characterized as a change from one angular orientation to another. This type of motion or command produces a gradual shift of DC offset and generally has a low frequency content. A gesture motion command, as shown by section <b>254</b>, is characterized as a dynamic and continuous changing signal over a period of time having a low to medium frequency content. A tap command, as shown by section <b>256</b>, is an impulse type signal produced over a short period of time and has a high frequency content. Tap commands are also known as impulse commands because of the impulse nature of the motion caused by a tap command. Detailed views of the tilt, gesture and tap signals shown in <figref idref="DRAWINGS">FIG. 7</figref> is shown in <figref idref="DRAWINGS">FIGS. 8A</figref>, <b>8</b>B, and <b>8</b>C, respectively.
Ideally, in this invention, processor <b>80</b> detects a tap or impulse command, as shown at <b>256</b>, <figref idref="DRAWINGS">FIGS. 7 and 8C</figref> by computing the power spectral density (PSD) of the motion signal and comparing the power level for a predetermined frequency range with a predetermined power level threshold. The PSD describes how the power (or variance) of a time series is distributed with frequency. It is defined, in mathematical terms, as the Fourier Transform of the autocorrelation sequence of the time series and it has units of power per unit of frequency. The computed PSD of the tap command signal shown by graph <b>256</b>, <figref idref="DRAWINGS">FIG. 8C</figref> is shown as waveform <b>258</b>, FIG. <b>9</b>C. Similarly, the computed PSD of the tilt command signal shown by graph <b>252</b>, <figref idref="DRAWINGS">FIG. 8A</figref> is shown by waveform <b>260</b>, FIG. <b>9</b>A. The computed PSD of gesture command signal shown by graph <b>254</b>, <figref idref="DRAWINGS">FIG. 8B</figref> is shown by waveform <b>262</b>, FIG. <b>9</b>B.
As can be seen by the computed PSD shown by waveform <b>258</b>, <figref idref="DRAWINGS">FIG. 9C</figref>, a tap command has a significantly higher energy level and frequency content than the computed PSD for tilt command, as shown by waveform <b>260</b>, <figref idref="DRAWINGS">FIG. 9A</figref>, and the computed PSD for a gesture command, as shown by waveform <b>262</b>, FIG. <b>9</b>B. Processor <b>80</b> of motion-based input system <b>50</b> of this invention is uniquely configured to detect the higher energy level and frequency from the computed PSD of a tap command as discussed above.
In one preferred embodiment, processor <b>80</b> is configured to detect predetermined threshold frequency greater than or equal to 5 Hz. In one example, the predetermined threshold levels are stored in a memory within processor <b>80</b>, although the predetermined threshold levels may also be stored in an external memory. Ideally, the threshold levels detected by processor <b>80</b> are configurable to adjust the sensitivity of the tap detected by processor <b>56</b>. This unique feature renders motion-based input system <b>50</b> able to distinguish between an inadvertent tap command on device <b>54</b> which is not intended to invoke any commands, and a tap which is intended to issue commands. Ideally, processor <b>82</b> also detects a tilt command (e.g., angular deflection) of device <b>54</b>. In a preferred embodiment, processor <b>82</b> is a microprocessor which is programmed to distinguish between a tap command on device <b>54</b> and a position command of device <b>54</b>.
In accordance with the method of this invention, input commands are processed for a device, which includes the steps of detecting a motion signal corresponding to movement of the device, step <b>300</b>, <figref idref="DRAWINGS">FIG. 10</figref>; analyzing the motion signal to distinguish between a tap command and a position command, step <b>302</b>; and providing, in response to the tap command, one or more actions and providing, in response to a position command, one or more different actions, step <b>304</b>, to control and operate the device. Typically, a tap is associated with an action such as “enter” but different series of taps may be associated with, in a memory, for example, with a number of different actions as explained above with reference to FIG. <b>3</b>. Also, different motions are associated, also perhaps in a memory, with different position commands. For example a tilt to the right means move the cursor to the right and the like. See also co-pending application Ser. No. 09/773,165 filed Jan. 31, 2001 incorporated herein by this reference.
The robust motion-based input system of this invention is uniquely designed to detect tap commands and further designed to distinguish between tap commands on an electronic device and position commands of the electronic device. The robust design not only distinguishes between tap commands and position commands, but also provides one or more actions in response to the tap commands, and one or more different actions in response to the position commands. This unique feature provides the ability to perform a vast combination of actions based on a simple tap, or a combination of taps and/or position commands. The ability to detect a tap and perform one or more actions eliminates the need to perform the complex gesture commands of the prior art, which are often difficult and/or impossible to perform by persons of limited hand dexterity. The system of this invention is simple and easy to operate and can even be applied to mouse-technology to provide for a completely buttonless mouse which does not need to be lifted or require elaborate motions to invoke certain commands. Moreover, there is no need to configure the system by performing elaborate gesture commands which must be stored in a database, or memorizing the patterns of movement associated with the gesture commands. Moreover, enter keys and buttons can be eliminated in any electronic device.
Although specific features of the invention are shown in some drawings and not in others, this is for convenience only as each feature may be combined with any or all of the other features in accordance with the invention. The words “including”, “comprising”, “having”, and “with” as used herein are to be interpreted broadly and comprehensively and are not limited to any physical interconnection. Moreover, any embodiments disclosed in the subject application are not to be taken as the only possible embodiments.
Other embodiments will occur to those skilled in the art and are within the following claims:
Contents6
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2008030456A1 | Cited by | United States of America | Pre-grant |
| US2005166162A1 | Cited by | United States of America | Pre-grant |
| US2011018814A1 | Cited by | United States of America | Pre-grant |
| US9191773B2 | Cited by | United States of America | Applicant |
| US8213686B2 | Cited by | United States of America | Applicant |
| US2010195452A1 | Cited by | United States of America | Pre-grant |
| US2010241983A1 | Cited by | United States of America | Pre-grant |
| US2011109546A1 | Cited by | United States of America | Pre-grant |
| US8437353B2 | Cited by | United States of America | Applicant |
| US9026923B2 | Cited by | United States of America | Applicant |
| US9900669B2 | Cited by | United States of America | Applicant |
| US9317108B2 | Cited by | United States of America | Applicant |
| US2011050570A1 | Cited by | United States of America | Pre-grant |
| US8325138B2 | Cited by | United States of America | Applicant |
| US2011109545A1 | Cited by | United States of America | Pre-grant |
| US8194926B1 | Cited by | United States of America | Search report |
| US9019214B2 | Cited by | United States of America | Applicant |
| US7281131B1 | Cited by | United States of America | Applicant |
| US9075558B2 | Cited by | United States of America | Applicant |
| US10433033B2 | Cited by | United States of America | Applicant |
| US11090223B2 | Cited by | United States of America | Search report |
| US2008198033A1 | Cited by | United States of America | Pre-grant |
| US7683883B2 | Cited by | United States of America | Applicant |
| US8983139B2 | Cited by | United States of America | Applicant |
| US11068124B2 | Cited by | United States of America | Applicant |
| US7439953B2 | Cited by | United States of America | Search report |
| US10729973B2 | Cited by | United States of America | Applicant |
| US9904359B2 | Cited by | United States of America | Search report |
| US2008266252A1 | Cited by | United States of America | Pre-grant |
| US8015718B2 | Cited by | United States of America | Applicant |
| US7827698B2 | Cited by | United States of America | Applicant |
| US7882435B2 | Cited by | United States of America | Search report |
| US10613706B2 | Cited by | United States of America | Applicant |
| US2011074974A1 | Cited by | United States of America | Pre-grant |
| US8648825B2 | Cited by | United States of America | Applicant |
| US2009196124A1 | Cited by | United States of America | Pre-grant |
| US2009239573A1 | Cited by | United States of America | Pre-grant |
| US7848542B2 | Cited by | United States of America | Applicant |
| US8542189B2 | Cited by | United States of America | Applicant |
| US7659836B2 | Cited by | United States of America | Search report |
| US2016077651A1 | Cited by | United States of America | Pre-grant |
| US2010238109A1 | Cited by | United States of America | Pre-grant |
| US8537110B2 | Cited by | United States of America | Applicant |
| US9372618B2 | Cited by | United States of America | Search report |
| US2007036348A1 | Cited by | United States of America | Pre-grant |
| US2008137913A1 | Cited by | United States of America | Pre-grant |
| US2006071904A1 | Cited by | United States of America | Pre-grant |
| US11599240B2 | Cited by | United States of America | Applicant |
| US8665877B2 | Cited by | United States of America | Applicant |
| US10035063B2 | Cited by | United States of America | Search report |
| US2010180336A1 | Cited by | United States of America | Pre-grant |
| US2009325705A1 | Cited by | United States of America | Pre-grant |
| US10558321B2 | Cited by | United States of America | Applicant |
| US2007223476A1 | Cited by | United States of America | Pre-grant |
| US7688307B1 | Cited by | United States of America | Applicant |
| US2007021153A1 | Cited by | United States of America | Pre-grant |
| US8230610B2 | Cited by | United States of America | Applicant |
| US2007271600A1 | Cited by | United States of America | Pre-grant |
| US2006082543A1 | Cited by | United States of America | Pre-grant |
| US2016041717A1 | Cited by | United States of America | Pre-grant |
| US9167209B2 | Cited by | United States of America | Search report |
| US2011110371A1 | Cited by | United States of America | Pre-grant |
| US8347103B2 | Cited by | United States of America | Applicant |
| US2006092133A1 | Cited by | United States of America | Pre-grant |
| US11666507B2 | Cited by | United States of America | Applicant |
| US2012084690A1 | Cited by | United States of America | Pre-grant |
| US7881295B2 | Cited by | United States of America | Applicant |
| US9176542B2 | Cited by | United States of America | Search report |
| US2008030466A1 | Cited by | United States of America | Pre-grant |
| US8810533B2 | Cited by | United States of America | Applicant |
| US7946758B2 | Cited by | United States of America | Search report |
| US9013264B2 | Cited by | United States of America | Applicant |
| US2006270952A1 | Cited by | United States of America | Pre-grant |
| US2011109540A1 | Cited by | United States of America | Pre-grant |
| US2007156679A1 | Cited by | United States of America | Pre-grant |
| US9046992B2 | Cited by | United States of America | Applicant |
| US11182046B2 | Cited by | United States of America | Applicant |
| US2008235965A1 | Cited by | United States of America | Pre-grant |
| US9052801B2 | Cited by | United States of America | Applicant |
| US5341133A | Cites | United States of America | Search report |
| US5650597A | Cites | United States of America | Search report |
| US6346935B1 | Cites | United States of America | Search report |
| US6369794B1 | Cites | United States of America | Search report |
| US6424338B1 | Cites | United States of America | Search report |
| US6430295B1 | Cites | United States of America | Search report |
| US6570078B2 | Cites | United States of America | Search report |
10 members in 3 offices
Priority claims14
| Document | Office | Kind | Date |
|---|---|---|---|
| 57280100 | United States of America | A | |
| 57280100 | United States of America | A | |
| 77316501 | United States of America | A | |
| 77316501 | United States of America | A | |
| 28686001 | United States of America | P | |
| 28686001 | United States of America | P | |
| 13263602 | United States of America | A | |
| 09572801 | – | – | – |
| 09773165 | – | – | – |
| 60286860 | – | – | – |
| US20000572801 | – | – | – |
| US20010286860P | – | – | – |
| US20010773165 | – | – | – |
| US20020132636 | – | – | – |
Members10
| Document | Office | Kind | |
|---|---|---|---|
| WO0137236A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU3790601A | Australia | A | |
| US2001047488A1 | United States of America | A1 | |
| WO0137236A9 | World Intellectual Property Organization (WIPO) | A9 | |
| WO02061621A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO02088853A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2002167699A1 | United States of America | A1 | |
| US6721738B2 | United States of America | B2 | |
| US6861946B2This record | United States of America | B2 | |
| US6970095B1 | United States of America | B1 |
37 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Expire PatentEXP. | EXP. | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Receipt into PubsR1021 | R1021 | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Receipt into PubsR1021 | R1021 | |
| Mail Examiner's AmendmentMEX.A | MEX.A | |
| Examiner's Amendment Communication | – | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Receipt into PubsR1021 | R1021 | |
| Workflow - File Sent to ContractorSENT | SENT | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Workflow incoming amendment IFWWAMD | WAMD | |
| Workflow incoming amendment IFWWAMD | WAMD | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Case Docketed to Examiner in GAU | – | |
| Case Docketed to Examiner in GAU | – | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Small Entity Statement (37 CFR 1.27)SES | SES | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL | OATHDECL | |
| Applicant has submitted new drawings to correct Corrected Papers problemsCORRDRW | CORRDRW | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| IFW Scan & PACR Auto Security Review | – | |
| IFW Scan & PACR Auto Security Review | – | |
| Initial Exam Team nnIEXX | IEXX |
11 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Lapse for failure to pay maintenance feesLapsedLAPS | LAPS | |
| Maintenance fee reminder mailedREMI | REMI | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| Fee paymentFPAY | FPAY | |
| Surcharge for late paymentSULP | SULP | |
| Maintenance fee reminder mailedREMI | REMI | |
| AssignmentAS | AS |
Numbers
- Publication
- 06861946
- Publication, DOCDB
- 6861946
- Publication, EPODOC
- US6861946
- Application
- 10132636
- Application, DOCDB
- 13263602
- Application, EPODOC
- US20020132636
Titles
- English
- Motion-based input system for handheld devices
Patent term adjustment
- A delay
- +315 daysthe office missed an examination deadline
- Net adjustment
- 315 days
Classification
- CPC, 11
- G08B13/1436
- G06F1/1626
- G06F1/1694
- G06F3/0346
- G06F3/0383
- G06F21/32
- G06F2200/1636
- G06F2200/1637
- H04M2250/12
- H04M1/7243
- H04M1/72403
- IPC, 6
- G06F1 00
- G06F1 16
- G06F3 038
- G08B13 14
- H04M1 72403
- H04M1 7243
- USPC, 3
- 340407200
- 340315000
- 340407100