Systems and methods for a texture engine

The present invention relates generally to tactile feedback and, more specifically, to systems and methods for texture engines.

(Cross-reference to related applications) This patent application claims priority to US Provisional Patent Application No. 61 / 159,482, entitled "Locating Features Using a Friction Display," filed March 12, 2009. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Provisional Patent Application No. 61 / 262,041 entitled "System and Method for Increasing Haptic Bandwidth in an Electronic Device" filed on November 17, 2009. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Provisional Patent Application No. 61 / 262,038, entitled "Friction Rotary Device for Haptic Feedback," filed November 17, 2009. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Patent Application No. 12 / 696,893, entitled "Systems And Methods For Providing Features In A Friction Display," filed January 29, 2010. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Patent Application No. 12 / 696,900, entitled "Systems And Methods For Friction Displays And Additional Haptic Effects," filed January 29, 2010. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Patent Application No. 12 / 696,908, entitled "Systems And Methods For Interfaces Featuring Surface-Based Haptic Effects," filed January 29, 2010. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Patent Application No. 12 / 697,010 entitled "Systems And Methods For A Texture Engine" filed January 29, 2010. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Patent Application No. 12 / 697,037, entitled "Systems And Methods For Using Textures In Graphical User Interface Widgets," filed January 29, 2010. The entire disclosure is incorporated herein by reference.

This patent application claims priority to US Patent Application No. 12 / 697,042, entitled "Systems And Methods For Using Multiple Actuators To Realize Textures," filed January 29, 2010. The entire disclosure is incorporated herein by reference.

Over the last few years, the use of all kinds of handheld devices has skyrocketed. Such devices are used as portable organizers, telephones, music players, and game systems. Today, many state-of-the-art handheld devices incorporate some kind of tactile feedback. As tactile technology advances, the device may incorporate tactile feedback to simulate textures. Therefore, a tactile texture engine is needed.

Embodiments of the present invention provide systems and methods for texture engines. For example, in one embodiment, the system for a texture engine receives a display signal containing multiple pixels, determines a tactile effect containing the texture, and sends a tactile signal associated with the tactile effect to an actuator communicating with the processor. The actuator is configured to receive a tactile signal and output a tactile effect.

Embodiments of this example are referred to to provide an example that facilitates understanding of the present invention, rather than limiting or defining it. Illustrative embodiments are discussed in the detailed description of the invention, where further description of the invention is provided. The advantages provided by the various embodiments of the invention can be further understood by reviewing the specification.

These and other features, aspects, and advantages of the present invention will be better understood by reading the detailed description below with reference to the accompanying drawings.<figref num="1">It is a block diagram of the system for the texture engine by one Embodiment of this invention.</figref><figref num="2">This is an example of a system for a texture engine according to an embodiment of the present invention.</figref><figref num="3a">This is an example of a system for a texture engine according to an embodiment of the present invention.</figref><figref num="3b">This is an example of a system for a texture engine according to an embodiment of the present invention.</figref><figref num="4">It is a flow chart of the method for a texture engine by one Embodiment of this invention.</figref><figref num="5a">It is one example of the texture that the texture engine can produce by one embodiment of the present invention.</figref><figref num="5b">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref><figref num="5c">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref><figref num="5d">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref><figref num="5e">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref><figref num="5f">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref><figref num="5g">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref><figref num="5h">It is another example of the texture that the texture engine can produce according to one embodiment of the present invention.</figref>

Embodiments of the present invention provide systems and methods for texture engines.

(Exemplary Embodiment of Texture Engine) Illustrative embodiments of the present invention include, for example, messaging devices such as mobile phones. In an exemplary embodiment, the messaging device is Immersion's TouchSense (R) 3000, TouchSense (R) 4000, or TouchSense (R) 5000, formerly known as Immersion's VibeTonz (R) vibrating tactile feedback system. Includes Samsung Haptic Phone (SCH-W420) equipped with a vibration and tactile feedback system. In other embodiments, different messaging devices and haptic feedback systems may be utilized.

The exemplary messaging device comprises a display, a speaker, a network interface, a memory, and a processor that communicates with each of these elements. The illustrated messaging device also includes a touch sensor interface and actuator. Both of these communicate with the processor. The touch-sensitive interface is configured to sense the interaction between the messaging device and the user, and the actuator is configured to output a tactile effect. The exemplary messaging device may further include controls configured to detect the user interaction and send an interface signal associated with the user interaction to the processor.

In the exemplary messaging device, the display is configured to display a graphical user interface to the user. The graphical user interface may include virtual objects such as icons, buttons, or virtual keyboards. The exemplary messaging device further comprises a touch sensor interface, such as a touch screen mounted on top of the display. The touch-sensitive interface allows the user to interact with the virtual objects displayed in the graphical user interface. For example, in one embodiment, the graphical user interface may include a virtual keyboard. In such an embodiment, the touch-sensitive interface allows the user to touch a key on a virtual keyboard and enter alphanumeric characters associated with the key. This functionality may be used to type messages or interact with objects within the graphical user interface.

In an exemplary messaging device, a processor is configured to determine a tactile effect and transmit a tactile signal corresponding to the tactile effect to an actuator configured to output the tactile effect. In an exemplary messaging device, the tactile effect simulates the texture felt by the user on the surface of a touch-sensitive interface. The simulated texture may be associated with the user interface shown on the display. For example, the display may show an icon that includes the shape of a rock. In such an embodiment, the processor may determine a tactile effect configured to simulate the texture of a rock on the surface of a touch-sensitive interface. The processor will then send a haptic signal to an actuator that is configured to output a haptic effect. Upon receiving the tactile signal, the actuator will output a vibration-like tactile effect at a frequency configured to approximate the surface of the touch-sensitive interface to the texture of the rock.

In an exemplary embodiment, the processor may implement a tactile map to determine the tactile effect. For example, in an exemplary embodiment, the processor may receive a display signal, each containing a plurality of pixels associated with a color. For example, in an exemplary embodiment, each pixel in the display signal may be associated with a color of red, green or blue, and may be associated with an intensity of each color. In an exemplary embodiment, the processor will assign a tactile value for each color and further assign a tactile intensity associated with the intensity of each color. The processor will then transmit a tactile signal, including tactile value and tactile intensity, to an actuator configured to output a tactile effect.

In an exemplary embodiment, the processor may further determine the tactile effect based on an external trigger. For example, in an exemplary embodiment, the processor is configured to receive an interface signal from a touch-sensitive interface that is configured to detect user interactions. Next, in an exemplary embodiment, the processor will determine the tactile effect based at least in part on the interface signal. For example, the processor may modify the tactile value or tactile intensity based at least in part on the interface signal. In an exemplary embodiment, the processor will determine a stronger tactile effect if the touch-sensitive interface detects fast or high pressure user interactions.

The exemplary messaging device may output tactile effects for many purposes. For example, in one embodiment, the tactile effect may act as a confirmation that the processor has received an interface signal associated with the user interaction. For example, a graphical user interface may include a button, and a touch-sensitive interface may detect a user interaction associated with pressing a button and send an interface signal to the processor. In response, the processor may determine the tactile effect to confirm that the interface signal has been received. In such embodiments, the tactile effect may allow the user to perceive the texture on the surface of the touch-sensitive interface. In an exemplary embodiment, the processor may further determine the tactile effect for other purposes. For example, the exemplary messaging device may output a texture to warn the user of the boundaries of the display or as an identification for an object such as an icon on the surface of the display.

This example is provided to introduce the reader to the general subject matter considered herein. The present invention is not limited to this example. The following paragraphs describe various additional non-limiting embodiments and examples of systems and methods for texture engines.

(Example system for texture engine) Next, referring to a drawing in which similar numbers indicate similar elements throughout a plurality of drawings, FIG. 1 is a block diagram of a system for a texture engine according to an embodiment of the present invention. As shown in FIG. 1, the system 100 includes a messaging device 102 such as, for example, a mobile phone, a PDA (portable digital assistant), a portable media player, a portable computer, a portable game device, or some other mobile device. .. In some embodiments, the messaging device 102 may include a laptop, tablet, desktop PC, or other similar device. In yet other embodiments, the messaging device may include an external monitor used with a PC or some other device. The messaging device 102 includes a network interface 112, a touch-sensitive interface 114, a display 116, an actuator 118, a speaker 120, and a processor 110 that communicates with the memory 122.

Processor 110 is configured to execute computer executable program instructions stored in memory 122. For example, processor 110 may execute one or more computer programs for messaging or tactile feedback generation. The processor 110 may include a microprocessor, a DSP (digital signal processor), an ASIC (application-specific integrated circuit), one or more FPGAs (field programmable gate array), or a state machine. The processor 110 is, for example, a PLC (programmable logic controller), a PIC (programmable interrupt controller), a PLD (programmable logic device), a PROM (programmable read-only memory), an EPROM or an EEPROM (electronically programmable read only). It may further include programmable electronic devices such as memory), or other similar devices.

The memory 122 includes a computer-readable medium that stores instructions that, when executed by the processor 110, cause the processor 110 to perform various steps as described herein. Embodiments of computer-readable media may include, but are not limited to, electronic, optical, magnetic, or other storage or transmission devices capable of providing computer-readable instructions to the processor 110. Other examples of media are, but are not limited to, floppy (registered trademark) disks, CD-ROMs, magnetic disks, memory chips, ROMs, RAM, ASICs, constituent processors, all optical media, all magnetic tapes or other magnetics. Includes media, or any other medium readable by a computer processor. In addition, various other devices may include computer-readable media such as, for example, routers, private or public networks, or other transmission devices. The processor 110 and the described processing may be in one or more structures or may be distributed over one or more structures.

Processor 110 communicates with network interface 112. The network interface 112 may include one or more mobile communication methods, such as infrared, wireless, Wi-Fi or cellular network communication. In another variant, the network interface 112 comprises a wired network interface, such as Ethernet®. The messaging device 102 may be configured to exchange messages or virtual message objects with other devices (not shown), for example, via networks such as cellular networks and / or the Internet. Embodiments of messages exchanged between devices may include voice messages, text messages, data messages, or other forms of digital messages.

The processor 110 also communicates with one or more touch-sensitive interfaces 114. In some embodiments, the touch sensor interface 114 may include a touch screen or touch pad. For example, in some embodiments, the touch sensor interface 114 may include a touch screen mounted on a display configured to receive a display signal and output an image to the user. In other embodiments, the touch sensor interface 114 may include an optical sensor or another type of sensor. In one embodiment, the touch sensor interface may include an LED detector. For example, in one embodiment, the touch sensor interface 114 may include an LED finger detector attached to the side of the display 116. In some embodiments, the processor communicates with a single touch-sensitive interface 114, and in other embodiments, the processor has multiple touch-sensitive interfaces, such as a first touch screen and a second touch. Communicate with the screen. The touch-sensitive interface 114 is configured to detect user interactions and send signals to the processor 110 based on the user interactions. In some embodiments, the touch-sensitive interface 114 may be configured to detect multiple aspects of user interaction. For example, the touch-sensitive interface 114 may detect the speed and pressure of user interaction and incorporate this information into the interface signal.

Also, in the embodiment shown in FIG. 1, the processor 110 also communicates with the display 116. The processor 110 may be configured to generate a graphic representation of the user interface shown on the display 116 and transmit a display signal containing this graphic representation to the display 116. In another embodiment, the display 116 is configured to receive a display signal from another device. For example, in some embodiments, the display 116 may include an external display such as a computer monitor. The display 116 is configured to receive a display signal and output an image associated with the display signal. In some embodiments, the display signal may include VGA, HDMI, SVGA, VIDEO, S-VIDEO, or other types of display signals well known in the art. In some embodiments, the display 116 includes, for example, a flat screen display such as a liquid crystal display (LCD) or plasma screen display. In another embodiment, the display 116 is a CRT (Cathode Ray). Tube), or other types of displays well known in the art. In yet another embodiment, the display 116 may include a touch sensor interface 114, for example, the display 116 may include a touch screen LCD. In yet another embodiment, the display 116 may include a flexible screen or a flexible display. For example, in some embodiments, the display 116 may include antennal substrates that are attached to the underside of its surface. In such an embodiment, the display 116 is made of a flexible material, and the tactile substrate bends in response to a signal received from the processor 110 to cause bumps, valleys, or other features on the surface of the display 116. To form. In some embodiments, the tactile substrate may include a plasma actuator, a piezoelectric actuator, an electroactive polymer, a microelectromechanical system, a shape memory alloy, a fluid grid or a gas filled cell.

In some embodiments, the processor 110 receives a signal from the touch-sensitive interface 114 that is associated with the interaction with the graphical user interface shown on the display 116. For example, in one embodiment, the touch sensor interface 114 may include a touch screen and the graphical user interface on the display 116 may include a virtual keyboard. In such an embodiment, when the user interacts with a portion of the touch screen that overlaps one of the keys of the virtual keyboard, the touch screen will send an interface signal corresponding to this user interaction to the processor 110. Based on this interface signal, processor 110 will determine that the user has pressed one of the keys on the virtual keyboard. This functionality allows the user to interact with other icons and virtual objects on the display 116. For example, in some embodiments, the user may flick the touch screen to move the virtual ball or turn the virtual knob.

As shown in FIG. 1, the processor 110 also communicates with one or more actuators 118, a suspension system for each actuator, and an operating system with power and control wiring for each actuator. In some embodiments, the messaging device 102 comprises one or more operating systems. The processor 110 is configured to determine a tactile effect and transmit a tactile signal corresponding to that tactile effect to the actuator 118. In some embodiments, the tactile effect comprises a vibrating tactile texture perceived on the surface of the housing of the display 116, the touch sensor interface 114, or the messaging device 102. In some embodiments, determining the tactile effect may include performing a series of calculations. In other embodiments, determining the tactile effect may include accessing a look-up table. In yet other embodiments, determining the tactile effect may include a combination of a look-up table and an algorithm.

In some embodiments, determining the tactile effect may include a tactile map. In such embodiments, determining the tactile effect may include mapping the display signal to the actuator. For example, the display signal may include multiple pixels, each associated with a color. In such embodiments, each pixel may be associated with a red, green or blue tint. In addition, each color may be associated with an intensity, eg, an intensity of 1-8. In such embodiments, determining the tactile effect may include assigning a tactile effect to each color. In some embodiments, the tactile effect may include the direction and intensity of motion. For example, in one embodiment, the tactile signal may be configured to rotate the rotary actuator clockwise with half the force. In some embodiments, the intensity of motion may be associated with the intensity of color. When the processor 110 determines the tactile effect, it transmits a tactile signal including the tactile effect. In some embodiments, processor 110 may assign tactile effects to only some pixels in the display signal. For example, in such an embodiment, the tactile effect may be associated with only part of the display signal.

In some embodiments, processor 110 may utilize a tactile map to determine tactile effects and then output a display signal to display 116. In another embodiment, the processor 110 may use a tactile map to determine the tactile effect and then not transmit a display signal to the display 116. In such an embodiment, the display 116 may remain dark or dormant while the actuator 118 outputs a tactile effect. For example, in such an embodiment, the processor 110 may receive a display signal from a digital camera associated with the messaging device 102. In some embodiments, the user may deactivate display 116 to save battery. In such an embodiment, the processor may utilize a tactile map to provide the user with a tactile effect that simulates a texture on the surface of the display. This texture may be used to warn the user when the camera is in focus or when some other event occurs. For example, processor 110 uses face recognition software to determine tactile effects that, when display 116 is activated, simulate textures that would be associated with a face at multiple locations on display 116. May be good.

In some embodiments, processor 110 may determine tactile effects based at least in part on user interactions or triggers. In such an embodiment, the processor 110 receives an interface signal from the touch-sensitive interface 114 and determines the tactile effect based at least in part on the interface signal. For example, in some embodiments, processor 110 may determine the tactile effect based on the location of user interaction detected by the touch-sensitive interface 114. For example, in such an embodiment, the processor 110 may determine a tactile effect that simulates the texture of a virtual object that the user is touching on the display 116. In other embodiments, processor 110 may determine the intensity of the tactile effect based at least in part on the interface signal. For example, if the touch-sensitive interface 114 detects high-pressure user interaction, processor 110 may determine a high-intensity tactile effect. In another embodiment, the processor 110 may determine a low intensity tactile effect when the touch sensor interface 114 detects low pressure user interaction. In yet another embodiment, the processor 110 may determine the intensity of the tactile effect based at least in part on the speed of user interaction. For example, in one embodiment, the processor 110 may determine a low intensity tactile effect when the touch sensor interface 114 detects slow user interaction. In yet another embodiment, the processor 110 does not have to determine any tactile effect unless it receives an interface signal associated with the user interaction from the touch-sensitive interface 114.

When the processor 110 determines the tactile effect, it sends a tactile signal associated with the tactile effect to the actuator 118. The actuator 118 is configured to receive a tactile signal from the processor 110 and generate a tactile effect. Actuator 118 may be, for example, a piezoelectric actuator, an electric motor, an electromagnetic actuator, a voice coil, a shape memory alloy, an electroactive polymer, a solenoid, an eccentric rotating mass motor (ERM) or a linear resonant actuator (LRA). In some embodiments, the actuator 118 may include multiple actuators, such as ERM and LRA.

In one embodiment of the invention, the tactile effect produced by the actuator 118 is configured to simulate a user-perceived texture on the surface of the touch-sensitive interface 114 or display 116. This texture may be associated with the graphical user interface shown on display 116. For example, display 116 may show an icon that includes the shape of a rock. In such an embodiment, the processor 110 may determine a tactile effect configured to simulate the texture of a rock on the surface of the touch-sensitive interface 114. The processor 110 will then transmit a tactile signal associated with the tactile effect to the actuator 118 that outputs the tactile effect. For example, when the actuator 118 receives a tactile signal, it may output a vibration configured to include a rock texture on the surface of the touch-sensitive interface at a predetermined frequency. In another embodiment, the actuator 118 prescribes vibration that causes the surface of the display 116 or touch sensor interface 114 to include water, ice, leather, sand, gravel, snow, skin, fur, or some other surface texture. It may be configured to output at the frequency of. In some embodiments, the tactile effect may be output to different parts of the messaging device 102, eg, on its housing. In some embodiments, the actuator 118 may output a large number of vibrations configured to output multiple textures simultaneously. For example, the actuator 118 may output a vibration configured to include a sand texture on the surface of the display 116. In such an embodiment, the actuator 118 may be configured to output additional vibrations that are configured to make the user sense the texture of the rock in the sand.

Processor 110 may determine the tactile effect for a variety of reasons. For example, in some embodiments, processor 110 may output a tactile effect corresponding to the texture of the object shown on display 116. In such an embodiment, the display may show multiple objects and the processor may determine different tactile effects as the user moves his or her finger from object to object, thereby per object. Simulate different textures. In some embodiments, the tactile effect may act as a confirmation that the processor 110 has received a signal associated with the user interaction. For example, in one embodiment, the graphical user interface may include a button, and the touch-sensitive interface 114 may detect user interactions associated with pressing this button. When the touch-sensitive interface 114 transmits an interface signal associated with user interaction to processor 110, processor 110 may determine a tactile effect for confirming receipt of the interface signal. In such an embodiment, the tactile effect may allow the user to perceive the texture on the surface of the touch sensor interface 114. For example, the processor may output a tactile effect that simulates the texture of sand to ensure that the processor 110 has received user input. In other embodiments, the processor may determine different textures, such as water, ice, oil, rock, or skin textures. In some embodiments, the tactile effect may serve different purposes, eg, warn the user of the boundaries of the display 116, or provide the user with tactile information about an image on the display 116. For example, in some embodiments, each icon on display 116 may contain a different texture, and when the user moves his or her finger from one icon to another, the processor will change the texture of each icon. It will determine the tactile effect to be simulated. In a further embodiment, the processor may change the texture as the user's finger moves from contact with the icon to contact with the background of the display, thereby warning that the user is no longer touching the icon.

The processor 110 also communicates with the speaker 120, as shown in FIG. The speaker 120 is configured to receive an audio signal from the processor 110 and output it to the user. In some embodiments, the audio signal may be associated with a tactile effect output by the actuator 118 or an image output by the display 116. In other embodiments, the audio signal does not have to correspond to a tactile effect or an image.

In some embodiments, the processor 110 comprises one or more sensors, such as a GPS sensor, an image sensor, an accelerometer, a location sensor, a rotational speed sensor, an optical sensor, a camera, a microphone, or some other type of sensor. Further may be included. The sensor may be configured to detect changes in acceleration, tilt, inertia, or location. For example, the messaging device 102 may include an accelerometer configured to measure the acceleration of the messaging device. The sensor is configured to send a sensor signal to the processor 110.

The sensor signal may include one or more parameters associated with the position, movement, acceleration, or "jerk" (ie, a derivative of acceleration) of messaging device 102. For example, in one embodiment, the sensor may generate and transmit a sensor signal that includes a plurality of parameters. Each parameter is associated with motion along or around one measured translational or axis of rotation. In some embodiments, the sensor outputs a voltage or current programmed to interpret that the processor 110 exhibits motion along one or more axes.

In some embodiments, processor 110 receives a sensor signal to activate the virtual workspace and message it in the X, Y, or Z direction to accommodate the "medium" virtual motion of the virtual workspace. It will determine that the perceived motion of device 102 should be interpreted. The user may then move device 102 within the virtual workspace and make gestures within the virtual space to select a function or file. For example, it is performed by moving the messaging device 102 on the Z axis on the function in the virtual workspace. In some embodiments, the user may use gestures in the virtual workspace to modify the tactile effects output by the messaging device 102.

FIG. 2 is an example of a system for a texture engine according to an embodiment of the present invention. FIG. 2 includes, for example, a messaging device 200 such as a mobile phone, PDA, portable media player, portable game device, or portable computer. The messaging device 200 is configured to transmit and receive signals such as voice mail, text messages, and other data messages via a network such as a cellular network or the Internet. The messaging device 200 may include a wireless network interface and / or a wired network interface (not shown in FIG. 2). Although device 200 is exemplified as a handheld messaging device in FIG. 2, other embodiments may include different devices such as, for example, video game systems and / or personal computers.

As shown in FIG. 2, the messaging device 200 includes a housing 202 and a display 216. In some embodiments, the display 216 may include an LCD display. In other embodiments, the display 216 may include a plasma display, or other type of display well known in the art. The display 216 is configured to receive a display signal and output an image associated with the display signal. In some embodiments, the display signal may include VGA, HDMI, SVGA, VIDEO, S-VIDEO, or other types of display signals well known in the art. In the embodiment shown in FIG. 2, display 216 includes textured balls 204. Display 216 further includes a texture selection icon 206 that includes rock, sand, and water textures.

Further referring to FIG. 2, the messaging device 200 further comprises an operator 214. In the embodiment shown in FIG. 2, the operator 214 comprises a rollerball and a button. The messaging device 200 also includes a touch sensor interface 218. In the embodiment shown in FIG. 2, the touch sensor interface 218 comprises a touch screen that is placed on top of the display 216. In some embodiments, the display 216 and the touch screen may include a single integrated component, such as a touch screen display.

The operator 214 and the touch-sensitive interface 218 are configured to detect the user interaction and transmit an interface signal corresponding to the user interaction to the processor. In some embodiments, the user interaction is associated with the graphical user interface shown on display 206. In such an embodiment, the processor receives an interface signal and manipulates the graphical user interface based on the interface signal, at least in part. For example, in the embodiment shown in FIG. 2, the user may use either the controls 214 or the touch-sensitive interface 218 to select one of the texture selection icons 206. If the user selects a textured texture for the ball 204, the appearance may change on the screen to correspond to that texture. For example, if the user selects a sand texture icon, the processor interacts with the textured ball 204 by manipulating the display to give the textured ball 204 the appearance of a sandy surface. The tactile effect that causes the user to perceive a sandy texture may be further determined. Alternatively, in another embodiment, if the user selects a rock texture icon, the processor may determine a tactile effect that causes the user to perceive the rock texture when the user interacts with the textured ball 204. ..

The messaging device 200 further comprises an actuator configured to receive a tactile signal and output a tactile effect (not shown in FIG. 2). In some embodiments, the tactile effect comprises a vibrating tactile texture perceived by the user of the messaging device 200. The processor 110 is configured to determine a tactile effect and transmit a tactile signal corresponding to the tactile effect to the actuator 118. In some embodiments, determining the tactile effect may include a series of calculations for determining the tactile effect. In other embodiments, determining a tactile effect may include accessing a look-up table to determine an appropriate tactile effect. In yet other embodiments, determining the tactile effect may include using a combination of a look-up table and an algorithm. When the processor 110 determines the tactile effect, it sends a tactile signal associated with the tactile effect to the actuator. The actuator receives a tactile signal from the processor 110 to generate a tactile effect. The user may sense the tactile effect through the surface of the display 216 or through another part of the messaging device 200, for example, through the controls 214 or the housing 202. In some embodiments, the processor may modify this tactile effect as the user's finger moves over the surface of the textured ball 204 to simulate a change in texture.

(Example of system for texture engine) FIG. 3a is an example of a system for a texture engine according to an embodiment of the present invention. FIG. 3a includes a messaging device 300 such as, for example, a mobile phone, a PDA, a portable media player, a portable game device, or a portable computer. The messaging device 300 is configured to transmit and receive signals including messages such as voice mail, text messages, and other data messages via networks such as, for example, cellular networks or the Internet. The messaging device 300 may include a wireless network interface and / or a wired network interface (not shown in FIG. 3a). Although device 300 is exemplified as a handheld messaging device in FIG. 3a, other embodiments may include different devices such as, for example, video game systems and / or personal computers.

As shown in FIG. 3a, the messaging device 300 includes a display 316. The display 316 is configured to receive a display signal and output an image based on the display signal at least in part. The messaging device 300 further comprises a processor (not shown in FIG. 3a) configured to transmit a display signal to display 316. The messaging device 300 further comprises a touch-sensitive interface 314 mounted on the display 316. The touch-sensitive interface 314 is configured to detect a user interaction and transmit an interface signal corresponding to this user interaction to the processor. The display 316 comprises two icons 302 and 304. When the user interacts with one of the icons 302 and 304, the touch-sensitive interface 314 will detect the user interaction and send the corresponding interface signal to the processor. Based on this interface signal, the processor may determine that the user has opened a file associated with one of the icons or performed some other operation well known in the art.

As shown in FIG. 3a, each of the icons 302 and 304 contains a texture. In the illustrated embodiment, icon 302 comprises a brick texture and icon 304 comprises a rock texture. In other embodiments, different textures may be used, such as sand, water, oil, grass, fur, skin, leather, ice, wood, or any other texture known in the art. When the user, shown as finger 306 in Figure 3a, interacts with a portion of display 316 associated with each icon, the processor will determine a tactile effect configured to simulate the texture of that icon. The processor will then output the signal associated with the tactile effect to an actuator (not shown in Figure 3a) that is configured to output the tactile effect. For example, in the embodiment shown in FIG. 3a, when the user interacts with a portion of the display 316 associated with the icon 302, the icon 302 will determine the tactile effect associated with the brick texture. This tactile effect may be characterized by a random signal separated by high power pulses as the user's finger 306 traverses the mortar. In other embodiments, other tactile effects will be used to simulate different textures that may correspond to the image shown on display 316.

FIG. 3b is an example of a system for a texture engine according to an embodiment of the present invention. In the embodiment shown in FIG. 3b, determining the tactile effect involves mapping the display signal to the actuator. The embodiment shown in FIG. 3b includes an enlarged portion of the display 350. The display 350 is configured to receive a display signal from the processor. The display signal contains a plurality of pixels, each associated with a color and the intensity of that color. The display 350 receives this display signal and outputs an image associated with this display signal. In the embodiment shown in FIG. 3b, the magnified portion of the display 350 includes six pixels 351, 352, 353, 354, 355, and 356. Each pixel is associated with a color and an intensity to that color in the range 1-10. For example, pixel 355 is associated with a green color and a color intensity of 3 out of 10. Thus, the display 350 will output a green color at intensity 3 at the location of pixels 355.

In the embodiment shown in FIG. 3b, the processor will determine the tactile effect based at least in part on the display signal and the interface signal received from the touch-sensitive interface mounted on the display 350 (see FIG. 3b). Is not shown). For example, in the embodiment shown in FIG. 3b, the processor uses a display signal to associate or "map" a tactile effect to each pixel. For example, in the embodiment shown in FIG. 3b, the processor may determine tactile effects at different frequencies for each color. The processor may further correlate the intensity of the tactile effect at each pixel with the intensity of color at each pixel. For example, the processor may determine that a pixel with a color intensity of 8 also has a tactile intensity of 8. When the processor receives an interface signal associated with a user interaction that covers a pixel on the display, the processor will output a tactile signal associated with the pixel with which the user interacts. This tactile effect is configured to allow the user to perceive the texture on the surface of the display.

For example, in the embodiment shown in Figure 3b, the processor has blue pixels associated with the knocking tactile effect, red pixels associated with the pulsed vibration, and green pixels associated with the click tactile effect. May be determined. In such an embodiment, when the touch-sensitive interface detects that the user's finger has passed over pixel 351 the processor will determine knocking at intensity 1. Then, as the user's finger moves over pixel 352, the processor will determine a pulse vibration of intensity 5. Then, as the user's finger continues to move over the display 350 to pixel 353, the processor may determine a click effect of intensity 3.

These tactile effects are configured to cause the user to perceive texture on the surface of the display 350 when the user moves his or her finger on the surface of the display 350. In some embodiments, the processor may communicate with one or more actuators, and each color may be associated with its own actuator. In other embodiments, different combinations of color, intensity, and tactile effect may be used to make the user perceive texture on the surface of the display.

FIG. 4 is a flow chart of a method for a texture engine according to an embodiment of the present invention studied for the apparatus shown in FIG. As shown in FIG. 4, method 400 begins when processor 110 receives a display signal containing a plurality of pixels (402). The display signal may include VGA, HDMI, SVGA, VIDEO, S-VIDEO, or other types of display signals well known in the art. The display signal may include a graphical user interface or other image that the messaging device displays to the user via the display 116.

The touch-sensitive interface 114 then sends an interface signal to processor 110, which receives the interface signal (404). In some embodiments, the touch sensor interface 114 may include a touch screen or touch pad. For example, in some embodiments, the touch sensor interface 114 may include a touch screen mounted on a display configured to receive a display signal and output an image to the user. In other embodiments, the touch sensor interface may include buttons, switches, scroll wheels, rollerballs, or any other type of physical device interface well known in the art. In some embodiments, the processor 110 communicates with a single touch-sensitive interface 114. In another embodiment, the processor 110 communicates with a plurality of touch-sensitive interfaces 114, such as a touch screen and a rollerball. The touch-sensitive interface 114 is configured to detect a user interaction and send a signal to the processor based on this user interaction, at least in part. In some embodiments, the touch-sensitive interface 114 may be configured to detect multiple aspects of user interaction. For example, the touch-sensitive interface 114 may detect the speed and pressure of user interaction and incorporate this information into the interface signal.

Processor 110 then determines the tactile effect, including the texture (406). The tactile effect may include vibrations that the user can perceive through the surface or controls of the touch-sensitive interface. In some embodiments, this vibration may cause the user to sense the texture on the surface of the touch-sensitive interface. For example, the texture is leather, snow, sand, ice, skin, or some other surface. In some embodiments, determining the tactile effect may include a series of calculations for determining the tactile effect. In other embodiments, determining a tactile effect may include accessing a look-up table to determine an appropriate tactile effect. In yet other embodiments, determining the tactile effect may include a combination of a look-up table and an algorithm.

In some embodiments, determining the tactile effect may include a tactile map. In such embodiments, determining the tactile effect may include mapping the display signal to the actuator. For example, the display signal may include multiple pixels, each associated with a color. In such embodiments, determining the tactile effect may include assigning a tactile effect to each color. The processor 110 will then output a tactile signal that includes a tactile effect. In some embodiments, processor 110 may assign tactile effects to only some pixels in the display signal. For example, in such an embodiment, the tactile effect may be associated with only part of the display signal. In some embodiments, processor 110 may determine tactile effects based at least in part on user interactions or triggers. In such an embodiment, the processor 110 receives an interface signal from the touch-sensitive interface 114 and determines the tactile effect based at least in part on the interface signal. For example, in some embodiments, processor 110 may determine tactile effects of different intensities based on the interface signal received from the touch sensor interface 114. For example, when the touch-sensitive interface 114 detects high-pressure user interaction, processor 110 may determine a high-intensity tactile effect. In another embodiment, the processor 110 may determine a low intensity tactile effect when the touch sensor interface 114 detects low pressure user interaction. In yet another embodiment, the processor 110 may determine a low intensity tactile effect when the touch sensor interface 114 detects slow user interaction. In addition, the processor 110 may determine a high intensity tactile effect when the touch sensor interface 114 detects fast user interactions. In yet another embodiment, the processor 110 is a touch-sensitive inn.

Finally, the processor 110 transmits a tactile signal associated with the tactile effect to an actuator 118 configured to receive the tactile signal and output the tactile effect (408). The actuator 118 is configured to receive a tactile signal from the processor 110 and generate a tactile effect. The actuator 118 may be, for example, a piezoelectric actuator, an electric motor, an electromagnetic actuator, a voice coil, a linear resonant actuator, a shape memory alloy, an electrically active polymer, a solenoid, an eccentric rotating mass motor (ERM) or a linear resonant actuator (LRA). Good.

FIG. 5a is an example of the textures that the texture engine can produce according to one embodiment of the present invention. The embodiment shown in FIG. 5a includes bricks. The texture of the brick is characterized by the fact that the brick has a rough and irregular texture and the mortar is separated by the sensation of a gravel valley. Systems for texture engines use random signals with moderate to high maximum variability while the user's finger is moving to drive actuators such as LRA, LPA, or FPA to coarse the brick. Irregular textures may be generated. In some embodiments, this change may be adjusted to different roughness. In some embodiments, the brick-to-mortar transition may be brought about by the long-lasting pops produced by the ERM. In addition, if the mortar is thick enough, even if the delicate texture is rendered by driving the actuator with a low-amplitude signal that varies more than the one used to drive the actuator that outputs the brick texture. Good.

FIG. 5b is an example of one of the textures that the texture engine can produce according to one embodiment of the present invention. The embodiment shown in Figure 5b includes rocks. The texture of the rock is characterized by a smooth surface separated by the transition as the user moves from rock to rock. Actuators such as FPA are used to produce low friction compartments to output rock textures. The individual rocks may be rendered by a non-visual edge map of the displayed image, and when the touch-sensitive interface detects user activity, it may output a high-amplitude tactile signal to an actuator such as an LPA or ERM. .. For example, each time the touch-sensitive interface detects that the user's finger is transitioning from one rock to another, it outputs a tactile effect.

FIG. 5c is an example of the textures that the texture engine can produce according to one embodiment of the present invention. The embodiment shown in FIG. 5c comprises sand or sandpaper. Sand is characterized by the sensation of coarse gravel, as well as the sensation of piles of sand particles piled up in front of the user's fingers. To output the texture of coarse gravel, for example, actuators such as LRA, LPA or FPA are driven by a random signal with a high degree of maximum variation while the user's finger is moving. In some embodiments, the processor may adjust signal variability to produce different degrees of roughness. Actuators such as FPA may be used to create the sensation of sand pile up. In such an embodiment, when the user moves his finger on the touch screen, the processor will start at low intensity and drive the actuator with a signal that increases as the user moves his finger in one direction.

In another embodiment, the texture shown in FIG. 5c may include sandpaper. Sandpaper is characterized by having a sensation of coarse gravel. To generate the sensation of coarse gravel, the processor drives an actuator such as an LRA, LPA or FPA with a random signal with a high degree of maximum variation. In some embodiments, this signal is output only while the user's finger is moving over the surface of the touch-sensitive interface. In some embodiments, the processor adjusts the change in signal to change the level of roughness.

FIG. 5d is an example of the textures that the texture engine can produce according to one embodiment of the present invention. In the embodiment shown in FIG. 5c, the texture comprises a grass texture. The grass is characterized by a periodic light sensation that feels like a user's finger. To generate the grass sensation, the processor may drive an actuator, such as an FPA, with a signal configured to produce a low friction compartment covered by a grass compartment. In some embodiments, the processor has a non-visual edge map of the displayed image and when the user interface detects user interaction, it outputs a low amplitude signal to an actuator such as an LPA or ERM. Individual grass leaves may be rendered by.

FIG. 5e is an example of the textures that the texture engine can produce according to one embodiment of the present invention. In the embodiment shown in FIG. 5e, the texture includes the texture of the woven fabric. The fabric is characterized by a light and smooth sensation. To generate the texture sensation of the fabric, the processor may drive an actuator such as an LPA or LRA with a low amplitude high frequency signal as the user's finger crosses the surface of the touch sensor interface.

FIG. 5f is an example of one of the textures that the texture engine can produce according to one embodiment of the present invention. In the embodiment shown in FIG. 5f, the texture comprises a water or molasses texture. Water is characterized by having almost no sensation. However, the disturbed water may bounce off and hit the user's finger. To emulate the texture of water, the processor may drive an actuator such as an FPA to reduce friction on the surface of the touch-sensitive interface. To emulate movement in water, the processor may output a tactile signal only when the user is in contact with the screen. For example, to emulate the texture of a more viscous liquid such as sugar or oil, the processor is configured to increase friction against the user's finger as the user's finger crosses the surface of the touch-sensitive interface. The actuator may be driven by the signal.

FIG. 5g is an example of one of the textures that the texture engine can produce according to one embodiment of the present invention. In the embodiment shown in FIG. 5g, the texture comprises a leather texture. Leather is characterized by a comprehensive and smooth sensation, including ridges and valleys on the surface of the leather. To generate a leather texture sensation, the processor drives an actuator such as an FPA with a signal configured to output a tactile effect that reduces friction as the user's finger crosses the surface of the touch-sensitive interface. You may. The processor can output crevices and bumps by driving the actuator with a very short, low-amplitude tactile signal when the touch-sensitive interface detects the movement of the user's finger.

FIG. 5g is an example of one of the textures that the texture engine can produce according to one embodiment of the present invention. In the embodiment shown in FIG. 5e, the texture includes the texture of wood. The wood may be characterized by an irregular texture that is separated by sharp transitions as the user moves from board to board. To generate irregular textures, the processor drives actuators such as LRA, LPA or FPA with non-visual edge maps of the displayed image, which is very short at various times when the user's fingers move. The actuator may be driven by a low amplitude signal. To output the plate-to-plate transition, the processor may output a tactile signal configured to cause the actuator to generate a high amplitude, short duration pop vibration.

In other embodiments, tactile effects associated with different textures may be output. For example, in one embodiment, the processor may transmit a tactile signal configured to cause the actuator to output a tactile effect configured to allow the user to perceive the texture associated with the ice texture. Ice is characterized by low friction. In some embodiments, the ice has a perfectly smooth texture. In other embodiments, the ice comprises a fine, low-amplitude gravel texture. To generate the ice texture, the processor may determine a tactile signal that is configured to reduce friction as much as possible on the actuator while the user moves his finger over the surface of the touch-sensitive interface. .. In another embodiment, the processor may drive an actuator, such as an LPA or LRA, by a tactile signal configured to output a low amplitude effect while the user moves his or her finger. These low-amplitude effects may be associated with ice surface imperfections or gravel.

In another embodiment, the processor may drive the actuator with a signal configured to output a tactile effect that approximates the texture of the lizard skin. The lizard skin is characterized by a comprehensive, smooth sensation separated by the transition from ridge to ridge on the skin. To implement a tactile effect that includes the texture of lizard skin, the processor may drive the actuator with a tactile signal configured to cause the actuator to generate a low friction compartment on a touch-sensitive interface. When the touch-sensitive interface detects the movement of the user's finger across the surface, the processor may render a crevice on the surface of the skin by periodically outputting a high-amplitude tactile signal. Such high-amplitude signals may approximate crevices on the surface of the skin. In yet another embodiment, the processor may drive the actuator with a signal configured to output a tactile effect that mimics the texture of fur. Fur is characterized by a periodic light sensation that is very soft to the touch. To implement a tactile effect that includes a fur texture, the processor is configured to output a tactile effect to the actuator that is configured to reduce the friction perceived by the user on the surface of the touch sensor interface. The actuator may be driven by. When the touch-sensitive interface detects the user's movement, the processor may output a low-amplitude pulsed tactile signal to further render individual hairs.

In yet another embodiment, the processor may drive the actuator with a signal configured to output a tactile effect that approximates the texture of the metal. The metal is, in some embodiments, characterized by a smooth, low-friction surface containing light gravel. To implement a tactile effect that includes a metallic texture, the processor may drive the actuator with a signal that is configured to reduce the friction perceived by the user on the surface of the touch-sensitive interface. In some embodiments, the processor may render individual bumps by outputting a short, high-amplitude tactile signal when the touch-sensitive interface detects user movement on the surface. Such short, high-amplitude signals may approximate gravel on the surface of metal.

In yet another embodiment, the processor may drive the actuator with a signal configured to cause the actuator to output a tactile effect that mimics another sensation, eg, heat. In such an embodiment, the processor may output a tactile signal configured to cause the actuator to output a high frequency swaying effect when the user touches an element of the display associated with heat.

(Advantages of systems and methods for texture engines) Systems and methods for texture engines have many advantages. For example, texture engine systems and methods add tactile effects to mobile devices that were not previously used. This new effect provides a new means for the user to receive information from the mobile device without the user having to look at the display of the mobile device. For example, texture engine systems and methods may allow users to assign different textures to different icons, buttons, or other elements of the display. Therefore, the user may be able to determine which icon is being touched without looking at the icon. This enhances the convenience of the device and may make the device more convenient for the visually impaired.

In addition, systems and methods for texture engines will provide more information to the user without distracting the user from other tasks, thus reducing user error. For example, users are less likely to press the wrong icon or the wrong key when using systems and methods for texture engines. This functionality can help both increase user satisfaction and increase the penetration of technologies that incorporate systems and methods for texture engines.

(Introduction) The term "adapted" or "configured" herein is used in the sense of an open and inclusive language that does not exclude devices adapted or configured to perform additional tasks or steps. Be done. In addition, the term "based" means that a process, step, calculation, or other behavior "based" on one or more stated conditions or values is actually based on additional conditions or values beyond those stated. It is used in the sense of open type and comprehensive type in that it may be used. The headings, lists, and numbering contained herein are for the sake of brevity only and are not intended to be limiting.

Embodiments according to the aspects of the subject matter of the present application may be implemented in digital electronic circuits or in computer hardware, firmware, software, or a combination thereof. In one embodiment, the computer may include one or more processors. The processor comprises or has access to a computer-readable medium such as RAM (random access memory) coupled to the processor, for example. The processor is stored in memory to execute one or more computer programs, including a sensor sampling routine, a tactile effect selection routine, and appropriate programming to generate a signal to generate the selected tactile effect described above. Executes computer executable program instructions.

Such a processor may include a microprocessor, a DSP (digital signal processor), an ASIC (application-specific integrated circuit), an FPGA (field programmable gate array), and a state machine. Such processors include PLCs, PICs (programmable interrupt controllers), PLDs (programmable logic devices), PROMs (programmable read-only memory), EPROMs or EEPROMs (electronically programmable read-only memory), or other similar devices. Programmable electronic devices may be further provided.

Such a processor comprises a medium capable of storing instructions that, when executed by the processor, may cause the processor to perform the steps described herein performed or assisted by the processor, eg, a tangible computer readable medium. Or you may communicate with it. Embodiments of computer-readable media may include, but are not limited to, all electronic, optical, magnetic, or other storage devices capable of providing computer-readable instructions to a processor, such as a processor in a web server. Other examples of media are, but are not limited to, floppy (registered trademark) disks, CD-ROMs, magnetic disks, memory chips, ROMs, RAM, ASICs, constituent processors, all optical media, all magnetic tapes or other magnetics. Includes media, or any other medium readable by a computer processor. Also, various other devices may include computer-readable media such as, for example, routers, private or public networks, or other transmission devices. The described processors and processes may be within one or more structures or may be distributed across one or more structures. The processor may include code for performing one or more of the methods (or parts of the methods) described herein.

Although the subject matter of the present application has been described in detail with respect to that particular embodiment, those skilled in the art will be able to readily manufacture alternatives, variants, and equivalents to such embodiments if the aforementioned understanding is achieved. It will be understood to get. It is therefore understood that the present disclosure is presented for purposes of illustration, not limitation, and does not exclude those skilled in the art from including modifications, modifications and / or additions to the subject matter of the present application. Should be.