Customizing haptic effects on an end user device
Abstract
Systems, methods, and related software are provided herein to allow a standard user of an end-user device, such as a mobile phone, to customize parameters related to tactile effects applied to the user by the end-user device. Will be described. In one of the implementations, the methods described herein allow users of the end-user device to access software adapted to design or modify the tactile effects of the end-user device. Including steps. The method further comprises the step of allowing the user to open the tactile track file and enter or change parameters related to the tactile effect of the opened tactile track file.
Term
Projected expiry 30 April 2028.
- Priority
- Filed
- Published
- Today
- Projected expiry
25 claims: 3 independent, 22 dependent
- 1電子携帯型装置であって、 ユーザへの触覚的効果を作動させるように構成される、触覚作動装置と、 前記ユーザが、前記触覚的効果を変更することを可能にするソフトウェアを記憶するように構成される、メモリと、 前記メモリ内に記憶された前記ソフトウェアを実行するように構成される、プロセッサと、を備え、 前記触覚作動装置は、前記電子携帯型装置に関連する事象が生じた時に、変更された触覚効果を再生するようにさらに構成される、電子携帯型装置。
- 2前記ユーザが、前記触覚的効果を変更できる情報を入力できるようにする、1つ以上の入力装置をさらに備える、請求項1に記載の電子携帯型装置。
- 3前記触覚的効果は、前記メモリ内に記憶される触覚トラックファイルによって定義される、請求項1に記載の電子携帯型装置。
- 4各触覚トラックファイルは、時間に関する強度パラメータを含む触覚トラックを記憶している、請求項3に記載の電子携帯型装置。
- 5前記メモリは、1つ以上の混合トラックファイルを記憶するようにさらに構成され、各混合トラックファイルは、複数の触覚トラックファイルの組み合わせを含む、請求項4に記載の電子携帯型装置。
- 6それぞれの混合トラックファイルの前記触覚トラックファイルの各々の少なくとも一部分は、時間的に重なっている、請求項5に記載の電子携帯型装置。
- 7前記電子携帯型装置は、モバイルハンドセット、携帯電話機、携帯情報端末、パーソナルナビゲーション装置、タブレットPC、ビデオゲーム装置、ゲームモジュール、またはゲームコンソールのうちの1つを含む、請求項1に記載の電子携帯型装置。
- 8前記メモリは、触覚的効果を作成するための出発点として使用することができる、触覚トラックのライブラリを記憶するように構成される、請求項1に記載の電子携帯型装置。
- 9前記電子携帯型装置に関連する前記事象は、通話呼び出しの受信である、請求項1に記載の電子携帯型装置。
- 10コンピュータが読み取り可能な媒体上に記憶される、プログラム可能な触覚設計ソフトウェアであって、 ユーザが、触覚トラックに関連するパラメータを入力または変更することを可能にするように適合される、ロジックと、 前記触覚トラックと、エンドユーザ装置の事象とを関連付けるように適合される、ロジックと、を含み、 前記エンドユーザ装置は、前記事象が生じた時、前記触覚トラックを再生するように構成される、 プログラム可能な触覚設計ソフトウェア。
- 11前記事象は、前記エンドユーザ装置の特定の聴覚または視覚出力に対応する、請求項10に記載のプログラム可能な触覚設計ソフトウェア。
- 12前記ユーザが、変更した触覚トラックの試験再生を開始することを可能にするように適合される、ロジックをさらに含む、請求項10に記載のプログラム可能な触覚設計ソフトウェア。
- 13前記触覚トラックに関連する前記パラメータは、アタックレベル、アタック時間、強度、持続時間、フェードレベル、およびフェード時間を含む、請求項10に記載のプログラム可能な触覚設計ソフトウェア。
- 14前記ユーザが、複数の触覚トラックを混合して混合トラックファイルを作成することを可能にするように適合される、ロジックをさらに備える、請求項10に記載のプログラム可能な触覚設計ソフトウェア。
- 15前記ユーザが、パラメータを入力または変更することを可能にするように適合される前記ロジックは、さらに、前記ユーザが、前記触覚トラックの前記持続時間を、約0.001秒乃至約10秒に設定することを可能にする、請求項10に記載のプログラム可能な触覚設計ソフトウェア。
- 16方法であって、 エンドユーザ装置のユーザが、前記エンドユーザ装置の触覚的効果を設計または変更するように適合される、ソフトウェアにアクセスすることを可能にするステップと、 前記ユーザが、触覚トラックファイルを開くことを可能にするステップと、 前記ユーザが、前記開いた触覚トラックファイルの前記触覚的効果に関連するパラメータを、入力または変更することを可能にするステップと、を含み、 特定の事象に応答して、前記エンドユーザ装置は、前記ユーザによって入力または変更された触覚的効果を再生する、方法。
- 17前記ユーザが、前記変更された触覚トラックファイルを記憶させることを可能にするステップをさらに含む、請求項16に記載の方法。
- 18前記エンドユーザ装置は、触覚可能な装置である、請求項16に記載の方法。
- 19前記ユーザが、前記触覚トラックファイルを開くことを可能にするステップは、前記ユーザが、新規ファイルまたは既存のファイルを開くことを可能にするステップを含む、請求項16に記載の方法。
- 20前記触覚トラックファイルは、時間に関する強度パラメータを含む、請求項19に記載の方法。
- 21前記触覚トラックファイルは、触覚トラックファイルの重複混合体を含み、各触覚トラックファイルは、時間に関する強度パラメータを含む、請求項19に記載の方法。
- 22触覚可能な遠隔装置へ触覚トラックファイルを送信するステップをさらに含む、請求項16に記載の方法。
- 23前記触覚トラックファイルを送信するステップは、前記触覚トラックファイルに関連する前記触覚効果の即時の再生を、前記遠隔装置上で開始する、請求項22に記載の方法。
- 24前記エンドユーザ装置の周囲状況を測定するステップと、 前記測定された周囲状況を補うように、前記触覚的効果を変更するステップと、をさらに含む、請求項16に記載の方法。
- 25前記特定の事象は、通話呼び出しの受信、特定の発信者からの通話呼び出しの受信、特定の可聴信号の提供、特定の視覚信号の提供、またはキーパッドまたはタッチスクリーンのキーまたはボタンの押圧のうちの1つを含む、請求項16に記載の方法。
Independent claims25
61 paragraphs, as filed
The present disclosure generally relates to devices having tactile feedback capability to provide a tactile effect to a user. More specifically, the present disclosure relates to allowing a user to customize a tactile effect on an end-user device.
Electronic device manufacturers strive to manufacture a wide variety of interfaces for their users. Traditional electronic devices typically use auditory and visual cue to provide feedback to the user. For example, mobile phones typically include auditory and visual output devices to indicate the receipt of a call call. The auditory cue may include, for example, a series of tones, synthetic music, or digitally recorded music. However, auditory and visual cues may not be useful to mobile phone users. For example, in a movie theater, a user generally keeps the phone from ringing and puts the phone in a place where the visual queue cannot be seen. In this case, kinesthetic and / or tactile feedback can provide a more desirable and more effective interface.
Some electronic devices have the ability to provide kinesthetic feedback (such as acting and resistance feedback) and / or tactile feedback (vibration, vibrating tactile feedback, texture, heat, etc.) to the user. Generally, these types of feedback are commonly known as "tactile feedback." Tactile feedback can provide cues that improve and simplify the user interface. Specifically, tactile effects are useful in notifying the user of a particular event or providing realistic feedback to provide additional immersiveness within a simulated or virtual environment. possible. However, further improvements in the tactile field can still be made to improve the user interface of the end-user device.
The present disclosure describes a system and method for allowing a user of an end-user device to change parameters related to tactile effects that can be reproduced on the end-user device. Among several possible embodiments, the methods disclosed herein access software adapted by a user of an end-user device to design or modify the tactile effect of the end-user device. Includes steps that allow you to. The method further comprises the step of allowing the user to open the tactile track file and enter or change parameters related to the tactile effect of the opened tactile track file.
Other features, advantages, and implementations of the present disclosure that are not expressly disclosed herein will become apparent to those skilled in the art by considering the following detailed description and accompanying drawings. Such implicit features, advantages, and implementations of the present disclosure are intended to be included herein.
The components in the drawing are not always drawn in proportion to the actual size. Instead, the emphasis is on clarifying the general principles of this disclosure. Reference codes that specify the corresponding components are repeated throughout the drawing, if necessary, for consistency and clarity.
<figref num="1">It is a block diagram which shows the end user apparatus by one Embodiment.</figref><figref num="2">It is a block diagram which shows the memory shown in FIG. 1 by one Embodiment.</figref><figref num="3">FIG. 2 is a block diagram of the programmable tactile design software shown in FIG. 2 according to an embodiment.</figref><figref num="4">One embodiment is a graphical user interface associated with an end-user device that allows tactile tracks to be modified.</figref><figref num="5A">It is a graph which shows the example of possible tactile track which can be created using the graphical user interface of FIG.</figref><figref num="5B">It is a graph which shows the example of possible tactile track which can be created using the graphical user interface of FIG.</figref><figref num="5C">It is a graph which shows the example of possible tactile track which can be created using the graphical user interface of FIG.</figref><figref num="5D">It is a graph which shows the example of possible tactile track which can be created using the graphical user interface of FIG.</figref><figref num="6">It is a flowchart which shows the operation provided by the tactile design program by one Embodiment.</figref>
Some electronic devices include a tactile actuating device to provide tactile feedback to the user. This tactile feedback can be used to supplement auditory and visual feedback to improve the way information is provided to the user. For many years, electronic device users have been given the option to modify various features of auditory and visual output. For example, a mobile phone user can easily change the ringtone if desired. However, the user typically has no option in the device itself to change the characteristics of the tactile feedback. Professional designers of tactile sensation typically use a computer system to create tactile effects or tactile tracks with parameters that are permanently set within the device during the manufacturing phase. End users usually do not have the means to create or modify tactile effect files directly on the device after purchasing the device.
However, the present disclosure describes a system and method that allows the user to create and / or modify parameters related to haptic feedback through means on the device in the target device itself. In this regard, the ability to create customized tactile effects is in the hands of the average end user, who may not be as skilled as a professional tactile designer. As a result, the end user, perhaps simplified, creates or modifies the tactile effect according to the user's preference, using something similar to the tools available to professional designers of tactile sensation. can do. Software and systems can be incorporated within the end-user device as taught herein to guide the user through input processes and / or parameters that are modified, and tactile track features.
The ability to change the tactile track allows the user to customize the tactile effect to be associated with a particular "event." For example, with respect to mobile phones, a user may want to associate a particular customized tactile effect with receiving a call call from a particular caller or a group of callers. The user may also want to customize to reproduce certain tactile effects during the output of certain auditory and / or visual cues. Other events related to the end-user device include, for example, pressing a key on the keypad, receiving a time-sensitive message or alarm, receiving a call, receiving an email, and the like.
In addition, customized tactile effects created by the user can be stored in the device for use by the user. Customized tactile effects, once saved, can also be shared with other users by sending the tactile file to another device. In this regard, other users can reproduce the tactile effect on these other devices, if desired. The customized tactile effect can also be transmitted to another device so that the tactile track starts playing immediately on the receiving device. In this embodiment, the customized sensation can be applied to the recipient of interest when receiving (or making a call to) a call call from the creator of the customized tactile effect. This is the tactile sensation that corresponds to the voice features known as "ring" and "ringtone", thereby allowing the caller and recipient to identify instead of the standard ringtone, respectively. You will hear the song or message.
While the numerous embodiments described in this disclosure relate to mobile phones, the teachings of this disclosure may include other uses in which tactile effects can be applied to users of end-user devices. Please understand. Other advantages will become apparent to those skilled in the art by understanding this disclosure.
FIG. 1 is a block diagram of an embodiment of the end user apparatus 10. At least a portion of the end-user device 10 includes standard electrical circuits for performing tasks related to the normal operation of the end-user device 10. For example, the end user device 10 is a mobile handset, mobile phone, personal digital assistant (PDA), personal navigation device, tablet PC, handheld video game device, game module, game console, touch screen, touch pad, virtual. It may be a realistic force feedback device, or other suitable electronic device. In these embodiments, the end-user device 10 may include a circuit for performing normal functions of these devices. However, the present disclosure describes additional components of the end-user device 10 and related software to allow the user to modify the tactile track as taught herein.
In some embodiments, the end-user device 10 can be a tactile device that provides tactile feedback to the user during a particular event. With respect to aspects of providing tactile feedback, the user can use a purse, purse, pouch, or other portable accessory when the device is held in the user's hands, in the pocket of the user's clothing. When stored inside, when attached or fastened to the user's clothing, when worn as an item of clothing, or held adjacent to or close to the user in any other suitable manner. Tactile effects may be perceived from the device when present. In this regard, the end-user device 10 may be in direct or indirect contact with at least a portion of the user's body so that the user can experience the sensation of the tactile effect provided by the device.
In addition to the standard circuitry and functionality of the end-user device 10, additional elements to allow the user to create and / or modify tactile effects, as described herein. Exists or is associated with end-user equipment 10. Customized tactile effects are reproduced on the end-user device 10 itself, if the end-user device 10 can provide tactile feedback, or if it can be played on a corresponding tactile compatible device. can do.
According to the embodiment of FIG. 1, the end-user device 10 includes an input / output device 12, a processor 14, a memory 16, and a tactile actuating device 18. The end-user device 10 further comprises a bus 20 or other suitable communication interface that allows the input / output device 12, the processor 14, the memory 16 and the tactile activator 18 to communicate with each other. In some embodiments, the end-user device 10 may further include a transmitter / receiver, such as for use in a mobile phone or other wireless communication device. Such transmitters and receivers can be used for communication within mobile phone networks or within short-range networks such as those associated with Bluetooth® compatible devices. In this case, the newly created or modified tactile effect can be transmitted to a device capable of reproducing the tactile effect. Tactile file when end-user device 10 is connected to another device via mobile phone network, wide area network (WAN), local area network (LAN), Bluetooth® communication, infrared communication, etc. Can be transmitted to these devices. In some embodiments, for example, the end-user device 10 may use a streaming data communication protocol for immediate playback on another user's device. When in streaming mode, the end-user device 10 may stream music, video and / or haptic data to other devices over an indefinite length of time.
In one embodiment, some of the elements shown in FIG. 1 can be placed on different devices. For example, input / output devices 12, processors 14, and memory 16 can be used to allow users to create or modify tactile effects. The created or modified tactile effect can be provided or transmitted to another device having the tactile actuating device 18 in any suitable manner. In this case, one device includes a tactile activator 18 so that the tactile effect can be created or modified and the other device can reproduce the tactile effect for the user of the other device.
The input / output device 12 consists of one or more input mechanisms, which include a keyboard, a keypad, a cursor control device, a computer mouse, a voice activation mechanism, and a corresponding stylus or other drawing instrument. Any suitable combination of touch screen, touch pad, button, slider, microphone, digital camera, etc. can be mentioned. The input / output device 12 also consists of one or more output mechanisms, such as a computer monitor, a display screen such as a touch screen, a virtual reality display device, a speaker, or any other audio output device, a printer, or the like. Suitable combinations can be mentioned. Some input / output devices 12 may have both functions of receiving inputs and providing outputs.
Processor 14 may be a general purpose or special purpose processor or microcontroller. In general, the processor 14 can control the functions of the end-user device 10 and execute software stored in the memory 16. Memory 16 may include an internal fixed storage device for storing information, data, and / or instructions, and / or a removable storage medium. The memory 16 includes volatile memory such as random access memory (RAM) and dynamic RAM (DRAM), and / or read-only memory (ROM), electrically erasable programmable ROM (EEPROM), and flash. Any suitable combination of non-volatile memory, such as memory, may be included. The memory 16 can also store software programs that allow the end user to create and / or modify tactile effects, which software programs can be executed by the processor 14.
The haptic activator 18 may include any suitable combination of electrical or electromechanical components to provide a tactile effect to the user. In some embodiments, the tactile actuator 18 is configured as an eccentric rotating mass (ERM) actuator. By changing the amplitude value applied to the ERM actuator, the change in the speed of the motor related to the ERM actuator can be obtained. In another embodiment, the tactile actuator 18 is a linear resonant actuator. It can be configured as actuator: LRA), which gives a change in vibration or pulse frequency by changing the amplitude value applied to the LRA. In yet another embodiment, the tactile activator 18 can be configured within a pressure sensitive surface, such as a touch screen device, which can sense the pressure applied by the user and also to the user. Tactile feedback can also be provided. The pressure sensed by the pressure-sensitive surface can be converted into data related to the amplitude parameter of the tactile effect so that the tactile effect is altered. With respect to embodiments where the tactile activator 18 is an accelerometer, the accelerometer can also be used as an input device for detecting rocking motion from the user and recording a particular vibration input.
FIG. 2 is a block diagram of an embodiment of memory 16 commonly shown in FIG. The memory 16 in this implementation is configured to store programs, data, information, files, etc., eg, operating system (O / S) 22, graphical user interface (GUI) 24, RAM 26 or other suitable volatile memory. Sexual memory and other suitable non-volatile memories such as ROM 28 or EEPROM, flash memory can be mentioned. Files stored in memory 16 related to tactile effects may contain specific file formats that are compatible with or can be understood by the tactile activator 18 or other tactile activators. it can.
ROM28 may be configured to store a library of preset tactile tracks that can be used as a general starting point for creating new tracks. In this case, the preset track can be protected from overwriting so that it is available whenever the user wants to create a new file. The ROM 28 can also store tactile track files created or modified by the user, or can store mixed track files containing multiple tactile tracks combined with each other. Users can assign new filenames to newly created or modified tactile track files and mixed track files. The ROM 28 can further store a file containing association information for associating a particular track file with a particular event associated with the end-user device 10.
As shown in FIG. 2, the memory 16 also stores programmable haptic design software 30 configured to allow the user to create, modify, design, and customize haptic effects as desired. The programmable haptic design software 30 allows the user to design a track or sequence of haptic output for playback at any length of time. The programmable haptic design software 30 also allows the user to associate a particular haptic track file and mixed track file with a particular event for the end-user device 10. For example, a tactile track plays when one or more specific events occur, such as when a mobile phone call call is received, or when a call call is received from a particular caller or phone number. Can be programmed as
Certain parameters or features of the tactile output or tactile track can be created, input, modified, modified, etc. For example, the parameters that can be changed include the frequency of vibration and the amplitude of vibration. Also, the frequency and amplitude can be set to change over time. In addition, the user can combine or mix different tactile tracks with each other to provide a more complete tactile experience, if desired. In this way, the user can program or customize the tactile track or track mixture to his or her taste.
While programming the tactile track or track mixture, the user can test the tactile track or track mixture so that the user can experience, if desired, how what he or she can actually feel. You can enter a command to start playback. This can be experienced using, for example, the tactile actuating device 18 (FIG. 1) located within the end-user device 10. The user may also have the option of running a tactile track or track mixture in test playback at the same time as audio and / or video output.
The programmable tactile design software 30 may be accessed by the user using any number of possible access techniques. In one embodiment, the user may access the programmable haptic design software 30 via GUI24. In this case, the programmable tactile design software 30 may be opened from menu choices such as "options", "tools", or "antenna sensations" from GUI24. Other non-limiting techniques for accessing the programmable haptic software 30 include a voice response system, a text interface, and a Braille-type surface with either fixed or variable components.
Upon first access, the programmable haptic design software 30 may offer the option of either "create a new track" or "modify an existing track" via GUI24. As used in the present disclosure, the term "track" can refer to a parameter associated with a tactile effect that can be reproduced on a tactile device. For example, the parameters may include frequency and amplitude characteristics of the tactile output over a particular time length.
According to one embodiment, when "Create New Track" is selected, the programmable haptic design software 30 tells the user two "start with a track from the library" or "start from the initial state". Either option may be provided. As mentioned above, ROM28 can store a library of tracks where certain types of tactile effects can be used as a starting point. When "Start with track from library" is selected, the list of track files stored in the library is displayed as a user's choice. Track files in the library may be given filenames that represent the understandable characteristics of the file. For exemplification purposes, files are among many, for example, "standard", "normal alarm", "gentle", "getting stronger", "long and constant", "fast pulse", "get up!" , "Large and unpleasant" and the like.
When opening a new or existing file, the user has the opportunity to change certain features of the tactile track, if desired. For example, the user may be able to set the amplitude or frequency of vibration of the tactile track. This is desirable when the user wants to vary the amplitude over time. Amplitude can be varied gradually or stepwise between parts of the tactile track, or throughout it.
Another feature of the tactile track that can be modified by the user is the attack level, which corresponds to the initial amplitude of the signal. The attack time is another variable parameter that corresponds to the time it takes for the signal to change from the attack level to the center intensity, and is another parameter that can be set. The central intensity corresponds to the amplitude of the tactile signal during which it can be the majority of the time of the tactile track. Another parameter is the fade level, which corresponds to the amplitude at the end of the track. The time it takes for the signal to change from the center strength to the fade level is called the fade time and can be changed as well. The user can enter another mutable parameter, a specific duration. In some embodiments, the signal remains centrally strong for the duration minus the attack and fade times. In other embodiments, the duration may be associated with the amount of time the signal remains at central intensity.
The following description includes several embodiments that define how the tactile track parameters can be modified. When the user accesses the programmable haptic design software 30 via GUI24 and opens the file to be edited, the user continues to exchange information with the programmable haptic design software 30 by the input / output mechanism of GUI24. can do.
In the first embodiment, specific values for tactile track parameters can be entered via GUI24. For parameters such as attack level, attack time, intensity, duration, fade level, and fade time, the user can enter values in units of hertz, seconds, milliseconds, decibels, and the like. GUI24 may represent an acceptable range of values for each parameter. Programmable tactile design software 30 can also monitor inputs to inspect for errors, such as unacceptable settings, inconsistent values in two or more parameters, etc. Can be the cause.
Another embodiment of how to modify the tactile track is by representing a range of values that can be selected by the user via GUI24. Alternatively, instead of values, descriptive expressions can be used that can be easier for the unskilled user to understand. For example, some descriptive expressions include categories such as "start strength" (attack level), "middle strength" (amplitude or strength), and "end strength" (fade level). Can be mentioned. Other descriptive expressions may include "duration" (duration), "rise time" (attack time), and "stop time" (fade time). Under the Start Strength and End Strength categories, descriptive expressions such as "strong," "medium," and "weak" may be presented to the user to select the desired attack level. Under the middle strength category, descriptive expressions such as "high", "medium", and "low" may be presented to the user to select the desired strength. Under the duration category, "long", "medium", and "short" may be represented to the user. Under the Rise Time and Stop Time categories, "Fast Rise / Fade", "Medium Speed Rise / Fade", and "Slow Rise / Fade" may be indicated as desired rise or fade time options. As suggested above, additional inputs can be made so that the user can vary the amplitude or pulse frequency during the tactile track. It should be understood that the characteristics of the tactile track can be described in layman's terms using other descriptive expressions. Also, it should be understood that categories can be divided into more than three value or choice levels.
In another embodiment of how parameters can be entered, GUI24 can display a graph showing some characteristics of the amplitude of the tactile output over time. GUI24 may also allow the user to change the graph according to the user's wishes. For example, graph lines can be stretched, shortened, moved, slid, changed, etc. using various input device tools. In this embodiment, the user may use an operational input device such as a touch screen device and a stylus.
Other visual displays may be provided to the user so that the user can change the parameters. For example, the amplitude of a tactile track can be represented by notes along the scale. Therefore, notes above the scale can represent tactile output with higher amplitude or higher pulse frequency. Other embodiments for expressing amplitude using notes include musical instructions regarding loudness. For example, ff (Fortissimo) for very large or very high amplitude, f (Forte) for large or high amplitude, mf (Mezzoforte) for moderately large or moderately high amplitude, m. (Mezzo) for moderate amplitude, mp (mezzoforte) for moderately quiet or moderately low amplitude, p (piano) for quiet or low amplitude, pp (pianissimo) very It may be used for quiet or very low amplitude. The duration parameter can also be represented by musical notes in this regard. For example, notes may be represented as eighth notes, quarter notes, half notes, etc. to represent the duration of tactile output.
After creating or modifying a tactile track file or a mixed track file, the user can remember the file using the new filename, or if the original file is not protected from overwriting, it will be in the original file. It can be overwritten. In particular, as described above, the files in the library can be set so that they cannot be overwritten. ROM28 is configured to store any reasonable number of tactile track files and mixed track files according to a particular design.
Various logical instructions or commands may be included in the programmable tactile design software 30. The programmable tactile design software 30 of the present disclosure can be implemented in hardware, software, firmware, or a combination thereof. When implemented in software or firmware, the software can be stored in memory 16 and executed by processor 14. When implemented in hardware, programmable tactile design software 30 includes, for example, individual logic circuits, application specific integrated circuits (ASICs), programmable gate arrays (PGAs), and field programmable gate arrays (FPGAs). ) Etc., or any combination thereof, can be used for implementation.
FIG. 3 is a block diagram of an embodiment of the programmable haptic design software 30 shown in FIG. In this embodiment, the programmable tactile design software 30 includes a memory interface 32, a temporary storage device 34, a tactile track editing module 36, a track mixing module 38, a track / event association module 40, and a test playback module 42. And, including.
The memory interface 32 is configured to capture a copy of a file, either a tactile track file or a mixed track file, from ROM 28 (FIG. 2). The memory interface 32 puts a copy of the captured file in the temporary storage device 34, which can change the file according to the user's input. In this regard, the temporary storage device 34 may simply include RAM or other volatile memory while the track is being programmed. After the user creates or modifies one or more files in the temporary storage device 34, the memory interface 32 is configured to store a copy of the files in ROM 28 as directed by the user. The user may also enter a unique file name to view and access the file later. In addition, each file may contain information that associates the file with one or more specific events that may occur during normal use of the end-user device 10.
While the file is open in temporary storage 34, the user may use the tactile track editing module 36 to edit the opened file. In addition, the user may use the track mixing module 38 to mix open tactile track combinations with each other. The tactile track editing module 36 allows the user to perform different types of tactile track editing by changing various parameters of the tactile track. The tactile track can be modified by any suitable method, such as the method described above. For example, the Tactile Track Editing Module 36 allows the user to use rise time, attack level, attack time, intensity, duration, fade time, and other features related to waveform parameters for the time while the tactile track is playing. It is possible to change the features such as. In addition, the haptic track editing module 36 allows the user to enter one or more frequencies for the haptic track, or even continuously change the frequency played along the length of the haptic track. To do.
The temporary storage device 34 can store two or more tactile tracks. In addition, the temporary storage device 34 can even store multiple copies of the same tactile track. For example, a user may want to mix the same tactile track within a mixed track so that the second occurrence of the tactile track is temporally offset from the first occurrence in order to provide a more complete tactile output. .. The track mixing module 38 allows the user to play end-to-end over a portion of the time, or after a short pause at the end of the first track. Tactile tracks can be combined and played simultaneously, just as they would start a track. When programmed to overlap in time, the two or more tactile tracks can be programmed to overlap in time or partially in any suitable manner. The track mixing module 38 also allows the user to adjust the amplitude of one track relative to the other so that one track is more emphasized than the other.
The Track / Event Association Module 40 allows the user to form a relationship or association between a particular event and a track file. One embodiment of the event is the reception of a mobile phone call from a particular caller. When a call call from the caller is received, the file with the association information added by the track / event association module 40 is read from memory and played along with the respective voice and visual queues. The Track / Event Association Module 40 allows the user to form an association between any number of events and any number of track files. In some cases, one or more events may not be associated with the track file, while in other cases each event may be associated with its own track file. Other associations can be established, such as to associate tactile and mixed tracks with other media or other specific auditory and / or visual outputs.
The test reproduction module 42 may be present in the programmable haptic design software 30, as shown in FIG. In other embodiments, this element may be excluded from the programmable haptic design software 30 depending on whether the end-user device 10 includes a haptic activator. If the end-user device 10 includes a tactile actuator, the test playback module 42 can be used to replay the tactile track or mixed track temporarily stored in the temporary storage device 34. When the user inputs a command to the end user device 10 to provide test playback, the test playback module 42 transmits the selected tactile track or mixed track from the temporary storage device 34 to the tactile actuator 18 and tactile actuation. The device 18 can then play the track to the user. The test playback module 42 helps the user understand how the tactile track or mixed track actually feels when played on the tactile actuator 18 and how the changes affect it. obtain. In a further implementation, the test playback module 42 may be configured to replay the tactile track as changes are being made. In this case, the user may receive immediate feedback on how much the change affects the tactile track.
In other embodiments, such as when the haptic activator 18 is present on the remote device, the programmable haptic design software 30 is such that the selected haptic track or mixed track is transmitted to the remote device. An additional transmission module may be included to send instructions to the transmitter or transmitter / receiver. Therefore, remote users can experience or test the modified track.
The programmable haptic design software 30 may operate in conjunction with other measurement and test devices associated with the end-user device 10. For example, a temperature measuring device may be used to detect if the temperature of the end user device 10 is below a certain level. In that case, one or more tactile tracks edited by the programmable tactile design software 30 may be programmed to compensate for situations in which some of the users may experience diminished ability to perceive tactile feedback. Low temperatures cool your hands so that vibrations cannot be easily detected. Also, with cold climates, users may be more likely to wear additional clothing, gloves, mittens, etc., blocking tactile feedback from the end-user device 10. Compensation in these situations includes tactile signals of higher amplitude, longer duration, and / or higher frequency vibrations.
The programmable tactile design software 30, which is described with respect to FIGS. 2 and 3, and other programs or software code stored in memory 16 related to the creation and modification of tactile effects are described herein. Includes executable logical instructions as described. Programmable tactile design software 30 in any suitable computer-readable medium is embodied for execution by any suitable processing device. Computer-readable media can include any physical medium capable of storing a program or software code for a measurable amount of time.
FIG. 4 is a diagram illustrating an embodiment of a graphical user interface (GUI) 50 relating to an end-user device having tactile design capability. The GUI 50 includes, in this embodiment, a screen 52 that graphically shows the output of the tactile track. In other embodiments, GUI50 may represent a track mixture in which two or more tactile tracks are combined with each other. The GUI 50 also includes an intensity adjusting mechanism 54, a duration adjusting mechanism 56 and an envelope adjusting mechanism 58.
The screen 52 showing a single tactile track contains four points numbered 1 to 4. Point 1 indicates the attack level, which is shown to have an intensity of 10,000 in this embodiment and corresponds to the attack level set by the envelope adjustment mechanism 58. In this embodiment, the center strength or intermediate strength is set to 4500. Screen 52 shows the central strength that maintains steady-state strength between points 2 and 3. The attack time is set to 20ms, which represents the time from point 1 to point 2.<sub>1</sub>As shown in screen 52. In this embodiment, the fade level is set to 0 (point 4) and the fade time is 30 ms (point 3 to point 4, i.e. t).<sub>3</sub>) Is set. If desired, the name used to describe the features or aspects of the tactile track can be changed to any suitable name. For example, "intensity" may be referred to as amplitude, strength, volume, etc., and "duration" may be given a name such as period, length, etc. as an alternative.
The intensity adjusting mechanism 54 includes a slider that allows the user to adjust the center intensity of the tactile track as desired. The intensity adjusting mechanism 54 also includes a window in which the user can enter a value representing the intensity. In this embodiment, the intensity value is set to 4500 and can be seen on the slider and in the window. The strength can be adjusted using these and other suitable means.
The duration adjustment mechanism 56 includes a slider that allows the user to adjust the duration of the tactile track as desired. GUI50 shows a duration slider represented on a logarithmic scale, but in other embodiments it may include a linear scale. The duration adjustment mechanism 56 also includes a window that allows the user to enter a duration value in milliseconds. In this embodiment, the duration can be adjusted to any time between 1 ms and 10 seconds. However, in other embodiments, the duration adjustment mechanism 56 may be configured to allow selection of any desired value. In this embodiment, the duration is set to 120 ms and can be seen on the slider and in the window.
The envelope adjustment mechanism 58 includes a window that allows the user to enter values for attack time, attack level, fade time, and fade level. In this embodiment, the attack time is set to 20 ms, the attack level is set to 10,000, the fade time is set to 30 ms, and the fade level is set to 0. Attack time (t<sub>1</sub>) Is set to 20ms and the fade time (t)<sub>3</sub>) Is set to 30ms and the duration is set to 120ms, the time t for the signal to maintain a central strength of 4500<sub>2</sub>Is equal to the duration minus the attack time and the fade time. Specifically, t<sub>2</sub>= Duration-t<sub>1</sub>-t<sub>3</sub>And in this case t<sub>2</sub>Is 70ms.
In FIG. 4, the tactile track parameters shown in screen 52 indicate the amplitude or intensity of the tactile track with respect to time, in which time is shown on the x-axis of the graph and amplitude is shown on the y-axis of the graph. Has been done. This graph may be shown on GUI24 in embodiments where the user can manipulate the lines of the graph to change the tactile track. In other embodiments, certain expressions or values that describe aspects of the tactile track can be stored for later recreating the tactile track 44.
The particular graph of the tactile track shown on screen 52 merely represents an example of possible tactile output and is not intended to limit this disclosure in any way. I want you to understand. In some embodiments, the attack time and attack level may be excluded and the user may be prompted to enter parameters for intensity, duration, fade time, and fade level. In still other embodiments, the attack time and fade time may be excluded, which can greatly simplify the user's operation. In yet other embodiments, additional features or parameters may be included within the tactile track 44 to allow the track to be more complex. For example, a tactile track may contain two or more levels instead of one constant amplitude level for intensity. In addition, the tactile track may include additional attack level, attack time, fade level, and fade time features between the shown attack and fade levels.
5A-5D are graphs showing the embodiment of screen 52 shown in FIG. Graph 60 in FIG. 5A shows a situation where the user inputs an attack level (point 1) higher than the central intensity (points 2 to 3). The central intensity in graph 60 is higher than the fade level (point 4). Therefore, Graph 60 shows that the first strong signal slopes down to a certain level and then again to the final fade level.
FIG. 5B shows Graph 62, which tilts upwards to the horizontal level portion and then upwards to the final fade level. In this case, the attack level is the lowest and the fade level is the highest. Graph 64 in FIG. 5C includes an upward slope to the horizontal level portion and a subsequent downward slope. Graph 66 in FIG. 5D includes a downward slope to the horizontal level portion and a subsequent upward slope. It should also be noted from Figures 5A-5D that the attack time, fade time, and duration include various non-limiting possibilities. Also note that the attack time and / or fade time can be 0ms so that the output simply includes the center intensity. Furthermore, if the sum of the attack time and the fade time is equal to the duration, then the time at the central intensity level is 0 ms. Other possible allocations using these parameters can be achieved if desired.
FIG. 6 is a flow chart illustrating an embodiment of a method for allowing a user to edit a tactile effect and a tactile track. The method may include the operation of a tactile design program, such as programmable tactile design software 30, or other programs that allow the creation and / or modification of tactile tracks. Block 70 of the method describes allowing the user of the end-user device to programmatically access software for designing or editing tactile effects. The end-user device may be a tactile device such as a portable device or a module. Software for designing or editing tactile effects may include programmable tactile design software 30 or other programs.
At block 72, the method allows the user to open a new file, an existing tactile track file, or an existing mixed track file. In these examples, the new file can represent a tactile track from a library with initial values that can be used as a guideline or starting point for creating a new track file. Otherwise, new files can be created, if desired, without any specific guidelines.
At block 74, the user can enter or change the parameters of the opened file. Parameter input or modification can be accomplished using any suitable interface between the user and the end-user device. The input of the value may correlate with the behavior for the new tactile file, while the change may correlate with the value of the existing tactile file or the preset file. The value can be directly input, the value can be selected from the range of values, and the line of the graph of the tactile track can be changed according to the change of the shape of the track or the like.
At block 76, the user can store the modified file. In some embodiments, the user can play a tactile track or a mixture of tracks created or modified to test how the track can actually be felt. In addition, the user may be able to send one or more tactile track or mixed track files on different devices of another user. In this regard, the user can share the tactile effect file.
It should be understood that the steps, processes, or operations described herein can represent any module or code sequence that can be implemented within software or firmware. In this regard, these modules and code sequences can include commands or instructions to perform specific logical steps, processes, or actions within a physical component. One or more of the steps, processes, and / or actions described herein may be at substantially the same time or in a different order than those explicitly described, as will be appreciated by those skilled in the art. Further understand what can be done.
The embodiments described herein merely illustrate examples of implementation and are not necessarily intended to limit the disclosure to any particular embodiment. Alternatively, various modifications can be made to these embodiments that will be understood by those skilled in the art. Any such changes are included in the spirit and scope of this disclosure and are intended to be protected by the claims.
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| JP2014204445A | Cited by | Japan | Search report |
| US9696807B2 | Cited by | United States of America | Applicant |
| WO2020255644A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| JP2015505085A | Cited by | Japan | Examiner |
| JP2018136976A | Cited by | Japan | Search report |
| JP2014093091A | Cited by | Japan | Search report |
| WO2021049084A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| JP2018085148A | Cited by | Japan | Search report |
| JP2014093091A | Cited by | Japan | Search report |
| JP2014093091A | Cited by | Japan | Search report |
| JP2016024826A | Cited by | Japan | Search report |
| JP2018136976A | Cited by | Japan | Search report |
| JP2014204445A | Cited by | Japan | Search report |
| JP2012526331A | Cited by | Japan | Examiner |
| JP2018136976A | Cited by | Japan | Search report |
| JP2014523560A | Cited by | Japan | Examiner |
| JP2014093091A | Cited by | Japan | Search report |
| JP2012526331A | Cited by | Japan | Search report |
| JP2021043618A | Cited by | Japan | Search report |
| JP2021043618A | Cited by | Japan | Search report |
| JP2015505085A | Cited by | Japan | Search report |
| US9997032B2 | Cited by | United States of America | Applicant |
| JP2015053043A | Cited by | Japan | Search report |
| JP2014010831A | Cited by | Japan | Search report |
| US9383820B2 | Cited by | United States of America | Applicant |
| JP2014204445A | Cited by | Japan | Search report |
| JP2015228064A | Cited by | Japan | Search report |
| JP2018506765A | Cited by | Japan | Search report |
| JP2014093091A | Cited by | Japan | Search report |
| JP2014093091A | Cited by | Japan | Search report |
| JP2020205011A | Cited by | Japan | Search report |
| JP2000138972A | Cites | Japan | Examiner |
| JP2003008687A | Cites | Japan | Examiner |
| JP2003290717A | Cites | Japan | Examiner |
| JP2004094389A | Cites | Japan | Examiner |
| JP2004265281A | Cites | Japan | Examiner |
| JP2004503004A | Cites | Japan | Examiner |
| JP2005065264A | Cites | Japan | Examiner |
| JP2005149385A | Cites | Japan | Examiner |
| JP2005217824A | Cites | Japan | Examiner |
| JP2006014141A | Cites | Japan | Examiner |
| JP2006065507A | Cites | Japan | Examiner |
| JP2007013837A | Cites | Japan | Examiner |
| JP2007215051A | Cites | Japan | Examiner |
| JPH10257135A | Cites | Japan | Examiner |
14 members in 4 offices
Priority claims14
| Document | Office | Kind | Date |
|---|---|---|---|
| 60940227 | United States of America | – | |
| 94022707 | United States of America | P | |
| 94022707 | United States of America | P | |
| 12060324 | United States of America | – | |
| 6032408 | United States of America | A | |
| 6032408 | United States of America | A | |
| 2008061937 | United States of America | W | |
| 2008061937 | United States of America | W | |
| 2007940227 | – | – | – |
| 2008060324 | – | – | – |
| 2008061937 | – | – | – |
| US20070940227P | – | – | – |
| US20080060324 | – | – | – |
| WO2008US61937 | – | – | – |
Members14
| Document | Office | Kind | |
|---|---|---|---|
| US2008294984A1 | United States of America | A1 | |
| WO2008147622A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2008147622A3 | World Intellectual Property Organization (WIPO) | A3 | |
| KR20100017929A | Republic of Korea | A | |
| JP2010528394AThis record | Japan | A | |
| US8621348B2 | United States of America | B2 | |
| JP5451598B2 | Japan | B2 | |
| JP2014056614A | Japan | A | |
| US2014089792A1 | United States of America | A1 | |
| US2014195906A1 | United States of America | A1 | |
| KR101468250B1 | Republic of Korea | B1 | |
| JP6000236B2 | Japan | B2 | |
| US9990038B2 | United States of America | B2 | |
| US2018284897A1 | United States of America | A1 |
17 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of no payment of annual feesLAPS | LAPS | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Written amendmentJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Written amendmentJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 | |
| Notification of resignation of power of attorneyJAPANESE INTERMEDIATE CODE: A7424RD04 | RD04 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 2010528394
- Publication, DOCDB
- 2010528394
- Publication, EPODOC
- JP2010528394
- Application
- 2010510395
- Application, DOCDB
- 2010510395
- Application, EPODOC
- JP20100510395
Titles2
- Japanese
- エンドユーザ装置上での触覚的効果のカスタマイズ
- English
- Customize tactile effects on end-user equipment
Classification
- CPC, 9
- G06F3/016
- G06F1/1626
- H04M19/04
- H04M19/047
- H04M1/72448
- G06F9/451
- G06F3/01
- G06F3/002
- G06F3/0488
- IPC, 3
- G06F3 01
- H04M1 00
- H04M1 72448
Designated states4
- Regional, 4
- Zimbabwe
- Turkmenistan
- Türkiye
- Togo