Portable type information device, and data input method thereof
Abstract
[Task] Data is input to a handheld portable information device, which lacks computing resources, by voice.
Solution.The association recording processing unit 18 of the PDA1 records the voice data input from the microphone 11 in the recording device 15 in association with the data object of the application. Further, the communication device 16 transfers the voice data to the host computer 2. In the host computer 2, the voice / text conversion unit 51 recognizes the voice data, converts it into text data, and transfers it from the communication device 56 to the PDA1. The association recording processing unit 18 of the PDA 1 records the text data converted from the voice data by the host computer 2 in the recording device 15 in association with the data object instead of the voice data.
Term
Term ended
Projected expiry passed 27 October 2019, 6.9 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
8 claims: 3 independent, 5 dependent
- 1【特許請求の範囲】 【請求項1】音声入力手段と、 記録手段と、 上記音声入力手段から入力された音声データをアプリケーションのデータオブジェクトに関連付けて上記記録手段に記録する関連付け記録処理手段とを備えていることを特徴とする携帯型情報装置。
- 2【請求項2】音声データを音声認識してテキストデータに変換する音声/テキスト変換手段を備えたホスト情報システムとの通信を行う通信手段を備えていることを特徴とする請求項1に記載の携帯型情報装置。
- 3【請求項3】上記関連付け記録処理手段は、上記の音声データから変換されたテキストデータを、該音声データが関連付けられていたデータオブジェクトに関連付けて上記記録手段に記録することを特徴とする請求項2に記載の携帯型情報装置。
- 4【請求項4】上記関連付け記録処理手段は、上記の音声データから変換されたテキストデータを、該音声データが関連付けられていたデータオブジェクトに該音声データの代わりに関連付けて上記記録手段に記録することを特徴とする請求項2に記載の携帯型情報装置。
- 5【請求項5】上記通信手段は、 上記記録手段に記録されているデータオブジェクトと、上記ホスト情報システムのホスト記録手段に記録されているデータオブジェクトとを同期させる際、 上記音声データの送信および該音声データが変換されたテキストデータの受信を行うことを特徴とする請求項2から4の何れかに記載の携帯型情報装置。
- 6【請求項6】音声を入力する音声入力ステップと、 上記音声入力ステップにて入力された音声データをアプリケーションのデータオブジェクトに関連付けて記録する音声データ記録ステップとを含んでいることを特徴とする携帯型情報装置のデータ入力方法。
- 7【請求項7】上記音声データをホスト情報システムへ送信する音声データ送信ステップと、 上記ホスト情報システムにて上記音声データを音声認識してテキストデータに変換する音声/テキスト変換ステップと、 上記テキストデータを上記ホスト情報システムから受信するテキストデータ受信ステップとを含んでいることを特徴とする請求項6に記載の携帯型情報装置のデータ入力方法。
- 8【請求項8】上記の音声データから変換されたテキストデータを、該音声データが関連付けられていたデータオブジェクトに該音声データの代わりに関連付けて記録するテキストデータ記録ステップを含んでいることを特徴とする請求項7に記載の携帯型情報装置のデータ入力方法。
Independent claims8
277 paragraphs in 1 section, as filed
Description: TECHNICAL FIELD [Detailed description of the invention]
【0001】
[Technical field to which the invention belongs]
The present invention relates to a hand-held portable information device in which data can be easily input, and a data input method for the portable information device.
【0002】
[Conventional technology]
Laptop computers have been developed, at least in part, to allow users to use their computers away from desktop computers. Such locations include hotels, airports, business meetings, and the like.
【0003】
Laptop computers typically include application software such as a scheduler and an address book. It allows users to manage this information while synchronizing it with other laptop and desktop computers. Also, laptop computers typically enter data by using a keyboard or voice recognition software. However, laptop computers are limited in portability due to their large size and weight of about 5 kg (several pounds).
【0004】
Therefore, in response to the demand for portability superior to laptop computers, a new class of information devices widely known as personal data appliances (PDAs) have been created. This PDA is a small hand-held information device, including address books, calculators, date books, memo pads, and to-do lists. Includes functionality.
【0005】
US Robotics has developed a handheld PDA with a touch screen and handwriting recognition, which is sold as the Palm Pilot (Palm Pilot is a trade name of US Robotics).
【0006】
The handwriting recognition function of the handheld PDA is based on drawing each character on a part of the screen using a stylus (input pen of a plastic rod). In order to use this handwriting recognition function, it is necessary to learn the characters written by the user (scripting character set). However, the handwriting recognition function lacks the accuracy and speed of conventional computer keyboards. In addition, it is very difficult to input characters using a stylus, especially in a moving vehicle.
【0007】
It should be noted that the PDA cannot effectively perform speech recognition because the computing resources are not sufficient.
【0008】
However, despite the unwieldy characteristics of these input methods, users of mobile devices such as PDAs use conventional data input methods (handwriting recognition, small keypad text input, etc.) to input data (reservation and contact). I think it's okay to create a new one.
【0009】
In addition, the application of database synchronization technology to PDAs has significantly reduced the amount of data that needs to be entered directly into PDAs. Specifically, the schedule information of the time management software of the user's desktop computer is automatically "synchronized" with the target PDA, and the company phone list is automatically "synchronized" with the target PDA. be able to. In this situation, even a large number of users who cannot tolerate the data input characteristics of a PDA can enjoy the benefits of a PDA. That is, such a user can simply scribble a notebook, carry it around until it can be input to the host personal computer, and use that personal computer to synchronize with the PDA.
【0010】
There are also credit card-sized PDAs that do not support data entry into the device itself. With such a credit card sized PDA, all data needs to be updated on a personal computer and then synchronized with the PDA. Such PDAs have the advantage of eliminating the computational resources to support data entry by the PDA itself, as well as significantly reducing size and cost. However, since the PDA information cannot be updated at a location away from the personal computer, the user needs to carry a handwritten notebook that outlines the changes to the accumulated schedule. Moreover, the longer the user waits during the synchronization session, the less compatible the data stored in the PDA.
【0011】
[Problems to be Solved by the Invention]
Therefore, in the above-mentioned conventional structure, it is difficult to input data to the handheld portable information device, and an input system for the handheld information device that is convenient for the user is desired.
【0012】
The present invention has been made to solve the above problems, and an object thereof is a portable information device capable of inputting data to a handheld portable information device having scarce computing resources by voice, and a portable information device. The purpose is to provide a data input method for a portable information device.
【0013】
[Means for solving problems]
In order to solve the above problems, the portable information device of the present invention associates the voice input means, the recording means, and the voice data input from the voice input means with the data object of the application and records them in the recording means. It is characterized in that it is provided with an association recording processing means.
【0014】
With the above configuration, the voice data input from the voice input means can be recorded in the recording means in association with the data object of the application by the association recording processing means. That is, the input data to the application can be recorded as voice data. Therefore, it is possible to input data to a handheld portable information device, which lacks computing resources, by voice.
【0015】
This eliminates the need for the user to enter text on the portable information device to enter data into the application. That is, by recording the voice data, the use of the stylus and the handwriting recognition, which have been conventionally required for text input, become unnecessary, and these restrictions can be alleviated.
【0016】
Therefore, with such a simple data input system, even a user who cannot tolerate the data input characteristics of the handheld portable information device can more fully enjoy the advantages of the portable information device.
【0017】
The portable information device of the present invention is a communication means for communicating with a host information system provided with a voice / text conversion means for recognizing voice data and converting it into text data in order to solve the above problems. It is characterized by having.
【0018】
With the above configuration, the voice data input to the portable information device can be transmitted to the host information system by the communication means, and the text data converted by the voice / text conversion means can be received.
【0019】
Therefore, text data can be input to the portable information device by using the voice recognition function. That is, it becomes possible to input text data to a handheld portable information device, which lacks computing resources, by voice input.
【0020】
In order to solve the above-mentioned problems, the portable information device of the present invention further, the above-mentioned association recording processing means converts the text data converted from the above-mentioned voice data into a data object to which the voice data is associated. It is characterized in that it is associated and recorded in the above-mentioned recording means.
【0021】
With the above configuration, further, the text data converted from the voice data can be recorded in the recording means in association with the data object to which the voice data is associated by the association recording processing means.
【0022】
Therefore, the text data can be associated with the data object of the application together with the voice data. Therefore, the user of the portable information device can confirm the content only by displaying the text data without reproducing the voice data.
【0023】
In order to solve the above-mentioned problems, the portable information device of the present invention further uses the above-mentioned association recording processing means to convert text data converted from the above-mentioned voice data into a data object to which the voice data is associated. It is characterized in that it is associated with the audio data and recorded in the recording means.
【0024】
With the above configuration, further, the text data converted from the voice data can be recorded in the recording means by associating the text data converted from the voice data with the data object to which the voice data is associated instead of the voice data by the association recording processing means.
【0025】
Therefore, text data can be associated with the data object of the application instead of voice data. Therefore, the same result as when the user of the portable information device directly inputs the text data can be obtained by the voice input. That is, it becomes possible to input text data to a handheld portable information device, which lacks computing resources, by voice input.
【0026】
In the portable information device of the present invention, in order to solve the above problems, the communication means is further recorded in the data object recorded in the recording means and the host recording means of the host information system. When synchronizing with a data object, the voice data is transmitted and the text data converted from the voice data is received.
【0027】
With the above configuration, further, when the data object to be synchronized is recorded in the host recording means of the host information system, the communication for synchronization of the data object transmits the voice data and the text to which the voice data is converted. Data can be received.
【0028】
Therefore, since the conversion of voice data to text data can be performed in synchronization with other data, it is not necessary to connect a communication link only for voice / text conversion.
【0029】
In the data input method of the portable information device of the present invention, in order to solve the above-mentioned problems, the voice input step for inputting voice and the voice data input in the voice input step are associated with the data object of the application. It is characterized by including an audio data recording step to be recorded.
【0030】
According to the above method, the voice data input by the voice input step can be recorded in association with the data object of the application by the voice data recording step. That is, the input data to the application can be recorded as voice data. Therefore, it is possible to input data to a handheld portable information device, which lacks computing resources, by voice.
【0031】
This eliminates the need for the user to enter text on the portable information device to enter data into the application. That is, by recording the voice data, the use of the stylus and the handwriting recognition, which have been conventionally required for text input, become unnecessary, and these restrictions can be alleviated.
【0032】
Therefore, with such a simple data input system, even a user who cannot tolerate the data input characteristics of the handheld portable information device can more fully enjoy the advantages of the portable information device.
【0033】
In the data input method of the portable information device of the present invention, in order to solve the above problems, the voice data transmission step of transmitting the voice data to the host information system and the voice data are transmitted by the host information system. It is characterized by including a voice / text conversion step of recognizing voice and converting it into text data, and a text data receiving step of receiving the text data from the host information system.
【0034】
By the above method, the voice data input to the portable information device is further transmitted to the host information system by the voice data transmission step, and the voice data is converted into text data by the host information system by the voice / text conversion step, and the text is displayed. The data reception step allows the text data to be received by the portable information device.
【0035】
Therefore, text data can be input to the portable information device by using the voice recognition function. That is, it becomes possible to input text data to a handheld portable information device, which lacks computing resources, by voice input.
【0036】
In the data input method of the portable information device of the present invention, in order to solve the above-mentioned problems, the text data converted from the above-mentioned voice data is further transferred to the data object to which the voice data is associated with the voice data. It is characterized by including a text data recording step of associating and recording instead of.
【0037】
By the above method, further, the text data converted from the voice data can be recorded in association with the data object to which the voice data is associated by the text data recording step instead of the voice data.
【0038】
Therefore, text data can be associated with the data object of the application instead of voice data. Therefore, the same result as when the user of the portable information device directly inputs the text data can be obtained by the voice input. That is, it becomes possible to input text data to a handheld portable information device, which lacks computing resources, by voice input.
【0039】
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment of the present invention will be described below with reference to FIGS. 1 to 11.
【0040】
Handheld data devices, commonly referred to as information devices, have sufficient computing resources to easily perform input, storage, and playback of audio samples. Examples of such portable information devices include personal data assistants (PDAs), digital telephones, and other handheld information devices. Then, such a portable information device is suitable for associating the stored speech sample with other data elements stored in the portable information device.
【0041】
As shown in FIG. 2, the PDA (portable information device) 1 according to the present embodiment is a handheld data device, which is interconnected with a host computer (host information system) 2 via an appropriate communication link. Data can be synchronized. That is, as will be described later, the PDA 1 and the host computer 2 are connected to form a distributed voice input recognition system.
【0042】
Specifically, the above PDA1 can call functions such as calendar, address book, and notepad with the touch of a button to instantly access necessary information, and the data synchronization communication function instantly connects with other PDAs and personal computers. Data can be exchanged. That is, it realizes light portability and comfortable interlocking with a personal computer. As a specific example of PDA1 according to the present embodiment, for example, Palm Pilot of US Robotics (described in "Palm Pilot handbook") is preferable.
【0043】
Further, the host computer 2 may be, for example, one personal computer or a plurality of computers as long as it has a voice / text conversion function that recognizes voice data and converts it into text data. It may be a connected information processing system.
【0044】
FIG. 1 is a block diagram showing an outline of the configurations of the PDA 1 and the host computer 2 according to the present embodiment.
【0045】
As shown in FIG. 1, the PDA1 includes a microphone (voice input means) 11, a speaker 12, a display 13, an input device 14, a recording device (recording means) 15, a communication device (communication means) 16, and a control device 17. It is composed of.
【0046】
The microphone 11 and the speaker 12 are arranged inside the PDA1. The display 13 is a touch-sensitive display. The input device 14 is provided with a touch sensor and a stylus (input pen) of the display 13 and buttons.
【0047】
The recording device 15 is a recording device such as a memory or a hard disk. The recording device 15 stores an operating system, application software, data objects, and the like.
【0048】
The communication device 16 interconnects with the communication device 56 (described later) of the host computer 2 via an appropriate communication link to perform data communication between the PDA 1 and the host computer 2. By communicating voice data and text data, it is possible to synchronize the data objects stored in both storage devices 15 and 55 with each other.
【0049】
The control device 17 controls the operation of the PDA 1 including the application. Programs and data such as application software stored in the recording device 15 are appropriately read and processed in the CPU (central processing unit) and the memory constituting the control device 17. Further, the control device 17 includes an association recording processing unit (association recording processing means) 18.
【0050】
The association recording processing unit 18 performs the following processing. The voice data input from the microphone 11 is associated with the data object of the application and recorded in the recording device 15. The text data converted from the voice data by the host computer 2 is associated with the data object to which the voice data is associated and recorded in the recording device 15. Further, if necessary, the voice data converted into text data is deleted.
【0051】
In particular, when the association recording processing unit 18 synchronizes the data object recorded in the recording device 15 with the data object recorded in the recording device 55 of the host computer 2, the transmission of voice data and the voice data are transmitted. The converted text data is received, and the audio data of the data object of the recording device 15 is converted into text data and stored.
【0052】
Further, as shown in FIG. 1, the host computer 2 includes a voice / text conversion unit (voice / text conversion means) 51, a speaker 52, a display 53, an input device 54, a recording device (host recording means) 55, and a communication device. It is configured to include (communication means) 56 and a control device 57.
【0053】
The host computer 2 has excellent operability due to a large screen display 53 and an input device 54 including a keyboard, a mouse, and the like, and sufficient computing resources for performing voice recognition.
【0054】
The recording device 55 records master or backup data of data created / edited by the PDA1 application. That is, the data object of the PDA1 application is recorded in synchronization with the recording device 15 and the recording device 55. Further, in the host computer 2, the same application software as the PDA 1 is recorded in the recording device 55 in order to edit the data object. A speaker 52 is provided to reproduce the audio data when editing the data.
【0055】
The control device 57 receives voice data from the PDA1 via the communication device 56, converts the voice data into text data by the voice / text conversion unit 51, and converts the obtained text data into the text data via the communication device 56. Each member is controlled so as to transmit to. Here, the voice / text conversion unit 51 is realized by a voice recognition program that recognizes voice data and converts it into text data.
【0056】
Here, the usage of the PDA1 will be briefly described with reference to FIGS. 4 to 11.
【0057】
The power button 21 is a button for switching the power on / off of the PDA1. Although the microphone 11 and the speaker 12 are provided inside the PDA1, they may be provided in another device and connected to the PDA1. The record button 22 is a button for instructing voice recording.
【0058】
A dedicated stylus (input pen) for selecting handwritten characters and menus should be stored in the stylus slot (not shown) provided on the side of the main unit when not in use. Can be done. The PDA1 also has a built-in power supply (not shown).
【0059】
The PDA1 is equipped with a microphone 11 and can input voice. In addition, PDA1 can input text by the following method. Display the screen keyboard on the display 13 and click a character on the stylus to enter the character. The screen keyboard is activated by pressing a keyboard icon (not shown). Enter handwritten characters with a stylus in the input area 13a, which is a part of the display 13, and recognize the characters. If the handwritten input characters are used, the handwritten characters can be recognized quickly and with high accuracy. Transfer data from another computer using the data synchronization communication function. For example, data can be input on the host computer 2 using a keyboard (input device 54), and the data can be transferred via the communication devices 56 and 16.
【0060】
Communication between the PDA1 and the external computer (host computer 2) can be performed using the infrared communication port or the serial port of the communication device 16. That is, the PDA1 can exchange data between the PDA1s or an external computer by the infrared communication function or the serial communication function. Communication with the Internet is also possible by connecting the communication device 16 to a modem. Data can be referenced and updated from PDA1 or an external computer. Therefore, since it is possible to exchange address book and calendar information, memo pad contents, data downloaded from the Internet, etc., it is possible to import emails and schedules on the server into PDA1 and check them when going out.
【0061】
In particular, when updating data between a desktop external computer such as an office and PDA1, place PDA1 on the installation stand (cradle) (Fig. 2) and press the data synchronization communication button (not shown) for data synchronization communication. With the feature, both data are always kept up to date. This updates the old data to the latest information, so you don't have to enter the same data twice.
【0062】
Various application software is recorded in the recording device 15. Each application software is started by an instruction from a button, an icon, or the like via the input device 14. In PDA1, at least the application software of address book, calendar, memo pad, and to-do list can be used. In addition, PDA1 can also use contact managers, expense trackers, email clients, and project managers.
【0063】
Specifically, the calendar is activated by pressing the calendar icon 24 displayed on the display 13 after pressing the application icon 23, or by pressing the calendar button 25. The calendar includes a daily calendar (Figure 5), a weekly calendar (Figure 6), and a monthly calendar (Figure 7). Each input data to the calendar is stored in association with a specific time and date that can be seen by the user.
【0064】
The address book is activated by pressing the address book icon 26 after the application icon 23, or by pressing the address book button 27. The address book contains an address list (Figure 8) and detailed information about each address (Figure 9).
【0065】
Notepad is activated by pressing the application icon 23 followed by the notepad icon 28 or the notepad button 29. Notepad contains a list of notes entered by the user (Figure 10).
【0066】
The to-do list is activated by pressing the application icon 23 followed by the to-do list icon 30 or the to-do list button 31. A to-do list is a list of items that contain priority, category, and due date (Fig. 11).
【0067】
FIG. 3 is a flowchart showing an outline of the operations of the PDA 1 and the host computer 2 according to the present embodiment.
【0068】
First, in order to use PDA1, the user can use PDA1's data objects (items), such as people in the address book, reservations in the calendar, items in the to-do list, and items in the memo list. Select one or more of (S11).
【0069】
After that, the user starts a voice recording session by pressing the record button 22 and speaking a memo to be attached to the data object to the microphone 14 (S12).
【0070】
PDA1 acquires audio and stores it as an audio sample, preferably in digital format (S13 (audio input step)). At this time, the audio sample is recorded in association with the data object selected in step S11 (S14 (audio data recording step)).
【0071】
The user can listen to the audio sample through the speaker 16 by selecting a specific data object with which the audio sample is associated (S15, S16). When you continue to look at the data object, the item being used or the item associated with the audio sample is displayed. At this point, the PDA1 can play the audio sample upon request, but cannot display the associated textual representation.
【0072】
In this way, associating a voice sample with a data object is a simple data input method that does not require the PDA1 user to input text. That is, the recording and playback of the voice sample can reduce the restrictions on the use of the stylus and the handwriting recognition required by the user for data input to the PDA1. Therefore, in this way, even a user who cannot tolerate the data input characteristics of a handheld data device (PDA) can enjoy the benefits of a PDA more fully.
【0073】
In addition, the PDA1 may lack the ability to interpret speech samples, but the PDA1 can be connected to and synchronized with a host computer (host system) 2 capable of speech recognition.
【0074】
That is, when the user acquires one or more audio samples associated with the data object on the PDA1 (S11 to S14), then connects the PDA1 to the host computer 2 and starts a synchronization session (S11 to S14). S17), the voice sample is transferred from PDA1 to the host computer 2 together with the remaining data (S18 (voice data transmission step)).
【0075】
The host computer 2 processes the voice sample by voice recognition processing by the voice / text conversion unit 51 to create a text expression (S19 (voice / text conversion step)). The user then edits and / or approves this textual representation (S20). Alternatively, the host computer 2 may present the recorded voice to the user by the speaker 52, and manually input the text data representing the voice sample by the keyboard of the input device 54.
【0076】
After that, the host computer 2 synchronizes with PDA1 and transfers the text data to PDA1 (S21 (text data reception step)). When the PDA1 receives the text data, it exchanges it for a voice sample (S22 (text data recording step)). That is, the PDA1 associates the text data with the data object with which the audio data was associated and at the same time erases the audio sample. As a result, text input by such conversion is indistinguishable from conventional text input. Note that text data (text expression) may be added without deleting the voice sample.
【0077】
In this way, the voice sample (memos) acquired in the PDA1 is synchronized with the host computer 2 that interprets the voice data using the voice recognition software. The textual representation of the audio data is then resynchronized with PDA1 to supplement or exchange audio samples.
【0078】
This enables simple data entry and / or speech recognition capabilities and enables conversion of speech samples to textual information. Note that the acquisition and storage of audio samples is a non-computationally intensive task, so the PDA1 does not need to substantially contain more computational resources.
【0079】
In the above PDA1, when the user presses the record button (speech capture key) 22, a separate speech capture / playback application is executed. At this time, the voice acquisition / playback application checks the active application to see if the voice input can be acquired. This is because some states of the main application may not acquire audio.
【0080】
Then, when it is confirmed that voice input is possible, a confirmation sound is emitted from the speaker 12, and then the user inputs voice from the microphone 11. When the voice input by the user is completed and the record button 22 is released, the voice acquisition / playback application returns the acquired voice data tag to the main application having the voice sample playback function. On the display 13, a mark indicating that the audio data can be reproduced is displayed in the field in which the audio data is input.
【0081】
The tags of the voice data acquired by the voice acquisition / playback application are managed by each application. That is, when the voice acquisition / playback application is completed, the voice acquisition / playback application records the voice sample and its tag in the recording device 15, and returns the tag to the application.
【0082】
This allows the application to request playback of the audio sample by referencing and calling the tag. Then, the application enables the synchronization engine of the host computer 2 to associate the voice data with the input data by associating the tag of the voice data with the recorded data item of the PDA1.
【0083】
Here, each item (entry) (appointment, contact info, etc.) of PDA1 is expressed as one object. The object is composed of digitized voice data tags, text data, and a combination thereof. The text data includes those input by the conventional method.
【0084】
Then, the procedure of the processing of synchronization and voice / text conversion via the host computer 2 is as follows. One or more objects on which audio data is recorded are sent from PDA1 to host computer 2 and this object is synchronized with host computer 2 (S18). The host computer 2 updates the synchronized objects using the voice / text-converted text data (S19, S20). Synchronize the updated object with the PDA1 object (S22).
【0085】
In this way, the application only manages the tags attached by the voice acquisition / playback application, and does not directly manage the voice data.
【0086】
The audio acquisition / playback application also records audio data as a linear file. As the simplest structure, a WAV file (Wave format file) or the like can be used. In a more powerful system, for example, a system capable of processing using a DSP (digital signal processor), audio data can be encoded using many general audio data compression algorithms.
【0087】
The main application then manages the physical communication (link) between the PDA1 (organizer like Pilot from 3Com) and the host computer 2 during the synchronization and voice / text conversion processes. At the same time, the main application passes the object to a suitable synchronization "conduit" pre-registered to process the input from the particular application that created the object. That is, each application of PDA1 is called with its own subprogram corresponding to its own data object to process synchronization and voice / text conversion. In addition, when the object contains a tag of digitized voice data in the original processing in the synchronization session, the host computer 2 requests the corresponding voice data by referring to the tag.
【0088】
The terms and expressions used in the present specification are used for explanation and do not limit the present invention in any way. By using such terms and expressions, there is no intention to exclude the equivalent of, or part of, the features described and described above. The scope of the invention should be defined and limited only by claims.
【0089】
For example, portable information devices according to the present invention may include (a) address books, calendars, notepads, to-do lists, contact managers, payment notes, email clients, and projects, all of which contain at least one data item. Includes a display that presents at least one of the managers and (b) an input device that is suitable for retrieving voice data from the user and is operatively connected. It may (c) store the audio data and (d) associate the audio data with at least one of the data items.
【0090】
Further, in the portable information device according to the present invention, the input device may be a microphone.
【0091】
Further, in the portable information device according to the present invention, the input device may be integrally provided with the portable information device.
【0092】
Further, the portable information device according to the present invention includes a converter that converts the voice data into a text representation, and is connected to a host computer that converts the received voice data into a text representation and returns the data. You may.
【0093】
Further, the portable information device according to the present invention may receive the text representation and associate the text representation with at least one of the data items.
【0094】
Further, in the portable information device according to the present invention, the associated text expression may delete the voice data.
【0095】
Further, in the portable information device according to the present invention, the converter may include voice recognition software.
【0096】
Further, in the portable information device according to the present invention, the converter may include a keyboard.
【0097】
Further, the data input method of the portable information device according to the present invention is as follows: (a) Address book, calendar, memo pad, To Do list, contact manager, payment memo, e-mail containing at least one of a plurality of data items. The process of presenting at least one of the client and the project manager, (b) the process of acquiring audio data from the user, and (c) the process of accumulating the audio data in the portable information device. , (D) It may include a step of associating the audio data with at least one of the data items.
【0098】
Further, in the data input method of the portable information device according to the present invention, a microphone may be used for acquiring the voice data.
【0099】
Further, the data input method of the portable information device according to the present invention may include a step of transmitting the voice data to the host computer and a step of converting the voice data into a text expression on the host computer.
【0100】
Further, the data input method of the portable information device according to the present invention may include a step of receiving the text representation and a step of associating the text representation with at least one of the data items.
【0101】
Further, the data input method of the portable information device according to the present invention may include a step in which the associated text representation deletes the voice data.
【0102】
Further, in the data input method of the portable information device according to the present invention, the step of converting voice data into a text expression by the above-mentioned host computer may be performed by voice recognition software.
【0103】
Further, in the data input method of the portable information device according to the present invention, the step of converting the voice data into the text expression by the host computer may include the input step by the keyboard.
【0104】
[Effect of the invention]
As described above, the portable information device of the present invention associates the voice input means, the recording means, and the voice data input from the voice input means with the data object of the application and records the voice data in the recording means. It is a configuration equipped with means.
【0105】
Therefore, the input data to the application can be recorded as voice data. Therefore, it is possible to input data to a handheld portable information device, which lacks computing resources, by voice.
【0106】
This has the effect of eliminating the need for the user to enter text on the portable information device in order to enter data into the application. That is, by recording the voice data, the use of the stylus and the handwriting recognition, which have been conventionally required for text input, become unnecessary, and these restrictions can be alleviated.
【0107】
Therefore, such a simple data input system has the effect that even a user who cannot tolerate the data input characteristics of the handheld portable information device can fully enjoy the advantages of the portable information device.
【0108】
As described above, the portable information device of the present invention further includes a communication means for communicating with a host information system provided with a voice / text conversion means for recognizing voice data and converting it into text data. It is a composition.
【0109】
Therefore, further, it is possible to input text data to the portable information device by using the voice recognition function. That is, there is an effect that text data can be input to a handheld portable information device, which lacks computing resources, by voice input.
【0110】
As described above, the portable information device of the present invention further, the association recording processing means associates the text data converted from the voice data with the data object to which the voice data is associated, and records the text data. It is a configuration to record in the means.
【0111】
Therefore, it is possible to further associate text data with audio data with the data object of the application. Therefore, the user of the portable information device has an effect that the content can be confirmed only by displaying the text data without reproducing the voice data.
【0112】
As described above, the portable information device of the present invention further, the association recording processing means transfers the text data converted from the voice data to the data object to which the voice data is associated. Instead, it is configured to be associated and recorded in the above-mentioned recording means.
【0113】
Therefore, it is possible to further associate text data with the data object of the application instead of voice data. Therefore, the same result as when the user of the portable information device directly inputs the text data can be obtained by the voice input. That is, there is an effect that text data can be input to a handheld portable information device, which lacks computing resources, by voice input.
【0114】
As described above, in the portable information device of the present invention, the communication means further comprises a data object recorded in the recording means and a data object recorded in the host recording means of the host information system. At the time of synchronization, the voice data is transmitted and the text data converted from the voice data is received.
【0115】
Therefore, since the conversion of voice data to text data can be performed in synchronization with other data, there is an effect that it is not necessary to connect a communication link only for voice / text conversion. ..
【0116】
As described above, the data input method of the portable information device of the present invention is the voice data in which the voice input step for inputting voice and the voice data input in the voice input step are associated with the data object of the application and recorded. It is a method that includes a recording step.
【0117】
Therefore, the input data to the application can be recorded as voice data. Therefore, it is possible to input data to a handheld portable information device, which lacks computing resources, by voice.
【0118】
This has the effect of eliminating the need for the user to enter text on the portable information device in order to enter data into the application. That is, by recording the voice data, the use of the stylus and the handwriting recognition, which have been conventionally required for text input, become unnecessary, and these restrictions can be alleviated.
【0119】
Therefore, such a simple data input system has the effect that even a user who cannot tolerate the data input characteristics of the handheld portable information device can fully enjoy the advantages of the portable information device.
【0120】
As described above, the data input method of the portable information device of the present invention further comprises a voice data transmission step of transmitting the voice data to the host information system and voice recognition of the voice data by the host information system. It is a method including a voice / text conversion step of converting into text data and a text data receiving step of receiving the text data from the host information system.
【0121】
Therefore, further, it is possible to input text data to the portable information device by using the voice recognition function. That is, there is an effect that text data can be input to a handheld portable information device, which lacks computing resources, by voice input.
【0122】
As described above, the data input method of the portable information device of the present invention further associates the text data converted from the above-mentioned voice data with the data object to which the voice data is associated instead of the voice data. It is a method that includes a text data recording step of recording.
【0123】
Therefore, it is possible to further associate text data with the data object of the application instead of voice data. Therefore, the same result as when the user of the portable information device directly inputs the text data can be obtained by the voice input. That is, there is an effect that text data can be input to a handheld portable information device, which lacks computing resources, by voice input.
[Simple explanation of drawings]
[Figure 1]
It is a block diagram which shows the outline of the structure of the portable information apparatus (PDA) which concerns on one Embodiment of this invention, and the host computer to which the portable information apparatus is connected.
[Figure 2]
It is explanatory drawing which shows the connection state of a PDA and a host computer shown in FIG.
[Fig. 3]
It is a flowchart explaining the operation of inputting the text data into the PDA shown in FIG.
[Fig. 4]
It is explanatory drawing which shows the appearance of the PDA shown in FIG.
[Fig. 5]
It is explanatory drawing which shows the state which displayed the daily planner on the PDA shown in FIG.
[Fig. 6]
It is explanatory drawing which shows the state which displayed the weekly schedule on the PDA shown in FIG.
[Fig. 7]
It is explanatory drawing which shows the state which the monthly calendar is displayed on the PDA shown in FIG.
[Fig. 8]
It is explanatory drawing which shows the state which the list of addresses is displayed on the PDA shown in FIG.
[Fig. 9]
It is explanatory drawing which shows the state which displayed the detailed information of an address on the PDA shown in FIG.
[Fig. 10]
It is explanatory drawing which shows the state which the list of memos is displayed on the PDA shown in FIG.
[Fig. 11]
It is explanatory drawing which shows the state which the to-do list is displayed on the PDA shown in FIG.
[Explanation of symbols]
1 PDA (Portable Information Device) 2 Host computer (host information system) 11 Microphone (voice input means) 15 Recording device (recording means) 16 Communication device (communication means) 18 Association record processing unit (association record processing means) 51 Voice / text conversion unit (voice / text conversion means) 55 Recording device (host recording means) S13 Voice input step S14 Voice data recording step S18 Voice data transmission step S19 voice / text conversion step S21 Text data reception step S22 Text data recording step
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| JP2002215340A | Cited by | Japan | Examiner |
| US11900372B2 | Cited by | United States of America | Applicant |
| US11360634B1 | Cited by | United States of America | Applicant |
| US10866731B2 | Cited by | United States of America | Applicant |
| US12107985B2 | Cited by | United States of America | Applicant |
| JP2016001871A | Cited by | Japan | Search report |
| US11037150B2 | Cited by | United States of America | Applicant |
| US10466891B2 | Cited by | United States of America | Applicant |
| US11907013B2 | Cited by | United States of America | Applicant |
| US10178234B2 | Cited by | United States of America | Applicant |
| US10877661B2 | Cited by | United States of America | Applicant |
| JP2003219052A | Cited by | Japan | Search report |
| US11921980B2 | Cited by | United States of America | Applicant |
| US11755712B2 | Cited by | United States of America | Applicant |
| US10616416B2 | Cited by | United States of America | Applicant |
| US11782598B2 | Cited by | United States of America | Applicant |
| US11323559B2 | Cited by | United States of America | Applicant |
| US11449188B1 | Cited by | United States of America | Applicant |
| US11256294B2 | Cited by | United States of America | Applicant |
| US11442598B2 | Cited by | United States of America | Applicant |
| US11803299B2 | Cited by | United States of America | Applicant |
| US9847999B2 | Cited by | United States of America | Applicant |
| US10996917B2 | Cited by | United States of America | Applicant |
| US11010121B2 | Cited by | United States of America | Applicant |
| US11281372B2 | Cited by | United States of America | Applicant |
| JP2016001871A | Cited by | Japan | Search report |
| US11539831B2 | Cited by | United States of America | Applicant |
| US11126704B2 | Cited by | United States of America | Applicant |
| US9990129B2 | Cited by | United States of America | Applicant |
| US11412081B2 | Cited by | United States of America | Applicant |
| US11487403B2 | Cited by | United States of America | Applicant |
| US10516997B2 | Cited by | United States of America | Applicant |
| US10749967B2 | Cited by | United States of America | Applicant |
| US10484384B2 | Cited by | United States of America | Applicant |
| US11392291B2 | Cited by | United States of America | Applicant |
| US11755273B2 | Cited by | United States of America | Applicant |
| US10567477B2 | Cited by | United States of America | Applicant |
| US10142835B2 | Cited by | United States of America | Applicant |
| US11928303B2 | Cited by | United States of America | Applicant |
| US11750734B2 | Cited by | United States of America | Applicant |
| US11095766B2 | Cited by | United States of America | Applicant |
| US12112037B2 | Cited by | United States of America | Applicant |
| US10908781B2 | Cited by | United States of America | Applicant |
| JP2017174455A | Cited by | Japan | Search report |
| US10992795B2 | Cited by | United States of America | Applicant |
| JP2017174455A | Cited by | Japan | Search report |
| US11567657B2 | Cited by | United States of America | Applicant |
| JP2016001871A | Cited by | Japan | Examiner |
| US11822761B2 | Cited by | United States of America | Applicant |
| US11431836B2 | Cited by | United States of America | Applicant |
| US11620103B2 | Cited by | United States of America | Applicant |
| US11200309B2 | Cited by | United States of America | Applicant |
| JP2012073739A | Cited by | Japan | Search report |
| US10334054B2 | Cited by | United States of America | Applicant |
| US11206309B2 | Cited by | United States of America | Applicant |
| US11283916B2 | Cited by | United States of America | Applicant |
| US11201961B2 | Cited by | United States of America | Applicant |
| US11907605B2 | Cited by | United States of America | Applicant |
| US10419933B2 | Cited by | United States of America | Applicant |
| US10637986B2 | Cited by | United States of America | Applicant |
| US11683408B2 | Cited by | United States of America | Applicant |
| US10567477B2 | Cited by | United States of America | Applicant |
2 members in 2 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 09212544 | United States of America | – | |
| 21254498 | United States of America | A | |
| 21254498 | United States of America | A | |
| 212544 | – | – | – |
| US19980212544 | – | – | – |
Members2
| Document | Office | Kind | |
|---|---|---|---|
| JP2000200092AThis record | Japan | A | |
| US6178403B1 | United States of America | B1 |
4 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Decision of refusalJAPANESE INTERMEDIATE CODE: A02A02 | A02 | |
| Written amendmentJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 |
Numbers
- Publication
- 2000-200092
- Publication, DOCDB
- 2000200092
- Publication, EPODOC
- JP2000200092
- Application
- 11305631
- Application, DOCDB
- 30563199
- Application, EPODOC
- JP19990305631
Titles2
- Japanese
- 【発明の名称】携帯型情報装置、および携帯型情報装置のデ―タ入力方法
- English
- [Title of the Invention] A portable information device and a data input method for the portable information device.
Classification
- CPC, 1
- G10L15/30
- IPC, 4
- G06F15 02
- G10L15 00
- G10L15 28
- H04M1 02