Electronic mail transmitting device and its related device
Abstract
[Task] E-mail creation workability is eliminated by eliminating the need to incorporate specific symbol strings such as emoticons so that robot-like bodies can perform actions to enrich emotional expression in synchronization with the voice output of the body of the e-mail. Improve and smooth the synchronization operation.
Solution.In the e-mail sending device 1, the operation category assigning unit 13 assigns an operation category to the character string from the mail body storage unit 12 to form an operation category set. The motion control data generation unit 14 generates motion control data having a timetable of the timing of character string audio output and the timing of robot-like motion based on the body of the email and the motion category set, and the transmission unit 16 generates the email. The operation control data is attached to the text of and sent to network 3. In the e-mail receiving device 2, the operation control data recognition unit 23 confirms the attachment of the operation control data, and the control unit 33 synchronously controls the voice output unit 25 and the emotion expression operation unit 26.

Term
Term ended
Projected expiry passed 20 June 2020, 6.3 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
17 claims: 5 independent, 12 dependent
- 1【特許請求の範囲】 【請求項1】 電子メールの本文中の任意の文字列に動作カテゴリを対応付けて動作カテゴリセットを生成する動作カテゴリ付与手段と、前記動作カテゴリセットと前記電子メールの本文に基づいて動作制御データを生成する動作制御データ生成手段と、前記電子メールの本文に前記動作制御データを添付し電子メールとして送信する送信手段とを備えていることを特徴とする電子メール送信装置。
- 2【請求項2】 前記動作制御データ生成手段は、文字列の出力のタイミングと動作のタイミングとを対応付けたタイムテーブルを含む動作制御データを生成するものとして構成されていることを特徴とする請求項1に記載の電子メール送信装置。
- 3【請求項3】 前記動作カテゴリ付与手段は、前記動作カテゴリを入力するための動作カテゴリ入力手段を備えたものとして構成されていることを特徴とする請求項1または請求項2に記載の電子メール送信装置。
- 4【請求項4】 前記動作カテゴリ付与手段は、前記文字列に基づいて前記動作カテゴリを自動的に生成する動作カテゴリ生成手段を備えたものとして構成されていることを特徴とする請求項1または請求項2に記載の電子メール送信装置。
- 5【請求項5】 前記動作カテゴリ付与手段は、さらに、前記動作カテゴリ生成手段による動作カテゴリを提示する動作カテゴリ提示手段と、提示された動作カテゴリの修正を行う動作カテゴリ修正手段とを備えたものとして構成されていることを特徴とする請求項4に記載の電子メール送信装置。
- 6【請求項6】 前記電子メールの本文をユーザー入力するためのメール本文入力手段と、入力された電子メールの本文を格納するメール本文格納手段とを備え、前記動作カテゴリ付与手段、動作制御データ生成手段および送信手段はそれぞれ前記メール本文格納手段から前記電子メールの本文を読み出すように構成されていることを特徴とする請求項1から請求項5までのいずれかに記載の電子メール送信装置。
- 7【請求項7】 前記動作制御データがロボット様体の動作制御にかかわるものである請求項1から請求項6までのいずれかに記載の電子メール送信装置。
- 8【請求項8】 前記文字列が記号、文字、単語、文節、文のうちから任意に選択された1つまたは複数のものである請求項1から請求項7までのいずれかに記載の電子メール送信装置。
- 9【請求項9】 電子メールの受信手段と、受信した電子メールの本文を音声データに変換する音声合成手段と、前記音声データを出力する音声出力手段と、感情表現のための動作を行わせる感情表現動作手段と、前記感情表現動作手段を駆動する駆動手段と、前記受信手段により受信した電子メールの本文に添付されている動作制御データに基づいて前記音声出力手段と前記駆動手段を同期的に制御する制御手段とを備えていることを特徴とする電子メール受信装置。
- 10【請求項10】 前記電子メールの本文に添付されている動作制御データは、前記電子メールの本文中の文字列とこの文字列に対応付けられた動作カテゴリからなる動作カテゴリセットおよび前記電子メールの本文に基づいて、前記文字列に基づく音声データの出力のタイミングと前記感情表現動作手段の動作のタイミングとを対応付ける状態に生成されたものである請求項9に記載の電子メール受信装置。
- 11【請求項11】 前記文字列が記号、文字、単語、文節、文のうちから任意に選択された1つまたは複数のものである請求項10に記載の電子メール受信装置。
- 12【請求項12】 前記感情表現動作手段がロボット様体に構成されている請求項9から請求項11までのいずれかに記載の電子メール受信装置。
- 13【請求項13】 前記音声合成手段は備えておらず、前記音声出力手段に代えて、前記受信手段が受信した電子メールの本文を表示する文字表示手段を備えていることを特徴とする請求項9から請求項12までのいずれかに記載の電子メール受信装置。
- 14【請求項14】 前記請求項1から請求項8までのいずれかに記載の電子メール送信装置と、前記請求項9から請求項13までのいずれかに記載の電子メール受信装置とがネットワークを介して接続されていることを特徴とする電子メール送受信システム。
- 15【請求項15】 前記請求項1から請求項8までのいずれかに記載の電子メール送信装置の機能と、前記請求項9から請求項13までのいずれかに記載の電子メール受信装置の機能とを併せ有するものとして構成されていることを特徴とする電子メール送受信装置。
- 16【請求項16】 前記電子メールに代えて、ネットワークを介することなく、文字メッセージを送信するものであって、「電子メール」を「文字メッセージ」に置き換えて記述したものとして構成されていることを特徴とする請求項1から請求項8までのいずれかに記載のメッセージ送信装置。
- 17【請求項17】 文字メッセージの入力手段と、入力した文字メッセージを音声データに変換する音声合成手段と、前記音声データを出力する音声出力手段と、感情表現のための動作を行わせる感情表現動作手段と、前記感情表現動作手段を駆動する駆動手段と、前記入力手段により入力した文字メッセージに添付されている動作制御データに基づいて前記音声出力手段と前記駆動手段を同期的に制御する制御手段とを備えていることを特徴とするメッセージ表現装置。
Independent claims17
219 paragraphs in 1 section, as filed
Description: TECHNICAL FIELD [Detailed description of the invention]
【0001】
[Technical field to which the invention belongs]
The present invention relates to an e-mail transmission device for transmitting an e-mail via a network, and a message expression device for expressing a character message recorded in a device related thereto by voice output or character display.
【0002】
[Conventional technology]
Some conventional e-mail receiving devices have a function of reading out e-mail by voice by synthesizing the text of the received e-mail into voice data and then outputting the voice from a speaker.
【0003】
On the other hand, in recent e-mails, in order to convey the sender's emotions that are difficult to express in sentences, symbols called emoticons (face marks) such as \ ("o") /, which means hurray, are used in the sentences. Some have columns built in. When such an e-mail is read aloud, the user cannot understand the meaning even if the symbol string such as an emoticon is read aloud as it is. Therefore, such a symbol string is usually processed so as to be skipped when reading aloud. Therefore, when such an e-mail is read aloud, the emotion of the sender expressed by the symbol string such as an emoticon cannot be correctly conveyed to the receiver.
【0004】
Therefore, for example, an e-mail receiving device that conveys the sender's emotions to the recipient by using an animal-type robot and operating the robot's limbs or the like based on a specific symbol string such as an emoticon included in the e-mail. , JP-A-11-327872, "E-mail presentation method and storage medium containing an e-mail terminal and an e-mail presentation program".
【0005】
FIG. 6 shows a configuration diagram of a conventional e-mail receiving device having the same concept as this publication. In FIG. 6, reference numeral 61 is a receiving unit, which receives an e-mail via a network. Reference numeral 62 denotes a mail body analysis unit, which analyzes the body of the received e-mail and associates the robot's operation with a specific symbol string such as an emoticon included in the body of the e-mail. Specifically, the mail body analysis unit 62 is configured to determine the type of robot operation corresponding to a specific symbol string and calculate the occurrence timing of the operation. Reference numeral 63 denotes a reading unit, which reads aloud the body of the e-mail received based on the operation occurrence timing obtained by the mail body analysis unit 62. Reference numeral 64 denotes a drive unit, which operates a movable unit 65 (hands, feet, etc.) of the e-mail receiving device in the shape of an animal robot based on the operation occurrence timing obtained from the mail body analysis unit 62. Reference numeral 66 denotes a control unit, which controls the operations of the reading unit 63 and the driving unit 64.
【0006】
The operation of the conventional e-mail receiving device configured as described above will be described below.
【0007】
The receiving unit 61 receives the e-mail via the network. The mail body analysis unit 62 analyzes the body of the e-mail received from the receiving unit 61, calculates the timing of the operation occurrence by a specific symbol string such as an emoticon included in the body of the e-mail, and outputs it to the control unit 66. To do. It takes a relatively long time to calculate this timing. The control unit 66 outputs a control signal for controlling the reading unit 63 and the driving unit 64 based on the operation occurrence timing obtained from the mail body analysis unit 62. The reading unit 63 reads out the text of the e-mail in response to the control signal from the control unit 66. At the same time, the drive unit 64 also operates the e-mail receiving device, that is, the movable unit 65 of the robot, in response to the control signal from the control unit 66.
【0008】
For example, in the body of an email ~ What is it? \ ("o") / If the description is included, the mail body analysis means 62 is a symbol string. \ ("O") / Is analyzed, and after the reading unit 63 finishes reading "~ what.", A few seconds later, the robot generates an action to raise both hands (moving part 65). Furthermore, the reading unit 63 calculates the timing when it finishes reading "~ what.", And controls the timetable that controls the operations of the reading unit 63 and the driving unit 64 so that the robot raises both hands at that time. Output to unit 66. The control unit 66 controls the reading unit 63 and the driving unit 64 so that the driving unit 64 raises both hands of the robot a few seconds after the reading unit 63 finishes reading "~ what." According to the timetable.
【0009】
[Problems to be Solved by the Invention]
However, in the above configuration, the mail body analysis unit 62 always checks whether the character string included in the body of the received e-mail is a specific symbol string associated with the operation of the robot. Since it is necessary, a lot of processing time was required to analyze the email body.
【0010】
On the other hand, in order to express the various emotions of the sender, it is necessary to increase the types of robot movements, but in the conventional example, it is necessary to increase the types of specific symbol strings accordingly. However, as the number of types of robot movements increases, the types of specific symbol strings to be collated also increase, so more processing time is required to analyze the body of the received e-mail, and processing cannot be performed in real time. There was a problem.
【0011】
Further, in the conventional example, the moving part of the robot reacts only to a specific symbol string included in the body of the e-mail. In other words, in order for the moving part of the receiving robot to operate as intended by the sender of the email, the sender needs to incorporate a specific symbol string such as an emoticon in the body of the email, which is usually the case. There is also the problem that it is difficult for users who are not accustomed to using such a symbol string to compose such an e-mail.
【0012】
The present invention has been created in order to solve the above-mentioned problems, and in an e-mail transmission device configured to transmit information on actions for enriching emotional expression together with the text, the text of the e-mail. Eliminates the need to incorporate specific symbol strings such as emoticons that are unfamiliar and difficult to understand, and even users who are not accustomed to using specific symbol strings such as emoticons can express emotions such as robot-like bodies on the receiving side. It is an object of the present invention to provide an e-mail transmission device capable of efficiently performing an e-mail creation work for operating an operating means.
【0013】
Further, according to the present invention, the received e-mail is read aloud at the same time, and at the same time, an emotion expression operation means such as a robot-like body is operated according to the contents of the e-mail to present the contents of the e-mail in a rich emotional expression. In a mail receiving device, time-consuming processing such as constant collation of the presence or absence of a specific symbol string in a received character string, interpretation of the operation meaning of the specific symbol string, calculation of operation timing, etc. as in the case of the prior art. Providing an e-mail receiver that can smoothly transmit messages with rich emotional expressions by quickly driving emotional expression operation means synchronized with voice output as expected. The purpose is to do.
【0014】
[Means for solving problems]
In order to solve the above-mentioned problems of the prior art, the present invention breaks away from transmitting a message using a specific symbol string such as an emoticon, and uses a character string included in the body of an e-mail. We propose a new method of attaching motion control data. An e-mail sending device and an e-mail receiving device are configured to exchange e-mails in the form of attaching operation control data to such a character string.
【0015】
The motion control data is pre-constructed as having a different origin from the body of the e-mail dedicated to message transmission. Specific symbol strings such as emoticons used in the conventional technology are included in the set of characters and symbols for message transmission in advance, and the body of the e-mail and the specific symbol string are the origins. Is the same. The operation control data is not a message, but data dedicated to controlling the control. Its data structure is clearly different from the data structure of the body of the email. This is the fundamental difference between the present invention and the prior art.
【0016】
Therefore, as the receiving side e-mail receiving device in the present invention, the character string included in the body of the e-mail is associated with the operation of the emotion expression operating means such as a robot-like body as in the case of the conventional technique. It is not necessary to constantly collate whether or not it is a specific symbol string such as a face character, and an analysis based on the specific symbol string obtained as a result of the collation is performed to express emotions. E-mail without the need to generate control signals for which parts should be moved or to calculate when to start and end operations according to what a particular string means. The emotional expression motion means may be directly controlled by the motion control data as the dedicated data for controlling the motion attached to the text of.
【0017】
In the e-mail transmitting device on the transmitting side, this is not required for the troublesome input operation of a specific symbol string such as an emoticon which is a combination of a plurality of symbols.
【0018】
The sending e-mail transmitting device according to the present invention provides an operation category assigning means and associates an operation category with an arbitrary character string (a character string of a part for which emotional expression is desired to be enriched) in the body of an e-mail. , The combination of the character string and the operation category is used as the operation category set.
【0019】
What this made operating category set, for example, combinations and of the behavior categories and the character string "I am happy", "joy", and the combination of the operations categories and the character string "I'm sorry", "sadness", "Hello There is a combination of the character string "" and the action category "daytime greeting", and a combination of the character string "goodbye" and the action category "farewell greeting".
【0020】
Alternatively, for example, a combination of the character string "I'm sorry" and the action category "head / lower", a combination of the character string "Haragatachimasu" and the action category "eyes / lifting", or "surprise". It is a combination of the character string "ta" and the operation category "eyes / opening / closing / mouth / opening".
【0021】
Further, in the e-mail transmission device, an operation control data generation means is provided to generate operation control data based on the above-mentioned operation category set and the text of the e-mail. Then, in the transmitting means, the operation control data is attached to the body of the e-mail and transmitted as an e-mail.
【0022】
As for the form of the motion control data, for example, when the motion category combined with the character string "I'm sorry" is "Apology", the motion is downward as a control code for the head of the robot-like body as an emotion expression motion means. It has a control code for specifying the operation part and operation form, and as a synchronization control between the character string and the operation, the head downward operation is synchronized with the start / end timing of the voice output of the character string "I'm sorry". It has a timing management control code that defines the start / end timing. In general, the control code of which part of the emotional expression action means is designated as the control target, the control code of how to operate the action part, and the corresponding character of such an action of the action part. It suffices to have a control code of how to synchronize with the timing of the audio output of the column.
【0023】
As described above, the motion control data generated in this way has a basically different origin from the body of the e-mail dedicated to message transmission in its code form, and controls the motion of the emotional expression motion means. The data is dedicated to the control and is independent of the body of the e-mail.
【0024】
The operation control data generated in the e-mail transmission device on the transmitting side is described in the above-mentioned example. joy", "sadness", "greeting", "parting", "head / lowering", "eye / lifting" , "Eyes, open / close, mouth, open", etc., emoticons in the case of conventional technology, \ ("o") / Compared to, it is a very straightforward description (expression). In other words, it is a common sense level description that anyone can immediately understand. Furthermore, the emoticons \ ("o") / Is a combination of letters and symbols \ ("O") / It is a list of the seven symbols of, but there is a circumstance that the general understanding is not well known as to what kind of emotional expression such a specific symbol string corresponds to.
【0025】
On the other hand, "joy", "head / lowering", etc. can be directly recognized by anyone with ordinary knowledge.
【0026】
Therefore, in the e-mail transmission device, the generation of the operation category that is the basis of the operation control data is very easy to understand.
【0027】
Moreover, in a straightforward description as in the case of the present invention, a huge number of types have already been accumulated historically. If you are Japanese, it is built as a well-known one in the common language system of Japanese people, and its knowledge is widely spread. The recognition of emoticons and the like is extremely low, and in comparison, the above-mentioned straightforward description has extremely high recognition. As the number of types of emotional expressions increases, it is quite troublesome to create a new specific symbol string such as an emoticon, and it takes a considerable amount of time to make it known. In the case of the action category method with straightforward description, such a problem is thin and it is very easy to deal with a great many kinds of emotional expressions. Since it is a response at the level of common sense, it does not take much time to make it known.
【0028】
In addition, the motion control data is created automatically, and the created motion control data is automatically attached to the body of the e-mail and sent. Therefore, the emoticons and the like can be specified in the body of the e-mail itself. There is no need to include the symbol string of. That is, the work itself of creating the body of the e-mail is speeded up and facilitated.
【0029】
Further, the receiving e-mail receiving device according to the present invention receives the operation control data attached to the body of the e-mail together with the body of the e-mail in receiving the e-mail, and the operation control data is the operation in the emotion expression operation means. It is a code form that directly controls the operation of the part in synchronization with the audio output of the character string, and constantly collates the presence or absence of a specific symbol string in the received character string as in the case of the conventional technology. There is no need for time-consuming processing such as recognizing the operation meaning of a specific symbol string and calculating the operation timing. Therefore, the emotional expression operation means can be quickly driven and controlled as desired, and a message with rich emotional expression can be smoothly transmitted.
【0030】
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in a comprehensive manner.
【0031】
The e-mail transmission device of the first invention of the present application includes an operation category assigning means for generating an operation category set by associating an operation category with an arbitrary character string in the body of an e-mail, and the operation category set and the e-mail. It is characterized by including an operation control data generation means for generating operation control data based on the text, and a transmission means for attaching the operation control data to the text of the e-mail and transmitting it as an e-mail.
【0032】
The configuration of the first invention corresponds to the description of the e-mail transmitting device in the above-mentioned [Means for Solving the Problem] in another expression form, and the operation thereof is also described above. It is substantially the same as that described in the section [Means for Solving Problems]. That is, the motion control data generated by associating the motion category with the character string of the part for which the emotional expression is desired to be enriched is attached to the body of the e-mail that conveys the message. This operation control data can be composed of a separate and independent control-dedicated code having a different system from the character string in the body of the e-mail. Therefore, as the operation category associated with the character string, it is possible to adopt a straightforward and easy-to-understand one having a different origin from the set of characters / symbols to which the character string belongs. It has a relatively high degree of recognition, and it is easy to publicize new products. As a result, there is no need to incorporate a specific symbol string such as an emoticon that is difficult to understand when creating the body of an e-mail, and even a user who is not accustomed to using a specific symbol string such as an emoticon can use the robot-like body on the receiving side. It is possible to easily create an e-mail capable of operating the emotional expression operation means of the above, and it is possible to promote the efficiency of the e-mail creation work.
【0033】
In the first invention described above, the e-mail transmission device of the second invention of the present application is that the operation control data generation means includes operation control data including a time table in which the output timing of a character string and the operation timing are associated with each other. Is configured to generate.
【0034】
The action of this second invention is as follows. On the receiving side, it is a problem of how to construct motion control data that controls the motion of emotional expression motion means such as a robot-like body in relation to the voice output of a character string. Compared to generating operation control data after interpreting a specific symbol string extracted from a character string and calculating the timing as in the conventional technology, the operation is performed in the e-mail transmission device on the transmitting side in advance. If the control data is constructed as a timetable in which the output timing of the character string and the operation timing are associated with each other, it is possible to reduce the processing load on the receiving e-mail receiving device. ..
【0035】
In the first and second inventions described above, the e-mail transmission device of the third invention of the present application is configured such that the operation category assigning means includes an operation category input means for inputting the operation category. It is that there is.
【0036】
In the first and second inventions described above, the e-mail transmission device of the fourth aspect of the present application is the operation category generating means for automatically generating the operation category based on the character string. It is configured as a provision.
【0037】
The third invention describes that the operation category is input manually by the user. The fourth invention describes that the operation category is automatically generated. According to the fourth invention of the latter, an appropriate action category to be associated with the character string of the part for which the emotional expression is desired to be enriched is automatically generated based on the character string, so that the user can compare with the case of manual input. It is possible to reduce the burden on the user. However, as in the third invention, the basic operation / effect of the present invention can be achieved even by manually inputting the operation category by the user.
【0038】
In the fourth invention, in which the e-mail transmission device of the fifth invention of the present application automatically generates the above operation category, the operation category assigning means further presents the operation category generated from the operation category generating means. It is configured to include an operation category presenting means and an operation category modifying means for modifying the presented operation category.
【0039】
The action of this fifth invention is as follows. Generating an action category based on the character string of the part where you want to enrich the emotional expression is automatically generated, so it is sometimes different from the emotional expression intended by the user. turn into. Therefore, if the motion control data based on the automatically generated motion category is transmitted as it is without any check, the sender's intention is the motion performed by the emotion expression motion means such as the robot-like body on the receiving side. It will be a different expression. Therefore, before sending, the automatically generated action category is presented to the user and checked, and if it is not the action category intended by the user, the modification (deletion, addition, change, etc.) is allowed. It was decided. This makes it possible to create an e-mail with an emotional expression in a state that accurately matches the emotional expression intended by the user.
【0040】
The e-mail sending device of the sixth invention of the present application stores the e-mail body input means for user inputting the body of the e-mail and the body of the input e-mail in the first to fifth inventions described above. The mail body storage means is provided, and the operation category assigning means, the action control data generation means, and the transmission means are configured to read the body of the e-mail from the mail body storage means, respectively.
【0041】
This sixth invention describes the origin of the body of the email to be sent. The e-mail sending device itself can create the body of the e-mail. If you have the ability to compose e-mail, you can enjoy its convenience. In inventions other than the sixth invention, it is not always necessary to have an e-mail creation function.
【0042】
In the e-mail transmission device of the seventh invention of the present application, in the first to sixth inventions described above, the motion control data is related to the motion control of the robot-like body. That is, the robot-like body is specified as an emotional expression motion means on the receiving side as an object for which the motion control data is used. Emotional expression as a medium for expressing the movement when transmitting the sender's message to the other party with rich emotional expression As a means of emotional expression, other than voice expression such as robot-like body, animation, object composite image in MPEG-4, etc. Anything can be used as long as it is used, but here, as a means of expressing emotions, a robot-like body having a very rich emotional expression is specified.
【0043】
However, as robot-like bodies, in addition to general robot-like bodies such as humanoid robot-like bodies, doll-shaped robot-like bodies, animal-type robot-like bodies, and plant-type robot-like bodies, any form such as musical instruments and automobiles can be used. It may be an object-type robot-like body.
【0044】
The e-mail transmission device of the eighth invention of the present application is one or more of the above-mentioned first to seventh inventions in which the character string is arbitrarily selected from symbols, characters, words, phrases, and sentences. It is said that. Although letters and words have already been illustrated, symbols are used to express emotions in association with, for example, "!" (Exclamation mark) or "?" (Question mark). If it has advanced functions, it is possible to associate operation categories on a phrase-by-phrase or sentence-by-sentence basis.
【0045】
The ninth to thirteenth inventions of the present application relate to an e-mail receiving device.
【0046】
The e-mail receiving device of the ninth invention of the present application includes an e-mail receiving means, a voice synthesizing means for converting the text of the received e-mail into voice data, a voice output means for outputting the voice data, and emotional expression. The voice expression operation means for performing the operation for the purpose, the drive means for driving the emotion expression operation means, and the voice output means based on the operation control data attached to the body of the e-mail received by the reception means. It is characterized in that it includes a control means for synchronously controlling the drive means.
【0047】
The action of this ninth invention is as follows. When the operation control data is attached to the body of the e-mail received by the receiving means, the control means controls the voice output means in synchronization with the driving means, and the body of the e-mail output from the voice output means. In the output of the voice of, the emotional expression action means is performed via the driving means at the timing when the character string of the part for which the emotional expression is desired to be enriched is output, and the emotional expression associated with the character string is output. Let the action take place. Therefore, the emotional expression that the sender wants to accompany the character string can be performed well and quickly in a state where the timing is adjusted to the voice output of the character string having the message that the sender wants to convey to the receiver.
【0048】
Here, the motion control data for controlling the motion of the emotion expression motion means and controlling the motion of the voice output means in synchronization with the control of the motion is in a code form for directly controlling each of them, and is a conventional code form. There is no need for time-consuming processing such as constant collation of the presence or absence of a specific symbol string in the received character string, interpretation of the operation meaning of the specific symbol string, and calculation of the operation timing as in the case of technology. Therefore, it is possible to quickly drive and control the emotional expression operation means synchronized with the voice output as desired, and it is possible to smoothly transmit a message with rich emotional expression in an e-mail that is difficult to convey only by sentences. Can be done.
【0049】
In the e-mail receiving device of the tenth invention of the present application, the operation control data attached to the body of the e-mail is an operation consisting of a character string in the body of the e-mail and an operation category associated with the character string. Based on the category set and the body of the e-mail, it is generated in a state of associating the output timing of the voice data based on the character string with the operation timing of the emotion expression operation means. .. This describes the form of the motion control data at a more specific level, and corresponds to the second invention of the above-mentioned e-mail transmission device.
【0050】
According to the tenth invention, the emotional expression operation means is moved in a timely manner in synchronization with the voice output of the character string of the part for which the emotional expression is desired to be enriched, and the output voice of the message to be transmitted. Emotions can be expressed as rich.
【0051】
In the e-mail receiving device of the eleventh invention of the present application, the character string is one or more arbitrarily selected from symbols, characters, words, phrases, and sentences. This corresponds to the eighth invention of the e-mail transmitting device.
【0052】
In the e-mail receiving device of the twelfth invention of the present application, the emotion expression operating means is configured in a robot-like body. This corresponds to the seventh invention of the e-mail transmitting device.
【0053】
In the ninth to twelfth inventions described above, the e-mail receiving device of the thirteenth invention of the present application does not include the voice synthesis means, and instead of the voice output means, the e-mail receiving means receives the e-mail. It is equipped with a character display means for displaying the text.
【0054】
The action of this thirteenth invention is as follows. In order to reproduce the message, it is not always necessary to output the message by voice, and the message may be displayed as the original characters of the e-mail in the character display means. In this case, the control means synchronously controls the driving means of the emotion expression action means and the character display means. Message transmission in character display has elements that make it more difficult to convey emotions than message transmission in voice output, but even so, there is support for emotional expression operation means such as robot-like bodies, so the recipient is made to read the displayed characters. Even in the mode, it is possible to convey a message with a considerably rich emotional expression.
【0055】
Needless to say, in addition to the voice synthesis means and the voice output means, the character display means may also be provided.
【0056】
The 14th invention of the present application relates to an e-mail transmission / reception system, and the e-mail transmission device of the 1st to 8th inventions described above and the e-mail receiving device of the 9th to 13th inventions described above are used. It is characterized by being connected via a network.
【0057】
The fifteenth invention of the present application relates to an e-mail transmitting / receiving device, and has the functions of the e-mail transmitting devices of the first to eighth inventions described above and the e-mail receiving devices of the ninth to thirteenth inventions described above. It is characterized in that it is configured to have both the functions of.
【0058】
The sixteenth invention of the present application relates to an e-mail transmitting device, and in the first to eighth inventions described above, instead of the e-mail, a character message is transmitted without going through a network. Therefore, it is configured as a description in which "e-mail" is replaced with "text message".
【0059】
The text message in this case is assumed to be stored in a recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, or a semiconductor memory, and the message is transmitted by exchanging such a recording medium, that is, without going through a network. At that time, the message can be made in a state rich in emotional expression.
【0060】
The seventeenth invention of the present application relates to a message expression device, and includes a character message input means, a voice synthesis means for converting the input character message into voice data, a voice output means for outputting the voice data, and emotions. An emotional expression operating means for performing an operation for expression, a driving means for driving the emotional expression operating means, and the voice output means based on operation control data attached to a character message input by the input means. It is characterized in that it includes a control means for synchronously controlling the drive means.
【0061】
The action of this 17th invention is as follows. Message transmission is not always just over the network. Even a stand-alone information processing device may require message transmission to another person. In addition to transmitting messages to other people, there are also cases where memorandums or healing expressions are used for oneself. It is possible to respond well to such requests.
【0062】
(Specific Embodiment) Hereinafter, a specific embodiment of the present invention will be described in detail with reference to the drawings.
【0063】
FIG. 1 is a block diagram showing a configuration of an e-mail transmitting device, an e-mail receiving device, and an e-mail transmitting / receiving system according to an embodiment of the present invention. Further, FIG. 2 shows the external shape of the e-mail receiving device configured as a robot-like body in the present invention.
【0064】
In FIG. 1, reference numeral 1 denotes an e-mail transmitting device, which transmits an e-mail created by a sender via a network 3. Reference numeral 2 denotes an e-mail receiving device, which receives an e-mail via the network 3 and presents the e-mail to the recipient. In addition, as shown in Fig. 2, the shape of the e-mail receiving device 2 is that of a humanoid robot, and this robot-like body moves six elements: right hand, left hand, neck, eyes, ears, and mouth. It shall be equipped with a speaker or the like capable of outputting audio. The robot-like body shown in FIG. 2 is an example showing a shape, and the appearance configuration is arbitrary. In order to enrich emotional expression, it is desirable to have a mechanism with more joints. Reference numeral 3 denotes a network such as the Internet or an intranet, which communicates e-mail between the e-mail sending device 1 and the e-mail receiving device 2.
【0065】
In the e-mail sending device 1, reference numeral 11 denotes a mail body input unit, in which the body of the e-mail is input by the sender. Reference numeral 12 denotes a mail body storage unit, which stores the body of the e-mail input in the mail body input unit 11. Reference numeral 13 denotes an operation category assigning unit, which associates the operation category with each character string included in the body of the e-mail stored in the mail body storage unit 12. A character string and an operation category associated with the character string are called an operation category set. Reference numeral 14 denotes an operation control data generation unit, which uses the body of the e-mail stored in the mail body storage unit 12 and the operation category set obtained from the operation category assignment unit 13 to control the operation data for the robot-like body. Is to generate. Reference numeral 15 denotes an operation control data storage unit, which stores the operation control data generated by the operation control data generation unit 14. Reference numeral 16 denotes a transmission unit, which is an e-mail in which the operation control data stored in the operation control data storage unit 15 is attached as an attachment to the body of the e-mail stored in the mail body storage unit 12, and the network 3 is connected. It is transmitted to the e-mail receiving device 2 via the e-mail receiving device 2.
【0066】
The operation category assigning unit 13 shown in FIG. 1 is configured as a manual input type by the user. In FIG. 1, reference numeral 17 is an operation category input unit, and the sender inputs an operation category corresponding to each character string included in the body of the e-mail stored in the mail body storage unit 12. is there. Reference numeral 18 denotes an operation category set storage unit, which stores the operation category set obtained from the operation category input unit 17.
【0067】
In the e-mail receiving device 2, reference numeral 21 denotes a receiving unit, which receives the e-mail transmitted from the e-mail transmitting device 1 via the network 3. Reference numeral 22 denotes an e-mail storage unit, which stores the e-mail received from the reception unit 21. Reference numeral 23 denotes an operation control data recognition unit, which determines whether or not the operation control data for the robot-like body is attached to the e-mail arriving at the e-mail storage unit 22. Reference numeral 24 denotes a voice synthesis unit, which converts the text of the e-mail stored in the e-mail storage unit 22 into voice data. Reference numeral 25 denotes a voice output unit, which outputs voice data obtained from the voice synthesis unit 24. Reference numeral 26 denotes an emotional expression movement part, which has a total of six moving parts of the robot-like body shown in FIG. 2, including the left hand, right hand, neck, eyes, ears, and mouth. The voice output unit 25 is mounted as a speaker behind the mouth portion of the robot-like body. 27 to 32 are driving units, which drive each of the six moving units included in the emotional expression motion unit 26. Reference numeral 33 denotes a control unit, which is based on the operation control data attached to the body of the e-mail stored in the e-mail storage unit 22 when the operation control data recognition unit 23 detects the attachment of the operation control data. , The operations of the audio output unit 25 and the drive units 27 to 32 are controlled in synchronization.
【0068】
Regarding the e-mail transmitting device 1 and the e-mail receiving device 2 of the present embodiment configured as described above, first, the e-mail transmitting device 1 creates an e-mail for operating the robot-like body on the receiving side. , The operation of transmitting to the e-mail receiving device 2 will be described below.
【0069】
In the e-mail sending device 1, the sender first inputs the body of the e-mail (header information and the transmitted message) from the mail body input unit 11. Here, the header information is, as shown in FIG. 3, the destination name [To:], the mail sender name [From:], the title [Subject:], the carbon copy [Cc:], and the blind carbon copy. [Bcc:], Attached [Attached:] shall be indicated, and the sent message shall indicate the content of the e-mail created by the sender. Figure 3 shows an example of the body of an email entered by the sender. The body of the e-mail completed by the sender is stored in the mail body storage unit 12.
【0070】
Next, the sender manually inputs the operation category corresponding to each character string included in the body of the e-mail stored in the mail body storage unit 12 from the operation category input unit 17.
【0071】
Here, the character string included in the body of the e-mail refers to a symbol, a character, a word, a phrase, or a sentence constituting the body of the e-mail. The motion category indicates the type of motion to be performed by the robot-like body on the receiving side. For example, emotions such as joy, sadness, fear, disgust, anger, and surprise, greetings, gratitude, apology, and request. , Consent, refusal, etc.
【0072】
Figure 4 shows an example of assigning action categories to the body of the email shown in Figure 3. In Figure 4, for example, "Hello." The sentence is granted the operating category of "day of greeting", in the phrase of "I'm sorry Did." Operation category of "apology" has been granted.
【0073】
When the sender finishes inputting the action category for all the character strings that the receiving robot wants to perform the action, the action category set (the character string and the action category associated with the character string). ) Is stored in the operation category set storage unit 18.
【0074】
Next, the operation control data generation unit 14 generates operation control data for the robot-like body using the body of the e-mail stored in the mail body storage unit 12 and the operation category set stored in the operation category set storage unit 18. Then, the generated operation control data is stored in the operation control data storage unit 15.
【0075】
Here, the motion control data is data that controls the motion of the robot-like body on the receiving side. Specifically, moving parts such as the left hand, right hand, neck, eyes, ears, and mouth corresponding to the timing at which the voice output unit 25 in the e-mail receiving device 2 starts / ends the voice data output and the drive units 27 to 32 correspond. This is a timetable in which the start / end timings of driving are described in a state in which they correspond to each other.
【0076】
For example, the operation category set, - if it is a combination of [ "Hello." "Greeting"], while output a voice as "Hello" to the robot-like body of the receiving side, the operation category of "greeting" operation (for example, moving the mouth, in order to carry out the right hand Raised etc.), the operation control data, the timing of the sound output unit 25 outputs the start / end the voice data "Hello", in synchronization, corresponding to the right hand and mouth The timing of starting / ending driving of the driving units 28 and 32 to be driven is described.
【0077】
The transmission unit 16 in the e-mail transmission device 1 first adds the file name of the operation control data to the attached [Attached:] of the mail header information included in the mail body stored in the mail body storage unit 12. Create an email header based on this email header information. The created mail header is added to the head part of the sent message stored in the mail body storage unit 12. Next, the operation control data stored in the operation control data storage unit 15 is attached as an attached document to the transmitted message to which the mail header is added, and this is used as the transmission e-mail as the transmission e-mail, and the e-mail receiving device 2 via the network 3 Send to.
【0078】
Next, the e-mail receiving device 2 for receiving the e-mail to which the operation control data transmitted from the e-mail transmitting device 1 is attached will be described below.
【0079】
In the e-mail receiving device 2, first, the receiving unit 21 receives the e-mail via the network, and the e-mail storage unit 22 stores the received e-mail.
【0080】
Next, the operation control data recognition unit 23 determines whether or not the operation control data is attached to the received e-mail based on the mail header of the e-mail stored in the e-mail storage unit 22, and attaches the operation control data to the e-mail. When it is determined that the motion control data is attached, a recognition signal indicating that the motion control data is attached is output to the voice synthesis unit 24 and the control unit 33.
【0081】
When the recognition signal is input from the operation control data recognition unit 23, the voice synthesis unit 24 removes the operation control data part from the e-mail stored in the e-mail storage unit 22 and extracts only the text, and the electronic By synthesizing the body of the mail by voice, the body of the e-mail is converted into voice data, and the voice data is output to the voice output unit 25.
【0082】
When the recognition signal is input from the operation control data recognition unit 23, the control unit 33 receives the voice output unit 25 based on the operation control data attached to the body of the e-mail stored in the e-mail storage unit 22. And controls the drive units 27 to 32. As described above, the motion control data includes the timing of starting / ending the output of the voice data obtained from the speech synthesis unit 24, and the left hand, right hand, neck, eyes, ears, mouth, etc. constituting the emotion expression motion unit 26. It is a timetable that describes the timing to start / end driving the moving part. That is, the control unit 33 outputs control signals to the audio output unit 25 and the drive units 27 to 32 according to the timetable.
【0083】
Finally, the voice output unit 25 converts the voice data obtained from the voice synthesis unit 24 into voice and outputs it according to the control signal from the control unit 33. At the same time, the drive units 27 to 32 also drive the corresponding movable units according to the control signal from the control unit 33. The drive of the movable part by the drive units 27 to 32 was synchronized with the voice output of the character string corresponding to the operation control data in the body of the e-mail that is the source of the voice output from the voice output unit 25. It is done in the state.
【0084】
For example, in the case of "hello." In the above example, at the same time voice saying "Hello" is output from the audio output unit 25, the drive unit 28, 32 is driven corresponding to the right hand and the mouth of the robot-like bodies To. Therefore, the robot Samatai performs the operation include the right hand while moving the mouth, is output voice saying "Hello." At the same time.
【0085】
As described above, according to the present embodiment, the timing at which the e-mail transmission device 1 controls the operation of the robot-like body on the receiving side (specifically, the timing and drive at which the voice output unit 25 starts / ends voice output). Create motion control data in which the drive start / end timings of the corresponding moving parts 27 to 32 are described in the form of a timetable, and attach this to the body of the e-mail and send it. In the e-mail receiving device 2, the control unit 33 controls the operations of the voice output unit 25 and the driving units 27 to 32 based on the operation control data attached to the body of the e-mail, so that the e-mail receiving device 2 Operate a robot-like body that is.
【0086】
In the prior art, it was necessary to analyze the body of the received e-mail and calculate the type of operation corresponding to a specific character string such as an emoticon, the timing of the operation occurrence, the timing of voice output, and the like. However, in the e-mail receiving device 2 of the present embodiment, there is no such necessity.
【0087】
As a result, the e-mail receiving device 2 of the present embodiment operates the voice output unit 25 and the driving units 27 to 32 of the robot-like body in a much shorter time than the conventional example after receiving the e-mail. be able to. That is, the received e-mail can be quickly presented to the recipient. In addition, by presenting the e-mail to the recipient while operating the robot-like body, it is possible to clearly convey the emotion of the sender, which is difficult to convey only by sentences.
【0088】
Further, in the e-mail transmission device 1 of the present embodiment, when the sender inputs the operation category corresponding to each character string included in the body of the e-mail from the operation category input unit 17, the operation control data generation unit 14 automatically generates motion control data that controls the robot-like body on the receiving side by using the motion category set (character string and the motion category associated with the string) and the body of the e-mail. Therefore, in the e-mail transmitting device 1 of the present embodiment, it is not necessary to incorporate a specific symbol string such as an emoticon into the e-mail body in order to operate the robot-like body on the receiving side as in the conventional example. Therefore, even a user who is not accustomed to using a specific symbol string such as an emoticon can easily create an e-mail capable of operating the robot-like body on the receiving side.
【0089】
The operation category assigning unit 13 may have a configuration as shown below instead of the configuration shown in FIG.
【0090】
FIG. 5 is a block diagram concretely showing the configuration of another form of the operation category assigning unit 13. In FIG. 5, reference numeral 51 is an operation category generation unit, which automatically generates an operation category corresponding to each character string included in the body of the e-mail stored in the mail body storage unit 12. Reference numeral 52 denotes an operation category set storage unit, which stores the operation category set. Reference numeral 53 denotes an operation category presentation unit, which presents the operation category set stored in the operation category set storage unit 52 to the user. Reference numeral 54 denotes an operation category correction unit, which allows the user to modify the operation category set presented by the operation category presentation unit 53.
【0091】
The operation of the operation category assigning unit 13 of FIG. 5 configured as described above will be described below.
【0092】
The operation category generation unit 51 analyzes the body of the e-mail stored in the mail body storage unit 12, and automatically associates the operation category with each character string included in the body of the e-mail. As a specific method, first, a morphological analysis is performed on the body of the e-mail, and all the words contained in the body of the e-mail are extracted. The operation category generation unit 51 includes a library including a database in which operation categories suitable for individual words are associated with a large number of words in advance. Then, the library is searched based on the extracted words, and the registered action categories are associated with the matching words. In the above method, the character string associated with the action category is a word, but a symbol, a character, a phrase, or a sentence may be used. In addition, the registered language of the library (language for creating the body of an email and for the operation category) does not have to be limited to Japanese at all, and any language may be adopted. The operation category generated by the operation category generation unit 51 is stored in the operation category set storage unit 52 as an operation category set together with the corresponding character string.
【0093】
Next, the operation category presentation unit 53 presents the operation category set to the sender by displaying the operation category set stored in the operation category set storage unit 52 on a monitor screen or the like.
【0094】
The sender browses the action category set presented to the action category presentation unit 53, and verifies whether or not each character string contained in the e-mail is associated with the action category intended by the sender. .. If the character string is not associated with the operation category intended by the sender, the operation category correction unit 54 makes necessary corrections such as adding, changing, or deleting the operation category to the corresponding character string. Do. The operation category set modified by the operation category correction unit 54 is stored in the operation category set storage unit 52.
【0095】
As described above, according to the operation category assignment unit 13 of FIG. 5, the operation category generation unit 51 automatically generates the operation category corresponding to the character string included in the body of the e-mail. Unlike the case, the sender does not have to enter all the action categories. Therefore, the sender can very easily create an e-mail capable of operating the robot-like body on the receiving side.
【0096】
Further, since the operation category set correction unit 54 allows the sender to correct the operation category automatically generated by the operation category generation unit 51, the robot-like body on the receiving side can be operated as intended by the sender.
【0097】
In the description of the above embodiment, the mail body input unit 11, the mail body storage unit 12, the operation category assignment unit 13, the operation control data generation unit 14, the operation control data storage unit 15, and the transmission in the e-mail transmission device 1 Although the receiving unit 21, the e-mail storage unit 22, the operation control data recognition unit 23, the voice synthesis unit 24, the voice output unit 25, and the control unit 33 in the e-mail receiving device 2 are composed of dedicated hardware. , Alternatively, the same function may be realized by software on the microcomputer.
【0098】
Similarly, the operation category input unit 17, the operation category set storage unit 18, and the operation category generation unit 51, the operation category, which constitute the operation category assigning unit 13 in the e-mail transmission device 1 shown in FIG. The set storage unit 52, the operation category presentation unit 53, and the operation category correction unit 54 are also configured by dedicated hardware, but instead of this, the same function may be realized by software on the microcomputer.
【0099】
[Effect of the invention]
In the present invention of the e-mail transmission device, the operation control data generated by associating the operation category with the character string of the part for which the emotional expression is desired to be enriched is attached to the body of the e-mail that conveys the message. , This operation control data can be composed of a separate and independent control-dedicated code that has a different system from the character string in the body of the e-mail. Therefore, as the operation category associated with the character string, it is possible to adopt a straightforward and easy-to-understand one having a different origin from the set of characters / symbols to which the character string belongs. It has a relatively high degree of recognition, and it is easy to publicize new products. As a result, there is no need to incorporate a specific symbol string such as an emoticon that is difficult to understand when creating the body of an e-mail, and even a user who is not accustomed to using a specific symbol string such as an emoticon can use the robot-like body on the receiving side. It is possible to easily create an e-mail capable of operating the emotional expression operation means of the above, and it is possible to promote the efficiency of the e-mail creation work.
【0100】
In addition, it is also possible to configure the operation category to be automatically generated for the character string, and in the case of manual input in associating the appropriate operation category with the character string of the part where the emotional expression is desired to be enriched. Compared to, it is possible to reduce the burden on the user.
【0101】
Also, in the case of the above automatic mapping, sometimes the action category may be different from the emotional expression intended by the user, but the automatically generated action category is presented to the user. It can also be configured to allow the user to check and modify (delete, add, change, etc.), which allows the email with emotional expression to accurately match the emotional expression intended by the user. It is possible to create in a state that matches.
【0102】
Next, according to the present invention of the e-mail receiving device, a desired operation is performed by the emotion expression operation means via the drive means at the timing when the voice of the character string of the portion for which the emotion expression is desired to be enriched is output. Of course, it is possible to transmit a message rich in emotional expression, and the motion control data for controlling the motion of the emotional expression motion means and controlling the motion of the voice output means in synchronization with this is provided for each. It is a code form that is directly controlled, and is constantly collated for the presence or absence of a specific symbol string in the received character string as in the case of the conventional technology, interpretation of the operation meaning of the specific symbol string, and operation timing. It is possible to eliminate the need for time-consuming processing such as calculation, and therefore, it is possible to quickly drive and control the emotional expression operation means synchronized with the voice output as desired, and it is difficult to convey by sentences alone. It is possible to smoothly convey a message with rich emotional expressions.
[Simple explanation of drawings]
[Figure 1]
A block diagram showing a configuration of an e-mail receiving device, an e-mail transmitting device, and an e-mail transmitting / receiving system according to an embodiment of the present invention. [Figure 2]
External view showing the outline of the shape of the e-mail receiving device according to the embodiment of the present invention. [Fig. 3]
The figure which shows the example of the body of the e-mail input by the sender in the e-mail transmission device in embodiment of this invention. [Fig. 4]
The figure which shows the example which the operation category is associated with the e-mail of FIG. 3 in the operation category assignment part of the e-mail transmission device in embodiment of this invention. [Fig. 5]
A block diagram showing another embodiment of the operation category assigning portion of the e-mail transmitting device according to the embodiment of the present invention. [Fig. 6]
Block diagram showing the configuration of an e-mail receiving device related to the conventional technology [Explanation of symbols]
1 E-mail transmitter 2 E-mail receiver 3 network 11 Email body input section 12 Email body storage 13 Action category assigning section 14 Operation control data generator 15 Operation control data storage unit 16 Transmitter 17 Operation category input section 18 Operation category set storage 21 Receiver 22 Email storage 23 Operation control data recognition unit 24 Speech synthesizer 25 Audio output 26 Emotional expression movement part 27 Moving part (left hand) drive part 28 Moving part (right hand) drive part 29 Moving part (neck) drive part 30 Moving part (eye) drive part 31 Moving part (ear) drive part 32 Movable part (mouth) drive part 33 Control unit 51 Operation category generator 52 Operation category set storage 53 Action category presentation section 54 Operation category correction part
9 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| KR100883352B1 | Cited by | Republic of Korea | Search report |
| US9037982B2 | Cited by | United States of America | Applicant |
| US7970716B2 | Cited by | United States of America | Applicant |
1 member in 1 office
Members1
| Document | Office | Kind | |
|---|---|---|---|
| JP2002007291AThis record | Japan | A |
Numbers
- Publication
- 2002-7291
- Application
- 184876
Titles2
- Japanese
- 電子メール送信装置およびその関連装置
- English
- [Title of Invention] An E-mail Transmission Device and Related Devices
Classification
- IPC, 3
- G06F13 00
- H04L12 54
- H04L12 58