Dialog server for handling conversation in virtual space method and computer program for having conversation in virtual space

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 14/047,590, filed Oct. 7, 2013 (status: pending), which is a continuation application of U.S. patent application Ser. No. 13/406,954, filed Feb. 28, 2012 (which issued as U.S. Pat. No. 8,554,841 on Oct. 8, 2013), which is a continuation of U.S. patent application Ser. No. 12/389,073, filed Feb. 19, 2009 (which issued as U.S. Pat. No. 8,156,184 on Apr. 10, 2012), which claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2008-38422, filed Feb. 20, 2008, the contents of each of which are hereby expressly incorporated herein by reference in their entireties for all purposes.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a dialog server providing dialogs between users and more particularly, it relates to a method and a computer program for having a conversation in a virtual space.

2. Description of Related Art

Previously, services allowing multiple users to exchange messages and thereby to have a conversation have been provided. Such services include a video conference service utilizing text chat, images and audio. Recently, it is being realized that a large number of users have a conversation in a virtual space. Since each user has been able to exchange messages with a large number of other users, it is necessary to connect each of these other users with his/her messages so that each user can distinguish messages of one user from those of another.

Japanese Patent Application Publication No. 2004-267433 (hereinafter referred to as Patent Document 1) and Japanese Patent Application Publication No. 2007-072511 (hereinafter referred to as Patent Document 2) each discloses a method of processing an inputted speech sound to output a message. According to the method described in Patent Document 1, an inputted speech sound is converted or combined with another sound so as to be closely associated with a virtual space before being outputted as a chat sound. According to the method described in Patent Document 2, a speech sound of a character assigned to a client terminal is synthesized and by using this character's speech sound, speech-sound data corresponding to a message inputted from the client terminal is generated.

Japanese Patent Application Publication No. Hei 9-006985 (hereinafter referred to as Patent Document 3) and Japanese Patent Application Publication No. Hei 10-079929 (hereinafter referred to as Patent Document 4) disclose a method of bringing a user other than a certain user into a view of the certain user. According to the method described in Patent Document 3, a distance between a first avatar a and a second avatar b is measured. If the distance is not more than a threshold value L and the first avatar a looks at the second avatar b, and if the distance is kept not more than a threshold value L for a time period not less than a threshold value T, the second avatar b is rotated in the current position or moved until the first and second avatars a and b look at each other. According to the method described in Patent Document 4, a graphically displayed icon representing a user who participates in a shared 3D space is brought into a view of another user in response to strength and feature quantity of the former user's speech sound.

Japanese Patent Application Publication No. 2001-228794 (hereinafter referred to as Patent Document 5) discloses a method of displaying, in a view of a user, a message of another user at a position varying in accordance with a position of the latter user, if the message is a text message. According to the method described in Patent Document 5, a position in which text-based information to be displayed of a speaker-user is determined on the basis of a distance between the speaker-user and a listener-user, a view of the listener-user, a 3D position of the speaker-user, and a vector indicating speaker-user's line of sight. Thereafter, the text-based information is outputted in the thus-determined position.

If the above conventional techniques are applied to a situation each user exchanges messages with a large number of other users, the following problems will arise. If the large number of other users simultaneously output messages, the methods of Patent Documents 1 and 2 allow the messages to have different tones and sounds. However, it is still difficult to recognize a certain message from these overlapping sounds. If there are a large number of users in a certain area, the methods of Patent Documents 3 and 4 keep the views of the certain user and the large number of other users frequently moving, so that the users have difficulties in continuing conversations. If a large number of messages are simultaneously displayed, the method of Patent Document 5 allows each message to be displayed in a position corresponding to a positional relationship between a listener-user and a speaker-user. However, it is still difficult to distinguish messages of one user from those of another.

SUMMARY OF THE INVENTION

The present invention provides a dialog server, a method, and a computer program thereof, of providing smooth communication between a large number of users in a virtual space.

According to a first aspect of the present invention, a dialog server for providing dialogs made by at least one user through at least one avatar in virtual space is provided. The dialog server includes: a position storage unit for storing at least one positional information on at least one avatar; an utterance receiver for receiving (i) at least one utterance of at least one avatar, and (ii) at least one utterance strength representing an importance or attention level of at least one utterance; an interest level calculator for calculating at least one interest level between two of at least one avatar to each other, based on at least one positional information of at least one avatar; a message processor for generating a message from at least one utterance in accordance with a value calculated from at least one interest level and at least one utterance strength; and a message transmitter for transmitting at least one message to at least one avatar.

According to another aspect of the present invention, a method of providing dialogs made by at least one user through at least one avatar in a virtual space is provided. The method includes the steps of: storing at least one positional information based on at least one avatar; receiving (i) at least one utterance from at least one avatar and (ii) at least one utterance strength representing an importance or attention level of at least one utterance; calculating at least one interest level between two avatars based on their positional information; generating at least one message from at least one utterance in accordance with a value calculated from the interest level and the utterance strength; and transmitting at least one message to other avatars.

According to another aspect of the present invention, a computer readable article of manufacture tangibly embodying computer readable instructions for executing the steps of the above method.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the embodiments of the present invention and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings.

<figref idref="DRAWINGS">FIG. 1</figref> is a functional block diagram showing a configuration of a dialog server according to an embodiment of the present invention.

<figref idref="DRAWINGS">FIG. 2</figref> is a flowchart showing a processing flow of the dialog server according to an embodiment of the present invention.

<figref idref="DRAWINGS">FIG. 3</figref> is a perspective view showing a positional relationship between avatars of a speaker and a listener used for calculating an interest level in an embodiment of the present invention.

<figref idref="DRAWINGS">FIGS. 4-1 to 4-5</figref> illustrate Example 1 of the present invention.

<figref idref="DRAWINGS">FIGS. 5-1 to 5-5</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 4-1 to 4-5</figref>.

<figref idref="DRAWINGS">FIGS. 6-1 to 6-5</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 5-1 to 5-5</figref>.

<figref idref="DRAWINGS">FIGS. 7-1 to 7-5</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 6-1 to 6-5</figref>.

<figref idref="DRAWINGS">FIGS. 8-1 to 8-3</figref> are perspective views, each showing the positional relationship (between the avatars of a speaker and a listener) used for calculating a value from interest levels and the voice volume of an utterance in the embodiment of the present invention.

<figref idref="DRAWINGS">FIGS. 9-1 to 9-4</figref> illustrate Example 2 of the present invention.

<figref idref="DRAWINGS">FIGS. 10-1 to 10-4</figref> illustrate Example 2 of the present invention.

<figref idref="DRAWINGS">FIGS. 11-1 to 11-4</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 10-1 to 10-4</figref>.

<figref idref="DRAWINGS">FIGS. 12-1 to 12-4</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 11-1 to 11-4</figref>.

<figref idref="DRAWINGS">FIGS. 13-1 to 13-4</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 12-1 to 12-4</figref>.

<figref idref="DRAWINGS">FIGS. 14-1 to 14-4</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 13-1 to 13-4</figref>.

<figref idref="DRAWINGS">FIGS. 15-1 to 15-4</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 14-1 to 14-4</figref>.

<figref idref="DRAWINGS">FIGS. 16-1 to 16-4</figref> illustrate a situation subsequent to <figref idref="DRAWINGS">FIGS. 15-1 to 15-4</figref>.

<figref idref="DRAWINGS">FIG. 17</figref> shows an information processor as a typical example of a hardware configuration of the dialog server, a speaker-user terminal and a listener-user terminal.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A description of preferred embodiments of the present invention follows with reference to the drawings.

The term “virtual space” in the context of the present invention means a collection of data in which background scenery and objects each having a position and a direction are arranged. The term “avatar” means an object associated with a user as a character representing the user in a virtual space.

“Utterance strength” is a value indicating deliverability of an utterance, and represents, for example, a voice volume of the utterance. It is also an importance level of the utterance for an avatar making the utterance, and further, it is an attention level of the utterance for an avatar receiving the utterance. The utterance strength is attached to an utterance by an avatar making the utterance.

“Interest level” is defined herein as being a value indicating utterance deliverability between two avatars, and automatically calculated in accordance with a positional relationship including each direction from one avatar to the other and a distance between the avatars.

If a certain avatar makes an utterance, the dialog server can transmit a content of the utterance to each of other avatars as a message in accordance with a value calculated from the utterance strength and the interest levels of the certain avatar to the each of other avatars and of the each of other avatars to the certain avatar. As a result, an utterance of an avatar is delivered to another avatar in accordance with a value which is calculated from interest levels automatically calculated from positions of the avatars and utterance strength of the utterance. Thus, the dialog server can provide a smooth communication using a conversation in a virtual space where a large number of users participate.

If a certain avatar makes an utterance, the dialog server can transmit the utterance to each of other avatars when a value calculated from the utterance strength and the interest levels of the certain avatar to the each of other avatars and of the each of other avatars to the certain avatar is not less than a predetermined value. As a result, an utterance of an avatar is delivered to another avatar when a value which is calculated from interest levels automatically calculated from positions of the avatars and utterance strength of the utterance is not less than a predetermined value. Thus, the dialog server can provide a smooth communication using a conversation in a virtual space where a large number of users participate.

Referring to <figref idref="DRAWINGS">FIG. 1</figref>, a functional block diagram showing a configuration of a dialog server as an example of an embodiment of the present invention is provided. A dialog server <b>10</b> receives utterance data and utterance strength data transmitted by a speaker-user terminal <b>21</b> via an utterance receiver <b>11</b>. The utterance data can be either text data or sound data. The utterance strength data indicates deliverability of an utterance of a speaker to a listener. For example, the utterance strength data can indicate a value designated by a speaker, as data separate from the utterance data, or can indicate voice volume of the utterance of sound data.

Dialog server <b>10</b> also receives positional information data transmitted by the speaker-user terminal <b>21</b> or the listener-user terminal <b>22</b>, through a position receiver <b>12</b>. The positional information data indicates the positions of avatars respectively representing one or more speakers and one or more listeners in a virtual space. For example, the positional information data includes an avatars' coordinate information in the virtual space and an avatars' facing directions.

A position storage unit <b>13</b> stores the received positional information on the avatars of the speakers and listeners. If the position storage unit <b>13</b> has already stored any positional information, it updates the stored positional information, and stores the updated positional information. The interest level calculator <b>15</b> reads the positional information stored in the position storage unit <b>13</b>, and calculates the interest levels of the speakers to the listeners and interest levels of the listeners to the speakers from the positional relationships between the avatars of the speakers and listeners.

An utterance strength calculator <b>14</b> calculates the utterance strength from either the utterance data or the utterance strength data received from the utterance receiver <b>11</b>. For example, in the case where the utterance strength data indicates a value designated and inputted by a speaker, as data separate from the utterance data, the value can be normalized to be made into the utterance strength. In the case where the utterance strength data indicates voice volume of the utterance of sound data, the voice volume can be normalized to be made into the utterance strength.

Message processor <b>16</b> processes the utterance in accordance with the interest levels calculated by the interest level calculator <b>15</b> and the utterance strength calculated by the utterance strength calculator <b>14</b>, and thereby generates a message. For example, in generating the message, the message processor <b>16</b> can change the font size or the sound volume of the utterance in accordance with the interest levels and the utterance strength. Alternatively, message processor <b>16</b> can generate a message from the utterance only when a value calculated from the interest levels and the content of the utterance exceeds a certain threshold value.

Message transmitter <b>17</b> transmits the generated message to the listener-user terminal <b>22</b>. The position transmitter <b>18</b> reads the positional information on the avatars of both the speakers and listeners stored in the position storage unit <b>13</b>, and transmits the information to the speaker-user terminal <b>21</b> and the listener-user terminal <b>22</b>, as positional information data.

<figref idref="DRAWINGS">FIG. 2</figref> is a flowchart showing a processing flow of the dialog server <b>10</b> according to an embodiment of the present invention. The dialog server <b>10</b> receives positional information data on avatars of one or more speakers and one or more listeners in a virtual space (step S<b>11</b>), as well as utterance data and utterance strength data of each speaker (step S<b>12</b>).

In step S<b>13</b>, the dialog server <b>10</b> updates positional information on the avatars of speakers and listeners based on the positional information data received in step S<b>11</b>. Thereafter, the dialog server <b>10</b> reads the updated positional information on the avatars of the speakers and listeners (step S<b>14</b>), and calculates the interest levels based on the updated positional information on the avatars of the speakers and listeners (step S<b>15</b>).

In step S<b>16</b>, dialog server <b>10</b> calculates a value from both the interest levels of the avatars of the speakers and listeners and the utterance strength calculated from the utterance strength data received in step S<b>12</b>. Thereafter, dialog server <b>10</b> determines whether or not the calculated value is not less than a predetermined value (step S<b>17</b>). If the calculated value is not less than the predetermined value, the processing proceeds to step S<b>18</b>. If the calculated value is less than the predetermined value, the processing proceeds to step S<b>20</b>.

In step S<b>18</b>, dialog server <b>10</b> generates a message from the content of the utterance received in step S<b>12</b>. Thereafter, the dialog server <b>10</b> transmits the generated message (step S<b>19</b>). In step S<b>20</b>, the dialog server <b>10</b> transmits, as positional information data, positional information on the avatars which is updated in step S<b>13</b>.

<figref idref="DRAWINGS">FIG. 3</figref> is a perspective view showing a positional relationship between avatars of a speaker and a listener used for calculating an interest level in an embodiment of the present invention. An interest level I_jof an avatar A_ito an avatar A_jin a virtual space is defined as shown in the following expression (1):

<maths id="MATH-US-00001" num="00001"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>I</mi><mi>ij</mi></msub><mo>=</mo><mrow><mi>d</mi><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><mi>θ</mi></mrow><mi>L</mi></mfrac></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Expression</mi><mo>⁢</mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⁢</mo><mn>1</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><br /> where θ is an angle made by a facing direction of the avatar A_iand a straight line connecting positions of the respective avatars A_iand A_j, and L is a distance between the avatars A_iand A_j. Here, d is a term for normalizing an interest level of a speaker or a listener to satisfy the following expression (2):

<maths id="MATH-US-00002" num="00002"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mi>l</mi></mrow><mi>n</mi></munderover><mo>⁢</mo><msub><mi>I</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub></mrow><mo>=</mo><mn>1</mn></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Expression</mi><mo>⁢</mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⁢</mo><mn>2</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><br /> where n is the number of avatars who exist in a circular region whose center is the position of the avatar A_iand whose radius r_iis a predetermined distance.

<figref idref="DRAWINGS">FIGS. 4-1 to 7-5</figref> illustrate Example 1 of the present invention. <figref idref="DRAWINGS">FIG. 4-1</figref> is a perspective view showing three avatars A, B and Ch sitting around a circular table in a virtual space. A, B and Ch sit in the positions located at the same distance from the center of the table while facing the center of the table. More specifically, straight lines connecting the center of the table and the respective positions of A, B and Ch are 120.degree. of each other.

<figref idref="DRAWINGS">FIG. 4-2</figref> shows A's view. A faces the midpoint between B and Ch. <figref idref="DRAWINGS">FIG. 4-3</figref> shows B's view. B faces the midpoint between A and Ch. <figref idref="DRAWINGS">FIG. 4-4</figref> shows Ch's view. Ch faces the midpoint between A and B.

<figref idref="DRAWINGS">FIG. 4-5</figref> is a table summarizing interest levels between A, B and Ch. A, B and Ch sit at respective vertices of an equilateral triangle, so that the distances between A, B and Ch are the same. Since each of the avatars A, B and Ch face the midpoint of the opposite side of this equilateral triangle, the facing direction of each avatar and the directions from the avatar to the other respective avatars are at the same angle, in this case, 30.degree. From above expressions (1) and (2), the interest levels between A, B and Ch are set to the same value. It is assumed that an utterance of one avatar is delivered to another as a message, if an interest level from the latter avatar to the former avatar is not less than 0.5. Accordingly, in the situation shown in <figref idref="DRAWINGS">FIG. 4-5</figref>, an utterance of any of the avatars is delivered to the other avatars as messages.

<figref idref="DRAWINGS">FIG. 5-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 4-1</figref>. Ch speaks while A and B look at Ch. <figref idref="DRAWINGS">FIG. 5-2</figref> shows A's view. A looks at Ch. <figref idref="DRAWINGS">FIG. 5-3</figref> shows B's view. B looks at Ch. <figref idref="DRAWINGS">FIG. 5-4</figref> shows Ch's view. Ch faces the midpoint between A and B.

<figref idref="DRAWINGS">FIG. 5-5</figref> is a table summarizing interest levels between A, B and Ch. A and B look at Ch. Accordingly, the interest levels of A to Ch and B to Ch has increased, while the interest levels of A to B and B to A has decreased. The facing direction of Ch remains unchanged from the situation shown in <figref idref="DRAWINGS">FIG. 4</figref>, so that the interest levels of Ch to A and Ch to B also remain unchanged from that situation.

In the situation shown in <figref idref="DRAWINGS">FIG. 5-5</figref>, A's utterances are delivered to Ch as messages, but not to B. Similarly, B's utterances are delivered to Ch as messages, but are not to A. On the other hand, Ch's utterances are delivered to both A and B as messages. These conditions allow only Ch's utterances to be delivered to A and B as messages. Accordingly, A and B can hear only the Ch's utterances as messages.

<figref idref="DRAWINGS">FIG. 6-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 5-1</figref>. B speaks to Ch, and Ch faces a point closer to B than the midpoint between A and B. A and B look at Ch. <figref idref="DRAWINGS">FIG. 6-2</figref> shows A's view. A looks at Ch. <figref idref="DRAWINGS">FIG. 6-3</figref> shows B's view. B looks at Ch. <figref idref="DRAWINGS">FIG. 6-4</figref> shows Ch's view. Ch faces the point closer to B than the midpoint between A and B.

<figref idref="DRAWINGS">FIG. 6-5</figref> is a table summarizing interest levels between A, B and Ch. A and B look at Ch as similar to the situation shown in <figref idref="DRAWINGS">FIG. 5</figref>. Accordingly, the interest levels of A to Ch, B to Ch, A to B and B to A remain unchanged from the situation shown in <figref idref="DRAWINGS">FIG. 5</figref>. Ch faces the point closer to B than the midpoint between A and B, so that the interest level of Ch to B has increased over the situation shown in <figref idref="DRAWINGS">FIG. 5</figref>, while the interest level of Ch to A has decreased as compared to the situation shown in <figref idref="DRAWINGS">FIG. 5</figref>.

In the situation shown in <figref idref="DRAWINGS">FIG. 6-5</figref>, A's utterances are not delivered to Ch or B. B's utterances are delivered to Ch as messages, but not to A. Similarly, Ch's utterances are delivered to B as messages, but not to A. These conditions allow Ch and B to have a conversation without being interrupted by any A's utterance, while preventing A from being disturbed by any of B's personal questions.

<figref idref="DRAWINGS">FIG. 7-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 6-1</figref>. Ch speaks to A, while facing a point closer to A than the midpoint between A and B. A and B look at Ch. <figref idref="DRAWINGS">FIG. 7-2</figref> shows A's view. A looks at Ch. <figref idref="DRAWINGS">FIG. 7-3</figref> shows B's view. B looks at Ch. <figref idref="DRAWINGS">FIG. 7-4</figref> shows Ch's view. Ch faces the point closer to A than the midpoint between A and B.

<figref idref="DRAWINGS">FIG. 7-5</figref> is a table summarizing interest levels between A, B and Ch. A and B look at Ch similar to the situation shown in <figref idref="DRAWINGS">FIG. 6</figref>. Accordingly, the interest levels of A to Ch, B to Ch, A to B and B to A remain unchanged from the situation shown in <figref idref="DRAWINGS">FIG. 6</figref>. Ch faces the point closer to A than the midpoint between A and B, so that the interest level of Ch to A has increased over the situation shown in <figref idref="DRAWINGS">FIG. 6</figref>, while the interest level of Ch to B has decreased as compared to the situation shown in <figref idref="DRAWINGS">FIG. 6</figref>.

In the situation shown in <figref idref="DRAWINGS">FIG. 7-5</figref>, A's utterances are delivered to Ch as messages, but not to B. B's utterances are not delivered to Ch or A. In addition, Ch's utterances are delivered to A as messages, but not to B. In <figref idref="DRAWINGS">FIG. 7-2</figref>, dialog between Ch and B is exchanged. This dialog is sequentially reproduced to be delivered to A as messages. This allows A to trace the content of the conversation between Ch and B, and accordingly allows Ch to deliver B's valuable remarks to A while preventing B from hearing what has already been said to B. This sequential reproduction can be deactivated by either A or Ch.

In the above Example 1, an interest level of each avatar calculated from the positional information of avatars is a value that becomes larger as (1) the direction from one avatar becomes closer to the direction of another avatar or (2) as the avatar stands closer to another avatar. Afterwards, it is determined whether or not to deliver an utterance of the avatar to the certain avatar as a message based on the calculated interest level. Accordingly, whether or not to deliver an utterance as a message can be automatically chosen in accordance with positions of the avatars.

As mentioned in Example 1, when the avatar acquires only a low interest level, certain dialogs are not delivered to an avatar as messages. Even in this case, if the message delivery is resumed in response to the fact that the avatar acquires a high interest level, the undelivered messages can be sequentially delivered to the avatar. In that event, the user of the avatar can choose whether or not to hear the undelivered messages.

<figref idref="DRAWINGS">FIGS. 8-1 to 8-3</figref> are perspective views each showing a positional relationship between avatars of a speaker and a listener used for determining whether or not to deliver an utterance as a message in another embodiment of the present invention. Specifically, such determination is made based on a scale value calculated from interest levels and a voice volume of the utterance. <figref idref="DRAWINGS">FIG. 8-1</figref> is a perspective view showing a positional relationship between avatars A_iand A_iin a virtual space. A condition under which an As utterance is delivered to A₁as a message is defined on the basis of a preset threshold level TH as shown in the following expression (3):

<maths id="MATH-US-00003" num="00003"><math overflow="scroll"><mtable><mtr><mtd><mtable><mtr><mtd><mrow><msub><mi>I</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mi>i</mi></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mi>i</mi></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>I</mi><mrow><mi>j</mi><mo>,</mo><mi>i</mi></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mi>j</mi></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mi>j</mi></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><msub><mi>I</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub><mo>×</mo><msub><mi>p</mi><mi>i</mi></msub></mrow><mo>+</mo><msub><mi>I</mi><mrow><mi>j</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow><mo>&gt;</mo><mi>TH</mi></mrow></mtd></mtr></mtable></mtd><mtd><mrow><mo>[</mo><mrow><mi>Expression</mi><mo>⁢</mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⁢</mo><mn>3</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><br /> where θ_iis an angle made by the facing direction of A_iand a straight line connecting positions of A_iand A_j. θ_jis an angle made by a facing direction of A_jand a straight line connecting positions of A_iand A_j. L is a distance between the avatars A_iand A_j, and p_iis a voice volume of the A_i's utterance. Here, d_iand d_jare terms used for the normalization mentioned previously.

<figref idref="DRAWINGS">FIG. 8-2</figref> is a perspective view showing a situation where the avatar A_ispeaks to the avatar A₂at a voice volume level p₁. In this case, the following result is obtained instead of the expression (3):

<maths id="MATH-US-00004" num="00004"><math overflow="scroll"><mtable><mtr><mtd><mtable><mtr><mtd><mrow><msub><mi>l</mi><mrow><mn>1</mn><mo>,</mo><mn>2</mn></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mn>1</mn></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mn>1</mn></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>l</mi><mrow><mn>2</mn><mo>,</mo><mn>1</mn></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mn>2</mn></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mn>2</mn></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><msub><mi>l</mi><mrow><mn>1</mn><mo>,</mo><mn>2</mn></mrow></msub><mo>×</mo><msub><mi>p</mi><mi>i</mi></msub></mrow><mo>+</mo><msub><mi>l</mi><mrow><mn>2</mn><mo>,</mo><mn>1</mn></mrow></msub></mrow><mo>≦</mo><mi>TH</mi></mrow></mtd></mtr></mtable></mtd><mtd><mrow><mo>[</mo><mrow><mi>Expression</mi><mo>⁢</mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⁢</mo><mn>4</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><br /> This means that this situation does not satisfy the condition defined in the expression (3), and thus A₁'s utterances are not delivered to A₂as messages. Accordingly, the displayed image of A₂is darkened to indicate that A₁'s messages are not delivered to A₂.

<maths id="MATH-US-00005" num="00005"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>l</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mi>i</mi></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mi>i</mi></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>l</mi><mrow><mi>j</mi><mo>,</mo><mi>i</mi></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mi>j</mi></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mi>j</mi></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><msub><mi>l</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub><mo>×</mo><msub><mi>p</mi><mi>i</mi></msub></mrow><mo>+</mo><msub><mi>l</mi><mrow><mi>j</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow><mo>&gt;</mo><mi>TH</mi></mrow></mtd></mtr></mtable></math></maths>

<figref idref="DRAWINGS">FIG. 8-3</figref> is a perspective view showing a situation where the avatar A₁speaks to the avatar A₂at a voice volume level p₂. In this case, the following result is obtained instead of the expression (3):

<maths id="MATH-US-00006" num="00006"><math overflow="scroll"><mtable><mtr><mtd><mtable><mtr><mtd><mrow><msub><mi>l</mi><mrow><mn>1</mn><mo>,</mo><mn>2</mn></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mi>i</mi></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mn>1</mn></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>l</mi><mrow><mn>2</mn><mo>,</mo><mn>1</mn></mrow></msub><mo>=</mo><mrow><msub><mi>d</mi><mn>2</mn></msub><mo>⁢</mo><mfrac><mrow><mi>cos</mi><mo>⁢</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>⁢</mo><msub><mi>θ</mi><mn>2</mn></msub></mrow><mi>L</mi></mfrac></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><msub><mi>l</mi><mrow><mn>1</mn><mo>,</mo><mn>2</mn></mrow></msub><mo>×</mo><msub><mi>p</mi><mn>2</mn></msub></mrow><mo>+</mo><msub><mi>l</mi><mrow><mn>2</mn><mo>,</mo><mn>1</mn></mrow></msub></mrow><mo>&gt;</mo><mi>TH</mi></mrow></mtd></mtr></mtable></mtd><mtd><mrow><mo>[</mo><mrow><mi>Expression</mi><mo>⁢</mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⁢</mo><mn>5</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><br /> This means that this situation satisfies the condition defined in Expression 3, and thus A₁'s utterances are delivered to A₂as messages. Accordingly, the displayed image of A₂returns to normal indicating that A₁'s messages are delivered to A₂.

<figref idref="DRAWINGS">FIGS. 9-1 to 16-4</figref> illustrate Example 2, which is another embodiment of the present invention. <figref idref="DRAWINGS">FIG. 9-1</figref> is a perspective view showing seven avatars A to F and Ch sitting around a rectangular table in a virtual space. Among A to F, three avatars sit at one longer side of the table and the remaining three avatars sit at the other longer side of the table. More specifically, the avatars at each side sit at regular intervals while facing the avatars at the other side. Ch sits at a shorter side of the table while facing in a direction perpendicular to the facing directions of A to F.

<figref idref="DRAWINGS">FIG. 9-2</figref> shows Ch's view. A to F sit at the longer sides of the tables while A, and E face B, D and F, respectively. Ch sits at the midpoint of the shorter side which is closer to A and B facing each other while facing the midpoint of the opposite side. <figref idref="DRAWINGS">FIG. 9-3</figref> shows C's view. D who faces C is seen in front of C, B who faces A is seen at a position closer to Ch, and F who faces E is seen at a position more distant from Ch. <figref idref="DRAWINGS">FIG. 9-4</figref> shows F's view. E who faces F is seen in front of F, and C who faces D is seen at a position closer to Ch.

<figref idref="DRAWINGS">FIG. 10-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 9-1</figref>. A to F and Ch face the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 9-1</figref>, and speak with a normal voice volume. <figref idref="DRAWINGS">FIG. 10-2</figref> shows Ch's view. Since A and B sit closer to Ch, their utterances with a normal voice volume satisfy the condition defined in the expression (3), and thus are delivered to Ch as messages. On the other hand, since C to F sit farther from Ch, their utterances with a normal voice volume do not satisfy the condition defined in the expression (3), and thus are not delivered to Ch as messages. Similarly, since C to F sit farther from Ch, Ch's utterances with a normal voice volume do not satisfy the condition defined in the expression (3), and thus are not delivered to Ch as messages. Accordingly, the display images of C to F are darkened in the Ch's view as shown in <figref idref="DRAWINGS">FIG. 10-2</figref>.

<figref idref="DRAWINGS">FIG. 10-3</figref> shows C's view. Utterances with a normal voice volume of B, D and F are delivered to C as messages. Since each of B, D and F is regarded as sitting at a distance and in a direction from C which allow C's utterances with a normal voice volume to be delivered to the each of B, D and F as messages, the display images of B, D and F are normal in C's view. <figref idref="DRAWINGS">FIG. 10-4</figref> shows F's view. Utterances of E and C are delivered to F as messages. Since both E and C are regarded as sitting at a distance and in a direction from F which allow F's utterances with a normal voice volume to be delivered to the each of E and C as messages, the display images of E and C are normal in the F's view.

<figref idref="DRAWINGS">FIG. 11-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 10-1</figref>. Ch faces the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 10-1</figref>, and speaks with a voice louder than normal. <figref idref="DRAWINGS">FIG. 11-2</figref> shows Ch's view. Ch speaks with the louder voice, and thus Ch's message is even delivered to C to F. Accordingly, the display images of C to F which are darkened in the situation shown in <figref idref="DRAWINGS">FIG. 10</figref> now become normal in Ch's view.

<figref idref="DRAWINGS">FIG. 11-3</figref> shows C's view. Ch speaks with the louder voice, and thus Ch's message is delivered to C even though Ch is out of the C's view. <figref idref="DRAWINGS">FIG. 11-4</figref> shows F's view. Ch speaks with the louder voice, and thus Ch's message is delivered to F even though Ch is out of the F's view.

<figref idref="DRAWINGS">FIG. 12-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 11-1</figref>. Since Ch's utterance with the louder voice in the situation shown in <figref idref="DRAWINGS">FIG. 11-1</figref> is delivered to A to F as a message, all the avatars look at Ch now. Ch faces the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 11-1</figref>, and speaks with a normal voice volume.

<figref idref="DRAWINGS">FIG. 12-2</figref> shows Ch's view. Ch speaks with a normal voice volume. A to F are looking directly at Ch. Accordingly, even though C to F are regarded as sitting at a distance and in a direction from Ch which normally can not allow Ch's utterances with a normal voice volume to be delivered to C to F as messages, C to F are regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to C to F as messages. Therefore the display images of C to F are normal in <figref idref="DRAWINGS">FIG. 10-2</figref>.

<figref idref="DRAWINGS">FIG. 12-3</figref> shows C's view. C looks at Ch. Accordingly, C is regarded to sit at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to C as messages, and thus the display image of Ch is normal in the C's view. Ch's utterances with a normal voice volume are delivered to C as messages. A looks at Ch and the direction from C to A is some degrees away from the facing direction of C. Accordingly, A is regarded to sit at a distance and in a direction from C which allow none of C's utterances with a normal voice volume to be delivered to A as messages. Thus, the display image of A is darkened in the C's view as shown in <figref idref="DRAWINGS">FIG. 12-3</figref>.

<figref idref="DRAWINGS">FIG. 12-4</figref> shows F's view. F looks at Ch. Accordingly, F is regarded to sit at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to F as messages, and thus the display image of Ch is normal in the F's view. Ch's utterances with a normal voice volume are delivered to F as messages. A and B look at Ch and the directions from F to A and to B are some degrees away from the facing direction of F. Accordingly, A and B are regarded as sitting at a distance and in a direction from F which allow none of F's utterances with a normal voice volume to be delivered to A or B as messages. Thus, the display images of A and B are darkened in the F's view as shown in <figref idref="DRAWINGS">FIG. 12-4</figref>.

<figref idref="DRAWINGS">FIG. 13-1</figref> is a perspective view showing a situation subsequent to <figref idref="DRAWINGS">FIG. 12-1</figref>. Ch faces the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 12-1</figref>, and speaks with a normal voice volume. A to E look at Ch while F looks at C. F speaks to C with a normal voice volume.

<figref idref="DRAWINGS">FIG. 13-2</figref> shows Ch's view. Ch speaks with a normal voice volume, and A to E look at Ch. Accordingly, A to E are regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to A to E as messages, and thus the display images of A to E are normal in the Ch's view. F looks at C. Accordingly, F is regarded as sitting at a distance and in a direction from Ch which allow none of Ch's utterances with a normal voice volume to be delivered to F as messages, and thus the display image of F is darkened in the Ch's view.

<figref idref="DRAWINGS">FIG. 13-3</figref> shows C's view. C looks at Ch. Accordingly, C is regarded to sit at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to C as messages, and thus Ch's utterances with a normal voice volume are delivered to C as messages. F looks at C. Accordingly, C is regarded as sitting at a distance and in a direction from F which allow F's utterances with a normal voice volume to be delivered to C as messages, and thus F's utterance with a normal voice volume is delivered to C as a message.

A looks at Ch and the direction from C to A is some degrees away from the facing direction of C. Accordingly, A is regarded as sitting at a distance and in a direction from C which allow none of C's utterances with a normal voice volume to be delivered to A as messages. Thus, the display image of A is darkened in the C's view.

<figref idref="DRAWINGS">FIG. 13-4</figref> shows F's view. Since F looks at C, F is regarded as sitting at a distance and in a direction from C which allow C's utterances with a normal voice volume, if they were, to be delivered to F as messages. Thus, the display image of C is normal in the F's view. A and E look at Ch and the directions from F to A and to E are some degrees away from the facing direction of F. Accordingly, A and E are regarded as sitting at a distance and in a direction from F which allow none of F's utterances with a normal voice volume to be delivered to A or E as messages. Thus, the display images of A and E are darkened in the F's view. These conditions allow F's utterances referring to earlier discussion to be delivered only to C selected by F as one to whom these utterances should be delivered as messages, while preventing A, B, D, E and Ch from hearing the utterances. This allows F to express opinions without interrupting the discussion on the table.

<figref idref="DRAWINGS">FIG. 14-1</figref> is a perspective view showing a situation subsequent to that of <figref idref="DRAWINGS">FIG. 13-1</figref>. Ch faces the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 13-1</figref>, and speaks with a normal voice volume. A, B, D and E look at Ch, while F looks at C and speaks to C with a normal voice volume. Since F's utterance in the situation shown in <figref idref="DRAWINGS">FIG. 13</figref> is delivered to C as a message, C looks at F now.

<figref idref="DRAWINGS">FIG. 14-2</figref> shows Ch's view. Ch speaks with a normal voice volume while A, B, D and E look at Ch. Accordingly, A, B, D and E are regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to A, B, D and E as messages, and thus the display images of A, B, D and E are normal in the Ch's view. F and C look at each other. Accordingly, C and F are regarded to sit at a distance and in a direction from Ch which allow none of Ch's utterances with a normal voice volume to be delivered to the C or F as messages, and thus the display images of C and F are darkened in the Ch's view.

<figref idref="DRAWINGS">FIG. 14-3</figref> shows C's view. Since C and F look at each other, F is regarded as sitting at a distance and in a direction from C which allow C's utterances with a normal voice volume to be delivered to F as messages. Accordingly, the display image of F is normal in the C's view. F's utterances with a normal voice volume are delivered to C as messages. On the other hand, D looks at Ch and the direction from C to D is some degrees away from the facing direction of C. Accordingly, D is regarded as sitting at a distance and in a direction from C which allow none of C's utterances with a normal voice volume to be delivered to D as messages. Thus, the display image of D is darkened in the C's view.

<figref idref="DRAWINGS">FIG. 14-4</figref> shows F's view. Since C and F look at each other, C is regarded as sitting at a distance and in a direction from F which allow F's utterances with a normal voice volume, if they were, to be delivered to C as messages. Thus, the display image of C is normal in the F's view. A and E look at Ch and the directions from F to A and F to E are some degrees away from the facing direction of F. Accordingly, A and E are regarded as sitting at a distance and in a direction from F which allow none of F's utterances with a normal voice volume to be delivered to the A or E as messages. Thus, the display images of A and E are darkened in the F's view.

C and F who face each other can see no other normal display images of avatars. Accordingly, C's utterances and F's utterances with a normal voice volume are not delivered to the avatars other than C and F, as messages. This allows C and F to discuss a topic different from one being discussed by all the avatars on the table without interrupting the discussion on the table.

<figref idref="DRAWINGS">FIG. 15-1</figref> is a perspective view showing a situation subsequent to that of <figref idref="DRAWINGS">FIG. 14-1</figref>. Ch faces the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 14-1</figref>, and speaks with a normal voice volume. A to E look at Ch. Among the avatars, C speaks with a normal voice volume while looking at Ch. F looks at C.

<figref idref="DRAWINGS">FIG. 15-2</figref> shows Ch's view. C speaks to Ch with a normal voice volume, and A to E look at Ch. Accordingly, A to E are regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to A to E as messages, and thus the display images of A to E are normal in the Ch's view. Since F looks at C, none of Ch's utterances with a normal voice volume is delivered to F as messages. Accordingly, the display image of F is darkened in the Ch's view. In this event, as in Example 1, dialogs between C and F can be sequentially reproduced. C and Ch can be allowed to choose whether or not to reproduce these dialogs.

<figref idref="DRAWINGS">FIG. 15-3</figref> shows C's view. Since C looks at Ch, Ch is regarded as sitting at a distance and in a direction from C which allow C's utterances with a normal voice volume to be delivered to Ch as messages. Accordingly, the display image of Ch is normal in the C's view. Ch's utterance with a normal voice volume is delivered to C as a message. On the other hand, A looks at Ch and the direction from C to A is some degrees away from the facing direction of C. Accordingly, A is regarded as sitting at a distance and in a direction from C which allow none of C's utterances with a normal voice volume to be delivered to A as messages. Thus, the display image of A is darkened in the C's view.

<figref idref="DRAWINGS">FIG. 15-4</figref> shows F's view. Since F looks at C, F is regarded as sitting at a distance and in a direction from C which allow F's utterances with a normal voice volume to be delivered to C as messages. Thus, the display image of C is normal in the F's view. Even though C speaks while looking at Ch, the distance between F and C is small enough and F looks at C. Accordingly, C is regarded as sitting at a distance and in a direction from F which allow C's utterances with a normal voice volume, if they were, to be delivered to F as messages.

C's utterance with a normal voice volume is delivered to F as a message. On the other hand, A and E look at Ch and the directions from F to A and F to E are some degrees away from the facing direction of F. Accordingly, A and E are regarded as sitting at a distance and in a direction from F which allow none of F's utterances with a normal voice volume to be delivered to the each of A and E as messages. Thus, the display images of A and E are darkened in the F's view.

<figref idref="DRAWINGS">FIG. 16-1</figref> is a perspective view showing a situation subsequent to that of <figref idref="DRAWINGS">FIG. 15-1</figref>. Ch, who has received C's utterance as a message, faces the same direction as in the situation shown in <figref idref="DRAWINGS">FIG. 15-1</figref>, and speaks on the message delivered from C with a normal voice volume. A to F look at Ch.

<figref idref="DRAWINGS">FIG. 16-2</figref> shows Ch's view. Ch speaks with a normal voice volume, and A to F look at Ch. Accordingly, A to F are regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to the each of A to F as messages, so that the display images of A to F are normal in the Ch's view. Ch's utterances with a normal voice volume are delivered to C as messages. In this event, as mentioned previously in Example 1, the dialog between C and F can be delivered to A to F as messages and be sequentially reproduced. A to F and Ch can be allowed to stop reproducing these messages.

<figref idref="DRAWINGS">FIG. 16-3</figref> shows C's view. Ch speaks with a normal voice volume while C looks at Ch. Accordingly, C is regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to C as messages, so that Ch's messages are delivered to C. A looks at Ch and the direction from C to A is some degrees away from the facing direction of C. Accordingly, A is regarded as sitting at a distance and in a direction from C which allow none of C's utterances with a normal voice volume to be delivered to A as messages. Thus, the display image of A is darkened in the C's view.

<figref idref="DRAWINGS">FIG. 16-4</figref> shows F's view. Ch speaks with a normal voice volume while F looks at Ch. Accordingly, F is regarded as sitting at a distance and in a direction from Ch which allow Ch's utterances with a normal voice volume to be delivered to F as messages, so that Ch's messages are delivered to F. A and B look at Ch and the directions from F to A and to B are some degrees away from the facing direction of F. Accordingly, A and B are regarded as sitting at a distance and in a direction from F which allow none of F's utterances with a normal voice volume to be delivered to the each of A and B as messages. Thus, the display images of A and B are darkened in the F's view.

As mentioned previously in Example 1, whether or not to deliver an utterance as a message is determined according to the interest levels of speaker's avatar and listener's avatar, each of which is automatically determined on the basis of each direction from one to the other and a distance between the avatars. By contrast, as mentioned previously in Example 2, a voice volume of an utterance is set as utterance strength in addition to such interest levels. Thus, if a value obtained from the utterance strength and the interest levels exceeds a predetermined threshold value, the corresponding utterance is delivered to the listener's avatar as a message. Accordingly, whether or not to deliver an utterance as a message can be determined by a method similar to that in real-world conversation. This allows a user of an avatar representing himself/herself to automatically select to which avatar to deliver an utterance as a message, only by causing the user's avatar to behave in a virtual space as if it were in the real world, more specifically, to appropriately move and to speak with an appropriate voice volume.

<figref idref="DRAWINGS">FIG. 17</figref> shows an example of a hardware configuration of an information processor <b>100</b> as a typical example of a hardware configuration of the dialog server <b>10</b>, the speaker-user terminal <b>21</b> and the listener-user terminal <b>22</b> described in the <figref idref="DRAWINGS">FIG. 1</figref>. The information processor <b>100</b> includes a central processing unit (CPU) <b>1010</b>, a bus line <b>1005</b>, a communication I/F <b>1040</b>, a main memory <b>1050</b>, a basic input output system (BIOS) <b>1060</b>, a parallel port <b>1080</b>, an USB port <b>1090</b>, graphics controller <b>1020</b>, a VRAM <b>1024</b>, an audio processor <b>1030</b>, an I/O controller <b>1070</b>, and input means including a keyboard and a mouse adapter and the like <b>1100</b>. To the I/O controller <b>1070</b>, the storage means including a flexible disk (FD) drive <b>1072</b>, a hard disk <b>1074</b>, an optical disk drive <b>1076</b> and a semiconductor memory <b>1078</b> can be connected. An amplification circuit <b>1032</b> and a speaker <b>1034</b> are connected to the audio processor <b>1030</b>. A display <b>1022</b> is connected to the graphics controller <b>1020</b>.

The BIOS <b>1060</b> stores a boot program that the CPU <b>1010</b> executes at the time of the boot-lip of the information processor <b>100</b>, a program dependent on the hardware of the information processor <b>100</b>. The FD drive <b>1072</b> reads a program or data from the flexible disk <b>1071</b>, to provide it to the main memory <b>1050</b> or the hard disk <b>1074</b> through the I/O controller <b>1070</b>.

As the optical disk drive <b>1076</b>, for example, a DVD-ROM drive, a CD-ROM drive, a DVD-RAM drive and a CD-RAM drive can be employed. Note that an optical disk <b>1077</b> supported in the employed drive needs to be used. The optical disk drive <b>1076</b> can read a program or data from the optical disk <b>1077</b> to provide it to the main memory <b>1050</b> or the hard disk <b>1074</b> through the I/O controller <b>1070</b>.

Each computer program to be provided to the information processor <b>100</b> is provided by a user in the form of being stored in a recording medium, such as the flexible disk <b>1071</b>, the optical disk <b>1077</b> or a memory card. The provided computer program is read out from the recording medium through the I/O controller <b>1070</b>, or is downloaded through the communication I/F <b>1040</b>, and thereby is installed in and executed by the information processor <b>100</b>. The operations that the computer program causes the information processor <b>100</b> to perform are the same as those in the aforementioned devices, and accordingly the description thereof will be omitted.

The above computer programs can be stored in an external recording medium. The recording medium used here can be the flexible disk <b>1071</b>, the optical disk <b>1077</b> or a memory card, or can alternatively be a magneto-optical recording medium such as an MD or a tape medium. Furthermore, the recording medium used here can be a storage device, such as a hard disk or an optical disk library, which is provided in a server system connected to a dedicated communication network or the Internet. In this case, the computer program can be provided to the information processor <b>100</b> through a communication network.

The above description has been given mainly of the hardware configuration example of the information processor <b>100</b>. However, it is possible to implement the functionality similar to that of the aforementioned information processor by installing, onto a computer, a program providing the functionality described as that of the information processor, and thus causing the computer to operate as the information processor. Accordingly, the information processor described as an embodiment of the present invention can alternatively be implemented by a method or a computer program thereof.

Each device of the present invention can be implemented as hardware, software, or a combination of hardware and software. A typical example of such implementation as a combination of hardware and software is a computer system including a predetermined program. In such a case, by being loaded and executed on the computer system, the predetermined program causes the computer system to perform processing according an embodiment of the present invention.

The program is composed of a group of instructions which can be written in any language, codes, or notations. Such a group of instructions allow the system to directly execute specific functions, or to execute the specific functions after (1) the instructions are converted into different language, codes or notations, and/or (2) the instructions are copied to a different medium.

The scope of the present invention includes not only such a program itself, but also program products, such as a medium storing the program therein. The program for executing the functions of the present invention can be stored in any computer readable medium, such as a flexible disk, an MO, a CD-ROM, a DVD, a hard disk device, a ROM, an MRAM, and a RAM. Specifically, this program can be stored in the computer readable medium by being downloaded to the medium in a computer system from another computer system connected thereto through a communication line, or by being copied from a different medium.

The program can either be compressed and, thereafter stored in a single recording medium or be divided into pieces and stored in multiple recording media.

Although the present invention has been described by use of the embodiment, the invention is not limited to these embodiments. The effects described in the embodiment of the present invention are merely a list of the most preferable effects provided by the present invention, and the effects of the present invention are not limited to those described in the embodiment or the examples of the present invention.