Communication system, communication method, communication program and information processor

Description: TECHNICAL FIELD [Detailed description of the invention]

【0001】

[Field to which the invention belongs]

According to the present invention, by transmitting and receiving arbitrary data among image data, voice data, character data, and control data between a plurality of information processing devices connected to a computer network, between users of each information processing device. Regarding communication systems and communication methods for mutual communication of intentions and emotions. Further, the present invention relates to a communication program and an information processing device that realize such a communication system and a communication method.

【0002】

[Conventional technology]

Conventionally, the so-called Internet (The Internet) has become widespread as a computer network to which a large number of computer devices are connected. The Internet makes it possible to freely send and receive various information between computers using various protocols (interconnection procedures) represented by TCP / IP (Transmission Control Protocol / Internet Protocol). There is.

【0003】

By the way, in the case of mutual communication (communication) of intentions and emotions between users of computer devices connected to the Internet, the following methods have been mainly used conventionally.

【0004】

The first method is to communicate using e-mail. An e-mail is a data group whose basic structure is a destination e-mail address and a text content described by character data, and is based on the e-mail address from the source computer device to the destination computer device. Will be delivered. In recent years, it has become common to attach a file containing image data, voice data, etc. to an e-mail and send it. In this way, by sending and receiving e-mails between users, information such as character data, image data, or voice data can be exchanged, and communication can be achieved thereby.

【0005】

The second method is to communicate using a so-called chat program. The chat program is a program that immediately transmits character data input by one user to the other user while being activated on a plurality of computer devices connected to each other via the Internet. In this way, communication can be achieved between users by exchanging character data using a chat program.

【0006】

[Problems to be Solved by the Invention]

By the way, when communicating using e-mail, it takes a predetermined time to deliver the e-mail, and there is a time lag before the destination user browses the received e-mail. There was a problem that simultaneity (real-timeness) in communication between them was not always guaranteed.

【0007】

That is, in communication using e-mail, it is difficult to have a dialogue in which a reply from the other party is immediately returned, as in the case of a face-to-face dialogue in the real world. For this reason, it is difficult to accurately convey the continuously changing emotions and facial expressions of the user to the other user in communication.

【0008】

In addition, when communicating using a chat program, while having high real-time performance, the content to be sent and received is limited to character data, so changes in emotions and facial expressions between users should be communicated to the other party. There is a problem that it is difficult.

【0009】

In recent years, a so-called video chat program has been realized in which moving image data is transmitted / received instead of the character data transmitted / received in the above-mentioned chat program. A video chat program, for example, sends and receives moving image data such as a user's facial expression captured by an imaging device connected to or mounted on a computer device between users, so that it can be used with the other user like a television telephone. It is a program that sends and receives between.

【0010】

However, the video chat program has a problem that it is difficult for a large number of people to communicate at the same time because the moving image data to be transmitted and received becomes extremely large in size. In addition, since it is specialized in sending and receiving moving image data, it is difficult to easily send and receive character data as in the case of using e-mail, and various types such as character data, image data, and voice data. Data cannot be transmitted and received efficiently.

【0011】

Therefore, the present invention solves the above-mentioned conventional problems and realizes completely new communication between users, and in particular, by efficiently transmitting image data between information processing devices, each information processing device can be used. An object of the present invention is to provide a communication system, a communication method, a communication program, and an information processing device capable of realizing smooth and diverse communication between users.

【0012】

[Means for solving problems]

The communication system according to claim 1 of the present invention transmits and receives arbitrary data among image data, voice data, character data, and control data between a plurality of information processing devices connected to a computer network. In a communication system for mutual communication of intentions and emotions between users of each information processing device, the information processing device is temporarily stored in a storage means for storing various information and a transmission queue set in a storage area of the storage means. When the information transmission means for transmitting the accumulated information to another information processing device and the user of the information processing device select to transmit the moving image information, the stored information is mounted on the information processing device. Alternatively, when it is selected to generate still image data from the moving image data input from the connected imaging device at predetermined time intervals, output the still image data to the transmission queue, and transmit the still image information, the selected stillness is selected. It is provided with an image output means for outputting image data to the transmission queue.

【0013】

Further, the communication method according to claim 2 of the present invention is to send and receive arbitrary data among image data, voice data, character data, and control data between a plurality of information processing devices connected to a computer network. In a communication method for mutual communication of intentions and emotions between users of each information processing device, either moving image information or still image information is transmitted from a predetermined information processing device to another information processing device. When transmission of moving image information is selected in the transmission image selection step for selecting the information processing device and the transmission image selection step, a predetermined time is obtained from the moving image data input from the imaging device mounted on or connected to the information processing device. Still image data is generated for each, output to the transmission queue set in the storage means in the information processing device, and when transmission of still image information is selected in the transmission image selection step, the selected still image data is selected. It has an image output step of outputting image data to the transmission queue and an image transmission step of transmitting the still image data output to the transmission queue to another information processing device.

【0014】

Further, the communication program according to claim 3 of the present invention transmits and receives arbitrary data among image data, voice data, character data, and control data between a plurality of information processing devices connected to a computer network. In a communication program for mutual communication of intentions and emotions between users of each information processing device, the information processing device is made to execute a transmission image selection step, an image output step, and an image transmission step. Is. In the transmission image selection step, it is selected whether to transmit moving image information or still image information in response to a request from the user. In the image output step, when transmission of moving image information is selected in the transmission image selection step, the moving image data input from the imaging device mounted on or connected to the information processing device is stationary at predetermined time intervals. Image data is generated, output to a transmission queue set in the storage means in the information processing device, and when transmission of still image information is selected in the transmission image selection step, the selected still image data is output. Output to the above send queue. In the image transmission step, the still image data output to the transmission queue is transmitted to another information processing device.

【0015】

Furthermore, the information processing device according to claim 4 of the present invention transmits and receives arbitrary data among image data, audio data, character data, and control data to and from other information processing devices via a computer network. As a result, in an information processing device that mutually communicates intentions and emotions between users of each information processing device, it is temporarily stored in a storage means for storing various information and a transmission queue set in the storage area of the storage means. When the information transmission means for transmitting the information to another information processing device and the user of the information processing device select to transmit the moving image information, the data is mounted on or connected to the information processing device. When it is selected to generate still image data at predetermined time intervals from the moving image data input from the image processing device, output it to the transmission queue, and transmit the still image information, the selected still image data is selected. Is provided with an image output means for outputting the data to the transmission queue.

【0016】

In the present invention configured as described above, when moving image information is transmitted from a predetermined information processing device to another information processing device via a computer network, it is determined from the moving image data input from the imaging device. Still image data is generated every hour and output to the transmission queue shared when the still image information is transmitted. Therefore, it is possible to manage and control the data to be transmitted in common between the case of transmitting the moving image information and the case of transmitting the still image information.

【0017】

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. According to the present invention, by transmitting and receiving arbitrary data among image data, voice data, character data, and control data between a plurality of information processing devices connected to a computer network, between users of each information processing device. It is suitable for application when mutual communication (communication) of intentions and emotions is performed. Therefore, in the following, first, the configuration of a basic system that realizes such communication will be roughly described.

【0018】

In the following, as a computer network, a network form in which a plurality of information processing devices can be interconnected by using a so-called TCP / IP (Transmission Control Protocol / Internet Protocol) protocol group will be described. However, the present invention is not limited to the application to such a network form, and can be widely applied to the case of using a computer network in which various information is exchanged between a plurality of information processing devices. Is.

【0019】

Further, in the following, a case where a personal computer device for consumer use (hereinafter, simply referred to as a computer device) is used as an information processing device for exchanging various information will be described. However, the present invention is not limited to application to the case of using such a computer device, for example, various PDA (Personal Digital Assistants) devices, mobile phones equipped with communication functions, and the like. It can be widely applied to the case where various information processing devices are used.

【0020】

(1) Basic configuration of communication system [0021] [0021]

As shown in FIG. 1, for example, the communication system 1 described in this example is connected to a plurality of computer devices 10 in a state in which various information can be exchanged with each other via the Internet (The Internet) 11.

【0022】

Here, each computer device 10 may be directly connected to the Internet 11, or may be connected to the Internet 11 via a public network 15 using an ISP (Internet Service Provider) or the like. You may be. Examples of the public line network 15 include a telephone line network 15a, a cable television network 15b, an ADSL (Asymmetric Digital Subscriber Line) network 15c, and the like. At this time, the computer device 10 may be connected by wire or wirelessly as long as it can be connected to the Internet 11. For example, the computer device 10 may be configured to be connected to the Internet 11 via a so-called personal handyphone system (PHS) or the like.

【0023】

Each computer device 10 establishes a transmission path on the Internet 11 using the TCP / IP protocol group while each is connected to the Internet 11, and various types of image data, audio data, character data, control data, etc. are established with each other. It is possible to exchange information with each other.

【0024】

(2) User terminal configuration [0025]

Next, the configuration of the computer device 10 constituting the above-mentioned communication system 1 will be described below.

【0026】

In the following, for convenience of explanation, a case where a digital video camera is mounted on the computer device 10 will be described. However, the computer device 10 may be connected to a digital video camera configured as an external device by wire or wirelessly, and may be connected to a computer network such as a LAN (Local Area Network) to which the computer device 10 is connected. Using a digital video camera that can be directly connected, the image data or audio data captured or recorded by the digital video camera may be taken into the computer device 10 via the computer network.

【0027】

As shown in FIG. 2, the computer device 10 has a CPU (Central Processing Unit) 20 that executes various arithmetic processes and controls each part in an integrated manner, and a RAM (Random Access Memory) 21 that functions as a work area of the CPU 20. A read-only ROM (Read Only Memory) 22 that stores information including various programs executed by the CPU 20 and various programs such as the operating system and application programs executed by the CPU 20 are recorded. HDD (Hard Disk) for recording and playback of various data, etc. Drive) 23, a display unit 24 that displays various information, a display interface 25 for exchanging data between the display unit 24 and the CPU 20, and for inputting various information and instruction operations by the user. Between the operation unit 26 of the above, the operation interface 27 for exchanging data between the operation unit 26 and the CPU 20, and the external device connected to the Internet 11 via the above-mentioned public network 15. A network interface 28 for sending and receiving data, a digital video camera 29 that shoots a subject and obtains video data and audio data, and compression coding and decoding based on the so-called MPEG2 (Moving Picture Experts Group phase 2) method. It has an MPEG2 codec 30 to perform.

【0028】

Of these parts, the computer device 10 has a CPU 20, RAM 21, ROM 22, HDD 23, display interface 25, operation interface 27, network interface 28, digital video camera 29, and MPEG2 codec 30 connected via bus 31. It is composed of.

【0029】

The digital video camera 29 in the computer device 10 may be connected to the bus 31 via, for example, a predetermined interface for connecting an external device, a network interface 28, or the like, without being mounted on the computer device 10. Further, in the computer device 10, for example, a removable type recording / reproducing device for recording / reproducing on a detachable recording medium is mounted or connected in addition to the HDD 23, and various data for the recording / reproducing device can be stored in the computer device 10. Recording and reproduction may be possible.

【0030】

The CPU 20 is connected to a RAM 21, a ROM 22, an HDD 23, a display interface 25, an operation interface 27, a network interface 28, a digital video camera 29, and an MPEG2 codec 30 via a bus 31. The CPU 20 controls each part in an integrated manner, and executes and processes an operating system and various application programs recorded in, for example, the HDD 23. In particular, the CPU 20 processes the execution of a communication program configured as one of the application programs. The details of this communication program will be described later.

【0031】

The RAM 21 functions as a work area when the CPU 20 executes various programs, and temporarily stores various data under the control of the CPU 20.

【0032】

The ROM 22 stores various programs and setting information necessary for starting the computer device 10. Various programs and setting information stored in the ROM 22 are read out when the computer device 10 is started and used by the CPU 20.

【0033】

The HDD23 records the operating system, application programs, etc., and records and reproduces various programs, data, etc. under the control of the CPU 20.

【0034】

The display unit 24 is composed of, for example, an LCD (Liquid Crystal Display), and under the control of the CPU 20, various information such as data recorded in the HDD 23 is displayed on the display screen. In particular, the display unit 24 displays the result of executing and processing the communication program described later under the control of the CPU 20, and displays a window for displaying buttons for performing various instruction operations on the communication program. Display the given graphical user interface on the display screen.

【0035】

The display interface 25 exchanges data between the CPU 20 and the display unit 24. That is, the display interface 25 supplies various information supplied from the CPU 20 via the bus 31 to the display unit 24.

【0036】

The operation unit 26 receives an operation by a user using a user interface such as a pointing device such as a keyboard or a mouse, or a rotary operation type switch such as a so-called jog dial, and transmits a control signal indicating an operation content via the operation interface 27. And supplies to CPU20.

【0037】

The operation interface 27 exchanges data between the CPU 20 and the operation unit 26. That is, the operation interface 27 supplies the control signal supplied from the operation unit 26 to the CPU 20 via the bus 31.

【0038】

The network interface 28 functions as an interface for communicating with the outside under the control of the CPU 20. That is, the network interface 28 is provided to exchange various information with and from another computer device 10 connected to the Internet 11.

【0039】

The digital video camera 29 includes a predetermined optical system for photographing a subject, a device for photoelectric conversion such as a CCD (Charge Coupled Devices), and the like. The video data and audio data obtained by the digital video camera 29 are supplied to the MPEG2 codec 30 via the bus 31 under the control of the CPU 20.

【0040】

The MPEG2 codec 30 performs compression coding based on the MPEG2 method on video data and audio data supplied from the digital video camera 29 via the bus 31 under the control of the CPU 20. At this time, the MPEG2 codec 30 compresses and encodes video data and audio data in real time under the control of the CPU 20. In addition, the MPEG2 codec 30 can also decode data that has been compressed and encoded based on the MPEG2 method.

【0041】

(3) Outline of communication program [0042]

Next, the communication program executed by the computer device 10 described above will be described below.

【0043】

The communication program is composed of a series of programs in which a plurality of modules that realize individual functions can be freely combined, and is recorded in, for example, the HDD 23 of the computer device 10. The computer device 10 executes this communication program by the CPU 20 to exchange various information such as image data, audio data, or character data with and from other computer devices, and thereby between users of each computer device. It enables mutual communication (communication) of intentions and feelings in the computer. The communication program can also be provided by a predetermined recording medium such as a so-called compact disc or a transmission medium such as the Internet 11.

【0044】

The communication program executed by the computer device 10 communicates with a communication program executed by another computer device by a so-called server-client method. That is, in a plurality of communication programs in which the interconnection state is established, a function as a server is realized by a predetermined communication program, and another communication program operates as a client. However, the communication program operates in the virtual session mode when the execution process is started in the computer device 10 and the interconnection state with other communication programs is not established, that is, in the initial startup state, and the server operates. Alternatively, the session can be established by itself regardless of the client.

【0045】

Here, when a session is established between each communication program executed by the plurality of computer devices 10, connection setting information is exchanged between these communication programs. This connection setting information is generated by the computer device 10 when the communication program is started, and is used by the IP address set in the computer device 10 that is the source of the connection setting information and the communication program. It consists of a file that describes the port number and so on. The details of the connection setting information will be described later.

【0046】

Then, when the connection setting information is sent from the communication program to another communication program, the communication program that has acquired the connection setting information is based on the IP address, port number, etc. described in the connection setting information. A connection process is performed on the computer device 10 (and by extension, the communication program executed by the computer device 10) that is the transmission source, and a session is established.

【0047】

At this time, the file containing the connection setting information is associated with the communication program by the extension, for example, and when this file is selected on the computer device by performing a so-called double-click operation, communication is automatically performed. The program is configured to start.

【0048】

In communication system 1, connection setting information is generated at startup, and the communication program on the side that sends this connection setting information to other communication programs functions as a server and starts based on the acquired connection setting information. It is assumed that the communication program on the receiving side operates as a client.

【0049】

Here, when exchanging connection setting information between computer devices as described above, for example, an e-mail containing a message prompting the computer device 10 as a server to start a connection to the computer device as a client. It is realized by attaching a file containing connection setting information to and sending it.

【0050】

In the communication system 1 described in this example, connection setting information is sent using e-mail. For example, between computer devices connected to the Internet 11, such as so-called FTP software. By using an application program that realizes various file exchanges, connection setting information may be transmitted in the form of a data file or an application program. Further, for example, the connection setting information is directly exchanged between the computer devices without notifying the user of the computer device of the start of the connection, thereby making the user aware of the start of the connection (establishment of the session). It may be configured so that the communication program is automatically started on the computer device on the client side without any need.

【0051】

(4) Modular structure of communication program [0052]

Here, an example of the module structure in the communication program will be described with reference to FIG. The communication program is a core that provides the establishment of a session between the interface module 50 that controls the operation of the network interface 28 in the computer device 10 and the communication program executed in another computer device, for example, as shown in FIG. A module 51, a basic module 52 that provides basic functions in a communication program, a plurality of application modules 53 that provide individual functions, and a graphical user interface (hereinafter referred to as GUI: Graphical User Interface). It is composed of GUI module 54 that manages the interface.

【0053】

The interface module 50 is configured as an API (Application Program Interface), and has image data, audio data, character data, etc. with a program executed by another computer device via a computer network such as the Internet 11. It is a module that establishes a transmission path for various types of information and makes it possible to easily process the details of network communication with a simple command system. As the interface module 50, for example, "Direct Play" of Microsoft Corporation can be used.

【0054】

The core module 51 has a session management function for establishing a session with another communication program and managing the established session. Specifically, for example, a connection setting information creation function for creating connection setting information, a session establishment function for establishing a session, a data transmission / reception function for sending / receiving data between communication programs, and a session for managing players in an established session. The internal player management function and the like are provided by the core module 51 as a session management function.

【0055】

Here, in the communication system 1, there are a communication program that serves as a server and a communication program that serves as a client. The server-side communication program refers to the destination of this data and transfers the data sent from the client-side communication program to another client-side communication program designated as the destination. Therefore, in the communication system 1, it is necessary to establish a session when exchanging various information such as image data, voice data, or character data. Therefore, in the communication program, the session management function is provided by the core module 51 as an interface for establishing and managing such a session.

【0056】

The core module 51 acquires an IP address, a port number, and the like, and generates a file in which connection setting information is described. In addition, this file is encrypted and decrypted. Further, when operating as a client, the core module 51 connects to a computer device on the server side based on the IP address and port number described in the acquired connection setting information. This establishes the session.

【0057】

In addition, the core module 51 manages the communication program (player) existing in the session. Specifically, for example, a list of players is generated or acquired, and unique identification information (player ID) assigned to each player is acquired or managed. In addition, the core module 51 establishes a connection with a new player, disconnects from a predetermined player, changes player information including information such as connection status and connection name for each player, and the like. When an event occurs, this event is notified to the basic module 52 and each application module 53.

【0058】

Further, the core module 51 has an application module management function that controls each of the plurality of application modules 53. Specifically, for example, startup management of each application module 53 and data transmission / reception with each application module 53 are performed.

【0059】

Specifically, for example, the core module 51 acquires module information about the application module 53 implemented in the communication program from a predetermined storage area of the computer device 10 and lists the implemented application module 53. This module information is composed of, for example, module identification information unique to each application module, GUI information which is information about GUI, flag information indicating whether or not to start operation at the same time as starting a communication program, and the like. .. Then, the core module 51 manages the startup state of each application module 53 based on this module information.

【0060】

Further, the core module 51 starts the application module 53 that has not been started, and controls the display / non-display switching of the display unit 24 of the computer device 10.

【0061】

Here, as an example of the operation of the core module 51, a case where data is transmitted from one communication program on the client side to the other communication program via the communication program on the server side is referred to with reference to FIG. explain.

【0062】

In this case, the core module 51a operating on the data transmission side receives the data transmitted from the basic module 52 and the application module 53, adds a transmission header to this data, and refers to the communication program on the server side. And send. When transmitting to the server side in this way, the content of the received data is not involved.

【0063】

On the other hand, the core module 51b operating on the server side refers to the transmission header included in the data acquired from the data transmission side and transmits data to the communication program on the data reception side described as the destination in this transmission header. Send the data acquired from the side.

【0064】

Further, the core module 51c operating on the data receiving side refers to the transmission header included in the acquired data and passes this data to the predetermined application module 53. At this time, the core module 51c starts the application module 53 when the corresponding application module 53 is not started as the data transfer destination in the communication program on the data receiving side.

【0065】

Further, when the application module 53 corresponding to the communication program on the data receiving side does not exist, the core module 51c transmits a message indicating this to the communication program on the data transmitting side. At this time, the core module 51c passes this data only to the running application module when all the application modules 53 are specified as the application module 53 to be passed the acquired data. ..

【0066】

The core module 51 operates as described above to transfer data between communication programs operating as clients.

【0067】

On the other hand, the basic module 52 is a module having a function of preparing various windows used in a communication program. In addition, the basic module 52 has a setting function for setting various information required for execution processing of the communication program, and an e-mail that attaches the connection setting information to the e-mail and sends it to the client side when establishing a session. It has a transmission function and the like.

【0068】

Further, a plurality of application modules 53 are implemented in the communication program as needed, and each has a function of providing a unique function. In the communication program in this example, the application module 53 includes the personal information management module 53a, the image transmission module 53b, the voice data transmission / reception module 53c, the Web function module 53d, the chat content transfer module 53e, the chat log module 53f, and the emotion expression module 53g. , Action module 53h, live appearance module 53i, etc. are implemented.

【0069】

The personal information management module 53a is a module that manages personal information such as image data and name information corresponding to each communication program existing in the session, that is, each user (player).

【0070】

In this communication program, in the first activated state, the user is requested to input and acquire an image, a name, and the like corresponding to the user. At this time, a display request is transmitted to the personal information management module 53a via the core module 51. Upon receiving the display request from the other module in this way, the personal information management module 53a sends a predetermined acquisition request to the GUI module 54 to acquire the corresponding personal information and displays it on the computer device 10. Display the predetermined personal information in the predetermined area in the window.

【0071】

In addition, when the personal information management module 53a receives a player information update request from another module, the personal information management module 53a acquires personal information from the personal information management module 53a in another communication program whose connection has been established via the network. Send a request. At this time, the personal information management module 53a on the side that has acquired the personal information acquisition request acquires its own personal information and returns it as a display notification.

【0072】

Such a player information update request is transmitted by the core module 51 to the personal information management module 53a, for example, when a new user enters the communication system 1.

【0073】

The image transmission module 53b is a module that provides additional processing, deletion processing, selection processing, and the like of image data. Further, the image transmission module 53b performs various controls such as on / off switching control of the shooting state for the digital video camera 29 mounted on or connected to the computer device 10. When the shooting state of the digital video camera 29 is on, the image data transmission process is performed while monitoring the load of the communication state on the Internet 11. In the image transmission module 53b, transmission to another communication program can be performed by non-guaranteed communication according to the setting by the user. In this case, even if the transmitted image data is lost in the middle of the transmission line, it is not retransmitted.

【0074】

The audio transmission / reception module 53c corresponds to the image transmission module 53b, and is a module that provides addition processing, deletion processing, selection processing, and the like of audio data. Further, the voice transmission / reception module 53c has a function of realizing transmission / reception of voice data between communication programs by using the voice function implemented in the interface module 50. In the communication system 1, it is possible to turn on the voice output in the communication program on the client side only when the voice output is turned on in the communication program on the server side. Further, the voice data transmitted from the communication program on the client side is mixed by the voice transmission / reception module 53c implemented in the communication program on the server side, and is transmitted to the communication program on the client side again.

【0075】

The Web function module 53d acquires various information such as hypertext and image data held in the computer device 10 on which the communication program is executed or another computer device connected to the Internet 11, and enters the communication program window. It is a module that provides a Web information display function that displays various acquired information in a predetermined display area in the above. In addition, the Web function module 53d has a URL sharing function for sharing a URL (Uniform Resource Locator) indicating the location and acquisition method of various information (resources) existing on the Internet 11 with other communication programs. Details of this URL sharing function will be described later.

【0076】

The chat content transfer module 53e acquires the character data input based on this event when an event indicating that the character data has been input to the GUI module 54 is notified from the GUI module 54. It is a module that sends a chat message notification including the acquired character data to all other communication programs for which a session has been established. When the chat content transfer module 53e receives the chat message notification, the chat content transfer module 53e requests the GUI module 54 to display the character data included in the chat message notification. As a result, a so-called "speech balloon" -shaped character display area is secured at a predetermined position in the window of the communication program, and character data is displayed in this area.

【0077】

The chat log module 53f records input or received character data based on a chat message notification sent from the chat content transfer module 53e, and generates a chat log file. The chat log module 53f stores character data corresponding to a predetermined storage capacity in the RAM 21 of the computer device 10, and saves the character data stored in the RAM 21 to the HDD 23 or the like as necessary to save the character data stored in the RAM 21 to a chat log file. To generate. In addition, the chat log module 53f has a function to acquire the character data stored in the chat log file and display it in a predetermined area in the window of the communication program when a request to display the chat log is made. doing.

【0078】

The emotion expression module 53g is a module for reading and displaying animation effects related to emotion expression, which will be described in detail later. Further, the emotion expression module 53g requires the GUI module 54 to display a button selected when expressing an emotion.

【0079】

Further, when the emotion expression module 53g receives the notification that the predetermined button is selected by the GUI module 54, the emotion expression data (animation data) corresponding to this button is transmitted to all the communication programs for which the session has been established. And send. On the other hand, when the emotional expression data is received, the GUI module 54 is requested to display the emotional expression data. The details of emotional expression will be described later.

【0080】

The action module 53h is a module for reading and displaying action data, which will be described in detail later. Further, the action module 53h requests the GUI module 54 to display a button selected when displaying the action.

【0081】

In addition, when the button selected when displaying the action is selected by the user, the action module 53h provides the action data (animation data) corresponding to the selected button to all communication programs for which a session has been established. Send to. On the other hand, when the action data is received, the GUI module 54 is requested to display the action data. The details of the action display will be described later.

【0082】

The live appearance module 53i is a module that operates in cooperation with a live distribution program that performs live distribution of image data and audio data via the Internet 11. Since the live appearance module 53i is implemented in the communication program, it is possible to exchange image data, audio data, etc. with an external live distribution program.

【0083】

The application module 53 is composed of various modules as described above. The communication program is not limited to the number and functions of the application modules 53 to be implemented, and in addition to the various modules described above, modules that provide their own functions are one of the application modules 53. It may be implemented. Further, in the communication program, it is possible to add or delete the application module 53 as needed.

【0084】

The GUI module 54 is a module that provides a screen display such as a window display generated by a communication program. However, the basic drawing of various windows such as the dialog box is provided by the basic module 52. The GUI module 54 draws in a window in response to a screen display request made from another module, and displays a function selection button, image data, and the like.

【0085】

This GUI module 54 has information on the position and arrangement of function selection buttons, the display position of image data, and the overall arrangement and configuration in the window, but regarding the number and contents of function selection buttons, It is displayed by referring to the data included in the request by the core module 51 or each application module 53.

【0086】

The application module 53 implemented in the communication program can use the application display area that can be independently drawn without depending on the GUI module 54. When the screen is displayed using such an application display area, the GUI module secures the application display area in response to the request from the application module 53, and the drawing process in the secured application display area is performed by the application. It can be done on the module 53 side.

【0087】

Further, when the function selection button or the like displayed in the window is selected by the user, the GUI module 54 sends an event indicating that this function selection button is selected to the basic module 52 or the application module 53. It has a function to notify.

【0088】

As described above, the communication program is composed of a plurality of modules, and each module is configured to operate in cooperation with each other as needed.

【0089】

(5) Connection setting information [0090]

Next, the connection setting information used when establishing a session between computer devices in the communication system 1 will be described. The connection setting information is information generated in a computer device on which a communication program serving as a server is executed.

【0091】

As shown in FIG. 5, for example, the connection setting information includes an access key for performing authentication when the communication program serving as a client establishes a session with the communication program serving as a server, and a computer device 10 used by the communication program. The port number of the network interface 28, the number of IP addresses set in the computer device 10 on which the server communication program is executed, and the series of IP addresses set in the computer device 10 in which the server communication program is executed. It is composed of such as.

【0092】

(6) Basic processing by communication program [0093]

In the following, a basic series of processes when the above-mentioned communication program is executed in the computer device 10 will be described step by step with reference to the flowcharts shown in FIGS. 6 and 7.

【0094】

When the execution process is started (started), the communication program starts the module for which the start flag is set by referring to the function module list in step S10 shown in FIG. The function module list has a data structure as shown in FIG. 8, for example, and for each module constituting the communication program, the identification information (ID) unique to the module, the module name unique to the module, and the execution of the module are executed. It is composed of a type that indicates the form and usage conditions, and a startup flag that indicates whether or not to start according to the conditions at the time of startup. The details of the start flag will be described later, but the communication program can select and start the module to be started according to the conditions at the time of start by referring to the function module list.

【0095】

Next, in step S11, the communication program determines whether or not the connection setting information is received from the communication program executed by the other computer device. As a result of this determination, if it is received, the process proceeds to step S12, and if it is not received, the process proceeds to step S13.

【0096】

Here, when the communication program receives the connection setting information, the communication program operates as a client and sends and receives various information to and from the communication program on the server side which is the source of the connection setting information. Will be done. On the other hand, when the connection setting information is not received, the communication program operates as a server.

【0097】

In step S12, the communication program performs a process of establishing a session with the server-side communication program that is the source of the connection setting information based on the received connection setting information.

【0098】

In step S13, the communication program is required to operate as a server, and determines whether or not to start the server module that provides the server function. This determination corresponds to the determination in step S11, and is performed by determining whether or not the connection setting information has been received from a communication program executed by another computer device. Then, as a result of this determination, when the server module is started, the process proceeds to step S14, and when operating as a client without starting the server module, the process proceeds to step S17.

【0099】

In step S14, the communication program determines whether or not a session has been established and connected to the server module started by itself. As a result of this determination, if the connection has not yet been made, the process proceeds to step S15, and if the connection has already been made, the process proceeds to step S17.

【0100】

In step S15, the communication program starts the server module that provides the server function. Next, in step S16, the communication program establishes a session and connects to the server module started by itself. As a result, in the communication program, the function as a server is realized by the server module started by itself, and the modules other than the server module can connect to the server module as a so-called client. It will be possible.

【0101】

In the communication program, since the server function is realized as a module in this way, even if it operates as a server, modules other than the server module can be used by the same procedure as when operating as a client. It becomes possible to access the server. Therefore, the processing procedure in these other modules can be simplified. In step S16, after the session for the server module is established, the communication program proceeds to step S17.

【0102】

In step S17, the communication program displays a window on the screen of the computer device 10, and various instruction operations by the user can be input by the input area displayed in the window, various function selection buttons, and the like. .. Then, in step S17, the communication program determines whether or not the above-mentioned function selection button is selected by the user and the function module corresponding to this function selection button is activated. As a result of this determination, if the function module is started, the process proceeds to step S18, and if it is not started, the process proceeds to step S19.

【0103】

In step S18, the communication program activates the function module corresponding to the function selection button selected in step S17. Then, after activating the function module, the communication program proceeds to step S19.

【0104】

In step S19, the communication program determines whether or not there is a message to be sent in the message transmission queue. Then, if the message exists in the message transmission queue, the process proceeds to step S20, and if the message does not exist, the process proceeds to step S21 shown in FIG. 7.

【0105】

Here, when the communication program exchanges various information such as image data, voice data, or character data with another communication program, the information is divided into information units called messages. Then, the message to be transmitted to the communication program of the other party is temporarily stored in the message transmission queue, and the message received from the communication program of the other party is temporarily stored in the message reception queue. The message transmission queue and the message reception queue are, for example, reserved in advance by a predetermined capacity in the storage area in the RAM 21 of the computer device 10.

【0106】

In step S20, the communication program sends the message existing in the message transmission queue to the server on which the session is established. After the process in step S20, the communication program proceeds to step S21 shown in FIG.

【0107】

In step S21, the communication program determines whether or not the message received from the server exists in the message reception queue. Then, if the message exists in the message reception queue, the process proceeds to step S22, and if the message does not exist, the process proceeds to step S25.

【0108】

In step S22, the communication program determines whether or not the functional module to which the message is sent, that is, the functional module that uses this message has been activated. As a result of this determination, if the corresponding functional module as the destination has not been started yet, the process proceeds to step S23, and if it has already been started, the process proceeds to step S24.

【0109】

In step S23, the communication program activates the activation module to which the message is sent. Then, after activating the corresponding functional module as the destination, the communication program proceeds to step S24.

【0110】

In step S24, the communication program transmits the message to the corresponding functional module as the destination of the message existing in the message transmission queue. After the process in step S24, the communication program advances the process to step S25.

【0111】

In step S25, the communication program determines whether or not it is requested to end the execution operation by performing a predetermined instruction operation from the user. As a result of this determination, if it is requested to end, the process proceeds to step S26, and if it is not requested to end, the process proceeds to step S13 shown in FIG. Repeat the series of processes after step S13.

【0112】

In step S26, the communication program determines whether or not the server module that realizes the server function is started by itself. That is, it is determined whether or not the communication program is operating as a server. As a result of this determination, if the server module is started by itself, the process proceeds to step S27, and if the server module is not started by itself and is operating as a client, various termination processes are performed. , Stops a series of processing operations.

【0113】

In step S27, the communication program performs termination processing on the server module started by itself in step S15, and stops the operation of this server module. After this, the communication program performs various termination processes and stops a series of processing operations.

【0114】

Next, a series of processes in the server module started in step S15 described above will be described step by step with reference to the flowcharts shown in FIGS. 9 and 10.

【0115】

When the execution process is started, the server module determines whether or not a connection request (session establishment request) from the client has been received in step S50 shown in FIG. At this time, the client may be another functional module that constitutes a communication program that started the server module, or may be a functional module that constitutes a communication program executed by another computer device. Then, as a result of this determination, if the connection request is received, the process proceeds to step S51, and if it is not received, the process proceeds to step S55.

【0116】

In step S51, the server module determines whether the number of currently connected users has reached a preset maximum number. As a result of this determination, if the maximum number of people has not been reached, the process proceeds to step S52, and if the maximum number of people has been reached, the process proceeds to step S55.

【0117】

In step S52, the server module generates a user ID, which is information unique to each user, for the user who newly made the connection request, and establishes a session with the communication program running on the user side. To connect. As a result, the communication program that operates on the user side that made the connection request acts as a client, and the communication state is established with the server module, and various information such as image data, audio data, or character data is exchanged. Is possible.

【0118】

Next, in step S53, the server module acquires the IP address of the computer device that executes the communication program on the side of the user who newly made the connection request and the user name of this user, and these IP addresses and the user name. And the user ID generated in step S52 are added to the user list.

【0119】

Here, the user list has a data structure as shown in FIG. 11, for example, the user ID of the user who established the session for the server module, the user name of this user, and the user side. It consists of the IP address of the computer device that executes the communication program.

【0120】

Next, in step S54, the server module notifies all the clients for which the session has been established, such as the user ID of the user added in step S53. This allows all clients connected to the server module to know that a new user has been connected. After the process in step S54, the server module proceeds to step S55.

【0121】

In step S55, the server module determines whether or not the connection state has been disconnected with the client for which the session has been established. As a result of this determination, if the connection state is disconnected, the process proceeds to step S56, and if the connection state is not disconnected, the process proceeds to step S58 shown in FIG. At this time, as factors that cause the connection state to be disconnected, for example, a defect that occurs in the transmission line between the server module and the client, a user's termination process of the communication module, and the like can be mentioned.

【0122】

In step S56, the server module deletes the information about the user determined to be disconnected in step S55 from the user list. Next, in step S57, the server module notifies all clients for which a session has been established information such as a user ID related to the user deleted from the user list in step S56. As a result, all clients connected to the server module can know that the user's connection has been disconnected. After the process in step S57, the server module proceeds to step S58 shown in FIG.

【0123】

In step S58, the server module determines whether a message has been sent from the connected client. As a result of this determination, if it is transmitted, the process proceeds to step S59, and if it is not transmitted, the process proceeds to step S61.

【0124】

In step S59, the server module refers to the user ID specified as the destination of the message, and acquires the IP address corresponding to the user ID based on the user list. Next, in step S60, the server module transmits a message to the computer device in which the IP address acquired in step S59 is set via a computer network such as the Internet 11. This delivers the message to the destination communication program. After the process in step S60, the server module proceeds to step S61.

【0125】

In step S61, the server module determines whether or not a termination request from the communication program has been received. Then, when the end request is received as a result of this determination, various end processes are performed to stop a series of processing operations. If the end request has not been received, the process proceeds to step S50 shown in FIG. 9, and the series of processes after step S50 described above are repeated. The termination request for this server module corresponds to the case where step S27 in the series of processing of the communication program shown in FIG. 7 is processed.

【0126】

A communication program is an application program that performs a series of processes as described above. As is clear from the description of the series of processes described above, the communication program can operate as a server or a client as needed.

【0127】

(7) Application window displayed by the communication program [0128]

Next, the application window displayed on the screen of the display unit 24 when the above-mentioned communication program is executed and processed in the computer device 10 will be described step by step with reference to the drawings.

【0129】

The communication program is configured to be displayed in a window according to the conditions at the time of startup, as described in detail later. However, in the following description, the execution process is performed under the most basic conditions. An example of the case where this is done shall be described.

【0130】

Further, in the communication system 1, each computer device 10 is provided in a state in which a communication program can be executed, and the communication program operates on each computer device 10 to exchange various information with each other. In the description of the above, the window display when the communication program running on the specific computer device 10 is executed and processed will be described.

【0131】

Further, in the following description, the user of the communication program described by paying attention is referred to as a "user", and the user of the communication program connected to the communication program, that is, the user of the other party is referred to as a "client". I will do it. However, the communication program described by focusing on the following does not necessarily have to fulfill the server function, and the server function may be fulfilled by the communication program operating on the other side user (client) side.

【0132】

When the execution process of the communication program is started, the user information setting window 100 as shown in FIG. 12 is displayed on the screen of the display unit 24. This user information setting window 100 is a window for prompting the user to select a name and a face image corresponding to himself / herself when starting a communication program, and corresponds to a text input area S100 for inputting a name as text and a face image. It has a face image selection area S101 for selecting the created image file.

【0133】

The text input area S100 is an area in which text can be input by selecting it with a mouse or the like connected to the computer device 10, and text input by a keyboard or the like is input in this state. The text input to the text input area S100 is set as the user's name in the subsequent processing of the communication program.

【0134】

The face image selection area S101 is an area in which file names corresponding to image data stored in the computer device 10 registered in advance as a face image are displayed in a list. When the file name listed in the face image display area S101 is selected by the user, the image data corresponding to the selected file name is set as the user's face image in the subsequent processing of the communication program.

【0135】

Further, the user information setting window 100 has a reference button S102 for referencing a file corresponding to the image data when the user sets arbitrary image data as a face image. When the browse button S102 is selected, a file selection window for selecting image data existing in the computer device 10 is displayed. Then, when the user selects and operates a file in this file selection window, the image data corresponding to the selected file is set as the user's face image. Further, the location (path) of the file selected in this way in the computer device 10 is displayed in the path display area S103 of the user information setting window 100. It should be noted that arbitrary image data (file) may be selectable as a face image by directly inputting the text for specifying the path in the path display area S103.

【0136】

Further, the user information setting window 100 has a preview display area S104 that preview-displays the contents of the image data selected by the user as described above. This makes it possible for the communication program to easily and surely select the facial image desired by the user.

【0137】

Note that FIG. 12 illustrates an example in which a so-called default face image, which is in a preselected state, is displayed in the preview display area S104. In the following description, it is assumed that the user does not particularly select the face image in the user information setting window 100 and the default face image is selected.

【0138】

The user information setting window 100 has a check box S105 for setting whether or not to select the name and face image as described above at the next startup, and a check box S105 for ending the name and face image selection operation. It has an OK button S106 and a cancel button S107 for canceling the name and face image selection operations and stopping the activation of the communication program.

【0139】

When the check box S105 is set to "On", the communication program displays the user information setting window 100 the next time it is started. On the other hand, when the check box S105 is set to "off", the display of the user information setting window 100 is omitted at the next startup, and the name and face image set last time by the user are referred to and used.

【0140】

Here, when the OK button S106 in the user information setting window 100 is selected by the user, the communication program shifts to the basic display mode and displays the basic display window 110 as shown in FIG. If the check box S17 is set to "Off" in the user information setting window 100 at the time of the previous startup, the display of the user information setting window 100 is omitted when the communication program is started, and the basic display mode is displayed immediately after the startup. The basic display window 110 is displayed.

【0141】

(7-1) Basic display mode [0142]

Here, the case where the communication program shifts to the basic display mode will be described with reference to the basic display window 110 shown in FIG.

【0143】

The basic display window 110 is a window displayed when the communication program shifts to the basic display mode, and as shown in FIG. 13, a user face image frame S110 in which a face image corresponding to the user is displayed, and a plurality of user face image frames S110. It has a plurality of client face image frames S111 in which face images corresponding to clients are displayed, and a plurality of function selection buttons S112 for selecting and operating execution of various functions.

【0144】

The user face image frame S110 is arranged in the center of the basic display window 110, and is located in a face image display area S110a for displaying a face image selected by the user and a lower part of the face image display area S110a. It is composed of a name display area S110b that displays the name set by the user.

【0145】

The client face image frame S111 is arranged at predetermined intervals on the circumference of a virtual circle centered on the user face image frame S110. These client face image frames S111 correspond to the user face image frame S110 and are frames for displaying information on the client side, and are a face image display area S111a for displaying a face image selected by each client, and a face image display area S111a, respectively. It is located below the face image display area S111a and is composed of a name display area S111b that displays the name set by each client.

【0146】

Note that FIG. 13 illustrates a state in which the client is not yet connected. In this state, the client face image frame S111 is in a state in which a predetermined predetermined face image indicating that the client is not connected is displayed.

【0147】

Further, each of the client face image frames S111 is displayed while gently moving in a predetermined area centered on the initial display position. As a result, in the basic display window 110, each client face image frame S111 is displayed with a so-called floating feeling.

【0148】

The function selection buttons S112 are arranged at predetermined intervals on a virtual circle centered on the user face image frame S110. The radius of the virtual circle on which the function selection button S112 is arranged is smaller than the radius of the virtual circle on which the client face image frame S111 is arranged. That is, the function selection button S112 is displayed located inside the client face image frame S111.

【0149】

A predetermined function is associated with each function selection button S112. When any one of the function selection buttons S112 is selected and operated by the user, the communication program shifts to the operation mode for realizing the function corresponding to the selected function selection button S112.

【0150】

In the example shown in FIG. 13, as the function selection button S112, the "setting" button S112a, the "end" button S112b, the "help" button S112c, the "friend" button S112d, and the "tool" button S112e are displayed. Shown.

【0151】

The setting button S112a is a function selection button for making various settings required for the communication program. The communication program has a setting window (not shown) that displays setting items such as whether or not to sound a sound effect when various operations are performed by the user when the setting button S112a is selected by the user. Is displayed. In the communication program, the items set by this setting window are saved in a predetermined storage area in the computer device 10 and reflected in the operation of the communication program itself.

【0152】

The end button S112b is a function selection button for ending the execution process of the communication program. The communication program ends the entire execution process when the end button S112b is selected by the user.

【0153】

The help button S112c is a function selection button for displaying help information that explains the operation of the communication program to the user. When the help button S112c is selected by the user, the communication program displays help information in which the operation guidance and the solution of the problem are described in the help window (not shown). Since the help information can be displayed in this way, in the communication program, it is possible to explain its own operation and function to a user who is unfamiliar with the operation in an easy-to-understand manner.

【0154】

The friend button S112d is a button for encouraging other users (clients) connected to the Internet 11 to connect to the communication program and participate in the communication. The communication program performs a series of processes for encouraging the client to participate by selecting the friend button S112d by the user. The details of this process will be described later.

【0155】

The tool button S112e is a function selection button for shifting to a tool mode that realizes various operations by the user. The communication program shifts to the tool mode when the tool button S112e is selected by the user. The details of this tool mode will be described later.

【0156】

In addition, the basic display window 110 is located at the top of the window, and a plurality of operation icons S113 for operating the display state of the basic display window 110 are arranged adjacent to each other and are located at the bottom of the window. Then, a status display area S114 in which the operating status (status) of the communication program and various messages are displayed is arranged as needed.

【0157】

Here, in the example shown in FIG. 13, when the "end" icon S113a, the "maximize" icon S113b, the "minimize" icon S113c, and the "display size change" icon S113d are arranged as the operation icons S113. It is shown in the figure.

【0158】

The end icon S113a is an operation icon for ending the execution process of the communication program. The communication program ends the entire execution process when the end icon S113a is selected by the user.

【0159】

The maximize icon S113b is an operation icon for enlarging and displaying the basic display window 110 on the entire display screen of the computer device 10. When the maximize icon S113b is selected by the user, the communication program performs a process of enlarging and displaying the basic display window 110 on the entire display screen of the computer device 10.

【0160】

The minimize icon S113c is an operation icon for stopping the display of the basic display window 110 and deleting it from the display screen of the computer device 10. When the minimize icon S113c is selected by the user, the communication program stops the display of the basic display window 110 and deletes it from the display screen of the computer device 10. In this way, even when the basic display window 110 is deleted from the display screen, the execution process of the communication program is continued.

【0161】

The display size change icon S113d is an operation icon for shifting to the reduced display mode for reducing the display of the basic display window 110. When the display size change icon S113d is selected by the user, the communication program shifts from the basic display mode to the reduced display mode. As a result, the display area of the basic display window 110 is reduced to, for example, the reduced display window 120 as shown in FIG.

【0162】

(7-2) Reduced display mode [0163]

Here, the case where the communication program shifts to the reduced display mode will be described with reference to the reduced display window 120 shown in FIG.

【0164】

The reduced display window 120 is a window that is displayed when the communication program shifts to the reduced display mode, has a smaller display area than the basic display window 110, and is a horizontally long window on the screen of the computer device 10. It is said to be in shape.

【0165】

Here, in the reduced display window 120 shown in FIG. 14, the description of the frame, the button, and the icon having the same functions as the basic display window 110 shown in FIG. 13 is omitted, and the same reference numerals are given. .. In the following description, the frames, buttons, and icons having the same reference numerals in the drawings will be described as corresponding to the above-mentioned ones.

【0166】

In this reduced display window 120, a plurality of client face image frames S111 are arranged side by side on both sides of the user face image frame S110 arranged in the center, and these user face image frames S110 and client face images are arranged side by side. Function selection buttons S112 are arranged side by side at the bottom of the frame S111. In addition, a plurality of operation icons S113 are arranged at the top of the reduced display window 120.

【0167】

When the display size change icon S113d is selected by the user in the reduced display window 120, the communication program shifts from the reduced display mode to the basic display mode. As a result, the display area of the reduced display window 120 is expanded to become the basic display window 110 shown in FIG.

【0168】

That is, in the communication program, by selecting the display size change icon S113d by the user, it is possible to freely shift the operation mode between the basic display mode and the reduced display mode.

【0169】

(7-3) Client participation [0170]

Here, the case where the friend button S112d described above is selected by the user will be described. When the friend button S112d is selected by the user, the communication program performs a series of processes for encouraging the client to participate.

【0171】

At this time, the communication program transmits the connection setting information to the client specified by the user. As a result, a session is established from the client side to the user side based on the IP address included in the connection setting information, and the connection is completed.

【0172】

Here, when the computer device 10 on the user side is in a network environment connected to the Internet 11 via a router device, the computer device 10 is only between the computer devices in the same network group. An identifiable IP address, a so-called private address, is set. In this case, computer devices can be connected only within the same network group, and a session can be appropriately established with computer devices belonging to other network groups, such as via the Internet 11. It may not be possible.

【0173】

Therefore, when transmitting the connection setting information to the client, the communication program determines whether or not a private address is set in the computer device 10 on the user side, and if the private address is set, for example, Display the notification window 130 as shown in FIG.

【0174】

The notification window 130 is a window in which the content of notifying the user that a session may not be established with the client due to the setting of the private address on the computer device 10 is described. , It has an "OK" button S130, a "Cancel" button S131, and a "Help" button S132.

【0175】

When the OK button S130 is selected by the user, the communication program performs a process of transmitting connection setting information to the client even if the IP address set in the computer device 10 is a private address. When the cancel button S131 is selected by the user, the process of transmitting the connection setting information to the client is stopped. When the help button S132 is selected by the user, help information, which is information describing operation guidance and a solution to a problem, is displayed in a help window (not shown).

【0176】

The communication program can display the notification window 130 as needed to indicate to the user the cause of the problem, for example, when a problem cannot be established with the client. it can. In addition, by describing the setting method of the computer device 10 and the router device in the help information, it is possible to urge the user to appropriately change the settings of the computer device 10 and the router device.

【0177】

By the way, when the communication program transmits the connection setting information to the client side, for example, a file including the connection setting information is attached to an e-mail, and this e-mail is transmitted to the computer device on the client side. At this time, for example, an e-mail having the content shown in the e-mail window 140 shown in FIG. 16 is transmitted to the client side.

【0178】

As shown in FIG. 16, the e-mail window 140 has a destination input area S140 in which the destination of this e-mail, that is, the e-mail address set in the computer device of the client prompting participation is input / displayed, and the e-mail. Subject input area S141 where the subject is input / displayed, attachment display area S142 where the file name of the file attached to this e-mail is displayed, and body display area where the body of this e-mail is input / displayed. It is composed of S143.

【0179】

In the subject input area S141, a text that urges the user to connect to a communication program and participate in communication, such as "communication invitation", is input. Further, in the attached file display area S142, the file name (for example, "Connect.qze") of the file including the connection setting information is displayed. Further, in the text display area S143, a communication program is started on the computer device to which the e-mail is sent by executing a file attached to this e-mail, and a session is established with the communication program on the user side. A message is written to prompt the establishment of.

【0180】

Then, for example, after the user inputs the e-mail address of the client prompting to participate in the destination input area S140, the e-mail transmission process is performed to set the connection in the form of a file attached to the e-mail. Information is sent to the client side.

【0181】

Note that the communication system 1 is not limited to transmitting connection setting information to the client side by e-mail, and is not limited to being transmitted between computer devices connected to the Internet 11, such as so-called FTP software. By using an application program that realizes various types of file exchange, connection setting information may be transmitted in the form of a data file or an application program. Further, for example, the connection setting information is directly exchanged between the computer devices without notifying the user of the computer device of the start of the connection, thereby making the user aware of the start of the connection (establishment of the session). It may be configured so that the communication program is automatically started on the computer device on the client side without any need.

【0182】

(7-4) Dialogue with the client [0183]

Here, when the connection setting information is transmitted to the client side as described above and the session is established with the client, for example, as shown in FIG. 17, for example, the client face image frame in the basic display window 110. Will display the face image and name of the connected client.

【0184】

In FIG. 17, two clients, a first client in which an image imitating a female half body is set and a second client in which an image imitating an animal face is set, are connected, and each of them is connected. The basic display window 110 in the state of being displayed in the first client face image frame S111a and the second client face image frame S111b is illustrated. In the following description, it is assumed that these first and second clients are connected.

【0185】

By the way, in the communication program, when the user face image frame S110 is selected by the user, for example, when the cursor overlaps the user face image frame S110 on the screen by operating the mouse, as shown in FIG. 18, the user face image frame The S110 is reduced and displayed, and the text input area S115 in which the user can input text (character data) is displayed at a position near the reduced user face image frame S110.

【0186】

The text input area S115 is an area having a so-called speech balloon -like outer shape in a general cartoon with respect to the reduced display user face image frame S110. Then, when the user inputs text to the text input area S115, the communication program transmits the input text (character data) to all of the currently connected clients.

【0187】

Further, when the communication program receives the text (character data) transmitted from the client in the same manner, as shown in FIG. 19, the communication program reduces and displays the client face image frame S111 corresponding to the client, and also reduces the display. A text display area S116 in which the text transmitted from the client is displayed is displayed at a position near the client face image frame S111. This text display area S116 is defined as an area having a so-called speech balloon -like outer shape in a general cartoon with respect to the reduced-displayed client face image frame S111.

【0188】

In FIG. 19, "Hello!" From the first client comprising text is sent, together with the first client face image frame S111a is displayed reduced, in the vicinity of the first client face image frame S111a The case where the text display area S116 is displayed is shown. Further, in the communication program, for example, when texts are transmitted from a plurality of clients at the same time, the text display area S116 corresponding to each client is displayed. That is, when texts are transmitted from four clients at the same time, the client face image frame S111 corresponding to each client is reduced and displayed, and a balloon-shaped text display area S116 is displayed for each.

【0189】

As described above, the communication program is capable of exchanging character data between the user and the client, and simultaneously exchanging texts between a plurality of clients. It is possible.

【0190】

In the communication program, text transfer using the text input area S115 and the text display area S116 text as described above is performed not only in the basic display window 110 in the basic display mode but also in the window in other operation modes. It is possible.

【0191】

(7-5) Tool mode [0192]

Here, the case where the communication program shifts to the tool mode will be described with reference to the tool display window 150 shown in FIG.

【0193】

The tool display window 150 is a window displayed when the communication program shifts to the tool mode, and as shown in FIG. 20, basically has the same configuration as the basic display window 110 shown in FIG. There is. Therefore, in the tool display window 150 shown in FIG. 20, the same or equivalent frames, buttons, and icons as the basic display window 110 shown in FIG. 13 will be omitted from the description and the same reference numerals will be given.

【0194】

The tool display window 150 has a plurality of function selection buttons S150 instead of the function selection button S112 shown in FIG. 13 as a difference from the basic display window 110. Similar to the function selection button S112 shown in FIG. 13, the function selection buttons S150 are arranged at predetermined intervals on a virtual circle centered on the user face image frame S110. The radius of the virtual circle on which the function selection button S150 is arranged is smaller than the radius of the virtual circle on which the client face image frame S111 is arranged. That is, the function selection button S150 is displayed located inside the client face image frame S111.

【0195】

A predetermined function is associated with each function selection button S150. When any one of the function selection buttons S150 is selected and operated by the user, the communication program shifts to an operation mode that realizes the function corresponding to the selected function selection button S150.

【0196】

In the example shown in FIG. 20, as the function selection button S150, the "emotion" button S150a, the "action" button S150b, the "help" button S150c, the "back" button S150d, the "image / audio" button S150e, and the "chat log" Indicates that the button S150f and the "Web browser" button S150g are displayed.

【0197】

The emotion button S150a is a function selection button for shifting to the emotion expression mode that realizes the emotion expression by the user. The communication program shifts to the emotion expression mode when the emotion button S150a is selected by the user. The details of this emotion expression mode will be described later.

【0198】

The action button S150b is a function selection button for shifting to the action expression mode that realizes the action expression by the user to other clients. The communication program shifts to the action expression mode when the action button S150b is selected by the user. The details of this action expression mode will be described later.

【0199】

The help button S150c corresponds to the help button S112c in the basic display window 110 shown in FIG. 13, and is a function selection button for displaying help information explaining the operation of the communication program to the user. When the help button S150c is selected by the user, the communication program displays help information in which the operation guidance and the method of determining the problem are described in the help window (not shown).

【0200】

The back button S150d is a function selection button for exiting the tool mode and shifting to the basic display mode. When the user selects the back button S150d, the communication program exits the tool mode and shifts to the basic display mode.

【0201】

The image / sound button S150e is a function selection button for shifting to the image / sound setting mode that realizes various setting operations related to the image and sound by the user. When the image / voice button 150e is selected by the user, the communication program shifts to the image / voice setting mode. The details of this image / sound setting mode will be described later.

【0202】

The chat log button S150f is a function selection button for shifting to the chat log display mode for displaying the chat log. The communication program shifts to the chat log display mode when the chat log button S150f is selected by the user. The details of this chat log display mode will be described later.

【0203】

The Web browser button S150g is a function selection button for shifting to the Web browsing mode. The communication program shifts to the Web browsing mode when the Web browser button S150g is selected by the user. The details of this Web browsing mode will be described later.

【0204】

Further, the communication program becomes the reduced display window 120 shown in FIG. 14 when the display size change icon S113d is selected by the user while the tool display window 150 is displayed. At this time, when the reduced display window 120 is displayed in the tool mode, the above-mentioned function selection button S150 is displayed in the reduced display window 120 shown in FIG. 14 instead of each function selection button S112. The Rukoto. Further, when the tool mode is entered in the state of the reduced display window 120 shown in FIG. 14, the above-mentioned function selection button S150 is displayed instead of each function selection button S112 in the state of the reduced display window 120. Will be done.

【0205】

That is, in the communication program, the window may be maximized or minimized corresponding to the maximize icon S113b and the minimize icon S113c, regardless of the operation mode. It is possible. In addition, each time the display size change icon S113d is selected by the user, it is displayed in a standard size corresponding to the basic display window 110 or the tool display window 150, or in a reduced size corresponding to the reduced display window 120. It is possible to be in a state. In the communication program, such a change in window size is also possible in the operation mode described below.

【0206】

(7-6) Emotional expression mode [0207]

Here, the case where the communication program shifts to the emotion expression mode will be described with reference to the emotion expression window 160 shown in FIG.

【0208】

The emotion expression window 160 is a window displayed when the communication program shifts to the emotion expression mode, and as shown in FIG. 21, basically has the same configuration as the basic display window shown in FIG. There is. Therefore, in the emotion expression window 160 shown in FIG. 21, the same or equivalent frames, buttons, and icons as the basic display window 110 shown in FIG. 13 will be omitted from the description and will be given the same reference numerals.

【0209】

The emotion expression window 160 has a plurality of function selection buttons S160 in place of the function selection button S112 shown in FIG. 13, as a difference from the basic display window 110. Similar to the function selection button S112 shown in FIG. 13, the function selection buttons S160 are arranged at predetermined intervals on a virtual circle centered on the user face image frame S110. The radius of the virtual circle on which the function selection button S160 is arranged is smaller than the radius of the virtual circle on which the client face image frame S111 is arranged. That is, the function selection button S160 is displayed located inside the client face image frame S111.

【0210】

A predetermined function is associated with each function selection button S160. When any one of the function selection buttons S160 is selected and operated by the user, the communication program performs a process of realizing the function corresponding to the selected function selection button S160.

【0211】

In the example shown in FIG. 21, as the function selection button S160, the "help" button S160a, the "back" button S160b, the "applause" button S160c, the "booing" button S160d, the "crying" button S160e, the "laughing" button S160f, The state in which the "Ase" button S160g and the "Angry" button S160h are displayed is shown.

【0212】

The help button S160a corresponds to the help button S112c in the basic display window 110 shown in FIG. 13, and is a function selection button for displaying help information explaining the operation of the communication program to the user. When the help button S160a is selected by the user, the communication program displays help information in which the operation guidance and the method of determining the problem are described in the help window (not shown).

【0213】

The back button S160b is a function selection button for exiting the emotion expression mode and shifting to the tool mode. When the user selects the back button S160b, the communication program exits the emotion expression mode and shifts to the tool mode.

【0214】

The function selection buttons S160c to S160h are function selection buttons for expressing emotions corresponding to the respective names. The communication program, if any of these function selection buttons S160c ~ S160h is selected by the user, an animation effect to express the emotion corresponding to the names of the function selection buttons S160c ~ S160h, the user face image off frame S110 Give to. At this time, the communication program may give an animation effect to the user face image frame S110 and at the same time output a voice expressing the emotion from a speaker device connected to or mounted on the computer device 10. This makes it possible to further improve emotional expression.

【0215】

Here, as a specific example of the animation effect expressing emotions and the voice, the case where the applause button S160c is selected by the user will be described. In this case, for example, an animation image (moving image or continuous still image) of applause is displayed superimposed on the face image in the face image display area S110a of the user face image frame S110, and a sound of "cracking" is displayed. Is output. At the same time, even if the display position of the entire user face image frame S110 is continuously changed within a predetermined area centered on the initial display position, the expression indicating that the user is applauding may be improved. Good.

【0216】

Further, for example, when the crying button S160e is selected by the user, for example, an animation image expressing tears is superimposed on the face image in the face image display area S110a of the user face image frame S110, and " Outputs the voice "Ane Ane". Further, for example, at the same time, by continuously changing the display position of the entire user face image frame S110 within a predetermined area centered on the initial display position, the expression indicating that the user is crying is improved. Let me.

【0217】

As described above, the communication program can express the user's emotions by displaying an animation image, outputting a voice, or changing the display position of the user face image frame S110. The details of the animation effect will be described later.

【0218】

Here, when the function selection buttons S160c to S160h are selected by the user, the communication program imparts various emotional expression effects to the user face image frame S110 as described above, and the function selection button by the user. Information indicating that S160c to S160h have been selected is transmitted to all clients via the server. As a result, in the communication program that operates on the client side, the various effects described above are added to the face image corresponding to the user and displayed.

【0219】

That is, for example, when various emotional expressions described above are selected on the first client side corresponding to the first client face image frame S111a, the first one is displayed in the window displayed by the communication program on the user side. The client face image frame S111a is given an animation image display, an audio output, a change in the display position of the first client face image frame S111a, and the like.

【0220】

In this way, the communication program is able to share the expression of each emotion between the user and the client. Therefore, the communication program can achieve more diverse and effective communication as compared with the communication using only text (character data).

【0221】

(7-7) Action expression mode [0222]

Here, the case where the communication program shifts to the action expression mode will be described with reference to the action expression window 170 shown in FIG.

【0223】

The action expression window 170 is a window displayed when the communication program shifts to the action expression mode, and as shown in FIG. 22, basically has the same configuration as the basic display window shown in FIG. There is. Therefore, in the action expression window 170 shown in FIG. 22, the same or equivalent frames, buttons, and icons as those of the basic display window 110 shown in FIG. 13 will be omitted from the description and the same reference numerals will be given.

【0224】

The emotion expression window 170 has a plurality of function selection buttons S170 in place of the function selection button S112 shown in FIG. 13, as a difference from the basic display window 110. Similar to the function selection button S112 shown in FIG. 13, the function selection buttons S170 are arranged at predetermined intervals on a virtual circle centered on the user face image frame S110. The radius of the virtual circle on which the function selection button S170 is arranged is smaller than the radius of the virtual circle on which the client face image frame S111 is arranged. That is, the function selection button S170 is displayed located inside the client face image frame S111.

【0225】

A predetermined function is associated with each function selection button S170. When any one of the function selection buttons S170 is selected and operated by the user, the communication program performs a process of realizing the function corresponding to the selected function selection button S170.

【0226】

In the example shown in FIG. 22, the function selection button S170 is a "help" button S170a, a "back" button S170b, a "love love" button S170c, a "stroking" button S170d, a "tapping" button S170e, and a "pinching" button S170f. Is displayed.

【0227】

The help button S170a corresponds to the help button S112c in the basic display window 110 shown in FIG. 13, and is a function selection button for displaying help information explaining the operation of the communication program to the user. When the help button S170a is selected by the user, the communication program displays help information in which the operation guidance and the method of determining the problem are described in the help window (not shown).

【0228】

The back button S170b is a function selection button for exiting the emotion expression mode and shifting to the tool mode. When the user selects the back button S170b, the communication program exits the emotional expression mode and shifts to the tool mode.

【0229】

The function selection buttons S170c to S170f are function selection buttons for expressing the action corresponding to each name. When any of these function selection buttons S170c to S170f is selected by the user, the communication program periodically moves and displays each client face image frame S111 with a predetermined movement amount based on the initial display position. .. This allows the communication program to prompt the user to select a client to represent the selected action.

【0230】

Then, in the communication program, when the target client expressing the action (that is, the target client face image frame S111) is selected by the user, the frame color of the selected client face image frame S111 and the user face are displayed. The frame color of the image frame S110 is highlighted in the same color. At this time, an animation effect expressing the selected action is given to the face images in the client face image frame S111 and the user face image frame S110. At this time, the communication program imparts an animation effect to the client face image frame S111 and the user face image frame S110, and at the same time, outputs a sound expressing the action from the speaker device connected to or mounted on the computer device 10. May be. The details of the animation effect will be described later.

【0231】

Here, as a specific example of the animation effect expressing the action and the sound, the case where the tap button S170e is selected by the user will be described. In this case, in order to express the action of "tapping", for example, an animation image (moving image or continuous still image) of a hand holding a hammer is displayed in the face image display area S110a of the user face image frame S110. It is displayed overlaid on the face image. On the other hand, in the face image display area S111a of the user face image frame S110 to be the target of the action expression, an animation image such as a star mark indicating that the user has been hit by a hammer is superimposed on the face image and displayed. It also outputs a voice (for example, "pashin") that expresses the hit with a hammer. At the same time, by continuously changing the display positions of the user face image frame S110 and the client face image frame S111, which are the targets of the action expression, within a predetermined area centered on the initial display position, the user The expression of the action to the client may be improved.

【0232】

When the function selection buttons S170c to S170f are selected by the user, the communication program imparts various action expression effects to and from the client face image frame S111 as described above, and the function selection buttons S170c to S170c to the user. Information indicating that S170f is selected is sent to all clients via the server. As a result, in the communication program that operates on the client side, the various effects described above are added to and displayed on the face image corresponding to the user or the set of clients that is the expression target of this action. ..

【0233】

In this way, the communication program is capable of sharing various action expressions between the user and the client. Therefore, the communication program can achieve more diverse and effective communication as compared with the communication using only text (character data).

【0234】

(7-8) Image / audio setting mode [0235]

Here, the case where the communication program shifts to the image / sound setting mode will be described with reference to the image / sound setting window 180 shown in FIG.

【0236】

The image / audio setting window 180 is a window that is displayed when the communication program shifts to the image / audio setting mode. As shown in FIG. 23, the image / audio setting window 180 is newly displayed at the lower part of the reduced display window 120 shown in FIG. The configuration area S180 is secured.

【0237】

In a predetermined part (the part on the right half in the figure) in the image / sound setting area S180, an image list area S181 in which a plurality of images registered in the communication program are displayed in a list, and these image list areas S181 An enter button S182 for setting an image selected from the images displayed in the image as a face image corresponding to the user, an additional button S183 for registering a new image in the image list area S181, and an image list. It has a delete button S184 for deleting an image selected from the images displayed in the area S181.

【0238】

The communication program registers the selected image as a face image corresponding to the user when the enter button S182 is selected after any of the images displayed in the image list area S181 is selected by the user. To do. Note that FIG. 23 illustrates a state in which a new image imitating the half body of a man is selected as the face image of the user.

【0239】

When the add button S183 is selected, for example, a new image file can be used as a face image by the user through a window (not shown) for selecting an image file stored in the computer device 10. It is possible to register in the image list area S181 in the state. On the other hand, if the delete button S184 is selected after any of the images displayed in the image list area S181 is selected by the user, the selected image is deleted from the image list area and the user's face image. It becomes unusable.

【0240】

Here, the image file that can be registered in the image list area S181 is not particularly limited to an image showing a human face, and may be, for example, an animal image or an image of various inorganic substances. May be good. Further, for example, it may be an illustration-like image, or it may be a realistic image obtained by digitizing a photograph. Further, the file format of the image file that can be registered is not particularly limited as long as it is a format that can be used by the communication program.

【0241】

On the other hand, a camera image display area in which an image taken by a digital video camera 29 connected to or mounted on the computer device 10 is displayed in a predetermined part (the part on the left half in the figure) in the image / sound setting area S180. The S185, the image input start button S186 that starts using the image displayed in the camera image display area S185 as the user's face image, and the image displayed in the camera image display area S185 are used as the user's face image. Input from the image input stop button S187, the volume slider S188 that controls the volume of the audio output by the communication program, and the digital video camera 29 or microphone connected to or mounted on the computer device 10. Input level slider S188 for controlling the voice level, voice input start button S190 for starting to use the voice input from the digital video camera 29 or microphone in the communication program, and input from the digital video camera 29 or microphone. It has a voice input stop button S191 that stops using the voice input in the communication program.

【0242】

When the image input start button S186 is selected by the user, the communication program uses the image input from the digital video camera 29 and displayed in the camera image display area S185 as the user's face image. In this case, the image input from the digital video camera 29 is displayed in the user face image frame S110, and this image is transmitted to all other clients via the server, and also on the client side. It will be displayed.

【0243】

An operation icon S192 is arranged at the top of the image / sound setting area S180. In the example shown in FIG. 23, as the operation icon S192, the tool mode end icon S192a for ending the image / audio setting mode which is the current operation mode and shifting to the tool mode, and the help icon for displaying help information are displayed. The case where S192b is displayed is shown.

【0244】

(7-9) Chat log display mode [0245]

Here, the case where the communication program shifts to the chat log display mode will be described with reference to the chat log window 200 shown in FIG. 24.

【0246】

The chat log window 200 is a window that is displayed when the communication program shifts to the chat log display mode, and as shown in FIG. 24, a new chat log area is displayed at the bottom of the reduced display window 120 shown in FIG. It is said that S200 is secured. This chat log area S200 is provided by, for example, the chat log module 53f that constitutes a communication program.

【0247】

The chat log area S200 displays the contents of the chat log file in which the text input by the user in the text input area S115 and the text received from the client and displayed in the text display area S116 are stored in chronological order. It has a log display area S201 and a save button S202 for saving by writing the contents of this chat log file as a separate file to a predetermined storage area in the computer device 10.

【0248】

In the chat log, the text input by the user for the text input area S115 and the text received from the client and displayed in the text display area S116 from the time when the communication program is started are stored in chronological order. It is stored in a predetermined memory area secured by the communication program.

【0249】

The communication program can view the chat log through the chat log display window 200. As a result, the user can eliminate the risk of missing the text sent from the client.

【0250】

(7-10) Web browsing mode [0251]

Here, the case where the communication program shifts to the Web browsing mode will be described with reference to the Web browsing window 210 shown in FIG.

【0252】

The Web browsing window 210 is a window that is displayed when the communication program shifts to the Web browsing mode. As shown in FIG. 25, a new Web browsing area S210 is displayed at the bottom of the reduced display window 120 shown in FIG. Is secured. The Web browsing area S210 is provided by, for example, the Web function module 53d that constitutes a communication program.

【0253】

In the central part of the Web browsing area S210, this resource was acquired based on the resources (various information such as image data and hypertext) on the Internet 11 specified by a predetermined URL (Uniform Resource Locator) and their access methods. The Web information display area S211 that displays the results is arranged. Further, in the Web browsing area S210, above the Web information display area S211, a plurality of operation icons S212 and a URL input area S213 in which the URL of the resource to be displayed in the Web information display area S211 is input and displayed are in the horizontal direction. They are arranged side by side.

【0254】

In the Web browsing window 210 shown in FIG. 25, the operation icons S212 include the "back" icon S212a, the "forward" icon S212b, the "stop" icon S212c, the "update" icon S212d, the "home" icon S212e, and the "move" icon. An example is shown when S212f and the "send address" icon S212g are displayed.

【0255】

Here, the operation icons S212a to S212f and the URL input area S213 have the same functions as the operation icons and the URL input area S213 provided in the so-called Web browser / application program, which have been widely used in the past. It has. Therefore, detailed description of these operation icons S212a to S212f and the URL input area S213 will be omitted.

【0256】

Further, in the Web browsing window 210, the recommended URL display area S214 is located below the Web information display area S211. The details of this recommended URL display area S214 will be described later.

【0257】

When the user inputs a predetermined URL into the URL input area S213 and the move icon S212f is selected, the communication program acquires the resource on the Internet 11 specified by the input URL and acquires the resource on the Internet 11 specified by the input URL, and obtains the resource on the Internet 11 to obtain the Web information display area S211. Display in. That is, the communication program has, so to speak, a Web browsing function.

【0258】

By the way, when the address transmission icon S212g is selected by the user while the URL is entered in the URL input area S213, the communication program sends this URL to all clients for which a session has been established via the server. And send.

【0259】

Here, for convenience of explanation, it will be described with reference to FIG. 26, assuming that the communication program on the user side acquires a predetermined URL transmitted from the communication program on the client side as described above.

【0260】

When the communication program acquires the URL transmitted from another communication program, it displays a predetermined message in the status display area S114 of the Web browsing window 210, for example, as shown in FIG. 26. The message displayed at this time is to notify the user that the URL sent from the other communication program (client) side has been acquired. For example, "Click here to display the introduced Web page. It will be displayed. "

【0261】

Here, when the message displayed in the status display area S114 is selected by the user, the communication program acquires the resource on the Internet 11 specified by the URL acquired from the client side and displays it in the Web information display area S211. To do.

【0262】

In the communication program, as described above, it is possible to send and receive URLs indicating various information such as image data and hypertext existing on the Internet 11 between the user and the client. That is, in the communication program, a session is established for the information being viewed by the extremely simple operation of selecting the address transmission icon S212g while the user is displaying various information in the Web information display area S211 and browsing various information. It is possible to share with each of the other clients.

【0263】

In the communication program, the message displayed in the status display area S114 when the URL is acquired is not particularly limited to being displayed in the status display area S114 of the Web browsing window 210. That is, even if the communication program is in an operation mode other than the Web browsing mode, the status display area S114 arranged at the bottom of the window corresponding to each operation mode when the URL is acquired from another client. A message is displayed in. Then, when the user selects the message displayed in the status display area S114, the computer program shifts to the Web browsing mode, acquires the information corresponding to the acquired URL, and displays it in the Web information display area S211. To do.

【0264】

Therefore, in the communication program, it is possible to immediately notify the user that the URL has been received when the URL sent from the client side is received, regardless of the current operation mode. In addition, the message displayed in the status display area S114 is automatically switched to the Web browsing mode by an extremely simple operation such as clicking with the mouse provided in the computer device 10, and the acquired URL is supported. Information can be acquired and displayed in the Web information display area S211.

【0265】

Further, a predetermined number of URLs acquired from the client as described above are stored in a predetermined storage area in the computer device 10 by the communication program. Then, the communication program displays in the recommended URL display area S214 in the Web browsing window 210 in order from the most recently acquired URL. Further, when the URL displayed in the URL display area S214 is selected by the user, the communication program acquires the information corresponding to this URL and displays it in the Web information display area S211.

【0266】

As a result, in the communication program, the information corresponding to the URL exchanged with the client in the past can be browsed by an extremely simple operation.

【0267】

Further, in the communication program, when the URL is transmitted to the client, the sender identification information for identifying the sender may be transmitted together with the URL. As the source identification information, for example, the name of the source user, the IP address of the source computer device 10, and the like can be used. Then, in this case, when the communication program receives the sender specific information together with the URL from the client side, the message to be displayed in the status display area S114, the content to be displayed in the URL display area S214, or the recommended URL display area S214 , A message or icon indicating the sender obtained by referring to the sender specific information is displayed.

【0268】

As a result, when the communication program receives the URL sent from the client side, it can notify the user from which client the URL was sent, and a large number of URLs are exchanged. It is possible to prevent the user from being confused when doing so.

【0269】

(8) Transmission of image data [0270]

By the way, as described with reference to FIG. 23, the communication program displays this image file in the user face image frame S110 when the image file registered in the image list area S181 is selected. Set as an image. When an image input from the digital video camera 29 and displayed in the camera image display area S185 is selected, this image is set as a face image to be displayed in the user face image frame S110.

【0271】

Here, the image file registered in the image list area S181 is generally composed of still image data, and the image displayed in the camera image display area S185 is based on the moving image data captured by the digital video camera 29. It is configured.

【0272】

Then, the communication program transmits the image set as the face image to be displayed in the user face image frame S110 to the communication program on the client side via the server. At this time, the communication program is the same as the case where the moving image data is used as the face image, the still image data is generated from the moving image data at predetermined time intervals, and the still image data is used as the face image. Image data is transmitted using the transmission queue.

【0273】

In the following, first, attention will be paid to a series of processes executed by the communication program when transmitting moving image data, and the description will be given with reference to the flowchart shown in FIG. 27.

【0274】

In this case, the communication program confirms that a session has been established with the communication program on the client side, that the digital video camera 29 is connected, and the like in step S300 shown in FIG. 27, and image data. Starts the transmission process of.

【0275】

Next, in step S301, the communication program determines whether or not the image input start button S186 in the image / voice setting window 180 shown in FIG. 23 is selected by the user. As a result of this determination, if it is selected, the process proceeds to step S302, if it is not selected, the determination in step S301 is repeated, and the process waits until the image input start button S186 is selected by the user.

【0276】

In step S302, the communication program confirms the state of the transmission queue set in the RAM 21 of the computer device 10, for example, and determines whether or not data exists in the transmission queue. As a result of this determination, if the data does not exist, the process proceeds to step S303, and if the data exists, the process proceeds to step S305.

【0277】

Here, the transmission queue is a storage area in which various information (for example, image data, voice data, character data, etc.) to be transmitted to the client via the server is temporarily stored. Then, in the communication program, when various data are stored in the transmission queue, a process of sequentially transmitting the stored data to the client is performed. Then, when all the data stored in the transmission queue is transmitted, the data is not stored in the transmission queue, that is, the transmission queue is "empty".

【0278】

In step S303, the communication program acquires the moving image data captured by the digital video camera 29, and generates still image data corresponding to the moment based on the moving image data. At this time, for example, when the moving image data output from the digital video camera 29 is composed of a continuous series of still image data, the still image data included in the moving image data at that moment The still image data corresponding to the above may be extracted.

【0279】

Here, the still image data is a coding / decoding process within a predetermined image frame. [0280]

Image data for which compression / decompression processing is completed.

【0281】

Next, in step S304, the communication program stores the still image data generated in step S303 in the transmission queue. The still image data stored in the transmission queue in this way is sequentially transmitted to the communication program on the client side via the server. Further, after the process in step S304, the communication program advances the process to step S305.

【0282】

In step S305, the communication program determines whether or not the image input stop button S187 is selected by the user in the image / voice setting window 180 shown in FIG. As a result of this determination, when the image input stop button S187 is selected, the process is returned to step S301, and the processes after step S301 described above are repeated. If the image input stop button S187 is not selected, the process proceeds to step S305.

【0283】

In step S305, the communication program performs a process (weight process) of waiting for a predetermined time (for example, 200 msec), then returns the process to step S302, and performs the process after step S302 described above.

【0284】

The communication program is executed as described above to generate still image data from the moving image data captured by the digital video camera 29 each time it waits for a predetermined time in step S305, and sends the still image data to the transmission queue. It is stored in. As a result, image data is transmitted from the communication program on the user side to the communication program on the client side at predetermined time intervals.

【0285】

Here, when, for example, 200 msec (200/1000 seconds) is set as the standby time in step S305, five image data are transmitted every second. That is, in this case, continuous image data is transmitted at a frame rate of 5 fps (Frame per Second).

【0286】

The standby time in step S305 may be appropriately set according to the communication band and the communication state between the user and the client. Further, for example, in response to a request from the user, the still image data is generated only once from the moving image data captured by the digital video camera 29, and the still image data is used as the user's face image in the user face image frame. It may be displayed on S110.

【0287】

Next, the image file registered in the image list area S181 is selected, and attention is paid to a series of processes executed by the communication program when this image file (still image data) is transmitted as a user's face image. This will be described with reference to the flowchart shown in 28.

【0288】

In this case, the communication program confirms that a session has been established with the communication program on the client side, that the digital video camera 29 is connected, and the like in step S310 shown in FIG. 28, and image data. Starts the transmission process of.

【0289】

Next, in step S311 the communication program determines whether or not the decision button S182 in the image / audio setting window 180 shown in FIG. 23 is selected by the user. If the result of this determination is not selected, the determination process in step S311 is continued until the enter button S182 is selected. If the enter button S182 is selected, the process proceeds to step S312.

【0290】

In step S312, the communication program determines whether or not any one of the plurality of image files (still image data) displayed in the image list area S181 is selected by the user. As a result of this determination, if the image file is not selected, the process returns to step S311, and if the image file is selected, the process proceeds to step S313.

【0291】

In step S313, the communication program stops the image input from the digital video camera 29. As a result, if the image input from the digital video camera 29 is set as the user's face image before step S313 and is transmitted to the client side, the transmission of the image from the digital video camera 29 is stopped. ..

【0292】

Next, in step S314, the communication program stores the still image data included in the image file selected in step S312 in the transmission queue. The still image data stored in the transmission queue in this way is sequentially transmitted to the communication program on the client side via the server. Further, after the process in step S314, the communication program proceeds to step S311.

【0293】

Here, in the communication program, the moving image captured by the digital video camera 29 is transmitted to the client side as the user's face image, and the image included in the image file displayed in the image list area S181 is the user's face. The transmission queue is not distinguished between the case where the image is transmitted to the client side and the case where the image is transmitted to the client side. That is, the send queue is shared. Therefore, the communication program can manage and control the data to be transmitted in common in both cases.

【0294】

(9) Processing when starting the communication program [0295]

By the way, the communication program is composed of a plurality of functional modules as described with reference to FIG. These function modules are started and operated by the user, and when the communication program is started, they are selectively started as needed, and the functions provided by each function module can be executed and processed. .. In the following, the processing when the function module is selectively started in this way will be described in detail.

【0296】

In the computer device 10, module information in which start conditions and start information are described for each functional module in the communication program is stored in a storage area secured in, for example, HDD 23 or RAM 21. Module information is stored as a file that exists independently outside the communication program, and for each function module, for example, an executable file or DLL (Direct Link Library) in which the processing contents of each function module are described. Information about the storage location on the computer device 10, information about the function selection button displayed in the window corresponding to the function provided by each function module, and start information indicating the start condition of each function module are described. There is.

【0297】

Of these, the activation information in the module information is given by a 32-bit bit string in which the functions provided by the functional modules are associated with each bit, as shown in FIG. 29, for example. This activation information indicates that the function module provides the function corresponding to the bit set to "1".

【0298】

In the example shown in FIG. 29, each bit is associated with "audio-related function", "video-related function", "live program appearance-related function", and "game-related function" in order from the least significant bit. The case is illustrated. Further, in the example shown in FIG. 29, since the bit associated with the "video-related function" and the "live program appearance-related function" is "1", the function associated with this activation information is set. Indicates that the module performs processing related to "video-related functions" and "live program appearance-related functions".

【0299】

Also, for example, when all the bits that make up the startup information are "0", the function module associated with this startup information should always be started regardless of the startup state of the communication program. Is shown.

【0300】

Here, the processing when each functional module is started at the time of starting the communication program by referring to the module information having such start information will be described.

【0301】

The communication program is started in the state at the time of startup, that is, the environment of the computer device 10 to be started (environment such as memory capacity and screen size), the state of the device mounted on or connected to the computer device 10, or is started independently. It detects a state such as whether it was started while being called by another application program, and generates a predetermined bit string according to this starting state. In this bit string, a function is associated with each bit corresponding to the activation condition in the module information, and the bit corresponding to the function required for starting the communication program is generated as "1".

【0302】

Then, for example, as shown in FIG. 30, the AND (logical product) of the bit string generated when the communication program was started and the start information of each function module (the function module A is illustrated in FIG. 30) was calculated. If the resulting bit string contains "1", the function module corresponding to this startup information is started.

【0303】

Further, for example, as shown in FIG. 31, the AND (logical product) of the bit string generated when the communication program is started and the start information of each function module (the function module B is illustrated in FIG. 31) is calculated. If "1" is not included in the resulting bit string, the startup process for the functional module corresponding to this startup information is not performed.

【0304】

Further, for example, as shown in FIG. 32, an AND (logical product) was calculated between the bit string generated when the communication program was started and the start information of each function module (the function module C is illustrated in FIG. 32). Occasionally, even if the obtained bit string does not contain "1", if each bit of the start information of the function module C is "0", this function module C starts all. The startup process is performed assuming that the function module should be started under the conditions.

【0305】

Here, the processing at the time of starting the communication program will be described with reference to the flowchart shown in FIG. 33.

【0306】

When the start-up process is started, the communication program acquires the start-up condition in step S320 shown in FIG. 33. As described above, this activation condition is a predetermined bit string generated according to the activation state of the communication program, and is generated by the CPU 20 of the computer device 10.

【0307】

Next, in step S321, the communication program acquires the module information stored in the predetermined storage area in the computer device 10. Next, in step S322, the communication program determines whether or not all the bit strings of the activation information included in the module information are "0". As a result of this determination, if all are "0", the process proceeds to step S325, and if "1" is included, the process proceeds to step S323.

【0308】

In step S323, the communication program calculates the AND (logical product) of the activation information corresponding to each functional module included in the module information and the activation condition. The calculation of this AND is performed by, for example, arithmetic processing by the CPU 20.

【0309】

Next, in step S324, the communication program determines whether or not all the bits included in the bit string obtained by the arithmetic processing in step S323 are "0". As a result of this determination, if all are "0", the process proceeds to step S326, and if "1" is included, the process proceeds to step S325.

【0310】

In step S325, the communication program activates the function module corresponding to the activation information. When starting this functional module, the information contained in the module information, that is, the information about the location where the functional module is stored, and the function selection button displayed in the window corresponding to the function provided by the functional module. Information etc. are used. After the process in step S325, the communication program proceeds to step S326.

【0311】

In step S326, the communication program determines whether or not a series of processes have been completed for all the start-up information included in the module information, that is, whether or not a series of start-up processes have been completed for all the functional modules. As a result, when the processing for all the functional modules is completed, the series of startup processing is terminated and the normal communication program execution operation is started. If there is start information for which the start process has not been determined, the process is returned to step S322 to determine the start process for this start information.

【0312】

By performing the activation process as described above, the communication program can selectively activate the required functional modules according to the activation conditions. As a result, when the communication program is called from a live distribution application program that provides live distribution of images and sounds to other computer devices via the Internet 11, for example, a function corresponding to this live distribution application program. The module is started. In this case, for example, as shown in FIG. 34, in the tool display window 150 shown in FIG. 20, the live distribution button S150h is newly additionally displayed as the function selection button S150.

【0313】

(10) Processing of URL sharing operation [0314]

Here, the URL sharing function realized in the communication program will be described. The communication program can send and receive URLs to and from other communication programs for which a session has been established, as described with reference to FIGS. 25 and 26. As a result, the user and the client can simultaneously experience browsing the Web page acquired by this URL with an extremely simple operation.

【0315】

Therefore, in the following, a series of processing flows by the communication program in the case of transmitting and receiving the URL as described above will be described in detail with reference to the flowchart.

【0316】

First, the process of sending the URL by the communication program will be described with reference to the flowchart shown in FIG. 35.

【0317】

As shown in step S330 in FIG. 35, whether or not the address transmission icon S212g in the Web browsing window 210 is selected by the user at predetermined time intervals while the communication program is performing other normal operation processing. Is determined. As a result of this determination, if the address transmission icon S212g is not selected, the process returns to the normal operation process, and if it is selected, the process proceeds to step S331.

【0318】

Next, in step S331, the communication program acquires the URL corresponding to the Web page displayed in the Web information display area S211 of the Web browse window 210. This URL matches the URL entered / displayed in the URL input area S213.

【0319】

Next, in step S332, the communication program adds the source identification information to the URL acquired in step S331, and sends these URLs and the source identification information to all the clients for which the session has been established. Send via. After the processing in step S332, the communication program returns to the normal operation processing.

【0320】

Next, an example of the processing of the communication program when the URL transmitted by the communication program on the client side is received will be described with reference to the flowchart shown in FIG.

【0321】

When the communication program receives the URL transmitted from the client side as shown in step S340 in FIG. 36, the communication program stores the URL and the sender identification information in the recommended URL list in step S341. Here, the recommended URL list has a data structure as shown in FIG. 37, for example, and receives the name of the sender included in the sender specific information and the URL sent from this sender as a set. This is a list in which the URL and the source specific information are stored in chronological order. In addition, the contents of the recommended URL list are displayed in the recommended URL display area S214 in the Web browsing window 210.

【0322】

Next, in step S342, the communication program adds the received URL and the name of the sender to the chat log file used in the chat log display mode. As a result, when the communication program shifts to the chat log display mode, the URL exchanged with another communication program can be confirmed at any time with respect to the chat log display area S201. Further, in this chat log display mode, the communication program automatically shifts to the Web browsing mode when the URL included in the content of the chat log displayed in the chat log display area S201 is selected by the user. Display the web page corresponding to the selected URL.

【0323】

In the communication program, the process in step S342 may be omitted. In this case, the URL exchanged with other communication programs will not be recorded in the chat log file.

【0324】

Next, in step S343, the communication program reduces and displays the client face image frame S111 of the client corresponding to the source of the received URL, and displays the text display area S116 adjacent to the client face image frame S111. , Display a message notifying that the URL has been received in this text display area S116. As such a message, for example, a message such as "URL has been sent" or "URL has been sent!" May be displayed.

【0325】

Next, in step S344, the communication program displays a message indicating that the URL has been received in the status display area S114.

【0326】

Next, in step S345, the communication program determines whether or not the message displayed in the status display area S114 is selected. As a result of this determination, if it is not selected, the process proceeds to step S346, and if it is selected, the process proceeds to step S347.

【0327】

In step S346, the communication program determines whether or not the URL displayed in the recommended URL display area S214 in the Web browsing window 210 has been selected by the user. As a result of this determination, if the URL is not selected, the process returns to step S345, and if the URL is selected, the process proceeds to step S348.

【0328】

In step S347, the communication program selects the last received URL from the URLs included in the recommended URL list, and proceeds to step S349.

【0329】

In step S348, the communication program selects the URL selected in step S346 from the recommended URL list and proceeds to step S349.

【0330】

In step S349, the communication program determines whether the Web function module 53d is activated and is operating in the Web browsing mode. As a result of this determination, if it is not operating in the Web browsing mode, the process proceeds to step S350, and if it is operating in the Web browsing mode, the process proceeds to step S351.

【0331】

In step S350, the communication program activates the Web function module 53d and shifts to the Web browsing mode. After the process in step S350, the communication program proceeds to step S351.

【0332】

In step S351, the communication program acquires Web information such as image data and hypertext from the Internet 11 based on the URL selected by the user, and browses the Web page composed of these Web information in the Web browsing window 210. It is displayed in the Web information display area S211 in.

【0333】

The communication program in this example is supposed to display a Web page in the Web information display area 210 of the Web browsing window 210 in the Web browsing mode provided by the Web function module 53d. However, the communication program is, for example, displaying Web information. An external application program such as a Web browser having a function may be started, and the Web browser may be requested to acquire and display Web information corresponding to the URL selected by the user.

【0334】

As described above, the communication program easily exchanges URLs as resource information indicating the location and / or acquisition method of various information existing on the computer network between the user and the client in which the session is established. It is configured to be possible. In addition, when a URL sent from the client side is received, it is possible to immediately notify the user of this.

【0335】

Therefore, the communication program can share the URL more efficiently and quickly than the case of exchanging the URL by using an e-mail or a chat program which has been widely used in the past.

【0336】

In addition, according to the communication program, for example, when a so-called network conference is held with a large number of clients, it is persuaded by having other clients browse the Web page on which the user's claim is based. Can make powerful claims. In addition, for example, it is possible to browse the tourist information Web page of the candidate site together while consulting with the client about the travel destination. Furthermore, by sharing the URL while communicating with the client, all the clients can view the material data existing on the Internet 11.

【0337】

(11) Animation effect [0338]

By the way, in a communication program, as described with reference to FIGS. 21 and 22, when a user is requested to express an emotion or an action, a user corresponding to the user to be expressed is supported. An animation effect corresponding to the requested emotional expression or motion expression is given to the face image frame S110 or the client face image frame S111. Therefore, in the following, this animation effect will be described with reference to the drawings.

【0339】

As an animation effect, for example, an effect of moving the display position of the user face image frame S110 or the client face image frame S111 selected by the user as an expression target can be added. Specifically, for example, emotions or actions are expressed by moving the user face image frame S110 or the client face image frame S111 to be expressed within a predetermined area centered on the initial display position for a predetermined time. ..

【0340】

Further, as the animation effect, an effect of changing the display size of the user face image frame S110 or the client face image frame S111 selected by the user as the expression target may be given. Specifically, for example, the user face image frame S110 or the client face image frame S111 to be expressed expresses emotions or actions by changing the display size relative to the initial display size for a predetermined time. To do.

【0341】

Further, as the animation effect, an effect of changing the display angle of the user face image frame S110 or the client face image frame S111 selected by the user as the expression target may be given. Specifically, for example, the user face image frame S110 or the client face image frame S111 to be expressed expresses emotions or actions by changing the display angle relative to the initial display angle for a predetermined time. To do.

【0342】

Further, as the animation effect, an effect of displaying a predetermined image may be given by superimposing the user face image frame S110 or the client face image frame S111 selected by the user as an expression target. Specifically, for example, emotions are generated by superimposing an image in a bitmap format in which a transparent color is specified on the user face image frame S110 or the client face image frame S111 to be expressed for a predetermined time. Or express the action.

【0343】

In this way, the image to be displayed superimposed on the user face image frame S110 or the client face image frame S111 is, for example, a plurality of continuous images as shown in FIGS. 38 (a) to 38 (e). May be good. Then, by sequentially displaying the plurality of continuous images on the user face image frame S110 or the client face image frame S111, the emotional expression or the motion expression can be further improved.

【0344】

Further, the user face image frame S110 or the client face image frame S111 may be simultaneously given any number of effects selected from the various animation effects described above. Specifically, for example, an image superimposition effect can be added at the same time as the display position movement effect.

【0345】

Here, the animation effects such as the display position movement effect, the size change, and the bitmap image superimposition effect described above are a method of continuously designating the values of the animation elements from the animation start time to a predetermined time, so-called keys. Frame-style animation techniques can be used. When adopting such a keyframe format animation method, for example, keyframe data having a data structure as shown in FIG. 39 is used.

【0346】

The keyframe data shown in FIG. 39 has a data structure in which a plurality of keyframes corresponding to each animation effect and values set in the keyframes are paired.

【0347】

For example, when giving the display position movement effect, the value "0,0" is set in the 0th keyframe and the value "-10,-10" is set in the 10th keyframe in this keyframe data. Is set. In the display position movement effect, the values set by the keyframes are associated with the X coordinate and the Y coordinate that move the user face image frame S110 or the client face image frame S111 from the initial display position, respectively. That is, in the tenth key frame, the user face image frame S110 or the client face image frame S111 is displayed by moving -10 pixels in the X direction and -10 pixels in the Y direction from the initial display position. ..

【0348】

Further, when the display size change effect is given, the value set by the key frame data expands the user face image frame S110 or the client face image frame S111 in the X direction and the Y direction with respect to the initial display size, respectively. It is associated with the expansion rate. That is, in the tenth key frame, the user face image frame S110 or the client face image frame S111 is displayed at a magnification of 100% in the X direction and 75% in the Y direction with respect to the initial display size. ..

【0349】

Further, when the image superposition effect is given, the values set by the key frame data are associated with the numbers of the images to be superposed on the user face image frame S110 or the client face image frame S111, respectively. That is, in the fifth key frame, for example, the image in which the number 2 is set is superimposed on the user face image frame S110 or the client face image frame S111.

【0350】

Further, the user face image frame S110 or the client face image frame S111 to be displayed with an animation effect is displayed at a predetermined frame rate such as 15 frames per second (15 FPS: Frame per Second) and is not set as a key frame. The value of each animation effect in the frame is interpolated according to the elapsed time from the start time of applying the animation effect. In the case of the image superimposition effect, interpolation is not performed and the value of the immediately preceding key frame is used.

【0351】

Here, as an example of the processing of the communication program when giving an animation effect, refer to the flowchart shown in FIG. 40 for expressing an action for a predetermined client in the action expression window 170 shown in FIG. 22. I will explain while.

【0352】

In step S360 shown in FIG. 40, when the user selects a predetermined function selection button S170 and is requested to perform an action expression, the communication program is an expression target of the requested action expression in step S361. That is, the client face image frame S111 is selected.

【0353】

Next, in step S362, the communication program determines whether or not the expression target is selected by the user. As a result of this determination, if the expression target is selected, the process proceeds to step S363, and if it is not selected, the expression of the action is stopped and the animation effect is finished.

【0354】

In step S363, the communication program matches the frame color of the user face image frame S110 with the frame color of the client face image frame S111 selected as the expression target, and these user face image frames S110 and client face image frame S111. Is given an animation effect corresponding to the action expression selected by the user. After the process in step S363, the communication program ends the process of adding the animation effect.

【0355】

Here, the details of the process in step S361 will be described with reference to the flowchart shown in FIG.

【0356】

In step S361, when performing the process of selecting the expression target of the requested action expression, the communication program performs an animation operation indicating that the client face image frame S111 is in the selected state in step S370 shown in FIG. Read.

【0357】

Next, in step S371, the communication program starts the animation operation read in step S111 with respect to the client face image frame S111 that can be selected as the expression target, and exerts an animation effect on these client face image frames S111. Give. As an animation effect given at this time, for example, each client face image frame S111 is periodically moved and displayed in the Y direction with a predetermined movement amount based on the initial display position. Thereby, for example, the client face image frame S111 that can be selected as an expression target can be given an effect of jumping. By giving an animation effect to the client face image frame S111 that can be selected as an expression target in this way, the selectable client face image frame S111 can be explicitly shown to the user.

【0358】

Next, in step S372, the communication program determines whether or not any of the client face image frames S111 as the expression target is selected by clicking the mouse or the like. As a result of this determination, if it is not selected, the process proceeds to step S373, and if it is selected, the process proceeds to step S374.

【0359】

In step S373, the communication program determines whether or not the animation effect used when selecting the expression target has ended. As a result of this determination, if it is not finished, the process is returned to step S372, and if it is finished, the process is returned to step S371 and the animation effect for selection is given again.

【0360】

In step S374, the communication program stops adding the animation effect used when selecting the expression target. Next, in step S375, the communication program returns the display state of all the client face image frames S111 to the initial display state. Next, in step S376, the communication program generates information that identifies the client face image frame S111 as the expression target selected in step S372. As a result, the selection process of the expression target is completed.

【0361】

Here, the details of the process in step S363 will be described with reference to the flowchart shown in FIG. 42.

【0362】

When the process of giving the animation effect corresponding to the action expression selected by the user to the user face image frame S110 and the client face image frame S111 selected as the expression target in step S363 is started, FIG. 42 In step S380 shown in the above, the communication program sets the client face image frame S111 selected as the expression target and the animation effect to be given to the client face image frame S111.

【0363】

Next, in step S381, the communication program sets the frame colors of the user face image frame S110 and the client face image frame S111 selected as the expression target. At this time, in the communication program, a plurality of preset frame colors are sequentially set as necessary in case a plurality of emotional expressions or action expressions occur simultaneously between the user and the client or between the clients. It is desirable to use it. Thereby, even when a plurality of emotional expressions or action expressions occur at the same time, the object relations of the expressions can be clarified.

【0364】

Next, in step S382, the communication program changes the frame color of the user face image frame S110 and the frame color of the selected client face image frame S111 to the frame color set in step S381.

【0365】

Next, in step S383, the communication program imparts a predetermined animation effect to the image frame to be expressed (in this case, the user face image frame S110 and the selected client face image frame S111).

【0366】

Next, in step S384, the frame color of the image frame to which the animation effect is given (in this case, the user face image frame S110 and the selected client face image frame S111) is returned to the original color, and the animation effect is given. End the process.

【0367】

Here, the processing for applying the animation effect in steps S371 and S383 described above will be described with reference to the flowchart shown in FIG. 43.

【0368】

When the process of giving the animation effect is started, the communication program sets the animation effect to be given in step S390 shown in FIG. 43.

【0369】

Next, in step S391, the communication program determines whether or not the set animation effect exists. As a result of this determination, if it does not exist, the process of giving the animation effect is terminated. If the set animation effect does not exist, the process proceeds to step S392.

【0370】

In step S392, the communication program reads the animation data. Next, in step S393, the communication program sets initial animation values for the image frames to which the animation effect is to be applied (in this case, the user face image frame S111 and the selected client face image frame S111). To do. This animation initial value has a value corresponding to the 0th key frame. Next, in step S394, the communication program calculates the time elapsed since the animation effect was started to be applied.

【0371】

Next, in step S395, the communication program determines whether or not the time calculated in step S394 coincides with the key frame. As a result of this determination, if they match, the process proceeds to step S396, and if they do not match, the process proceeds to step S397.

【0372】

In step S396, the communication program sets a value corresponding to the key frame for the image frame to which the animation effect is given. After the processing in step S396, the communication program proceeds to step S399.

【0373】

In step S397, the communication program acquires the values of two keyframes before and after the elapsed time calculated in step S394. Next, in step S398, the communication program sets a value interpolated from the values of the two keyframes for the image frame to which the animation effect is applied. After the process in step S398, the communication program proceeds to step S399.

【0374】

In step S399, the communication program displays an image frame in the window to which the animation effect is applied according to the set value.

【0375】

Next, in step S400, the communication program determines whether or not the time for applying the preset animation effect has elapsed. As a result of this determination, if it has not elapsed, the process is returned to step S394, and a series of processes for applying the animation effect are continued. If the time to apply the animation effect is wary, the process proceeds to step S401.

【0376】

In step S401, the communication program stops applying the animation effect to the target image frame, and ends the process of applying a series of animation effects.

【0377】

In the above description, the case where the action is expressed to a predetermined client in the action expression window 170 shown in FIG. 22 has been described, but the communication program is in the emotion expression window 160 shown in FIG. 21. When applying an animation effect to the user face image frame S110, the same processing as described above is performed.

【0378】

Further, the above-mentioned animation effect is given not only when the user requests to perform a predetermined emotional expression or action expression, but also when the client side requests to perform a predetermined emotional expression or action expression. However, when the communication program on the user side performs the same processing as described above, the animation effect is applied to the image frame (user face image frame S110 or client face image frame S111) targeted for expressing the emotional expression or the action expression. Is given.

【0379】

(12) Display of text sent from the client side [0380]

By the way, as explained with reference to FIG. 19, when the communication program receives the text (character data) transmitted from the client side, the client face image frame S111 corresponding to the client is reduced and displayed, and the client face image frame S111 is reduced and displayed. A text display area S116 in which the text transmitted from the client is displayed is displayed near the reduced client face image frame S111.

【0381】

At this time, the communication program gradually reduces the display size of the client face image frame S111 as shown in time series in FIGS. 44 (a) to 44 (c), while the display size of the text display area S116. Finally, a text display area S116 having a predetermined size is displayed at a position near the reduced-displayed client face image frame S111.

【0382】

Therefore, the text display area S116 can be displayed in the area secured by reducing the client face image frame S111 from the initial display size, and in particular, a window such as the reduced display window 120 shown in FIG. The available area is limited, and even if it is relatively small, the text sent from the client side can be displayed in a sufficiently large size.

【0383】

In addition, since the text display area S116 is displayed in the vicinity of the reduced client face image frame S111, the text displayed in the text display area S116 and the source (speaker) of this text You can intuitively grasp the correspondence with a certain client.

【0384】

Further, in the communication program, since the outer frame of the text display area S116 has a so-called "speech balloon" shape, the text displayed in the text display area S116 and the sender (speaker) of this text. ), It is possible to express the correspondence with the client more clearly.

【0385】

By the way, when displaying the text received from the client side in the text display area S116 as described above, the time for continuing the display of the text display area S116 is controlled according to the character string length of the displayed text. Is desirable.

【0386】

Specifically, for example, the shortest time for continuing the display of the text display area S116 is 2 seconds, and the longest time is 6 seconds. Further, the character string length of the text to be displayed in the text display area S116 is, for example, a maximum length equivalent to 90 bytes (90 half-width characters and 45 full-width characters). Then, the time for displaying the text display area S116 is appropriately controlled in the range of 2 seconds to 6 seconds according to the length of the character string displayed in the text display area S116. That is, for example, as shown in FIG. 45 (a), when displaying 3 double-byte characters (6 bytes), the display duration of the text display area S116 is set to 2.27 seconds, and is shown in FIG. 45 (b), for example. As described above, when displaying 31 double-byte characters (62 bytes), the display duration of the text display area S116 is set to 4.76 seconds.

【0387】

In this way, by controlling the display time of the text according to the character string length of the text to be displayed, communication between the user and the client or between the clients is performed by a natural tempo rhythm close to the actual dialogue. Can be planned. In addition, the communication program displays short texts such as exclamation phrases for a short time, while long texts are displayed for a long time, so that the displayed text can be reliably read by the user. ..

【0388】

Here, the processing flow of the communication program when the text transmitted from the client side is displayed in the text display area S116 as described above will be described with reference to the flowchart shown in FIG. 46.

【0389】

In this case, the communication program first receives and acquires the text (character data) transmitted from the communication program on the client side in step S410 shown in FIG. Next, in step S411, the communication program acquires the character string length of the text. Next, in step S412, the communication program calculates the display duration of this text based on the character string length of the text.

【0390】

Next, in step S413, the communication program gradually reduces and displays the client face image frame S111 corresponding to the client that is the source of the received text. Next, in step S414, the communication program gradually enlarges and displays the text display area S116 at a position near the client face image frame S111 reduced and displayed in step S413. The process in step S413 and the process in step S414 may be performed in parallel at the same time.

【0391】

Next, in step S415, the communication program displays the received text in the text display area S116 displayed in step S414. Next, in step S416, the communication program determines whether or not the display duration calculated in step S412 has elapsed in step S412. As a result of this determination, if the display duration has elapsed, the process proceeds to step S417, and if not, the process returns to step S415 to continue displaying the text.

【0392】

In step S417, the communication program gradually reduces and displays the text display area S116 and the text displayed in the text display area S116. At this time, the text display area S116 and the text displayed in the text display area S116 may be deleted instantly. Next, in step S418, the reduced-displayed client face image frame S111 is gradually enlarged and displayed, and finally displayed in the initial display size. The process in step S417 and the process in step S418 may be performed in parallel at the same time.

【0393】

As described above, the communication program displays the text (character data) transmitted from the client side.

【0394】

(13) Window display by communication program [0395]

By the way, in the communication program, as described above, depending on the activation form such as whether the communication program is started independently or is called from another application program and started, or depending on the operation mode of the communication program, for example. As shown in FIGS. 13 and 14, the display size of the application window can be changed as appropriate.

【0396】

Further, in the communication program, for example, as shown in FIG. 13, a state in which the basic module is started independently, and as shown in FIGS. 23, 24, and 25, for example, a functional module that realizes various functions. Can be roughly divided into three operating states: a state in which is started and a state in which is called from an external application program and started, for example, as shown in FIG. 34. Then, the communication program appropriately sets the display positions of the user face image frame S110 and the client face image frame S111 as display elements to be displayed in the application window, or the various function selection buttons described above, depending on these operating states. It is controlled so that all display elements fit within the display area corresponding to each operating state.

【0397】

The communication program is not limited to displaying the application window in the state shown in FIGS. 13 and 14. For example, as shown in FIG. 47, the application window is displayed in a form having a vertically long display area. It can also be displayed.

【0398】

Here, as shown in FIGS. 14 and 47, for example, the communication program does not display the caption of each function selection button when the display size is set to be smaller than in the normal state. Further, in this case, the display size of the user face image frame S110 and the client face image frame S111 is displayed in a smaller size than in the normal state so as to fit within the display area. This allows the communication program to display all display elements according to a consistent interface design while making the best use of the display area of the application window.

【0399】

In addition, the communication program can change the display size of the application window by performing a predetermined instruction operation from the user. Specifically, for example, the display size can be appropriately changed by selecting and operating the operation icon S113 displayed at the top of the application window, or by dragging the four corners of the application window with the mouse. It is said that.

【0400】

In this way, when the display size of the application window is changed by the request from the user, the communication program displays the display elements such as the user face image frame S110 and the client face image frame S111, or the various function selection buttons described above. By appropriately controlling the position, the process of adjusting so that all the display elements fit in the application window is performed.

【0401】

Further, in the communication program, for example, when shifting from the basic display mode to the image / voice setting mode, chat log mode, Web browsing mode, etc., the user face image frame S110 and the client face image frame S111, or various function selections are made. The area where buttons and the like are displayed (hereinafter referred to as the main display area) is reduced and displayed, and the free area created by the reduced display in this way includes an image / audio setting area S180, a chat log area S200, or a chat log area S200. Web information display area S210 etc. is displayed.

【0402】

As a result, even when the display area provided by various functional modules is required in the communication program, the display provided by these functional modules is used in the free space generated by reducing the main display area. Since the area (hereinafter referred to as a sub display area) is displayed, a large amount of information can be displayed without securing a new display area.

【0403】

Further, in this way, when the main display area is reduced and the sub display area is also displayed, and the display size of the entire application window is changed at the request of the user, the display size of the entire application window is changed. Change only the display size of the sub-display area without changing the display size. Since the process of changing the display size of the sub-display area is performed by a basic module that constitutes a communication program such as the core module 51, each function module detects the change in the display area and displays the display. There is no need to perform rewriting processing. Further, in the communication program, when the operation of the function module that provides the sub display area is completed, the main display area is returned to the normal display size.

【0404】

Here, the window display processing of the communication program when the functional module is started or terminated as described above will be described with reference to the flowcharts shown in FIGS. 48 and 49.

【0405】

In step S420 shown in FIG. 48, when the communication program is requested to activate a predetermined functional module, in step S421, whether or not a sub-display area reserved by another functional module exists. judge. As a result of this determination, if it exists, the process proceeds to step S422, and if it does not exist, the process proceeds to step S423.

【0406】

In step S422, the communication program stops the display, such as by minimizing the currently existing sub-display area. After the process in step S422, the communication program proceeds to step S425.

【0407】

In step S423, the communication program reduces the main display area. Next, in step S424, the communication program rearranges the display positions of the user face image frame S110 and the client face image frame S111, or each function selection button. After the process in step S424, the communication program proceeds to step S425.

【0408】

In step S425, the communication program performs a process of activating the functional module requested in step S420. Next, in step S426, the communication program acquires information about the sub-display area to be secured in this functional module from the functional module activated in step S425.

【0409】

Next, in step S427, the communication program displays the sub display area in accordance with the size and position of the free area generated by reducing and displaying the main display area based on the information acquired in step S426. And set the position. Next, in step S428, the communication program displays the sub-display area according to the size and position set in step S427.

【0410】

On the other hand, in step S430 shown in FIG. 49, when the communication program is requested to terminate a predetermined functional module, is the sub display area corresponding to this functional module displayed in step S431? To judge. As a result of this determination, if the display is stopped due to the minimization of the sub display area, the process proceeds to step S432, and if the sub display area is displayed, the process proceeds to step S433. Proceed with processing.

【0411】

In step S432, the communication program performs a process of terminating the functional module for which the request to be terminated in step S430 has been made. As a result, the process of terminating the function module is terminated.

【0412】

In step S433, the communication program determines whether or not the sub-display area provided by the other functional module exists in a stopped state such as by being minimized. As a result of this determination, if it exists, the process proceeds to step S434, and if it does not exist, the process proceeds to step S435.

【0413】

In step S434, the communication program resumes the display in place of the sub-display area where the display has been stopped, in place of the sub-display area provided by the functional module for which the request to end has been made. After the process in step S434, the communication program proceeds to step S432.

【0414】

In step S435, the communication program returns the display size of the reduced main display area to the normal display size. Next, in step S436, the communication program rearranges the display positions of the user face image frame S110 and the client face image frame S111, or each function selection button. After the process in step S436, the communication program proceeds to step S432.

【0415】

By starting and terminating each function module as described above, the communication program reduces the main display area and starts displaying the sub display area in the free area generated by the reduction, or the sub display. The process of ending the display of the area and returning the main display area to the normal display size is performed.

【0416】

(14) Hierarchical menu [0417]

By the way, in a communication program, a hierarchical menu is configured by function selection buttons. Specifically, for example, in the basic display mode, by selecting one of the plurality of function selection buttons S112 displayed in the basic display window 110 shown in FIG. 13, the selected function selection button S112 is selected. Then, it shifts to the tool mode, the emotion expression mode, the action expression mode, and the like.

【0418】

When the communication program shifts to the tool mode, emotion expression mode, action expression mode, etc., a plurality of function selection buttons S150, a plurality of function selection buttons S160, and a plurality of function selection buttons S170 are displayed as new menus, respectively. , These function selection buttons are ready to be selected by the user. Further, in each operation mode, the "back" button S150d of the function selection button S150, the "back" button S160b of the function selection button S160, or the "back" button S170b of the function selection button S170 is selected. Then, the communication program shifts to the basic display mode again and displays the function selection button S112.

【0419】

In this way, when the operation mode is shifted by the function selection button being selected by the user and the hierarchy in the hierarchical menu is moved, the communication program responds to the function selection buttons constituting the hierarchical menu. Gives a predetermined animation effect.

【0420】

Examples of the animation effect given at this time include changing the display size, display position, or display angle of the function selection button according to the elapsed time, and changing the content of the image displayed as the function selection button to the elapsed time. It can be mentioned that it is changed accordingly. Further, at this time, for example, the function selection button may be selected by the user, and a voice indicating that the hierarchical menu is moved may be output.

【0421】

In the communication program, when moving the hierarchy of the hierarchical menu in this way, by giving a predetermined animation effect to the function selection button, the movement source hierarchy and the movement destination hierarchy can be set for a predetermined time. During that time, it can be explicitly displayed to the user, and it is possible to easily grasp the hierarchy. In addition, it is possible to improve the expression when operating the hierarchical menu.

【0422】

Here, as an example of the above-mentioned animation effect adopted in the communication program in this example, it will be described with reference to FIG. 50.

【0423】

In the communication program, the function selection buttons S112 displayed in the basic display window 110 are arranged at predetermined intervals on the circumference of the virtual circle centered on the user face image frame S110 as shown in FIG. 50 (a). Has been done. Further, in this state, a text (caption) indicating a function provided by selecting each function selection button S112 is displayed at the lower part of each function selection button S112.

【0424】

In this state, for example, when the tool button S112e is selected by the user, these function selection buttons S112 are displayed by slightly moving toward the outside of the virtual circle, as shown in FIG. 50 (b). At this time, for example, effects such as enlargement of the display size and translucency may be imparted. At this time, the display of the menu element existing in the next hierarchy, that is, the function selection button S150 is started centering on the initial display position of the tool button S112e selected by the user. At this time, each function selection button S150 is displayed in, for example, half the size of the final display size. Then, each of these function selection buttons S150 is moved and displayed while being gradually enlarged from the initial display position to the final display position. In FIG. 50 (b), the moving direction of each function selection button is indicated by an arrow.

【0425】

Then, the function selection button S112 finally disappears, and the function selection button S150 finally disappears on the circumference of the virtual circle centered on the user face image frame S110 as shown in FIG. 50 (c). Displayed at predetermined intervals.

【0426】

In the communication program, when the function selection button is selected by the user, the function of the next hierarchy stored in the selected function selection button is displayed by adding the animation effect as described above. It is possible to give the user the impression that the selection buttons pop out or dive into the menu structure of the hierarchical menu.

【0427】

By memorizing which function selection button in the previous hierarchy is selected by the user, for example, the "back" button can be used to reverse the hierarchy. At this time, for example, an animation effect corresponding to the case where the above-mentioned animation effect is reproduced in reverse may be given to the function selection button. As a result, contrary to the above, the user gives the impression that the function selection buttons of the current hierarchy are sucked into the selected function selection buttons, or that the function selection buttons of the current hierarchy emerge from the menu structure of the hierarchical menu. Can be given to.

【0428】

Here, when the function selection button is selected, the processing of the communication program in the case of giving the animation effect as described above will be described with reference to the flowchart shown in FIG. 51.

【0429】

When the communication program detects that any of the displayed function selection buttons S112 is selected by a click operation by the mouse in step S440 shown in FIG. 51, the communication program selects in step S441. It is determined whether or not the function selection button group S150 of the next layer corresponding to the function selection button S112 is present. As a result of this determination, if it does not exist, the process of giving the animation effect is terminated. If the function selection button group S150 in the next layer exists, the process proceeds to step S442. Here, it is assumed that the function selection button S112e is selected.

【0430】

In step S442, the communication program acquires the current position of the function selection button S112e selected by the user (for example, absolute coordinates on the display screen or relative coordinates in the application window) and stores it in a predetermined storage area. save.

【0431】

Next, in step S443, the communication program acquires information regarding the function selection button group S115 in the next layer. The information includes, for example, the number of function selection buttons S150 included in the function selection button group S150, or image data to be displayed as each function selection button S150.

【0432】

Next, in step S444, the communication program calculates the final display position of all of the function selection button S112 of the current layer and the function selection button S150 of the next layer, respectively.

【0433】

Next, in step S445, the communication program sets the display size of the function selection button S150 in the next layer as half of the final display size.

【0434】

Next, in step S446, the communication program invalidates the selection operation for all of the function selection button S112 of the current layer and the function selection button S150 of the next layer. As a result, it is possible to prevent the user from selecting an erroneous function selection button during the movement of the hierarchy.

【0435】

Next, in step S447, the communication program sets the value of the display coordinates that determine the display position of each of the function selection button S112 of the current layer and the function selection button S150 of the next layer to the final display position. Increases or decreases by a predetermined amount of movement toward.

【0436】

Next, in step S448, the communication program slightly increases the value set as the display size of the function selection button S150 in the next layer. As a result, the function selection button S150 is displayed in a slightly enlarged size.

【0437】

Next, in step S449, the communication program displays all of the function selection button S112 of the current layer and the function selection button S150 of the next layer in the application window. At this time, the function selection button S112 of the current layer and the function selection button S150 of the next layer are displayed according to the display coordinates and the display size values set for each.

【0438】

Next, in step S450, the communication program determines whether or not all of the function selection button S112 of the current layer and the function selection button S150 of the next layer have reached the final display position. As a result of this determination, if all the function selection buttons have not reached the final display position, the process is returned to step S447, and a series of processes after this step S447 are repeated. If all the function selection buttons have reached the final display position, the process proceeds to step S451.

【0439】

In step S451, the communication program stops displaying the function selection buttons S112 corresponding to the movement source hierarchy and deletes them from the application window.

【0440】

Next, in step S452, the communication program enables the selection operation for the function selection buttons S150 corresponding to the destination hierarchy, and makes these function selection buttons S150 selectable. This ends the process of moving between hierarchical menu hierarchies.

【0441】

The communication program can add an animation effect to the function selection button which is a menu element of the hierarchical menu by performing the above-mentioned processing.

【0442】

(15) Other embodiments [0443]

In the above description, as an embodiment of the present invention, the communication program executed and processed on each information processing device constituting the communication system 1 has been focused on, but in the present invention, such a communication program It corresponds to the communication system realized by the execution processing, the communication method realized by performing the procedure corresponding to the processing executed by the above-mentioned communication program, or the processing executed by the above-mentioned communication program. It goes without saying that the procedure can be widely applied to information processing devices realized by other software or hardware methods.

【0444】

[Effect of the invention]

In the present invention, when moving image information is transmitted from a predetermined information processing device to another information processing device via a computer network, still image data is input from the moving image data input from the imaging device at predetermined time intervals. It is generated and output to the transmission queue that is shared when transmitting still image information. Therefore, it is possible to manage and control the data to be transmitted in common between the case of transmitting the moving image information and the case of transmitting the still image information.

【0445】

Therefore, according to the present invention, various information such as image data, audio data, or character data can be efficiently transmitted between information processing devices, and smooth and diverse communication between users of each information processing device can be performed. It can be realized.

[Simple explanation of drawings]

[Figure 1]

It is the schematic which shows the overall basic structure of the communication system shown as the embodiment of this invention.

[Figure 2]

It is a functional block diagram which shows the structure of the computer apparatus used for this communication system.

[Fig. 3]

It is a schematic diagram which shows the module structure of the communication program which is executed and processed on the computer apparatus.

[Fig. 4]

It is a schematic diagram explaining the case where the application module constituting the communication program is started by sending and receiving data by the communication program.

[Fig. 5]

It is a schematic diagram which shows the data structure of the connection setting information used in the communication program.

[Fig. 6]

It is a flowchart which shows the overall processing flow by executing the communication program.

[Fig. 7]

It is a schematic diagram which shows the data structure of the function module list used in the communication program.

[Fig. 8]

It is a flowchart which shows the overall processing flow by executing the communication program.

[Fig. 9]

It is a flowchart which shows the process flow by the server module started in the communication program.

[Fig. 10]

It is a flowchart which shows the process flow by the server module started in the communication program.

[Fig. 11]

It is a schematic diagram which shows the data structure of the user list used in the server module started in the communication program.

[Fig. 12]

It is a schematic diagram which shows an example of the user information setting window displayed on the screen of a computer device by executing the communication program.

[Fig. 13]

It is a schematic diagram which shows an example of the basic display window displayed on the screen of a computer device by executing the communication program.

[Fig. 14]

It is a schematic diagram which shows an example of the reduced display window displayed on the screen of a computer device by executing the communication program.

[Fig. 15]

It is a schematic diagram which shows an example of the notification window displayed on the screen of a computer device by executing the communication program.

[Fig. 16]

It is a schematic diagram which shows an example of the e-mail window displayed on the screen of a computer device by executing the communication program.

[Fig. 17]

It is a schematic diagram which shows an example of the state in which a client is connected to the communication program, and the image corresponding to the client is displayed in the basic display window.

[Fig. 18]

It is a schematic diagram which shows an example of the basic display window at the time of transmitting character data (text) from the user side in the communication program.

[Fig. 19]

It is a schematic diagram which shows an example of the basic display window when the character data (text) transmitted from the client side is displayed in the communication program.

[Fig. 20]

It is a schematic diagram which shows an example of the tool display window displayed on the screen of a computer device by executing the communication program.

[Fig. 21]

It is a schematic diagram which shows an example of the emotion expression window displayed on the screen of a computer device by executing the communication program.

[Fig. 22]

It is a schematic diagram which shows an example of the action expression window displayed on the screen of a computer device by executing the communication program.

[Fig. 23]

It is a schematic diagram which shows an example of the image sound setting window displayed on the screen of a computer device by executing the communication program.

[Fig. 24]

It is a schematic diagram which shows an example of the chat log window displayed on the screen of a computer device by executing the communication program.

[Fig. 25]

It is a schematic diagram which shows an example of the Web information display window displayed on the screen of a computer device by executing the communication program.

[Fig. 26]

It is a schematic diagram which shows the state which the URL sent from the client side is displayed in the e-mail window displayed on the screen of a computer device by executing the communication program.

[Fig. 27]

It is a flowchart which shows an example of processing when moving image data is set as a face image of a user in the communication program.

[Fig. 28]

It is a flowchart which shows an example of processing when a still image file is set as a face image of a user in the communication program.

[Fig. 29]

It is a schematic diagram which shows an example of the data structure of the activation information included in the module information used in the communication program.

[Fig. 30]

It is a schematic diagram explaining that the functional module A is started by referring to the module information used in the communication program.

[Fig. 31]

It is a schematic diagram explaining that the functional module B is not started by referring to the module information used in the communication program.

[Fig. 32]

It is a schematic diagram explaining that the function module C is started in the communication program.

[Fig. 33]

It is a flowchart which shows an example of the process which is executed when the communication program is started.

[Fig. 34]

It is a schematic diagram which shows an example of the tool display window when a new function module is added, and a new function selection button is added in the communication program.

[Fig. 35]

It is a flowchart which shows an example of the process when the URL is sent to the client side in the communication program.

[Fig. 36]

It is a flowchart which shows an example of the process when the URL sent from the client side is received in the communication program.

[Fig. 37]

It is a schematic diagram which shows an example of the data structure of the recommended URL list used in the communication program.

[Fig. 38]

It is a schematic diagram which shows an example of the continuous image to be superposed on the face image frame in the communication program.

[Fig. 39]

It is a schematic diagram which shows an example of the data structure of the keyframe data used in the communication program.

[Fig. 40]

It is a flowchart which shows the whole process when the action expression is performed to the client in the communication program.

[Fig. 41]

It is a flowchart which shows an example of the process at the time of selecting the expression target when the action expression is performed to the client in the communication program.

[Fig. 42]

It is a flowchart which shows an example of the processing at the time of giving the animation effect corresponding to the action expression selected by the user in the communication program.

[Fig. 43]

It is a flowchart which shows an example of the detailed processing at the time of giving the animation effect corresponding to the action expression selected by the user in the communication program.

[Fig. 44]

It is a schematic diagram explaining the display method of the text display area which displays the text transmitted from the client side in the communication program.

[Fig. 45]

It is a schematic diagram for demonstrating the case where the display time of a text is controlled according to the character string length of the text transmitted from the client side in the communication program.

[Fig. 46]

It is a flowchart which shows an example of the process in the case of controlling the display time of a text according to the character string length of the text transmitted from the client side in the communication program.

[Fig. 47]

It is a schematic diagram which shows another example of the shape of the application window displayed in the communication program.

[Fig. 48]

It is a flowchart which shows an example of the process at the time of displaying an application window in the communication program.

[Fig. 49]

It is a flowchart which shows an example of the process at the time of displaying an application window in the communication program.

[Fig. 50]

It is a schematic diagram which shows an example of the animation effect which is given when the display of the function selection button which constitutes a hierarchical menu is switched in the communication program.

[Fig. 51]

It is a flowchart which shows an example of the process when the animation effect is given to the function selection button in the communication program.

[Explanation of symbols]

1 Communication system, 10 Computer equipment, 11 Internet, 20 CPU, 21 RAM, 50 Interface module, 51 Core module, 52 Basic module, 53 Application module, 54 GUI module, 110 Basic display window, S110 User face image frame, S111 Client Face image frame, S112 function selection button, S113 operation icon, S114 status display area, S115 text input area, S116 text display area, 120 reduced display window, 150 tool display window, S150 function selection button, 160 emotion expression window, S160 function Select button, 170 action expression window, S170 function selection button, 180 image / audio setting window, S180 image / audio setting area, S181 image list area, S185 camera image display area, 200 chat log window, S200 chat log area, S201 chat log display Area, 210 Web Information Display Window, S210 Web browsing area, S211 Web information display area, S212g address transmission icon, S214 Recommended URL display area