Information processor and information processing method, program and recording medium

The present invention relates to an information processing device and an information processing method, a program, and a recording medium, and is particularly suitable for use when information can be communicated between a plurality of devices. Regarding programs and recording media.

Conventionally, a user has been able to contact a desired person by selectively using, for example, a telephone or an e-mail. For example, if you try to make a call to a desired person using dialer software or an IP phone, but you cannot make a call while you are busy, the user terminates the dialer software or IP phone and instead uses an e-mail application. You can activate and contact the person you want. At this time, the user had to manually launch the email application.

On the other hand, for example, using IP telephone software or a dialer, I tried to contact the desired user by entering the telephone number for the desired person, but I could get in touch while talking. If you cannot do this, or if you send an e-mail to the desired person but the undelivered e-mail is returned, use the phone number or the original destination address of the unreachable e-mail as a key. There is a technology that searches for other applications in which the contact information of the other party is registered and automatically starts them (for example, Patent Document 1).

<patcit num="1"><text>Japanese Patent Application Laid-Open No. 2003-219046</text></patcit>

<p> In general communication, including the case where a communication device is not used, in order to contact a certain person, think about how to contact, or easily contact a person nearby. It tries to contact the person who can get it. That is, in the natural form of communication between people, the selection of the other party precedes the selection of the tool.</p><p> However, in the technique of Patent Document 1 described above, first, one of the applications is selected, communication processing is performed with a desired partner using the application, and when communication cannot be performed, the user has conventionally manually performed the operation. It is designed to automatically start other applications that were done in, and the selection of tools is prioritized. Further, in the technique of Patent Document 1 described above, it is not possible to select a person who can easily make contact and try to make contact.</p><p> The present invention has been made in view of such a situation, and allows the user to more naturally determine the communication partner.</p>

<p> The information processing device of one aspect of the present invention is an information processing device capable of exchanging information with other devices. A communication means that communicates with the other device to be communicated with.<u style="single">The information of the registered user in the predetermined communication mode includes at least the registered user information acquisition means for acquiring the information of the registered user in the predetermined communication mode.</u>Information regarding the state of communication with the other device by the communication means<u style="single">As</u>By the communication state information acquisition means to be acquired and the communication state information acquisition means.<u style="single">, Connoisseur</u>Information about the state of trust<u style="single">Information of the registered user acquired as</u>On the basis of,<u style="single">Any of the icons of the plurality of registered users</u>Displayed as an icon corresponding to the owner of the other device<u style="single">Do you do</u>Is determined, the determination means for determining the arrangement of the icons, the image generation means for generating the display image including the icon based on the arrangement of the icons determined by the determination means, and the image generation means for generating the icon. It is provided with a display means for displaying the displayed image.</p><p> There may be a plurality of communication modes by the communication means, and the determination means is based on the communication mode.<u style="single">, Which</u>The above icon<u style="single">Whether to display</u>You can change it.</p><p> Among the icons displayed by the display means, based on the operation input acquisition means for acquiring the operation input indicating the selection determination of the icon by the user and the operation input of the user acquired by the operation input acquisition means. , The other device corresponding to the selected and determined icon can be further provided with an extraction means for extracting an application capable of transmitting information by the communication means, and the image. The generation means can further control the application list screen showing the list of the applications extracted by the extraction means, and the display means can further control the application list screen generated by the image generation means. Can be further displayed.</p><p> It is possible that a plurality of communication modes by the communication means exist, and the communication means can be made to repeatedly execute the plurality of the communication modes for a predetermined period of time, and the communication state information. The acquisition means may be made to acquire information regarding the state of communication with the other device by the communication means in each of the communication modes.</p><p> The communication state information acquisition means includes transmission information acquisition means for acquiring information transmitted from other devices existing within the communication range in a communication mode in which devices directly perform wireless communication without going through an access point. The determination means is made to determine the arrangement of the icons based on the information transmitted from the other device existing in the communication range acquired by the transmission information acquisition means. Can be.</p><p> In the communication mode in which the communication state information acquisition means communicates via the access point, another device owned by the registered user who can communicate via the predetermined access point is currently in the online state. It is possible to include an online state detecting means for detecting whether or not the icon is present, and the determining means is made to determine the arrangement of the icons based on the detection result by the online state detecting means. Can be done.</p><p> The information processing method of one aspect of the present invention is an information processing device capable of exchanging information with other devices. It is an information processing method of the device.<u style="single">The information of the registered user in the predetermined communication mode stored in the storage means for storing the information of the registered user in the predetermined communication mode is stored.</u>Information on the state of communication with the other device<u style="single">As</u>Acquired,<u style="single">Connoisseur</u>Information about the state of trust<u style="single">Information of the registered user acquired as</u>On the basis of,<u style="single">Any of the icons of the plurality of registered users</u>Displayed as an icon corresponding to the owner of the other device<u style="single">Do you do</u>Is determined, the arrangement of the icons is determined, a display image including the icon is generated based on the determined arrangement of the icons, and the generated display image is displayed.<u style="single">Let</u>Including steps.</p><p> The program of one aspect of the present invention is a program for causing a computer to execute a process of controlling the display of a display screen that assists the user in designating another device to be communicated.<u style="single">The information of the registered user in the predetermined communication mode stored in the storage means for storing the information of the registered user in the predetermined communication mode is stored.</u>Information on the state of communication with the other device<u style="single">As</u>Acquired,<u style="single">Connoisseur</u>Information about the state of trust<u style="single">Information of the registered user acquired as</u>On the basis of,<u style="single">Any of the icons of the plurality of registered users</u>Displayed as an icon corresponding to the owner of the other device<u style="single">Do you do</u>Is determined, the arrangement of the icons is determined, a display image including the icon is generated based on the determined arrangement of the icons, and a process including a step of controlling the display of the generated display image is performed by a computer. To execute.</p><p> In one aspect of the invention<u style="single">The information of the registered user in the predetermined communication mode stored in the storage means for storing the information of the registered user in the predetermined communication mode</u>Information about the status of communication with other devices<u style="single">As</u>Obtained,<u style="single">Connoisseur</u>Information about the state of trust<u style="single">Registered user information acquired as</u>On the basis of,<u style="single">Any of the icons of the plurality of registered users</u>Displayed as an icon corresponding to the owner of the other device<u style="single">Do you do</u>Is determined, the array of icons is determined, a display image including the icons is generated based on the determined array of icons, and the generated display image is displayed.</p><p> A network is a mechanism in which at least two devices are connected so that information can be transmitted from one device to another. The devices that communicate via the network may be independent devices or internal blocks constituting one device.</p><p> Further, the communication is not only wireless communication and wired communication, but also communication in which wireless communication and wired communication are mixed, that is, wireless communication is performed in a certain section and wired communication is performed in another section. You may. Further, the communication from one device to another device may be performed by wired communication, and the communication from another device to a certain device may be performed by wireless communication.</p>

<p> As described above, according to one aspect of the present invention, the icons corresponding to the devices to be communicated can be displayed, and in particular, the arrangement of the icons is arranged based on the state of communication with the devices to be communicated. Since the determination is made, the user can easily select a communication partner with which the communication is easy.</p>

Embodiments of the present invention will be described below.<u style="single">。</u>

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

An information communication system including the information communication terminal 1-1 to the information communication terminal 1-3 to which the present invention is applied will be described with reference to FIG. In FIG. 1, the information communication terminals 1-1 to the information communication terminals 1-3 are devices having the same functions.

The information communication terminal 1-1 to the information communication terminal 1-3 execute, for example, various programs, and have an information communication function via wireless and wired, a function of recording various information, a function of reproducing audio and video, and recording. It has a function to display various information that has been input, played video, information that assists the user's operation input (so-called GUI (Graphic User Interface)), and a function to receive user's operation input with various input devices. doing. In the following description, when it is not necessary to individually distinguish the information communication terminal 1-1 to the information communication terminal 1-3, it is simply referred to as the information communication terminal 1.

Specifically, the information communication terminal 1 has, for example, a WLAN (Wireless Local Area Network) function corresponding to the 802.11b standard, and can be connected to another device to exchange information. In the WLAN, the information communication terminal 1 can selectively use either an infrastructure mode in which communication is performed via an access point or an ad hoc mode in which devices directly communicate with each other without going through an access point. Further, the information communication terminal 1 can be connected to another device by wire in accordance with the USB (Universal Serial Bus) 2.0 standard, and can exchange information. The USB connection of the information communication terminal 1 corresponds to MSC (Mass Storage Class) and MTP (Media Transfer Protocol) and can be selectively used.

That is, if the information communication terminal 1 is a device that subscribes to a predetermined service or a device in which a predetermined application program is installed and a predetermined setting is made, the information communication terminal 1 does not have to be the information communication terminals 1 to each other. Information can be exchanged via wired or wireless communication, via a predetermined access point, or without an access point.

The information communication terminal 1 includes, for example, a Flash Memory (for example, having a storage capacity of about 1 GB) in addition to a general volatile memory. Further, the information communication terminal may be provided with a storage unit having a larger capacity, such as a hard disk, if necessary. In addition, the information communication terminal 1 is equipped with an LCD (Liquid Crystal display) as a display device and a keyboard as an input device, but if necessary, other input devices such as a mouse and a joystick are connected. Alternatively, a touch panel may be provided together with the LCD.

In addition, the information communication terminal 1 is supplied in response to an audio codec system such as ATRAC (Advanced TRansform Acoustic Coding) 3, MP3 (MPEG Audio Layer-3), and WMA (Windows (registered trademark) Media Audio). Audio data can be recorded or played back. The information communication terminal 1 is provided with a so-called Photo Viewer function, and can store image data and reproduce and display the image data. Furthermore, the information communication terminal 1 supports various DRMs (Digital Rights Management) such as OpenMG and WMT10 (Janus), and distributes and exchanges illegal data without the permission of the author. Can be prevented.

In addition, the information communication terminal 1 can install and execute various application programs such as an IP phone, an instant messenger, an e-mail, a web browser, and a text editor.

Further, it is preferable that the information communication terminal 1 is configured to have a size that can be grasped by the user with one hand and can be carried by the user.

The information communication terminal 1 can be directly connected to a network 11 such as the Internet by wireless communication, and via the network 11, various servers 12, a personal computer 13, or another information communication terminal 1 (information in the figure). Information can be exchanged with (indicated by communication terminal 1-1 and information communication terminal 1-2).

Further, the information communication terminal 1 can directly exchange information with another information communication terminal 1 (indicated by the information communication terminal 1-1 and the information communication terminal 1-2 in the figure) by wireless communication. Is.

The information communication terminal 1 can also be connected to the personal computer 13 (information communication terminals 1-3 in the figure), can exchange information with the personal computer 13, and is a network to which the personal computer 13 is connected. Information can be exchanged with various servers and other information and communication terminals via 11 (for example, the Internet).

Needless to say, more information communication terminals 1, servers 12, or personal computers 13 can be connected to the network 11 of the information communication system.

Next, the outer shape of the information communication terminal 1 will be described with reference to FIGS. 2 to 8. FIG. 2 is a front outline view of the information communication terminal 1.

The information communication terminal 1 is provided with a display unit 21, a WLAN mode switching button 22, a HOME button 23, a BACK button 24, an option button 25, a 4-way key 26, an enter button 27, a speaker 28, and a microphone 29 in front of the information communication terminal 1. , The WLAN ON / OFF switch 30, the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the power switch 33 are provided on the left side surface when facing the display unit 21, and are provided on the right side when facing the display unit 21 in the figure. A communication status notification light emitting unit 34 is provided on the side surface, and a music key 35 is provided on the lower side surface facing the display unit 21.

The display unit 21 is composed of, for example, a flat display such as an LCD so that various information can be displayed. Of the information displayed on the display unit 21, the display of the information indicating the state of the information communication terminal 1 will be described with reference to FIGS. 8 and 9. Further, the information displayed on the display unit 21 at the time of various processing of the information communication terminal 1 will be described later as appropriate.

The WLAN mode switching button 22 is a button for inputting an operation for switching ON / OFF of the wireless LAN.

The HOME button 23 is a button for inputting an operation to display the HOME menu described later on the display unit 21 using FIG. 14 regardless of the type of information currently displayed on the display unit 21.

The BACK button 24 is a button for inputting an operation for returning the display screen to the previous screen.

The option button 25 is a button for inputting an operation for displaying a display screen for setting various options.

The four-direction key 26 is a key for performing operation input such as moving the cursor, changing the selection of a menu, a button, an icon, or the like in the information displayed on the display unit 21.

The decision button 27 is a menu in the selected state or a button for inputting an operation for deciding the selection of a button, an icon, or the like.

The speaker 28 is a speaker that outputs the voice of a call or outputs the voice reproduced by a predetermined application among the voice data recorded in the information communication terminal 1 when an IP telephone is used, for example. is there.

The microphone 29 inputs the voice of a call or collects the voice acquired by a predetermined application, for example, when an IP telephone is used.

The WLAN ON / OFF switch 30 is a switch operated by the user when switching between enabling and disabling the wireless communication function of the information communication terminal 1.

The WLAN status notification light emitting unit 31 notifies the user of whether the wireless communication function of the information communication terminal 1 is enabled or disabled, which is composed of, for example, a light emitting element such as one or a plurality of LEDs (light emitting diodes) and a light guide tube. It is a light emitting unit for lighting, for example, it is turned on when the wireless communication function is enabled, and turned off when the wireless communication function is disabled. When blinking and lit, the communication status notification light emitting unit 34 causes the LED to emit light via the light guide tube.

The power status notification light emitting unit 32 is, for example, whether or not the information communication terminal 1 composed of light emitting elements such as one or a plurality of LEDs (light emitting diodes) is turned on, and whether or not it is being charged. It is a light emitting unit for notifying the user whether charging has been completed. For example, it is turned on when the power is turned on, turned off when the power is turned off, and turned on in a different color when the power is turned on. ..

The power switch 33 is a switch for turning on / off the power of the information communication terminal 1.

The communication status notification light emitting unit 34 is, for example, a light emitting unit for notifying the user of the communication status of the information communication terminal 1, which is composed of a light emitting element such as one or a plurality of LEDs (light emitting diodes). , Lighting in different colors in WLAN infrastructure mode and WLAN ad hoc mode, blinking in different colors when receiving an IP phone, etc. It can be turned off.

Here, the WLAN infrastructure mode is a method of communicating via a wireless LAN access point, and the WLAN ad hoc mode is a method of directly exchanging data between devices without going through a wireless LAN access point. It is a method.

The music key 35 is used to input operations such as playback start, playback end, fast forward, rewind, pause, and forward / reverse AMS (Auto Music Scan; cue) when playing audio data on the information communication terminal 1. Is the key to do.

Next, FIG. 3 is an outline view of the back side (the side where the display unit 21 is not provided) of the information communication terminal 1.

A battery cover 41 is provided on the back side of the information communication terminal 1, and a ringer speaker 42, a HOLD switch 43, and a volume button 44 are provided on the side where the communication status notification light emitting unit 34 is provided.

The battery cover 41 is a mounting portion and a battery cover for mounting a battery that supplies power to each portion of the information communication terminal 1.

The ringer speaker 42 mainly reproduces and outputs music data among the voice data stored in the information communication terminal 1 and music data streamed from another information communication terminal 1 or the like, or is used by an IP telephone. It is a speaker that reproduces and outputs the ringing sound when the call is made.

The HOLD switch 43 is used, for example, in the information communication terminal 1 stored in a pocket or bag, so that any button or switch is not operated against the intention of the user. It is a switch that is operated when the input of buttons, switches, etc. is invalidated.

The volume button 44 is operated by the user when adjusting the volume of the sound output from the ringer speaker 42.

Next, FIG. 4 is an outline view of the upper side surface (the side where the WLAN ON / OFF switch 30 is provided) of the information communication terminal 1.

A USB connector 51 and a connector jack 52 are provided on the upper side surface of the information communication terminal 1.

A USB cable is connected to the USB connector 51 to exchange information with other devices. As the USB connector 51, it is necessary to provide at least a downstream connector (so-called series B or series mini B for connecting to the personal computer 13), and further, an upgrade for connecting peripheral devices. A connector for the stream (so-called series A) may be provided. In addition, the information communication terminal 1 can also be supplied with power by a USB connection.

The connector jack 52 is composed of, for example, a 10-pin flat female connector or the like, and can be connected to an audio input / output device such as headphones or a microphone.

The DC jack 53 receives a DC power supply. Generally, an AC / DC adapter is attached to the DC jack 53, and a household power supply (100V AC) is converted into a DC of a predetermined voltage by the AC / DC adapter and supplied.

Next, FIG. 5 is an external view of the right side surface (the side where the communication status notification light emitting unit 34 is provided) of the information communication terminal 1 from the side where the display unit 21 is provided.

The communication status notification light emitting unit 34, the HOLD switch 43, and the DC jack 53 are arranged as shown in FIG. 5 on the right side surface of the information communication terminal 1.

Next, FIG. 6 is an external view of the left side (the side where the WLAN ON / OFF switch 30 and the power switch 33 are provided) when viewed from the side where the display unit 21 of the information communication terminal 1 is provided.

The WLAN ON / OFF switch 30, the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the power switch 33 are arranged as shown in FIG. 6 on the left side surface of the information communication terminal 1.

FIG. 7 is an external view of the lower side surface (the side where the power switch 33 and the music key 35 are provided) of the information communication terminal 1.

The power status notification light emitting unit 32, the power switch 33, the communication status notification light emitting unit 34, the music key 35, the HOLD switch 43, and the volume button 33 are as shown in FIG. 7 on the lower side surface of the information communication terminal 1. Have been placed.

The information communication terminal 1 is provided with a display unit 21, a WLAN mode switching button 22, a HOME button 23, a BACK button 24, an option button 25, a 4-way key 26, an enter button 27, a speaker 28, and a microphone 29. The front housing 61 part is slid upward (upward toward the display surface of the display unit 21), and the keyboard 71 can be moved by sliding the housing 61 part. It is made to appear. FIG. 8 is an external view when the housing 61 is slid.

Next, the operation inputs related to the power supply and WLAN, and the states of the light emitting units described with reference to FIGS. 2 to 7 will be described.

First, when the power of the information communication terminal 1 is off, none of the light emitting units including the power status notification light emitting unit 32 is lit. Then, when the power switch 33 is operated in the power off state and the power is turned on, the power status notification light emitting unit 32 lights up in a predetermined color indicating that the power is on, and the user's information is displayed. It is ready for normal operation.

When the power of the information communication terminal 1 is ON, that is, the power status notification light emitting unit 32 is lit in a color indicating that the power is on, the WLAN is OFF, that is, the WLAN status notification. When turning on the WLAN while the light emitting unit 31 is off, the user operates the WLAN ON / OFF switch 30. For example, when the WLAN ON / OFF switch 30 is a slide type switch and the ON / OFF is switched by sliding it in a predetermined direction, the user slides the WLAN ON / OFF switch 30. By the operation, the information communication terminal 1 is in a wireless communication enabled state, and the WLAN status notification light emitting unit 31 lights up.

When the WLAN ON / OFF switch 30 is operated and wireless communication is started, the information communication terminal 1 enters either the WLAN infrastructure mode or the WLAN ad hoc mode. Which communication mode is selected may be determined by the setting, or may be set to the communication mode when the information communication terminal 1 last performs wireless communication.

The communication status notification light emitting unit 34 lights up in a predetermined color based on whether the current communication mode of the information communication terminal 1 is the WLAN infrastructure mode or the WLAN ad hoc mode. Further, the communication status notification light emitting unit 34 may be turned on after the WLAN status notification light emitting unit 31 is turned on regardless of the connection state, or may be turned on when the connection is confirmed. Further, the luminosity of the communication status notification light emitting unit 34 may be changed according to the intensity of the radio wave received by the information communication terminal 1.

The power of the information communication terminal 1 is ON, that is, the power status notification light emitting unit 32 is lit in a color indicating that the power is on, and the communication mode is the WLAN infrastructure mode state. That is, in a state where the WLAN status notification light emitting unit 31 is lit and the communication status notification light emitting unit 34 is lit in a predetermined color indicating that the WLAN infrastructure mode is set, the communication mode is set to the WLAN infrastructure mode. When switching to the WLAN ad hoc mode from, the user operates the WLAN mode switching button 22. For example, when the communication mode of the information communication terminal 1 is switched between the WLAN infrastructure mode and the WLAN ad hoc mode by pressing the WLAN mode switching button 22, the user presses the WLAN mode switching button 22. Press. By the operation, the communication mode is switched to the WLAN ad hoc mode, and the lighting color of the communication status notification light emitting unit 34 changes from a predetermined color indicating that the WLAN infrastructure mode is set to a predetermined color indicating that the communication status is in the WLAN ad hoc mode. Be changed.

Further, the communication mode of the information communication terminal 1 is in the WLAN ad hoc mode state, that is, the WLAN status notification light emitting unit 31 is lit, and the communication status notification light emitting unit 34 is lit in a predetermined color indicating that the WLAN ad hoc mode is set. In this state, the user also operates the WLAN mode switching button 22 when the communication mode is switched from the WLAN ad hoc mode to the WLAN infrastructure mode. By that operation, the communication mode of the information communication terminal 1 is switched to the WLAN infrastructure mode, and the lighting color of the communication status notification light emitting unit 34 is from the predetermined color indicating that it is the WLAN ad hoc mode to the WLAN infrastructure mode. It is changed to the predetermined color indicating.

Then, when the power of the information communication terminal 1 is turned on, that is, when the power status notification light emitting unit 32 is lit with a color indicating that the power is turned on, the user turns off the WLAN. ON / OFF switch 30 Operate. For example, when the WLAN ON / OFF switch 30 is a slide type switch and the ON / OFF is switched by sliding it in a predetermined direction, the user slides the WLAN ON / OFF switch 30. By the operation, the communication by the WLAN of the information communication terminal 1 is terminated, and the WLAN status notification light emitting unit 31 is turned off.

When the communication status notification light emitting unit 34 is set to light after the WLAN status notification light emitting unit 31 is lit regardless of the connection status, the communication status notification light emitting unit 34 turns off the WLAN status notification light emitting unit 31. At the same time, it goes out. Further, when the communication status notification light emitting unit 34 is set to light up when the connection is confirmed, the communication status notification light emitting unit 34 is turned off when the wireless connection is disconnected even if the WLAN is ON. When the WLAN is turned off in the connected state, the WLAN status notification light emitting unit 31 is turned off and turned off.

In addition, there are two power-off states, the first of which is power-off state 1 (User OFF) in which no operation input is performed within 3 days after the power-off operation is performed by the user. State). The information communication terminal 1 is designed so that it can be started immediately when the power is turned on in the power off state 1 (power is supplied to a processor or the like described later so that the information communication terminal 1 can be started immediately. Keep it).

The second state is a state in which no operation input is performed after the power is turned off by the user for 3 days or more, or a state in which the battery is removed, a power off state 2 (Deep OFF state). When the information communication terminal 1 receives a power ON operation in the power OFF state 2, it takes a predetermined time such as 30 seconds to start (does not supply power to a processor or the like described later).

Further, the information communication terminal 1 is supplied with DC power by making a USB connection via the USB connector 51 or from the DC jack 53 (generally, AC / DC from a household AC power source or the like). It can be charged by receiving DC power supply via a converter). During charging, the power status notification light emitting unit 32 is set to light in a predetermined color indicating that charging is in progress.

Next, a constant display panel that is basically always displayed on the display unit 21 will be described.

The constant display panel 101 is provided in a predetermined area along the lower side of the display unit 21, for example, as shown in FIG. 9, and is basically always displayed. For example, it is shown in FIG. Various information indicating the status of the information communication terminal 1 is displayed.

On the constant display panel 101, for example, the battery level display area 111, the WLAN signal strength display area 112, the WLAN status display area 113, the communication use application status display area 114, the keyboard input mode display area 115, and the clock display area 116 Is provided.

Information indicating the remaining battery level is displayed in the battery level display area 111. Specifically, in the battery level display area 111, for example, the remaining battery level is displayed with particle sizes of 0%, 25%, 50%, 75%, and 100%, and an animation indicating that the battery is being charged is displayed. Is displayed.

Information indicating the strength of the WLAN is displayed in the WLAN signal strength display area 112. Specifically, in the WLAN radio wave strength display area 112, for example, the strength of the WLAN is displayed in four stages of 0, 1, 2, and 3.

Information indicating the WLAN mode and connection status is displayed in the WLAN status display area 113. Specifically, in the WLAN status display area 113, for example, information indicating whether the WLAN mode is OFF, infrastructure mode, or ad hoc mode, and whether the connection status is connected or OFFLINE. Information indicating that is displayed.

In the communication use application status display area 114, information regarding the execution status of the application to which communication is executed using either the infrastructure mode or the ad hoc mode of the WLAN is displayed. Specifically, for example, when the IP telephone application is executed in the infrastructure mode, the execution status of the IP telephone application is displayed in the communication use application status display area 114, and the instant messenger application is executed in the infrastructure mode. If so, the execution status of the instant messenger application is displayed in the communication use application status display area 114, and when the application using the ad hoc connection is executed in the ad hoc mode, the communication use application status display area 114 is displayed. Displays ad-hoc mode connection information, such as information indicating whether or not one-to-one communication is in progress.

The keyboard input mode display area 115 indicates the input mode of special keys on the keyboard (eg, ALT, NUM, SHIFT, Fn, etc.). When the key is held, the HOLD mark is displayed in the keyboard input mode display area 115.

Then, the current time information is displayed in the clock display area 116.

Needless to say, the constant display panel 101 may display various types of information indicating the state of the information communication terminal 1 other than those described above.

Next, FIG. 11 is a block diagram showing an example of the internal configuration of the information communication terminal 1.

The information communication terminal 1 includes an application processor 131 that mainly controls execution of application programs, and an audio processor 132 that mainly controls functions such as voice data management, audio codec, and copyright management. The application processor 131 and the audio processor 132 are connected by, for example, one or a plurality of serial interfaces or parallel interfaces so that control signals and data can be exchanged.

The application processor 131 executes various processes based on the clock generated by the clock generator 141. Details of the functions executed by the application processor 131 will be described later with reference to FIG.

A display module 142, a backlight driver 143, a light emitting module 144, an audio conversion module 145, a flash memory 146, a memory 147, a wireless communication module 148, a keyboard module 149, and an input module 150 are connected to the application processor 131. .. The input module 150 is also connected to the audio processor 132.

The display module 142 includes a display unit 21, and when the display unit 21 is composed of an LCD, information by the display unit 21 such as an LCD driver, an LCD backlight, and a light guide tube, if necessary, is provided. It is composed of what is necessary for the display of, and displays various information under the control of the application processor 131.

The backlight driver 143 is a driver for the backlight of the display unit 21.

The light emitting module 144 is composed of a WLAN status notification light emitting unit 31, a power status notification light emitting unit 32, a communication status notification light emitting unit 34, and a driver of a light emitting element included in these light emitting units. Based on the control, each of the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the communication status notification light emitting unit 34 is turned on, blinked, or turned off in a predetermined color.

The audio conversion module 145 has, for example, a PLL circuit, an A / D converter, a D / A converter, a DSP core, etc., and in the DSP core, filtering processing such as a high-pass filter and a notch filter, an equalizer, etc. Processing can be performed, and under the control of the application processor 131, the sound collected by the microphone 29 or the microphone connected to the connector jack 52 is A / D converted to perform predetermined processing such as filtering. After the application, it is supplied to the application processor 131, the audio data supplied from the application processor 131 is D / A converted, and the audio data is output to the speaker 28 for reproduction, or via the audio signal processing module 152. Then, the audio data is output to the headphones connected to the connector jack 52 and played back.

The flash memory 146 has a storage capacity of about 64 MB, for example, even after the power supply is stopped, such as a program executed by the application processor 131 and a register in which information necessary for executing the program and various variables are set. Memorize information that is not erased.

The memory 147 is composed of, for example, SDRAM (Synchronous Dynamic Random Access Memory) or the like, has a storage capacity of, for example, about 64 MB, and stores information necessary for processing executed by the application processor 131.

The wireless communication module 148 is, for example, a unit that realizes the WLAN function corresponding to the 802.11b standard, executes wireless communication under the control of the application processor 131, and directly communicates with other devices or is an access point. And exchange information via the network.

The keyboard module 149 is configured to include a keyboard 71, receives a user's operation input, and supplies a signal indicating an operation content to the application processor 131.

Input module 150 includes WLAN mode switch button 22, HOME button 23, BACK button 24, option button 25, 4-way key 26, enter button 27, WLAN ON / OFF switch 30, power switch 33, music key 35, and HOLD switch 43. , And, corresponding to the volume button 44, the user's operation input is received, and a signal indicating the operation content is supplied to the application processor 131 or the audio processor 132.

The audio processor 132 executes various processes based on the clock generated by the clock generation unit 151-1 or the clock generation unit 151-2. Since the audio processor 132 is a processor that mainly handles audio data, if it receives two clock inputs, a basic clock used for codec processing of audio data and a basic clock used for other signal processing. Suitable. Details of the functions performed by the audio processor 132 will be described later with reference to FIG.

In addition to the input module 150 described above, the audio processor 132 is connected to an audio signal processing module 152, a USB connector 51, a real-time clock (RTC) 153, a large-capacity flash memory 154, and a memory bus 155. Flash memory 156 and memory 157 are connected to. The audio processor 132 is also supplied with an insertion / removal detection signal of the connector jack 52.

The audio signal processing module 152 contains, for example, a D / A converter, a digital filter, an audio output (headphone or speaker) amplifier, and the audio data supplied from the audio processor 132 or the audio conversion module 145 is D. It is converted to / A, filtered and amplified as necessary, supplied to the ringer speaker 42 or the connector jack 52, and played back and output. Further, the audio signal processing module 152 receives a command from the audio processor 132 to output not only an audio output but also a so-called beep sound or a ring tone such as an IP phone, and the ringer speaker 42 or the connector jack 52 receives a beep sound or a ring tone. Is output.

The real-time clock (RTC) 153 is a clock that counts the current time, and supplies the current time to the audio signal processing module 152.

The large-capacity flash memory 154 is a flash memory having a large storage capacity such as 1 GB to several GB, and stores information supplied from the audio processor 132. The large-capacity flash memory 154 also stores information generated or acquired by the processing of the application processor 131 supplied via the audio processor 132.

The large-capacity flash memory 154 contains, for example, content data such as music data that can be played by processing of the audio processor 132, data generated by various application programs, and tools such as instant messenger, IP phone, chat, and e-mail. The registration information of other users, which is used when exchanging information with other users by using the above, is stored. Further, the large-capacity flash memory 154 also stores registration information about itself (device and user) sent to a device owned by another user, and the user can change the setting as appropriate. There is.

The flash memory 156 has a storage capacity of, for example, about 64 MB, and even after the power supply is stopped, such as a program executed by the audio processor 132 and a register in which information necessary for executing the program and various variables are set. Memorize information that is not erased.

The memory 157 is composed of, for example, SDRAM or the like, has a storage capacity of about 64 MB, and stores information necessary for processing executed by the audio processor 132.

Further, another device such as a personal computer 13 is connected to the USB connector 51 via, for example, a USB cable, as described with reference to FIG. 1, for example. A computer in which a drive 171 is connected to the USB connector 51 as needed, and a removable media 172 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached and read from the removable media 172. The program is installed in flash memory 146 or flash memory 156 as needed to make it executable.

The signal supplied from, for example, the personal computer 13 is supplied to the audio processor 132 via the USB connector 51, and is supplied to the application processor 131 as needed. Further, the audio processor 132 outputs a predetermined signal to, for example, a personal computer 13 via the USB connector 51.

Further, the DC power supply supplied by the USB connection, the DC power supply supplied via the DC jack 53, or the DC power supply supplied from the battery 160 mounted on the information communication terminal 1 is informationed by the power supply control unit 161. It is supplied to each part of the communication terminal 1.

Next, FIG. 12 is a software stack showing the configuration of software executed in the application processor 131.

As shown in FIG. 12, the configuration of software executed by the application processor 131, from the lower side, a hardware layer, a device driver layer, OS layer, a middleware layer, and an application layer regulations are constant.

The device driver layer is dedicated software for operating the application processor 131 and the hardware connected to the application processor 131. Specifically, the device driver (WLAN) for operating the wireless communication module 148, Operates the LCD driver (LCD) for operating the LCD included in the display module 142 for displaying images on the display unit 21, the keyboard driver (KEY) for operating the keyboard module 149, and the general-purpose port of the application processor 131. A driver (GPIO) for operating the light emitting element included in each of the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the communication status notification light emitting unit 34 of the light emitting module 144 ( LED) is included.

Further, in the device driver layer, as other device drivers (Other), for example, a driver for operating the backlight driver 143, various memory drivers, a device driver for operating the audio conversion module 145, and information. When the communication terminal 1 has an input device such as a mouse, a mouse driver for operating the mouse, and when the information communication terminal 1 has a hard disk for storing information inside. , If the hard disk driver for driving the hard disk and the information communication terminal 1 are connected to an external printer and can output information to the printer for printing, drive that printer. Necessary device drivers, such as printer drivers for, are included as appropriate.

Next, the operating system (OS) that controls the basic operation of the application processor 131 is installed in the OS layer. The OS manages various resources operated by the device driver. For example, an instruction generated by an application program executed in the middleware layer or the application layer, which will be described later, is transmitted to the device driver or flashed. Provides basic functions commonly used by many application software, such as data input / output with memory 146, memory 147, or audio processor 132, or management of input / output functions such as key input and screen output. And manage the entire system. OS includes, for example, Windows (registered trademark) 95 (trademark), Windows (registered trademark) 98 (trademark), Windows (registered trademark) NT (trademark), LINUX, OS / 2 (trademark) and the like. In addition, the OS manages a part of software resources such as the execution context of any application program executed in the application layer described later (register set, main memory image, file handle, etc. used by a certain application program). Is also designed to be done.

The middleware layer is composed of middleware, which is software that runs on the OS and provides application software with more advanced and specific functions than the OS.

Middleware has an intermediate character between the OS and application software. Since it is inefficient to individually develop the functions that are commonly used in many application software, the functions that are commonly used in many application software (often the basic functions) are Provided as middleware.

Here, as middleware, we provide a communication engine for providing basic functions of communication applications such as IP phones, and basic functions of technology for transmitting and receiving voice data using TCP / IP networks such as the Internet and intranet. VoIP (Voice over IP) engine to provide, instant messenger engine to provide basic functions of instant messenger, to realize the function of encrypting data to protect the copyright of digital data. In addition to the DRM (Digital Rights Management) protocol, a graphic library, which is a collection of GUI parts displayed on the display unit 21 as various application programs are executed, is prepared.

A graphic library is a collection of versatile functions and data used in the image processing of various application programs executed in the application layer. Specifically, some versatile functions used in image processing are put together like an archive, and the functions required for software execution are standardized as independent files. Graphics libraries are generally distinguished from application program subroutines as they are loaded at run time separately from the application program.

Then, various application programs are executed in the uppermost application layer. In the information communication terminal 1, for example, a communication application, a web browser, a file exchange application, a personal computer connection application, an audio player, a music search application, music streaming, an instant messenger, a recording tool, a photo viewer, and a text editor ( In addition to individual applications such as Text Editor), WLANs, menu display tools, setting tools, status bar display tools, utilities such as FEP (Front End Processor), an application manager that manages these application software, and a development environment. It is prepared.

The communication application is for using a communication engine or a VoIP engine to provide communication with other devices (other users using) such as so-called IP telephone function and voice chat.

A web browser is an application for browsing web pages via a network. Specifically, it downloads HTML files, image files, music files, etc. via the network, analyzes the layout, and displays it. Application software that executes the playback function, allows the user to send data to a Web server using the displayed form, and is written in Java (registered trademark) Script, Flash, and Java (registered trademark). To realize the function to operate.

The file exchange application is for providing a file transfer function for sending and receiving data files to and from other devices connected to the network or directly. The personal computer connection application is for connecting to the personal computer 13 to provide a function of exchanging information.

The audio player provides a function of playing back music data. The music search application is for creating a database of music data stored inside and providing a function of searching for music data desired by a user. In addition, music streaming provides a function of exchanging music data with another device for streaming playback.

The instant messenger application is for checking whether a friend who is using the same software on a network such as the Internet or LAN is online, and if it is online, chatting or transferring files.

The recording tool is for providing a function of recording and playing back the voice data collected by the microphone 29, such as a so-called voice memo. The photo viewer manages the image data (photograph data) recorded inside, and controls the playback display in various display methods such as a list display of thumbnail images and a slide show display. The text editor provides a function for creating text data based on the user's operation input by the keyboard 71 or the like.

In addition to this, as individual applications, for example, spreadsheet software, database creation software, e-mail applications, various games, and the like can be appropriately installed.

In addition, the WLAN is for realizing the WLAN function corresponding to the 802.11b standard, for example, and the menu display tool is for controlling the display of the menu screen, the standby screen, etc. displayed on the display unit 21. belongs to. The setting tool is for setting various functions of the information communication terminal 1 based on the user's operation input, and the status bar display tool is for various information on the constant display panel described with reference to FIGS. 9 and 10. Is for displaying. FEP is a kana-kanji conversion software used to input Japanese.

Next, FIG. 13 is a software stack showing the configuration of software executed in the audio processor 132.

First, the device driver layer consists of an audio processor 132 and dedicated software for operating the hardware connected to the audio processor 132. Specifically, in order to realize a USB connection and a USB streaming function. Of the USB driver, which is the driver software of the above, the flash memory driver for operating the large-capacity flash memory 154 connected to the audio processor 132, the audio driver for operating the audio signal processing module 152, and the input module 150. In particular, it is composed of a key driver for operating a music key 52 or the like for inputting an operation related to a process executed by the audio processor 132.

Further, in the device driver layer, as other device drivers, for example, a memory driver for operating a memory other than the large-capacity flash memory 154, and a device driver (GPIO) for operating a general-purpose port of the application processor 131. Necessary device drivers such as are included as appropriate.

The OS controls the basic operation of the audio processor 132. As the OS, it is preferable to use a real-time OS for embedded systems such as uITRON.

Then, various applications run on the OS.

The information communication terminal 1 can switch between two USB modes, MSC (Mass Storage Class) and MTP (Media Transfer Protocol), when connecting via USB.

The MSC (Mass Storage Class) is for providing a function of recognizing and controlling a connected USB device (here, an information communication terminal 1 for a personal computer 13) as a storage device. That is, since the information communication terminal 1 adopts an interface compatible with the USB mass storage class, it is recognized as a drive by the OS of the personal computer 13. As a result, the data recorded inside the information communication terminal 1 (for example, image data, music data, etc.) can be read from the personal computer 13 not only from the dedicated application but also from an application such as an explorer.

MTP (Media Transfer Protocol) is a protocol that connects an information communication terminal 1 and a personal computer 13 to transfer music data, moving image data, or still image data in both directions. MTP runs on the communication layer with any storage device, including the USB mass storage class, and can securely transfer copyrighted content.

The file system manages files recorded in a large-capacity flash memory 154 or the like connected to the audio processor 132. Among the files managed by the file system, the music data files are stored in a database by the music DB (Data Base) and copyright protected by DRM (Digital Rights Management) Lib. (Library).

DRM Lib. Is a variety of functions to protect the copyright of digital data and to prevent unauthorized copying and leakage by encrypting digital contents such as music, videos, and images. A collection of versatile functions and data used in the application program of.

The music data recorded in the large-capacity flash memory 154 connected to the audio processor 132 is, for example, MP3 (MPEG Audio Layer-3), ATRAC (Adaptive TRansform Acoustic Coding) 3, WMA (Windows (Windows (Windows)). Since it is compressed in a compression format such as (registered trademark) Media Audio) or ASF (Advanced Streaming Format), music data and the like are compressed and decompressed by an audio cordic based on each method.

Then, the audio player is copyright-protected by DRM Lib. Based on the control signals of various software running on the application processor 131 supplied via the application processor interface, and the music data managed by the music DB. Is compressed and decompressed by an audio cordic in a predetermined manner, and the process of reproducing and outputting is controlled.

The system controller controls the various functions described above realized by the audio processor 132.

The application processor interface provides a function of controlling the exchange of various information and control signals between the application processor 131 and the audio processor 132.

Next, a specific execution example in various application programs executed in the information communication terminal 1 will be described with reference to the display screen displayed on the display unit 21.

Various application programs executed in the information communication terminal 1 include communication with other devices such as an audio player that reproduces voice data, a recording tool (so-called voice memo), a photo viewer, or a text editor. A file exchange application that does not use processing, sends and receives data files to and from other devices via the network, sends multimedia data such as video and audio to other devices through the network, and receives these multimedia data. Uses communication processing with other devices such as music streaming that plays at the same time, communication applications that provide functions such as IP phone, instant messenger that provides functions such as chat, and web browsers for browsing web pages. There is something to do.

There are also application programs that include multiple functions. For example, audio data (for example, especially music data), still image or moving image data, etc. can be recorded internally, the recorded data can be organized to build a database, and data can be exchanged with other devices. There are also application programs that include both processing that does not require communication processing with other devices and processing that requires communication processing, such as processing that reproduces internally recorded data or streamed data.

FIG. 14 is a diagram showing a display example of the Home screen 451 displayed on the display unit 21 of the information communication terminal 1 immediately after the power is turned on or when the HOME button 23 is pressed. The Home screen 451 displays a menu of a list of application programs (or items composed of a plurality of application programs) that can be executed on the information communication terminal 1. In the Home screen 451 of FIG. 14, the standby screen (Stand by Screen) 461, the communication application (Communication) 462, the music tool (Music) 463, the web browser (WEB Browser) 464, the photo viewer (Photo Viewer) 465, and the text editor (text editor) Text Editor) 466, Recording Tool (Voice) Memo) 467 and various settings (Tools) 468 are displayed as selectable states. When the application program that can be executed on the information communication terminal 1 cannot be displayed in one screen of the Home screen 451, the user operates the UP key or the DOWN key of the 4-way key 26 to scroll the menu list. All applications are designed to be displayed. The user can display the Home screen 451 on the display unit 21 and select and start any of the application programs displayed in the menu.

As a method of determining the menu selection by the user, for example, the position of the selected (cursor is on) menu is changed by the user operating the UP key or the DOWN key of the 4-way key 26. (The menu list is displayed only when the UP key is pressed while the cursor position is at the top position, or when the DOWN key is pressed while the cursor position is at the bottom position. Is scrolled), even if the user can select and determine the desired application (for example, instruct to start) by moving the cursor position to the desired application menu and pressing the enter button 27. Also, when the user operates the UP key or DOWN key of the 4-way key 26, the entire menu list is moved, and the menu displayed at a predetermined position (for example, the third from the top) is always selected. The state is assumed, and the user selects and determines the desired application by moving the desired application menu to a predetermined position (for example, the third from the top) and pressing the enter button 27 (for example, launching). It may be something that can be ordered).

First, the recording tool (Voice Memo) 467 is selected and determined from the menu display of the application program (or item composed of a plurality of application programs) list on the Home screen 451 described with reference to FIG. An example of processing when a so-called voice memo) is executed will be described with reference to FIGS. 15 to 18.

FIG. 15 shows a display example of the screen 481 in the recording standby state, which is first displayed when the recording / playback tool is started.

The recording and playback tool display screen 481 includes a recording time display area 491 for displaying the recording time and a message display area 492 for displaying a message to the user. In the recording time display area 491, not only the recording or playback time, but also information indicating, for example, the volume of the audio data being recorded or played, or the current playback position (playback) in the audio data recorded during the playback process. The stop position) and the like may be displayed.

As shown in FIG. 15, in the recording standby state, the recording time displayed in the recording time display area 491 indicates 0, and in the message display area 492, "Recording standby state. Recording is started. If so, the message "Rec Ready. Push Enter to Start." Is displayed.

When the user presses the enter button 27, that is, when the input module 150 receives a signal indicating the user's operation input, the application processor 131 is picked up by the microphone 29 or the microphone connected to the connector jack 52. , The audio data converted to A / D in the audio conversion module 145 is supplied, supplied to the audio processor 132, encoded, and then supplied to the large-capacity flash memory 154 for storage.

FIG. 16 shows a display example of the screen 501 during recording.

As shown in Fig. 16, in the recording state, the recording time is displayed in the recording time display area 491, and in the message display area 492, "Recording is in progress. To stop recording, press the OK button. (New Recording. Push Enter to Stop.) "Is displayed.

When the user presses the enter button 27, that is, when the input module 150 receives a signal indicating the user's operation input, the application processor 131 is picked up by the microphone 29 or the microphone connected to the connector jack 52. End the acquisition of the sound.

FIG. 17 shows a display example of the screen 511 in a state where recording is stopped, that is, while the recorded audio data is waiting for playback (pause).

As shown in FIG. 17, in the playback standby state, the recording time is displayed in the recording time display area 491, and information indicating the current playback stop position in the recorded voice data is displayed, and the message display area is displayed. The message "Pause. Push Enter to Pray." Is displayed on 492. "Pause. Push Enter to Pray." Is displayed.

When the user presses the enter button 27, that is, when a signal indicating the user's operation input is received from the input module 150, the application processor 131 transmits the audio data recorded in the large-capacity flash memory 154 to the audio processor 132. After being read and decoded, it is supplied to the audio conversion module 145. The audio conversion module 145 D / A-converts the supplied audio data and outputs the decoded audio data to the speaker 28 for playback, or connects to the connector jack 52 via the audio signal processing module 152. The decoded audio data is output to the headphones and the like for playback.

FIG. 18 shows a display example of the screen 521 during playback of the recorded audio data.

As shown in FIG. 18, in the playing state, the recording time is displayed in the recording time display area 491, and information indicating the current playback position in the recorded voice data is displayed, and the message display area is displayed. The message "New Praying. Push Enter to Pause." Is displayed on 492. "Playing. If you want to pause the playback, press the OK button (New Praying. Push Enter to Pause.)". When the user presses the enter button 27 in the state shown in FIG. 18, the playback is paused, and the playback standby state described with reference to FIG. 17 is set.

Next, when the photo viewer 465 is selected and determined from the menu display of the application program (or item composed of a plurality of application programs) list on the Home screen 451 described with reference to FIG. 14, and the photo viewer is executed. An example of the processing of is described.

FIG. 19 is a diagram showing an example of the display screen 551 when the photo viewer is being executed. The photo viewer is an application program that reads out and displays the still image data stored in the large-capacity flash memory 154 based on the user's operation input. For example, the stored image is converted into a thumbnail image. The image is displayed as a list, thumbnail images are displayed in units of classification by the user, and the images are displayed in a slide show format.

Next, with reference to FIGS. 20 to 22, the text editor 466 is selected and determined from the menu display of the application program (or item composed of a plurality of application programs) list of the Home screen 451 described with reference to FIG. An example of processing when a text editor is executed will be described.

FIG. 20 is a diagram showing an example of a new text creation screen 571. The title of the text file is displayed at the top of the new text creation screen, and "Untitled" is displayed if the title of the text file has not been entered yet. In addition, a cursor indicating the current editing position of the text input area is displayed.

Then, during the text input, the context menu (Context Menu) 581 as shown in FIG. 21 can be displayed based on the user's operation input. The context menu 581 includes, for example, "End Comm. App. Call" to quit the text editor and start the communication application, and "End AD" to quit the text editor and start the ad hoc connection mode. "HOC Connect", "Save" to save the created text file, "Save As" to save the text file with a name, "Cut" to specify the range of the character string and cut out the specified part, There are "Copy" that copies the specified part by specifying the range of the character string, and "Paste" that pastes the cut or copied character string at the specified position.

In addition, the text editor has a character prediction conversion function. With the character prediction conversion function, when you move the cursor to the place where you want to enter a character string and start inputting characters, multiple candidates for the character string that is expected to be input following the character you started inputting are displayed. The character string predictive conversion bar 591 of FIG. 22 is displayed at the bottom of the screen.

If there is a character string to be input in multiple candidates of the character string displayed in the character string prediction conversion bar 591, the user can input the operation to select the character string, and input a small amount of text. It becomes possible for the user to input a desired sentence. The display of the character string prediction conversion bar 591 is erased when the part displayed as "x" at the end thereof is selected and determined by the user's operation input.

Further, the information communication terminal 1 may be provided with a so-called cross key on the keyboard 71 shown in FIG. 8 in addition to the four-way key 26 provided on the housing 61. In this case, it is preferable to use the 4-way key 26 and the cross key of the keyboard 71 properly.

For example, when the 4-direction key 26 is used to command the movement in the up / down / left / right direction, or when the cross key on the keyboard 71 is used to command the movement in the left / right direction, the cursor movement in the editor is commanded. Then, when the vertical movement is commanded using the cross key of the keyboard 71, it is possible to command the selection change of a plurality of candidates of the character string displayed on the character string prediction conversion bar 591. it can.

The three application softwares described above, voice memo, photo viewer, and text editor, did not use communication processing with other devices. For example, for functions related to music content, with other devices. Since there are both those that do not use communication processing and those that use communication processing with other devices, for example, by preparing a menu screen that summarizes those that handle music content, the user can use the music content. It is preferable to be able to use a plurality of application programs that handle the above without consciously distinguishing them.

Communication methods with other devices include a wired connection using USB and a wireless connection using WLAN. Further, as described above, the wireless connection using WLAN includes an ad hoc mode and an infrastructure mode.

Communication in the ad hoc mode will be described with reference to FIGS. 23 to 26.

For example, as shown in FIG. 23, there are information communication terminals 1-1 to information communication terminals 1-5 owned by users A to E within a range in which ad hoc communication is possible, and information communication owned by user D. It is assumed that the terminal 1-4 and the information communication terminal 1-5 owned by the user E are communicating in the ad hoc mode.

In the information communication terminal 1, the information communication terminals 1 in the ad hoc mode, which exist in the range where ad hoc communication is possible, are not allowed to freely transfer files and stream music data, and each other is not allowed to perform file transfer or streaming of music data. File transfer and music data streaming can be performed only when the device on the side is registered.

Each of the information communication terminals 1-1 to information communication terminals 1-5 owned by users A to E in FIG. 23 is unique (that is, basically changed) of itself (information communication terminal 1) in the ad hoc mode. All information within the communication range, rather than being broadcast (ie, deciding on a specific destination), and information about the current status of yourself (information and communication terminal 1) (ie, depending on the time). (To the device) to send. FIG. 24 shows an example of information transmitted by the information communication terminal 1 in the ad hoc mode by broadcasting.

The information communication terminal 1 in ad hoc mode is currently playing a song such as its own IP address and port number, device-specific ID, profiled User ID, connection availability information such as Busy or Ready, song title, artist name, etc. (Now Playing song) information, information necessary for stream playback when the song data is copyright protected, such as Sequence Number + Object Handle of the song being played, other information such as playback operation status, input by the user Broadcast information such as text memos.

Of these, the IP address and port number of the own station, the device-specific ID, and the profile-set User ID are basically unchanged information, and are currently playing song (Now Playing song) information and playing song. Information necessary for stream playback when is copyright-protected music data, other information such as playback operation status, etc. differs depending on the time, and information such as text memos entered by the user is basic. It is not changed to, but it is information that can be changed when the user changes the registered contents.

Further, the information communication terminal 1 in the ad hoc mode will be described with reference to FIG. 24, for example, as long as the information may be disclosed to a user who is not registered as a communication partner in the ad hoc mode for mutual information communication. Alternatively, it may be transmitted by broadcast. For example, it is an icon (thumbnail) indicating oneself displayed on the standby screen (details will be described later) on the information communication terminal 1 of the communication partner in the ad hoc mode, and is used by users who have not yet registered with each other. The image data corresponding to the icon to be displayed may be transmitted to another information communication terminal 1 in the ad hoc mode together with the above-mentioned information.

Then, each of the information communication terminals 1-1 to information communication terminals 1-5 owned by users A to E in FIG. 23 acquires information as described with reference to FIG. 24 from other devices, and each of them obtains information as described with reference to FIG. 24. Whether or not the other information communication terminal 1 is a device owned by a user registered as a communication partner in ad hoc mode, and another information communication terminal 1 owned by a user registered as a communication partner in ad hoc mode. It is possible to recognize the communication status of the user and the information about the user of another unregistered information communication terminal 1 existing in the range where ad hoc communication is possible.

Then, the information communication terminal 1 is registered on the display unit 21 as a user of another information communication terminal 1 registered as a communication partner in the ad hoc mode in the ad hoc mode and existing in a range in which ad hoc communication is possible. Displays the ad hoc user list display screen that displays a list of information about users of other information communication terminals 1.

On the ad hoc user list display screen, the communication status with another information communication terminal 1 owned by the user registered as the communication partner in the ad hoc mode is "Online state", which is a communicable state, or is not here. Therefore, it is displayed whether it is in the "Offline state", which is the communication disabled state, or the "Busy state", which is the communication disabled state because it is communicating with another device, and ad hoc communication is performed. It is displayed that the status of the other unregistered information / communication terminal 1 existing in the possible range is "Unknown status".

That is, for example, when user A has registered user B, user Z, user D, and user E as communication partners, the user A's ad hoc user list display screen is displayed as shown in FIG. B is online, user Z is offline, user D is communicating with another device and is busy, and user E is communicating with another device and is busy. Information indicating that the user C is present and that the unregistered user C is within the range in which ad hoc communication is possible is displayed. When user B has registered user A, user D, and user E as communication partners, user A is in the online state on the ad hoc user list display screen of user B as shown in FIG. There is, user D is communicating with another device and is in a busy state, user E is communicating with another device and is in a busy state, and user C who is not registered is ad hoc communication. Information is displayed indicating that it exists within the possible range. Similarly, when user C has registered user D and user E as communication partners, user D is on another device as shown in FIG. 25 on the ad hoc user list display screen of user C. The user E is communicating with another device and is in the busy state, and the unregistered users A and B are within the range where ad hoc communication is possible. Information indicating that is displayed.

In addition, on the ad hoc user list display screen, at least a user name that can be identified from the user ID among various information acquired by broadcasting and information indicating communication information (for example, Online, Offline, Busy, Unknown, etc.) are displayed. At the same time, other information can be displayed as needed. Here, on the ad hoc user list display screen, the Now Playing song information is displayed together with the user name and the information indicating the communication information. Further, the ad hoc user list display screen may display information such as a text memo input by the user, if necessary.

Then, among the various information acquired by the broadcast, the information that is not displayed on the ad hoc user list display screen may be made available for confirmation as, for example, a user information property.

In addition, when an unregistered user in the ad hoc mode, such as user C in user A, user C in user B, or user A and user B in user C, is selected and determined on the ad hoc user list display screen, this user is selected. A dialog is displayed with a message confirming mutual registration processing, and if the user approves this, the mode shifts to the registration mode.

FIG. 26 shows an example of user information exchanged when information communication terminals 1 owned by unregistered users are mutually registered as communication partners.

The information given and received at the time of registration includes, for example, a device-specific ID, a profile-set User ID, text data entered by the user for registration, such as the URL of his / her own homepage and self-introduction text, which will be described later. Image data used for the face icon (not to mention the actual user's face photo data) displayed on the standby screen (Stand by Screen), and the display unit 21 during communication processing with the user. Contains user color information set by the user as the display color of the background (so-called wallpaper), ID used in communication applications (for example, tools such as chat and IP phone), and instant messenger ID. Is suitable.

Information and communication terminals 1 owned by unregistered users can send messages to other information and communication terminals within the communicable range. The wireless communication module 148 of the information communication terminal 1 sends, for example, a message prompting mutual user registration to the information communication terminal 1 of the other party, and after mutual consent, provides information as shown in FIG. 26. It sends and receives and supplies the received information to the application processor 131. The application processor 131 supplies the supplied information to the flash memory 146 connected to the application processor 131, or the flash memory 156 or the large-capacity flash memory 154 connected to the audio processor 132, and in the ad hoc mode. , Registered as information about the information communication terminal 1 held by the user registered as a communication partner capable of executing file exchange, streaming, and the like.

The information communication terminals 1 registered as communication partners capable of executing file exchange and streaming in the ad hoc mode are as shown in the information communication terminals 1-4 and the information communication terminals 1-5 shown in FIG. It is designed so that it can always communicate one-on-one and perform file exchange and streaming playback.

Here, the file exchange can be basically executed for all the data files recorded inside the information communication terminal 1, but the data files to be exchanged are copyright protected. If so, the data file acquired by file exchange is opened (played) unless the information communication terminal 1 of the communication partner (the file supply destination) holds the descramble key of the data file. You can't.

In addition, in streaming playback in ad hoc mode, when streaming playback of non-copyright-protected content, the information communication terminal 1 that performs streaming playback (file supply destination) is permitted to play the stream file. If so, the data file acquired by file exchange is opened unless the information communication terminal 1 that performs streaming playback (file supply destination) has the descramble key of the stream file. It cannot be (reproduced).

Next, referring to FIGS. 27 to 32, from the menu display of the application program (or item composed of a plurality of application programs) list of the Home screen 451 described with reference to FIG. 14, the music tool (Music) 463 Will be selected and determined, and a case where processing for handling audio data (mainly music data) is executed will be described.

FIG. 27 is a menu screen 621 displayed on the display unit 21 when the music tool (Music) 463 is selected and determined from the menu display of the list of the Home screen 451 described with reference to FIG. When Music Tool (Music) 463 is selected on the Home screen 451, the Music Search631, Streaming632, Now Playing633, All Tracks634, ATRAC AD635, Music Folder636, My Playlist637, and Inbox638 menus are displayed, as shown in FIG. Displayed, the user can select and determine the desired menu using the four-way key 26 and the enter button 27.

When Music Search 631 is selected and decided on the menu screen, the music search application of the application layer described with reference to FIG. 12 is started, the search screen 651 is displayed as shown in FIG. 28, and the user can enter the text input unit. By inputting a desired search key in 661, music data can be selected.

When the user inputs a desired search key into the text input unit 661 and presses the enter button 27, the music search application running on the application processor 131 is supplied to the audio processor 132 from the keyboard module 149. Supply the searched key.

The audio processor 132 uses the music DB function described with reference to FIG. 13 to search for titles, album names, and artist names that include the supplied search key, and searches for search results (for example,). , Music name) is supplied to the application processor 131.

As shown in FIG. 28, the music search application running on the application processor 131 displays the search result (for example, the music name) in the search result display area 662 of the search screen 651.

The user uses the four-way key 26 to move the cursor 663 to one of the search results (for example, the music name) in the search result display area 662 of the search screen 651, and uses the enter button 27 to move the cursor. When the search result (for example, the music name) selected by 663 is selected and determined, the application processor 131 starts the audio player described with reference to FIG. 12, and controls the audio processor 132 as needed. The music data selected and determined by the user is played back and output. That is, the audio processor 132 starts the reproduction processing of the selected and determined music data by using the function of the audio player described with reference to FIG.

Specifically, the audio processor 132 reads the music data managed by the music DB from the large-capacity flash memory 154, and holds the selected music data by DRM Lib. When the selected music data is copyright protected. While descrambling is performed using the functions and data that have been created, it is supplied to the audio signal processing module 152, and the audio signal processing module 152 is controlled by using the audio cordic function to perform decoding processing and D / A. After performing conversion processing, the ringer speaker 42 is used for playback output, or the headphone or the like attached to the connector jack 52 is used for playback output.

FIG. 29 shows a music data reproduction display screen 671 displayed on the display unit 21 of the information communication terminal 1 during music data reproduction. On the music data playback display screen 671, for example, information about the content such as the title name of the music data, the artist name, the album name, or the thumbnail image of the jacket of the album or the like is displayed.

Then, when Streaming632 is selected and determined on the menu screen 621 of FIG. 27 while the WLAN ad hoc mode is ON, the ad hoc user list screen 681 is displayed as shown in FIG. In addition, when Streaming632 is selected and determined on the menu screen 621 while the WLAN ad hoc mode is OFF, a dialog containing a message prompting the user to turn the WLAN ad hoc mode ON is displayed. May be good. When the WLAN ad hoc mode is turned on after the Streaming 632 is selected and determined on the menu screen 621, the ad hoc user list display screen 681 is displayed in the same manner as shown in FIG.

On the ad hoc user list display screen 681, basically, as in the case described with reference to FIG. 25, users of other information communication terminals 1 registered as communication partners in the ad hoc mode and ad hoc communication are possible. Information about users of other unregistered information communication terminals 1 that exist in the above range is displayed in a list.

For example, when "User B" in the Online state is selected and determined on the ad hoc user list display screen shown in FIG. 30, the streaming connection with the information communication terminal 1 used by the "User B" in the Online state is confirmed. , Public playlists (lists of at least some of the songs held internally, details of which will be described later) are exchanged with each other. Then, based on the user B public playlist received from the information communication terminal 1 used by the user B and the Now Playing information among the broadcast information, the user B as shown in FIG. 31 is used. The public playlist list display screen 701, which is a list of the song currently being played and the public playlist, is displayed. At this time, if a playlist including the music currently being played (that is, Now Playing) on the information communication terminal 1 used by the user B is published, the public playlist list display screen 701 displays the playlist. It is displayed in the selected state.

Then, when the playlist desired by the user is selected and determined from the public playlist list display screen 701 of the user B in FIG. 31, the music included in the selected playlist is shown in FIG. 32. The data, in other words, the track display screen 711 that displays a list of music tracks is displayed. The user can receive and play the music data selected and determined by the user B by selecting and determining the desired music track displayed on the track display screen 711.

Specifically, the music stream application executed in the application processor 131 of the information communication terminal 1-1 receives a signal indicating the user's operation input from the input module 150, and the playlist and music data selected and determined by the user. The information for designating the above is controlled by the wireless communication module 148 and supplied to the information communication terminal 1-2 owned by the user B.

At this time, the connection permission request from the user A may or may not be displayed on the display unit 21 of the information communication terminal 1-2 owned by the user B.

The music stream application executed in the application processor 131 of the information communication terminal 1-2 transmits the playlist and music data selected and determined by the user supplied from the information communication terminal 1-1 via the wireless communication module 148. Provides information to specify to the audio processor 132. The audio processor 132 reads the music data (stream data) managed by the music DB from the large-capacity flash memory 154, supplies it to the application processor 131, controls the wireless communication module 148, and controls the information communication terminal 1-. Send to 1.

Then, in the music stream application executed in the application processor 131 of the information communication terminal 1-1, the music data (stream data) supplied from the information communication terminal 1-2 via the wireless communication module 148 is copyright protected. If this is the case, descrambling is performed using the functions and data held by DRM Lib., And the audio signal processing module 152 is supplied to the audio signal processing module 152, and the audio signal processing module 152 is used by using the audio cordic function. It is controlled to perform decoding processing and DA conversion processing, and is reproduced and output from the ringer speaker 42, or is reproduced and output from a headphone or the like attached to the connector jack 52.

At this time, the music data reproduction display screen 671 described with reference to FIG. 29 is displayed on the display unit 21 of the information communication terminal 1-1 during stream reproduction. On the music data playback display screen 671, in addition to information related to the content such as the title name of the music data, the artist name, the album name, or the thumbnail image of the jacket of the album, the source of the streaming data ( Here, information about the user B) may be displayed.

When Now Playing 633 is selected on the menu screen 621 described with reference to FIG. 27, the application processor 131 activates the audio player described with reference to FIG. 12, and if necessary, the audio processor 132. Is controlled to reproduce and output the music data desired by the user. That is, the audio processor 132 starts the reproduction processing of the selected and determined music data by using the function of the audio player described with reference to FIG.

The audio processor 132 uses the music DB function described with reference to FIG. 13 to obtain a list of music data recorded in the large-capacity flash memory 154 or a file structure (even if it is an actual file structure, it is virtual. Generates information indicating (which may be a typical file structure) and supplies it to the application processor 131. The application processor 131 uses the graphics library to display a list of music data recorded in the large-capacity flash memory 154 or information indicating a file structure on the display unit 21. The user refers to the data displayed on the display unit 21 and performs an operation input for selecting and determining desired music data.

The audio processor 132 reads the selected music data among the music data managed by the music DB from the large-capacity flash memory 154, and when the selected music data is copyright protected, the DRM While descrambling is performed using the functions and data held by Lib., It is supplied to the audio signal processing module 152, and the audio signal processing module 152 is controlled by using the audio cordic function to perform decoding processing. And DA conversion processing is performed, and playback output is performed from the ringer speaker 42, or playback output is performed from headphones or the like attached to the connector jack 52.

Further, at the time of reproducing the music data, the music data reproduction display screen 671 similar to the case described with reference to FIG. 29 is displayed.

When All Tracks 634 is selected on the menu screen 621 described with reference to FIG. 27, a list of all tracks recorded in the large-capacity flash memory 154 is displayed on the display unit 21.

The content such as music data recorded in the large-capacity flash memory 154 may be acquired directly from the service provider that distributes the music data, or may be acquired via a predetermined recording medium. , It may be obtained from another information communication terminal 1 or a personal computer 13. In other words, content such as music data recorded in the large-capacity flash memory 154 may be acquired using wireless communication in the ad hoc mode or infrastructure mode of WLAN, or wired communication (MSC) by USB connection. And MTP).

In the information communication terminal 1, it is possible to classify and record contents such as music data recorded in the large-capacity flash memory 154 according to the data acquisition method, the type of codec, or the copyright protection method. It is done like this. For example, if the coded format of the content such as music data differs or the copyright protection method differs depending on the service provider (organization or company) that distributes the music data, the music data etc. The classification of the contents of is synonymous with the classification based on the distribution source of the music data.

Here, as an example of the classification method, contents such as music data will be described as being classified and recorded at least in three types of "ATRAC AD", "Music Folder", and "Inbox". In such a case, when All Tracks 634 is selected on the menu screen 621 described with reference to FIG. 27, all the folders in the three types of folders "ATRAC AD", "Music Folder", and "Inbox" are selected. A list of tracks is displayed on the display unit 21.

Here, the music data stored in "ATRAC AD" and "Music Folder" is music data acquired by wireless communication (infrastructure mode or ad hoc mode), and is music stored in "ATRAC AD". The data is music data decoded in the ATRAC format, and the music data stored in the "Music Folder" is music data decoded in a format other than the ATRAC format. Further, it is assumed that the music data saved in the "Inbox" is the music data acquired by the wired communication by the USB connection.

Conventionally, the copyright management method and cordic method for acquiring (in many cases, downloading) and playing music data often differ depending on the service provider that distributes the music data, and the service provider that distributes the music data. In many cases, an application program for acquiring and playing music data is provided. In such a case, the communication methods permitted as the method of exchanging music data are also different. Information communication terminal 1 supports WLAN ad hoc mode and infrastructure mode, and also supports both MSC and MTP methods of USB connection, so the corresponding application program (or software cordic or DRM) By installing the protocol), it is possible to acquire, store, and play music data (contents) distributed by many service providers.

Then, when ATRAC AD635 is selected on the menu screen 621 described with reference to FIG. 27, a list of tracks recorded in the above-mentioned "ATRAC AD" folder is displayed on the display unit 21, and FIG. 27 is used. When Music Folder 636 is selected in the menu screen 621 described above, a list of tracks recorded in the above-mentioned "Music Folder" folder is displayed on the display unit 21, and the menu screen 621 described with reference to FIG. 27 is displayed. When the Inbox 638 is selected, a list of tracks received by File Transfer via USB connection and recorded in the above-mentioned "Inbox" folder is displayed on the display unit 21.

The data file acquired by making a USB connection with the personal computer 13 is stored in the above-mentioned "Inbox" folder. As described above, the music data stored in the "Inbox" is the music data acquired by the wired communication by the USB connection, and the USB connection mode may be either MSC or MTP.

As described above, conventionally, the copyright management method and the cordic method for acquiring (in many cases, downloading) and playing music data are often different depending on the service provider that distributes the music data, and the music data is stored. In many cases, the service provider that distributes the music provides an application program for acquiring and playing the music data. That is, application programs provided by a plurality of service providers are installed in the personal computer 13, and contents such as music data stored in the personal computer 13 are handled only in the predetermined application programs. May be made possible. That is, the operation of copying contents such as music data from the personal computer 13 to the information communication terminal 1 connected via USB may be executed only in a predetermined application program. Even in such a case, since the information communication terminal 1 supports both MSC and MTP as the USB connection mode, the contents such as music data provided by various service providers can be personalized. It can be acquired from the computer 13 and stored and played back.

To switch the USB connection mode between MSC and MTP, for example, it is described using FIG. 13, which is activated by selecting various settings (Tools) 468 on the Home screen 451 described with reference to FIG. The setting tool of the application processor 131 includes a function to control the audio processor 132 based on the user's operation input and switch the USB connection mode between MSC and MTP, and the MSC and MTP of the audio processor 132. And (Fig. 13), the function used by the file exchange application etc. should be switched.

Then, when My Playlist 637 is selected on the menu screen 621 described with reference to FIG. 27, a list of contents such as music data created based on the user's operation input is displayed. Specifically, My Playlist classifies and generates content such as music data that is classified into three types, "ATRAC AD", "Music Folder", and "Inbox", according to the classification determined by the user. It is a list corresponding to the virtual file system. For example, the user can combine contents such as "favorite" songs into one list, classify them by genre such as "chamber music", "orchestra music", "instrumental music", and "voice music", or "musicians". Classified by artist or performer, such as "A", "Musician B", "Orchestra A", "Orchestra B", "Conductor A", "Conductor B", etc., "Composer A", "Composer B", etc. You can manage a lot of content by classifying by composer.

Needless to say, My Playlist may have a hierarchical structure having a plurality of layers. For example, as a major classification, it is classified by composer such as "Composer A" and "Composer B", and as a middle classification, it is classified as "Indoor music", "Orchestra", "Instrumental music", "Voice music", etc. , It is possible to classify by genre, classify by music name as a sub-classification, and to put together the same music played by a plurality of different performers or orchestras in the sub-classification. By classifying in this way, the user wants to listen to the music played by "Orchestra B" of "Symphony No. X" among the "symphonic music" of "Composer A". You can easily find the data.

In addition, a plurality of My Playlists may be prepared. At this time, it goes without saying that the same song may be registered in a plurality of My Playlists, and since My Playlist is a virtual file system, when the same song is registered in a plurality of My Playlists. However, only one data file needs to be recorded in the large-capacity flash memory 154.

Furthermore, it is possible to set whether or not My Playlist may be published at the time of broadcasting in ad hoc mode for each My Playlist. Further, only a part of My Playlist may be set to be published when My Playlist is broadcast in ad hoc mode.

In addition, My Playlist can be freely created, deleted, and updated based on the user's operation input. For example, when the user presses the option button 25 while the information related to My Playlist is displayed, it is preferable to display a dialog box for selecting the process of creating, deleting, or updating My Playlist. Is.

Next, an application that performs processing using communication processing in the WLAN infrastructure mode will be described. Applications that perform processing using communication processing in WLAN infrastructure mode include communication applications including functions such as IP phones, instant messengers, web browsers, etc., and application programs such as e-mail applications are installed. It may have been done.

On the Home screen 451 described with reference to FIG. 14, the communication application (Communication) 462 is selected and determined from the menu display of the application program (or item composed of a plurality of application programs) list, and the communication application is executed. An example of case processing will be described.

For example, communication tools that use a wide area network such as the Internet, such as IP phones and chats, are provided by a plurality of service providers (service providers). The information communication terminal 1 is adapted to be able to use communication tools provided by those plurality of service providers (service providers) as communication applications.

FIG. 33 shows a communication application top screen 751 displayed when the communication application (Communication) 462 is selected and determined on the Home screen 451 described with reference to FIG. The communication application top screen 751 displays a list of communication tool names provided by a plurality of service providers (service providers).

In addition, the user can set the so-called auto-login function to ON or OFF in advance for each communication tool to be used. This setting is also activated by selecting various settings (Tools) 468 on the Home screen 451 described with reference to FIG. 14, and the user operates the setting tool of the application processor 131 described with reference to FIG. Based on the input, a function to switch the auto login function to ON or OFF may be included, and the process executed by the communication application may be switched.

Furthermore, it is preferable to enable initial settings so that the communication application is automatically started when the WLAN is turned on and the infrastructure mode is set.

On the communication application top screen shown in FIG. 33, when the tool name of the communication tool in which the auto login function is set to OFF is selected and determined, the login screen 771 shown in FIG. 34 is displayed. Information required for login, such as a user ID and password, can be entered on the login screen 771.

In this state, if the WLAN infrastructure mode is not ON, a message prompting the user to turn the WLAN infrastructure mode ON is displayed, and the WLAN infrastructure mode is ON. After that, the process may proceed to the following.

When the tool name of the communication tool for which the auto login function is set to ON is selected and determined on the communication application top screen shown in FIG. 33, or when login is executed on the login screen 771 shown in FIG. 34. The contact list display screen 781 shown in FIG. 35 is displayed.

The contact list display screen 781 includes a content tab display area 791 and a list or the like display area 792 in addition to the constant display panel 101.

In the content tab display area 791, a plurality of tabs are displayed so that the user can select the information displayed in the display area 792 such as a list and command various operations. The user can use the left and right keys of the four-way key 26 to select a desired tab from a plurality of tabs and press the enter button 27 to determine the desired one.

Here, the plurality of tabs are virtually arranged, and the user moves the entire array using the left and right keys of the 4-way key 26, and the tab displayed in the central selection tab display area 793 is selected. It is a tab of the state. On the left and right of the selection tab display area 793, tabs that are selected when the user moves the entire array using the left and right keys of the four-way key 26 are displayed. Note that the ends of the virtual array may be set to be continuous or non-continuous, and if they are not continuous, at the end of the virtual array. When the user moves the entire array using the left and right keys of the 4-direction key 26, the tab that is selected is only in one of the left and right directions.

In the tab displayed in the content tab display area 791, for example, a Contact List tab for displaying a list of registered users who can communicate, a list of registered users who can communicate, or a list of telephone numbers is displayed and selected. Dial tab to let the other party input the operation of the process of making an IP phone, Call tab to set the setting process of the calling screen, text input area to input text for chat, and the chat partner Chat tab to display the display area of the text entered by, Call List tab to display the incoming / outgoing call history, Setting tab to display the setting screen for making various settings, display your own status, etc. There is a Start tab to let you.

For example, a list of registered users who can communicate is displayed in the list display area 792 with the Contact List tab selected. The user can select a desired registered user using the four-way key 26. In the list display area 792, for example, the information of the selected registered user may be displayed in a larger amount as compared with the non-selected registered user. For example, when the user refers to the information of the selected registered user and makes a decision by pressing the enter button 27, a list of tools available in the corresponding communication tool such as IP phone, chat, and e-mail is displayed. It is preferable that the information is selected by the user.

Next, on the Home screen 451 described with reference to FIG. 14, a web browser (WEB Browser) 464 is selected and determined from the menu display of the application program (or item composed of a plurality of application programs) list, and the web browser is selected. An example of processing when is executed will be described.

When the web browser (WEB Browser) 464 is selected and determined on the Home screen 451 described with reference to FIG. 14, the web browser menu screen 801 shown in FIG. 36 is displayed. The web browser menu screen 801 displays a menu for selecting a method for designating a web page to be displayed.

The method of specifying the web page to be displayed includes, for example, displaying the last connected web page (Last URL), displaying a pre-registered page as the first web page to be displayed (Start Page), and favorite. Display a list of registered web pages, select and determine the user's desired page from them (Bookmark), save the page data itself in advance, and save the saved page. There are such things as displaying (Saved Page) and prompting the user to enter the URL of the desired web page (Input URL).

When one of the web page specification methods is selected and determined on the web browser menu screen 801 and the web page to be connected is determined, the connection to that page (the server that publishes the page on a network such as the Internet 12) During that time, the connection screen 811 shown in FIG. 37 is displayed.

Here, if the WLAN infrastructure mode is not ON, as shown in FIG. 38, a message display screen including a message prompting the user to operate the WLAN infrastructure mode ON. After displaying 821 etc. and turning on the WLAN infrastructure mode, you may proceed to the following process.

Then, when the connection is made to the web page of the specified URL in the state where the WLAN infrastructure mode is ON, the web page is displayed on the web page display screen 831 as shown in FIG. 39.

In addition, the connection screen 811 of FIG. 37, the message display screen 821 of FIG. 38, and the constant display panel 101 of the web page display screen 831 of FIG. Information may be displayed.

Next, the processing when the standby screen (Stand by Screen) 461 is selected and determined from the menu display of the application program (or item composed of a plurality of application programs) list of the Home screen 451 described with reference to FIG. An example will be described.

When the standby screen (Stand by Screen) 461 is selected and determined in the Home screen 451 described with reference to FIG. 14, the standby screen 851 shown in FIG. 40 is displayed.

The standby screen 851 includes a date / time display area 861, a music data information display area 862 being played, an image display area 863, and a contact icon display area 864.

In the date / time display area 861, the current date and time are displayed.

If there is music data currently being output in the music data information display area 862 during playback, information about the music data is displayed.

Image data can be displayed in the image display area 863, and if there is an image set by the user (so-called wallpaper) or music data currently being played back, the music data will be displayed. An image of an album jacket, which is associated and stored, is displayed.

In the contact icon display area 864, the communication status of the communication target in the current communication mode (whether or not communication is possible, whether or not it is registered as a communication partner, etc.) is displayed.

On the standby screen 851, the communication enable / disable status of the communication target in each communication mode is displayed. That is, when the information communication terminal 1 is made capable of communicating with another device by wire or wirelessly, but is made able to communicate with another information communication terminal 1 by wirelessly. , It is possible to communicate with a plurality of other information communication terminals 1. Therefore, when the WLAN is ON, the information communication terminal 1 is adapted to display the communication target communication availability status on the standby screen 851 depending on whether it is in the ad hoc mode or the infrastructure mode.

In the WLAN ad hoc mode, the contact icon display area 864 may display, for example, an icon indicating a registered user (Online) existing in the currently communicable range. Further, in the WLAN ad hoc mode, icons indicating registered users (Online) and users who have not yet been registered (Unknown) existing in the currently communicable range are displayed separately in the contact icon display area 864. You may do so. Further, in the WLAN ad hoc mode, in the contact icon display area 864, basically the same as in the case described with reference to FIG. 25, whether the registered user's icon is in the Online state or the Offline state is displayed. In addition to displaying them separately, icons indicating unregistered users (Unknown) existing in the currently communicable range may be displayed separately.

Then, in the WLAN infrastructure mode, the contact icon display area 864 shall display, for example, an icon indicating a user who can communicate with a plurality of application programs that perform communication processing using the WLAN infrastructure mode. Can be done. That is, for example, in the contact icon display area 864, an icon indicating a user who can currently communicate with an instant messenger, an icon indicating a user who can communicate with a communication application, and an icon indicating a user to whom an e-mail destination is registered are displayed. Is displayed.

In such a case, for example, when the communication mode is switched between the WLAN infrastructure mode and the WLAN ad hoc mode while the standby screen is displayed, the icon displayed in the contact icon display area 864 of the standby screen 851 is displayed. , It is automatically changed according to the change of communication mode.

That is, the application processor 131 executes file exchange, streaming, etc. in the ad hoc mode to the flash memory 146 connected to the application processor 131, or the flash memory 156 or the large-capacity flash memory 154 connected to the audio processor 132. Information held by the user registered as a communication partner that can be used Information on the communication terminal 1 and information held by the user registered as a communication partner in the communication application or instant messenger in the infrastructure mode. The contact of the standby screen 851 corresponding to the communication mode based on the information of the communication terminal 1 or the information received by the wireless communication module 148 of the information communication terminal 1 and broadcast in the ad hoc mode described with reference to FIG. The display image data of the icon display area 864 is generated, and the display module 142 is controlled and displayed.

The icon indicating the registered user displayed in the contact icon display area 864 is the image data included in the user information given and received when mutual registration is performed as a communication partner, which is described with reference to FIG. Is created based on. In addition, the icon indicating an unregistered user (Unknown) existing in the currently communicable range is the image data when the image data corresponding to the icon is received together with the information explained with reference to FIG. 24. It may be an icon including character information indicating a part of the information described with reference to FIG. 24, or it may be an icon described as "Unknown", for example. Good.

Further, it is preferable that the icons indicating the registered users displayed in the contact icon display area 864 are arranged according to a predetermined rule. Details on the rules for arranging icons will be described later.

By doing so, the user of the information communication terminal 1 can determine which user to contact in a more natural way when making contact with another user by communication.

That is, in general, in communication without using a communication device, there is a case of trying to make contact with a person who can easily make contact, for example, a person nearby. That is, on the standby screen, whether the other party can communicate (the other party is Online, Offline, or the other party who has never communicated but is in a communicable state (Unknown)). ) Is shown, the user of the information communication terminal 1 can determine which user to contact in a more natural way.

Further, in the ad hoc mode, when any of the icons displayed in the contact icon display area 864 is selected, it will be described with reference to FIG. 24 broadcast from another information communication terminal 1 existing in the currently communicable range. The image data published by the selected user is displayed in the image display area 863 based on the information and the user information given and received when mutual registration is performed as a communication partner described with reference to FIG. 26. The information on the music currently being played by the selected user, the text memo broadcast by the selected user, and the like may be displayed in the music data information display area 862 being played.

Further, in the ad hoc mode, the information communication terminal 1 is set to Now of the information broadcast from the other corresponding information communication terminal 1. Based on the Playing information, it is possible to determine whether or not the music data is being played. Therefore, in the ad hoc mode, the application processor 131 activates a part of the music streaming function in the background while the standby screen 851 is displayed, and one of the icons displayed in the contact icon display area 864 is displayed. Among them, when the icon corresponding to the other information communication terminal 1 owned by the registered user currently in the communicable range is selected and the user corresponding to the selected icon is playing the music data. The other information and communication terminal 1 corresponding to the selected icon may be requested to stream the music data being played, and the music data being played may be received and played. At this time, in order to change the icon selection, the other information communication terminal 1 corresponding to all the icons that pass through while moving the cursor position is requested to stream the music data being played. For example, when one of the icons is selected for a predetermined time (for example, about 3 seconds) or more, the other information communication corresponding to the selected icon is performed so as not to cause the error. The terminal 1 may be requested to play the streaming music data being played.

Then, in the infrastructure mode, when any of the icons displayed in the contact icon display area 864 is selected, the user information given and received when mutual registration is performed as a communication partner as described with reference to FIG. 26. The image data published by the selected user is displayed in the image display area 863, and the text memo registered by the selected user is displayed in the music data information display area 862 being played. You may do so.

In addition, if any of the icons displayed in the contact icon display area 864 is selected, regardless of whether it is in ad hoc mode or infrastructure mode, the selected icon will be magnified (eg, magnified). It may be displayed (enlarged to a rate of about 150%).

Further, by selecting and determining the icon displayed in the contact icon display area 864, for example, the user information exchanged when mutual registration is performed as the communication partner described with reference to FIG. 26, or FIG. 24 can be obtained. User information generated based on the broadcast information described in use may be displayed.

Alternatively, by selecting and determining the icon displayed in the contact icon display area 864, information is exchanged with another information communication terminal 1 owned by the user corresponding to the selected and determined icon, or a device such as a personal computer 13. You may want to see a list of applications available for you.

By doing so, when contacting other users using communication, the user of the information communication terminal 1 can determine the application to be used for contacting other users in a more natural way. it can.

That is, in communication including the case where a communication device is not used, in general, in order to contact a certain person, the method of contacting is considered. That is, by showing a list of applications that can be used to exchange information with the selected party on the standby screen, the user of the information communication terminal 1 can use the desired user in a more natural way. You can decide whether to contact.

Controlling the display of the standby screen 851 described above and the list of applications that are displayed following the standby screen 851 and that can be used to contact the user corresponding to the selected icon (to send and receive information). It is the application processor 131 that performs a lot of processing, basically the menu display tool shown in FIG.

FIG. 41 shows an application that can be used when information is exchanged between the standby screen 851 described above and the device owned by the user corresponding to the selected and determined icon displayed following the standby screen 851. It is a functional block diagram which shows the function which the menu display tool of the application processor 131 uses when controlling the display of a list. The menu display tool of the application processor 131 also has a function not shown in FIG. 41, and when controlling the display of other display screens, a function not shown in FIG. 41 is used, but the description thereof is omitted here. ..

The operation input acquisition unit 871 acquires a signal corresponding to the user's operation input supplied from the input module 150 (acquired from the device driver via the OS).

The communication status detection unit 872 is the wireless communication status of the information communication terminal 1 controlled by the application program that controls the operation of the WLAN, that is, whether the WLAN is ON or OFF, and the WLAN is ON. If so, detect whether it is in ad hoc mode or infrastructure mode.

The display setting storage control unit 873 acquires the display settings on the standby screen 851 based on the signal corresponding to the user's operation input acquired by the operation input acquisition unit 871 and stores the display setting information in the flash memory 146. , Controls the reading of display setting information stored in the flash memory 146 (by controlling the device driver via the OS).

The registered user information acquisition unit 874 is stored in the large-capacity flash memory 154 via the audio processor 132, for example, a registered user registered so that music streaming or file transfer can be performed in the ad hoc mode. Or, in infrastructure mode, control the acquisition of information about registered users who can communicate with multiple application programs that perform communication processing using WLAN infrastructure mode (by controlling the device driver via the OS). To do.

The broadcast information acquisition unit 875 controls the acquisition of information broadcast in the ad hoc mode described with reference to FIG. 24 received by the wireless communication module 148 (by controlling the device driver via the OS).

In the infrastructure mode, the Online / Offline discriminator 876 uses at least a part of the functions of the communication application or the application program that communicates using the infrastructure mode, such as instant messenger, to perform each service, for example. Access the provided server 12 and determine whether the user registered as a communicable user is online or offline. Further, the Online / Offline determination unit 876 sets the communication mode to the ad hoc mode and the infrastructure, if necessary, in order to determine whether the user registered as a communicable user is online or offline. It controls the device driver that controls the operation of the wireless communication module 148 so that it can be switched between modes.

The icon arrangement determination unit 877 is the wireless communication status of the information communication terminal 1 detected by the communication status detection unit 872, the display setting information whose reading from the flash memory 146 is controlled by the display setting storage control unit 873, and the registered user. An application program that communicates using information about registered users acquired by the information acquisition unit 874, information broadcast in the ad hoc mode acquired by the broadcast information acquisition unit 875, and infrastructure mode by the Online / Offline determination unit 876. The arrangement of icons displayed in the contact icon display area 864 is determined based on the determination result of whether the user registered as a communicable user is online or offline.

A specific example of the arrangement of the icons displayed in the contact icon display area 864 will be described later with reference to FIGS. 44 to 51.

The available application extraction unit 878 includes signals corresponding to the user's operation input acquired by the operation input acquisition unit 871, information about the registered user acquired by the registered user information acquisition unit 874, and an ad hoc acquired by the broadcast information acquisition unit 875. Information broadcast in the mode and the result of determining whether the user registered as a communicable user in the application program that communicates using the infrastructure mode by the Online / Offline discriminator 876 is online or offline. Based on, the applications that can be used when exchanging information with the device owned by the user corresponding to the selected icon are extracted.

Specific examples of the display screen including a list of applications that can be used when exchanging information with the device owned by the user corresponding to the selected icon will be described later with reference to FIGS. 42 and 43.

The various display information acquisition units 879 acquire information necessary for generating image data of the screen to be displayed from each unit such as the flash memory 146, the memory 147, or the audio processor 132 (via the OS, the device). Control (by controlling the driver).

The display image generation unit 880 is owned by the user corresponding to the array of icons displayed in the contact icon display area 864 determined by the icon arrangement determination unit 877 and the selected icon extracted by the available application extraction unit 878. Based on the information required to generate the image data of the displayed screen acquired by the application that can be used when exchanging information with the device to be displayed and the various display information acquisition units 879, if necessary, The graphics library is used to generate display image data to be displayed on the display unit 21, control the display module 142 (control the device driver via the OS), and display the display on the display unit 21.

Next, an example of a display screen display method including a list of applications that can be used when exchanging information with a device owned by a user corresponding to the selected icon, which is extracted by the available application extraction unit 878. Will be described with reference to FIGS. 42 and 43.

Specifically, for example, in a state where the communication state detection unit 872 has detected that the WLAN infrastructure mode is set, the operation input acquisition unit 871 displays the contact icon in the contact icon display area 864 described with reference to FIG. When an operation input indicating that one of the icons is selected is acquired from the icon, the registered user information acquisition unit 874 is stored in the large-capacity flash memory 154 via the audio processor 132, and the other icon is stored in the large-capacity flash memory 154. From the user registration information, the user registration information corresponding to the selected icon is extracted and supplied to the available application extraction unit 878.

Since the available application extraction unit 878 has been detected by the communication status detection unit 872 to be in the WLAN infrastructure mode, the corresponding user and the infrastructure mode are based on the registration information of the user corresponding to the selected icon. The applications that can be used for communication in the above are extracted and supplied to the display image generation unit 880. The display image generation unit 880 shows a list of applications that can be used to exchange information with other information communication terminals 1 owned by the corresponding user, a device such as a personal computer 13, based on the supplied information. Display screen data is generated, and the display module 142 is controlled to be displayed on the display unit 21.

Specifically, for example, user A corresponding to the selected icon can communicate as an application that uses communication in the infrastructure mode, in an instant messenger, or in a communication application such as chat or IP phone. If registered and the e-mail address has been registered, the available application list screen 891 as shown in FIG. 42 is displayed. Further, for example, the user B corresponding to the selected icon is not registered as a communicable user in the instant messenger or the communication application such as chat or IP phone, and only the e-mail address is registered. In this case, only e-mail is displayed as an available application on the available application list screen 891 so that it can be selected.

Then, when the application desired by the user is selected and determined from the available applications shown on the available application list screen 891, the application processor 131 indicates a signal indicating the user's operation input supplied from the input module 150. Based on this, the application specified by the user is started, and if necessary, access to the server 12 that provides each service is started.

Further, in the infrastructure mode, the Online / Offline discriminator 876 operates at least a part of the functions of the application that uses the communication in the infrastructure mode, and accesses, for example, the server 12 that provides each service. However, by constantly monitoring whether the user registered as a communicable user is online or offline, an application that can be used to exchange information with the user corresponding to the selected icon can be used. It can be extracted more accurately.

Specifically, for example, user A corresponding to the selected icon can communicate as an application that uses communication in the infrastructure mode, in an instant messenger, or in a communication application such as chat or IP phone. If registered, both are online, and the e-mail address is registered, the available application list screen 891 as shown in FIG. 42 is displayed. Further, for example, the user B corresponding to the selected icon is not registered as a communicable user in the instant messenger or in the communication application such as chat or IP phone, or is registered. When the user is offline and only the e-mail address is registered, only the e-mail is displayed as the available application on the available application list screen 891 and can be selected.

Further, for example, user C corresponding to the selected icon is registered as a communicable user in both instant messenger and communication applications such as chat and IP phone as an application that uses communication in the infrastructure mode. However, if the instant messenger is offline and the communication application such as chat or IP phone is online, the available application list screen 891 shows the communication application (chat, IP phone, etc.) as the available application. Is displayed and can be selected. Therefore, when the user having the information communication terminal 1 wants to communicate with the user C, he / she selects the IP phone of the communication application in which the user C is online and makes an IP phone. You can make a call. By doing so, the user can easily select the most suitable communication method from the plurality of communication methods when making contact with a desired partner.

Further, for example, in a state where the communication state detection unit 872 has detected that the WLAN ad hoc mode is set, the operation input acquisition unit 871 will use the icon displayed in the contact icon display area 864 described with reference to FIG. 40. When the operation input indicating that the icon is selected is acquired, the registered user information acquisition unit 874 uses the audio processor 132 to store the registration information of another user stored in the large-capacity flash memory 154. Extracts the registration information of the user corresponding to the selected icon from, and supplies it to the available application extraction unit 878.

Since the available application extraction unit 878 has been detected by the communication status detection unit 872 to be in the WLAN ad hoc mode, it communicates with the corresponding user in the ad hoc mode based on the registration information of the user corresponding to the selected icon. Extracts the applications that can be used in and supplies them to the display image generation unit 880. Based on the supplied information, the display image generation unit 880 generates and displays display screen data showing a list of applications that can be used to exchange information with another information communication terminal 1 owned by the corresponding user. The module 142 is controlled to be displayed on the display unit 21.

Specifically, for example, when the user A corresponding to the selected icon is a registered user who is already capable of music streaming and file transfer in the ad hoc mode, the available application list screen 892 as shown in FIG. 43. Is displayed. Further, for example, when the user B corresponding to the selected icon is not a registered user, only Send Message is displayed as an available application on the available application list screen 892 so that the user can be selected. ..

Further, it is preferable that the icons indicating the registered users displayed in the contact icon display area 864 are arranged according to a predetermined rule.

Further, as described above, in both the infrastructure mode and the ad hoc mode, the arrangement of the icons when displaying the icons corresponding to the registered users is the device (instant messenger, IP phone, chat service, electronic) owned by each registered user. As long as it has a function to use mail, for example, it may be any device such as another information communication terminal 1, a personal computer, a PDA, or a portable telephone). It is made to be. Next, a specific example of the arrangement of the icons displayed in the contact icon display area 864 will be described with reference to FIGS. 44 to 51.

First, with reference to FIGS. 44 to 46, an example of the priority of the icon arrangement and the method of determining the priority will be described.

A case of prioritizing an array of icons will be described with reference to FIG. 44.

Like the number shown in the contact icon display area 864 of FIG. 44, for example, the icon corresponding to the registered user is displayed so that the position closer to the upper right corner in order from the upper right corner has a higher priority. It is possible to prioritize the arrangement of icons at the time, and determine the priority of icon arrangement based on the connection status of the devices owned by each registered user.

For example, in the ad hoc mode, the case where the registered user exists in the communication range (on-line) is regarded as the highest priority, and the registered user is within the communication range. The non-existing state (off-line) is regarded as the next highest priority, and the unregistered user exists in the communication range (unregistered on-line). , Can be the lowest priority. Further, in the infrastructure mode, since a plurality of applications can be used for communication, it is determined based on the registered users of each application or whether or not the registered users in each application are online, and those are determined. Priority can be determined based on the results. The priority may be freely set by the user of the information communication terminal 1.

Further, as described with reference to FIG. 44, the order of arrangement when displaying the icons corresponding to the users according to the determined priority is not the order from the one with the shortest distance from the upper right corner. For example, the upper part may have a higher priority, or the central part may have a higher priority. Further, as described with reference to FIG. 44, the priority may be set for each position where each icon can be arranged, or may be set for each area where a plurality of icons can be arranged. That is, from the high-level area to the low-level area, for example, the first level area, the second level area, and the xth level area are distinguished from each other, and each icon is displayed. An icon may be arranged in each area based on the connection state of the device owned by the corresponding registered user. Further, the user of the information communication terminal 1 may freely set the order of arrangement in each area.

An example of icon arrangement will be described with reference to FIG. 45 when an area in which a plurality of icons can be arranged is set.

In FIG. 45, the contact icon display area 864 is divided into three areas, a first area, a second area, and a third area, and each area is determined assuming that the central part has a higher priority. Has been done. Then, in both the ad hoc mode and the infrastructure mode, the priority of icon arrangement is determined based on the connection status of the devices owned by each registered user, and the icons corresponding to the registered users are arranged and displayed. It is preferable that the three regions of the first region, the second region, and the third region can be distinguished by using, for example, the background color or the color of the edge portion of each icon.

For example, in the ad hoc mode, the icon corresponding to the state (on-line) in which the registered user exists in the communication range is placed in the first area having the highest priority, and the registered user is registered. The icon corresponding to the state where is not in the communication range (off-line) is placed in the second area with the next highest priority, and the unregistered user is in the communication range (the state where is not in the communication range (off-line). The icon corresponding to (unregistered on-line) can be placed in the third area having the lowest priority. By doing so, the user of the information communication terminal 1 can determine the communication state with each user only by referring to the arrangement of the icons.

Further, when displaying the icon corresponding to the user according to the predetermined priority, for example, the size of the displayed icon may be set based on the priority.

A case where the size of the displayed icon is set based on the priority will be described with reference to FIG. 46.

In FIG. 46, the contact icon display area 864 is divided into three areas, a first area, a second area, and a third area, and each area is determined assuming that the central part has a higher priority. The size of the icon is set and displayed so that the first area is the largest, the second area is the second largest, and the third area is the smallest. By doing so, the user of the information communication terminal 1 can more intuitively determine the communication state with each user.

Next, a specific example of determining the arrangement of the icons according to the communication mode will be described with reference to FIGS. 47 to 51.

First, a first example of icon placement in ad hoc mode will be described with reference to FIG. 47.

In FIG. 47, the contact icon display area 864 is divided into three areas, the first area, the second area, and the third area, so that the position closer to the upper right corner in order from the upper right corner has a higher priority. The first area, which is located closest to the upper right corner, has the highest priority, then the second area has the second highest priority, and the third area has the lowest priority. The area has been determined. Then, in the ad hoc mode, the icon corresponding to the state (on-line) in which the registered user exists within the communication range is arranged in the first area having the highest priority, and the registered user The icon corresponding to the state that does not exist in the communication range (off-line) is placed in the second area with the next highest priority, and the unregistered user exists in the communication range (not yet). The icon corresponding to the registration on-line) can be placed in the third area having the lowest priority.

By doing so, the user of the information communication terminal 1 can determine the communication status with each registered user only by referring to the arrangement of the icons.

Next, a second example of icon placement in ad hoc mode will be described with reference to FIG. 48.

As shown in FIG. 48, a fourth area is further set in the contact icon display area 864, and the priority is set so that the position closer to the upper right corner in order from the upper right corner has a higher priority. Then, in the ad hoc mode, the icon corresponding to the state (on-line) in which the registered user exists within the communication range is placed in the first area having the highest priority, and the registered user is registered. The icon corresponding to the state where is not in the communication range (off-line) is placed in the second area with the next highest priority, and the unregistered user is in the communication range (the state where is not in the communication range (off-line). Place the icon corresponding to (unregistered on-line) in the third area, which is the next priority, and in any of the applications that communicate using infrastructure mode, although not a registered user in ad hoc mode. The registered registered user may be displayed in the fourth area having the lowest priority.

By doing so, the user of the information communication terminal 1 wants to transfer a file to a device owned by a friend, for example, but forgets whether the file is registered in the ad hoc mode or the infrastructure mode. In such a case, the corresponding friend can recognize that he / she is a registered user registered in the infrastructure mode, and communicates to transfer the file to the device owned by the corresponding friend. It is possible to switch the mode.

Further, although not shown, in the infrastructure mode as well, the icon corresponding to the registered user registered in the infrastructure mode is displayed in the high priority area of the contact icon display area 864, and is registered in the ad hoc mode. By displaying the icon corresponding to the registered user in the area having a lower priority than the registered user registered in the infrastructure mode, the same effect as that described with reference to FIG. 48 can be obtained. It goes without saying that you can do it.

Further, here, in the area where the icons are arranged, the areas having the highest priority are described as being in order from the one having the shortest distance from the upper right corner, but for example, FIG. 45 or FIG. 46 has been described. As described above, the high-priority areas may be defined in different arrangements, or the icons of the high-priority areas may be displayed larger.

Next, with reference to FIG. 49, a first example of icon placement in infrastructure mode will be described.

The information communication terminal 1 is configured to be able to execute a plurality of applications that communicate using the infrastructure mode. Therefore, for example, as described above, the icons corresponding to the registered users registered in each application may be displayed separately in the contact icon display area 864.

Also, if some of the functions of multiple applications that communicate using infrastructure mode are activated and each user is monitored to see if they are online, the registered user will be notified. It is preferable not only to distinguish the corresponding icons for each application but also to distinguish them based on whether or not they are online to determine the arrangement of the icons.

Here, since the user of the information communication terminal 1 generally considers how to contact a friend in order to contact the friend, the user of the information communication terminal 1 may want to contact the user. Whether or not you are online is more important than the type of application.

Therefore, in the first example of icon placement in infrastructure mode, as shown in FIG. 49, the contact icon display area 864 is divided into four areas, first to fourth areas, in order from the upper right corner. Set the priority so that the position closer to the upper right corner has a higher priority, and in the first area, the icon corresponding to the user who is a registered user of the communication application and is currently online. Is placed, an icon corresponding to a user who is a registered user of instant messenger and is currently online is placed in the second area, and an icon corresponding to a user who is a registered user of a communication application and is currently online is placed in the third area. , An icon corresponding to the user who is in the offline state is arranged, and an icon corresponding to the user who is a registered user of the instant messenger and is currently in the offline state is arranged in the fourth area.

By doing so, a plurality of applications can be used in one communication mode, and even when there are a plurality of communication states of the registered user who is the communication partner, the user of the information communication terminal 1 can display the icon. It is possible to determine the communication status with each registered user simply by referring to the arrangement.

Here, the information and communication terminal 1 has been described as being able to execute two applications that communicate using the infrastructure mode, but the information and communication terminal 1 has three or more in the infrastructure mode. Even when applications are executed and communicated, in the same way, prioritization and icon arrangement are determined based on whether or not each application is online. Needless to say, it's good.

Further, here, in the area where the icons are arranged, the areas having the highest priority are described as being in order from the one having the shortest distance from the upper right corner, but for example, FIG. 45 or FIG. 46 has been described. As described above, the high-priority areas may be defined in different arrangements, or the icons of the high-priority areas may be displayed larger.

Next, with reference to FIG. 50, a second example of icon placement in infrastructure mode will be described.

As described above, the information communication terminal 1 is configured to be able to execute a plurality of applications that communicate using the infrastructure mode, and the user of the information communication terminal 1 generally talks to a friend. For the user of the information communication terminal 1, it is considered that whether or not the user is online is more important than the type of application because the method of contacting is considered in order to contact the user.

Therefore, it is preferable to determine the arrangement so that the icons corresponding to the registered users who can communicate with as many applications as possible (in the online state) are displayed at high priority positions.

For example, if two applications, a communication application and an instant messenger, that communicate using infrastructure mode are enabled to run, the contact icon display area 864, as shown in the second example in Figure 50. , Divide into four areas, the first area to the fourth area, and set the priority so that the position closer to the upper right corner in order from the upper right corner has higher priority, and the first area , Communication applications and instant messengers have icons corresponding to users who are currently online, and in the second area, only communication applications have icons corresponding to users who are currently online. In the third area, only the instant messenger has an icon corresponding to the user who is currently online, and in the fourth area, at least one of the communication application and the instant messenger is a registered user. , Currently, the icon corresponding to the user who cannot communicate (offline or not registered) in either the communication application or instant messenger is arranged.

By doing so, a plurality of applications can be used in one communication mode, and even when there are a plurality of communication states of the registered user who is the communication partner, the user of the information communication terminal 1 can display the icon. By simply referring to the arrangement, it is possible to easily determine the ease of communication with each registered user, in other words, the registered user who has many available applications.

Here, the information and communication terminal 1 has been described as being able to execute two applications that communicate using the infrastructure mode, but the information and communication terminal 1 has three or more in the infrastructure mode. Similarly, if the application is run and communicated, the icon corresponding to the registered user who can communicate (online) with as many applications as possible has a higher priority. Needless to say, the arrangement of the icons may be determined.

Further, here, in the area where the icons are arranged, the areas having the highest priority are described as being in order from the one having the shortest distance from the upper right corner, but for example, FIG. 45 or FIG. 46 has been described. As described above, the high-priority areas may be defined in different arrangements, or the icons of the high-priority areas may be displayed larger.

In the above description, basically, in the state where the standby screen 851 is displayed, the communication mode is either the ad hoc mode or the infrastructure mode, and the icon displayed in the contact icon display area 864 is displayed. The array is now described as being determined by either ad hoc mode or infrastructure mode, depending on the state of communication with the device owned by the registered user in that mode.

On the other hand, for example, in the state where the standby screen 851 is displayed, the communication mode of the WLAN is switched between the ad hoc mode and the infrastructure mode at a predetermined time, and communication with the device owned by the registered user in both communication modes is performed. The state may be detected and the arrangement of icons may be determined based on the state.

With reference to FIG. 51, in the state where the standby screen 851 is displayed, the ad hoc mode and the infrastructure mode are switched at a predetermined time, the communication state with the registered user in both communication modes is detected, and based on this, the communication state with the registered user is detected. An example of icon arrangement in the contact icon display area 864 when the arrangement of icons is determined will be described.

In FIG. 51, the contact icon display area 864 is divided into an α area of a first area, a second area, ... The priority shall be set so that the closer the position is, the higher the priority is. The number of divisions α of the area is appropriately determined by the number of possible communication states in the ad hoc mode and the infrastructure mode.

Here, for example, the case where the communication application is online is placed in the area of high priority, both the communication application and the instant messenger are online, and the user registered in the ad hoc mode is within the communication range. The icon corresponding to the on-line that exists in is placed in the first area with the highest priority, and both the communication application and instant messenger are online, but the registered user is in the communication range. The icon corresponding to the off-line that does not exist in is placed in the second area with the next highest priority, and it is online in the communication application, but offline in the instant messenger, and in ad hoc mode. The icon corresponding to the state (on-line) in which the user registered in the above exists within the communication range shall be arranged in the third area. Then, an icon corresponding to a state (off-line) in which the registered user is not in the communication range because it is online in the communication application but offline in the instant messenger is placed in the fourth area. The icon corresponding to the state (on-line) in which the user registered in the ad hoc mode is in the communication range, which is offline in the communication application but online in the instant messenger, is the fifth icon. Placed in the area. Then, similarly, for example, the icon corresponding to the state in which the communication application and the instant messenger are offline and the corresponding user is not registered in the ad hoc mode has the lowest priority. The placement of the icons is determined by the combination of communication states until they are placed in the α region (not shown).

In addition, the device owned by the communication partner is in a state where at least one of the communication application and the instant messenger is online, and a user registered in the ad hoc mode exists within the communication range (on-). In the case of line), the device owned by the corresponding communication partner can also switch between the ad hoc mode and the infrastructure mode at a predetermined time, and can detect the communication status with the registered user in both communication modes. There is.

The method of determining the combination and priority of each communication state described with reference to FIG. 51 is not limited to the examples, and for example, in the case of a user who frequently uses the instant messenger, the user in the state where the instant messenger is online. The combination and priority of each communication state may be determined so that the priority of the icon corresponding to is higher, or in the case of a user who frequently uses the ad hoc mode rather than the infrastructure mode, the ad hoc mode The combination and priority of each communication state may be determined so that the priority of the icon corresponding to the user registered in and online is high.

The arrangement method and display method of the registered icons displayed in the contact icon display area 864 described above can be changed as appropriate, and the setting contents will be described with reference to FIG. 41. Based on the control of the display setting storage control unit 873, it is stored in one of the memories and read out as needed.

Next, the standby screen display process will be described with reference to the flowcharts of FIGS. 52 to 55.

In step S1, did the display image generation unit 880 and the communication status acquisition unit 872 receive a command to display the standby screen based on the signal indicating the user's operation input acquired and supplied by the operation input acquisition unit 871? Judge whether or not. If it is determined in step S1 that the command for displaying the standby screen has not been received, the process of step S1 is repeated until it is determined that the command for displaying the standby screen has been received.

If it is determined in step S1 that a command to display the standby screen has been received, in step S2, the communication status acquisition unit 872 detects the current communication status, determines whether or not the WLAN is turned on, and determines. The result is supplied to the icon arrangement determination unit 877.

If it is determined in step S2 that the WLAN is not turned on, the icon arrangement determination unit 877, which has been supplied with the determination result, notifies the display image generation unit 880 that the WLAN is OFF. The display image generation unit 880 controls the display module 142 to control the display of the standby screen when the WLAN is OFF. As a result, the standby screen when the WLAN is OFF is displayed on the display unit 21.

In step S4, the communication status acquisition unit 872 detects the current communication status and determines whether or not the WLAN is turned on. If it is determined in step S4 that the WLAN has been turned on, the process proceeds to step S6, which will be described later.

If it is determined in step S4 that the WLAN is not turned on, in step S5, the display image generation unit 880 is based on the signal indicating the user's operation input acquired and supplied by the operation input acquisition unit 871. For example, the HOME button 23 is pressed to command the display of the Home screen 451 or the BACK button 24 is pressed to command the display of the previous display screen. Determine if it has been done.

If it is determined in step S5 that a display other than the standby screen is instructed, the process proceeds to step S43, which will be described later. If it is determined in step S5 that no display other than the standby screen has been commanded, the process returns to step S4, and the subsequent processes are repeated.

If it is determined in step S2 that the WLAN is turned on, or if it is determined in step S4 that the WLAN is turned on, in step S6, the icon arrangement determination unit 877 is determined by the display setting storage control unit 873. The display setting whose memory is controlled is read, and it is determined whether or not it is set to switch the displayed icon corresponding to the ad hoc mode and the infrastructure mode.

If it is determined in step S6 that the displayed icons are not set to be switched corresponding to the ad hoc mode and the infrastructure mode, in step S7, the WLAN described later with reference to FIGS. 56 and 57 will be described. The communicable user display process is executed and the process is completed.

If it is determined in step S6 that the displayed icon is switched according to the ad hoc mode and the infrastructure mode, the communication status acquisition unit 872 sets the current communication status in step S8. Upon detection, it is determined whether or not the communication mode is ad hoc mode, and the determination result is supplied to the registered user information acquisition unit 874 and the icon arrangement determination unit 877.

If it is determined in step S8 that the communication mode is not the ad hoc mode, that is, the infrastructure mode, the process proceeds to step S27 described later.

When it is determined in step S8 that the communication mode is the ad hoc mode, in step S9, the registered user information acquisition unit 874 performs a large amount of information regarding the registered user of the mutual communication in the ad hoc mode via the audio processor 132. Read from memory 154 and extract.

In step S10, whether or not the icon arrangement determination unit 877 is set to read the display setting whose memory is controlled by the display setting storage control unit 873 and to display the icon corresponding to the registered user in the infrastructure mode. To judge.

If it is determined in step S10 that the icon corresponding to the registered user in the infrastructure mode is also displayed, in step S11, the icon arrangement determination unit 877 tells the registered user information acquisition unit 874 the infrastructure. Information about the registered user of the mode is read from the large-capacity memory 154 and extracted via the audio processor 132. Then, the icon arrangement determination unit 877 determines that all the extracted registered users as the registered users of the mutual communication in the ad hoc mode are offline, as described with reference to FIG. 48, for example, and displays the icons. Is arranged, and the icon corresponding to the registered user in the infrastructure mode is arranged in a lower level area than the icon corresponding to the registered user in the mutual communication in the ad hoc mode, and the information indicating the determined arrangement is displayed. Notify the image generator 880. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 described with reference to FIG. 48, and controls the display module 142 to control the display of the standby screen 851. To do.

When it is determined in step S10 that the icon corresponding to the registered user in the infrastructure mode is not displayed, in step S12, the icon arrangement determination unit 877 is described with reference to FIG. 47, for example. Then, all the registered users extracted as the registered users in the ad hoc mode are judged to be offline (that is, in the case of FIG. 47, they are displayed in the second area of the contact icon display area 864. ), Notify the display image generator 880 with information indicating the determined sequence. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 described with reference to FIG. 47, controls the display module 142, and controls the display of the standby screen 851. To do.

After the processing of step S11 or step S12 is completed, in step S13, the broadcast information acquisition unit 875 determines whether or not the broadcast information has been received from the other information communication terminal 1. If it is determined in step S13 that the broadcast information has not been received from the other information communication terminal 1, the process proceeds to step S17 described later.

If it is determined in step S13 that the broadcast information has been received from the other information communication terminal 1, in step S14, the broadcast information acquisition unit 875 uses the registered user as the source of the broadcast information. Determine if it exists.

If it is determined in step S14 that the source of the broadcast information is a registered user, in step S15, the broadcast information acquisition unit 875 supplies the determination result to the icon arrangement determination unit 877. The icon arrangement determination unit 877 updates the entire arrangement assuming that the icon of the corresponding user is online, and notifies the display image generation unit 880 of information indicating the determined arrangement. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 whose array has been updated, and controls the display module 142 to control the display of the standby screen 851. Specifically, for example, when the positions where the icons can be arranged in the contact icon display area 864 are prioritized in order, the icon arrangement determination unit 877 corresponds to the source of the broadcast information. Determine the array of icons and update the entire array so that the icons of registered users are displayed in a higher priority position than the icons corresponding to offline users. Further, for example, in the case of FIG. 47, the icon arrangement determination unit 877 moves the corresponding registered user icon displayed in the second area of the contact icon display area 864 to the first area, and is required. Update the entire array accordingly.

If it is determined in step S14 that the source of the broadcast information is not a registered user but an unregistered user, in step S16, the broadcast information acquisition unit 875 determines the determination result and the broadcast information. Is supplied to the icon arrangement determination unit 877. Based on the broadcast information, the icon arrangement determination unit 877 adds an icon corresponding to the source of the information and updates the entire arrangement, and displays information indicating the determined arrangement to the display image generation unit 880. Notice. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 whose array has been updated, and controls the display module 142 to control the display of the standby screen 851. Specifically, for example, when the positions where the icons can be arranged in the contact icon display area 864 are prioritized in order, the icon arrangement determination unit 877 corresponds to the source of the broadcast information. Determine the array of icons so that the icons of unregistered users are displayed at a lower priority than the icons corresponding to offline users, and update the entire array as necessary. Further, for example, in the case of FIG. 47, the icon arrangement determination unit 877 displays the icon of the corresponding unregistered user in the third area, and updates the entire arrangement as needed.

If it is determined in step S13 that the broadcast information has not been received from the other information communication terminal 1, the operation is performed in step S17 after the processing in step S15 is completed or after the processing in step S16 is completed. The input acquisition unit 871 determines whether or not any of the icons displayed in the contact icon display area 864 has been selected and determined. If it is determined in step S17 that none of the icons displayed in the contact icon display area 864 has been selected and determined, the process proceeds to step S24 described later.

If it is determined in step S17 that any of the icons displayed in the contact icon display area 864 is selected, the operation input acquisition unit 871 is selected and determined by the display image generation unit 880 in step S18. The icon supplies information indicating which icon it is. Since the display image generation unit 880 changes the display screen to the available application list screen 892 described with reference to FIG. 43, for example, which icon is selected and determined by the available application extraction unit 878. Provides information indicating. The available application extraction unit 878 includes the communication status acquired by the communication status acquisition unit 828 (currently in ad hoc mode), information about the registered user acquired by the registered user information acquisition unit 874, and the broadcast information acquisition unit. Based on the information about the unregistered user being broadcast obtained by 875, the application that can be used to communicate with the registered user corresponding to the selected icon is extracted and supplied to the display image generation unit 880. To do.

In step S19, the display image generation unit 880, for example, based on the extraction result of the application available for communicating with the registered user corresponding to the selected and determined icon supplied from the available application extraction unit 878, for example. Generate screen data for the available application list screen 892 described with reference to FIG. 43.

In step S20, the display image generation unit 880 controls the display module 142 to control the display of the available application list screen 892 generated in step S19. As a result, the available application list screen 892 described with reference to FIG. 43 is displayed on the display unit 21.

In step S21, the operation input acquisition unit 871 determines whether or not any of the applications shown on the available application list screen 892 displayed in step S20 has been selected and determined.

If it is determined in step S21 that any of the applications has been selected and determined, in step S22, the application manager of the application processor 131 starts and executes the selected application program, and the process ends.

If it is determined in step S21 that none of the applications has been selected and determined, in step S23, the operation input acquisition unit 871 determines whether or not the display of the standby screen is commanded. If it is determined in step S23 that the display of the standby screen has not been commanded, the process returns to step S21, and the subsequent processes are repeated.

If it is determined in step S17 that none of the icons displayed in the contact icon display area 864 have been selected and determined, or if it is determined in step S23 that the display of the standby screen has been commanded, step S24 In, the operation input acquisition unit 871 determines whether or not the switch to the infrastructure mode is instructed. If it is determined in step S24 that the switch to the infrastructure mode has been ordered, the process proceeds to step S27, which will be described later.

If it is determined in step S24 that the switch to the infrastructure mode has not been commanded, in step S25, the operation input acquisition unit 871 determines whether or not the WLAN OFF has been commanded. If it is determined in step S25 that the WLAN OFF is commanded, the process returns to step S3, and the subsequent processes are repeated.

If it is determined in step S25 that the WLAN OFF is not commanded, in step S26, the display image generation unit 880 outputs a signal indicating the user's operation input acquired and supplied by the operation input acquisition unit 871. Based on this, for example, the HOME button 23 is pressed to command the display of the Home screen 451 or the BACK button 24 is pressed to command the display of the previous display screen. To determine if was ordered.

If it is determined in step S26 that a display other than the standby screen is instructed, the process proceeds to step S43, which will be described later. If it is determined in step S26 that no display other than the standby screen has been commanded, the process returns to step S17, and the subsequent processes are repeated.

In step S8, if it is determined that the communication mode is not ad hoc mode, that is, it is in infrastructure mode, or in step S24 it is determined that a switch to infrastructure mode is instructed, in step S27, The registered user information acquisition unit 874 reads and extracts information about the registered user registered as a communication partner from the large-capacity memory 154 via the audio processor 132 in the application using the infrastructure mode, and determines the icon arrangement. Supply to department 877.

In step S28, the icon arrangement determination unit 877 reads the display setting whose memory is controlled by the display setting storage control unit 873, and the communication partner (registered user) registered in the application using the infrastructure mode is online. Determine if it is set to check in advance whether it is or offline. If it is determined in step S28 that it is not set in advance to confirm whether the communication partner is online or offline, the process proceeds to step S32 described later.

If it is determined in step S28 that it is set to confirm in advance whether the communication partner is online or offline, in step S29, the Online / Offline determination unit 876 is an application that uses the infrastructure mode. Functions At least some of these functions are activated.

In step S30, the application processor 131 operating at least some of the functions of the application that uses the infrastructure mode accesses the server 12 that provides each service and registers as a communicable user. The constant monitoring of whether the user is online or offline is started, and the result is supplied to the icon arrangement determination unit 877.

In step S31, the icon arrangement process described later is executed using FIG. 58 or FIG. 59, and the process proceeds to step S33.

If it is determined in step S28 that the communication partner is not set to be checked in advance whether it is online or offline, in step S32, the icon arrangement determination unit 877 of the extracted registered user's icon The array is determined based on the available application, and the information indicating the determined icon array is supplied to the display image generation unit 880. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 whose arrangement has been determined, and controls the display module 142 to control the display of the standby screen 851.

After the processing of step S31 or step S32 is completed, in step S33, the operation input acquisition unit 871 determines whether or not any of the icons displayed in the contact icon display area 864 has been selected and determined. .. If it is determined in step S33 that none of the icons displayed in the contact icon display area 864 has been selected and determined, the process proceeds to step S40 described later.

If it is determined in step S33 that any of the icons displayed in the contact icon display area 864 is selected, the operation input acquisition unit 871 is selected and determined by the display image generation unit 880 in step S34. The icon supplies information indicating which icon it is. Since the display image generation unit 880 changes the display screen to the available application list screen 891 described with reference to FIG. 42, for example, which icon is selected and determined by the available application extraction unit 878. Provides information indicating. The available application extraction unit 878 is based on the communication status (currently in infrastructure mode) acquired by the communication status acquisition unit 828 and the information about the registered user acquired by the registered user information acquisition unit 874. An application that can be used to communicate with the registered user corresponding to the selected and determined icon is extracted and supplied to the display image generation unit 880.

In step S35, the display image generation unit 880, for example, based on the extraction result of the application available for communicating with the registered user corresponding to the selected and determined icon supplied from the available application extraction unit 878, for example. Generate screen data for the available application list screen 891 described with reference to FIG. 42.

In step S36, the display image generation unit 880 controls the display module 142 to control the display of the available application list screen 891 generated in step S35. As a result, the available application list screen 891 described with reference to FIG. 42 is displayed on the display unit 21.

In step S37, the operation input acquisition unit 871 determines whether or not any of the applications shown on the available application list screen 891 displayed in step S36 has been selected.

If it is determined in step S37 that any of the applications has been selected and determined, in step S38, the application manager of the application processor 131 starts and executes the selected application program, and the process ends.

If it is determined in step S37 that none of the applications has been selected and determined, in step S39, the operation input acquisition unit 871 determines whether or not the display of the standby screen is commanded. If it is determined in step S39 that the display of the standby screen has not been commanded, the process returns to step S37, and the subsequent processes are repeated.

If it is determined in step S33 that none of the icons displayed in the contact icon display area 864 have been selected and determined, or if it is determined in step S39 that the display of the standby screen has been commanded, step S40 In, the operation input acquisition unit 871 determines whether or not the switch to the ad hoc mode is commanded. If it is determined in step S40 that the switch to the ad hoc mode has been ordered, the process returns to step S9 described above, and the subsequent processes are repeated.

If it is determined in step S40 that the switch to the ad hoc mode has not been commanded, the operation input acquisition unit 871 determines in step S41 whether or not the WLAN OFF has been commanded. If it is determined in step S41 that the WLAN OFF is commanded, the process returns to step S3, and the subsequent processes are repeated.

If it is determined in step S41 that the WLAN OFF is not commanded, in step S42, the display image generation unit 880 outputs a signal indicating the user's operation input acquired and supplied by the operation input acquisition unit 871. Based on this, for example, the HOME button 23 is pressed to command the display of the Home screen 451 or the BACK button 24 is pressed to command the display of the previous display screen. To determine if was ordered. If it is determined in step S42 that a display other than the standby screen has not been commanded, the process returns to step S28, and the subsequent processes are repeated.

If it is determined in step S5, step S26, or step S42 that a display other than the standby screen is commanded, in step S43, the display image generation unit 880 controls the display module 142 to obtain the operation input acquisition unit 871. The display screen is controlled to be changed according to the user's operation input acquired and supplied by, and the process is completed.

In this way, the standby screen can be changed based on, for example, whether the WLAN is ON or OFF according to the setting by the user, and further, when the WLAN is ON, it is an ad hoc mode. Based on whether it is in infrastructure mode or in ad hoc mode or infrastructure mode, it is displayed in the contact icon display area 864 according to the communication status of each registered user. The arrangement of icons can be determined. In addition, when any of the icons displayed in the contact icon display area 864 is selected and determined, the application that can be used to communicate with the registered user corresponding to the selected and determined icon is extracted, and the application that can be used is extracted. Available application list screen 891 or 892 can be generated and displayed.

By doing so, the user of the information communication terminal 1 can find and contact a person who is easy to contact, or how to contact a friend in order to contact the user. The information communication partner can be determined in the general order of thinking of thinking, and the method of exchanging information with the device possessed by the corresponding information communication partner can be easily selected.

Next, the WLAN communicable user display process executed in step S7 of FIG. 52 will be described with reference to the flowcharts of FIGS. 56 and 57.

In step S71, the registered user information acquisition unit 874 transmits information about the registered user of mutual communication in the ad hoc mode and the registered user registered as the communication partner in the application using the infrastructure mode via the audio processor 132. Then, it is read from the large-capacity memory 154, extracted, and supplied to the icon arrangement determination unit 877.

In step S72, the Online / Offline determination unit 876 automatically sets the communication mode to the ad hoc mode (regardless of the user's operation input).

In step S73, the broadcast information acquisition unit 875 determines whether or not the broadcast information has been received from the other information communication terminal 1. If it is determined in step S73 that the broadcast information has not been received from the other information communication terminal 1, the process proceeds to step S76 described later.

If it is determined in step S73 that the broadcast information has been received from the other information communication terminal 1, the broadcast information acquisition unit 875 supplies the acquired information to the icon arrangement determination unit 877 in step S74. .. The icon arrangement determination unit 877 determines whether the registered users of mutual communication in the ad hoc mode are online or offline, respectively, based on the information about the registered users and the broadcast information.

In step S75, the broadcast information acquisition unit 875 extracts and holds information corresponding to the unregistered user from the broadcasted and acquired information based on the information about the registered user and the broadcasted information. To do.

If it is determined in step S73 that the broadcast information has not been received from the other information communication terminal 1, or after the processing in step S75 is completed, in step S76, the Online / Offline determination unit 876 communicates. Automatically change the mode to infrastructure mode (regardless of user input).

In step S77, the Online / Offline discriminant unit 876 operates at least some of the functions of the application that uses the infrastructure mode.

In step S78, the application processor 131 operating at least some of the functions of the application that uses the infrastructure mode accesses the server 12 that provides each service and registers as a communicable user. It confirms whether the user is online or offline, and supplies it to the Online / Offline determination unit 876. The Online / Offline determination unit 876 supplies the icon arrangement determination unit 877 with the determination result of whether the user registered as a communicable user is online or offline.

In step S79, the icon arrangement determination unit 877 reads the display setting whose storage is controlled by the display setting storage control unit 873, and based on the information acquired in the processes of steps S71 to S78, for example, FIG. 51. Display information indicating the set or changed array as setting or changing the arrangement of each icon based on the communication status with the registered user in both communication modes as described with. Notify the image generator 880. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 described with reference to FIG. 48, and controls the display module 142 to control the display of the standby screen 851. To do.

In step S80, the operation input acquisition unit 871 determines whether or not any of the icons displayed in the contact icon display area 864 is selected. If it is determined in step S80 that none of the icons displayed in the contact icon display area 864 has been selected and determined, the process proceeds to step S88 described later.

If it is determined in step S80 that any of the icons displayed in the contact icon display area 864 is selected, the operation input acquisition unit 871 is selected and determined by the display image generation unit 880 in step S81. The icon supplies information indicating which icon it is. The display image generation unit 880 is, for example, an available application list screen (basically) in which a list of applications that can be used in ad hoc mode or infrastructure mode for communication with a device owned by the user corresponding to the selected and determined icon is displayed. Is equivalent to the available application list screen 891 described with reference to FIG. 42 and the available application list screen 892 described with reference to FIG. 43). 878 is supplied with information indicating which icon the selected icon is. The available application extraction unit 878 makes a selection decision based on the information about the registered user acquired by the registered user information acquisition unit 874 and the information about the unregistered user being broadcast acquired by the broadcast information acquisition unit 875. The application that can be used to communicate with the registered user corresponding to the icon is extracted and supplied to the display image generation unit 880.

In step S82, the display image generation unit 880 is used based on the extraction result of the application that can be used to communicate with the registered user corresponding to the selected and determined icon supplied from the available application extraction unit 878. Generate screen data for the list of possible applications.

In step S83, the display image generation unit 880 controls the display module 142 to control the display of the available application list screen generated in step S82. As a result, the available application list screen is displayed on the display unit 21.

In step S84, the operation input acquisition unit 871 determines whether or not any of the applications shown on the available application list screen displayed in step S83 has been selected.

If it is determined in step S84 that any of the applications has been selected and determined, in step S85, the application processor 131 sets the communication mode to the communication mode corresponding to the selected application.

In step S86, the application manager of the application processor 131 starts and executes the selected application program, the process returns to step S7 of FIG. 52, and the process ends.

If it is determined in step S84 that none of the applications has been selected and determined, in step S87, the operation input acquisition unit 871 determines whether or not the display of the standby screen is commanded. If it is determined in step S87 that the display of the standby screen has not been commanded, the process returns to step S84, and the subsequent processes are repeated.

When it is determined in step S87 that the display of the standby screen is commanded, in step S88, the operation input acquisition unit 871 determines whether or not the WLAN OFF is commanded, and determines the determination result as the icon arrangement determination unit 877. Supply to.

When it is determined in step S88 that the WLAN OFF is commanded, the icon arrangement determination unit 877, which has been supplied with the determination result in step S89, indicates to the display image generation unit 880 that the WLAN OFF has been ordered. Notice. The display image generation unit 880 controls the display module 142 to control the display of the standby screen when the WLAN is OFF. As a result, the standby screen when the WLAN is OFF is displayed on the display unit 21.

In step S90, the communication status acquisition unit 872 detects the current communication status and determines whether or not the WLAN is turned on. If it is determined in step S90 that the WLAN has been turned on, the process returns to step S71, and the subsequent processes are repeated.

If it is determined in step S90 that the WLAN is not turned on, in step S91, the display image generation unit 880 is based on the signal indicating the user's operation input acquired and supplied by the operation input acquisition unit 871. For example, the HOME button 23 is pressed to command the display of the Home screen 451 or the BACK button 24 is pressed to command the display of the previous display screen. Determine if it has been done.

If it is determined in step S91 that a display other than the standby screen is instructed, the process proceeds to step S93, which will be described later. If it is determined in step S91 that no display other than the standby screen has been commanded, the process returns to step S90, and the subsequent processes are repeated.

If it is determined in step S88 that the WLAN OFF has not been commanded, the icon arrangement determination unit 877 notifies the display image generation unit 880 that the WLAN OFF has not been commanded in step S92. The display image generation unit 880 is instructed to display the Home screen 451 by, for example, pressing the HOME button 23 based on the signal indicating the user's operation input acquired and supplied by the operation input acquisition unit 871. , The BACK button 24 is pressed, and it is determined whether or not a display other than the standby screen is commanded, such as a command to display the previous display screen.

If it is determined in step S92 that no display other than the standby screen has been commanded, the process returns to step S80, and the subsequent processes are repeated.

When it is determined in step S91 or step S92 that a display other than the standby screen is commanded, in step S93, the display image generation unit 880 controls the display module 142 and is acquired by the operation input acquisition unit 871. Based on the user's operation input supplied to the user, the display screen is controlled to be changed according to the user's operation input based on the signal indicating the user's operation input, and the process is performed in step S7 of FIG. It returns and the process is finished.

By such processing, when it is not set to switch the displayed icon corresponding to the ad hoc mode and the infrastructure mode, each of them is based on the communication status with the registered user in both communication modes. You can set or change the placement of the icons so that they are displayed. In addition, when any of the icons displayed in the contact icon display area 864 is selected and determined, the application that can be used to communicate with the registered user corresponding to the selected and determined icon is extracted, and the application that can be used is extracted. The available application list screen is generated and displayed. Further, when the application to be used is selected and determined by the user, the communication mode is set to either the ad hoc mode or the infrastructure mode according to the selected application.

By doing so, the user of the information communication terminal 1 thinks about how to contact a friend in order to contact a friend, which is a general thought order of information communication. The other party can be determined more easily, and the method of exchanging information with the device possessed by the corresponding information communication partner can be easily selected.

Next, the icon arrangement process 1 which is the first example of the process executed in step S31 of FIG. 54 will be described with reference to the flowchart of FIG. 58.

In the icon arrangement process 1, for example, as described with reference to FIG. 49, the icons corresponding to the registered users are not only distinguished for each application, but also the arrangement is determined based on whether or not they are online. It is a process when it is done like this. Here, it is assumed that n (n is an integer of 1 or more) types of applications that communicate using the infrastructure mode are installed.

In step S121, the icon arrangement determination unit 877 determines which of the applications communicating using the infrastructure mode is processing the registered user registered. For example, the value N set in the internal register or the like is set to N = 1.

In step S122, the icon arrangement determination unit 877 is among the registered users based on the information of the registered users registered as communication partners in the application using the infrastructure mode supplied from the registered user information acquisition unit 874. , Extract the registered users registered in the Nth application.

In step S123, the icon arrangement determination unit 877 determines whether the registered users extracted in step S122 are online or offline, respectively, based on the constant monitoring result supplied from the Online / Offline determination unit 876. ..

In step S124, the icon arrangement determination unit 877 shall arrange the icon corresponding to the user who is online in the Nth application in the Nth level area based on the determination result in step S123.

In step S125, the icon arrangement determination unit 877 arranges the icon corresponding to the user who is offline in the Nth application in the (n + N) level area based on the determination result in step S123. To do.

In step S126, the icon arrangement determination unit 877 sets the value N to N = N + 1.

In step S127, the icon arrangement determination unit 877 compares the total number n of available applications with the value N and determines whether or not n &lt;N.

If it is determined in step S127 that n &lt;N, the process returns to step S122, and the subsequent processes are repeated.

If it is determined in step S127 that n &lt;N, the processing has been completed for all the applications. Therefore, in step S128, the icon arrangement determination unit 877 is controlled by the display setting storage control unit 873. The display image generation unit 880 is notified of the information indicating the set or changed arrangement as the display setting is read, the arrangement of each icon is set, or the arrangement is changed. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 described with reference to FIG. 49, and controls the display module 142 to display the standby screen 851. To control.

By such a process, the icons corresponding to the registered users are not only distinguished for each application, but also the arrangement is determined based on whether or not they are online. Therefore, in the same communication mode. Even when a plurality of applications are available, it is possible to clearly indicate which registered user is online in any of the applications.

Next, the icon arrangement process 2, which is a second example of the process executed in step S31 of FIG. 54, will be described with reference to the flowchart of FIG. 59.

In the icon arrangement process 2, for example, as described with reference to FIG. 50, the icon corresponding to the registered user who can communicate with as many applications as possible (online state) is displayed at a high priority position. This is a process when the sequence is determined. Here, it is assumed that there are two types of applications that communicate using the infrastructure mode, but even if there are three or more types of applications that communicate using the infrastructure mode, the arrangement is basically the same. It is possible to decide.

In step S151, the icon arrangement determination unit 877 is among the registered users based on the information of the registered users registered as communication partners in the application using the infrastructure mode supplied from the registered user information acquisition unit 874. , Extract the registered users registered in the first application.

In step S152, the icon arrangement determination unit 877 determines whether the users extracted in step S151 are online or offline, respectively, based on the constant monitoring result supplied from the Online / Offline determination unit 876.

In step S153, the icon arrangement determination unit 877 is among the registered users based on the information of the registered users registered as communication partners in the application using the infrastructure mode supplied from the registered user information acquisition unit 874. , Extract the registered users registered in the second application.

In step S154, the icon arrangement determination unit 877 determines whether the users extracted in step S153 are online or offline, respectively, based on the constant monitoring result supplied from the Online / Offline determination unit 876.

In step S155, the icon arrangement determination unit 877 sets the icon corresponding to the user who is online in both the first application and the second application at the first level based on the determination results of step S152 and step S154. It shall be placed in the area of.

In step S156, the icon arrangement determination unit 877 arranges the icon corresponding to the user who is online only in the first application in the second level area based on the determination results of step S152 and step S154. And.

In step S157, the icon arrangement determination unit 877 arranges the icon corresponding to the user who is online only in the second application in the third level area based on the determination results of step S152 and step S154. And.

In step S158, the icon arrangement determination unit 877 is either offline in the first application and the second application based on the determination results in step S152 and step S154, or one is offline and the other is offline. The icon corresponding to the unregistered user shall be placed in the 4th level area.

In step S159, the icon arrangement determination unit 877 reads the display setting whose memory is controlled by the display setting storage control unit 873, sets the arrangement of each icon, or sets or changes the arrangement. Notify the display image generation unit 880 of the information indicating the changed array. The display image generation unit 880 controls the display module 142 to generate display image data corresponding to the standby screen 851 described with reference to FIG. 49, and controls the display module 142 to display the standby screen 851. To control.

By such processing, even when a plurality of applications are available in the same communication mode, the icon corresponding to the registered user who can communicate with as many applications as possible (online state) has a high priority. The sequence can be determined to be displayed at the position.

As described above, by applying the present invention, the user of the information communication terminal 1 can specify the communication partner in a more natural way when making contact with another user by communication, and the communication partner can be specified. It is possible to determine the application used to communicate with the device owned by another user designated as, i.e., to contact the desired communication partner.

That is, in communication including the case where a communication device is not used, in general, in order to contact a certain person, the method of contacting is considered. That is, by showing a list of applications that can be used to exchange information with the selected party on the standby screen, the user of the information communication terminal 1 can use the desired user in a more natural way. You can decide whether to contact.

The series of processes described above can be performed by software or by using hardware built in to perform the series of processes described above. The software is a computer in which the programs that make up the software are embedded in dedicated hardware, or a general-purpose personal computer that can execute various functions by installing various programs. Etc., it is installed from the recording medium.

As shown in FIG. 11, this recording medium is a magnetic disk (including a flexible disk) or an optical disk (CD-ROM (CD-ROM)) on which a program is recorded, which is distributed to provide a program to a user separately from a computer. Compact Disk-Read Only Memory), DVD (including Digital Versatile Disk)), optical magnetic disk (including MD (Mini-Disk) (trademark)), removable media 172 consisting of semiconductor memory, etc.

Further, in the present specification, the steps for describing a program recorded on a recording medium are not necessarily processed in chronological order, but also in parallel or in parallel or not necessarily in chronological order. It also includes processes that are executed individually.

In addition, in this specification, a system represents the whole apparatus composed of a plurality of apparatus.

The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

<figref num="1">It is a figure for demonstrating an information communication system including an information communication terminal to which this invention is applied.</figref><figref num="2">It is a front outline view of an information communication terminal.</figref><figref num="3">It is an outline drawing of the back side (the side without a display part) of an information communication terminal.</figref><figref num="4">It is an outline drawing of the upper side surface (the side where the WLAN ON / OFF switch is provided) of an information communication terminal.</figref><figref num="5">It is an external view of the right side surface (the side where the communication state notification light emitting part is provided) from the side where the display part of the information communication terminal is provided.</figref><figref num="6">It is an outline drawing of the left side (the side where the WLAN ON / OFF switch and the power switch are provided) facing from the side where the display part of the information communication terminal is provided.</figref><figref num="7">It is an outline drawing of the lower side surface (the side where the power switch and the music key are provided) of the information communication terminal.</figref><figref num="8">It is an external view when the housing is slid.</figref><figref num="9">It is a figure for demonstrating the constant display panel.</figref><figref num="10">It is a figure for demonstrating the information which is always displayed on the display panel.</figref><figref num="11">It is a block diagram which shows the internal structure example of an information communication terminal.</figref><figref num="12">It is a software stack diagram which shows the structure of the software executed in the application processor.</figref><figref num="13">It is a software stack diagram which shows the structure of the software executed in an audio processor.</figref><figref num="14">It is a figure which shows the display example of a Home screen.</figref><figref num="15">It is a figure which shows the display example of the screen in a recording standby state.</figref><figref num="16">It is a figure which shows the display example of the screen during recording.</figref><figref num="17">It is a figure which shows the display example of the screen in the state where the recording is stopped, that is, while the recorded audio data is waiting for reproduction (pause).</figref><figref num="18">It is a figure which shows the display example of the screen during reproduction of the recorded audio data.</figref><figref num="19">It is a figure which shows an example of the display screen when a photo viewer is executed.</figref><figref num="20">It is a figure which shows an example of the screen for creating a new text.</figref><figref num="21">It is a figure for demonstrating the context menu (Context Menu).</figref><figref num="22">It is a figure for demonstrating the character prediction conversion function.</figref><figref num="23">It is a figure for demonstrating communication in an ad hoc mode.</figref><figref num="24">It is a figure for demonstrating an example of the information which an information communication terminal of an ad hoc mode transmits by a broadcast.</figref><figref num="25">It is a figure for demonstrating the ad hoc user list display screen.</figref><figref num="26">It is a figure for demonstrating an example of the user information exchanged when mutual registration is performed as a communication partner.</figref><figref num="27">It is a figure for demonstrating the menu screen.</figref><figref num="28">It is a figure for demonstrating the search screen.</figref><figref num="29">It is a figure for demonstrating the music data reproduction display screen.</figref><figref num="30">It is a figure for demonstrating the ad hoc user list screen.</figref><figref num="31">It is a figure for demonstrating the public playlist list display screen.</figref><figref num="32">It is a figure for demonstrating the track display screen.</figref><figref num="33">It is a figure for demonstrating the communication application top screen.</figref><figref num="34">It is a figure for demonstrating the login screen.</figref><figref num="35">It is a figure for demonstrating the contact list display screen.</figref><figref num="36">It is a figure for demonstrating the web browser menu screen.</figref><figref num="37">It is a figure for demonstrating the connection screen.</figref><figref num="38">It is a figure for demonstrating the message display screen.</figref><figref num="39">It is a figure for demonstrating the web page display screen.</figref><figref num="40">It is a figure for demonstrating the standby screen.</figref><figref num="41">It is a function block diagram which shows the function used by a menu display tool.</figref><figref num="42">It is a figure for demonstrating the available application list screen.</figref><figref num="43">It is a figure for demonstrating the available application list screen.</figref><figref num="44">It is a figure for demonstrating the standby screen.</figref><figref num="45">It is a figure for demonstrating the standby screen.</figref><figref num="46">It is a figure for demonstrating the standby screen.</figref><figref num="47">It is a figure for demonstrating the standby screen.</figref><figref num="48">It is a figure for demonstrating the standby screen.</figref><figref num="49">It is a figure for demonstrating the standby screen.</figref><figref num="50">It is a figure for demonstrating the standby screen.</figref><figref num="51">It is a figure for demonstrating the standby screen.</figref><figref num="52">It is a flowchart for demonstrating the standby screen display processing.</figref><figref num="53">It is a flowchart for demonstrating the standby screen display processing.</figref><figref num="54">It is a flowchart for demonstrating the standby screen display processing.</figref><figref num="55">It is a flowchart for demonstrating the standby screen display processing.</figref><figref num="56">It is a flowchart for demonstrating the user display process which can communicate with WLAN.</figref><figref num="57">It is a flowchart for demonstrating the user display process which can communicate with WLAN.</figref><figref num="58">It is a flowchart for demonstrating the icon arrangement process 1.</figref><figref num="59">It is a flowchart for demonstrating the icon arrangement processing 2.</figref>

Code description

1 Information and communication terminal, 11 Network, 12 Server, 13 Personal computer, 21 Display, 22 WLAN mode switching button, 23 HOME button, 24 BACK button, 25 Option button, 26 4 arrow keys, 27 Enter button, 28 Speaker, 29 Microphone, 30 WLAN ON / OFF switch, 31 WLAN status notification light emitter, 32 power status notification light emitter, 33 power switch, 34 communication status notification light emitter, 35 music key, 41 battery cover, 42 ringer speaker, 43 HOLD switch, 44 Volume Button, 51 USB Connector, 52 Connector Jack, 101 Always Display Panel, 131 Application Processor, 132 Audio Processor, 342 Display Module, 143 Backlight Driver, 144 Light Emitting Module, 145 Audio Conversion Module, 146 Flash Memory, 147 memory, 148 wireless communication module, 149 keyboard module, 150 input module, 152 audio signal processing module, 153 real-time clock (RTC), 154 large-capacity flash memory, 155 memory bus, 156 flash memo, 157 memory, 851 standby screen, 864 Contact icon display area