Information processor, information processing method and program
Abstract
Problem to be solved.To shift to a function operating in the background when a plurality of functions are executed. An information communication terminal 1 can execute a plurality of functions at the same time by activating a single application or a plurality of applications. In addition, when the information communication terminal 1 is executing multiple functions at the same time, the user can click the INFO button for the functions that are operating in parallel in the background and that are useful to be able to access (migrate) immediately. You can easily migrate (that is, shortcut) by pressing 11. The present invention can be applied to information communication terminals. [Selection diagram] Fig. 2

Term
Term ended
Projected expiry passed 30 June 2026, 0.2 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
8 claims: 3 independent, 5 dependent
- 1コンテンツデータの再生機能と、外部機器との通信機能を同時に実行している情報処理装置において、 前記再生機能を実行する再生手段と、 前記通信機能を実行する通信手段と、 第1の操作手段からの操作入力を、前記再生機能または前記通信機能に割当てる操作入力割当手段と、 第2の操作手段からの操作入力を取得する操作入力取得手段と、 前記再生機能に関する情報または前記通信機能に関する情報を、表示部に表示させる表示制御手段と を備え、 前記操作入力割当手段は、前記表示制御手段により前記通信機能に関する情報が前記表示部に表示されているときに、前記第1の操作手段からの操作入力を前記通信機能に割当てるとともに、前記第1の操作手段からの操作入力を前記通信機能に割当てている場合に、前記操作入力取得手段により前記第2の操作手段からの操作入力が取得されたとき、前記第1の操作手段からの操作入力を前記再生機能に割当て、 前記表示制御手段は、前記通信機能に関する情報を前記表示部に表示しているときに、前記操作入力取得手段により前記第2の操作手段からの操作入力が取得されたとき、前記再生機能に関する情報を前記表示部に表示する 情報処理装置。
- 2前記操作入力割当手段は、前記第1の操作手段からの操作入力が前記通信機能および前記再生機能のいずれにも割当てられていない場合、前記操作入力取得手段により前記第2の操作手段からの操作入力が取得されたとき、前記第1の操作手段から入力された情報を前記通信機能に割当て、さらに、前記操作入力取得手段により前記第2の操作手段からの操作入力が取得されたとき、前記第1の操作手段から入力された情報を前記再生機能に割当て、 前記表示制御手段は、前記通信機能に関する情報および再生機能に関する情報のいずれも前記表示部に表示していない場合、前記操作入力取得手段により前記第2の操作手段からの操作入力が取得されたとき、前記通信機能に関する情報を前記表示部に表示し、さらに、前記操作入力取得手段により前記第2の操作手段からの操作入力が取得されたとき、前記再生機能に関する情報を前記表示部に表示する 請求項1に記載の情報処理装置。
- 3前記通信機能に関する情報は、前記通信機能による通信状態に応じた情報であり、 前記再生機能に関する情報は、前記再生機能による再生状態に応じた情報である 請求項1に記載の情報処理装置。
- 4前記再生機能により再生されるコンテンツが格納されている記憶部を有し、 前記表示制御手段は、前記再生機能で再生されているコンテンツが、前記記憶部に記憶されているコンテンツであるか、外部機器から提供されたコンテンツであるかを表す情報を含む前記再生機能に関する情報を、前記表示部に表示する 請求項3記載の情報処理装置。
- 5前記表示制御手段は、前記再生機能で再生されたコンテンツが外部機器に提供されている場合、前記外部機器で前記コンテンツが出力されていることを表す情報を含む前記再生情報に関する情報を前記表示部に表示する 請求項3記載の情報処理装置。
- 6前記通信機能において新たなイベントが発生したとき、その旨が提示される 請求項3に記載の情報処理装置。
- 7コンテンツデータの再生機能と、外部機器との通信機能を同時に実行させる情報処理方法において、 前記再生機能を実行する再生ステップと、 前記通信機能を実行する通信ステップと、 第1の操作手段からの操作入力を、前記再生機能または前記通信機能に割当てる操作入力割当ステップと、 第2の操作手段からの操作入力を取得する操作入力取得ステップと、 前記再生機能に関する情報または前記通信機能に関する情報を、表示部に表示させる表示制御ステップと を含み、 前記操作入力割当ステップは、前記表示制御ステップの処理で前記通信機能に関する情報が前記表示部に表示されているときに、前記第1の操作手段からの操作入力を前記通信機能に割当てるとともに、前記第1の操作手段からの操作入力を前記通信機能に割当てている場合に、前記操作入力取得ステップの処理で前記第2の操作手段からの操作入力が取得されたとき、前記第1の操作手段からの操作入力を前記再生機能に割当て、 前記表示制御ステップは、前記通信機能に関する情報を前記表示部に表示しているときに、前記操作入力取得ステップの処理で前記第2の操作手段からの操作入力が取得されたとき、前記再生機能に関する情報を前記表示部に表示する 情報処理方法。
- 8コンテンツデータの再生機能と、外部機器との通信機能を同時に実行させる情報処理をコンピュータに実行されるプログラムにおいて、 前記再生機能を実行する再生ステップと、 前記通信機能を実行する通信ステップと、 第1の操作手段からの操作入力を、前記再生機能または前記通信機能に割当てる操作入力割当ステップと、 第2の操作手段からの操作入力を取得する操作入力取得ステップと、 前記再生機能に関する情報または前記通信機能に関する情報を、表示部に表示させる表示制御ステップと を含み、 前記操作入力割当ステップは、前記表示制御ステップの処理で前記通信機能に関する情報が前記表示部に表示されているときに、前記第1の操作手段からの操作入力を前記通信機能に割当てるとともに、前記第1の操作手段からの操作入力を前記通信機能に割当てている場合に、前記操作入力取得ステップの処理で前記第2の操作手段からの操作入力が取得されたとき、前記第1の操作手段からの操作入力を前記再生機能に割当て、 前記表示制御ステップは、前記通信機能に関する情報を前記表示部に表示しているときに、前記操作入力取得ステップの処理で前記第2の操作手段からの操作入力が取得されたとき、前記再生機能に関する情報を前記表示部に表示する 情報処理をコンピュータに実行させるプログラム。
Independent claims8
292 paragraphs, as filed
The present invention relates to an information processing apparatus, an information processing method, and a program, and more particularly to an information processing apparatus, an information processing method, and a program, which are suitable for use when a plurality of functions can be operated in parallel.
In recent years, with the miniaturization of personal computers and the increasing number of functions of mobile phones or handheld game machines, attention has been paid to the efficiency of operating means of small devices .
In a large device, operating means can be arranged according to each function, but in a small device, the area in which the operating means can be arranged is limited.
Therefore, it has been proposed to assign the operation input from one operation means to a plurality of functions. For example, Patent Document 1 describes that a function to which an operation input from an operation means is assigned can be selected according to a contact pressure of the user with the operation means.
<patcit num="1"><text>Japanese Patent Application Laid-Open No. 2005-317041</text></patcit>
<p> However, in this method, the functions that can be selected by the contact pressure are uniformly determined according to the contact pressure, for example, when a plurality of functions are executed at the same time, in relation to the functions being executed. , No method has been developed to determine the function to be assigned to the operation input.</p><p> The present invention has been made in view of such a situation, and in a small terminal device capable of executing a plurality of functions in parallel, an operation input from an operating means is converted into a function executed in parallel. It allows you to allocate.</p>
<p> The information processing device of one aspect of the present invention executes the playback means for executing the playback function and the communication function in the information processing device that simultaneously executes the content data reproduction function and the communication function with the external device. The communication means to be used, the operation input allocation means for allocating the operation input from the first operation means to the reproduction function or the communication function, the operation input acquisition means for acquiring the operation input from the second operation means, and the above. The display control means for displaying information on the reproduction function or the information on the communication function on the display unit is provided, and the operation input assigning means displays the information on the communication function on the display unit by the display control means. Occasionally, when the operation input from the first operating means is assigned to the communication function and the operation input from the first operating means is assigned to the communication function, the operation input acquisition means causes the first operation input. When the operation input from the second operation means is acquired, the operation input from the first operation means is assigned to the reproduction function, and the display control means displays information on the communication function on the display unit. At that time, when the operation input from the second operation means is acquired by the operation input acquisition means, the information regarding the reproduction function is displayed on the display unit.</p><p> When the operation input from the first operation means is not assigned to either the communication function or the reproduction function, the operation input assigning means is operated by the operation input acquisition means from the second operation means. When the input is acquired, the information input from the first operating means is assigned to the communication function, and when the operation input acquiring means acquires the operation input from the second operating means, the said When the information input from the first operation means is assigned to the reproduction function and the display control means does not display either the information related to the communication function and the information related to the reproduction function on the display unit, the operation input acquisition When the operation input from the second operation means is acquired by the means, the information about the communication function is displayed on the display unit, and further, the operation input from the second operation means is received by the operation input acquisition means. When acquired, information regarding the reproduction function can be displayed on the display unit.</p><p> The information regarding the communication function may be information according to the communication state by the communication function, and the information regarding the reproduction function may be information according to the reproduction state by the reproduction function.</p><p> The display control means has a storage unit in which the content reproduced by the reproduction function is stored, and the display control means means that the content reproduced by the reproduction function is the content stored in the storage unit or is external. Information on the playback function, including information indicating whether the content is provided by the device, can be displayed on the display unit.</p><p> When the content reproduced by the reproduction function is provided to an external device, the display control means displays information on the reproduction information including information indicating that the content is output by the external device. Can be displayed on.</p><p> When a new event occurs in the communication function, that fact is presented.</p><p> The information processing method or program of one aspect of the present invention is an information processing method for simultaneously executing a content data reproduction function and a communication function with an external device, or a content data reproduction function and a communication function with an external device. In a program that executes information processing on a computer at the same time, the reproduction step for executing the reproduction function, the communication step for executing the communication function, and the operation input from the first operation means are input to the reproduction function or the operation input. An operation input allocation step to be assigned to the communication function, an operation input acquisition step to acquire an operation input from the second operation means, and a display control step for displaying information on the reproduction function or information on the communication function on the display unit. In the operation input allocation step, when information about the communication function is displayed on the display unit in the process of the display control step, the operation input from the first operation means is sent to the communication function. When the operation input from the first operation means is assigned to the communication function and the operation input from the second operation means is acquired in the process of the operation input acquisition step, the first operation input is assigned. The operation input from the operation means 1 is assigned to the reproduction function, and the display control step is the process of the operation input acquisition step when the information about the communication function is displayed on the display unit. When the operation input from the operation means is acquired, the information about the reproduction function is displayed on the display unit.</p><p> In the information processing device, information processing method, or program of one aspect of the present invention, the reproduction function is executed, the communication function is executed, and the operation input from the first operating means is the reproduction function or the said. It is assigned to the communication function, the operation input from the second operation means is acquired, and the information about the reproduction function or the information about the communication function is displayed on the display unit. When the information related to the communication function is displayed on the display unit, the operation input from the first operating means is assigned to the communication function, and the operation input from the first operating means is assigned to the communication function. When the operation input from the second operation means is acquired, the operation input from the first operation means is assigned to the reproduction function. When the operation input from the second operating means is acquired while the information regarding the communication function is displayed on the display unit, the information regarding the reproduction function is displayed on the display unit.</p>
<p> As described above, according to one aspect of the present invention, for example, in a small terminal device capable of executing a plurality of functions in parallel, an operation input from an operating means is assigned to a function executed in parallel. be able to.</p>
An embodiment of the present invention will be described below, and the correspondence between the constituent requirements of the present invention and the embodiment described in the specification or drawings will be illustrated as follows. This description is to confirm that the embodiments supporting the present invention are described in the specification or drawings. Therefore, even if there is an embodiment that is described in the specification or drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is the practice. Does not mean that the form of is not corresponding to the constituent requirements. On the contrary, even if the embodiment is described here as corresponding to the constituent requirements, it means that the embodiment does not correspond to the constituent requirements other than the constituent requirements. It's not something to do.
The information processing device of one aspect of the present invention is a playback means (for example, the application of FIG. 11) that executes the playback function in the information processing device that simultaneously executes the content data playback function and the communication function with an external device. The playback function is the operation input from the processor 131), the communication means for executing the communication function (for example, the application processor 131 in FIG. 11), and the first operation means (for example, the four-way key 26 in FIG. 2). Alternatively, the operation input acquisition means for acquiring the operation input from the operation input allocation means (for example, the operation input allocation unit 906 in FIG. 28) and the second operation means (for example, the INFO button 11 in FIG. 2) to be assigned to the communication function. (For example, the shortcut operation input unit 901 in FIG. 28) and a display control means (for example, the INFO panel generation unit 905 in FIG. 28) for displaying information on the playback function or information on the communication function on the display unit. , The operation input allocating means allocates the operation input from the first operating means to the communication function when the information about the communication function is displayed on the display unit by the display control means, and also allocates the operation input from the first operating means to the communication function. When the operation input from the operation means is assigned to the communication function and the operation input from the second operation means is acquired by the operation input acquisition means, the operation input from the first operation means is acquired. Is assigned to the reproduction function (for example, step S11 in FIG. 39), and the display control means performs the second operation by the operation input acquisition means while displaying information on the communication function on the display unit. When the operation input from the means is acquired, the information regarding the reproduction function is displayed on the display unit (for example, step S10 in FIG. 39).
When the operation input from the first operation means is not assigned to either the communication function or the reproduction function, the operation input assigning means is operated by the operation input acquisition means from the second operation means. When the input is acquired, the information input from the first operating means is assigned to the communication function (for example, step S6 in FIG. 39), and further, the operation input acquiring means from the second operating means. When the operation input is acquired, the information input from the first operation means is assigned to the reproduction function (for example, step S11 in FIG. 39), and the display control means relates to the information related to the communication function and the reproduction function. When none of the information is displayed on the display unit, when the operation input from the second operation means is acquired by the operation input acquisition means, the information on the communication function is displayed on the display unit (for example). , Step S5 in FIG. 39), and further, when the operation input from the second operation means is acquired by the operation input acquisition means, information on the reproduction function is displayed on the display unit (for example, in FIG. 39). Step S10).
The information regarding the communication function is information according to the communication state by the communication function (for example, FIG. 29 or FIG. 32), and the information about the reproduction function is information according to the reproduction state by the reproduction function (for example, FIG. 32). , Figure 35).
The display control means has a storage unit (for example, the large-capacity flash memory 154 of FIG. 11) in which the content reproduced by the reproduction function is stored, and the display control means stores the content reproduced by the reproduction function. Information about the playback function (for example, the playback INFO panel 801-2 in FIG. 37B) including information indicating whether the content is stored in the unit or the content is provided from an external device is displayed on the display unit. indicate.
When the content reproduced by the reproduction function is provided to an external device, the display control means displays information on the reproduction information including information indicating that the content is output by the external device. (For example, playback INFO panel 801-2 in Figure 38B).
When a new event occurs in the communication function, that fact is presented (for example, FIG. 30 or FIG. 33).
The information processing method or program of one aspect of the present invention is an information processing method for simultaneously executing a content data reproduction function and a communication function with an external device, or a content data reproduction function and a communication function with an external device. In a program that executes information processing to be executed simultaneously by a computer, a reproduction step for executing the reproduction function (for example, the audio player in FIG. 12) and a communication step for executing the communication function (for example, the communication application in FIG. 12). And an operation input allocation step (for example, the application manager of FIG. 12) for allocating the operation input from the first operation means to the playback function or the communication function, and an operation for acquiring the operation input from the second operation means. It includes an input acquisition step (for example, the application manager of FIG. 12) and a display control step (for example, the application manager of FIG. 12) for displaying information about the playback function or information about the communication function on the display unit. In the operation input allocation step, when information about the communication function is displayed on the display unit in the process of the display control step, the operation input from the first operation means is assigned to the communication function, and the communication function is assigned. When the operation input from the first operation means is assigned to the communication function and the operation input from the second operation means is acquired in the process of the operation input acquisition step, the first operation means The operation input from is assigned to the reproduction function (for example, step S11 in FIG. 39), and the display control step processes the operation input acquisition step when the information related to the communication function is displayed on the display unit. When the operation input from the second operation means is acquired, the information regarding the reproduction function is displayed on the display unit (for example, step S10 in FIG. 39).
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 shows a configuration example of an information communication system including information communication terminals 1-1 to information communication terminals 1-3 to which the present invention is applied. Information communication terminals 1-1 to information communication terminals 1-3 are devices having the same function, and in the following, it is not necessary to individually distinguish information communication terminals 1-1 to information communication terminals 1-3. , Simply referred to as information communication terminal 1. The same applies to other cases.
The information communication terminal 1 is a portable device having various functions and having a size that can be grasped by a user with one hand.
The information communication terminal 1 has, for example, an information communication function via wireless and wired.
Specifically, the information communication terminal 1 has, for example, a WLAN (Wireless Local Area Network) function corresponding to the 802.11b standard, and can be connected to another device to exchange information.
In the example of FIG. 1, the information communication terminal 1 can be directly connected to a network 2 such as the Internet by wireless communication by executing a predetermined application, and various servers 3 and a personal computer are connected via the network 2. Information can be exchanged with 4 or another information communication terminal 1 (indicated by information communication terminal 1-1 and information communication terminal 1-2 in the figure).
The information communication terminal 1 also directly communicates with another information communication terminal 1 (indicated by the information communication terminal 1-1 and the information communication terminal 1-2 in the figure) by executing a predetermined application. It is also possible to exchange information.
There is an application infrastructure mode application that realizes wireless communication corresponding to the 802.11b standard, but the information communication terminal 1 can selectively use either the infrastructure mode or the ad hoc mode in this WLAN.
The WLAN infrastructure mode is a method of communicating via a wireless LAN access point. The WLAN ad hoc mode is a method in which data is directly exchanged between devices without going through a wireless LAN access point.
Applications that use infrastructure mode communication processing include communication applications that provide functions such as IP phones, instant messengers that provide functions such as chat, web browsers for browsing web pages, and electronic devices. There is a mail application and so on.
As an application that performs processing using ad hoc mode communication processing, ad hoc mode information communication terminal 1 (in the figure, information communication terminal 1-1 and information communication terminal 1-2) that exists within the range where ad hoc communication is possible (Shown) There are file exchange applications that transfer files between each other and music applications that stream music data.
The information communication terminal 1 can also be connected to other devices by wire in accordance with the USB (Universal Serial Bus) 2.0 standard, for example, to exchange information.
The information communication terminal 1 has a function of recording various information and a function of reproducing audio and video.
Specifically, the information communication terminal 1 is compatible with various audio codec methods such as ATRAC (Advanced Transform Acoustic Coding) 3, MP3 (MPEG Audio Layer-3), and WMA (Windows (registered trademark) Media Audio). By running the application, the supplied audio data can be recorded or played back.
An audio player is an application that reproduces music data. Another type of application is a music application that streams music data between ad hoc mode information communication terminals 1 that exist within the range where ad hoc communication is possible.
The information communication terminal 1 also has a so-called Photo Viewer function, and can store image data and reproduce the image data.
The information communication terminal 1 has a function of displaying various information including the reproduced video, information assisting the user's operation input (so-called GUI (Graphic User Interface)), and the like.
Specifically, the information communication terminal 1 is provided with, for example, an LCD (Liquid Crystal display) as a display device and a keyboard or the like as an input device, and by executing a predetermined application, various information including images, or various information including images, or It is possible to display various GUIs and control user operation inputs from various input devices.
The information communication terminal 1 has a plurality of such functions, but is configured to be able to execute several functions at the same time.
That is, the user can start the audio player to listen to the music while starting the browser and using the Internet, or even when the audio player is started to listen to the music, in the infrastructure mode of the WLAN. It can accept access by instant messenger.
The user can also start the music application in the ad hoc mode of the WLAN to perform streaming playback while accepting access from other devices in the ad hoc mode.
Further, when the information communication terminal 1 executes a plurality of functions at the same time in this way, among the functions operating in parallel in the background, the functions that can be accessed immediately are useful, the INFO button described later is pressed. By doing so, you can easily migrate (that is, shortcut).
Details will be described later with reference to FIGS. 27 to 39, but in the information communication terminal 1, when a plurality of functions are being executed at the same time and the INFO button is pressed, the functions operating in the background are displayed. A predetermined operation panel (hereinafter referred to as an INFO panel) for use is displayed, and operation input from the predetermined operation means is assigned to the transferred function.
That is, the user can shortcut to a function operating in the background by simply pressing the INFO button, and the function can be used quickly.
Normally, a terminal that can execute multiple functions has a GUI for accessing the function hierarchically, and the user operates in the background by transitioning the GUI hierarchy according to a certain procedure. You can reach the function you are using. On the other hand, according to this information communication terminal 1, by operating the INFO button, it is possible to easily shortcut to a function operating in the background.
In this way, being able to shortcut to a function that operates in the background is particularly useful in a device that is becoming more multifunctional, and that the same operating means can be used to control the function after migration. Is particularly useful in small terminals in which the area in which the operating means are arranged is limited and the operating means cannot be arranged according to each function.
Next, the appearance of the information communication terminal 1 will be described with reference to FIGS. 2 to 8. FIG. 2 is a front outline view of the information communication terminal 1.
The information communication terminal 1 has an INFO button 11, a display unit 21, a WLAN mode switching button 22, a HOME button 23, a BACK button 24, an option button 25, a 4-way key 26, an enter button 27, a speaker 28, and A microphone 29 is provided, and a WLAN ON / OFF switch 30, a WLAN status notification light emitting unit 31, a power status notification light emitting unit 32, and a power switch 33 are provided on the left side surface facing the display unit 21, and the display unit 21 in the figure is provided. A communication status notification light emitting unit 34 is provided on the right side surface facing the display unit 21, and a music key 35 is provided on the lower side surface facing the display unit 21.
The INFO button 11 is a button that is operated when a shortcut is made to a predetermined function operating in the background when a plurality of functions are being executed.
The display unit 21 is composed of, for example, a flat display such as an LCD so that various information can be displayed.
The WLAN mode switching button 22 is a button for inputting an operation for switching ON / OFF of the wireless LAN.
The HOME button 23 is a button for inputting an operation to display the HOME menu described later on the display unit 21 using FIG. 13 regardless of the type of information currently displayed on the display unit 21.
The BACK button 24 is a button for inputting an operation for returning the display screen to the previous screen.
The option button 25 is a button for inputting an operation for displaying a display screen for setting various options.
The four-direction key 26 is a key for performing an operation input such as moving a cursor, changing a menu, or a selection of a button or an icon in the information displayed on the display unit 21.
The decision button 27 is a menu in the selected state or a button for inputting an operation for deciding the selection of a button, an icon, or the like.
The speaker 28 is a speaker that outputs the voice of a call or outputs the voice reproduced by a predetermined application among the voice data recorded in the information communication terminal 1 when an IP telephone is used, for example. is there.
The microphone 29 inputs the voice of a call or collects the voice acquired by a predetermined application, for example, when an IP telephone is used.
The WLAN ON / OFF switch 30 is a switch operated by the user when switching between enabling and disabling the wireless communication function of the information communication terminal 1.
The WLAN status notification light emitting unit 31 notifies the user of whether or not the wireless communication function of the information communication terminal 1 is enabled or disabled, which is composed of, for example, a light emitting element such as one or a plurality of LEDs (light emitting diodes) and a light guide tube. It is a light emitting part for doing so.
The power status notification light emitting unit 32 is, for example, whether or not the information communication terminal 1 composed of light emitting elements such as one or a plurality of LEDs is turned on, is being charged, or is charged to be completed. It is a light emitting unit for notifying the user of such things.
The power switch 33 is a switch for turning on / off the power of the information communication terminal 1.
The communication status notification light emitting unit 34 is, for example, a light emitting unit composed of light emitting elements such as one or a plurality of LEDs for notifying the user of the communication status of the information communication terminal 1.
The music key 35 is used to input operations such as playback start, playback end, fast forward, rewind, pause, and forward / reverse AMS (Auto Music Scan; cue) when playing audio data on the information communication terminal 1. Is the key to do.
Next, FIG. 3 is an external view of the back side (the side where the display unit 21 is not provided) of the information communication terminal 1.
A battery cover 41 is provided on the back side of the information communication terminal 1, and a ringer speaker 42, a HOLD switch 43, and a volume button 44 are provided on the side where the communication status notification light emitting unit 34 is provided.
The battery cover 41 is a mounting portion and a battery cover for mounting a battery that supplies power to each portion of the information communication terminal 1.
The ringer speaker 42 mainly reproduces and outputs music data among the voice data stored in the information communication terminal 1 and music data streamed from another information communication terminal 1 or the like, or is used by an IP telephone. It is a speaker that reproduces and outputs the ringing sound when the call is made.
The HOLD switch 43 is, for example, a switch that is operated when the input of all buttons, switches, or the like is invalidated.
The volume button 44 is a button operated when adjusting the volume of the sound output from the ringer speaker 42.
Next, FIG. 4 is an outline view of the upper side surface (the side where the WLAN ON / OFF switch 30 is provided) of the information communication terminal 1.
A USB connector 51 and a connector jack 52 are provided on the upper side surface of the information communication terminal 1.
A USB cable is connected to the USB connector 51 to exchange information with other devices.
The connector jack 52 is composed of, for example, a 10-pin flat female connector and can be connected to an audio input / output device such as headphones or a microphone.
The DC jack 53 receives a DC power supply.
Next, FIG. 5 is an external view of the right side (the side where the communication status notification light emitting unit 34 is provided) of the information communication terminal 1 from the side where the display unit 21 is provided.
The communication status notification light emitting unit 34, the HOLD switch 43, and the DC jack 53 are arranged as shown in FIG. 5 on the right side surface of the information communication terminal 1.
Next, FIG. 6 is an external view of the left side surface (the side where the WLAN ON / OFF switch 30 and the power switch 33 are provided) when viewed from the side where the display unit 21 of the information communication terminal 1 is provided.
The WLAN ON / OFF switch 30, the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the power switch 33 are arranged as shown in FIG. 6 on the left side surface of the information communication terminal 1.
FIG. 7 is an external view of the lower side surface (the side where the power switch 33 and the music key 35 are provided) of the information communication terminal 1.
The power status notification light emitting unit 32, the power switch 33, the communication status notification light emitting unit 34, the music key 35, the HOLD switch 43, and the volume button 33 are as shown in FIG. 7 on the lower side surface of the information communication terminal 1. Have been placed.
The information communication terminal 1 is provided with a display unit 21, a WLAN mode switching button 22, a HOME button 23, a BACK button 24, an option button 25, a 4-way key 26, an enter button 27, a speaker 28, and a microphone 29. The front housing 61 part is slid upward (upward toward the display surface of the display unit 21), and the keyboard 71 can be moved by sliding the housing 61 part. It is made to appear. FIG. 8 is an external view when the housing 61 is slid.
As described above, since the information communication terminal 1 is provided with various buttons, when operating with reference to the information displayed on the display unit 21, the user can operate by referring to the information displayed on the display unit 21, for example, as shown in FIG. You can operate various buttons with. FIG. 9 shows how the music key 35 is operated by the thumb of the user's right hand.
When using an IP telephone, as shown in FIG. 10, the user holds the position of the speaker 29 and the microphone 29 of the information communication terminal 1 so as to correspond to the positions of the user's ear and mouth, and holds the information communication terminal 1. Operate various buttons.
Next, FIG. 11 is a block diagram showing an example of the internal configuration of the information communication terminal 1.
The information communication terminal 1 includes an application processor 131 that mainly controls execution of application programs, and an audio processor 132 that mainly controls functions such as voice data management, audio codec, and copyright management. The application processor 131 and the audio processor 132 are connected by, for example, one or a plurality of serial interfaces or parallel interfaces so that control signals and data can be exchanged.
The application processor 131 executes various processes based on the clock generated by the clock generator 141. Details of the functions executed by the application processor 131 will be described later.
A display module 142, a backlight driver 143, a light emitting module 144, an audio conversion module 145, a flash memory 146, a memory 147, a wireless communication module 148, a keyboard module 149, and an input module 150 are connected to the application processor 131. .. The input module 150 is also connected to the audio processor 132.
The display module 142 includes a display unit 21, and when the display unit 21 is composed of an LCD, information by the display unit 21 such as an LCD driver, an LCD backlight, and a light guide tube, if necessary, is provided. It is composed of what is necessary for the display of, and displays various information under the control of the application processor 131.
The backlight driver 143 is a driver for the backlight of the display unit 21.
The light emitting module 144 is composed of a WLAN status notification light emitting unit 31, a power status notification light emitting unit 32, a communication status notification light emitting unit 34, and a driver of a light emitting element included in these light emitting units. Based on the control, each of the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the communication status notification light emitting unit 34 is turned on, blinked, or turned off in a predetermined color.
The audio conversion module 145 A / D-converts the sound collected by the microphone 29 or the microphone connected to the connector jack 52 under the control of the application processor 131, and performs predetermined processing such as filtering. After that, it is supplied to the application processor 131, the audio data supplied from the application processor 131 is D / A converted, and the audio data is output to the speaker 28 for playback, or the audio signal processing module 152 is installed. The audio data is output to the headphones connected to the connector jack 52 and played back.
The flash memory 146 has a storage capacity of, for example, about 64 MB, and even after the power supply is stopped, such as a program executed by the application processor 131 and a register in which information necessary for executing the program and various variables are set. Memorize information that is not erased.
The memory 147 is composed of, for example, SDRAM (Synchronous Dynamic Random Access Memory) or the like, has a storage capacity of, for example, about 64 MB, and stores information necessary for processing executed by the application processor 131.
The wireless communication module 148 is, for example, a unit that realizes the WLAN function corresponding to the 802.11b standard, executes wireless communication under the control of the application processor 131, and directly communicates with other devices or is an access point. And exchange information via the network.
The keyboard module 149 is configured to include a keyboard 71, receives a user's operation input, and supplies a signal indicating an operation content to the application processor 131.
The input module 150 includes an INFO button 11, a WLAN mode switching button 22, a HOME button 23, a BACK button 24, an option button 25, a 4-way key 26, an enter button 27, a WLAN ON / OFF switch 30, a power switch 33, and a music key 35. , HOLD switch 43, and volume button 44, receive user's operation input, and supply a signal indicating the operation content to the application processor 131 or audio processor 132.
The audio processor 132 executes various processes based on the clock generated by the clock generation unit 151-1 or the clock generation unit 151-2. Since the audio processor 132 is a processor that mainly handles audio data, if it receives two clock inputs, a basic clock used for cordic processing of audio data and a basic clock used for other signal processing. Suitable.
In addition to the input module 150 described above, the audio processor 132 is connected to an audio signal processing module 152, a USB connector 51, a real-time clock (RTC) 153, a large-capacity flash memory 154, and a memory bus 155. Flash memory 156 and memory 157 are connected to. The audio processor 132 is also supplied with an insertion / removal detection signal of the connector jack 52.
The audio signal processing module 152 contains, for example, a D / A converter, a digital filter, an audio output (headphone or speaker) amplifier, and the audio data supplied from the audio processor 132 or the audio conversion module 145 is D. It is converted to / A, filtered and amplified as necessary, supplied to the ringer speaker 42 or the connector jack 52, and played back and output. Further, the audio signal processing module 152 receives a command from the audio processor 132 to output not only an audio output but also a so-called beep sound or a ring tone such as an IP phone, and the ringer speaker 42 or the connector jack 52 receives a beep sound or a ring tone. Is output.
The real-time clock (RTC) 153 is a clock that counts the current time, and supplies the current time to the audio signal processing module 152.
The large-capacity flash memory 154 is a flash memory having a large storage capacity such as 1 GB to several GB, and stores information supplied from the audio processor 132. The large-capacity flash memory 154 also stores information generated or acquired by the processing of the application processor 131 supplied via the audio processor 132.
The large-capacity flash memory 154 contains, for example, content data such as music data that can be played by processing of the audio processor 132, data generated by various application programs, and tools such as instant messenger, IP phone, chat, and e-mail. The registration information of other users, which is used when exchanging information with other users by using the above, is stored. Further, the large-capacity flash memory 154 also stores registration information about itself (device and user) sent to a device owned by another user, and the user can change the setting as appropriate. There is.
The flash memory 156 has a storage capacity of, for example, about 64 MB, and even after the power supply is stopped, such as a program executed by the audio processor 132 and a register in which information necessary for executing the program and various variables are set. Memorize information that is not erased.
The memory 157 is composed of, for example, SDRAM or the like, has a storage capacity of about 64 MB, and stores information necessary for processing executed by the audio processor 132.
Further, another device such as a personal computer 4 is connected to the USB connector 51 via, for example, a USB cable, as described with reference to FIG. 1, for example. A computer in which a drive 171 is connected to the USB connector 51 as needed, and a removable media 172 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached and read from the removable media 172. The program is installed in flash memory 146 or flash memory 156 as needed to make it executable.
The signal supplied from, for example, the personal computer 4 and the like via the USB connector 51 is supplied to the audio processor 132, and is supplied to the application processor 131 as needed. Further, the audio processor 132 outputs a predetermined signal to, for example, a personal computer 4 via the USB connector 51.
Further, the DC power supply supplied by the USB connection, the DC power supply supplied via the DC jack 53, or the DC power supply supplied from the battery 160 mounted on the information communication terminal 1 is informationed by the power supply control unit 161. It is supplied to each part of the communication terminal 1.
Next, the software executed in the application processor 131 will be described. FIG. 12 is a software stack showing the configuration of software executed in the application processor 131.
As shown in FIG. 12, the configuration of the software executed in the application processor 131 defines the hardware layer, the device driver layer, the OS layer, the middleware layer, and the application layer from the lower side.
The device driver layer is dedicated software for operating the application processor 131 and the hardware connected to the application processor 131. Specifically, the device driver (WLAN) for operating the wireless communication module 148. , The LCD driver (LCD) for operating the LCD included in the display module 142 for displaying the image on the display unit 21, the keyboard driver (KEY) for operating the keyboard module 149, and the general-purpose port of the application processor 131. A driver for operating the device driver (GPIO) for operation, the light emitting element included in each of the WLAN status notification light emitting unit 31, the power status notification light emitting unit 32, and the communication status notification light emitting unit 34 of the light emitting module 144. (LED) etc. are included.
Next, the operating system (OS) that controls the basic operation of the application processor 131 is installed in the OS layer. The OS manages various resources operated by the device driver. For example, the OS transmits an instruction generated by an application program executed in the middleware layer or the application layer, which will be described later, to the device driver, or flashes. Provides basic functions commonly used by many application software, such as data input / output with memory 146, memory 147, or audio processor 132, or management of input / output functions such as key input and screen output. And manage the entire system. OS includes, for example, Windows (registered trademark) 95 (trademark), Windows (registered trademark) 98 (trademark), Windows (registered trademark) NT (trademark), LINUX, OS / 2 (trademark) and the like. In addition, the OS is a part of software resources such as the execution context of any application program executed in the application layer described later (register set, main memory image, file handle, etc. used by a certain application program). It is also managed.
The middleware layer is composed of middleware, which is software that runs on the OS and provides application software with more advanced and specific functions than the OS.
The middleware layer has an intermediate character between the OS and application software. Since it is inefficient to individually develop the functions that are commonly used in many application software, the functions that are commonly used in many application software (often the basic functions) are Provided as middleware.
Here, as middleware, we provide a communication engine for providing basic functions of communication applications such as IP phones, and basic functions of technology for transmitting and receiving voice data using TCP / IP networks such as the Internet and intranet. VoIP (Voice over IP) engine to provide, instant messenger engine to provide basic functions of instant messenger, to realize the function of encrypting data to protect the copyright of digital data. In addition to the DRM (Digital Rights Management) protocol, a graphic library, which is a collection of GUI parts displayed on the display unit 21 as various application programs are executed, is prepared.
A graphic library is a collection of versatile functions and data used in image processing of various application programs executed in the application layer. Specifically, some versatile functions used in image processing are put together like an archive, and the functions required for software execution are standardized as independent files. Graphics libraries are generally distinguished from application program subroutines as they are loaded at run time separately from the application program.
Then, various application programs are executed in the uppermost application layer. In the information communication terminal 1, for example, a communication application, a web browser, a file exchange application, a personal computer connection application, an audio player, a music search application, music streaming, an instant messenger, a recording tool, a photo viewer, and a text editor ( In addition to individual applications such as Text Editor), WLANs, menu display tools, setting tools, status bar display tools, utilities such as FEP (Front End Processor), an application manager that manages these application software, and a development environment. It is prepared.
The communication application is for using a communication engine or a VoIP engine to provide communication with other devices (other users using) such as so-called IP telephone function and voice chat.
A web browser is an application for browsing web pages via a network. Specifically, it downloads HTML files, image files, music files, etc. via the network, analyzes the layout, and displays it. Application software that executes the playback function, allows the user to send data to a Web server using the displayed form, and is written in Java (registered trademark) Script, Flash, and Java (registered trademark). To realize the function to operate.
The file exchange application is for providing a file transfer function for sending and receiving data files to and from other devices connected to the network or directly. The personal computer connection application is for providing a function of connecting to the personal computer 4 and exchanging information.
The audio player provides a function of playing back music data. The music search application is for creating a database of music data stored inside and providing a function of searching for music data desired by a user. In addition, music streaming provides a function of exchanging music data with another device for streaming playback.
The instant messenger application is for checking whether a friend who is using the same software on a network such as the Internet or LAN is online, and if it is online, chatting or transferring files.
The recording tool is for providing a function of recording and playing back the voice data collected by the microphone 29, such as a so-called voice memo. The photo viewer manages the image data (photograph data) recorded inside, and controls the playback display in various display methods such as a list display of thumbnail images and a slide show display. The text editor provides a function for creating text data based on the user's operation input by the keyboard 71 or the like.
In addition to this, as individual applications, for example, spreadsheet software, database creation software, e-mail applications, various games, and the like can be appropriately installed.
In addition, the WLAN is for realizing the function of the WLAN corresponding to the 802.11b standard, for example, and the menu display tool is for controlling the display of the menu screen and the like displayed on the display unit 21. is there. The setting tool is for setting various functions of the information communication terminal 1 based on the user's operation input, and the status bar display tool is for displaying various information on the constant display panel described later. .. FEP is a kana-kanji conversion software used to input Japanese.
Next, a specific execution example of various functions executed in the information communication terminal 1 will be described with reference to the display screen displayed on the display unit 21.
FIG. 13 is a display example of the HOME screen 451 displayed on the display unit 21 of the information communication terminal 1 immediately after the power is turned on or when the HOME button 23 is pressed.
The HOME screen 451 displays a menu for selecting an application program that can be executed on the information communication terminal 1 (or an item composed of a plurality of application programs).
On the HOME screen 451 of FIG. 13, the menus of the communication application (Communication) 461, music tool (Music) 463, web browser (WEB Browser) 462, photo viewer (Photo Viewer) 465, and recording tool (Voice Memo) 467 are selected. Listed as possible states.
The user can basically select and start a desired application by using the HOME screen 451 to execute various functions.
In FIG. 13, in addition to the menu list screen, the constant display panel 101 is displayed. The constant display panel 101 is basically a panel that is always displayed on various screens described later in addition to the HOME screen 451.
Here, the constant display panel 101 will be described.
As shown in FIG. 13, the constant display panel 101 is provided in a predetermined area along the lower side of the display unit 21, and displays various information indicating the state of the information communication terminal 1. Has been done.
Information indicating the remaining battery level is displayed in the battery level display area 201.
Information indicating the strength of the WLAN is displayed in the WLAN radio wave strength display area 202.
Information indicating the WLAN mode and connection status is displayed in the WLAN status display area 203. Specifically, in the WLAN status display area 203, for example, information indicating whether the WLAN mode is OFF, infrastructure mode, or ad hoc mode, and whether the connection status is connected or OFFLINE. Information indicating that is displayed.
In the communication use application status display area 204, information on the execution status of the application in which the WLAN infrastructure mode and the ad hoc network mode are executed is displayed.
Specifically, for example, when the IP phone application is running in infrastructure mode, the execution status of the IP phone application is displayed, and when the instant messenger application is running in infrastructure mode, the instant messenger application is executed. The status is displayed.
Further, when an application using an ad hoc connection is executed in the ad hoc mode, the connection information of the ad hoc mode is displayed, for example, information indicating whether or not one-to-one communication is in progress.
The keyboard input mode display area 205 shows the input modes of special keys on the keyboard (eg, ALT, NUM, SHIFT, Fn, etc.). When the key is held, the HOLD mark is displayed in the keyboard input mode display area 115.
Then, the current time information is displayed in the clock display area 206.
Next, on the HOME screen 451 of FIG. 13, the processing when the communication application (Communication) 461, the web browser (WEB Browser) 462, and the music tool (Music) 463 are selected and determined will be described.
First, the processing when the communication application (Communication) 461 on the HOME screen 451 is selected and determined will be described.
By selecting and deciding the communication application (Communication) 461, applications such as communication applications including functions such as IP telephone, instant messenger, and e-mail applications as applications that perform processing using communication processing in WLAN infrastructure mode. Can be started, and information can be exchanged with various servers 3, personal computers 4, or other information communication terminals 1 via network 2 by wireless communication depending on the started application.
FIG. 14 shows a communication application top screen 461 displayed when the communication application (Communication) 461 is selected and determined on the HOME screen 451 of FIG. The communication application top screen 461 lists the tool names of communication tools that can be used in the WLAN infrastructure mode provided by a plurality of service providers (service providers).
Communication tools that use wide-area networks such as the Internet, such as IP phones and chats, are provided by multiple service providers (service providers). The information communication terminal 1 is adapted to be able to use communication tools provided by these plurality of service providers (service providers) as communication applications.
When the tool name of the communication tool on the communication application top screen 461 of FIG. 14 is selected and determined, the contact list display screen 462 as shown in FIG. 15 is displayed, for example.
In the content tab display area 463 of the contact list display screen 462, a plurality of tabs are displayed so that the user can select the information displayed in the list or the like display area 464 and command various operations. .. The user can use the left and right keys of the four-way key 26 to select a desired tab from a plurality of tabs and press the enter button 27 to determine the desired one.
The selected tab is displayed in the central selection tab display area 465.
In the tab displayed in the content tab display area 463, for example, there is a Contact List tab for displaying a list of registered users who can communicate, and when the Contact List tab is selected, the list display etc. area 464 has. , A list of communicable registered users as shown in FIG. 15 is displayed.
The user can select a desired registered user using the four-way key 26, and can communicate with the selected user using a corresponding communication tool such as an IP phone, chat, or e-mail.
In addition, in the tab displayed in the content tab display area 463, a list of registered users or a list of telephone numbers that can communicate is also displayed, and the operation input of the process of making an IP phone is made to the selected party. Dial tab, Call tab for setting the middle screen of Call, text input area for inputting text for chat, and Chat tab for displaying the display area of the text input by the chat partner. There is a Call List tab for displaying the incoming call history, a Setting tab for displaying the setting screen for making various settings, and a Start tab for displaying your own status.
Next, the processing when the WEB Browser 462 is selected and determined on the HOME screen 451 of FIG. 13 will be described.
By selecting and deciding this WEB browser (WEB Browser) 462, it is possible to use the WEB browser as an application that performs processing using the communication processing of the WLAN infrastructure mode.
FIG. 16 shows a display example of the web browser menu screen 471 displayed on the display unit 21 when the web browser (WEB Browser) 462 is selected and determined on the HOME screen 451 of FIG. On the web browser menu screen 471, a menu for selecting a method for specifying a web page to be displayed is displayed.
In the case of this example, the method of specifying the web page to be displayed is, for example, to display the last connected web page (Last URL) and to display the page registered in advance as the first web page to be displayed (Start). Page), a list of registered favorite web pages is displayed, and the user's desired page is selected and displayed (Bookmark) from among them, and the page data itself is saved in advance and saved. You can display the page you are using (Saved Page), and you can enter the URL of the web page you want (Input URL).
On the web browser menu screen 471, when one of the web page specification methods is selected and determined and the web page to be connected is confirmed, the connection to that page (the server that publishes the page on network 2 such as the Internet) When access to 3 etc. is performed and a web page with the specified URL is connected, the web page is displayed on the web page display screen 472 as shown in FIG.
Next, the processing when the music tool (Music) 463 is selected and determined on the HOME screen 451 of FIG. 13 will be described.
By selecting and determining this music tool (Music) 463, it is possible to perform processing for handling audio data (mainly music data).
FIG. 18 shows a display example of the menu screen 501 displayed on the display unit 21 when the music tool (Music) 463 is selected and determined on the HOME screen 451 of FIG.
In the case of this example, each menu of Music Search631, Streaming632, Now Playing633, All Tracks634, and My Playlist634 can be selected and selected by the user using the four-way key 26 and the enter button 27.
Regarding functions related to music content, there are both those that do not use communication processing with other devices and those that use communication processing with other devices. In this way, those that handle music content are summarized. By preparing a menu screen, the user can use a plurality of application programs that handle music contents without consciously distinguishing them from each other.
Communication methods with other devices include a wired connection using USB and a wireless connection using WLAN. Further, as described above, the wireless connection using WLAN includes an ad hoc mode and an infrastructure mode.
Here, the processing when each menu of the menu screen 501 of FIG. 18 is selected and determined will be described.
When Music Search 631 is selected and determined on the menu screen 501 of FIG. 18, the music search application of the application layer shown in FIG. 12 is started, the search screen 511 is displayed as shown in FIG. By inputting a desired search key into the input unit 512, music data can be selected.
When the user inputs a desired search key into the text input unit 512 and presses the enter button 27, the music search application running on the application processor 131 is supplied from the keyboard module 149 to the audio processor 132. Supply the searched key.
The audio processor 132 uses the music DB function to search for titles, album names, and artist names that include the supplied search key, and uses the application processor to search the search results (for example, the music name). Supply to 131.
As shown in FIG. 19, the music search application running on the application processor 131 displays the search result (for example, the music name) in the search result display area 513 of the search screen 511.
The user uses the four-way key 26 to move the cursor 514 to one of the search results (for example, the music name) in the search result display area 513 of the search screen 511, and uses the enter button 27 to move the cursor. When the search result (for example, the music title) selected by 514 is selected and determined, the audio player shown in FIG. 12 is started in the application processor 131, the audio processor 132 is controlled as necessary, and the user controls the audio processor 132. The selected and determined music data is played back and output. That is, the audio processor 132 starts the reproduction processing of the selected and determined music data by using the function of the audio player.
FIG. 20 shows a music data reproduction display screen 512 displayed on the display unit 21 of the information communication terminal 1 during music data reproduction. The music data playback display screen 512 displays information about the content, such as the title name of the music data, the artist name, the album name, or the thumbnail image of the jacket of the album or the like.
Returning to FIG. 18, when Streaming632 is selected and determined while the WLAN ad hoc mode is ON on the menu screen 501, the music streaming shown in FIG. 12 is activated and the streaming is started.
Here, communication in the ad hoc mode will be described with reference to FIGS. 21 to 23.
As shown in FIG. 21, each of the information communication terminals 1-1 to information communication terminals 1-5 owned by users A to E, which are within the range where ad hoc communication is possible, themselves (information communication) in the ad hoc mode. Broadcast (ie, specific) information specific to (ie, essentially unchanged) information about terminal 1) and information about itself (ie, time-dependent) about the current situation of itself (information and communication terminal 1). Send (to all devices within the communication range) instead of deciding the destination. FIG. 22 shows an example of information transmitted by the information communication terminal 1 in the ad hoc mode by broadcasting.
The information communication terminal 1 in ad hoc mode is currently playing a song such as its own station's IP address and port number, device-specific ID, profiled User ID, connection availability information such as Busy or Ready, song title, artist name, etc. (Now Playing song) information, information necessary for stream playback when it is copyright-protected song data such as Sequence Number + Object Handle of the song being played, other information such as playback operation status, input by the user Broadcast information such as text memos.
Of these, the IP address and port number of the own station, the device-specific ID, and the profile-set User ID are basically unchanged information, and are currently playing song (Now Playing song) information and playing song. Information necessary for stream playback when is copyright-protected music data, other information such as playback operation status, etc. differs depending on the time, and information such as text memos entered by the user is basic. It is not changed to, but it is information that can be changed when the user changes the registered contents.
Each of the information communication terminals 1-1 to information communication terminals 1-5 owned by users A to E in FIG. 21 acquires the information shown in FIG. 22 from other devices, and each of the other information communication terminals. Whether or not 1 is a device owned by a user registered as a communication partner in ad hoc mode, the communication status with another information communication terminal 1 owned by a user registered as a communication partner in ad hoc mode, and Recognize information about users of other unregistered information communication terminals 1 that exist within the range where ad hoc communication is possible.
Like the information communication terminals 1-4 and the information communication terminals 1-5 in FIG. 21, in order to be able to perform file transfer and music data streaming, it is necessary for each other to register the device of the other party.
For example, when an unregistered user requests registration, the information shown in FIG. 23 is mutually exchanged and registered as a communication partner.
In the example of FIG. 23, for example, a device-specific ID, a profile-set User ID, text data entered by the user for registration, such as the URL of his / her own homepage or self-introduction text, display on the standby screen, etc. The image data used for the face icon (needless to be not the actual user's face photo data) to be displayed, and the user as the display color of the wallpaper of the display unit 21 during the communication process with the user. It is preferable that the set user color information, an ID used in a communication application (for example, a tool such as chat or IP phone), an ID of an instant messenger, and the like are included.
It should be noted that even information communication terminals 1 owned by unregistered users can send a message to other information communication terminals existing within the communicable range. The wireless communication module 148 of the information communication terminal 1 sends, for example, a message prompting mutual user registration to the information communication terminal 1 of the other party, and after mutual consent, provides information as shown in FIG. 23. It sends and receives and supplies the received information to the application processor 131. The application processor 131 supplies the supplied information to the flash memory 146 connected to the application processor 131, or the flash memory 156 or the large-capacity flash memory 154 connected to the audio processor 132, and in the ad hoc mode. , Registered as information about the information communication terminal 1 held by the user registered as a communication partner capable of executing file exchange, streaming, and the like.
The information communication terminals 1 registered as communication partners capable of executing file exchange and streaming in the ad hoc mode are as shown in the information communication terminals 1-4 and the information communication terminals 1-5 shown in FIG. You can always communicate one-on-one, exchange files, and perform streaming playback.
In this way, communication is performed in the ad hoc mode.
FIG. 24 shows an example of the ad hoc user list display screen 521 displayed when Streaming 632 is selected and determined while the WLAN ad hoc mode is ON on the menu screen 501 of FIG.
On the ad hoc user list display screen 521, whether the communication status with another information communication terminal 1 owned by the user registered as the communication partner in the ad hoc mode is the "online state" in which communication is possible, or here. It is displayed whether it is in the "Offline state" where communication is not possible because it is not in, or the "Busy state" where communication is not possible because it is communicating with another device, and it is ad hoc. The "Unknown state" is displayed as the state of another unregistered information communication terminal 1 that exists within the communication range.
That is, FIG. 24 shows a display example of the ad hoc user list display screen 521 when user A in the example of FIG. 21 has registered user B, user Z, user D, and user E as communication partners. User B is in the Online state, User Z is in the Offline state, User D is in the busy state while communicating with another device, and User E is in the communication with another device. Information indicating that the user is busy and that the unregistered user C is within the ad hoc communication range is displayed.
For example, when "User B" in the Online state is selected and determined on the ad hoc user list display screen of FIG. 24, the connection between the information communication terminal 1 used by the "User B" in the Online state and the streaming is confirmed. , Public playlists (lists of at least some of the songs held internally) that are allowed to be published on the air are exchanged with each other. Then, based on the public playlist of user B received from the communication terminal 1 of user B and the Now Playing information among the broadcast information, user B is currently playing back as shown in FIG. 25. The public playlist list display screen 531, which is a list of the songs inside (that is, Now Playing) and the public playlist, is displayed.
Then, for example, when the playlist desired by the user is selected and determined from the public playlist list display screen 531 of the user B in FIG. 25, the playlist is included in the selected playlist as shown in FIG. The track display screen 541 that displays a list of music data, in other words, music tracks, is displayed. The user can receive and play the music data selected and determined by the user B by selecting and determining the desired music track displayed on the track display screen 541.
Specifically, the music stream application executed in the application processor 131 of the information communication terminal 1-1 receives a signal indicating the user's operation input from the input module 150, and the playlist and music data selected and determined by the user. The information for designating the above is controlled by the wireless communication module 148 and supplied to the information communication terminal 1-2 owned by the user B.
At this time, the connection permission request from the user A may or may not be displayed on the display unit 21 of the information communication terminal 1-2 owned by the user B.
The music stream application executed in the application processor 131 of the information communication terminal 1-2 transmits the playlist and music data selected and determined by the user supplied from the information communication terminal 1-1 via the wireless communication module 148. Provides information to specify to the audio processor 132. The audio processor 132 reads the music data (stream data) managed by the music DB from the large-capacity flash memory 154, supplies it to the application processor 131, controls the wireless communication module 148, and controls the information communication terminal 1-. Send to 1.
Then, the music stream application executed in the application processor 131 of the information communication terminal 1-1 processes the music data (stream data) supplied from the information communication terminal 1-2 via the wireless communication module 148 as an audio signal. It is supplied to the module 152, and the audio signal processing module 152 is controlled by using the function of the audio cordic to perform the decoding process and the DA conversion process, and the ringer speaker 42 reproduces and outputs it, or it is attached to the connector jack 52. Playback output from headphones.
At this time, the music data reproduction display screen 512 shown in FIG. 20 is displayed on the display unit 21 of the information communication terminal 1-1 during stream reproduction. On the music data playback display screen 512, in addition to information related to the content such as the title name of the music data, the artist name, the album name, or the thumbnail image of the jacket of the album or the like, the source of the streaming data ( Here, information about the user B) may be displayed.
Returning to FIG. 24, on the ad hoc user list display screen, when an unregistered user such as user C in user A is selected and decided in the ad hoc mode, a message confirming mutual registration processing with this user is displayed. When a dialog is displayed and the user approves this, the mode shifts to the registration mode, and the information shown in FIG. 23 is exchanged with each other and registered.
In this way, communication processing is performed when Streaming 632 is selected and determined on the menu screen 501 of FIG.
When Now Playing 633 is selected on the menu screen 501, the audio player shown in FIG. 12 is activated in the application processor 131, and if necessary, the audio processor 132 is controlled to play the music data desired by the user. Output. That is, the audio processor 132 starts the reproduction processing of the selected and determined music data by using the function of the audio player.
The audio processor 132 uses the function of the music DB to obtain a list of music data recorded in the large-capacity flash memory 154 or a file structure (even if it is an actual file structure, it has a virtual file structure. Generates information indicating (may be) and supplies it to the application processor 131. The application processor 131 uses the graphics library to display a list of music data recorded in the large-capacity flash memory 154 or information indicating a file structure on the display unit 21. The user refers to the data displayed on the display unit 21 and performs an operation input for selecting and determining desired music data.
The audio processor 132 reads the music data selected and determined from the music data managed by the music DB from the large-capacity flash memory 154, supplies it to the audio signal processing module 152, and uses the function of the audio cordic. , The audio signal processing module 152 is controlled to perform decoding processing and DA conversion processing to reproduce and output from the ringer speaker 42, or to reproduce and output from headphones or the like attached to the connector jack 52.
At the time of reproducing the music data, the music data reproduction display screen 512 similar to the case described with reference to FIG. 20 is displayed.
Returning to FIG. 18, when All Tracks 634 is selected on the menu screen 501, a list of all tracks recorded in the large-capacity flash memory 154 is displayed on the display unit 21.
When My Playlist 634 is selected on the menu screen 501 of FIG. 18, a list of contents such as music data created based on the user's operation input is displayed.
When each menu of the menu screen 501 of FIG. 18 is selected and determined in this way, a predetermined process is executed.
As described above, on the HOME screen 451 of FIG. 13, a predetermined process is executed when the communication application (Communication) 461, the web browser (WEB Browser) 462, and the music tool (Music) 463 are selected and determined.
Next, a specific example of a shortcut to a function running in the background when various applications as described above are started alone or in multiples and a plurality of functions are running at the same time will be described. ..
For example, it is assumed that both the audio player and the instant messenger in the infrastructure mode of the WLAN are activated, and the communication function in the instant messenger and the playback function by the audio player are executed at the same time. It is assumed that the HOME screen 451 shown in FIG. 13 is displayed on the display unit 21.
At this time, when the INFO button 11 is pressed once by the user, the HOME screen 451 contains information according to the communication state of the communication function in the instant messenger at that time, as shown by the arrow A in FIG. 27. The panel (hereinafter referred to as the communication INFO panel for IM) 801-1A is superimposed and displayed.
Then, in the state where the communication INFO panel 801-1A for IM is superimposed and displayed on the HOME screen 451 in this way, when the INFO button 11 is pressed again, as shown by arrow B, for IM. Instead of the communication INFO panel 801-1A, the INFO panel (hereinafter referred to as the playback INFO panel) 801-2 containing information about the music being played is superimposed and displayed.
Further, it is assumed that, for example, music streaming in the ad hoc mode of WLAN is activated this time, and the communication function and the streaming playback function in the ad hoc mode are executed at the same time. It is assumed that the HOME screen 451 shown in FIG. 13 is displayed on the display unit 21.
At this time, when the INFO button 11 is pressed once by the user, the HOME screen 451 contains information according to the communication state of the communication function in the ad hoc mode at that time, as shown by the arrow C in FIG. 27. The panel (hereinafter referred to as the communication INFO panel for ad hoc mode) 801-1B is superimposed and displayed.
Then, in the state where the communication INFO panel 801-1B for ad hoc mode is superimposed and displayed on the HOME screen 451 in this way, when the INFO button 11 is pressed again, ad hoc as shown by arrow D. Instead of the communication INFO panel 801-1B for the mode, the playback INFO panel 801-2 containing information about the music being streamed is superimposed and displayed.
For example, when the audio player is started and only the playback function is executed, when the INFO button 11 is pressed once, the INFO panel 801-1C indicates that the WLAN is turned off as shown by the arrow E. Is displayed.
Also in this case, when the INFO button 11 is pressed again, as shown by the arrow F, the playback INFO panel 801-2 showing information about the music being played is superimposed instead of the INFO panel 801-1C. Is displayed.
Communication INFO panel 801-1A for IM, communication INFO panel 801-1B for ad hoc mode, or INFO panel 801-1C (hereinafter, if it is not necessary to distinguish these individually, they are simply communicated together INFO panel Instead of the playback INFO panel 801-2 (hereinafter referred to as 801-1), the playback INFO panel 801-2 (hereinafter, simply referred to as INFO panel 801 when it is not necessary to distinguish between the communication INFO panel 801-1 and the playback INFO panel 801-2) When the INFO button 11 or the BACK button 24 is operated after the display, the INFO panel 801 is returned to the hidden state (that is, the INFO panel 801 is erased) as shown by the arrow G.
When the BACK button 24 is operated while each communication INFO panel 801-1 is displayed, the previous state, that is, the non-display state of the INFO panel 801 is shown by arrows H, I, and J. Return to.
When the INFO button 11 is pressed in this way, the communication INFO panel 801-1 or the playback INFO panel 801-2 is displayed, but at the same time, the input from the input device such as the 4-way key 26 is the migration destination. Assigned to a function.
When the INFO panel 801 is not displayed, for example, the input from the 4-direction key 26 is assigned to the menu selection process on the HOME screen 451 and the predetermined menu is selected and determined according to the input, but the INFO button 11 is pressed. When pressed once and the communication INFO panel 801-1 is displayed, the input from the given input device is assigned to the operation on the communication INFO panel 801-1, i.e. the communication function, for example from the 4-way key 26. The communication function is controlled according to the input.
Further, when the INFO button 11 is pressed and the playback INFO panel 801-2 is displayed, the input from the predetermined input device is assigned to the operation on the playback INFO panel 801-2, that is, the playback function, for example, four directions. The playback process is controlled according to the input from the key 26.
Each INFO panel 801 displayed in the example of FIG. 27 can be automatically deleted if the INFO button 11 or the like is not operated within a predetermined time.
FIG. 28 shows a functional configuration example of the application manager (FIG. 12) of the application processor 131 (FIG. 11) when executing a process (hereinafter referred to as a shortcut process) corresponding to such an operation of the INFO button 11. Shown.
The shortcut operation input acquisition unit 901 is the INFO button 11 or the BACK button received by the input module 150 when the function targeted by the shortcut (communication function and playback function in the example of FIG. 27) is being executed. The operation input from 24 is acquired as a shortcut operation, and the acquisition result is supplied to the shortcut control unit 902.
The shortcut control unit 902 controls each unit according to the content of the shortcut operation supplied from the shortcut operation input acquisition unit 901 (in the example of FIG. 27, depending on whether the INFO button 11 or the BACK button 24 is operated). Control.
The communication status acquisition unit 903 acquires the communication status of the communication function currently being executed (for example, the communication function at the time of starting the communication application, music streaming, or instant messenger) under the control of the shortcut control unit 902, and shortcuts. Supply to control unit 902.
The playback state acquisition unit 904 acquires the playback state of the playback function currently being executed (for example, the playback function when the audio player or music streaming is started) under the control of the shortcut control unit 902, and the shortcut control unit 902 Supply to.
Under the control of the shortcut control unit 902, the INFO panel generation unit 905 generates the INFO panel 801 according to the shortcut operation and the communication state or the playback state, and supplies the INFO panel 801 to the display module 142.
Under the control of the shortcut control unit 902, the operation input allocation unit 906 allocates the input from a predetermined input device such as the 4-way key 26 to the communication function or the playback function, or cancels the allocation, in response to the shortcut operation. To do.
Next, a specific example of the shortcut processing in the example of FIG. 27 will be described with reference to FIGS. 29 to 38.
First, when both the audio player and the instant messenger in the infrastructure mode of WLAN are activated and the communication function by the instant messenger and the playback function by the audio player are executed at the same time, the shortcut to the communication function by the instant messenger is executed. A specific example will be described (arrow A in FIG. 27).
When the INFO button 11 is pressed when the communication status in the communication function by instant messenger is, for example, an event in the logged-in communication tool is occurring, as shown in FIG. 29A, for each e-mail service. E-mail information 811 indicating the number of unread e-mails, etc., and for each unprocessed event (for example, chat), an icon representing a communication tool, an icon indicating the content of the event, the ID of the communication partner, and the time when the event occurred. Communication INFO panel 801-1A for IM including event information 812 such as is displayed.
In the case of this example, the information about the newly generated event of the event information 812 (in the example of FIG. 29A, the information at the top of the event information 812) has a flag icon indicating that the event has newly occurred. Is displayed.
When an event occurs, as shown in FIG. 30, a flag icon indicating that the event has occurred is displayed in the communication use application status display area 204 of the constant display panel 101, so that the user can use that icon. Is displayed on the constant display panel 101, and if the INFO button 11 is pressed, the communication INFO panel 801-1A for IM shown in FIG. 29A can be displayed, so check the newly generated event. Can be done.
Also, when the INFO button 11 is pressed in the communication state where no new event has occurred (that is, when the flag icon is not displayed on the constant display panel 101), when there is an unprocessed event, , Event information 812 for outstanding events is displayed, as shown in Figure 29B, and when there are no outstanding events, message 813 is displayed to the effect that no events exist, as shown in Figure 29C. To.
When the INFO button 11 is pressed in this way, the communication INFO panel 801-1A for IM according to the communication status is displayed, but at the same time, the input from a predetermined input device such as the 4-way key 26 is displayed. It is assigned to the communication function by the instant messenger, and the instant messenger is controlled in response to the input from the 4-way key 26, for example.
For example, by operating the four-way key 26, information about the event at the top of the event information 812 in FIG. 29A can be selected and determined, GUI814 as shown in FIG. 31A is displayed, and the GUI814 is responded to. Events can be processed by entering a message and confirming the input. After that processing, for example, as shown in FIG. 31B, the contact list 815 in the communication tool is displayed.
In this way, by operating the INFO button 11, it is possible to shortcut to the communication function in the infrastructure mode.
Next, a specific example will be described when a shortcut to the communication function in the ad hoc mode is performed when, for example, music streaming in the ad hoc mode of the WLAN is activated and the communication function and the playback function in the ad hoc mode are executed at the same time (. Arrow C in Figure 27).
When the INFO button 11 is pressed when the communication status in the communication function in the ad hoc mode is the state in which the event of receiving the registration request is occurring, a message indicating that the registration request has been made, as shown in FIG. 32A, is displayed. The communication INFO panel 801-1B for ad hoc mode is displayed, which includes a 821 and a button 822 to access the event.
When an event occurs, as shown in FIG. 33, an icon indicating that an event in ad hoc mode communication has occurred is displayed in the communication use application status display area 204 of the constant display panel 101, so that the user can use it. , When the icon is always displayed on the display panel 101, if the INFO button 11 is pressed, the information corresponding to the event that has occurred can be confirmed.
Also, when the INFO button 11 is pressed when the communication status is such that an event that a file is being transferred from another information communication terminal 1 is occurring, the file is being transferred as shown in FIG. 32B. A message 831 to that effect and a communication INFO panel 801-1B for ad hoc mode containing a button 832 to access the event are displayed.
Further, when the INFO button 11 is pressed while the communication state is the state in which the event that the music from the other information communication terminal 1 is being streamed is occurring, that fact is shown in FIG. 32C. The communication INFO panel 801-1B for ad hoc mode is displayed, which includes streaming information 841 indicating. In the streaming information 841, a face icon (FIG. 23) registered as registration information of the other information communication terminal 1 of the streaming source is displayed.
In addition, when the INFO button 11 is pressed when the communication state is in the state where the event that the other information communication terminal 1 is streaming and playing the music provided by itself is occurring, FIG. 32D shows. As a result, the communication INFO panel 801-1B for ad hoc mode containing the streaming information 851 indicating that fact is displayed. In the streaming information 851, a face icon registered as registration information (own registration information) of the information communication terminal 1 of the streaming source is displayed.
If the INFO button 11 is pressed in the communication state that no event has occurred, the communication INFO panel 801-1B for ad hoc mode including the carry-on information 861 is displayed as shown in FIG. 32E. .. In the case of this example, the carry-on information 861 contains information published in ad hoc mode.
When the button 11 is pressed in this way, the communication INFO panel 801-1B for ad hoc mode according to the communication status is displayed, but at the same time, the input from a predetermined input device such as the 4-way key 26 is displayed. It is assigned to the communication function in the ad hoc mode, and the communication in the ad hoc mode is controlled in response to the input from the four-way key 26, for example.
For example, when the button 822 of FIG. 32A is operated, as shown in FIG. 34, a GUI 823 for registering the other party requesting registration is displayed, and the registration process can be performed using the GUI 823.
In this way, by operating the INFO button 11, it is possible to shortcut to the communication function in the ad hoc mode.
Next, a specific example of a shortcut to the playback function will be described (arrows B, D, F in FIG. 27).
In the case of this example, when the communication INFO panel 801 is displayed, the operation input from a predetermined input device is assigned to the communication function, the communication function is shortcut, and then the INFO panel 11 is further pressed, for example, FIG. 35. The playback INFO panel 801-2 shown in is displayed.
The reproduction INFO panel 801-2 is configured to include, for example, information according to the reproduction state such as a title name of music data, an artist name, an album name, or a thumbnail image of a jacket of an album or the like. Note that this information is basically the same as the information displayed on the music data playback display screen 512 shown in FIG.
Even when the playback function is not performed, the playback INFO panel 801-2 is displayed in response to the operation of the INFO button 11. In this case, the contents of the INFO panel 801-2 are as shown in FIG. It will be blank.
Also, even if the music being played is stored locally (for example, even if it is stored in the large-capacity flash memory 154 of FIG. 11), it is being streamed. However, basically, the same playback INFO panel 801-2 is displayed, but the music being played is stored locally, or it receives streaming from another information communication terminal 1. You can also display the playback INFO panel 801-2 to show what you have.
For example, the communication INFO panel 801-1B for ad hoc mode (the same communication INFO panel 801 as FIG. 32C) including the streaming information 841 indicating that the music provided from the other information communication terminal 1 is being streamed, as shown in FIG. 37A. When the INFO button 11 is further pressed while -1B) is displayed, it is assumed that the playback state is the streaming playback state, and as shown in FIG. 37B, the upper half of the playback INFO panel 801-2. It is possible to display the playback INFO panel 801-2 in which the area 851 is the color represented by the user color information (FIG. 23) registered as the registration information of the information communication terminal 1 of the streaming source. In the case of this example, the area 852 is the color represented by the user color information (FIG. 23).
Also, if you are playing something that is stored locally, it is assumed that the playback state is that you are playing a song that is stored locally, and the user color information that is registered as your own registration information. The playback INFO panel 801-2 with the color represented by (Fig. 23) can be displayed.
For ad hoc mode including when the music is provided to another information communication terminal 1 for streaming playback, that is, the streaming information 851 indicating that the music provided by oneself is being streamed as shown in FIG. 38A. When the INFO button 11 is pressed further while the communication INFO panel 801-1B (same communication INFO panel 801-1B as in Fig. 32D) is displayed, it is not information about one's own playback, but as shown in Fig. 38B. It is also possible to display the playback INFO panel 801-2 showing the playback information of the streaming destination.
When the INFO button 11 is pressed in this way, the playback INFO panel 801-2 according to the playback status is displayed, but at the same time, the input from a predetermined input device such as the 4-way key 26 is displayed in the playback function. It is assigned, and the reproduction process is controlled according to the input from, for example, the four-way key 26.
In this way, by operating the INFO button 11, it is possible to shortcut to the playback function.
Next, the operation of the application manager (FIG. 28) when executing the shortcut process will be described with reference to the flowchart of FIG. 39. Note that this shortcut process is performed when a plurality of predetermined functions are executed at the same time, and in this example, it is assumed that the wireless communication function and the playback function are executed at the same time.
In step S1, the shortcut operation input acquisition unit 901 waits until the operation input to the INFO button 11 is received by the input module 150 (that is, until the INFO button 11 is pressed), and when the INFO button 11 is pressed. , Notify the shortcut control unit 902 to that effect, and proceed to step S2.
In step S2, the shortcut control unit 902 determines whether or not the wireless communication function of the information communication terminal 1 is enabled, and if it is determined that the wireless communication function is enabled, the process proceeds to step S3.
Specifically, the shortcut control unit 902 determines, for example, whether or not the ON operation of the WLAN ON / OFF switch 30 is accepted by the input module 150, and if it is determined that the operation is accepted, step S3. Proceed to.
In step S3, the shortcut control unit 902 detects whether the WLAN application is in infrastructure mode or ad hoc mode, and in step S4, acquires the communication status in that mode.
Specifically, at this time, the communication status acquisition unit 903 detects and detects an application (for example, a communication application, a streaming application, or an instant messenger) that is currently running and realizes a wireless communication function. Access the application, acquire the communication status of the communication function being executed (for example, that a predetermined event has occurred), and supply it to the shortcut control unit 902.
The shortcut control unit 902 supplies the communication status of the executed communication function supplied from the communication status acquisition unit 903 to the INFO panel generation unit 905.
In step S5, the IMFO panel generation unit 905 generates the communication IMFO panel 801-1 according to the communication state of the communication function being executed, which is supplied from the shortcut control unit 902, and supplies the communication IMFO panel 801-1 to the display module 142. As a result, the display module 142 displays the communication INFO panel 801-1 supplied from the INFO panel generation unit 905 on the display unit 21 (arrows A, C, E in FIG. 27).
In step S6, the shortcut control unit 902 controls the operation input allocation unit 906 to allocate the operation input from the predetermined input device received by the input module 150 to the communication function currently being executed. That is, the operation input received by the input module 150 is supplied to the application executing the function. If the communication function has already been executed and the operation input from the predetermined input device is assigned to the communication function, the operation input from the predetermined input device is continuously assigned to the communication function.
By supplying the operation input to the application that realizes the communication function in this way, the user can use the communication function that is currently being executed by operating the input device.
Next, in step S7, the shortcut operation input acquisition unit 901 determines whether or not the operation input to the BACK button 24 is accepted by the input module 150 (that is, the BACK button 24 is operated), and is operated. If not, the process proceeds to step S8, and it is determined whether or not the INFO button 11 is further pressed.
When it is determined in step S8 that the INFO button 11 has not been pressed further, the process returns to step S7, and the subsequent processing is performed in the same manner.
When it is determined in step S2 that the wireless communication function of the information communication terminal 1 is not enabled, or when it is determined in step S8 that the INFO button 11 is further pressed, the process proceeds to step S9, and the shortcut control unit The 902 acquires the playback state of the currently executed playback function.
Specifically, at this time, the playback state acquisition unit 904 detects an application (for example, a streaming application or an audio player) that realizes the playback function that is currently started, and accesses and plays back the detected application. Acquires the state (for example, the locally stored music such as the name of the music being played is being played, and streaming playback is being performed), and supplies the status to the shortcut control unit 902.
The shortcut control unit 902 notifies the INFO panel generation unit 905 of the reproduction state of the execution function supplied from the reproduction state acquisition unit 904.
In step S10, the IMFO panel generation unit 905 generates a playback IMFO panel 801-2 according to the playback state of the playback function being executed, which is supplied from the shortcut control unit 902, and supplies the playback IMFO panel 801-2 to the display module 142. As a result, the display module 142 displays the reproduced INFO panel 801-2 supplied from the INFO panel generation unit 905 on the display unit 21 (arrows B and D in FIG. 27). The display processing of the INFO panel 801-1C in the example of FIG. 27 is omitted.
In step S11, the shortcut control unit 902 controls the operation input allocation unit 906 to allocate the operation input from the predetermined input device received by the input module 150 to the playback function currently being executed. That is, the operation input received by the input module 150 is supplied to the application executing the reproduction function.
By supplying the operation input to the application that realizes the playback function in this way, the user can use the playback function by operating the input device.
In step S12, the shortcut operation input acquisition unit 901 determines whether or not the INFO button 11 or the BACK button 24 has been operated, and waits until any of the buttons is operated.
When it is determined that the BACK button 24 has been operated in step S7, or when it is determined that the INFO button 11 or the BACK button 24 has been operated in step S12, the process proceeds to step S13, and the shortcut control unit 902 generates an INFO panel. Control the display module 142 through section 905 to erase the INFO panel 801 displayed in step S5 or step S10 (ie, return to the hidden state of the INFO panel 801) (arrows H, I, in FIG. 27). J, or arrow G).
The shortcut control unit 902 also controls the operation input allocation unit 906 to release the allocation (step S6 or step S11) of the communication function or the reproduction function of the operation input from the input device received by the input module 150. As a result, for example, the operation input is assigned to the operation process on the HOME screen 451. Therefore, the user can operate the HOME screen 451 by operating the input device.
After returning to the hidden state of the INFO panel 801 in step S13, the process returns to step S1 and the subsequent processing is performed in the same manner.
As described above, the shortcut process is executed.
In the above description, the case where the wireless communication function and the playback function are executed at the same time and the shortcut is made to either the wireless communication function or the playback function has been described as an example, but the present invention can be applied to other functions as well. ..
Next, another example of assigning operation input will be described.
When the information communication terminal 1 is used as a telephone, that is, when the communication application is started and the IP telephone function is executed, the operation input from the music key 35 is assigned to the volume of the IP telephone. It is assigned to the adjustment function.
When the user uses an IP telephone with the information communication terminal 1, as shown in FIG. 10, the user sets the information communication terminal 1 so that the positions of the speaker 28 and the microphone 29 of the information communication terminal 1 correspond to the positions of the ears and the mouth. Will have. That is, at this time, the positional relationship between the finger of the user's left hand and each input device of the information communication terminal 1 is as shown in FIG. 40. Therefore, the position of the music key 35 on the side surface in the longitudinal direction of the main body is The position is easy to operate with the thumb of the left hand. When held by the right hand, the position is easy to operate with the index finger, middle finger, etc. of the right hand, although the illustration is omitted.
Therefore, when using an IP phone on the information communication terminal 1, the user can easily adjust the volume of the call by assigning the operation input from the music key 35 to the volume adjustment function of the IP phone. become.
It is possible to provide a separate volume control button when using an IP phone, but for example, if there is no space to newly provide such a button, the music key 35 can also be used as a volume control button in this way. If set to, the volume can be adjusted without providing a separate button, and if the music key 35, which is in a position that is easy to operate when using an IP phone, is used for the volume adjustment, information communication is performed during the volume adjustment. You can easily adjust the volume without changing the terminal 1.
The IP telephone service is a relatively new service, and its infrastructure is not yet fully equipped at present. Therefore, the volume of the call changes depending on the position where the user's information communication terminal 1 is used, and it is often difficult to hear the call. When the device of the other party of the call is a personal computer, the volume of the call may be reduced depending on the volume setting of the personal computer.
That is, since it is expected that the volume adjustment will be performed frequently when using the IP phone, it is possible to give the information communication terminal 1 a function that can easily adjust the volume when using the IP phone. It is especially useful as an IP phone terminal.
FIG. 41 shows a functional configuration example of the application manager of the application processor 131 when executing the process of allocating the input from the music key 35 to the volume adjustment process of the call during the IP phone when the IP telephone function is executed. Shown.
The IP telephone function detection unit 951 is used, for example, when the communication application (Communication) 461 on the HOME screen 451 in FIG. 13 is selected and determined and the execution of the IP telephone function is started, or when the execution of the IP telephone function is completed. Notify the operation input allocation unit 952 to that effect.
When the operation input allocation unit 952 receives a notification from the IP telephone function detection unit 951 that the execution of the IP telephone function has started, the operation input allocation unit 952 allocates the input from the music key 35 to the volume adjustment function in the IP telephone function.
The operation input allocation unit 952 also receives a notification from the IP telephone function detection unit 951 that the execution of the IP telephone function is completed after assigning the operation input from the music key 35 to the volume adjustment function in the IP telephone function. And, the IP telephone function of the input from the music key 35 is unassigned (that is, the input from the music key 35 is assigned to the function before the IP telephone function is assigned).
The series of processes described above can be executed by software or by using hardware built in to execute the series of processes described above. The software is, for example, a general-purpose computer in which the programs constituting the software can execute various functions by installing a computer embedded in the dedicated hardware or various programs. It is installed from a recording medium on a personal computer or the like.
As shown in FIG. 11, this recording medium is a magnetic disk (including a flexible disk) or an optical disk (CD-ROM (CD-ROM)) on which a program is recorded, which is distributed to provide a program to a user separately from a computer. Compact Disk-Read Only Memory), DVD (including Digital Versatile Disk)), optical magnetic disk (including MD (Mini-Disk) (trademark)), removable media 172 consisting of semiconductor memory, etc.
Further, in the present specification, the steps for describing a program recorded on a recording medium are not necessarily processed in chronological order, but also in parallel or in parallel or not necessarily in chronological order. It also includes processes that are executed individually.
In addition, in this specification, a system represents the whole apparatus composed of a plurality of apparatus.
The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.
<figref num="1">It is a figure for demonstrating an information communication system including an information communication terminal to which this invention is applied.</figref><figref num="2">It is a front outline drawing of an information communication terminal.</figref><figref num="3">It is an outline drawing of the back side (the side without a display part) of an information communication terminal.</figref><figref num="4">It is an outline drawing of the upper side surface (the side where the WLAN ON / OFF switch is provided) of an information communication terminal.</figref><figref num="5">It is an outline drawing of the right side (the side where the communication state notification light emitting part is provided) from the side where the display part of an information communication terminal is provided.</figref><figref num="6">It is an outline drawing of the left side (the side where the WLAN ON / OFF switch and the power switch are provided) facing from the side where the display part of the information communication terminal is provided.</figref><figref num="7">It is an outline drawing of the lower side surface (the side where a power switch and a music key are provided) of an information communication terminal.</figref><figref num="8">It is an external view when the housing is slid.</figref><figref num="9">It is a figure which shows the example of how to hold a user of an information communication terminal.</figref><figref num="10">It is a figure which shows the example of another way of holding an information communication terminal user.</figref><figref num="11">It is a block diagram which shows the internal structure example of an information communication terminal.</figref><figref num="12">It is a software stack diagram which shows the structure of the software executed in the application processor.</figref><figref num="13">It is a figure which shows the display example of a HOME screen.</figref><figref num="14">It is a figure for demonstrating the communication application top screen.</figref><figref num="15">It is a figure for demonstrating the contact list display screen.</figref><figref num="16">It is a figure for demonstrating the web browser menu screen.</figref><figref num="17">It is a figure for demonstrating the connection screen.</figref><figref num="18">It is a figure for demonstrating the menu screen.</figref><figref num="19">It is a figure for demonstrating the search screen.</figref><figref num="20">It is a figure for demonstrating the music data reproduction display screen.</figref><figref num="21">It is a figure for demonstrating communication in an ad hoc mode.</figref><figref num="22">It is a figure for demonstrating an example of the information which an information communication terminal of an ad hoc mode transmits by a broadcast.</figref><figref num="23">It is a figure for demonstrating an example of the user information exchanged when mutual registration is performed as a communication partner.</figref><figref num="24">It is a figure for demonstrating the ad hoc user list screen.</figref><figref num="25">It is a figure for demonstrating the public playlist list display screen.</figref><figref num="26">It is a figure for demonstrating the track display screen.</figref><figref num="27">It is a figure explaining the outline of the shortcut process.</figref><figref num="28">It is a block diagram which shows the functional configuration example of the application manager when executing a shortcut process.</figref><figref num="29">It is a figure which shows the display example of a communication INFO panel.</figref><figref num="30">It is a figure which shows the other display example of the HOME screen.</figref><figref num="31">It is a figure explaining the use example of a communication INFO panel.</figref><figref num="32">It is a figure which shows the other display example of a communication INFO panel.</figref><figref num="33">It is a figure which shows the other display example of the HOME screen.</figref><figref num="34">It is a figure explaining the use example of another communication INFO panel.</figref><figref num="35">It is a figure which shows the display example of the reproduction INFO panel.</figref><figref num="36">It is a figure which shows the other display example of the reproduction INFO panel.</figref><figref num="37">It is a figure which shows the other display example of the reproduction INFO panel.</figref><figref num="38">It is a figure which shows the other display example of the reproduction INFO panel.</figref><figref num="39">It is a flowchart explaining the shortcut process.</figref><figref num="40">It is a figure which shows the example of how to hold a user when using an information communication terminal.</figref><figref num="41">It is a block diagram which shows the other functional configuration example of the application manager.</figref>
Code description
1 Information and communication terminal, 11 INFO button, 35 Music key, 131 Application processor, 132 Audio processor, 142 Display module, 150 Input module, 152 Audio signal processing module
42 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| JP2011097236A | Cited by | Japan | Examiner |
| JP2004304311A | Cites | Japan | Examiner |
| JP2005057315A | Cites | Japan | Examiner |
14 members in 4 offices
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 2006181915 | Japan | A | |
| JP20060181915 | – | – | – |
Members14
| Document | Office | Kind | |
|---|---|---|---|
| CN101098334A | China | A | |
| EP1873635A1 | European Patent Office (EPO) | A1 | |
| JP2008009896AThis record | Japan | A | |
| US2008106513A1 | United States of America | A1 | |
| JP5045983B2 | Japan | B2 | |
| US8416184B2 | United States of America | B2 | |
| US2013185637A1 | United States of America | A1 | |
| EP1873635B1 | European Patent Office (EPO) | B1 | |
| CN101098334B | China | B | |
| CN103491239A | China | A | |
| CN103491239B | China | B | |
| US9769229B2 | United States of America | B2 | |
| US2018007107A1 | United States of America | A1 | |
| US10511647B2 | United States of America | B2 |
21 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of no payment of annual feesLAPS | LAPS | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Written notification of patent or utility model registrationJAPANESE INTERMEDIATE CODE: R151R151 | R151 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Transfer to examiner for re-examination before appeal (zenchi)AppealJAPANESE INTERMEDIATE CODE: A911A911 | A911 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Decision of refusalJAPANESE INTERMEDIATE CODE: A02A02 | A02 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 2008009896
- Publication, DOCDB
- 2008009896
- Publication, EPODOC
- JP2008009896
- Application
- 181915
- Application, DOCDB
- 2006181915
- Application, EPODOC
- JP20060181915
Titles2
- Japanese
- 情報処理装置、情報処理方法、およびプログラム
- English
- Information processing equipment, information processing methods, and programs
Classification
- CPC, 15
- G06F1/1624
- H04L65/60
- G06F1/1671
- G06F1/1688
- G06F1/1698
- G06F3/0481
- H04M1/0235
- H04M1/2535
- G06F9/451
- H04M1/72412
- H04M1/72403
- H04M1/72436
- H04M1/72442
- H04M1/72445
- G06F3/165
- IPC, 7
- G06F3 048
- H04M1 00
- H04M1 72403
- H04M1 72412
- H04M1 72436
- H04M1 72442
- H04M1 72445