Portable information terminal unit

The present invention relates to a portable information terminal device.

In general, voice calls are the mainstream of calls on mobile phones that can be sent and received at the destination. In recent years, a mobile phone equipped with a digital camera and having a function of capturing a moving image or a still image has become widespread. Among these mobile phones with digital cameras, those capable of making a call using voice and a moving image or still image taken by the digital camera during a call have been developed. For example, a mobile phone with a videophone function (a mobile phone with a videophone function) See Patent Document 1).<patcit num="1"><text>Japanese Unexamined Patent Publication No. 10-65780</text></patcit>

<p> The mobile phone with a videophone function is a reasonably effective method in that it simply makes a call to the other party terminal by voice and video. However, when using a videophone, such as displaying the time of the videophone answering record that leaves the image and sound, displaying the screen showing each other's position information during the videophone call, or realizing the portrait right protection function of the videophone caller. It was not possible to realize a convenient function for this purpose.</p><p> In view of the above problems, an object of the first invention is mobile information that allows the call source to set permission / disapproval of call recording when recording a call by video or still image and voice at the call destination. To provide a terminal.</p><p> An object of the second invention is to provide a mobile information terminal that can be played back or displayed in an easy-to-understand manner when displaying an answering machine or each other's position information in a video or still image and voice call.</p>

<p> In order to solve the above problem, the invention according to claim 1 is a mobile information terminal device capable of communicating information with a specific communication destination, in which a recording means capable of recording communication information and the communication information communicate with each other. A communication record control signal transmitting means for transmitting a communication record control signal that is refused or permitted to be recorded in the destination mobile information terminal device to the communication destination mobile information terminal device, and a communication record control signal received from the communication destination. It is characterized by comprising a determination means for determining the content and a recording control means for controlling the recording operation of communication information on the recording means according to the result of the determination by the determination means.</p><p> The invention according to claim 2 comprises an imaging means, an image transmitting means capable of transmitting image information acquired by the imaging means, and the image information in a mobile information terminal device capable of communicating information with a specific communication destination. Alternatively, a recording means capable of recording communication information including call information, and a communication recording control signal transmitting means for transmitting a communication recording control signal indicating refusal or permission to record the communication information to the mobile information terminal device of the communication destination. A determination means for determining the content of the communication record control signal received from the communication destination, and a recording control means for controlling the recording operation of the communication information on the recording means according to the result of the determination by the determination means. It is characterized by being prepared.</p><p> The invention according to claim 3 is the invention according to claim 1 or 2, wherein the communication recording control signal includes a signal indicating refusal or permission to copy the communication information, and the recording means is used together with the communication information. It is characterized in that a control means for recording the communication recording control signal and controlling the transfer or duplication of the communication information based on the communication recording control signal is provided.</p><p> The invention according to claim 4 is the invention according to any one of claims 1 to 3, wherein the recording means adds and records the communication time information at the time of recording the communication information, and the recording means is used. It is characterized in that it is provided with a reproduction means for displaying the time information when the communication record is reproduced.</p><p> The invention according to claim 5 is a position confirmation means for confirming the current position of the mobile information terminal device by GPS during communication in a mobile information terminal device capable of communicating information with a specific communication destination, and the position. It is characterized by including a position information notification means for notifying a communication destination of position information by a confirmation means, and a position information display means for displaying the position information on a screen being communicated by the position information notification means.</p>

<p> According to the inventions of claims 1 to 3, when recording a video or still image and voice call (for example, a call on a videophone) at the call destination, permission / non-permission of recording of the call from the call source to the call destination. The portrait right of the caller can be protected by setting permission or permission / non-permission of transfer / reproduction of the record.</p><p> According to the invention of claim 4, by adding the time information to the call record at the time of recording the call, it is possible to confirm the time when the other party has made a call at the time of recording / reproducing the call.</p><p> According to the invention of claim 5, at the time of a video or still image and voice call, visual information such as the facial expression of the other party or the background in the vicinity of the other party's terminal taken by the camera and the position information are displayed at the same time. A mobile information terminal can be provided.</p>

[First Embodiment]

Hereinafter, the mobile information terminal device 1 according to the embodiment of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

FIG. 1 shows a front view of the mobile information terminal device 1 according to the embodiment of the present invention. As shown in FIG. 1, the mobile information terminal device 1 includes a display unit 13 that displays moving images or images and various information sent from the other party's terminal during a call, an operation unit 12 that receives an operation instruction from a user, and a call. Alternatively, it is provided with a camera unit 15 that captures a moving image or a still image according to a shooting instruction, an audio input / output unit 17 composed of a speaker and a microphone for making a call or recording.

Next, the internal configuration of the mobile information terminal device 1 will be described with reference to FIG. As shown in FIG. 2, the mobile information terminal device 1 includes a control unit 11, an operation unit 12, a display unit 13, a storage unit 14, a camera unit 15, an image processing unit 16, an audio input / output unit 17, and a communication unit 18. Each of these parts is connected to each other via a bus 19.

The control unit 11 includes a CPU (Central Processing Unit), an internal RAM (Random Access Memory), a ROM (Read Only Memory), and the like (not shown), and the CPU stores a predetermined area of the internal RAM as a work area in the ROM. According to various control programs, control signals are sent to each of the above parts to control the overall operation of the portable information terminal device 1.

Further, the control unit 11 selects a predetermined map based on the position information from the GPS circuit 22, which will be described later, and calculates the current position on the map based on the predetermined program.

The operation unit 12 includes various keys such as number keys, character keys, and function keys for inputting operation instructions for the personal digital assistant device 1, a small stick-shaped pointing device, and the like. By operating the operation unit 12 while referring to the screen displayed on the display unit 13, the user inputs various operation instructions for the mobile information terminal device 1 or a setting for permitting / disallowing call recording as a call recording setting means. To do.

The display unit 13 is composed of a liquid crystal display or the like, and displays an image on the display based on the display data input from the control unit 11.

The storage unit 14 is composed of a volatile memory, a magnetic / optical recording medium, a non-volatile memory, or the like, and stores various data such as an OS, various operation programs, or a map.

The camera unit 15 is composed of an optical lens made of glass or plastic, an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and an AFE (Analog Front End) (none of which is shown). ), When an instruction to shoot a moving image or a still image is input from the control unit 11, the image of the subject to be imaged on the image sensor is converted into an electric signal by the image sensor. Digital image data is generated by AFE and output to the control unit 11.

The image processing unit 16 is composed of an image DSP (Digital Signal Processor) or the like, performs various image processing such as pixel complementation of image data input from the control unit 11 or white balance adjustment, and outputs the image to the control unit 11. Further, the image processing unit 16 performs compression / decoding processing of the image data and outputs the image data to the control unit 11.

The voice input / output unit 17 includes a voice speaker, a microphone, and the like, outputs the user's voice and the like during a call to the control unit 11 as a voice input signal by the microphone, and outputs the voice output signal from the control unit 11 for the voice. It is output as audio by the speaker.

The communication unit 18 includes a wireless communication circuit 21, a GPS circuit 22, and a communication processing circuit 23, and wirelessly transmits and receives data or voice signals by a predetermined communication method.

The wireless communication circuit 21 is based on an analog signal from the communication processing circuit 23 described later, and is a GSM (Global System for Mobile communication) system, a GPRS (General Packet Radio System) system, or a PDC (Personal Digital Cellular). Not shown depending on the standards and communication methods of various mobile phones and wireless modems such as system, CDMA (Code Division Multiple Access) system, PHS (Personal Handyphone System) system, Bluetooth wireless communication system, wireless LAN (Local Area Network), etc. Data communication, call data, etc. are wirelessly transmitted and received between the wireless base station of the communication company and the communication antenna (not shown) provided in the mobile information terminal device 1, and the received analog signal is output to the communication processing circuit 23. To do. Further, the wireless communication circuit 21 receives signals indicating position information from a plurality of GPS satellites by a GPS antenna (not shown) and outputs the signals to the GPS circuit 22.

The GPS circuit 22 calculates the current position of the portable information terminal device 1 based on the signals indicating the position information from the plurality of GPS satellites, and outputs the current position information to the control unit 11.

The communication processing circuit 23 is composed of an AFE, a communication DPS, etc. (neither is shown), and decodes an analog received signal input from the wireless communication circuit 21 into various digital data such as communication data, image data, or voice data. After that, it is output to the control unit 11. Further, the communication processing circuit 23 performs processing such as compression on the various digital data input from the control unit 11, converts the digital data into an analog signal, and outputs the digital data to the wireless communication circuit 21.

Next, the call record control process for the purpose of protecting portrait rights in the mobile information terminal device 1 will be described with reference to the flowchart shown in FIG. The call recording restriction process described here includes steps A11 to A14 performed by the control unit 11 of the mobile information terminal device 1, and steps B11 to B18 performed by the control unit 11 of the mobile information terminal device 1a.

The mobile information terminal device 1 or the mobile information terminal device 1a starts a call by communicating audio data with a moving image or a still image according to an instruction from the user (steps A11 and B11). The call start instruction here may be from either the mobile information terminal device 1 or the mobile information terminal device 1a.

After step A11, the mobile information terminal device 1 confirms the value of the call record setting as the communication record control signal (step A12), and the call record setting is the mobile information according to step A13 as the communication record control signal transmission means. It is transmitted to the terminal device 1a, waits until the end of the call (step A14: No), and ends when the call ends (step A14: Yes).

Here, the call record setting is information indicating permission / non-permission of recording at the communication destination and information indicating permission / non-permission of transfer or duplication of the record in the case of permission.

After step A13, the mobile information terminal device 1a receives the call record setting (step B12), inputs the call record instruction by the user (step B13), and sets the call record setting by step B14 as the record control means. It is confirmed.

In step B14, if the call recording is disallowed (step B14: Yes), the display 13 displays that the call recording is disallowed (step B16), and then waits until the end of the call (step B16). Step B18: No), exit (Step B18: Yes).

Here, a display example in step B16 is shown in FIG. 6 (b). FIG. 6B is a diagram showing that the call recording is not permitted at the lower part of the screen where the upper body of the other party during the call is displayed on the display unit 13 of the mobile information terminal device 1a.

In step B14, if call recording is permitted (step B14: No), time information and call recording and recorded data are temporarily stored (step B15), and the call is continued until the end of call recording is instructed. The recording status is displayed and the device waits (step B17: No).

Here, FIG. 6A shows a display example in which the displayed call is being recorded. In FIG. 6A, the display indicating that the call is being recorded, the recording time, and the recording time are displayed at the lower part of the screen where the upper body of the other party during the call is displayed on the display unit 13 of the mobile information terminal device 1a. It is a figure.

When the end of the call recording is instructed in step B17, the storage of the data is ended, the data is stored as call data (step B17: Yes), and after waiting until the end of the call (step B18: No), exit (step B18: Yes).

The call data is stored in step B17 by adding information indicating permission / non-permission of record transfer or duplication. As a result, the transfer or duplication of the call record is controlled by determining the information at the time of the transfer or duplication of the record.

The call recording by the user here is performed by the mobile information terminal device 1a, but the present invention is not limited to this, and the call recording setting is transmitted on the mobile information terminal device 1a side and the mobile information terminal device 1 is used. The operation configuration may be such that call recording is performed.

As described above, the mobile information terminal device 1 or the mobile information terminal device 1a notifies the other terminal of the permission / disapproval of the call record or the permission / disapproval of the transfer / duplication of the record to make a call. By restricting recording, the portrait right of the caller can be protected.

Next, the answering machine record to which the time information is added in the portable information terminal device 1 will be described with reference to the flowchart of the answering machine record shown in FIG. 4 (a). Each process described here includes steps S11 to S16 performed by the control unit 11 of the personal digital assistant device 1.

The mobile information terminal device 1 waits for an incoming call from another terminal such as another mobile phone with a videophone function or a telephone with a videophone function (step S11: No). Here, when an incoming call is received from the other terminal (step S11: Yes), it is confirmed whether the setting is to record the answering machine after a predetermined time has elapsed (step S12), and the answering machine is recorded. If it is determined that the setting is not set (step S12: No), the process ends.

If it is determined in step S12 that the setting is to record an answering machine (step S12: Yes), after an incoming call from the other terminal is received and an announcement to record a predetermined answering machine is transmitted. , The recording of the call as the answering machine data and the storage of the recorded data in the memory are started (step S13), and after the time information is added to the answering machine data by the step S14 as the recording means, the call is made. It waits until the end (step S15: No).

In step S15, when the call is terminated (step S15: Yes), the answering machine data is saved (step S16), and the call is terminated.

Next, the reproduction of the answering machine record with the time information added in the personal digital assistant device 1 will be described with reference to the flowchart of the answering machine record reproduction shown in FIG. 4 (b). Each process described here includes steps S21 to S27 performed by the control unit 11 of the personal digital assistant device 1.

The mobile information terminal device 1 receives an answering machine playback instruction from the user (step S21), confirms the voicemail recording data and time information (step S22), and then starts the voicemail playback. (Step S23).

After step S23, step S24 as a playback means displays the time information on the playback screen based on the time information, and waits until the end of playback of the moving image (step S25: No).

Here, a display example in step S24 is shown in FIG. 6 (c). FIG. 6 (c) shows that the image of the upper body of the other party during a call recorded on the answering machine is being reproduced. Further, FIG. 6 (c) shows that the display indicating that the answering machine is being reproduced, the recording time, and the recording time are displayed at the lower part of the image at the time of reproducing the above recording.

In step S25, if the time display switching instruction is given (step S26: Yes) while waiting until the end of video playback, the time information display is switched (step S27).

In step S26, when the display switching instruction of the time information is not particularly given (step S26: No), the process waits until the end of the playback of the moving image and ends (step S25: Yes).

It should be noted that the addition of time information to the answering machine data or the display of the time information at the time of reproduction is an example of recording or reproduction of the call, and the time information is added to the call data at the time of normal call recording, and the above-mentioned The operation configuration may be such that time information is displayed, and is not particularly limited to answering machine recording or playback.

As described above, the mobile information terminal device 1 records the time information in the call data or the answering machine data at the time of call recording, and displays the time information together with the time information at the time of playback to confirm the time when the other party made a call. be able to.

[Second Embodiment]

With reference to FIG. 5, the operation of displaying the position information on each other of the mobile information terminal device 1b and the mobile information terminal device 1c according to the second embodiment will be described. For the sake of simplification, the same components as those of the mobile information terminal device 1 are designated by the same reference numerals and the description thereof is omitted, and the mobile information terminal device 1b and the mobile information terminal device have different configurations from the mobile information terminal device 1. Only the operation of 1c will be described.

The operation described here includes steps A21 to A28 performed by the control unit 11 of the mobile information terminal device 1b, and steps B21 to S26 performed by the control unit 11 of the mobile information terminal device 1c.

In the mobile information terminal device 1b or the mobile information terminal device 1c, a video or still image and voice call are started according to an instruction from the user (step A21, step B21). The call start instruction here may be from either the mobile information terminal device 1b or the mobile information terminal device 1c.

After step A21, the mobile information terminal device 1b inputs a display instruction of the current position (step A22), the mobile information terminal device 1c is requested to acquire the current position (step A23), and step A24 as a position confirmation means. After the current position is acquired by GPS, a map showing the current position with a predetermined marker or the like is displayed (step A25).

After step A23, the mobile information terminal device 1c acquires the current position by GPS (step B22), and displays a map showing the current position with a predetermined marker or the like (step B23).

After step A25 in the mobile information terminal device 1b and b step B23 in the mobile information terminal device 1c, the mobile information terminal device 1b and the mobile information terminal device 1c are present to each other by step A26 and step B24 as location information notification means. Information indicating the position is transmitted and received, and the current position of the other party's terminal is displayed on the map with a predetermined marker by steps A27 and B25 as the position information display means.

Here, a display example in step A27 or step B25 is shown in FIG. 6 (d). In Fig. 6 (d), the image of the other party's upper body during a call captured by the camera of the other party is displayed on the left side of the screen, the map showing each other's current position is displayed on the right side of the screen, and each on the map is displayed at the bottom of the screen. It is a figure which shows that the marker of is displayed.

In addition, although the configuration in FIG. 6 (c) is intended to display the upper body of the other party captured by the camera of the other party terminal, for example, a mark or a building in the vicinity of the target may be photographed, which is particularly limited. It's not a thing.

After step A27 in the mobile information terminal device 1b and step B25 in the mobile information terminal device 1c, in the mobile information terminal device 1b and the mobile information terminal device 1c, step A24 in the mobile information terminal device 1b until the mutual talk is terminated. ~ Each process of step A27 and each process of steps B22 to B25 in the mobile information terminal device 1c are executed (step A28: No, step B26: No), and the call is terminated (step A28: Yes, step). B26: Yes), exit.

The current position of the personal digital assistant 1b or the personal digital assistant 1c was acquired by GPS, but the plurality of positions based on the position information of a plurality of wireless base stations (not shown) and the radio wave intensity of the wireless communication circuit 21. It may be a method of calculating the position from the distance from the radio base station of.

Further, the selection of a predetermined map from the position information and the calculation of the current position on the map were performed by the control unit 11 using the map stored in the storage unit 14, but the calculation was performed by a terminal such as a server (not shown) by communication. The method may be used to notify the user, and the method is not particularly limited.

As described above, the mobile information terminal device 1b or the mobile information terminal device 1c notifies each other's position information during a videophone call, and displays an image taken by the camera and a map showing each other's position. This makes it easier to visually recognize each other's positions.

<figref num="1">It is a figure which shows the front appearance of the mobile information terminal apparatus in this invention.</figref><figref num="2">It is a figure which shows the internal structure of the mobile information terminal apparatus in this invention.</figref><figref num="3">It is a flowchart explaining the control process of the call record by the mobile information terminal device 1 and the mobile information terminal device 1a in the first embodiment.</figref><figref num="4">(a) is a flowchart for explaining the operation processing of the answering machine record to which the time information of the personal digital assistant device 1 is added in the first embodiment, and (b) is the mobile phone in the first embodiment. It is a flowchart explaining operation process of reproduction of the answering machine record of the information terminal apparatus 1.</figref><figref num="5">It is a flowchart explaining the operation process which displays the position information of each other by the mobile information terminal device 1b and the mobile information terminal device 1c in the second embodiment.</figref><figref num="6">(a) is a display example indicating that the call is being recorded displayed on the display unit 13 shown in FIG. 1, and (b) is a call recording disapproval displayed on the display unit 13 shown in FIG. (C) is a display example of the answering machine record displayed on the display unit 13 shown in FIG. 1, and (d) is a display example of the answering machine record displayed on the display unit 13 shown in FIG. This is a display example of a map showing the other party's image inside and the position information of each terminal.</figref>

Code description

1 Mobile information terminal device 11 Control unit 12 Operation unit 13 Display unit 14 Storage unit 15 Camera unit 16 Image processing unit 17 Voice input / output unit 18 Communication unit 19 Bus 21 Wireless communication circuit 22 GPS circuit 23 Communication processing circuit