Information processing apparatus and method

The present invention relates to an information processing device and a method, for example, an information processing device and a method in which information can be input by holding and rotating the entire device with one hand.

Conventionally, for example, in portable electronic devices such as electronic organizers, mobile phones, and pagers, buttons, pens, touch panels, and the like have been used as means for inputting information. For example, in an electronic organizer, one hand holds the device body, the other hand holds the pen, and the touch panel provided on the device body is operated with the pen to input predetermined information.

Further, in a mobile phone, a number key for inputting a telephone number and a function button corresponding to each function are provided so as to perform a predetermined operation. Pagers and the like are provided with the minimum necessary function buttons corresponding to each function, and these are operated.

<p> However, in the case of a portable device such as an electronic organizer that inputs information using a pen and a touch panel, one hand must hold the device body provided with the touch panel and the other hand must hold the pen. There was a problem that sometimes both hands were required and it was not easy to use. For example, it is difficult to operate with luggage in one hand.</p><p> Further, in a mobile phone or the like, there is a problem that a number key for inputting a telephone number requires a considerable space, which may hinder miniaturization.</p><p> The present invention has been made in view of such a situation, and it is intended to reduce the number of operation buttons and to make it easy to operate with one hand.</p>

<p> The information processing apparatus of the present invention includes a display means for displaying information and<u style="single">Input means for inputting operations from the user and</u>A map information storage means for storing map information composed of graphic data, a rotation angle detecting means for detecting displacement of the posture of the housing due to rotation of the entire housing, and generating displacement information corresponding to the detection result. A position detecting means that detects the current position and generates current position information corresponding to the detection result, a viewpoint position that determines the viewpoint position and the line-of-sight direction based on the displacement information and the current position information, and a viewpoint position. It is composed of a graphic data coordinate conversion means for converting the coordinates of the graphic data constituting the map information based on the line-of-sight direction and the coordinate-converted graphic data.<u style="single">For map information</u>On the basis of<u style="single">Map image</u>To generate<u style="single">Map image</u>Including means of generation<u style="single">Only, when a predetermined operation is continuously input from the user, the viewpoint position line-of-sight direction determining means determines the viewpoint position and the line-of-sight direction based on the displacement information and the current position information after the start of the operation, and the graphic data. The coordinate conversion means converts the coordinates of the graphic data constituting the map information based on the determined viewpoint position and the line-of-sight direction, and the map image generation means is based on the map information composed of the coordinate-converted graphic data. , Generates a first map image showing the area in the line-of-sight direction, the display means displays the generated first map image, and displays when the continuous input of a predetermined operation from the user is completed. The means displays a second map image showing the area in the line-of-sight direction at the end of the operation.</u>It is characterized by that.</p><p> The position detecting means can be made to detect the current position by using GPS.</p><p> Said<u style="single">Map image</u>Can be a bird's-eye view based on the viewpoint position and the line-of-sight direction.</p><p> The map information storage means can be a hard disk card.</p><p> The rotation angle detecting means can detect the rotation angles in the three axial directions orthogonal to each other.</p><p> The housing can be sized to be held by one hand.<u style="single"> When a predetermined operation is continuously input from the user, the viewpoint position line-of-sight direction determining means inputs the viewpoint position and the predetermined operation from the user based on the displacement information and the current position information after the start of the operation. The position is determined to be higher than the viewpoint position and the line-of-sight direction is determined, and the graphic data coordinate conversion means converts the coordinates of the graphic data constituting the map information based on the determined viewpoint position and the line-of-sight direction. However, the map image generation means includes at least a part of the map image of the current position and a preset movement destination based on the map information composed of the coordinate-transformed graphic data, and is in the line-of-sight direction. A first bird's-eye view map image indicating an area can be generated, and the display means can display the generated first bird's-eye view map image, and continuous input of a predetermined operation from the user is completed. In this case, the viewpoint position line-of-sight direction determining means gradually changes the viewpoint position to directly above the moving destination and the line-of-sight direction to directly below based on a preset moving destination, and the graphic data coordinate conversion means. Sequentially converts the coordinates of the graphic data constituting the map information based on the gradually changed viewpoint position and line-of-sight direction, and the map image generation means converts the map information composed of the sequentially coordinate-converted graphic data into the map information. Based on this, a second bird's-eye view map image indicating the movement destination can be sequentially generated, and the display means can display the sequentially generated second bird's-eye view map image.</u></p><p> The information processing method of the present invention<u style="single">When a predetermined operation is continuously input from the user, the viewpoint position and the line-of-sight direction are determined based on the displacement information and the current position information after the start of the operation, and the map is determined based on the determined viewpoint position and the line-of-sight direction. The coordinates of the graphic data constituting the information are converted, and the first map image showing the area in the line-of-sight direction is generated based on the map information composed of the coordinate-converted graphic data, and the generated first map is generated. Includes a step of displaying an image and displaying a second map image showing the area in the line-of-sight direction at the end of the operation when the continuous input of a predetermined operation from the user is completed.</u>It is characterized by that.</p><p> Main departure<u style="single">Ming</u>In<u style="single">When a predetermined operation is continuously input from the user, the viewpoint position and the line-of-sight direction are determined based on the displacement information and the current position information after the start of the operation, and the map is determined based on the determined viewpoint position and the line-of-sight direction. The coordinates of the graphic data constituting the information are converted, and the first map image showing the area in the line-of-sight direction is generated based on the map information composed of the coordinate-converted graphic data, and the generated first map image is generated. A map image is displayed. Then, when the continuous input of the predetermined operation from the user is completed, the second map image showing the area in the line-of-sight direction at the end of the operation is displayed.</u></p>

<p> According to the present invention, information can be input by rotating the entire device, the input can be performed with one hand, and the number of operation buttons can be reduced. Therefore, it is possible to improve the usability of the portable device and to reduce the size of the device.</p>

An embodiment of the present invention will be described below, and the correspondence between the constituent requirements described in the claims and the specific example in the embodiment of the invention will be illustrated as follows. This description is for confirming that the specific examples supporting the invention described in the claims are described in the embodiment of the invention. Therefore, even if there is a specific example which is described in the embodiment of the invention but is not described here as corresponding to the constituent requirements, the specific example is the configuration thereof. It does not mean that it does not meet the requirements. On the contrary, even if the specific example is described here as corresponding to the constituent requirements, it means that the specific example does not correspond to the constituent requirements other than the constituent requirements. not.

Furthermore, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to a specific example described in an embodiment of the invention, and the existence of the invention not described in the claims of this application, that is, a divisional application is filed in the future. It does not deny the existence of inventions that are added by amendment or amendment.

<u style="single">The present invention</u>Information processing equipment (for example,<u style="single">Figure</u>PDA50) of 1 is a display means for displaying information (for example, LCD3 in FIG. 2).<u style="single">Input means for inputting operations from the user (for example, operation button 2 in FIG. 1) and</u>A map information storage means for storing map information composed of graphic data (for example, the map data storage unit 47 in FIG. 14) and a displacement of the posture of the housing due to rotation of the entire housing are detected, and the detection result is supported. Rotation angle detecting means (for example, 3-axis gyro sensor 13 in FIG. 2) that generates displacement information and the current position<u style="single">Always</u>A position detecting means (for example, GPS card 22 in FIG. 2) that detects and generates current position information corresponding to the detection result, and a viewpoint position line of sight that determines the viewpoint position and the line-of-sight direction based on the displacement information and the current position information. Direction determination means (for example, viewpoint position / line-of-sight direction determination unit 44 in FIG. 14) and figure data coordinate conversion means (for example, FIG. 14) for converting the coordinates of graphic data constituting map information based on the viewpoint position and line-of-sight direction. It is composed of the graphic data coordinate conversion unit 45) of the above and the coordinate-converted graphic data.<u style="single">For map information</u>On the basis of<u style="single">Map image</u>To generate<u style="single">Map image</u>Including a generation means (for example, the image data output unit 46 in FIG. 14)<u style="single">。</u>

FIG. 1 shows an external view of a portable information processing apparatus (PDA: personal digital assistants) 50 to which the present invention is applied. The 3-axis gyro sensor 1 is designed to detect each rotation angle when the entire device rotates around the X-axis, Y-axis, and Z-axis. The operation button 2 is designed to give a predetermined instruction to the device. LCD3 is designed to display images such as menu screens and maps.

FIG. 2 is a block diagram showing an example of the internal configuration of the PDA50 shown in FIG. The 3-axis gyro sensor 1 includes vibration gyros 1a, 1b, and 1c corresponding to the X-axis, Y-axis, and Z-axis coordinate axes.

The vibrating gyro has a characteristic that when a rotational angular velocity is applied to a vibrating object, a Coriolis force is generated in a direction perpendicular to the vibration, and this Coriolis force F is expressed as follows.

F = 2mvω (where m is mass, v is velocity, ω is angular velocity)

Therefore, the angular velocity ω is proportional to the Coriolis force F, and the rotational angular velocity can be detected by detecting the Coriolis force F.

The vibration gyro 1a is provided with a drive piezoelectric device 4a and a detection piezoelectric device 4b, and an alternating signal, which is an oscillation output of the oscillator 25, is applied to the drive piezoelectric device 4a. In this state, when the vibrating gyro 1a is rotated in the θ direction, a Coriolis force F is applied to the detection piezoelectric device 4b, and a voltage E is generated.

The minute voltage output from the detection piezoelectric device 4b is amplified by the amplifier 7 and converted into digital data by the A / D converter 10.

The angular velocity ω applied to the vibration gyro 1a and the generated voltage E have a proportional relationship. For example, when the voltage E is rotated to the right around the X axis, the voltage E rises and is rotated to the left. When, the voltage E is arranged so as to decrease.

The vibration gyros 1b and 1c are basically the same as those of the vibration gyro 1a. The vibration gyro 1b detects the angular velocity around the Y axis, amplifies it in the amplifier 8, and then digitalizes it in the A / D converter 11. Is converted to the data of. Similarly, the vibration gyro 1c detects the angular velocity around the Z axis, amplifies it in the amplifier 9, and then converts it into digital data in the A / D converter 12.

The operation button 2 is configured to generate a predetermined signal in response to a user operation and supply it to the input interface 13. The CPU 14 is connected to various ICs and the like via the bus 26. In addition to the system program of the entire device, the ROM 15 is written with, for example, a kana-kanji conversion program for a word processor function and a dictionary table for that purpose, a recognition program for handwriting input, and a dictionary table for that purpose. Data necessary for operation is stored in RAM16 at any time.

The LCD 3 is designed to perform a predetermined display under the control of the color LCD controller 18. The pressure-sensitive transparent tablet 29 is designed to detect a predetermined input under the control of the pressure-sensitive transparent tablet controller 17. The backlight 30 is controlled by the backlight controller 19 to illuminate the LCD 3 from behind through a pressure-sensitive transparent tablet.

The PC card interface 20 is provided with a connector 27, and is a PCMCIA type GPS (Global Positioning System) card (hereinafter, simply abbreviated as GPS card) 22 (hereinafter abbreviated as GPS card) conforming to the PCMCIA (Personal Computer Memory Card International Association) standard as a GPS device. Position detection means) is inserted. The CPU 14 can exchange data, programs, etc. with the GPS card 22 via the PC card interface 20. Further, the GPS card 22 is connected to a GPS antenna 23 that receives radio waves from GPS satellites and outputs a corresponding signal. The GPS card 22 detects the current position based on the signal received by the GPS antenna 23 and outputs the position data corresponding to the current position.

A connector 28 is provided in the PC card interface 21, and for example, a PCMCIA type hard disk card (hereinafter, simply abbreviated as HDD card) 24 as a storage device is connected to the PC card interface 21. Map data and the like are stored in the HDD card 24.

Further, the input interface 13 is adapted to supply the detection signal of the 3-axis gyro sensor 1 supplied from the A / D converters 10 to 12 to the CPU 14 via the bus 26. Further, a signal corresponding to a predetermined operation supplied from the operation button 2 is supplied to the CPU 14 via the bus 26.

Next, with reference to FIGS. 3 and 4, the operation when menu selection is performed using the PDA50 having the above configuration will be described. Since this operation does not require data on the current position, it is not necessary to insert the GPS card 22 into the connector 27 of the PC card interface 20 in FIG. Moreover, since the map data is also unnecessary, it is not necessary to insert the HDD card 24 into the connector 28.

FIG. 3 shows an example of a series of operation screens when menu selection is performed, and FIG. 4 is a flowchart for explaining an operation procedure. First, in step S1 of FIG. 4, the CPU 14 determines whether or not the operation button 2 is pressed by the user. At this time, as shown in FIG. 3A, nothing is displayed on the screen of PDA50.

Now, when the operation button 2 is pressed by the user, a predetermined signal is generated and supplied to the CPU 14 via the input interface 13 and the bus 26. As a result, the CPU 14 determines that the button 2 has been operated, and proceeds to step S2. On the other hand, if the user does not operate the button 2, the process of step S1 is repeated.

In step S2, the CPU 14 generates display data (bitmap data) corresponding to a predetermined menu, and supplies the data together with the data corresponding to the display position on the screen to the color LCD controller 18 via the bus 26. Alternatively, the bitmap data corresponding to the menu may be stored in the ROM 15 in advance, read out via the bus 26, and supplied to the color LCD controller 18.

The color LCD controller 18 has a VRAM (video RAM) (not shown), controls the LCD3 according to the data written in the VRAM, and displays a predetermined image. Therefore, the display data corresponding to the predetermined menu supplied from the CPU 14 is stored in the VRAM of the color LCD controller. The color LCD controller 18 supplies a control signal to the LCD 3 according to the display data stored in the VRAM, and displays a predetermined menu.

Next, in step S3, the CPU 14 reads out the display data corresponding to the predetermined cursor from, for example, the ROM 15, and supplies the display data corresponding to the display position on the screen to the color LCD controller 18. The color LCD controller 18 stores the display data corresponding to the cursor supplied from the CPU 14 in the VRAM, and controls the LCD 3 according to the display data stored in the VRAM.

As a result, as shown in FIG. 3B, a predetermined menu and a predetermined cursor (in this case, in the shape of a cross) are displayed on the screen of LCD3. In this case, the cursor is initially displayed in the center of the menu.

Next, the process proceeds to step S4, and the CPU 14 determines whether or not the entire device (PDA) 50 has been rotated. For example, as shown in FIG. 1, when the entire device is rotated with one hand while the entire device is held, for example, around the X axis, this rotation generates a predetermined voltage in the detection piezoelectric device 4b. Then, it is amplified by the amplifier 7 and converted into digital data by the A / D converter 10. This digital data is input via the input interface 13 and supplied to the CPU 14 via the bus 26. As a result, the CPU 14 can recognize that the entire device has been rotated around the X axis. The same applies to rotation around the Y-axis and rotation around the Z-axis.

If it is determined in step S4 that the entire device has been rotated, the process proceeds to step S5, and the CPU 14 extracts the amount of rotation related to the X-axis. Next, in step S6, the amount of rotation about the Y-axis is extracted. In step S7, the cursor is moved up, down, left, and right according to the amount of rotation of each of the X-axis and the Y-axis.

That is, in order to move the cursor up / down / left / right according to the rotation of the entire device, the bitmap data corresponding to the cursor and the display position shifted in the up / down / left / right direction with respect to the cursor currently displayed on the screen. The data corresponding to is supplied to the color LCD controller 18. The magnitude of the deviation of the display position corresponds to each output voltage of the detection piezoelectric devices 4b and 5b. The color LCD controller 18 stores the bitmap data supplied from the CPU 14 in a predetermined location in the VRAM based on the data corresponding to the display position.

The color LCD controller 18 controls the LCD 3 according to the bitmap data corresponding to the moved cursor stored in the VRAM. As a result, when the entire device is initially rotated around the X-axis with the cursor in the center of the screen as shown in Fig. 3 (b), for example, the cursor is as shown in Fig. 3 (c). Moves to the item "banana". Also, when the entire device is initially rotated around the Y axis with the cursor in the center of the screen as shown in Fig. 3 (b), for example, the cursor moves as shown in Fig. 3 (d). Go to the item "Apple".

Next, the process proceeds to step S8, and when the cursor is located on any of the menu items, the CPU 14 generates display data corresponding to the menu in which the menu item is highlighted, and the color LCD controller 18 is used. Supply. For example, as shown in Fig. 3 (c), when the cursor is located on the menu item "Banana", the display data corresponding to the menu in which the menu item "Banana" is highlighted is generated, and the color LCD controller 18 Supply to.

As a result, the color LCD controller 18 stores the display data corresponding to the menu in which the menu item "Banana" where the cursor is located is highlighted in VRAM. Then, the LCD3 is controlled according to the display data stored in the VRAM to display the screen in which the menu item "Banana" is highlighted.

Further, for example, as shown in FIG. 3 (d), when the cursor is located on the menu item "Apple", the display data corresponding to the menu in which the menu item "Apple" is highlighted is generated, and the color LCD is displayed. Supply to controller 18.

As a result, the color LCD controller 18 stores the display data corresponding to the menu in which the menu item "Apple" where the cursor is located is highlighted in VRAM. Then, the LCD3 is controlled according to the display data stored in the VRAM to display the screen in which the menu item "Apple" is highlighted.

When the process in step S8 is completed, the process returns to step S4, and the processes after step S4 are repeatedly executed.

If it is determined in step S4 that the entire device is not rotating, the process proceeds to step S9, and it is determined whether or not the operation button 2 is released. If it is determined that the operation button 2 is not released, the process returns to step S4, and the processes after step S4 are repeatedly executed. On the other hand, for example, when the operation button 2 is released while the screen as shown in FIG. 4D is displayed, it is determined in step S9 that the operation button 2 is released, the process proceeds to step S10, and the CPU 14 steps. Confirm the selection of the highlighted menu item in S8.

As a result, in step S11, the menu is deleted from the screen, the screen returns to step S1, and the processes after step S1 are repeatedly executed.

In this way, a predetermined menu item can be selected by holding the entire device with one hand and rotating it around the X-axis and the Y-axis. Here, the case of rotating around two axes of X-axis and Y-axis has been described, but of course, menu items are selected by rotating around three axes of X-axis, Y-axis, and Z-axis. It is also possible to do so.

Further, here, when the device is rotated, the cursor moves on the menu so that a predetermined menu item can be selected. However, as shown in FIG. 5, the cursor is fixed at a predetermined position on the screen, for example, in the center. However, it is also possible to have the menu move within the screen as the device rotates. Even in this way, a predetermined menu item can be selected.

FIG. 6 shows a display example of LCD3 when the present invention is applied to an electronic organizer. For example, hold the electronic organizer with one hand and press the operation button 2 to display the circular menu. In this case, menu items used in the electronic organizer, such as "schedule", "dictionary", "memo", "reminder", "phonebook", "TO DO (matters to be done)", etc. are displayed on the screen. The cursor is displayed in the center.

Next, while pressing the operation button 2, the entire electronic organizer is rotated around the X-axis and the Y-axis to move the cursor to a predetermined menu item. Then, when the operation button 2 is released while the cursor is located at the desired menu item, the selection of the menu item at which the cursor is located is confirmed.

In this way, the electronic organizer can be operated with one hand to select menu items. Also, instead of the above menu, display a menu with numbers, alphabets, hiragana, katakana, etc. as menu items, and select the desired number or character with the cursor to enter a telephone number, text, etc. You can also do it.

FIG. 7 shows an example of a drum-shaped menu. In this way, the menu items are displayed as if they were arranged on the drum, and a rectangular cursor is displayed at a predetermined position. The user first presses the operation button 2 and then rotates the device around the X axis. As a result, when the drum rotates and the desired menu item moves within the cursor, the operation button 2 is released. In this way, the desired menu item of the drum-shaped menu can be selected and confirmed.

Next, a case where a digital map is displayed using the PDA50 having the above configuration will be described with reference to FIGS. 8 to 13. Since data on the current position is required for this display, the GPS card 22 is inserted into the connector 27 of the PC card interface 20 in FIG. As a result, the GPS card 22 can calculate the current position based on the radio waves from the GPS satellites received by the GPS antenna 23. In addition, the HDD card 24 is inserted into the connector 28 so that the map data can be read.

FIG. 8 is a conceptual diagram showing that a predetermined area such as a virtual map or drawing is displayed on the screen by applying a rotation operation to the PDA50. In the PDA50, the HDD card 24 stores the map data, and the CPU 14 reads the map data from the HDD card 24 via the PC card interface 21. Then, the read map data is subjected to coordinate conversion processing for displaying a bird's-eye view as described later with reference to FIGS. 14 to 16 to generate bitmap data corresponding to the map data subjected to the coordinate conversion processing. , Supply to the color LCD controller 18.

The color LCD controller 18 stores the bitmap data supplied by the CPU 14 in VRAM. Then, the color LCD controller 18 controls the LCD3 according to the bitmap data stored in the VRAM, and displays the map corresponding to the bitmap data. In this way, the area corresponding to the current position of a predetermined map can be displayed. In this case, the map data corresponding to the current position supplied from the GPS card 22 is read from the HDD card 24 and displayed by the LCD 3.

With the map of the current position displayed on the screen of the PDA50, for example, when the user presses the operation button 2 and rotates the PDA50 around the horizontal axis (X axis) with respect to the screen, the detection piezoelectric A predetermined voltage is generated by the porcelain 4b, amplified by the amplifier 7, converted into digital data by the A / D converter 10, and then supplied to the CPU 14 via the bus 26. As a result, CPU14 recognizes that PDA50 has been rotated around the X-axis.

Next, the CPU 14 is based on the map data read from the HDD card 24 so that the map displayed on the LCD3 moves upward or downward, and is above or above the part currently displayed on the screen of the LCD3. Generate bitmap data corresponding to the map data shifted downward and supply it to the color LCD controller 18.

The color LCD controller 18 temporarily stores the bitmap data supplied from the CPU 14 in VRAM. Next, the LCD3 is controlled according to the bitmap data stored in the VRAM to display the corresponding map. As a result, the map displayed on the screen of LCD3 of the PDA50 moves in the vertical direction according to the rotation operation by the user. This amount of movement corresponds to the rotation angle of the PDA50.

If the PDA50 is rotated around the axis (Y-axis) perpendicular to the screen while pressing the operation button 2, a voltage is generated by the detection piezoelectric device 5b, and the PDA50 rotates around the Y-axis. CPU14 recognizes that the operation has been performed.

Next, the CPU 14 is left or right from the part currently displayed on the LCD3 screen based on the map data read from the HDD card 24 so that the map displayed on the LCD3 moves to the left or right. Bitmap data corresponding to the map data shifted to the right is generated and supplied to the color LCD controller 18.

The color LCD controller 18 temporarily stores the bitmap data supplied from the CPU 14 in VRAM. Next, the LCD3 is controlled according to the bitmap data stored in the VRAM to display the corresponding map. As a result, the map displayed on the LCD3 screen of the PDA50 moves in the left-right direction in response to the rotation operation by the user. This amount of movement corresponds to the rotation angle of the PDA50.

Further, by combining the above rotation operations, any part of the map can be displayed on the screen of the LCD3. In this way, when the operation button 2 is released (released) while the predetermined area of the map is displayed, the map of the currently displayed area is confirmed, and the map of that part is continuously displayed on the screen. Is displayed. The rotation operation around the X-axis and the rotation operation around the Y-axis can be performed at the same time.

Figure 9 shows the PDA50 tilted and positioned with respect to the virtual map. By observing the virtual map on the back side of the LCD3 screen from the direction perpendicular to the LCD3 screen of the PDA50 (Z-axis direction), the area A on the map can be observed. Therefore, the LCD3 of the PDA50 is displayed with a map as shown in FIG. As a result, it is possible to display an image on the screen as if the map was actually expanded and viewed from various angles.

Further, as shown in FIGS. 9 and 10, the index M indicating the destination to be moved can be displayed next. As a result, the user can recognize which part of the map he / she is going to move to, so that the operation for moving to the desired part of the map can be facilitated. Further, even when the moving destination is far away, the current display area and the moving destination can be stored on the screen at the same time, so that the relationship between the moving destination and the current position can be easily recognized.

FIG. 11 shows a diagram when the trajectory of the PDA50 moving on a virtual map is observed from the side of the map surface. First, from the viewpoint P1, the map is observed from directly above, and the map as shown in FIG. 12 is displayed on the screen of LCD3. Next, press the operation button 2 of the PDA50 and rotate the PDA50 around a predetermined axis as it is. Then, the viewpoint automatically moves from the viewpoint P1 to the viewpoint P2 located above the viewpoint P1, and the map can be observed from diagonally above.

At this time, it is possible to make all or part of the area on the map observed at the viewpoint P1 within the screen of the PDA50. As a result, the positional relationship between the current position and the moving destination can be easily grasped, and the desired moving destination can be quickly found.

At viewpoint P2, as shown in FIG. 13, a bird's-eye view of a virtual map observed from diagonally above is displayed on the screen of LCD3 of PDA50, and the index M of the destination is displayed. Then, when the index M matches the desired movement destination, when the operation button 2 is released, the index M moves from the viewpoint P2 to the viewpoint P4 via the viewpoint P3. Then, at the viewpoint P4, the image obtained by observing the map from directly above is displayed on the LCD3 of the PDA50.

In this way, the user can easily display the desired location on the map by operating the PDA 50 with one hand.

Next, a method of displaying a bird's-eye view will be described with reference to FIGS. 14 to 16. This is a method of displaying a map as if it were viewed from the sky. Recently, it has been used in navigation devices and the like to display a detailed road form around the display reference point where the own vehicle is located and a distant road. The form can also be displayed.

FIG. 14 shows a configuration example of a general system for realizing a bird's-eye view display. This system is in the current position P₀(X_p, Y_P, Z_P) Is input, the viewpoint conversion key input unit 42 for changing the current position, and the viewpoint position / line-of-sight direction is determined based on the information from the current position input unit 41. Based on the information from the line-of-sight direction determination unit 44, the viewpoint position / line-of-sight direction determination unit 44, and the graphic data coordinate conversion unit 45 that converts the coordinates of the graphic data based on the map information, and the information from the graphic data coordinate conversion unit 45. , A bird's-eye view display calculation unit 43 consisting of an image data output unit 46 that outputs image data, and a map data storage that stores various map information and outputs the stored map information to the graphic data coordinate conversion unit 45. It is composed of a unit 47 and an image display unit 48 that displays an image corresponding to the image information output from the image data output unit 46.

This system can be realized by installing the GPS card 22 in the PDA50 shown in FIG. That is, the current position input unit 41 corresponds to the GPS card 22 and the GPS antenna 23 in FIG. 2, and the viewpoint conversion key input unit 42 corresponds to the 3-axis gyro sensor 1. The viewpoint position / line-of-sight direction determination unit 44 and the graphic data coordinate conversion unit 45 constituting the bird's-eye view display calculation unit 43 correspond to the CPU 14, and the image data output unit 46 corresponds to the color LCD controller 18. The map data storage unit 47 corresponds to the HDD card 24, and the image display unit 48 corresponds to the LCD 3.

In the perspective projection drawing, as shown in FIG. 15, the viewpoint E (X) is obtained from the map ABCD region represented as the XY plane reference of the XYZ plane.₀, Y₀, Z₀) To reference point B (X)_{b b}, Y_{b b}, Z_{b b}), The image viewed at a depression angle θ is projected onto the viewing plane G arranged perpendicular to the line-of-sight direction, and the image is displayed on the screen as a bird's-eye view.

At this time, it is assumed that the line-of-sight direction from the viewpoint E has a rotation direction information angle α with respect to the XY plane. Also, the distance between the viewpoint E and the viewing plane G is V._dAnd. Then, in the perspective-projected display image, the vertical line on the center line is used as the reference line, and the defined point Q on the reference line is referred to as the perspective projection reference point. This reference point Q is a point on the map data on a straight line connecting the viewpoint E when considered in the XY plane and the reference point B (center of the screen) of the perspective projection, and the reference point B is from the lower side of the display screen. Toward the distance D_cIt is displayed at the point of.

FIG. 16 is a flowchart showing the processing operation by the system shown in FIG. This process is realized by a general computer calculation, and the current position P₀How to set the viewpoint position E and the current position P₀Is a reference point Q for perspective projection, but here, the current position P₀A reference point Q, and a case where this reference point Q coincides with the reference point B will be described.

First, in step S1, the current position P is performed by the viewpoint conversion key input unit 42 and the current position input unit 41.₀Is a reference point and a reference point B, and in step S22, the line-of-sight depression angle θ, the viewpoint height h, and the traveling direction α are set.

Next, the process proceeds to step S23, and the viewpoint position / line-of-sight direction determination unit 44 calculates the viewpoint position using the following mathematical formula. Here, the viewpoint E can be determined as follows based on the information of the reference point B as follows. That is, if the coordinates of the reference point B are now (x, y, 0), the viewpoint E (X)₀, Y₀, Z₀) Can be expressed as follows. X₀= xh × cos α (t) / tan θ Y₀= yh × sin α (t) / tan θ Z₀= h

Next, in step S24, the graphic data coordinate conversion unit 45 performs perspective projection conversion on the map data based on the calculated viewpoint. Here, the point M (M) on the XY plane_x, M_y, M_z) View plane G (S)_x, S_yThe relational expression of the coordinate transformation to) is expressed by the following expression. In the case of a flat map, M_z= 0.

<maths num="1"><img file="JP4000570B2_D0001.tif" /></maths>

Next, in step S25, the image data output unit 46 performs each data (S) after coordinate conversion._xi, S_yi) Is supplied to the image display unit 48, and the image display unit 48 displays an image corresponding to the data supplied from the image data output unit 46, and ends the process. As a result, the map data represented with reference to the XY plane is perspectively projected onto the viewing plane G and displayed as a bird's-eye view.

In the above embodiment, it is also possible to separately provide a button for virtually moving the viewpoint forward or backward. This makes it possible to observe the map from any altitude.

Further, in the above embodiment, the PCMCIA type HDD card is used as the storage device for storing information, but it is also possible to use another storage device such as a semiconductor memory.

It is also possible to move the cursor or menu using an angle sensor that detects the rotation angle only around the X-axis or around the X-axis and the Y-axis.

<figref num="1">It is external drawing of the portable information processing apparatus which applied the input device of this invention.</figref><figref num="2">It is a block diagram which shows the internal structure example of the portable information processing apparatus of FIG.</figref><figref num="3">It is a figure which shows the procedure which displays a circular menu, and selects a menu item.</figref><figref num="4">It is a flowchart explaining the procedure of selecting a menu item of the circular menu of FIG.</figref><figref num="5">It is a figure which shows the example of the menu screen which fixed the cursor, and moved the circular menu.</figref><figref num="6">It is a figure which shows the example of the menu screen displayed in the electronic organizer.</figref><figref num="7">It is a figure which displays the cylindrical menu and shows how the menu item is selected.</figref><figref num="8">It is a figure which shows the state of moving on a virtual map, and displaying an arbitrary part on a map on a screen.</figref><figref num="9">It is a figure which shows the state of observing a virtual map from an oblique sky.</figref><figref num="10">FIG. 9 is a diagram showing an example of a screen displayed on LCD3 of PDA50.</figref><figref num="11">It is a figure which observed the locus of movement of a viewpoint from the lateral direction of a map when the viewpoint was moved from the present position to the destination on a virtual map.</figref><figref num="12">This is an example of screen display when the map is observed from the viewpoint P1 in FIG.</figref><figref num="13">This is an example of screen display when the map is observed from the viewpoint P2 in FIG.</figref><figref num="14">It is a block diagram which shows the general configuration example of the system which performs the bird's-eye view display processing.</figref><figref num="15">It is a figure explaining the concept of perspective projective transformation.</figref><figref num="16">It is a flowchart explaining the operation of the system shown in FIG.</figref>

Code description

1 3-axis gyro sensor, 2 operation buttons, 3 LCD, 4a, 5a, 6a drive pressure electromagnetic device, 4b, 5b, 6b detection pressure electromagnetic device, 7,8,9 amplifier, 10,11,12 A / D converter , 13 Input Interface, 14 CPU, 15 ROM, 16 RAM, 17 Pressure Sensitive Transparent Tablet Controller, 18 Color LCD Controller, 19 Backlight Controller, 20,21 PC Card Interface, 22 PCMCIA GPS Card, 23 GPS Antenna, 24 PCMCIA Type HDD card, 25 oscillator, 26 bus, 27,28 connector, 29 tablet, 30 backlight, 41 current position input unit, 42 viewpoint conversion key input unit, 43 bird's-eye view display calculation unit, 44 viewpoint position / line-of-sight direction determination unit , 45 Graphic data coordinate conversion unit, 46 Image data output unit, 47 Map data storage unit, 48 Image display unit, 50 PDA, M index