Information-processing apparatus and programs used in information-processing apparatus

The present invention is for improving the operability of designating a display range in an information processing device configured so that a user can input an operation while viewing a screen display using a coordinate input device (or a coordinate reader) such as a touch panel. Regarding the technology of.

As an operation input form in an information processing device such as a portable computer, a configuration form using an absolute coordinate type input device or a reading device such as a touch panel or a tablet is known, and an input pen such as a stylus or a finger can be used. Operation instructions to the device are possible. For example, with an application running on the operating system (hereinafter referred to as "OS") installed in the device running, the user uses the graphical user interface (GUI) while looking at the information on the display screen. Can be operated.

For example, left-click and right-click of the mouse so that a user who is accustomed to operating in a GUI environment using a pointing device such as a mouse can perform input operations and selection operations with the same operation feeling on a device equipped with a touch panel. An input pen system having a switching function is known (see, for example, Patent Document 1).

<patcit num="1"><text>Japanese Unexamined Patent Publication No. 2000-81951</text></patcit>

<p> However, in the conventional device, there is a problem in operability in designating the display range because the touch panel is an absolute coordinate value type pointing device.</p><p> Figure 8 shows the maximum of the absolute position coordinate input device.<u style="single">Number of pixels</u>But on the screen to be displayed<u style="single">Number of pixels</u>It is explanatory drawing about the state smaller than.</p><p> The rectangular frame W in the figure indicates the screen, and the rectangular frame ω having a small area shown in the frame indicates the display range (or display area) of the display device (tablet integrated display device, etc.).</p><p> screen<u style="single">Number of pixels</u>However, it is expected to be displayed on a CRT (cathode ray tube) or liquid crystal display.<u style="single">Number of pixels</u>(Maximum displayable<u style="single">Number of pixels</u>) Is exceeded, only the range corresponding to the rectangular frame ω is partially displayed in the frame W (hereinafter referred to as panning state). That is, the state is the screen<u style="single">Number of pixels</u>The maximum of the display device than<u style="single">Number of pixels</u>Is the display state when is small (however, when the reduction of image data is not considered).</p><p> In such a panning state, it is impossible for the user to instruct the outside of the display range (outside the frame of ω) by the operation on the touch panel. That is, the operation of moving from the current display range to another display range on the screen cannot be realized only by the operation of the touch panel, and the combined use of other relative coordinate type devices is indispensable. For example, it is necessary to move the pointer to the intended display range by performing an operation of moving the pointer further outward beyond the end of the display range using a track point, an operation stick, a mouse, or the like along a desired direction. There is.</p><p> In the input operation mode in the panning state (hereinafter referred to as "panning mode"), it is not possible to specify the desired display range by operating only the absolute coordinate type input device, or it is necessary to use another device. Therefore, there is a problem that the operability of the user may be affected, or the number of parts and the cost may increase due to the complicated circuit configuration and control.</p><p> Therefore, an object of the present invention is to improve user operability related to display range designation in an information processing device using an absolute coordinate type input device such as a touch panel.</p>

<p> In order to solve the above-mentioned problems, the information processing apparatus according to the present invention has an input unit for inputting a user operation on an operation surface as input information, a display unit in which the input unit is integrated, and at least a first mode. And multiple input operation modes including the second mode can be changed, and from the first mode<u style="single">the above</u>When the input operation mode is changed<u style="single">Whole screen</u>Only part of<u style="single">Is the above display</u>Is it displayed in<u style="single">no</u>Judging whether or not<u style="single">The whole screen</u>Only part<u style="single">Is the above display</u>If it is determined that the display is displayed in, the movement amount due to the operation is detected according to the operation on the operation surface of the input unit, and the movement amount is displayed on the display unit.<u style="single">Part of the entire screen above</u>To move<u style="single">A control unit for changing to the second mode is provided, and further, for example, the input operation mode is changed by operating the specific operation area provided in the input unit, and the operation to the specific operation area is performed. The above input operation mode is changed in a cyclic manner.</u>It is a thing.</p><p> Further, according to the present invention.<u style="single">The input operation mode control method has an input unit for inputting user operations on the operation surface as input information and a display unit in which the input unit is integrated, and a plurality of inputs including at least a first mode and a second mode. In the input operation mode control method in the information processing apparatus that allows the operation mode to be changed, whether or not only a part of the entire screen is displayed on the display unit when the input operation mode is changed from the first mode. If it is determined that only a part of the entire screen is displayed on the display unit, the amount of movement due to the operation is detected according to the operation of the input unit on the operation surface, and the display is displayed. It has a processing step of changing to a second mode in which a part of the entire screen displayed on the unit is moved, and further, for example, the input operation mode is performed by operating on a specific operation area provided in the input unit. Is changed, and the input operation mode is changed in a cyclic manner by operating the specific operation area.</u></p><p> Therefore, in the present invention, in the panning state in which a part of the screen is displayed, it is possible to move to a desired display range only by operating the absolute coordinate type input device.</p>

<p> According to the present invention, since no other relative coordinate type device is required for the operation in the panning state, it is effective for simplification of the device configuration and cost reduction. It is also effective in improving user operability and convenience.</p><p> Further, in the configuration form in which the mode can be changed by touching a specific operation area provided in the absolute coordinate type input device, a dedicated operation key by hardware is not required, and the size of the display device is increased. Suitable for. In that case, if the mode is changed in a cyclic manner by a contact operation with a specific operation area, the occupied area of the operation area can be suppressed to the minimum necessary.</p><p> Further, in order to improve the operability, it is effective to make it easy to change or switch to the mode (hover mode) corresponding to the movement operation of the mouse pointer.</p>

The present invention uses an absolute coordinate type input device to change the display range in a panning state in an information processing device including an absolute coordinate type input device such as a touch panel and a display device in which the absolute coordinate type input device is integrated. It provides a configuration that can be performed only by operation. The information processing device according to the present invention can be applied to computer devices, PDAs (personal digital assistants), various video devices, audio devices, and the like.

FIG. 1 is a conceptual diagram showing a basic configuration example of the information processing apparatus 1 according to the present invention.

The absolute coordinate type input device 2 uses a touch panel integrated with a display device described later, a pen input device, a digitizer, or the like. For example, the user can use a finger, a pen, a stylus, or the like to determine the position on the operation surface. Absolute position coordinates are detected when specified. When the present invention is applied, the connection form between the device main body and the input pen or the like may be wired or non-wired.

The position information and operation information instructed by the user operation using the absolute coordinate type input device 2 are processed by the arithmetic processing means 3 using the CPU (central processing unit), the system controller, and the like.

The display device 4 is integrated with the absolute coordinate type input device 2, and a device such as a liquid crystal display panel is used. The user can perform an input operation, a selection operation, and the like using the absolute coordinate type input device 2 while looking at the screen display.

In the present invention, there is a configuration in which an operation unit including hardware keys such as operation buttons and switches is provided in the main body of the device, and an operation using an absolute coordinate type input device without providing such an operation means. It can be applied to a configuration form in which input and selection can be completed by itself.

FIG. 2 is a schematic view illustrating the information processing device 1, and an operation display unit 6 in which a touch panel and a display device are integrated is provided on the front surface of the main body unit 5.

When operating the touch panel using fingers, a stylus, etc., change the input operation mode using the specific operation key 7 attached to the main body 5 or the specific operation area 8 provided on the touch panel. Can be done.

Examples of the user operation on the touch panel include the following operations.

Touch = Touch the touch panel with your fingertip or stylus and continue to touch it. -Release = Release the fingertip, stylus, etc. from the touch panel while touching the operation surface. Single tap (so-called tap) = Touch the touch panel with your fingertip or stylus to release immediately. Double tap = single tap twice in a row -Drag = Move your fingertip, stylus, etc. while maintaining the state of touching the operation surface (contact state).

In the normal input operation mode, the operation of releasing immediately after touching corresponds to the click (so-called left click) of the main button (normal left button) at the time of mouse operation.

In addition to clicking the main button, mouse operations include clicking the secondary button (usually the right button) (so-called right click) and moving the mouse pointer only (hereinafter referred to as "hover"), and the user is in a situation. It is necessary to use these operations properly according to the situation.

For example, assuming the input operation mode shown below, a method of changing the input operation mode will be described.

Left click mode (click mode of main button) This mode is set in the initial state, and when the user hits the touch panel (tap), this is recognized as a left-click mouse event and notified to the OS.

Right-click mode (secondary button click mode) When the user hits the touch panel, it is recognized as a right-click mouse event and notified to the OS.

Hover mode (move mode with pointer only) When the user hits the touch panel, it is recognized as a hover mouse event and notified to the OS.

Panning mode This mode can be changed only in the panning state, and is the maximum of the display device 4.<u style="single">Number of pixels</u>Of the screen that should be displayed<u style="single">Number of pixels</u>It is a display range operation mode in a smaller state (specific operations will be described in detail later).

When the current mode is left-click mode, as a method of changing to right-click mode, hover mode, etc., there is a form of starting a dedicated application and switching modes, but there are multiple ways to switch modes. The operation is unavoidable, it takes time and effort, and it is necessary for the user to learn the operation procedure.

Therefore, it is preferable to configure the mode so that the mode can be changed by a contact operation with the operation key 7 of the main body 5 or the specific operation area 8 provided in the absolute coordinate type input device 2.

FIG. 3 is a diagram for explaining an example of state transition between the above modes using a specific operation button (hereinafter, referred to as mode switching button).

First, the left-click mode is selected in the initial setting state, and the mode shift to the right-click mode by operating the mode switching button (pressing the button or tapping the operation area). Further operation of the mode switching button shifts to hover mode, and when the mode switching button is operated next, it shifts to panning mode if it is in a panning state, but returns to left-click mode if it is not in a panning state. ..

When the mode switching button is operated in the panning mode or the panning state is stopped, the mode shifts to the left click mode.

In this way, in the configuration in which the input operation mode is changed in a cyclic manner by operating the mode switching button, it is sufficient to use a single operation button or operation area, so that the occupied area can be minimized. .. That is, it is not necessary to attach the operation keys 7, 7, ... for each mode to the main body 5, or to provide the operation contact for each mode in the operation area 8 (for example, in the above description, the four modes are described. As shown, if the number of switching modes is further increased, it is necessary to increase the number of operation buttons, etc. for mounting, which affects the display area.)

In a configuration in which the input operation mode is changed by touching a specific operation area provided on the touch panel, a dedicated hardware key is not required, and the display area of the display device can be increased accordingly. it can.

Next, the panning mode will be described.

When a CRT, a liquid crystal display device, or the like is used as the display device 4, a plurality of display devices 4 are used.<u style="single">Number of pixels</u>Can be displayed on the screen<u style="single">Number of pixels</u>Is the maximum that can be displayed on the display device<u style="single">Number of pixels</u>In the following cases, the entire screen can always be displayed on the display device.

But the screen<u style="single">Number of pixels</u>Is the maximum that can be displayed on the display device<u style="single">Number of pixels</u>When the value exceeds the above, the image processing function of the graphic LSI or the like causes a panning state in which only a part of the screen is displayed as described in FIG.

The transition to the panning mode is performed by operating the mode switching button in the panning state, and the operation of the user on the touch panel in the mode is recognized as, for example, moving the display range.

FIG. 4 is a diagram for explaining the operation status in the panning mode according to FIGS. (A) to (D) (the meanings of the frames W and ω are the same as those in FIG. 8). In this example, the display frame is described as a rectangular frame, but in the application of the present invention, a frame having an arbitrary shape can be used without being limited to the rectangular frame.

First, FIG. (A) shows a state in which a part of the area in the screen frame W is cut out in the frame ω and displayed on the display device 4, and the pointer (or cursor) indicated by the arrow as the indicator 9 is shown. )It is shown.

When the panning mode is changed in this state, the shape of the indicator 9 is changed for the panning mode as shown in (B) (in this example, it is a symbol of the palm shape of the right hand).

As shown in Fig. (C), when the user slides the touch panel while the stylus or fingers are in contact with the touch panel (touch) (drag operation), as shown in Fig. (D), up to that point. The display range (see the dashed frame) moves to another display range (see the solid line frame). For example, as shown by the arrow M in Fig. (C), by moving the display device 9 diagonally upward to the left and performing a drag operation, the movement distance of the operation is detected, and the moving distance of the operation is detected by the arrow m in Fig. (D). As shown, the display range moves diagonally downward to the right (as a result of translation while the size of the frame ω remains unchanged, an image with a display range different from the previous one is displayed on the display device. ).

In this way, when the input operation mode shifts to the panning mode and the operation of moving the indicator on the display screen is performed by the contact operation with respect to the operation surface of the absolute coordinate type input device 2, the movement amount by the operation is performed. Is detected, and the display range is moved or changed according to the movement amount.

The program including the steps for realizing this process is read from the storage means 10 of FIG. 1, interpreted by the CPU, and executed. That is, the processing subject in the information processing device 1 is the hardware including the arithmetic processing means 3 such as the CPU and the total of various programs executed by the means, and the following is performed by executing the program according to the operation information. Is processed.

(1) Processing step to determine that the input operation mode has changed to the panning mode (2) After shifting to the panning mode, when an operation to move the display on the display screen is performed by a contact operation with the operation surface of the absolute coordinate type input device 2, the movement amount due to the operation is detected and displayed. A processing step for moving or changing the display range on device 4.

By applying the above-mentioned device or program or a storage medium containing the program, it is possible to change the display range in the panning state by using only the touch panel. Further, by preparing an operation button or the like for changing the mode of the touch panel, the mode can be easily switched. Preferably, the simplification of the operation system can be achieved by assigning the mode change function to a single operation unit.

Hereinafter, an example of implementation in which the present invention is applied to a portable computer device will be described.

As shown in FIG. 5, the housing 12 of the information processing device 11 is formed in a horizontally long flat rectangular shape, and a display device (liquid crystal display or the like) 14 is provided on the front surface 13 of the housing 12.

A touch panel is provided on the surface 15 of the display device 14, and the user can perform selection operations, input operations, etc. by instructing a desired position on the operation surface with a finger or a dedicated pen (stylus, etc.) 16 while looking at the display screen. It can be performed. In addition, various operation elements (buttons, switches, etc.) 17, 17, ... Are attached to predetermined positions of the housing 12, and a mode switching button is assigned to one of them. For example, the configuration form shown below can be mentioned.

-Fixed key function assignment -A form in which the key function assignment can be changed according to the dominant hand or user's usability.

FIG. 6 shows an example of the hardware configuration of the information processing device 11.

The CPU 101, which is the control center, is connected to the control device 102 via a bus (FSB: Front Side Bus), and the control device 102 constitutes the above-mentioned arithmetic processing means 3 together with the control device and the device described later. There is. The control device 102 is in charge of controlling the main memory 103 and controlling the graphic function, and mainly has a role of processing a large amount of data at high speed. In an AT compatible machine, it is called a "north bridge", and a graphic display device 105 such as a CPU 101, a main memory 103, a control device 104, and a liquid crystal display device is connected to the control device 102 shown in this example.

The control device 104 mainly controls a control device or the like for a user interface, and performs a bus link or the like of the device. In AT compatible machines, it is called "South Bridge", and in "PCI to ISA bridge", it has the role of bridging the bus (PCI: Peripheral Component Interconnect bus) to the low speed bus (ISA: Industry Standard Architecture bus, etc.), and ISA. It has functions such as a controller and an IDE (Integrated Drive Electronics) controller.

A wireless LAN (W-LAN) as a wireless communication device 106 and a device 107 for connecting and controlling an external memory and an external device are connected to the PCI bus. As the external memory, a semiconductor memory device that can be attached to and detached from the main body of the device, for example, a control device 108 for reading and writing data on a stick-shaped storage medium and a control device 109 such as a card-shaped storage medium are provided. ing. In addition, device 107 has a function of an interface for connecting to an external device (for example, "IEEE 1394" that defines hardware specifications for adding a serial device to a computer).

A LAN (Local Area Network) connection device 110 is connected to the control device 104, and a touch panel 111 is connected to a USB (Universal Serial Bus) port.

For the auxiliary storage device 112, for example, a drive device using a magnetic disk or an optical disk is used, but in this example, a drive device using a large-capacity storage medium such as a hard disk is used, and the control device 104 (inside). Connected to the IDE controller).

Further, the audio signal processing unit (Audio Codec) 113 connected to the control device 104 sends a digital-to-analog converted audio signal to, for example, a speaker 114 or a headphone 115 to output audio. Alternatively, in the form of a device provided with a microphone, the audio signal processing unit 113 performs processing such as digitizing and capturing voice input data.

The storage device 116 stores a control program or the like for operating a computer, and is connected to the control devices 104 and 117 by using an LPC (Low Pin Count: serial bus) or the like.

The control device 117 is a general-purpose device that controls various signals. For example, "EC" (Embedded Controller) is used to control the functions of the keyboard controller, the power supply control of the system, the additional functions of the system, and the like. (Portable devices, etc. are equipped with a microcomputer). The control method of the computer can be changed by changing the control program in the storage device 116.

A signal from the operation unit 118 including the operation element 17 provided in the device main body is sent to the control device 117. A USB connector is provided as a connection unit 119 for connecting an external device to the device main body, and the connector is connected to the control device 104.

A commercial power supply voltage is supplied from an AC adapter, or a DC power supply is supplied from a battery pack using a secondary battery, a fuel cell, or the like to a power supply unit (not shown).

FIG. 7 is an explanatory diagram showing a main part of the software configuration.

The operation information of the mode switching button, which is one of the operation elements 17, (for example, the detection information of pressing or not pressing the button) is received by the device driver 18 via the control device 117 (EC in this example), and the dynamic link library. 19 will be notified. Then, the dynamic link library 19 notifies the service program 20 of the received operation information.

Service program 20 is the current screen via video driver 21<u style="single">Number of pixels</u>Setting status and<u style="single">Number of pixels</u>We are monitoring changes, and when we receive notification of the above operation information from dynamic link library 19, the screen at that time<u style="single">Number of pixels</u>The mode to be transitioned to next is determined based on the input operation mode, and the touch panel driver 22 is notified of the instruction based on the determination result.

The operation information of the touch panel 111 is sent to the control device 104 and then sent to the upper hierarchy (OS) 23 via the touch panel driver 22. The touch panel driver 22 sets the mode according to the above notification from the service program 20, and as a result, when the user hits the touch panel 111, the OS is notified of a mouse event message according to the set mode. For example, in the panning mode, the user's operation is recognized as the movement of the display range as described above. That is, in the movement process of the display range, the movement distance for changing the display range is calculated from the coordinates of the drag operation using the stylus or the like and notified to the OS.

In this example, the service program 20 manages the dynamic mode switching settings, and the mode switching button operation and screen.<u style="single">Number of pixels</u>It has a processing step for determining the transition to the input operation mode specified according to the above. Then, the touch panel driver 22 notifies the OS of the mouse event according to the set mode. For example, after the service program 20 notifies the touch panel driver 22 of the transition to the panning mode, when a user operation for moving the indicator 9 is performed on the operation surface of the touch panel as described in FIG. , The process for moving the display range is performed under the control of the OS by a known method according to the amount of movement during the operation. Not limited to this example, various embodiments such as consolidating the functions of the service program and the touch panel driver into one program are possible.

According to the configuration described above, the following advantages can be obtained.

-Mode change and switching related to input operations on the touch panel can be performed instantly by operating a single operation button or a specific operation area on the touch panel, which contributes to improved operability (starts an application for changing settings, etc.). There is no need to let it.) -The display range can be changed in the panning state only by operating the touch panel (no auxiliary operation means is required, which is effective for simplifying the configuration and increasing the display area).

<figref num="1">It is a figure which shows the basic structure example of this invention.</figref><figref num="2">It is the schematic which illustrated the information processing apparatus.</figref><figref num="3">It is explanatory drawing of the state transition example between each mode.</figref><figref num="4">It is explanatory drawing which illustrated the operation situation in a panning mode.</figref><figref num="5">It is a figure for demonstrating the Example which concerns on this invention together with FIG. 6 and FIG. 7, and this figure is the perspective view which shows the appearance composition example of the apparatus.</figref><figref num="6">It is a figure which shows the hardware configuration example of the apparatus.</figref><figref num="7">It is a figure which showed the main part of the software structure.</figref><figref num="8">It is explanatory drawing of the panning state.</figref>

Code description

1 ... Information processing device, 2 ... Absolute coordinate type input device, 4 ... Display device, 8 ... Specific operation area, 9 ... Displayer, 11 ... Information processing device