Information processor and method for displaying information object
Abstract
Problem to be solved.To propose a configuration capable of executing an application program associated with the information in interlocking with the display of the information by a method for allowing a user to peruse a plurality of information objects disposed in a virtual space while smoothly changing a defined field of view in the virtual space, for displaying additional information related with the displayed information objects and for displaying the information related with the displayed information objects in much more detail when it is necessary to interact with the user.
Solution.The method comprises a step for accepting the positional change of a virtual point of view, a step for continuously changing a field of view on the basis of the positional change of the virtual point of view and smoothly display-changing information objects positioned in the field of view, a step for judging whether the information objects positioned in the field of view fulfill prescribed geometrical conditions in the field of view, and a step for performing preliminarily set processing to the information objects fulfilling the prescribed geometrical conditions.
Copyright (C)2003,JPO

Term
Term ended
Projected expiry passed 28 November 2021, 4.8 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
5 claims: 4 independent, 1 dependent
- 1[Claims] 1. A method of displaying an information object, which is a method of arranging a plurality of information objects in a three-dimensional virtual space and displaying the information objects located in the field of view from the set virtual viewpoint. The stage of accepting the position change of the virtual viewpoint and The stage of continuously changing the field of view based on the position change of the virtual viewpoint and smoothly changing the display of the information object located in the field of view. The stage of determining whether an information object located in the field of view satisfies a predetermined geometrical condition in the field of view, and A display method of an information object including a step of executing a process preset for the information object for an information object satisfying a predetermined geometric condition. 【特許請求の範囲】 【請求項1】3次元の仮想空間内に複数の情報オブジェクトを配置し、設定される仮想視点からの視野内に位置する情報オブジェクトを表示する情報オブジェクトの表示方法であって、 前記仮想視点の位置変更を受け付ける段階と、 前記仮想視点の位置変更に基づいて視野を連続的に変更し、視野内に位置する情報オブジェクトを円滑に表示変更する段階と、 視野内に位置する情報オブジェクトが、視野内における所定の幾何的条件を満たすか否かを判別する段階と、 所定の幾何的条件を満たす情報オブジェクトについて、その情報オブジェクトに予め設定された処理を実行する段階と、を含む情報オブジェクトの表示方法。
- 3An information display device for arranging a plurality of information objects in a three-dimensional virtual space and displaying the information objects located in the field of view from the set virtual viewpoint. A visual field data updating means for accepting a change in the position of the virtual viewpoint and An object data processing means that continuously changes the field of view based on the position change of the virtual viewpoint and smoothly changes the display of the information object located in the field of view. A processing execution condition determining means for determining whether or not an information object located in the visual field satisfies a predetermined geometrical condition in the visual field, and For an information object that satisfies a predetermined geometric condition, a visual field movement interlocking processing execution means that executes a process preset for the information object, and Information display device including. 【請求項3】3次元の仮想空間内に複数の情報オブジェクトを配置し、設定される仮想視点からの視野内に位置する情報オブジェクトを表示する情報表示装置であって、 前記仮想視点の位置変更を受け付ける視野データ更新手段と、 前記仮想視点の位置変更に基づいて視野を連続的に変更し、視野内に位置する情報オブジェクトを円滑に表示変更するオブジェクト・データ処理手段と、 視野内に位置する情報オブジェクトが、視野内における所定の幾何的条件を満たすか否かを判別する処理実行条件判定手段と、 所定の幾何的条件を満たす情報オブジェクトについて、その情報オブジェクトに予め設定された処理を実行する視野移動連動処理実行手段と、 を含む情報表示装置。
- 4An information display device for arranging a plurality of information objects in a three-dimensional virtual space and displaying the information objects located in the field of view from the set virtual viewpoint. A visual field data updating means for accepting a change in the position of the virtual viewpoint and An object data processing means that continuously changes the field of view based on the position change of the virtual viewpoint and smoothly changes the display of the information object located in the field of view. Processing execution condition determination means for determining whether or not there is an information object located in the center of the display screen and whose occupancy rate in the display screen is equal to or higher than a predetermined value. An information display device including a visual field movement interlocking process execution means that executes a process preset for the information object based on a determination result of the process execution determination means. 【請求項4】3次元の仮想空間内に複数の情報オブジェクトを配置し、設定される仮想視点からの視野内に位置する情報オブジェクトを表示する情報表示装置であって、 前記仮想視点の位置変更を受け付ける視野データ更新手段と、 前記仮想視点の位置変更に基づいて視野を連続的に変更し、視野内に位置する情報オブジェクトを円滑に表示変更するオブジェクト・データ処理手段と、 表示画面の中心に位置するとともに表示画面中の占有率が所定値以上である情報オブジェクトがあるか否かを判別する処理実行条件判定手段と、 前記処理実行判定手段の判定結果に基づいて、その情報オブジェクトに予め設定された処理を実行する視野移動連動処理実行手段と、を含む情報表示装置。
- 5An information display device for arranging a plurality of information objects in a three-dimensional virtual space and displaying the information objects located in the field of view from the set virtual viewpoint. A visual field data updating means for accepting a change in the position of the virtual viewpoint and An object data processing means that continuously changes the field of view based on the position change of the virtual viewpoint and smoothly changes the display of the information object located in the field of view. An information display device including a visual field movement interlocking processing execution means for executing a process preset for the information object when the distance from the virtual viewpoint of the information object located in the visual field reaches a predetermined value. 【請求項5】3次元の仮想空間内に複数の情報オブジェクトを配置し、設定される仮想視点からの視野内に位置する情報オブジェクトを表示する情報表示装置であって、 前記仮想視点の位置変更を受け付ける視野データ更新手段と、 前記仮想視点の位置変更に基づいて視野を連続的に変更し、視野内に位置する情報オブジェクトを円滑に表示変更するオブジェクト・データ処理手段と、 視野内に位置する情報オブジェクトの仮想視点からの距離が所定値になった場合に、その情報オブジェクトに予め設定された処理を実行する視野移動連動処理実行手段と、を含む情報表示装置。
Independent claims4
161 paragraphs in 1 section, as filed
Description: TECHNICAL FIELD [Detailed description of the invention]
【0001】
[Technical field to which the invention belongs]
The present invention relates to a display method and a display control device for an information object that displays an information object arranged in a three-dimensional virtual space according to a field of view from a set viewpoint.
【0002】
[Conventional technology]
Computers connected to networks such as the Internet can acquire vast amounts of diverse information. In addition, as the capacity of the storage medium increases, it has become possible to use a huge amount of diverse information even in an information device that exists alone.
【0003】
In order to use such a huge and diverse information, GUI (Grafical User Interface) using desktop metaphor such as Microsoft Windows (registered trademark) can be used, or Microsoft Internet Explorer (registered trademark) or Netscape Navigator ( Web browsers such as (registered trademark) are used. These applications statically and flatly arrange and display the information content to be browsed on the screen, and are displayed in the active window in order to browse each information content sequentially. It is necessary to display the next display content instead of the content, or change the active attribute of the window superimposed on the screen to display it.
【0004】
As described above, when the display is switched to display a plurality of information contents, the continuity of the screen is impaired, so that there is a problem that the user cannot understand the mutual relationship between the information contents. In order to solve such a problem, chain-linked information objects are placed in a three-dimensional virtual space, and the information objects are displayed on the display screen based on the field of view defined in this virtual space. An information display method has been proposed that makes it possible to browse information by following links while smoothly changing the display screen by smoothly changing the field of view (Japanese Patent Application No. 2001-162322 (May 30, 2001). Japanese application), Japanese Patent Application Laid-Open No. 2000-172248).
【0005】
Such a prior art will be described with reference to FIGS. 5 and 6. FIG. 5 is a conceptual diagram of the link structure of the information objects linked in a chain, and FIG. 6 is a display example of the information objects linked in a chain. In FIG. 5, the information objects 102 and 103 are related as links 112 and 113 in the information object 101, respectively. In addition, the information objects 104 and 105 are related as links 114 and 115 in the information object 102, respectively. In addition, the information object 106 is associated as a link 116 within the information object 104.
【0006】
In the display example 301 of FIG. 6A, the information object 101 and the information objects 102 and 103 linked to the information object 101 are displayed. When a viewpoint movement instruction is received, the display range is smoothly changed based on this instruction, and the state shifts to, for example, the state of display example 302 in FIG. 6 (B). In this display example 302, the information object 101, the information object 102 linked to the information object 101, and the information objects 104, 105 linked to the information object 102 are displayed.
【0007】
Further, when the movement instruction of the viewpoint is received, the state shifts to the state of the display example 303 of FIG. 6 (C). In this display example 303, the information object 102, the information object 104 linked to the information object 102, and the information object 106 linked to the information object 104 are displayed. Further, when the movement instruction of the viewpoint is received, the state shifts to the state of display example 304 in FIG. 6 (D). In this display example 304, the information object 104 and the information object 106 linked to the information object 104 are displayed.
【0008】
In the display examples 301 to 304, the details of the information object having the largest occupied area on the display screen are displayed, and the context of each information object is set and displayed according to the form of the link. In addition, since the display in the visual field always changes smoothly according to the movement instruction of the viewpoint, it is possible to browse the information object by following the link.
【0009】
[Problems to be Solved by the Invention]
In the information display method as described above, it is possible to easily browse the information linked in a chain by following the link, and it is possible to improve the problem of losing the mutual relationship between each information content. However, it may display additional information related to the displayed information object, display more detailed information related to the displayed information object, or provide a means to do so in situations where interaction with the user is required. , Does not consider executing the application program associated with the information in conjunction with the display of the information.
【0010】
In the present invention, it is possible to browse a large number of information objects arranged in the virtual space while smoothly changing the field of view defined in the virtual space, and display additional information related to the displayed information objects. It displays the information related to the displayed information object in more detail, provides a means for that when interaction with the user is required, and executes the application program associated with the information in conjunction with the display of the information. We propose a configuration that can be used.
【0011】
[Means for solving problems]
The information object display method according to the present invention is an information object display method in which a plurality of information objects are arranged in a three-dimensional virtual space and the information objects located in the field of view from the set virtual viewpoint are displayed. The stage of accepting the position change of the virtual viewpoint, the stage of continuously changing the field of view based on the position change of the virtual viewpoint, and the stage of smoothly changing the display of the information object located in the field of view, and the stage of information located in the field of view. This includes a step of determining whether or not an object satisfies a predetermined geometric condition in a field of view, and a step of executing a process preset for the information object for an information object satisfying the predetermined geometric condition.
【0012】
Here, the process preset for the information object can be configured to display a display image different from the display image of the virtual space located in the field of view. In addition, it can be configured to display another image placed in front of the information object located in the field of view of the virtual space, and it is different from the window in which the information object located in the field of view in the virtual space is displayed. Can be configured to display an image and can be configured to display a different image in a frame in the same window that is different from the frame in which the information object located in the field of view in the virtual space is displayed, message, modal dialog, modeless It can be configured to display at least one of the information related to a dialog or information object.
【0013】
Further, the processing preset in the information object can be configured to execute the preset application program. The information display device according to the present invention is an information display device that arranges a plurality of information objects in a three-dimensional virtual space and displays the information objects located in the field of view from the set virtual viewpoint, and is a virtual viewpoint. A field data updating means that accepts a change in the position of the information object, and an object data processing means that continuously changes the field based on the position change of the virtual viewpoint to smoothly display and change the information object located in the field. A process execution condition determination means for determining whether or not a located information object satisfies a predetermined geometrical condition in a field of view, and a process preset for the information object that satisfies a predetermined geometrical condition are performed. Includes a visual field movement interlocking process execution means to be executed.
【0014】
Further, the information display device according to the present invention is an information display device in which a plurality of information objects are arranged in a three-dimensional virtual space and the information objects located in the field of view from the set virtual viewpoint are displayed. A field data updating means that accepts a change in the position of a virtual viewpoint, and an object data processing means that continuously changes the field based on a change in the position of a virtual viewpoint and smoothly displays and changes an information object located in the field. Based on the processing execution condition determination means that determines whether or not there is an information object that is located in the center of the screen and the occupancy rate in the display screen is equal to or greater than a predetermined value, and the determination result of the processing execution determination means, the information object. Includes a field movement interlocking process execution means for executing a preset process. Further, the information display device according to the present invention is an information display device in which a plurality of information objects are arranged in a three-dimensional virtual space and the information objects located in the field of view from the set virtual viewpoint are displayed. A field data updating means that accepts a change in the position of a virtual viewpoint, an object data processing means that continuously changes the field based on a change in the position of a virtual viewpoint, and smoothly displays and changes an information object located in the field, and a field. It includes a field movement interlocking processing execution means for executing a process preset for the information object when the distance from the virtual viewpoint of the information object located in the information object reaches a predetermined value.
【0015】
BEST MODE FOR CARRYING OUT THE INVENTION
[Summary Configuration] Fig. 1 shows a control block diagram of an information processing apparatus in which one embodiment of the present invention is adopted. The information processing device 500 is composed of a personal computer, a workstation, and other computers, and is composed of an input device 501 such as a keyboard and a mouse, a hard disk, a CD-ROM, and an information storage device 502, which is composed of other information recording devices. Network interface 503 that can be connected to the Internet or LAN, program storage unit 504 such as ROM and hard disk, cache data storage unit 505 composed of memory such as RAM, CRT, display device composed of liquid crystal display device, etc. It includes a 507, a frame memory 506 for storing image data of an image displayed on the display device 507, a data processing unit 510 for generating image data to be displayed on the display device 507, and the like.
【0016】
The data processing unit 510 is composed of a CPU, memory, etc., and includes a processing control function unit 512, a field of view data update function unit 511, an object data processing function unit 514, a field of view movement interlocking processing execution function unit 517, and a display image composition function. Includes part 519 and so on. The object data processing function unit 514 and the visual field movement interlocking processing execution function unit 517 can be configured to exist in a plurality of types according to the type of information object or the visual field movement interlocking processing type, and are generally stored in a program. It can be realized by loading the program stored in the part 504 into the memory and expanding it.
【0017】
Of the data processing units 510, the processing control function unit 512 controls the entire processing. The field of view data update function unit 511 receives an instruction regarding the field of view movement input from the input device 501, moves the virtual viewpoint, and continuously changes the field of view data 513 in the virtual space viewed from the virtual viewpoint.
【0018】
The display image composition function unit 519 synthesizes the partial display images generated by the object data processing function unit 514 and the field of view movement interlocking processing execution function unit 517, respectively, and displays an appropriate display on the display device 507. Generate an image. Object data is stored in the data storage unit 530. The object data is information acquired via the network interface 503 or information stored in the information storage device 502, and there are a plurality of object data corresponding to information objects that are arranged in the virtual space and are candidates for display.
【0019】
As shown in FIG. 2, the object data 531 stored in the data storage unit 530 includes object placement data 532 that defines information regarding the placement of information objects in the virtual space, and object display content data that defines the display contents of information objects. 533, Includes the field movement interlocking process content definition data 534 that defines the content of the process to be executed in conjunction with the field movement and the conditions related to the geometrical relationship between the field and the target object for executing the process.
【0020】
The object data processing function unit 514 performs processing related to a specific type of information object, and includes an object display image generation function unit 515 and a visual field movement interlocking processing function unit 516. Among the object data processing function units 514, the object display image generation function unit 515 generates a display image of an information object based on the current field data 513 of the virtual space in which a plurality of information objects are arranged. Each time the object display image generation function unit 515 generates a new display image frame, the display image of the information object to be displayed is displayed based on the field data 513, the object arrangement data 532, and the object display content data 533. Generate and display Write to frame memory 506 via image composition function unit 519.
【0021】
The visual field movement interlocking processing control function unit 516 controls preset processing execution in conjunction with the visual field movement by referring to the visual field data 513, the object arrangement data 532, and the visual field movement interlocking processing content definition data 534. The field of view movement interlocking processing control function unit 516 is provided with a processing execution condition determination function unit 521, and is based on the field of view data 513, the object arrangement data 532, and the field of view movement interlocking processing content definition data 534. From the geometrical relationship, it is determined whether or not the conditions for processing execution linked to the preset visual field movement have been met. The visual field movement interlocking processing control function unit 516 controls the processing of the visual field movement interlocking processing execution function unit 517 based on the determination result by the processing execution condition determination function unit 521.
【0022】
The visual field movement interlocking processing execution function unit 517 executes the processing specified in the visual field movement interlocking processing content definition data 534 according to the control of the visual field movement interlocking processing control function unit 516. The visual field movement interlocking processing execution function unit 517 includes the visual field movement interlocking information display function unit 518, and among the processes specified in the visual field movement interlocking processing content definition data 534, the display content on the display device 507 is displayed in this visual field. It is generated by the movement interlocking information display function unit 518 and written to the frame memory 506 via the display screen composition function unit 519.
【0023】
With the above configuration, in a virtual space where a plurality of information objects are arranged, the information objects are displayed while the display range is smoothly changed by continuously changing the field of view, and the information objects are preset. When a predetermined geometric condition is satisfied with the visual field, processing such as information display can be executed.
【0024】
[Processing Flow Chart] The operation of the information processing apparatus 500 described above will be described with reference to the flowchart shown in FIG. When the process is started in step S401, the field of view data is updated in step S402. Here, the visual field data update function unit 511 updates the visual field data 513 based on the instruction regarding the visual field movement input from the input device 501.
【0025】
In step S403, the frame memory area (506) for drawing the information object based on the field of view in the virtual space is initialized. In step S404, the information object to be displayed is determined based on the field of view data and the object data. Here, based on the current field of view data 513 and object data 531, the information object that exists in the field of view and is to be displayed is determined in consideration of the distance from the viewpoint and the link relationship with other information objects. To do. It is possible to select multiple information objects to be displayed.
【0026】
In step S405, it is determined whether or not there is an information object that is not displayed among the information objects to be displayed. If it is determined that there is an undisplayed information object, the process proceeds to step S406, and if it is determined that there is no undisplayed information object, the process proceeds to step S409. In step S406, one undisplayed information object is selected from the information objects to be displayed, a display image of the information object is generated based on the field data 513 and the object data 531, and the display image composition function is performed. It is drawn on the target area of the frame memory 506 via the part 519.
【0027】
In step S407, it is determined whether or not the information object selected in step S406 satisfies the execution condition of the field of view movement interlocking process defined in the field of view movement interlocking process content definition data 534. For example, if it exists on the axis that penetrates the center of the display screen and the apparent size is 1/3 or more of the width of the display screen, it is judged that the execution condition of the field of view interlocking process is satisfied, and the process proceeds to step S408. If not, move to step S405.
【0028】
In step S408, the visual field movement interlocking process is executed based on the visual field data 513, the object arrangement data 532, and the visual field movement interlocking process content definition data 534. When the information display on the display screen is instructed in the visual field movement interlocking processing content definition data, the visual field movement interlocking information display function unit 518 creates the display content, and the frame is created via the display image composition function unit 519. Draw in the target area of memory 506. After that, the process proceeds to step S405.
【0029】
In step S409, the contents of the frame memory 506 are output to the display device 507. In step S410, it is determined whether or not to perform processing on the next display image frame. When the process for the next display image frame is performed, the process proceeds to step S402, and when not, the process proceeds to step S411 to end the process.
【0030】
The geometrical relationship between the field of view and the information object in the three-dimensional virtual space can be represented, for example, as shown in FIG. The display state of the information object 605 arranged in the three-dimensional virtual space changes based on the relative relationship with the current viewpoint 601. As shown in the figure, the inside of the quadrangular pyramid-shaped area having the viewpoint 601 as the apex is the field of view displayed on the display screen. When the field of view changes due to the movement of the viewpoint 601 and the change of the elevation angle, the position of the information object 605 with respect to the field of view changes, and the display screen changes smoothly.
【0031】
The determination of the execution condition of the visual field movement interlocking process in the processing execution condition determination function unit 521 is based on, for example, the relationship between the visual field coordinate system 603 with the viewpoint 601 as the origin and the local coordinate system 604 with the center point of the information object 605 as the origin. It can be configured to determine whether a particular condition is met. [Link structure of information objects] An example of the link structure of the information object group to be displayed will be described with reference to the conceptual diagram of FIG.
【0032】
Here, the visual field movement interlocking processes 221-226 are attached to the information objects 201-206 linked in a chain by the links 212-216. In the illustrated example, the information object 201 is provided with links 212 and 213 of the information objects 202 and 203, and is accompanied by the visual field movement interlocking process 221 for displaying a message. The information object 202 is provided with links 214,215 of the information objects 204,205, and is accompanied by a visual field movement interlocking process 222 for displaying a modal dialog.
【0033】
The information object 203 is accompanied by the visual field movement interlocking process 223 that starts the application X. The information object 204 is provided with a link 216 of the information object 207, and is accompanied by a visual field movement interlocking process 224 that displays the document A in a separate window. The information object 205 is accompanied by a visual field movement interlocking process 225 that displays a modeless dialog. The information object 206 is accompanied by a visual field movement interlocking process 226 that displays the document B in a separate window.
【0034】
When the information objects 201 to 206 to be displayed satisfy the execution conditions of the predefined field of view movement interlocking processes, these field of view movement interlocking processes 221-226 are executed. Figures 8 to 14 show examples of display screens when the field of view is changed by moving the viewpoint with respect to the information object group to be displayed.
【0035】
FIG. 8 shows an example of displaying a message in conjunction with the movement of the visual field. In the display example 311 of FIG. 8 (A), the information objects 201, 202, 203 are displayed. Here, each of the information objects 201 to 203 is not in a state that satisfies the execution conditions of the respective field of view movement interlocking processes. Display example 312 in FIG. 8B is a state in which the viewpoint is moved forward to advance the entire field of view, and each information object 201 to 203 is displayed larger than in the case of display example 311. At this time, the execution condition of the visual field movement interlocking process 221 attached to the information object 201 is satisfied, and the message 231 is displayed.
【0036】
In the display example 313 of FIG. 8C, the viewpoint is further moved from the display example 312 to advance the entire field of view, and each information object 201 to 203 is displayed larger than in the case of the display example 312. ing. At this time, the execution condition of the visual field movement interlocking process 221 accompanying the information object 201 is no longer satisfied, and the message is hidden.
【0037】
FIG. 9 shows an example of displaying a modal dialog in conjunction with the movement of the field of view. Here, the modal dialog is a dialog that does not accept operations other than the operations on the dialog during display. In the display example 321 of FIG. 9 (A), the state is the same as that of FIG. 8 (C), and the information object 202 is displayed near the center. Information objects 204 and 205 are linked to this information object 202, but they are not yet displayed in this display example 321.
【0038】
The display example 322 of FIG. 9B is a state in which the viewpoint is slightly advanced from the display example 321 and the processing conditions of the visual field movement interlocking process 222 attached to the information object 202 are satisfied, and the modal dialog 232 is displayed. Has been done. The modal dialog 232 here displays a password input box, an OK function button, and a cancel function button. In this state, the visual field movement interlocking processing execution function unit 517 is configured to block instructions related to visual field movement, and either enter a predetermined password in the password input box and click the OK function button or cancel function. Operations other than clicking the button are not accepted.
【0039】
In the modal dialog 232 of display example 322, when an appropriate password is entered and the OK function button is clicked, the field of view movement interlocking processing execution function unit 517 cancels the blocking of the field of view movement operation, enables the field of view movement, and provides information. The information objects 204 and 205 linked from the object 202 are made displayable. As a result, the state shown in Display Example 323 of FIG. 9 (C) is obtained.
【0040】
FIG. 10 shows an example of displaying the related information of the information object in conjunction with the movement of the visual field. Here, the information related to the information object can be composed of, for example, a Web page related to the information object to be displayed. Further, in this example, the information related to the information object is displayed in the document display window 233 opened in front of the information object display image based on the field of view in the virtual space on the display screen.
【0041】
The display example 331 of FIG. 10 (A) is in a state where the field of view is further advanced from the display example 323 of FIG. 9 (C), and the information objects 202 and 204 are displayed. In the display example 332 of FIG. 10B, the field of view is slightly advanced from the display example 331, the information object 204 is displayed in a large size, and the information object 206 linked to the information object 204 is also displayed. It is displayed. Further, the execution condition of the visual field movement interlocking process 224 attached to the information object 204 is satisfied, the document display window 233 is displayed in the foreground, and the document A is displayed in the document window 233.
【0042】
The display example 333 of FIG. 10C is a state in which the field of view is slightly advanced from the display example 332, and the information objects 204 and 206 are displayed slightly larger. At this time, since the execution condition of the visual field movement interlocking process 224 is continuously satisfied, the document A in the document display window 233 is still displayed. The display position and size of the document window 233 do not change in conjunction with the movement of the visual field, and are displayed at a fixed position on the display screen. It should be noted that the position of the document window 233 may be changed according to the display position of this information object so as to avoid the area where the main information object is displayed among the information objects to be displayed. it can.
【0043】
The display example 334 of FIG. 10D is a state in which the field of view is slightly advanced from the display example 333, and the information object 206 is displayed in a large size. At this time, the execution condition of the visual field movement interlocking process 226 attached to the information object 206 is satisfied, and the document B is displayed in the document display window 233 instead of the document A. FIG. 11 is an example of displaying a display image of an information object based on the visual field in the virtual space in the information object display window 234, and is a case where the related information of the information object linked to the visual field movement is displayed as in FIG. Shown.
【0044】
The display example 341 of FIG. 11A displays the information object 202 to be displayed in the information object display window 234. When the field of view of the information object display window 234 of the display example 341 is advanced and the execution condition of the field of view movement interlocking process 224 accompanying the information object 204 is satisfied, as shown in the display example 342 of FIG. 11B, the document Launch display window 233 to display document A. Similarly, when the execution condition of the visual field movement interlocking process 226 accompanying the information object 206 is satisfied, the document B is displayed in the document display window 233 as shown in the display example 343 of FIG. 11 (C).
【0045】
FIG. 12 shows an example of displaying the display image of the information object based on the field of view in the virtual space and the related information of the information object in different frames in the browser window 235 on the display screen. Here, as in FIGS. 10 and 11, the case where the related information of the information object linked to the visual field movement is displayed is shown. In the display example 351 of FIG. 12 (A), for example, a Web browser such as Microsoft Internet Explorer (registered trademark) is used, and the document S is displayed in the browser window 235.
【0046】
The display example 352 of FIG. 12B is a state when the link for calling the next display is clicked in the document S displayed in the display example 351. Here, the information object display frame 236 and the document display frame 237 are displayed in the browser window 235, and the information object 202 and the like are displayed in the information object display frame 235 based on the field of view defined in the virtual space. The document T is displayed in the document display frame 237.
【0047】
The display example 353 of FIG. 12C is a state in which the field of view is slightly advanced in the information object display frame 236 of the display example 352, the information object 204 is displayed in a large size, and the field of view movement interlocking associated with the information object 204 is interlocked. The execution condition of process 224 is satisfied, and document A is displayed in place of document T in the document display frame 237.
【0048】
The display example 354 of FIG. 12 (D) is a state in which the visual field is slightly advanced in the information object display frame 236 of the display example 353, the information object 206 is displayed in a large size, and the visual field movement interlocking associated with the information object 206 is interlocked. The execution condition of process 226 is satisfied, and document B is displayed in place of document A in the document display frame 237.
【0049】
FIG. 13 is an example of displaying a modeless dialog in conjunction with the movement of the field of view. Here, the modeless dialog is a dialog in which other operations are not blocked even if the dialog is displayed. In the display example 361 of FIG. 13 (A), the information objects 202, 204, 205 are displayed.
【0050】
The display example 362 of FIG. 13B is a state in which the field of view is slightly advanced from the display example 361, the information object 205 is displayed in a large size, and a sample of the moving image included in the information object 205 is displayed as a still image. There is. Here, the execution condition of the visual field movement interlocking process 225 attached to the information object 205 is satisfied, and the modeless dialog 238 is displayed. In the modeless dialog 238 in this example, a play button for instructing the playback of the moving image is set, and it is possible to play the moving image in which the sample is displayed as a still image. Note that the state in which the modeless dialog 238 is displayed is different from the case in which the modal dialog is displayed, and it is possible to move the field of view from this state.
【0051】
The display example 363 of FIG. 13C is an image displayed when the play button of the modeless dialog 362 is clicked in the display example 362, and the moving image is reproduced on the information object 205. Further, as shown in the figure, it is possible to display a modeless dialog provided with a stop button for stopping the reproduction of the moving image during the reproduction of the moving image.
【0052】
The display example 364 of FIG. 13 (D) shows a state in which the field of view is slightly advanced from the display example 363, the information object 205 is displayed slightly larger, and the moving image is continuously reproduced. FIG. 14 shows an example in which the application is executed in conjunction with the movement of the visual field. In the display example 371 of FIG. 14 (A), the information objects 201, 202, 203 are displayed.
【0053】
The display example 372 of FIG. 14B is a state in which the visual field is slightly advanced from the display example 371, the information object 203 is displayed in a large size, and the execution conditions of the visual field movement interlocking process 223 accompanying the information object 203 are set. Satisfied and displaying a modeless dialog 239 to confirm application launch. This modeless dialog 239 is provided with an OK function button and a cancel function button for starting the application, and the application can be started by clicking the OK function button.
【0054】
When the OK function button is clicked, the modeless dialog 239 is hidden and the application window 240 is opened instead, and the application can be used, as shown in FIG. 14 (C). [Other Embodiments] In the above-described embodiment, the execution conditions of the visual field movement interlocking process are determined based on the geometrical relationship between the visual field and each information object, but other conditions can also be used. For example, the priority value is calculated for all the information objects to be displayed, the information object with the highest priority value is set as the representative object, and the execution condition of the field of view movement interlocking process is determined only for the representative object. You may. It is also possible to set conditions unrelated to visual field movement.
【0055】
For example, it can be configured to execute the visual field movement interlocking process for an information object located in the center of the screen and whose apparent size is equal to or larger than a predetermined value (for example, 1/3 or more) of the width of the screen. In this case, when there are a plurality of information objects satisfying the conditions, the information objects having a lower link relationship can be preferentially executed.
【0056】
<Additional Notes> (Appendix 1) A method of displaying an information object in which a plurality of information objects are arranged in a three-dimensional virtual space and the information objects located in the field of view from the set virtual viewpoint are displayed, and the position of the virtual viewpoint. The stage of accepting the change, the stage of continuously changing the field of view based on the position change of the virtual viewpoint and smoothly changing the display of the information object located in the field of view, and the stage of changing the display of the information object located in the field of view are in the field of view. A method of displaying an information object including a step of determining whether or not a predetermined geometrical condition is satisfied in the above, and a stage of executing a process preset for the information object for the information object satisfying the predetermined geometrical condition. ..
【0057】
(Appendix 2) The process preset for the information object is the display method of the information object described in Appendix 1, which displays a display image different from the display image of the virtual space located in the field of view. (Appendix 3) The method for displaying an information object according to Appendix 2, which displays another image arranged in front of the information object located in the field of view of the virtual space.
【0058】
(Appendix 4) The method of displaying the information object described in Appendix 2 in which another image is displayed in a window different from the window in which the information object located in the field of view in the virtual space is displayed. (Appendix 5) The method of displaying the information object described in Appendix 2 in which another image is displayed in a frame in the same window different from the frame in which the information object located in the field of view in the virtual space is displayed.
【0059】
(Appendix 6) A method of displaying an information object according to Appendix 2, which displays at least one of information related to a message, a modal dialog, a modeless dialog, and an information object. (Appendix 7) The process preset for the information object is the method for displaying the information object described in any of the appendices 1 to 6, which executes the preset application program.
【0060】
(Appendix 8) An information display device that arranges a plurality of information objects in a three-dimensional virtual space and displays the information objects located in the field of view from the set virtual viewpoint, and changes the position of the virtual viewpoint. The receiving field data updating means, the object data processing means that continuously changes the field based on the position change of the virtual viewpoint and smoothly displays and changes the information object located in the field, and the information located in the field. A process execution condition determining means for determining whether or not an object satisfies a predetermined geometrical condition in the field of view, and a field of view for executing a process preset for the information object for an information object satisfying the predetermined geometrical condition. An information display device including a movement interlocking process execution means.
【0061】
(Appendix 9) An information display device that arranges a plurality of information objects in a three-dimensional virtual space and displays the information objects located in the field of view from the set virtual viewpoint, and changes the position of the virtual viewpoint. The field data update means that accepts, the object data processing means that continuously changes the field based on the position change of the virtual viewpoint and smoothly displays and changes the information object located in the field, and the position at the center of the display screen. The information object is preset based on the processing execution condition determination means for determining whether or not there is an information object whose occupancy rate in the display screen is equal to or higher than a predetermined value and the determination result of the processing execution determination means. An information display device including a field movement interlocking processing execution means for executing the processing.
【0062】
(Appendix 10) An information display device that arranges a plurality of information objects in a three-dimensional virtual space and displays the information objects located in the field of view from the set virtual viewpoint, and changes the position of the virtual viewpoint. The field of view data update means that accepts, the object data processing means that continuously changes the field of view based on the position change of the virtual viewpoint and smoothly displays and changes the information object located in the field of view, and the information located in the field of view. An information display device including a visual field movement interlocking processing execution means for executing processing preset for the information object when the distance from the virtual viewpoint of the object reaches a predetermined value.
【0063】
[Effect of the invention]
In the present invention, while smoothly changing the field of view defined in the virtual space, a large number of information objects arranged in the virtual space can be browsed, and additional information related to the information object to be displayed can be displayed. It is possible to provide a means for interacting with the user when there is a need for it, and to execute an application program associated with the information in conjunction with the information object.
[Simple explanation of drawings]
[Figure 1]
The functional block diagram which shows the structure of 1 Embodiment of this invention.
[Figure 2]
A functional block diagram showing the details.
[Fig. 3]
Control flowchart.
[Fig. 4]
Explanatory drawing showing the geometrical relationship between the field of view and the information object in the three-dimensional virtual space.
[Fig. 5]
Explanatory drawing which shows an example of the link structure of a group of information objects.
[Fig. 6]
Explanatory drawing which shows the link structure of the information object group by the prior art.
[Fig. 7]
Explanatory drawing which shows the link structure of the information object group to be displayed in this invention.
[Fig. 8]
Explanatory drawing which shows the display example of the message linked with the field of view movement.
[Fig. 9]
Explanatory drawing which shows the display example of the modal dialog interlocked with the field of view movement.
[Fig. 10]
Explanatory drawing which shows the display example of the related information linked with the visual field movement.
[Fig. 11]
Explanatory drawing which shows the display example of the related information linked with the visual field movement in another window.
[Fig. 12]
An explanatory diagram showing an example of displaying related information linked to visual field movement in another frame.
[Fig. 13]
Explanatory drawing which shows the display example of the modeless dialog interlocked with the field of view movement.
[Fig. 14]
Explanatory drawing which shows the display example of application execution linked with the field of view movement.
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| JP2006228142A | Cited by | Japan | Examiner |
| WO2010073616A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| JP2017120612A | Cited by | Japan | Search report |
| JP2008027001A | Cited by | Japan | Search report |
| US7932903B2 | Cited by | United States of America | Applicant |
| US10235776B2 | Cited by | United States of America | Applicant |
| JP6025280B1 | Cited by | Japan | Search report |
| US9204050B2 | Cited by | United States of America | Applicant |
| KR100892902B1 | Cited by | Republic of Korea | Search report |
| WO2006090526A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
2 priority claims, no other members on record
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 2001363240 | Japan | A | |
| JP20010363240 | – | – | – |
12 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Notification of resignation of power of attorneyRD04 | RD04 | |
| Notification of acceptance of power of attorneyRD02 | RD02 | |
| Removal of reconsideration by examiner before appeal (zenchi)AppealA912 | A912 | |
| Transfer of reconsideration by examiner before appeal (zenchi)AppealA911 | A911 | |
| Written amendmentA521 | A521 | |
| Decision of refusalA02 | A02 | |
| Written amendmentA521 | A521 | |
| Notification of reasons for refusalA131 | A131 | |
| Written amendmentA521 | A521 | |
| Notification of reasons for refusalA131 | A131 | |
| Report on retrievalA977 | A977 | |
| Written request for application examinationA621 | A621 |
Numbers
- Publication
- 2003-167659
- Publication, DOCDB
- 2003167659
- Publication, EPODOC
- JP2003167659
- Application
- 363240
- Application, DOCDB
- 2001363240
- Application, EPODOC
- JP20010363240
Titles2
- Japanese
- 【発明の名称】情報処理装置および情報オブジェクトの表示方法
- English
- PROBLEM TO BE SOLVED: To display an information processing device and an information object.
Classification
- CPC, 2
- G06T15/20
- G06T2200/24
- IPC, 4
- G06F13 00
- G06T15 20
- G06T19 00
- G06F3 048