Virtual space image display method, apparatus, virtual space image display program, and recording medium
Claim Score by NHIP
Abstract
Three-dimensional map data of drawing objects in respective division areas and distant view images in respective directions on map data, which are obtained when viewing is made from insides of the respective division areas, are held in a recording medium, three-dimensional map data of a drawing object for a near view positioned in a sight line direction at a point of interest is retrieved from the three-dimensional map data based on position information of the point of interest and sight line direction information, and is converted into a map image based on a perspective drawing method. A distant view image obtained in the sight line direction is retrieved from the distant view images held in the recording medium based on the position information of the point of interest and the sight line direction information, and the retrieved distant view image is overwritten with the map image for the near view to combine them.

Term
Projected expiry 3 November 2026.
- Priority
- Filed
- Published
- Today
- Projected expiry
17 claims: 4 independent, 13 dependent
- 1A virtual space image display method in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the virtual space image display method comprising the steps of:holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas;holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions;acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
- 9Broadest claimClaim Score 17, narrow(NHIP)A virtual space image display apparatus in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the virtual space image display apparatus comprising:a recording medium that holds three-dimensional map data of drawing objects in respective division areas which are obtained by dividing the map data into specified areas, and distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, for the respective division areas;point-of-interest acquisition means for acquiring position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;neighboring map data retrieval means for retrieving three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;real-time rendering means for performing a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;distant view data retrieval means for retrieving a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;and combining means for overwriting the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and for drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
- 15A computer readable recording medium recording a virtual space image display program in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the computer-readable recording medium recording the virtual space image display program for causing a computer to execute the processes of:holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas;holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions;acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
- 17A virtual space image display apparatus in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the virtual space image display apparatus comprising:a recording medium that holds three-dimensional map data of drawing objects in respective division areas which are obtained by dividing the map data into specified areas, and distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, for the respective division areas;a point-of-interest acquisition unit configured to acquire position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;a neighboring map data retrieval unit configured to retrieve three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;a real-time rendering unit configured to perform a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;a distant view data retrieval unit configured to retrieve a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;and a combining unit configured to overwrite the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and to draw and display them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
Independent claims4
115 paragraphs in 5 sections, as filed
CROSS REFERENCE TO RELATED APPLICATIONS
0001The present invention contains subject matter related to Japanese Patent Application JP 2005-323757 filed in the Japanese Patent Office on Nov. 8, 2005, the entire contents of which being incorporated herein by reference.
BACKGROUND OF THE INVENTION
00021. Field of the Invention
0003The present invention relates to a virtual space image display method, apparatus, a virtual space image display program and a recording medium, that enables drawing of a map image which is close to an actual landscape and is based on a perspective drawing method.
00042. Background Art
0005In related art, when a map image based on a perspective drawing method is drawn, it becomes necessary to perform a processing of extracting a building as a drawing object from map data. As an extraction method of the building as the drawing object, a specific region from a present position or a point of interest is made the drawing object, and data of the building included in the region is extracted. In a map drawing system for drawing the three-dimensional map image based on the perspective drawing method as stated above, since the data amount for buildings to be drawn is limited and the drawing speed is lowered, buildings in a wide region can not be drawn, and buildings in a region neighboring the present position or the point of interest are drawn.
0006As an apparatus which extracts a drawing object from map data as stated above and creates an image in a sight line direction in a virtual space by a perspective drawing method, there is a virtual space display apparatus including a distant view rendering section in which an object group stored in a distant view object storage section is made an object, a view point is placed at the origin of a coordinate system, a sight line is directed in a direction stored in a sight line direction register, and an image to be obtained in a case where viewing is made in the virtual space is created by the perspective drawing method and is stored in a frame memory, a near view rendering section in which an object group stored in a near view object storage section is made an object, the view point is placed at a position stored in a view point position register, the sight line is directed in the direction stored in the sight line direction register, and an image to be obtained in a case where viewing is made in the virtual space is created by the perspective drawing method and is stored in the frame memory, and a distant view and near view combining section which first starts the distant view rendering section in a case where content of the view point position register or the sight line direction register is updated by an input control section, and next starts the near view rendering section (JP-A-10-83465 (patent document 1)).
SUMMARY OF THE INVENTION
0007In the virtual space display apparatus of the related art, the drawing object is extracted from the map data, the image in the sight line direction in the virtual space is created by the perspective drawing method, and the distant view and the near view are combined and displayed. With respect to the distant view image, in the case where the content of the view point position register or the sight line direction register is updated, the object group stored in the distant view object storage section is made the object, the view point is placed at the origin of the coordinate system, the sight line is directed in the direction stored in the sight line direction register, and the distant view image to be obtained in the case where the viewing is made in the virtual space is created by the perspective drawing method and is stored in the frame memory. Besides, also with respect to the near view image, in the case where the content of the view point position register or the sight line direction register is updated, the object group stored in the near view object storage part is made the object, the viewpoint is placed at the position stored in the view point position register, the sight line is directed in the direction stored in the sight line direction register, and the near view image to be obtained in the case where the viewing is made in the virtual space is created by the perspective drawing method and is stored in the frame memory. Then, the distant view image and the near view image are combined and displayed.
0008As stated above, the object group stored in the distant view object storage section is made the object, and the distant view image is required to be created each time the content of the view point position register or the sight line direction register is updated. Thus, under the situation in which the update of the content of the view point position register or the sight line direction register is repeated in a short time, in order to draw the realistic distant view image, it becomes necessary to perform the processing to create the distant view image by the perspective drawing method each time the content of the view point position register or the sight line direction register is updated. And then, the distant view image, such as a building or a mountain, which should be seen actually on the background of the near view image is displayed.
0009Thus, there has been a problem that in order to perform the realistic image display in which the distant view image, such as the building or mountain, which should be actually seen on the background of the near view image is displayed, the load in the apparatus including a CPU (Central Processing Unit) for creating the distant view image is increased and the speedup of the processing speed can not be avoided.
0010In view of the above circumstances, it is desirable to provide a virtual space image display method, apparatus, a virtual space image display program and a recording medium, in which an increase in the load of an apparatus including a CPU is avoided at a time when a distant view image close to an actual landscape, which should be actually seen on the background of a near view image, is displayed, and a realistic map image based on a perspective drawing method can be drawn without enhancing the processing speed.
0011According to an embodiment of the present invention, there is provided a virtual space image display method in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, and the virtual space image display method includes the steps of holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas, holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions, acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0012A virtual space image display apparatus according to another embodiment of the invention is a virtual space image display apparatus in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, and the virtual space image display apparatus includes a recording medium that holds three-dimensional map data of drawing objects in respective division areas which are obtained by dividing the map data into specified areas, and distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, for the respective division areas, point-of-interest acquisition means for acquiring position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, neighboring map data retrieval means for retrieving three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, real-time rendering means for performing a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, distant view data retrieval means for retrieving a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and combining means for overwriting the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and for drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0013A virtual space image display program according to another embodiment of the invention is a virtual space image display program for causing a computer to draw and display, when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, and causes the computer to execute the processes of holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas, holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions, acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0014A recording medium according to another embodiment of the invention is a computer readable recording medium recording a virtual space image display program in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, and computer-readably records the virtual space image display program for causing a computer to execute the processes of holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas, holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions, acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0015According to the embodiment of the invention, since the distant view image is previously held in the recording medium, it is unnecessary to perform the rendering processing at the time when the distant view image is drawn, it has only to be retrieved and read out from the recording medium, and there is an effect that the virtual space image display method/apparatus, the virtual space image display program and the recording medium can be provided in which an increase in the load of the apparatus including the CPU can be avoided as compared with the case where the rendering processing is performed each time the position of the point of interest, the sight line direction or the traveling direction is changed and the distant view image is drawn.
0016Besides, since the distant view image is created for each of the division areas so as to have a size corresponding to the distance between the division area and the drawing object for the distant view, there is an effect that the virtual space image display method/apparatus, the virtual space image display program and the recording medium can be provided in which the map image which is based on the perspective drawing method and in which the realistic distant view image is drawn on the background can be drawn without enhancing the processing speed.
BRIEF DESCRIPTION OF THE DRAWINGS
0017<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram showing a hardware structure of a virtual space image display apparatus to which a virtual space image display method of embodiment 1 of the invention is applied.
0018<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram showing a structure of software to realize the virtual space image display method of the embodiment 1 of the invention.
0019<figref idref="DRAWINGS">FIG. 3</figref> is a flowchart showing the virtual space image display method of the embodiment 1 of the invention.
0020<figref idref="DRAWINGS">FIG. 4</figref> is a flowchart showing the virtual space image display method of the embodiment 1 of the invention.
0021<figref idref="DRAWINGS">FIG. 5</figref> is a flowchart showing the virtual space image display method of the embodiment 1 of the invention.
0022<figref idref="DRAWINGS">FIG. 6</figref> is an explanatory view showing an example of division areas for explaining three-dimensional map data in the embodiment 1 of the invention.
0023<figref idref="DRAWINGS">FIG. 7</figref> is an explanatory view of the division areas in the embodiment 1 of the invention and three-dimensional map data stored in an external storage device for the respective division areas.
0024<figref idref="DRAWINGS">FIG. 8</figref> is a conceptual view for explaining distant view data in the embodiment 1 of the invention.
0025<figref idref="DRAWINGS">FIG. 9</figref> is an explanatory view showing an example of distant view data stored in the external storage device in the embodiment 1 of the invention.
0026<figref idref="DRAWINGS">FIG. 10</figref> is an explanatory view showing, in the embodiment 1 of the invention, a distant view image, a map image in the vicinity of a point of interest and based on a perspective drawing method, which is overwritten on the distant view image, and a map image in the vicinity of the point of interest and based on the perspective drawing method, in which the distant view image is drawn on the background.
0027<figref idref="DRAWINGS">FIG. 11</figref> is an explanatory view showing a change in the distant view image drawn in the case where the point of interest in the embodiment 1 of the invention is moved in the order of division area E<b>9</b>→E<b>10</b>→E<b>11</b>.
0028<figref idref="DRAWINGS">FIG. 12</figref> is a block diagram showing a structure of an in-vehicle navigation apparatus of embodiment 2 of the invention.
0029<figref idref="DRAWINGS">FIG. 13</figref> is a block diagram showing a structure of a portable navigation apparatus of embodiment 3 of the invention.
DETAILED DESCRIPTION OF THE INVENTION
0030According to an embodiment of the present invention, there is provided a virtual space image display method in which an increase in the load of an apparatus including a CPU is avoided at the time when a distant view image close to an actual landscape, which should be actually seen on the background of a near view image, is displayed, and a realistic map image based on a perspective drawing method can be drawn without enhancing the processing speed, and the virtual space image display method is realized such that three-dimensional map data of drawing objects in respective division areas obtained by dividing the map data into specified ranges are held in a recording medium for the respective division areas, distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, are held in the recording medium while the distant view images are made to correspond to the division area and the directions, point-of-interest acquisition means acquires position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, neighboring map data retrieval means retrieves three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, on the basis of the acquired position information of the point of interest and the sight line direction information from the three-dimensional map data held in the recording medium, real-time rendering means performs a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, distant view data retrieval means retrieves a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, on the basis of the acquired position information of the point of interest and the sight line direction information from the distant view images held in the recording medium, and combining means overwrites the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and draws and displays them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0031Besides, according to another embodiment of the present invention, there is provided a virtual space image display apparatus in which an increase in the load of the apparatus including a CPU is avoided at the time when a distant view image close to an actual landscape, which should be actually seen on the background of a near view image, is displayed, and a realistic map image based on a perspective drawing method can be drawn without enhancing the processing speed, and the virtual space image display apparatus is realized such that three-dimensional map data of drawing objects in respective division areas which are obtained by dividing the map data into specified areas, and distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, are held in a recording medium for the respective division areas, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest are acquired by point-of-interest acquisition means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, is retrieved by neighboring map data retrieval means from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, the retrieved three-dimensional map data is subjected to a rendering processing by real-time rendering means to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists is retrieved by distant view data retrieval means from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and the drawing object for the near view converted into the map image based on the perspective drawing method is overwritten on the retrieved distant view image by combining means to combine them, and they are drawn and displayed as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0032Besides, according to another embodiment of the present invention, there is provided a virtual space image display program in which an increase in the load of an apparatus including a CPU is avoided at the time when a distant view image close to an actual landscape, which should be actually seen on the background of a near view image, is displayed, and a realistic map image based on a perspective drawing method can be drawn without enhancing the processing speed, and the virtual space image display program is realized by causing a computer to execute the processes of holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas, holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions, acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
0033Besides, according to another embodiment of the present invention, there is provided a recording medium in which an increase in the load of an apparatus including a CPU is avoided at the time when a distant view image close to an actual landscape, which should be actually seen on the background of a near view image, is displayed, and a realistic map image based on a perspective drawing method can be drawn without enhancing the processing speed, and the recording medium is realized by computer-readably recording a virtual space image display program for causing a computer to execute the processes of holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas, holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions, acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest, retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method, retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information, and overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.
Embodiment 1
0034<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram showing a hardware structure of a virtual space image display apparatus to which a virtual space image display method of embodiment 1 is applied. This virtual space image display apparatus includes a RAM (Random Access Memory) <b>1</b>, a ROM (Read Only Memory) <b>2</b>, an external storage device (recording medium) <b>3</b> which previously stores three-dimensional map data including information indicating positions and forms of constructions, such as roads and buildings, of map data divided into specified division areas, and distant view data indicating distant view images for the respective division areas and having been previously subjected to a rendering processing, a display device <b>4</b>, a display interface <b>5</b> for transmitting/receiving various signals to display map images based on a perspective drawing method to/from the display device <b>4</b>, an input device <b>6</b> including a keyboard, a mouse or an operation pad for variously operating the virtual space image display apparatus, an interface <b>7</b> for inputting, as an electric signal, the operation of a user through the input device <b>6</b> to the virtual space image display apparatus, a GPS receiver <b>9</b> provided with a GPS (Global Positioning System) antenna <b>8</b>, an interface <b>10</b> through which a CPU <b>13</b> transmits/receives various signals to/from the GPS receiver <b>9</b>, a geomagnetic sensor <b>11</b> that detects terrestrial magnetism and outputs an orientation signal with a specified resolution for determining the orientation of a sight line direction or a traveling direction, and an interface <b>12</b> through which the CPU <b>13</b> transmits/receives various signals including the orientation signal outputted from the geomagnetic sensor <b>11</b> to/from the geomagnetic sensor <b>11</b>.
0035The external storage device <b>3</b> may be a storage device which can read/write data from/to various disks including a hard disk and an optical disk or a recording medium such as a semiconductor memory, or may be a server system which can configure a database.
0036<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram showing a structure of software for realizing the virtual space image display method.
0037The structure of the software includes point-of-interest acquisition means <b>21</b>, drawing region calculation means <b>22</b>, map data retrieval means <b>23</b>, neighboring map data retrieval means <b>24</b>, distant view data retrieval means <b>25</b>, three-dimensional map data <b>31</b>, distant view data <b>33</b>, map data reading means (combining means) <b>26</b>, real-time rendering means <b>27</b>, and display means (combining means) <b>28</b>.
0038The point-of-interest acquisition means <b>21</b>, the drawing region calculation means <b>22</b>, the map data retrieval means <b>23</b>, the neighboring map data retrieval means <b>24</b>, the distant view data retrieval means <b>25</b>, the map data reading means <b>26</b>, the real-time rendering means <b>27</b>, and the display means <b>28</b> are stored as programs in the ROM <b>2</b>.
0039The three-dimensional map data <b>31</b> is stored, as three-dimensional data including information indicating positions and forms of constructions, such as roads and buildings, for respective specified division areas defined by longitude and latitude information on map data, in the external storage device <b>3</b> for the respective specified division areas.
0040With respect to the distant view data <b>33</b>, in each of the specified division areas, an image seen as a distant view in the case where viewing is made from the inside of the division area to the east, west, south and north is previously subjected to a rendering processing to form a distant view image, and the distant view data is stored as the distant view image in the external device <b>3</b>. The distant view image includes artificial constructions such as buildings, and natural objects such as mountains, rivers and trees.
0041Incidentally, in this embodiment 1, although the shape of the division area is the rectangle obtained by dividing the map mesh of the Geographical Survey Institute, no limitation is made to the map mesh of the Geographical Survey Institute, and a map by another publisher and having another form may be used. Besides, it is not necessary to limit the shape of the division area to the rectangle, and another shape such as a hexagon or a circle may be adopted.
0042The point-of-interest acquisition means <b>21</b> realizes a function to acquire position information of a point of interest and sight line direction information concerning a sight line direction or a traveling direction from the latitude and longitude information detected based on the GPS signal received by the GPS receiver <b>9</b> from the GPS satellite, and to determine the division area where the point of interest is included.
0043Incidentally, the point-of-interest acquisition means <b>21</b> can also acquire the position information of the point of interest or the present position by using a portable telephone including a PHS (Personal Handy-phone System).
0044Besides, in the case where the point of interest, and the sight line direction or the traveling direction at the point of interest are directly inputted and set from the input device including the keyboard, the mouse or the operation pad by the operation of the user on the map data displayed on the display device <b>4</b>, the position information of the point of interest and the sight line direction information are acquired from the latitude and longitude information of the inputted and set point of interest, and the sight line direction or the traveling direction at the point of interest, and the division area where the point of interest is included can be determined.
0045Besides, in the case where the latitude and longitude information of the point of interest, and the sight line direction or the traveling direction at the point of interest are directly inputted and set from the input device including the keyboard, the mouse or the operation pad by the operation of the user, the position information of the point of interest is acquired from the inputted and set latitude and longitude information, the sight line direction information is acquired from the inputted and set sight line direction or traveling direction, and the division area where the point of interest is included can be determined.
0046The drawing region calculation means <b>22</b> has a function to calculate, as a drawing region near a point of interest, a specific region on the map data in the sight line direction or the traveling direction from the point of interest acquired by the point-of-interest acquisition means <b>21</b>.
0047The drawing region near the point of interest is calculated as a triangular or fan-shaped region defined by, for example, the position of the point of interest, the sight line direction information of the sight line direction or the traveling direction at the point of interest, a visual field range around the direction, and a drawing distance from the point of interest.
0048The three-dimensional data in the drawing region near the point of interest is extracted from the three-dimensional map data <b>31</b>, and is drawn as the map image near the point of interest and based on the perspective drawing method. The map image based on the perspective drawing method includes artificial constructions such as roads and buildings, and natural objects such as roadside trees and rivers.
0049The drawing region calculation means <b>22</b> has a function to calculate a drawing region of a distant view image as the background of the map image near the point of interest drawn based on the division area where the point of interest acquired by the point-of-interest acquisition means <b>21</b> is included and the calculated drawing region near the point of interest. The calculation of the drawing region of the distant view image is performed by, for example, calculating the range of the distant view image of the division area which is included in the visual field range of the drawing region near the point of interest and in which the point of interest exists.
0050The map data retrieval means <b>23</b> has a function to retrieve three-dimensional data in the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> from the three-dimensional map data <b>31</b>, and to retrieve distant view data corresponding to the division area, where the point of interest is included, from the distant view data <b>33</b>.
0051The neighboring map data retrieval means <b>24</b> retrieves the three-dimensional data included in the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> from the three-dimensional map data <b>31</b> stored in the external storage device <b>3</b>.
0052The distant view data retrieval means <b>25</b> retrieves the distant view data for drawing the distant view image from the distant view data <b>33</b> stored in the external storage device <b>3</b> based on the drawing region of the distant view image calculated by the drawing region calculation means <b>22</b>.
0053The distant view image developed with the distant view data includes a mountain or a construction seen, as the distant view from the point of interest, in the visual field range defining the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b>.
0054The map data reading means <b>26</b> reads the three-dimensional data retrieved by the neighboring map data retrieval means <b>24</b> from the external storage device <b>3</b>. Besides, the map data reading means <b>26</b> reads the distant view data retrieved by the distant view data retrieval means <b>25</b> from the external storage device <b>3</b>.
0055The real-time rendering means <b>27</b> performs a real-time rendering processing on the three-dimensional data read out from the external storage device <b>3</b> by the map data reading means <b>26</b>, and converts a drawing object in the drawing region near the point of interest into the map image based on the perspective drawing method.
0056The display means <b>28</b> writes the distant view image developed with the distant view data read out from the external storage device <b>3</b> by the map data reading means <b>26</b> into a frame memory. Next, the distant view image is overwritten with the drawing object in the drawing region near the point of interest, which is converted by the real-time rendering means <b>27</b> into the map image based on the perspective drawing method.
0057<figref idref="DRAWINGS">FIG. 6</figref> is an explanatory view showing an example of division areas for explaining the three-dimensional map data.
0058In the example of <figref idref="DRAWINGS">FIG. 6</figref>, the map data is divided into rectangular division areas E<b>0</b>, E<b>1</b>, E<b>2</b>, E<b>3</b>, E<b>4</b>, E<b>5</b>, E<b>6</b>, E<b>7</b>, E<b>8</b>, E<b>9</b>, E<b>10</b>, E<b>11</b>, E<b>12</b>, E<b>13</b>, E<b>14</b> and E<b>15</b> specified by the latitude and longitude. The three-dimensional map data <b>31</b> represents drawing objects, such as constructions, included in the respective division areas by stereoscopic three-dimensional data with coordinates of respective apexes, and represents the positions where those constructions exist by latitudes and longitudes, and they are respectively stored as files in the external storage device <b>3</b>.
0059<figref idref="DRAWINGS">FIG. 7</figref> is an explanatory view of the division areas and the three-dimensional map data stored in the external storage device <b>3</b> for the respective division areas. In the figure, reference numeral <b>51</b> denotes the division area E<b>0</b> specified by latitudes a<b>1</b> and a<b>2</b> and longitudes b<b>1</b> and b<b>2</b>, and reference numeral <b>52</b> denotes three-dimensional data of the division area E<b>0</b>.
0060The distant view data <b>33</b> represents distant view images, and when a drawing object in a drawing region is drawn as a map image based on the perspective drawing method, the distant view image is drawn on the background of the map image and has been previously subjected to the rendering processing. The distant view data <b>33</b> is paired with each of the division areas shown in <figref idref="DRAWINGS">FIG. 6</figref> or <figref idref="DRAWINGS">FIG. 7</figref>. The distant view images seen from the inside of the paired division area in the respective directions of the east, west, south and north of the circumference of 360 degrees are formed into files as the distant view data <b>33</b> and are stored in the external storage device <b>3</b>.
0061<figref idref="DRAWINGS">FIG. 8</figref> is a conceptual view for explaining the distant view data. In the figure, F<b>1</b> denotes distant view data seen in the north direction from, for example, the center position of the division area E<b>9</b>, F<b>2</b> denotes distant view data seen in the east direction from the center position of the division area E<b>9</b>, F<b>3</b> denotes distant view data seen in the south direction from the center position of the division area E<b>9</b>, and F<b>4</b> denotes distant view data seen in the west direction from the center position of the division area E<b>9</b>.
0062<figref idref="DRAWINGS">FIG. 9</figref> is an explanatory view showing an example of the distant view data <b>33</b> stored in the external storage device <b>3</b>. In the example shown in <figref idref="DRAWINGS">FIG. 9</figref>, E<b>9</b>-F<b>1</b> denotes distant view data seen in the north direction from the inside of the division area E<b>9</b>, E<b>9</b>-F<b>2</b> denotes distant view data seen in the east direction from the inside of the division area E<b>9</b>, E<b>9</b>-F<b>3</b> denotes distant view data seen in the south direction from the inside of the division area E<b>9</b>, and E<b>9</b>-F<b>4</b> denotes distant view data seen in the west direction from the inside of the division area E<b>9</b>. Besides, E<b>10</b>-F<b>1</b> denotes distant view data seen in the north direction from the inside of the division area E<b>10</b>, E<b>10</b>-F<b>2</b> denotes distant view data seen in the east direction from the inside of the division area E<b>10</b>, E<b>10</b>-F<b>3</b> denotes distant view data seen in the south direction from the inside of the division area E<b>10</b>, and E<b>10</b>-F<b>4</b> denotes distant view data seen in the west direction from the inside of the division area E<b>10</b>. Besides, E<b>11</b>-F<b>1</b> denotes distant view data seen in the north direction from the inside of the division area E<b>11</b>, E<b>11</b>-F<b>2</b> denotes distant view data seen in the east direction from the inside of the division area E<b>11</b>, E<b>11</b>-F<b>3</b> denotes distant view data seen in the south direction from the inside of the division area E<b>11</b>, and E<b>11</b>-F<b>4</b> denotes distant view data seen in the west direction from the inside of the division area E<b>11</b>. The distant view image seen in the east, west, south or north from the inside of each of the division areas is created for each division area according to the distance between the position of the division area and the position of the object seen as the distant view and in accordance with a change in a distant view actually seen when the point of interest passes through the division area and is moved.
0063Next, the operation will be described.
0064<figref idref="DRAWINGS">FIG. 3</figref>, <figref idref="DRAWINGS">FIG. 4</figref> and <figref idref="DRAWINGS">FIG. 5</figref> are flowcharts showing the virtual space image display method of the embodiment 1. Hereinafter, the operation will be described with reference to the flowcharts shown in <figref idref="DRAWINGS">FIG. 3</figref>, <figref idref="DRAWINGS">FIG. 4</figref> and <figref idref="DRAWINGS">FIG. 5</figref>.
0065In the flowchart shown in <figref idref="DRAWINGS">FIG. 3</figref>, first, the point of interest acquisition means <b>21</b> acquires the point of interest (step S). The acquisition of the point of interest is realized in such a manner that the CPU <b>13</b> executes the point-of-interest acquisition means <b>21</b>. That is, in the case where the present position can be determined from the latitude and longitude information detected based on the GPS signal received from the GPS satellite, the point-of-interest acquisition means <b>21</b> acquires the point of interest and the sight line direction information concerning the sight line direction or traveling direction from the latitude and longitude information using the GPS satellite, and further determines the division area on the map data where the point of interest is included.
0066Besides, in the case where the point of interest and the sight line direction or traveling direction at the point of interest are directly inputted and set on the map data displayed on the display device <b>4</b> from the input device including the keyboard, the mouse, or the operation pad by the cursor movement based on the user's operation, the point of interest and the sight line direction information are acquired from the latitude and longitude information of the inputted and set point, and the inputted and set sight line direction or traveling direction, and further, the specified division area where the point of interest is included is determined.
0067Besides, in the case where the latitude and longitude information of the point of interest, the sight line direction or traveling direction at the point of interest are directly inputted and set from the input device including the keyboard, the mouse or the operation pad by the user's operation, the position information of the point of interest on the map data is acquired from the inputted and set latitude and longitude information, and the sight line direction information is acquired from the inputted and set sight line direction or traveling direction, and further, the specified division area where the point of interest is included is determined.
0068Next, the drawing region calculation means <b>22</b> calculates the drawing region near the point of interest in the sight line direction or the traveling direction from the point of interest. The calculation of the drawing region is realized in such a manner that the CPU <b>13</b> executes the drawing region calculation means <b>22</b>.
0069That is, the drawing region near the point of interest is calculated as the triangular or fan-shaped area determined by, for example, the latitude and longitude of the point of interest, the sight line direction information as the sight line direction or the traveling direction at the point of interest, the visual field range around the direction, and the specified distance from the point of interest.
0070The drawing region calculation means <b>22</b> calculates the drawing region of the distant view image as, for example, the drawing region of the distant view image in the sight line direction or traveling direction within the division area where the point of interest exists, or as the range of the distant view image of the division area where the point of interest exists, which is included in the visual field range of the drawing region near the point of interest.
0071Here, an example of the drawing region of the distant view image calculated by the drawing region calculation means <b>22</b> will be described. In <figref idref="DRAWINGS">FIG. 8</figref>, the point of interest, that is, the present position is made point P. The sight line direction or traveling direction is the north direction. Reference numeral <b>61</b> denotes the drawing region near the point of interest in the sight line direction or traveling direction calculated by the drawing region calculation means <b>22</b> with respect to the present position of the point of interest P acquired by the point-of-interest acquisition means <b>21</b> based on the latitude and longitude information.
0072Reference numeral <b>62</b> denotes the visual field range of the drawing region <b>61</b> near the point of interest at the point of interest P. Reference numeral <b>63</b> denotes the range of the distant view image of the division area E<b>9</b> where the point of interest P exists, which is included in the visual field range <b>62</b> of the drawing region near the point of interest. The drawing region calculation means <b>22</b> calculates the range <b>63</b> of the distant view image. <figref idref="DRAWINGS">FIG. 9</figref> shows the range <b>63</b> of the distant view data calculated by the drawing region calculation means <b>22</b> in the case where the point of interest P exists in the division area E<b>9</b>.
0073Next, the neighboring map data retrieval means <b>24</b> retrieves three-dimensional map data (step S<b>3</b>). The retrieval of the three-dimensional map data is realized in such a manner that the CPU <b>13</b> executes the neighboring map data retrieval means <b>24</b>. The neighboring map data retrieval means <b>24</b> retrieves the three-dimensional data of constructions and the like included in the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> from the three-dimensional map data <b>31</b>.
0074<figref idref="DRAWINGS">FIG. 4</figref> is the flowchart showing the details of the retrieval processing of the three-dimensional map data on the step S<b>3</b> in <figref idref="DRAWINGS">FIG. 3</figref>. The retrieval processing of the three-dimensional map data on the step S<b>3</b> in <figref idref="DRAWINGS">FIG. 3</figref> will be described with reference to <figref idref="DRAWINGS">FIG. 4</figref>.
0075The neighboring map data retrieval means <b>24</b> specifies a file of three-dimensional data of constructions and the like included in the division area where the point of interest exists from the latitude and longitude information of the point of interest (step S<b>11</b>). The neighboring map data retrieval means <b>24</b> causes the specified file of the three-dimensional data to be the reading object (step S<b>12</b>).
0076Further, the neighboring map data retrieval means <b>24</b> judges whether in addition to the specified file, all files of the three-dimensional data included in the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> are retrieved (step S<b>13</b>). In the state where all the files of the three-dimensional data included in this drawing region have not been retrieved, the file of the three-dimensional data in the drawing region, which has not been read, is retrieved. In this case, since there is a case where the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> extends over plural division areas, the neighboring map data retrieval means <b>24</b> retrieves the file of the three-dimensional data in the drawing region also with respect to another division area to which the drawing region near the point of interest extends (step S<b>14</b>). With respect to all division areas to which the drawing region near the point of interest extends, the files of the three-dimensional data in the drawing region are retrieved.
0077Return is made to the flowchart shown in <figref idref="DRAWINGS">FIG. 3</figref>, and next, the map data reading means <b>26</b> reads the three-dimensional data of the drawing region near the point of interest retrieved by the neighboring map data retrieval means <b>24</b> with respect to the three-dimensional map data <b>31</b> (step S<b>4</b>).
0078Next, the distant view data retrieval means <b>25</b> retrieves the distant view data concerning the drawing region of the distant view image calculated by the drawing region calculation means <b>22</b> (step S<b>5</b>). The retrieval of the distant view data is realized in such a manner that the CPU <b>13</b> executes the distant view data retrieval means <b>25</b>.
0079<figref idref="DRAWINGS">FIG. 5</figref> is the flowchart showing the retrieval processing of the distant view data on the step S<b>5</b> in <figref idref="DRAWINGS">FIG. 3</figref>. In the retrieval processing of the distant view data, the distant view data retrieval means <b>25</b> specifies, from the file of the distant view data in the division area where the point of interest determined by the point-of-interest acquisition means <b>21</b> exists, the file of the distant view data <b>33</b> in the range of the drawing region calculated by the drawing region calculation means <b>22</b> with respect to the distant view image (step S<b>21</b>). Next, the distant view data of the specified file is made the read object (step S<b>22</b>).
0080Return is made to the flowchart shown in <figref idref="DRAWINGS">FIG. 3</figref>, and next, the map data reading means <b>26</b> reads the range <b>63</b> of the distant view data from the file of the distant view data retrieved and specified by the distant view data retrieval means <b>25</b> with respect to the distant view data <b>33</b> (step S<b>6</b>).
0081The display means <b>28</b> writes the distant view data read by the map data reading means <b>26</b> into the frame memory, and performs the drawing of the distant view image (step S<b>7</b>).
0082In this case, since the distant view data is the distant view image previously subjected to the rendering processing, even in the case where the distant view image is changed each time the position of the point of interest, or the sight line direction or traveling direction from the point of interest is updated, the distant view data is not required to be subjected to the rendering processing, and has only to be retrieved and read from the external storage device <b>3</b>. Thus, as compared with the case where the rendering processing is performed each time the position of the point of interest, or the sight line direction or traveling direction from the point of interest is updated, an increase in the load of the apparatus including the CPU can be avoided, and the realistic distant view image can be drawn without enhancing the processing speed.
0083On the other hand, the real-time rendering means <b>27</b> applies the real-time rendering processing to the three-dimensional data read by the map data reading means <b>26</b>. The real-time rendering means <b>27</b> converts constructions and the like included in the drawing region near the point of interest into the map image based on the perspective drawing method. The display means <b>28</b> overwrites the map image of the constructions and the like near the point of interest and based on the perspective drawing method to the frame memory in which the distant view image based on the distant view data is written, outputs the map image of the constructions and the like near the point of interest and based on the perspective drawing method, in which the distant view image is drawn on the background, to the display device <b>4</b>, and displays it (step S<b>8</b>).
0084<figref idref="DRAWINGS">FIG. 10</figref> is an explanatory view showing the distant view image, the map image near the point of interest and based on the perspective drawing method, which is overwritten on the distant view image, and the map image near the point of interest and based on the perspective drawing method, in which the distant view image is drawn on the background.
0085<figref idref="DRAWINGS">FIG. 11</figref> is an explanatory view showing a change in the distant view image drawn in the case where the point of interest P, that is, the present position moves in the order of the division areas E<b>9</b>→E<b>10</b>→E<b>11</b>. In <figref idref="DRAWINGS">FIG. 11</figref>, reference numeral <b>101</b> denotes the traveling direction, for example, the north direction. In the traveling direction from the present position of the point of interest P, a high building <b>102</b> and Tokyo Tower <b>103</b> are seen as the distant view, and Mount Fuji <b>104</b> is seen farther away.
0086In the case where the present position of the point of interest P exists in the division area E<b>9</b>, the range of the distant view data calculated by the drawing region calculation means <b>22</b> is the range indicated by reference numeral <b>63</b> shown in <figref idref="DRAWINGS">FIG. 9</figref>, and is drawn as the distant view image indicated by reference numeral <b>111</b> of <figref idref="DRAWINGS">FIG. 11</figref>. Incidentally, the distant view image <b>111</b> is overwritten with, as the map image based on the perspective drawing method, constructions and the like of the drawing region near the point of interest calculated in the traveling direction from the present position of the point of interest P by the drawing region calculation means <b>22</b>. The drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> is updated in accordance with the movement of the point of interest, and the map image overwritten on the distant view image <b>111</b> and based on the perspective drawing method is also updated in accordance with the movement of the point of interest.
0087In the case where the present position of the point of interest P is moved into the division area E<b>10</b>, the range of the distant view data calculated by the drawing region calculation means <b>22</b> is the range denoted by reference numeral <b>64</b> shown in <figref idref="DRAWINGS">FIG. 9</figref>, and is drawn as the distant view image denoted by reference numeral <b>112</b> of <figref idref="DRAWINGS">FIG. 11</figref> by the display means <b>28</b>. Incidentally, the distant view image <b>112</b> is overwritten with, as the map image based on the perspective drawing method, the constructions and the like in the drawing region near the point of interest calculated in the traveling direction from the present position of the point of interest P by the drawing region calculation means <b>22</b>. In the case where the distant view image <b>112</b> is compared with the distant view image <b>111</b>, the high building <b>102</b> and the Tokyo Tower <b>103</b> drawn in the distant view image <b>112</b> are drawn to be rather large and to shift in the right direction. On the other hand, the Mount Fuji <b>104</b> is drawn in the state where the position and size are not changed.
0088This is because as compared with the distance from the present position of the point of interest P to the high building <b>102</b> or the Tokyo Tower <b>103</b>, the distance from the point of interest P to the Mount Fuji <b>104</b> is remarkably large, and the movement distance (distance between one division area and the next division area) of the point of interest P is almost neglected with respect to the distance from the point of interest P to the Mount Fuji <b>104</b>, whereas it can not be neglected with respect to the distance from the point of interest P to the high building <b>102</b> or the Tokyo Tower <b>103</b>.
0089As stated above, the distant view image is created, for each division area, to have the drawing position and the size according to the distance between the position of the division area and the distant view image drawing object, such as the high building <b>102</b>, the Tokyo Tower <b>103</b>, or the Mount Fuji <b>104</b> and in accordance with the change in the distant view actually seen when the point of interest is moved.
0090Further, in the case where the present position of the point of interest P is moved into the division area E<b>11</b>, the range of the distant view data calculated by the drawing region calculation means <b>22</b> is the range denoted by reference numeral <b>65</b> shown in <figref idref="DRAWINGS">FIG. 9</figref>, and is drawn as the distant view image denoted by reference numeral <b>113</b> of <figref idref="DRAWINGS">FIG. 11</figref> by the display means <b>28</b>.
0091The distant view image <b>113</b> is overwritten with, as the map image based on the perspective drawing method, the constructions and the like in the drawing region near the point of interest calculated by the drawing region calculation means <b>22</b> in the traveling direction from the present position of the point of interest P. In the case where the distant view image <b>113</b> is compared with the distant view image <b>111</b>, the high building <b>102</b> and the Tokyo Tower <b>103</b> drawn in the distant view image <b>113</b> are sufficiently large, and are drawn to further shift in the right direction, and it can be actually felt also from the distant view image that the present position of the point of interest P further approaches the position where the high building <b>102</b> and the Tokyo Tower <b>103</b> can be visually seen in the right and forward direction. On the other hand, the Mount Fuji <b>104</b> is drawn in the state where the position and size are not changed.
0092As stated above, the distant view data for each of the division areas is previously made so that when the point of interest P is moved, the realistic distant view image can be drawn. That is, the distant view data of each division area is subjected to the operation in the distant view image structure such that in view of the distance from the object, such as the high building <b>102</b>, the Tokyo Tower <b>103</b>, or the Mount Fuji <b>104</b>, adopted as the distant view image to the division area, its size and drawing position are changed for each division area, or they are not changed at all.
0093In the above description, although the point-of-interest acquisition means <b>21</b>, the drawing region calculation means <b>22</b>, the map data retrieval means <b>23</b>, the neighboring map data retrieval means <b>24</b>, the distant view data retrieval means <b>25</b>, the map data reading means <b>26</b>, the real-time rendering means <b>27</b>, and the display means <b>28</b> are stored as programs in the ROM <b>2</b>, they may have such form that as programs executable by a computer, they are written in a recording medium, such as a magnetic disk, an optical disk, or a semiconductor memory, and the CPU of the virtual space image display apparatus reads the programs stored in the recording medium and executes them.
0094Besides, although the description has been made on the assumption that the three-dimensional map data <b>31</b> and the distant view data <b>33</b> are stored in the external storage device <b>3</b>, there may be provided a function to download the three-dimensional map data <b>31</b> and the distant view data <b>33</b> from a database configured in an external server system to the virtual space image display apparatus by communication means and by wireless. In this case, before the point of interest, that is, the present position enters the inside of the division area, the distant view data <b>33</b> of the division area is downloaded from the external database to the virtual space image display apparatus by the communication means and by wireless.
0095As described above, according to this embodiment 1, since the distant view image which has been previously subjected to the rendering processing is stored as the distant view data in the external storage device <b>3</b>, the rendering processing at the time when the distant view image is drawn is not required, and the distant view image has only to be retrieved and read out from the distant view data <b>33</b>. Thus, there is an effect that the virtual space image display method/apparatus, the virtual space image display program and the recording medium can be provided in which an increase in the load of the apparatus including the CPU can be avoided as compared with the case where the rendering processing is performed each time the position of the point of interest, the sight line direction or the traveling direction is changed and the distant view image is drawn.
0096Besides, since the distant view image seen in the east, west, south, or north from the inside of each division area is created for each division area according to the distance between the position of the division area and the object, such as the high building <b>102</b>, the Tokyo Tower <b>103</b>, or the Mount Fuji <b>104</b>, and in accordance with the change in the distant view actually seen when the point of interest is moved, there is an effect that the virtual space image display method/apparatus, the virtual space image display program and the recording medium can be provided in which the map image which is based on the perspective drawing method and in which the realistic distant view image is drawn on the background can be drawn without enhancing the processing speed.
Embodiment 2
0097<figref idref="DRAWINGS">FIG. 12</figref> is a block diagram showing a structure of an in-vehicle navigation apparatus to which the virtual space image display method/apparatus, or the virtual space image display program described in the embodiment 1 is applied. In <figref idref="DRAWINGS">FIG. 12</figref>, portions having the same or like functions to those of <figref idref="DRAWINGS">FIG. 1</figref> are denoted by the same reference numerals.
0098The in-vehicle navigation apparatus includes a RAM <b>1</b>, a ROM <b>2</b>, and an external storage device <b>3</b> that previously stores three-dimensional map data including information indicating the positions and forms of constructions, such as roads and buildings, of map data divided into specified division areas, and distant view data which are distant view images for the respective division areas and are previously subjected to the rendering processing.
0099Besides, the in-vehicle navigation apparatus includes a display device <b>4</b>, an interface <b>5</b> for display through which a CPU <b>13</b> transmits/receives various signals for displaying map images based on a perspective drawing method on the display device <b>4</b> to/from the display device <b>4</b>, an audio output device <b>71</b> for performing various guides including a road guide not only through a screen of the display device <b>4</b> but also through an effective sound or voice, and an interface <b>72</b> for audio output through which the CPU <b>13</b> transmits/receives signals, by which the audio output device <b>71</b> performs the various guides through the effective sound or voice, to/from the audio output device <b>71</b>.
0100Further, there are provided an operation switch <b>73</b> for variously operating the in-vehicle navigation apparatus, and an input port <b>74</b> for inputting the operation through the operation switch <b>73</b> to the in-vehicle navigation apparatus as an electric signal.
0101Besides, the in-vehicle navigation apparatus includes a GPS receiver <b>9</b> provided with a GPS antenna <b>8</b>, an interface <b>10</b> through which the CPU <b>13</b> transmits/receives various signals to/from the GPS receiver <b>9</b>, a geomagnetic sensor <b>11</b> that detects the terrestrial magnetism and outputs an orientation signal with a specified resolution for fixing the orientation of a sight line direction or a traveling direction, and an interface <b>12</b> through which the CPU <b>13</b> transmits/receives various signals including the orientation signal outputted from the geomagnetic sensor <b>11</b> to/from the geomagnetic sensor <b>11</b>.
0102Besides, the in-vehicle navigation apparatus includes a gyro <b>75</b> for determining the traveling direction, an interface <b>76</b> through which the CPU <b>13</b> transmits/receives various signals including the output signal of the gyro <b>75</b> to/from the gyro <b>75</b>, a vehicle speed sensor <b>77</b> for detecting a vehicle speed, and an interface <b>78</b> through which the CPU <b>13</b> transmits/receives various signals including the output signal of the vehicle speed sensor <b>77</b> to/from the vehicle speed sensor <b>77</b>.
0103In this in-vehicle navigation apparatus, various guides are performed through the map image which is based on the perspective drawing method and is drawn by the virtual space image display method described in the embodiment 1.
0104Besides, in this in-vehicle navigation apparatus, the point-of-interest acquisition means <b>21</b> of <figref idref="DRAWINGS">FIG. 2</figref> realizes a function to acquire information of the point of interest as the present position of the vehicle and the traveling direction based on various information, such as the latitude and longitude information detected based on the GPS signal received by the GPS receiver <b>9</b> from the GPS satellite, a vehicle speed pulse as the output signal of the vehicle speed sensor <b>77</b>, the output signal of the gyro <b>75</b>, and the orientation obtained from the output of the geomagnetic sensor <b>11</b>, and to determine the division area where the point of interest is included.
0105Accordingly, in the in-vehicle navigation apparatus of the embodiment 2, since the distant view image can be drawn by merely retrieving and reading the distant view data which is stored in the external storage device <b>3</b> and has been previously subjected to the rendering processing, there is an effect that the in-vehicle navigation apparatus can be provided in which an increase in the load of the apparatus including the CPU for drawing the distant view image can be avoided as compared with the case where the rendering processing is performed each time the present position of the vehicle or the traveling direction of the vehicle is changed and the distant view image is drawn.
0106Besides, since the distant view image seen in the east, west, south, or north from the inside of each division area is created for each division area according to the distance between the position of the division area and the distant view image drawing object and in accordance with the change in the distant view actually seen when the vehicle is moved, there is an effect that the in-vehicle navigation apparatus can be provided in which the map image which is based on the perspective drawing method and in which the realistic distant view image is drawn on the background can be drawn without enhancing the processing speed.
Embodiment 3
0107<figref idref="DRAWINGS">FIG. 13</figref> is a block diagram showing a structure of a portable navigation apparatus to which the virtual space image display method/apparatus, or the virtual space image display program described in the embodiment 1 is applied. In <figref idref="DRAWINGS">FIG. 13</figref>, portions having the same or like functions to those of <figref idref="DRAWINGS">FIG. 12</figref> are denoted by the same reference numerals and their description will be omitted.
0108Since the portable navigation apparatus of the embodiment 3 is used while the user carries it, the vehicle sensor <b>77</b> is not provided unlike the in-vehicle navigation apparatus.
0109In this portable navigation apparatus, the point-of-interest acquisition means <b>21</b> of <figref idref="DRAWINGS">FIG. 2</figref> realizes a function to acquire information of the point of interest as the present position and the sight line direction or traveling direction based on various information, such as latitude and longitude information detected based on a GPS signal received by a GPS receiver <b>9</b> from a GPS satellite, an output signal of a gyro <b>75</b>, and an orientation obtained from the output of a geomagnetic sensor <b>11</b>, and to determine the division area where the point of interest is included.
0110Accordingly, in the portable navigation apparatus of the embodiment 3, since the distant view image can be drawn by merely retrieving and reading the distant view data which is stored in an external storage device <b>3</b> and has been subjected to the rendering processing, there is an effect that the portable navigation apparatus can be provided in which an increase in the load of the apparatus including the CPU for drawing the distant view image can be avoided as compared with the case where the rendering processing is performed each time the present position, the sight line direction or the traveling direction is changed and the distant view image is drawn.
0111Besides, since the distant view image seen in the east, west, south, or north from the inside of each division area is created for each division area according to the distance between the position of the division area and the distant view image drawing object and in accordance with the change in the distant view actually seen when the vehicle is moved, there is an effect that the portable navigation apparatus can be provided in which the map image which is based on the perspective drawing method and in which the realistic distant view image is drawn on the background can be drawn without enhancing the processing speed.
0112It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Contents5
13 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US12293470B2 | Cited by | United States of America | Search report |
| US2018182168A1 | Cited by | United States of America | Search report |
| US8898034B2 | Cited by | United States of America | Search report |
| US2011054787A1 | Cited by | United States of America | Pre-grant |
| USD994696S | Cited by | United States of America | Applicant |
| USD1098175S | Cited by | United States of America | Applicant |
| US2009010491A1 | Cited by | United States of America | Pre-grant |
| US10146877B1 | Cited by | United States of America | Search report |
| US2012166147A1 | Cited by | United States of America | Pre-grant |
| US2009135178A1 | Cited by | United States of America | Pre-grant |
| USD868093S | Cited by | United States of America | Applicant |
| US2009021514A1 | Cited by | United States of America | Pre-grant |
| US2008154494A1 | Cited by | United States of America | Pre-grant |
| US2023298275A1 | Cited by | United States of America | Search report |
| CN115482341A | Cited by | China | Search report |
| US11163813B2 | Cited by | United States of America | Applicant |
| USD877765S | Cited by | United States of America | Applicant |
| US9116002B2 | Cited by | United States of America | Applicant |
| US9229084B2 | Cited by | United States of America | Applicant |
| US11207952B1 | Cited by | United States of America | Applicant |
| USD933691S | Cited by | United States of America | Applicant |
| US8493380B2 | Cited by | United States of America | Search report |
| US2012119992A1 | Cited by | United States of America | Pre-grant |
| USD1006046S | Cited by | United States of America | Applicant |
| USD934281S | Cited by | United States of America | Applicant |
| CN104133819A | Cited by | China | Search report |
| US9151610B2 | Cited by | United States of America | Applicant |
| USD868092S | Cited by | United States of America | Applicant |
| US2010312519A1 | Cited by | United States of America | Pre-grant |
| US2021043003A1 | Cited by | United States of America | Search report |
| US11841241B2 | Cited by | United States of America | Search report |
| US7925434B2 | Cited by | United States of America | Search report |
| US2024040247A1 | Cited by | United States of America | Search report |
| US8941677B1 | Cited by | United States of America | Search report |
| US11860923B2 | Cited by | United States of America | Applicant |
| US10152953B2 | Cited by | United States of America | Search report |
| US2009015585A1 | Cited by | United States of America | Pre-grant |
| US9506754B2 | Cited by | United States of America | Applicant |
| US11699266B2 | Cited by | United States of America | Search report |
| US10839614B1 | Cited by | United States of America | Search report |
| US8254727B2 | Cited by | United States of America | Search report |
| US9423252B2 | Cited by | United States of America | Applicant |
| US9142051B2 | Cited by | United States of America | Search report |
| US11687149B2 | Cited by | United States of America | Search report |
| US2018261000A1 | Cited by | United States of America | Search report |
| CN102254467A | Cited by | China | Search report |
| US10176787B2 | Cited by | United States of America | Applicant |
| US10540804B2 | Cited by | United States of America | Search report |
| US11024081B2 | Cited by | United States of America | Search report |
| US2012306932A1 | Cited by | United States of America | Pre-grant |
| US2002049530A1 | Cites | United States of America | Pre-grant |
| US2002141659A1 | Cites | United States of America | Pre-grant |
| US2002154699A1 | Cites | United States of America | Pre-grant |
| US2003040277A1 | Cites | United States of America | Pre-grant |
| US2003096648A1 | Cites | United States of America | Pre-grant |
| US2003130788A1 | Cites | United States of America | Pre-grant |
| US2003135327A1 | Cites | United States of America | Pre-grant |
| US2003218546A1 | Cites | United States of America | Pre-grant |
| US2004032410A1 | Cites | United States of America | Pre-grant |
| US2004066384A1 | Cites | United States of America | Pre-grant |
| US2004080510A1 | Cites | United States of America | Pre-grant |
| US2004128070A1 | Cites | United States of America | Pre-grant |
| US2004150659A1 | Cites | United States of America | Pre-grant |
| US2004222988A1 | Cites | United States of America | Pre-grant |
| US2004239688A1 | Cites | United States of America | Pre-grant |
| US2004254718A1 | Cites | United States of America | Pre-grant |
| US2005035883A1 | Cites | United States of America | Pre-grant |
| US2005055155A1 | Cites | United States of America | Pre-grant |
| US2006074549A1 | Cites | United States of America | Pre-grant |
| US2006253245A1 | Cites | United States of America | Pre-grant |
| US5414801A | Cites | United States of America | Pre-grant |
| US5544052A | Cites | United States of America | Pre-grant |
| US5613055A | Cites | United States of America | Pre-grant |
| US5657402A | Cites | United States of America | Pre-grant |
| US5748194A | Cites | United States of America | Pre-grant |
| US5841439A | Cites | United States of America | Pre-grant |
| US5856829A | Cites | United States of America | Pre-grant |
| US5884219A | Cites | United States of America | Pre-grant |
| US5892519A | Cites | United States of America | Pre-grant |
| US5920657A | Cites | United States of America | Pre-grant |
| US5952993A | Cites | United States of America | Pre-grant |
| US5999189A | Cites | United States of America | Pre-grant |
| US6005504A | Cites | United States of America | Pre-grant |
| US6008820A | Cites | United States of America | Pre-grant |
| US6064393A | Cites | United States of America | Pre-grant |
| US6084597A | Cites | United States of America | Pre-grant |
| US6088820A | Cites | United States of America | Pre-grant |
| US6124859A | Cites | United States of America | Pre-grant |
| US6169552B1 | Cites | United States of America | Pre-grant |
| US6198431B1 | Cites | United States of America | Pre-grant |
| US6199015B1 | Cites | United States of America | Pre-grant |
| US6222583B1 | Cites | United States of America | Pre-grant |
| US6229546B1 | Cites | United States of America | Pre-grant |
| US6281903B1 | Cites | United States of America | Pre-grant |
| US6304212B1 | Cites | United States of America | Pre-grant |
| US6324469B1 | Cites | United States of America | Pre-grant |
| US6326964B1 | Cites | United States of America | Pre-grant |
| US6335765B1 | Cites | United States of America | Pre-grant |
| US6341254B1 | Cites | United States of America | Pre-grant |
| US6360168B1 | Cites | United States of America | Pre-grant |
2 members in 2 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 2005323757 | Japan | A | |
| 2005323757 | Japan | A | |
| P2005323757 | Japan | – | |
| JP20050323757 | – | – | – |
| P2005323757 | – | – | – |
Members2
| Document | Office | Kind | |
|---|---|---|---|
| US2007103461A1 | United States of America | A1 | |
| JP2007133489A | Japan | A |
116 transactions on the USPTO file
Abandoned after 5 non-final rejections, 5 final rejections and 4 RCEs.
- Non-final rejections
- 5
- Final rejections
- 5
- RCEs
- 4
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Email NotificationEML_NTR | EML_NTR | |
| Mail Abandonment for Failure to Respond to Office ActionAbandonedMABN2 | MABN2 | |
| Aband. for Failure to Respond to O. A.AbandonedABN2 | ABN2 | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Response after Non-Final ActionA... | A... | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Applicant Initiated Interview SummaryMEXIA | MEXIA | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Interview Summary- Applicant InitiatedEXIA | EXIA | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Examiner Interview Summary (PTOL - 413)MEXIN | MEXIN | |
| Examiner Interview Summary Record (PTOL - 413)EXIN | EXIN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Examiner Interview Summary (PTOL - 413)MEXIN | MEXIN | |
| Response after Non-Final ActionA... | A... | |
| Examiner Interview Summary Record (PTOL - 413)EXIN | EXIN | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Advisory Action (PTOL - 303)MCTAV | MCTAV | |
| Advisory Action (PTOL-303)CTAV | CTAV | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Final ActionA.NE | A.NE | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Examiner Interview Summary (PTOL - 413)MEXIN | MEXIN | |
| Examiner Interview Summary Record (PTOL - 413)EXIN | EXIN | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Examiner Interview Summary (PTOL - 413)MEXIN | MEXIN | |
| Examiner Interview Summary Record (PTOL - 413)EXIN | EXIN | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF |
1 recorded assignment at the USPTO, latest first
- Now
Now: Held by
SONY CORP - 2007-01-08
Assignment of assignors interest.
Ownership change- From
- OKUDA SHIZUEITO JUNPEISUZUNO SATOSHI
and 1 moreShow fewer
KODA NATSUO - To
- SONY CORPSONY CORPORATION
Recorded 2007-01-08, Signed 2006-12-14
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTIONSTCB | STCB | |
| AssignmentAS | AS |
Numbers
- Publication
- 20070103461
- Publication, DOCDB
- 2007103461
- Publication, EPODOC
- US2007103461
- Application
- 11556312
- Application, DOCDB
- 55631206
- Application, EPODOC
- US20060556312
Titles
- English
- VIRTUAL SPACE IMAGE DISPLAY METHOD, APPARATUS, VIRTUAL SPACE IMAGE DISPLAY PROGRAM, AND RECORDING MEDIUM
Classification
- CPC, 3
- G06T17/05
- G06T19/00
- G06T15/20
- IPC, 3
- G06T15 00
- G06T17 05
- G09B29 00
- USPC, 1
- 345419000