Systems and methods for processing images with edge detection and snap-to feature

[0001] The present application claims benefit of U.S. Patent Application Serial Number US 12/972,088. filed 17 December 2010 (17/12/2010).

Statement Regarding Federally Sponsored Research or Development [0002] Not Applicable.

The Names of the Parties to a Joint Research Agreement [0003] Not Applicable.

Background of the Invention

1. FIELD OF INVENTION

[0004] The Inventive concepts disclosed and claimed herein relate generaly to digital image processing and, more particularly, but not by way of limitation, to finding and selecting points of interest on an edge of interest in a digital image.

2. BRIEF DESCRIPTION OF RELATED ART

[0005] In the remote sensing/aerial inaging industry, imagery is used to capture views of a geographic area to be able to measure objects and structures within the images as well as to be able to determine geographic locations of points within the image. Such imagery is described in, tor example, U.S. Patent Application Publication No. 2008/0231700. Photogrammetry is the science of malting measurements of and between objects depicted within photographs, especially aerial photographs. A person, or User, may interact with the image to select Pointe of Interest that may be used to perform other functions such as: determine distance between two points; determine the area outlined by a set of points; determine the volume of a 3-dimensional shape, or other functions. Usually, the greatest error induced into the calculation of the function is the human error introduced by the User selecting the Points of Interest. For example, if a measurement from a building to the edge of a curb is desired and the User selects a point that is dose to the edge of

CA 2819166 2018-04-17

WO 2012/083135

PCT/US2011/065418 the building, but not the actual edge of the building, then the measurement will differ from the actual measurement by the distance the User selected away from the building. In the projected image, several pixels could significantly impair the accuracy of the measurement. Additionally, when multiple Users perform the same measurement, their results can differ significantly.

[0006] In light of the foregoing, there is a need for a system and process for allowing a User to select Points of Interest based on the edge elements that exist in a geo-referenced image, wherein the Points of Interest are determined without the error caused by human determination of the position of the edge of an element in an image.

SUMMARY OF THE INVENTION

[0007] A method for creating image products includes the following steps. Image data and positional data corresponding to the image data are captured and processed to create geo-referenced images. Edge detection procedures are performed on the geo-referenced images to identify edges and produce georeferenced, edge-detected images.

[0008] In one embodiment, a computerized system includes a computer system for storing a database of captured oblique images with corresponding geolocation data and corresponding detected edge data. The computer system has computer executable logic that, when executed by a processor, causes the computer system to receive a selection of a geographic point from a User, search the database to find images that contain the selected point, and make the images that contain the selected point available to the User.

[0009] In another embodiment a method of providing images to a User includes the following steps. A database stores captured oblique images having corresponding geo-location data and corresponding detected edge data. A selection of a geographic point is received from a user and the database is then searched to find images that contain the selected geographic point. The images that contain the selected geographic point are then made available to the User.

[0010] In yet another embodiment a sequence of instructions is stored on at least one non-transitory computer readable medium for running on a computer system capable of displaying and navigating imagery. The sequence of instructions includes instructions for causing the computer system to display a pixel representation of a georeferenced, edge-detected image, wherein the pixel representation includes one or more detected edges in the geo-referenced, edgedetected image; instructions for causing the computer system to allow the User to select one of the one or more detected edges by moving a cursor over a region of interest (which may be magnified), wherein the cursor is caused to snap-to a selected detected edge when the cursor is within a predetermined distance from the selected detected edge; instructions for causing the computer system to allow the User to accept the selected detected edge as an edge of interest; and instructions for causing the computer system to allow the User to determine and store one or more points of Interest along the edge of interest

[0011] In yet another embodiment, a system for preparing and utilizing geo* referenced images includes one or more image and data files accessible by a computer system capable of displaying and navigating digital imagery, the image and data file Including a plurality of image files, detected edge information corresponding to the plurality of image files, and positional data corresponding to the plurality of image files; and image display and analysis software stored on a nontransitory computer readable medium and executable by the computer system. The image display and analysis software causes the computer system to allow a user to download and display, from the image and data file, a pixel representation of an image having a plurality of detected edges within the image, and to select a detected edge within the pixel representation by moving a cursor over the pixel representation, wherein the cursor is caused to snap-to a selected detected edge when the cursor is within a predetermined distance from the selected detected edge. The image display and analysis software also causes the computer system to allow the user to accept the selected detected edge as an edge of interest; and to allow the user to determine and store one or more points of interest along the edge of Interest

CA 2819166 2020-02-14

[0011a] One embodiment of the present invention provides a method for utilizing geo-referenced images, comprising the steps of: storing a database of captured georeferenced, edge-detected images, comprising oblique images having corresponding geo-location data and corresponding detected edge data; receiving a selection of a geographic point from a user; searching the database to find geo-referenced, edgedetected images that contain the selected geographic point; making the geo-referenced, edge-detected images that contain the selected geographic point available to the user; causing a computer system to download and display a pixel representation of one or more of the geo-referenced, edge-detected images, wherein one or more detected edge of the detected edge data is superimposed on the pixel representation; receiving from the user a selection of one of the one or more detected edge by moving a cursor over the pixel representation, wherein the cursor is caused to snap-to a selected detected edge when the cursor is within a predetermined distance from the selected detected edge; receiving from the user acceptance of the selected detected edge as an edge of interest; receiving from the user selection of one or more first point of interest along the edge of interest; storing the one or more first point of interest; providing the user with a measuring mode which includes one or more of: a distance mode that enables measurement of the distance between two or more selected points of interest, an area mode that enables measurement of the area encompassed by several selected and interconnected points of interest, a height mode that enables measurement of the height between two or more selected points of interest, and an elevation mode that enables the measurement of the change in elevation of one selected point of interest relative to one or more other selected point of interest; receiving from the user a selection of the one or more measuring mode and a selection of one or more second point of interest; and providing to the user a measurement based on the selection of the one or more measuring mode and the selected first point and second point of interest.

[0011b] A further embodiment of the present invention provides a system for preparing and utilizing geo-referenced images. The system includes: a computer system capable of displaying and navigating digital imagery. The computer system comprises a processor; one or more input device; one or more output device; one or more image and

3a

CA 2819166 2020-02-14 data file accessible by the processor, the image and data file including a plurality of image files, detected edge information corresponding to the plurality of image files, and positional data corresponding to the plurality of image files. Image display and analysis software is stored on a non-transitory computer readable medium and executable by the processor of the computer system to cause the computer system to: download and display on the one or more output device, from the image and data file, a pixel representation of a geo-referenced, edge detected image having a plurality of detected edges within the image, wherein one or more detected edge of the detected edge information is superimposed on the pixel representation of the geo-referenced, edgedetected image, and receive from a user a selection, through the one or more input device, one or more of the detected edge within the pixel representation by the user moving a cursor over the pixel representation, wherein the cursor is caused to snap-to a selected detected edge when the cursor is within a predetermined distance from the selected detected edge; receive from the user an acceptance of the selected detected edge as an edge of interest; receive from the user a selection of one or more first point of interest along the edge of interest; store the one or more first point of interest; provide to the user one or more measuring mode which include one or more of a distance mode that enables measurement of the distance between two or more selected points of interest, an area mode that enables measurement of an area encompassed by several selected and interconnected points of interest, a height mode that enables measurement of the height between two or more selected points of interest, and an elevation mode that enables measurement of a change in elevation of one selected point of interest relative to one or more other selected point of interest; receive from the user a selection of the one or more measuring mode and a selection of one or more second point of interest; and provide to the user a measurement based on the selection of the one or more measuring mode and the selected first point of interest and the second point of interest.

[0011c] A still further embodiment of the present invention provides a system for utilizing geo-referenced images. The system comprises: a computer system capable of displaying and navigating digital imagery comprising a processor; one or more input

3b

CA 2819166 2020-02-14 device; one or more output device; one or more image and data file accessible by the processor. The image and data file includes a plurality of geo-referenced images having corresponding positional data, and including detected edge information corresponding to the geo-referenced images. Image display and analysis software is stored on a nontransitory computer readable medium and executable by the computer system to cause the computer system to: magnify a user-requested region of interest from a displayed pixel representation of one of the geo-referenced images on the one or more output device; perform linear edge detection procedures on the user-requested region of interest to identify one or more detected linear edges within the user-requested region of interest, wherein one or more of the detected linear edge is superimposed on the displayed pixel representation of the geo-referenced image; receive from the user selection of one of the one or more detected linear edge within the user-requested region of interest with the one or more input device by moving a cursor over the magnified region of interest, wherein the cursor is caused to snap-to a selected detected linear edge when the cursor is within a predetermined distance from the selected detected linear edge; receive from the user acceptance of the selected detected linear edge as an edge of interest; receive from the user a selection of one or more first point of interest along the edge of interest; store the one or more first point of interest; provide to the user one or more measuring mode which includes one or more of: a distance mode that enables measurement of the distance between two or more selected points of interest, an area mode that enables measurement of the area encompassed by several selected and interconnected points of interest, a height mode that enables measurement of the height between two or more selected points of interest, and an elevation mode that enables the measurement of the change in elevation of one selected point of interest relative to one or more other selected point of interest; receive from the user a selection of the one or more measuring mode and a selection of one or more second point of interest; and provide to the user a measurement based on the selection of the one or more measuring mode and the selected first and second points of interest.

[0011d] A still further embodiment of the present invention provides a method, comprising the steps of: displaying a pixel representation of a full geo-referenced image;

3c

CA 2819166 2020-02-14 magnifying a user-requested region of interest from the full geo-referenced image, wherein the region of interest is a subset of the full geo-referenced image, wherein unmagnified surrounding areas of the full geo-referenced image are still visible to the user, and wherein the user can interact with the magnified region of interest; performing linear edge detection procedures on the magnified region of interest to identify one or more detected linear edge within the region of interest, wherein one or more of the detected linear edge is superimposed on the magnified region of interest of the displayed pixel representation of the geo-referenced image; receiving from the user a selection of one of the one or more detected linear edge within the user-requested region of interest by moving a cursor over the magnified region of interest, wherein the cursor is caused to snap-to a selected detected linear edge when the cursor is within a predetermined distance from the selected detected linear edge; receiving from the user acceptance of the selected detected linear edge as an edge of interest; receiving from the user selection, indication, and marking of at least one first point of interest along the edge of interest; storing the first point of interest; providing to the user one or more measuring modes which include one or more of: a distance mode that enables measurement of the distance between two or more selected points of interest, an area mode that enables measurement of the area encompassed by several selected and interconnected points of interest, a height mode that enables measurement of the height between two or more selected points of interest, and an elevation mode that enables the measurement of the change in elevation of one selected point of interest relative to one or more other selected points of interest; receiving from the user the selection of one or more of the measuring modes and the selection of one or more second points of interest; and providing to the user a measurement based on the selection of the one or more measuring modes and the selected first and second points of interest.

[0012] Thus utilizing (1) the technology known in the art; (2) the above-referenced general description of the presently claimed and disclosed inventive concept(s); and (3) the drawings and detailed description of the inventive concepts that follows, the advantages and novelties of the presently claimed and disclosed inventive concept(s) are readily apparent to one of ordinary skill in the art.

3d

CA 2819166 2020-02-14

BRIEF DESORPTION OF THE DRAWINGS

[0013] LBce reference numerals In the figures represent and refer to the same element or function. Implementations of the disclosure may be better understood when consideration is given to the following detailed description thereof. Such description makes reference to the annexed pictorial ^lustrations, schematics, graphs, drawings, and appendices. In the drawings:

[DOIAl Figure 1 is a flow chart showing an exemplary process for selecting a Point of Interest on an edge element in a digital photographic image.

[0015] Figure 2 is a block diagram of an exemplary computer system in accordance with the present disclosure.

[D0161 Figures 3 and 3A illustrate an exemplary selection of a region of interest on an image.

[0017] Figures 4 and 4A illustrate an exemplary magnification of the region of interest on an image such that the magnified region of Interest is a subset of the entire Image and unmagnified surrounding areas are still visible to the User.

[Q018] Figures 5 and 5A illustrate an exemplary image showing numerous detected edges.

[0019] Figure 6 is a flaw chart describing a User selection of an edge of interest in an embodiment of the invention.

[0020] Figure 7 is a flow chart describing a User selection of a point of Interest in an embodiment of the Invention.

[0021] Figures 8 and 8A illustrate an image showing a selected edge of interest and selected points of interest.

DETAILED DESCRIPTION OF THE INVENTION

[0022] Before explaining at least one embodiment of the inventive concepts(s) disclosed hereto in detail, it is to be understood that the Inventive concepts) is not limited In its application to the details of construction and the arrangement of the components or steps or methodologies set forth In the following description or illustrated in the drawfogs. The inventive concept(s) disclosed herein is capable of odier embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limittig.

CA 2819166 2018-04-17

WO 2012/083135

PCT/US2011/065418

[0023] In the following detailed description of embodiments of the disclosure, numerous specific details are set forth in order to provide a more thorough understanding of the disclosure. However, it will be apparent to one of ordinary skill in the art that the concepts within the disclosure can be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.

[0024] The inventive concepts) disclosed herein is directed to methods and systems of creating image products, wherein image data is captured, along with positional data corresponding to the image data. The image and positional data are processed to create a plurality of geo-referenced images. In one embodiment disclosed herein, edge detection procedures are performed on the plurality of georeferenced images to identify edges and produce geo-referenced, edge-detected images, which are saved in a database. A computer system storing such a database of captured oblique images having corresponding geo-location data and corresponding detected edge data, has computer executable logic that when executed by a processor causes the computer system to receive a selection of a geographic point from a user, search the database to find images that contain the selected point, and make the images that contain the selected point available to the user. Alternatively, the database may store captured oblique images without the detected edge data, and the edges within such images can be detected in real-time as the user is viewing the image(s).

[0025] In one embodiment, a sequence of instructions is stored on at least one non-transitory computer readable medium for running on a computer system capable of displaying and navigating imagery. Referring now to the drawings, and in particular to FIG. 1, in general, a User downloads a geo-referenced image as in step 10. The sequence of instructions optionally includes instructions for beating and selecting a user-requested region of interest (ROI) from a downloaded georeferenced image as in step 12. Further instructions can be provided for magnifying the user-requested region of interest (ROI) to provide a magnified region of interest (MROI) and for performing edge detection procedures on the region of interest (ROI) to provide a detected edge DE as in step 14. However, detected edge data indicative of the detected edge DE can be provided in the downloaded image. The detected edge DE can be either a linear edge or a non-linear edge. In step 16, instructions cause the cursor to snap-to a detected edge (DE) when the User moves

CA028i9tWWlW5-2^

WO 2012/083135

PCT/US2011/065418 the curser over the MROI and the cursor nears the DE. Further instructions allow the User to determine points of interest (POI) on a selected DE as in step 18. It is known that accuracy of selection of a POI of an element in a digital photographic image can be improved by magnifying the ROI so that the User may select a point as close as humanly possible to the actual edge of the element. However, computerized edge detection is more accurate for determination of an edge of an element and it provides consistency between multiple Users and interactions with the image. It has been discovered that by combining magnification of the ROI with edge detection, ED, and a snap-to utility for the cursor to snap to the detected edge, one can obtain synergistic improvements in the accuracy, precision and consistency of measurements of and between objects depicted within the digital photographic image as in step 20.

[0026] Referring now to FIG. 2, the User preferably interacts with a first computer system 21 to view and download one or more geo-referenced images to a second computer system 22 (although the geo-referenced images can be stored locally). The first and second computer system 21 and 22 can be a stand-alone computer, one or more computing device(s) and/or a distributed computing system. The stand-alone computer can be a personal computer such as a conventional desktop personal computer, laptop computer or tablet, or a mobile computer terminal. The second computer system 22 preferably includes one or more processor 23, communication connections 24, input devices 26a and 26b, output devices 28a and 28b including a display device 28a, and at least one computer readable medium 30a and 30b. The first computer system 21 can be constructed in a similar manner as the second computer system 22. While the geo-referenced image is often provided by downloading from an Internet site, the geo-referenced image can be provided by accessing any source of data files having image files and positional data corresponding to the images. Image-capturing and geo-locating systems can include image capturing devices, such as, for example, conventional cameras, digital cameras, digital sensors, charge-coupled devices, or other suitable image-capturing devices capable of capturing images photographically or electronically, and positioning information provided by, for example, a global positioning system and/or an inertial navigation unit. These systems and devices are well known to those skilled in the art.

[0027] The knage display and analysis software can be stored on a nontransftory computer readable medium and/or executed by the first and/or the second computer systems 21 and 22 Software providing insfructions for displaying a pixel representation of image are available commercially and weB known to those skilled in the art. Image display and analysis software can include methods for utïizing oblique images such as described in U.S. Patent No. 7,787.859.

[0028] The computer readable mediums 30a and/or 30b includes, for example, non-volatile read only memory, random access memory, hard disk memory, removable memory cards and/or other suftable memory storage devices and/or media. Input devices 26a and 26b, such as, for example, a mouse, keyboard, joystick, or other such input device, enable the input of data and interaction of a User with image display and analysis software being executed by the first and/or the second computer systems 21 and 22. In one embodiment, the first computer system 21 executes the image display and analysis software, and the second computer system 22 executes a communication software package, such as a web browser, to communicate with the first computer system 21 and display the geo-referenced Images. An output device such as display device 28a can Include, for example, a liquid crystal display or cathode ray tube, and displays information to the User of the second computer system 22. Additional output devices 28b can include a second display device, printer, speaker, etc. Communication connections 24 connect the second computer system 22 to a network 32, such as, for example, a local-area network, a wide-area network, the Internet and/or the World Wide Web for establishing communication with the first computer system 21.

[0029] The second computer system 22 typically uses a computer monitor as a display device 28a. These display devices often cannot display an entire Image with the deteti necessary. This may be due to the resolution of the Information In the image and the resolution and size of the display surface. When a fuN image is not displayable on the monitor in its entirety, the displayable image which is substituted for the full image is often a ÿobal Image, i.e. the full image with resolution removed to allow the entire image to fit onto the display surface of the display device. Referring now to FIG. 3, FIG. 3A, FIG. 4 and FIG. 4A, to obtain the detail necessary to select a point of interest (POI), algorithms and software have been developed to allow the User to box out a sub-region or region of interest ROI 50 of a photograph or foil image 52

CA 2819166 2018-04-17

CA028i9tWWWW-2^

WO 2012/083135

PCT/US2011/065418 and zoom-in or enlarge that sub-region as a magnified region of interest MROI 54, thus allowing the User to select points and lines from an enlarged detail image with greater ease and accuracy.

[0030] The detail image or magnified region of interest MROI 54 shows the details of the region of interest ROI 50, but when shown alone the global contexts of the details are lost. Thus, in one embodiment, instructions and algorithms known to those skilled in the art are utilized for magnifying a user-requested region of interest (ROI) 50 from the image 52 and displaying the full image or a portion thereof, along with a subsection of the display screen showing a linear magnification of the userrequested ROI 50. This allows for magnification of a particular ROI in an image while preserving visibility of the larger image as shown in FIG 4.

[0031] In some applications, a non-linear magnification of the user-selected ROI 50 may be provided so that the connection between the detail image and the immediately surrounding portion of the global image is not obscured. Such methods are also known to those skilled in the art. While non-linear magnification creates a “lens” like distortion to the original image, it still provides increased detail for the ROI 50 while maintaining the connection to the immediately surrounding portion of the global image.

[0032] The User typically interprets the image and decides which features are to be measured. By positioning, for example, a mouse cursor, the approximate location of the features can be pointed out to an algorithm. Semi-automatic feature extraction is known to those skilled in the art and is used for measuring height points as well as for measuring specific object comers. A User positions the cursor at some position in the image 52 and the cursor snaps-to the desired surface or object comer. However, the image around this selected point will usually contain gray value gradients caused by the object edges. Thus the snap-to feature may be limited by the size and quality of the pixels.

[0033] The extraction of lines from digital images has also been researched for many years. Semi-automatic algorithms have been developed, for example, for the extraction of roads. Most algorithms of this kind are based on so-called “snakes”. Extraction of objects like house roofs can be improved by algorithms that extract homogeneous gray value. The algorithms used to find the boundaries of a homogeneous area are usually based on a “region growing algorithm”. A common interactive approach is to allow the User to select an appropriate object model, and approximately align the object model with the image. A fltttag algorithm can then be used to find the best correspondence between edges of the object model and the location of high gradients In the image.*¹*

[0034] In an embodiment of the present disclosure, the sequence of Instructions stored on at least one computer readable medium 30a, 30b and/or computer readable medium 55 of the first computer system 21 for running on the first and/or second computer systems 21 and 22 capable of displaying and navigating digital imagery includes mstructions for performing edge detection procedures on the user-requested region of interest and/or on the entire pixel representation of the image. Referring now to FIG. 5 and FIG. 5A, detected edges 56 can include linear edges 58 as well as curved edges 60. Edge detection is a tool in Image processing which identifies discontinuities in a digital image such as points at which the image brightness or color changes sharply. Techniques, procedures and algorithms for edge detection are avaïable commerclaly and known to those skilled in foe art.

[0036] Referring now to FIG. 6, the sequence of Instructions stored on the computer readable mediums 30a, 30b and/or 55 forms a process 98 as discussed below. The process 98 indudes instructions for allowing the User to interact with the magnWed region of Interest MROI 54 as shown In a step 100 to determine points of interest by moving the cursor over the MROI 54. The User interaction can be accomplished with a mouse, touchpad, stylus or other means. Then the first and/or the second computer systems 21 and 22 detect a cursor position as Indicated at a step 102. Once the first and /or the second computer systems 21 and 22 detects the cursor position, instructions cause the one or more processor 23 to determine the distance between the cursor and a detected edge DE 56 at a step 104. If foe distance Is less than a predetermined distance, for example, within 3 pixel lengths, the cursor is caused to snap-to that detected edge DE 56 at a step 106. Snap-to algorithms are known to those skied in the ait

[0036] In an embodiment, instructions are provided at a step 108 to hold the cursor at the detected edge DE 56 until the User mdicates acceptance or rejection of the detected edge DE 56 as an edge of interest EOI 110 at a step 112. Upon rejection, the cursor is allowed to move freely at a step 114 and the process 98 branches to the step 100 until foe cursor position is detected again within a predetermined distance of the same or another detected edge DE 56, at which point the cursor will again snap-to foe detected edge DE 56. Upon acceptance of the

CA 2819166 2018-04-17 detected edge DE 56 as an edge of interest E01 110, the process 98 includes Instructions at a step 116 to indicate, mark and store the accepted edge of interest EOI 32 on the image 52 as shown, for example, in FIG. 8 and FIG. ΘΑ.

Acceptance can be indicated by any means of communication with the second computer system 22, such as, for example, by clicking the mouse or by selecting Accept* from an opened dialog box. Rejection can be indicated similarly or by lade of acceptance for a specified time.

[0037] Referring now to FIG. 7, the sequence of instructions stored on ths computer raaddile mediums 30a, 30b and/or 55 forms a process 118 as discussed below for proceeding once the User has accepted an edge of interest EO1110. The process 118 Includes instructions for allowing the User to move the cursor along the edge of interest EO1110 as in a step 121 in order to select a point of Interest POI 120. The first and/or the second computer systems 21 and 22 detects the cursor position, and determines whether the cursor Is more or less than a predetermined distance from the edge of interest EOI 110 as in a step 122. If the cursor has moved more than the predetermined distance from the edge of interest EOI 110, the process 118 branches back to step 100 In process 98. If the cursor has moved less than the predetermined distance from the edge of interest EO1110, the User may select a point of interest PO1120 along the detected edge DE forming the edge of Interest 110. At a step 124 the User may select a point of interest PO1120 and accept or reject the POI by, for example, double dieting a mouse or by any means of communication with the second computer system 22 as described above for accepting or rejecting the edge of interest EO1110. If the point of interest PO1120 is rejected, the process 118 braches bat* to step 122. Upon acceptance of the point of interest PO1120, instructions are provided in a step 126 to indicate, marie and store the accepted point of Interest PO1120 on the Image as shown, for example, in FIG. 8 and FIG. 8A.

[0038] The User is then allowed to move the cursor in a step 128 in order to select additional points of Interest PO1120. The process 118 queries the User at a step 130 regarding whether all of the points of interest PO1120 have been selected. The User can Indicate by any means of communication with the second computer system 22, such as, for example, by selecting “AH Done or Continue* from an opened dialog box. If additional points of Interest PO1120 are desired, process 118 branches back to step 100 of process 98 and additional points of interest PO1120 10

CA 2819166 2018-04-17

WO 2012/083135

PCT/US2011/065418

WWW» can be identified using the procedure described above until the User has selected all of the points of interest PO1120 necessary to perform a desired function. If in fact, the User has selected all the necessary points of interest POI 120, the User may select a function to be performed or exit out of the magnified region of interest MROI 54 as in a step 132.

[0039] Often, the User takes measurements of and between objects depicted in the image 52 by selecting one of several available measuring modes provided within the image display and analysis software. The User selects the desired measurement mode by accessing, for example, a series of pull-down menus or toolbars or via keyboard commands. The measuring modes provided by image display and analysis software may include, for example, a distance mode that enables measurement of the distance between two or more selected points, an area mode that enables measurement of the area encompassed by several selected and interconnected points, a height mode that enables measurement of the height between two or more selected points, and an elevation mode that enables the measurement of the change in elevation of one selected point relative to one or more other selected points.

[0040] After selecting the desired measurement mode, the User selects a starting point of interest POI 120 and an ending point of interest POI 120’ on the image 52, and image display and analysis software automatically calculates and displays the quantity sought. The accuracy, precision and consistency of these measurements depend in great part on the procedure used to select the points of interest PO1120. By combining edge detection procedures with a snap-to function in a magnified region of interest, edges of interest can be identified and individual points of interest along those edges can be selected in a much more accurate and consistent manner than is currently available.

[0041] In one embodiment disclosed herein, edge detection procedures are performed on the plurality of geo-referenced images to identify edges and produce geo-referenced, edge-detected images which are saved in a database on one or more of the computer readable mediums 30a, 30b and 55. Either the first and/or the second computer system 21 and 22 storing such a database of captured oblique images having corresponding geo-location data and corresponding detected edge data, has computer executable logic that when executed by a processor causes the computer systems 21 and/or 22 to receive a selection of a geographic point from a 11

WO 2012/083135

PCT/US2011/065418 user, search the database to find images that contain the selected point, and make the images that contain the selected point available to the user. Alternatively, the database may store captured oblique images without the detected edge data, and the edges within such images can be detected in real-time as the user is viewing the image(s) and/or when the MROI 54 is showing details of a region of interest 50.

[0042] As it will be appreciated by persons of ordinary skill in the art, changes may be made in the construction and the operation of the various components, elements and assemblies described herein or in the steps or the sequence of steps of the methods described herein without departing from the spirit and scope of the inventive concepts) disclosed herein.

[0043] From the above description, it is clear that the inventive concept(s) disclosed herein is well adapted to carry out the objects and to attain the advantages mentioned herein as well as those inherent in the inventive concepts) disclosed herein. While presently preferred embodiments of the inventive concept(s) disclosed herein have been described for purposes of this disclosure, it will be understood that numerous changes may be made which will readily suggest themselves to those skilled in the art and which are accomplished within the spirit of the inventive concepts) disclosed and claimed herein.

[0044] References

[0045] (1) George Vosselman, “Cartographic Feature Extraction”, Delft

University of Technology, Delft, The Netherlands.