Navigation system for partially-sighted person uses miniature video camera on pair of spectacles and camera on mobile telephone sending signals to navigation server at cell station

The invention refers to a Method for improving the accuracy in determining the position with the aid of a mobile terminal.

Field of the invention especially densely built up areas, such as urban areas.

To determine the position are used to Currently, the following technologies, particularly mobile network operators studied and tested: Cell of Origin (COO or Cell-ID), Enhanced Observed Time Difference (E-OTD), time of arrival (TOA), Assisted GPS (A-GPS) and GPS. The Cell-ID and TOA methods as network-based solutions referred to as terminal-oriented GPS and some A-GPS are. E-OTD and partly A-GPS are hybrid solutions, based both on the Network Infrastructures and to the terminals. The Cell-ID technology has two improved variants. Cell-ID + improve network measurements and Cell-ID plus TA (Timing Advance) the accuracy of position determination.

In addition, there are a number by methods based on infrastructure solutions. Sensors, barks, Low-power radio cells (eg Bluetooth) measure the position of Object or give themselves a precise position, so that the Object it can determine its own position.

Out <patcit><text>DE 297 17 403 U1</text></patcit> is a mobile phone with integrated GPS transmitter or GPS receiver known. By means of this solution Is it possible, current location on positions determine GPS navigation and the display of the mobile phone cartographic display based on orientation appropriate maps.

Out <patcit><text>DE 299 22 501</text></patcit> is a multimedia mobile computer known the of the components of image mobile, computer with a DVD drive, TV card, radio card GPS component clock and lens is. This solution a universal arrangement for a plurality of applications is.

<patcit><text>DE 198 52,659</text></patcit> refers to a vehicle-based solution Navigation with Multimedia incorporating a GPS component. additionally to text information on an information carrier further Information in multimedia form, for example in the form of Images, image sequences, films, sound and music documents or in mixtures these forms filed. The data thus stored can of a service center to be updated. is In this solution, coupled with the video output of the navigation device. The representation objects of interest, both ahead and currently dependent carried from the position of the vehicle. A precise detection the position of this solution not required and also not possible.

Out <patcit><text>DE 198 52 662</text></patcit> is a method for multimedia-assisted navigation and a known navigation device, the one for navigation Motor vehicle in a road network serve. Driving instructions, relying on striking objects along the route refer, are thereby given in everyday language to the user and supported by an optical output. Even with this solution a precise detection of the position neither necessary nor possible.

In <patcit><text>DE 101 10 271</text></patcit> is a solution to clarify the localization of mobile subscribers with Cell-ID / Timing Advance The method described. In this solution, as part of cyclically transmitted Radio field strength signal measurements for many adjacent base stations Cell IDs of base stations in the overlapping Radio cell to a mobile station is located in an active base station supplied, and then the base station with the smallest radius of radio cells certainly. Within these smallest radio cell, the position the mobile station by a subsequent timing advance measurement be more accurately determined.

The inventive method is based on that a possible accurate position determination of the mobile station of the cell ID of the smallest possible Radio cell takes place. In this solution, the accuracy is the position determination with an average of about 50 meters.

The solutions described is common that they for a precise positioning is not designed or suitable are. Solutions, on a GPS based positioning, allow a positioning with an accuracy of about 10 meters to. The positioning on Cell ID-based Methods are only as good as the radio cell density permitting. in addition comes, for example, in large cities in the digital mobile network by dead spots or distraction-related areas exist, in which a position determination is hardly possible.

The inventive method is directed to a solution, the most precise positioning and thus the navigation of pedestrians and Passersby, including visually impaired or blind people, allows. The position of the user to this with an accuracy of up to a few centimeters can be determined.

In the novel process is for determining the position of a participant, preferably a pedestrian, a mobile terminal <figref>2</figref> used, that over an optical pickup device (camera) and a radio link for wireless transmission data features. alternative the camera can also a wireless &lt;?page 3?&gt;or a cable link to the mobile terminal <figref>2</figref> affiliated be. This embodiment for example, can be realized by means of a camera, which in the case of a blind or visually impaired strong participant in a corresponding built special glasses. The data transfer from the camera (glasses) to the mobile terminal <figref>2</figref> done preferably on a wireless connection, for example via Bluetooth. The inventive method is particularly useful for the locating individuals designed which contained a defined area such as a city are, and mainly move my feet.

The mobile terminal <figref>2</figref> the participant takes over the Camera takes an image or a sequence of images of the environment on, in which the carrier the mobile terminal <figref>2</figref> is. The mobile terminal <figref>2</figref> can for example, be a mobile phone with camera and MMS function.

The images recorded by the camera Images or image sequences along with data to device settings from the mobile terminal <figref>2</figref> and of the recording camera, such example, Zoom, camera type, etc. and with the determined by a GPS device geostationary Position of the participant a wireless connection to a Position and Navigation Server <figref>3</figref> Posted. If no geostationary present position, the image or image sequence with is links the radio cell predetermined cell ID and the position and navigation Server <figref>3</figref> Posted. The position determination in this case the position and Navigation Server <figref>3</figref> With Using appropriate procedures on the Cell-ID performed.

From Position and Navigation Server <figref>3</figref> will all data received, including the position information, to an image database <figref>4</figref> forwarded. In the picture Database <figref>4</figref> are a plurality of images or image sequences, for example, an urban area, stored, which already Position data are associated. The position data to the images or image sequences resulting from the existing to the urban area exact measurement data. The survey data contain more precise Position information on the measured objects. let From this data thus also distances from object to object (House of at home) or data for length a road or derive the dimensions of a square. In summary, it should be noted, that within with the help of such precise measurement data at any point assigned a measured site in relation to its position exactly can be.

In the image database <figref>4</figref> done a comparison of the position and Navigation Server <figref>3</figref> received Images image sequences with the images / image sequences already stored there. The search area in the image database <figref>4</figref> is by the transmitted with the data position information via the Cell ID or GPS Measurement were determined, determined. The search area in the picture Database <figref>4</figref> is addressed with the degree of the respective inaccuracy the position determination on GPS or Cell ID specified. For the comparison will be made of the video surveillance known algorithms used (including pattern recognition, handwriting recognition, etc.).

The inventive method is based on a embodiment for the a severe visual impairment position detection / positioning explained subscriber within an urban area.

<figref idrefs="S11">1</figref> shows the operating principle of the inventive method.

<figref idrefs="S12">2</figref> shows a schematic illustration of a Pattern comparison between a from the camera the Visually Impaired Participant captured image and the image from the database <figref>4</figref> for comparison relied images.

The visually impaired participant has a Cell phone and a camera. The mobile phone is available with either BT and SMS functions equipped or it has MMS functionality. At a strongly visually impaired participants, the camera is preferably in a integrated special glasses. additionally the camera function in the spectacle also a voice output be integrated. The voice acting is preferably a earphones realized.

Another function that the Glasses can be realized, including the display of images, the realized by an integrated in the spectacles in the camera monitor can be. This monitor can by the position and Navigation Server <figref>3</figref> calculated Position and navigation data are graphically presented. The graph, for example, by symbols for people Navigation (Eg indication of the direction by arrows or different Brightness done so. The connection between the mobile terminal<figref>2</figref>. here a mobile phone, and the spectacle of the subscriber associated Components is preferably about a wireless connection such as Bluetooth, realized. However, conceivable is a conventional cable connection.

Starts the visually impaired participants the search feature of the invention, as captured by the camera or image sequences together with information on its current position, which is determined via GPS or Cell-ID were, and the belonging to the images or image sequences data the camera settings (eg zoom), etc., and the data for mobile terminal <figref>2</figref> (Device type, etc.) through a Wireless connection to a positioning and navigation server <figref>3</figref> forwarded. The Position and Navigation Server <figref>3</figref> has access to an image database <figref>4</figref>In which images or image sequences to Urban area, such as individual images on buildings, &lt;?page 4?&gt;monuments or other distinctive points of the city, or image sequences of all Streets with on the street lying buildings stored and road crossings are. The images or image sequences are exact position additions associated with at a frame rate each frame also at least one position indication assigned. The position information can arise from the exact Survey data for that city area. In position and navigation Server <figref>3</figref> an image pattern matching between the images taken by the camera of the visually impaired customer images or image sequences and to the image database <figref>4</figref> saved made images and image sequences (see <figref idrefs="S12">2</figref>). The taken into account for the pattern comparison Search section of the image database <figref>4</figref> is carried by the visually impaired Participants together with the images or image sequences to position and Navigation Server <figref>3</figref> transmitted current position information certainly. In the absence of position information, as is the entire Content of the Image Database <figref>4</figref> used for comparison.

Comparing the images from the visually impaired participants with the images or image sequences of the image database <figref>4</figref> done on the basis of an image pattern comparison. Here are preferably consisting of video and image monitoring known algorithms used. This includes known methods for text recognition, so that street names, house numbers, Names of buildings, etc. can be extracted from the image information.

If using the image pattern comparison a match with a in the image database <figref>4</figref> saved recognized image, then from the information on the camera position, angle of view, Camera type and Zoom calculates the position of the viewer. The position and Navigation Server <figref>3</figref> then outputs current position information in the form of an SMS in conjunction with BT or MMS to the subscriber out.

is the case of a visually impaired customers the location indication preferably as voice information over the earphones output, wherein at a transmission in the form of an MMS which belongs to the position indication image of the image database <figref>4</figref> via the issued the spectacle of the visually impaired customer associated Monitor can be. From this current position of the visually impaired participants can then according to the usual procedures in navigation systems the desired of him out place will.

In a first stage, the image database <figref>4</figref> becomes not be covered the entire city, but only the images the main building, courses and monuments and the image sequences of the main roads with the appropriate buildings, and the associated Position information. By the process of the users of the invention for determining the position of the image database <figref>4</figref> supplied Images and image sequences by means of a corresponding function the existence of the image database <figref>4</figref> constantly expanded and updated.

The position information on the new Images in the image database <figref>4</figref> be it by means of a computational algorithm from the position have been to the image database <figref>4</figref> existing Images / image sequences calculated in the image database <figref>4</figref> stored. The images with the thus determined position Sang Eben are here according to their position information in the image database <figref>4</figref> inserted so that in the second stage a database exists that the entire city with the corresponding position information virtually maps. Each site this virtual urban area can the Figure its surroundings as a starting point for navigating to another Place be determined precisely in the urban area.

In the event of a structural change in the urban area are the old pictures / image sequences in most make while retaining the old location information by new date Photo / image sequences replaced. In this way, expanded and updated the Image Database <figref>4</figref> in dependence of the activities of Participants automatically all their database.

The possible with the inventive method precise Positioning is the basis of a number of applications in the field of navigation of pedestrians and other passers-by, including visually impaired or blind people within a defined area, such as the area of ​​a large city.

In particular, during the navigation of blind people is a precise determination of the respective Position in conjunction with very precise information on the area and the desired routing essential.