A system and process for displaying information from a mobile computer in a vehicle

FIELD OF THE INVENTION

0001The present invention relates to computer projection displays on vehicles and in particular to projection displays on fork lift trucks.

BACKGROUND

0002Generally speaking, many forklift trucks are equipped with mobile computers for vehicle status and mobile worker productivity. When the forklift is moving, the computer screen should be blank so as not to distract the driver. However, when the forklift is stationary, the computer screen should be on.

0003Further, transparent screens, such as an Organic Light-Emitting Diode (OLED) screen mounted on the windshield, for example, of a forklift can be seen both from inside and from outside the vehicle. The driver may use the information on the screen to locate crates in a warehouse, for example.

0004However, once the driver leaves the vehicle and looks at the screen from in front of the vehicle, the image is the reverse of what he viewed from inside the vehicle. This may reduce productivity as the driver needs to reorient the information on the screen.

0005<patcit id="pcit0001" dnum="WO2014171124A1"><text>Patent document number WO2014/171124A1</text></patcit> describes a vehicular display device which comprises: an information screen display means for displaying an information screen upon a display unit when a vehicle is stopped; a fixation point location identification means for identifying a fixation point location of a driver; a fixation point location determination means for determining whether the fixation point location is on the display unit; a monitoring means which starts to monitor the situation in the periphery of the vehicle when the fixation point location is on the display unit; a possible to proceed state determination means for determining whether the vehicle is in a possible to proceed state on the basis of the situation in the periphery; a situation screen display means for displaying a situation screen behind the information screen if it is possible for the vehicle to proceed; and a translucency means for making the information screen translucent.

0006<patcit id="pcit0002" dnum="JP2005242606A"><text>Patent document number JP2005-242606A</text></patcit> describes an image generation system which comprises: space reconstructing means for mapping input images from one or more cameras to a predetermined space model in a three-dimensional space; viewpoint converting means for referring to the space data mapped by the space reconstructing means to generate virtual viewpoint images that are images viewed from arbitrary virtual viewpoints in the three-dimensional space; and display controlling means for controlling the display of the plurality of virtual viewpoint images viewed from the different viewpoints.

0007Therefore, a need exists for a system that allows the screen to be easily seen by the driver of the vehicle from both inside and outside the vehicle and which automatically presents the same view of the screen to the driver regardless of the driver's position with respect to the vehicle.

SUMMARY

0008The present invention in its various aspects is as set out in the appended claims.

0009Accordingly, in one aspect, the present invention embraces a system for displaying information from a mobile computer in a vehicle.

0010In an exemplary embodiment, the system comprises: a screen mounted on the vehicle, means for projecting images from the mobile computer onto the screen, means to determine a driver of the vehicle's position with respect to the vehicle, and means to adjust the orientation of the images on the screen based upon the position of the driver. The screen is a transparent screen and is viewable from inside the vehicle and from outside the vehicle. The means to determine a driver of the vehicle's position with respect to the vehicle and the means to adjust the orientation of the images on the screen based upon the position of the driver are communicatively linked to the computer. The system is configured to reverse the orientation of the images on the screen based upon the driver being in front of the vehicle.

0011In another exemplary embodiment, the system further comprises means to determine when the vehicle is stopped. The means to determine when the vehicle is stopped is communicatively linked to the computer. The means for projecting images is configured to project images onto the screen based upon the vehicle being stopped.

0012In another exemplary embodiment of the system, the means to determine the position of the driver includes means to determine when the driver is inside the vehicle.

0013In another exemplary embodiment of the system, the means to determine when the driver is inside the vehicle is selected from a seat sensor for occupant detection, a manual switch operated by the driver of the vehicle, and a scanner for sensing when the driver enters and leaves the vehicle.

0014In yet another exemplary embodiment of the system, the means to determine the position of the driver includes means to determine when the position of driver is in front of the vehicle and when the position of the driver is behind the vehicle.

0015In another exemplary embodiment of the system, the means to determine when the position of driver is in front of the vehicle and when the position of the driver is behind the vehicle is selected from a wireless control operated by the driver, and a position sensor carried by the driver communicatively linked to the computer.

0016In another exemplary embodiment of the system, the means to adjust the orientation of the images on the screen based upon the position of the driver is comprised of a wireless control operated by the driver. The wireless control is communicatively and wirelessly linked to the computer.

0017In another exemplary embodiment of the system, the vehicle is a forklift truck.

0018In another exemplary embodiment of the system, the screen is an OLED screen. The OLED screen is positioned on the windshield of the forklift truck.

0019In another exemplary embodiment, the system further comprises means to zoom in and scroll the images on the screen.

0020In another exemplary embodiment of the system, the means to zoom in and scroll the images on the screen is controlled by the driver. The driver is provided with a wirelessly-linked control to the computer.

0021In yet another exemplary embodiment of the system, the means to determine a driver of the vehicle's position with respect to the vehicle is comprised of a portable scanner. The portable scanner is provided with a position sensor. The portable scanner is communicatively linked by wireless means to the computer. The driver's position with respect to the vehicle is determined by the position sensor on the portable scanner based upon the driver carrying the portable scanner.

0022In another exemplary embodiment of the system, the portable scanner is provided with means to zoom in the images on the screen. The means to zoom in is provided with predetermined settings based upon the portable scanner carried by the driver being at corresponding predetermined distances away from the vehicle and the portable scanner communicating the position of the driver to the computer. Thus the images are zoomed in when the driver is further away from the vehicle.

0023In another exemplary embodiment of the system, the portable scanner is a barcode scanner.

0024In another exemplary embodiment of the system, the portable scanner is an RFID reader.

0025In another aspect, the present invention embraces a process for displaying information from a mobile computer in a vehicle.

0026In an exemplary embodiment, the process comprises the steps of projecting images from the computer onto a transparent screen in the vehicle, sensing a driver of the vehicle's position with respect to the vehicle; and orienting the images on the screen based upon the driver's position with respect to the vehicle.

0027In another exemplary embodiment, the process further comprises the steps of sensing when the vehicle is stopped, and projecting an image on the screen based upon the vehicle being stopped.

0028In another exemplary embodiment of the process, the orienting step is comprised of the steps of: orienting the images on the screen in a first orientation based upon the driver's position being selected from being in the vehicle, behind the vehicle, and being to the side of the vehicle; and orienting the images on the screen in a second orientation based upon the driver's position being in front of the vehicle, the second orientation being a mirror image of the first orientation.

0029In another exemplary embodiment, the process further comprises the step of zooming in on the projected images on the screen to predetermined settings based upon the driver's position being predetermined distances from the vehicle. The predetermined settings correspond to the predetermined distances.

0030In another exemplary embodiment of the process, a portable scanner with a position sensor is provided to the driver of the vehicle. The portable scanner is communicatively linked by wireless means to the computer. The step of sensing a driver of the vehicle's position with respect to the vehicle includes the steps of sensing the position of the driver when the driver exits the vehicle with the portable scanner, and transmitting driver position information to the computer from the portable scanner when the driver is outside the vehicle.

0031The foregoing illustrative summary, as well as other exemplary objectives and/or advantages of the invention, and the manner in which the same are accomplished, are further explained within the following detailed description and its accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

0032<ul id="ul0001" list-style="none"><li><figref idref="f0001">Figure 1</figref> schematically depicts an exemplary embodiment of the system for displaying information from a mobile computer in a vehicle where the driver of the vehicle is not in front of the vehicle.</li><li><figref idref="f0002">Figure 2</figref> schematically depicts an exemplary embodiment of the system for displaying information from a mobile computer in a vehicle where the driver of the vehicle is in front of the vehicle.</li><li><figref idref="f0003">Figure 3</figref> schematically depicts in flowchart form the process according to an exemplary embodiment of the invention.</li></ul>

DETAILED DESCRIPTION

0033The present invention embraces a system for displaying information from a mobile computer in a vehicle.

0034In an exemplary embodiment, referring to <figref idref="f0001">Figure 1</figref>, the system (10) is comprised of a screen (28); a means for (22) for projecting images (30) from the mobile computer (20) onto the screen (28); means (24) to determine a driver (12) of the vehicle's position with respect to the vehicle (11); and means (not shown) to adjust the orientation of the images (30) on the screen (28) based upon the position of the driver (12). The screen (28) is mounted on the vehicle (11). The screen (28) is a transparent screen. Further, the screen (28) is viewable from inside the vehicle (11) and from outside the vehicle (11). The means (24) to determine a driver (12) of the vehicle's position with respect to the vehicle and the means to adjust the orientation of the images (30) on the screen (28) based upon the position of the driver (12) are communicatively linked to the computer (20). The system (10) is configured to reverse the orientation of the images (30) on the screen (28) based upon the driver (12) being in front of the vehicle (11). In the present Figure, the driver (12) is depicted as being behind the vehicle (11). In <figref idref="f0002">Figure 2</figref>, the driver (12) is shown in front of the vehicle (11). The images (30) on the screen (28) are the mirror of the images (30) depicted in <figref idref="f0001">Figure 1</figref>, or look exactly the same from the front of the vehicle (11) as from inside or behind the vehicle (11) from the perspective of the driver (12).

0035<figref idref="f0002">Figure 2</figref> is similar to <figref idref="f0001">Figure 1</figref>, except that driver (12) is now in front of the vehicle (11), and thus the images (30) have been reversed as discussed above. The following discussion applies equally to <figref idref="f0001">Figures 1</figref> and <figref idref="f0002">2</figref>.

0036As illustrated in <figref idref="f0001">Figures 1</figref> and <figref idref="f0002">2</figref>, the vehicle (11) may be a forklift truck.

0037The screen (28) is preferably an OLED screen. The OLED screen (28) is positioned on the windshield of the forklift truck.

0038The means for projecting images (22) may be a projector communicatively linked to and controlled by the computer (20). Alternatively, for example in the case where the screen (28) is an OLED screen, the means for projecting images (22) may be electrically wired from the computer (20) to the screen (28) as is depicted in <figref idref="f0001">Figures 1</figref> and <figref idref="f0002">2</figref>.

0039The means (24) to determine the position of the driver (12) includes means to determine when the position of driver is in front of the vehicle and when the position of the driver is behind the vehicle.

0040The means (24) to determine when the position of driver is in front of the vehicle and when the position of the driver is behind the vehicle may be, for example, a wireless control operated by the driver or a position sensor carried by the driver communicatively linked to the computer.

0041In another exemplary embodiment of the system, the means to adjust the orientation of the images (30) on the screen (28) based upon the position of the driver is comprised of a wireless control operated by the driver (12). The wireless control is communicatively and wirelessly linked to the computer (20).

0042In an exemplary embodiment, the means (24) to determine when the position of driver is in front of the vehicle and when the position of the driver is behind the vehicle, and the means to adjust the orientation of the images on the screen may be combined in one unit. Thus, the driver (12) may hold the unit (24) which has a position sensor and communicates with the computer (20) to change orientation of the images (30) depending on the driver's (12) position.

0043For example, in yet another exemplary embodiment of the system, the means (24) to determine a driver of the vehicle's position with respect to the vehicle is comprised of a portable scanner (referred hereinafter as 24). The portable scanner (24) is provided with a position sensor. The portable scanner (24) is communicatively linked by wireless means to the computer (20). The driver's (12) position with respect to the vehicle (11) is determined by the position sensor on the portable scanner based upon the driver (12) carrying the portable scanner.

0044The portable scanner (24) may be for example a barcode scanner, or for example an RFID reader. For example, the driver (12) of the vehicle (11) fork lift may be identifying pallets for transport in a warehouse. The mobile computer (20) and the images (30) on the screen (28) show the driver (12) where to find the pallet to be moved. The portable scanner (24) can be used both on the images (30) and the on the pallets to identify targets for transport. The portable scanner (24) uses a position sensor provided therein, to track the driver's (12) position with respect to the fork lift vehicle (11), and more specifically to the screen (28), and sends this information to the computer (20) wirelessly. The computer (20) changes the images' (30) orientation based on the position sensor information provided. Thus the driver (12) always can view the images (30) on the screen (28) at the same orientation from any position around the vehicle (11), beside, and in front of the vehicle (11).

0045In another exemplary embodiment, the system (10) further comprises means to zoom in and scroll the images (30) on the screen (28). The means to zoom in and scroll the images (30) on the screen (28) is controlled by the driver (12). For example, the driver (12) may be provided with a wirelessly-linked control to the computer (20).

0046For example, in another exemplary embodiment of the system, the portable scanner (24) is provided with means to zoom in the images on the screen. The means to zoom in is provided with predetermined settings based upon the portable scanner (24) carried by the driver (12) being at corresponding predetermined distances away from the vehicle (11) and the portable scanner (24) communicating the position of the driver (12) to the computer (20). Thus the images (30) are zoomed in when the driver (12) is further away from the vehicle (11). Further, the portable scanner (24) is provided with screen control via wireless communication with the computer (20). Thus the driver (12) can both zoom and scroll the images (30) on the screen (28).

0047In another exemplary embodiment, the system further comprises means (not shown) to determine when the vehicle (11) is stopped. The means to determine when the vehicle (11) is stopped is communicatively linked to the computer (20). The means for projecting images (22) is configured to project images (30) onto the screen (28) based upon the vehicle (11) being stopped. Further, the means to determine the position of the driver (12) includes means to determine when the driver (12) is inside the vehicle (11).

0048For example, in another exemplary embodiment of the system (10), the means to determine when the driver is inside the vehicle is selected from a seat sensor for occupant detection, a manual switch operated by the driver of the vehicle, and a scanner for sensing when the driver enters and leaves the vehicle.

0049In an exemplary embodiment, the system for displaying information from a mobile computer in a vehicle could be employed in conjunction with a system for tracking motion and position of a vehicle and for displaying information in the vehicle based upon tracking and position information. Such a system, for example, is comprised of a mobile computer mounted to the vehicle to be viewable by a driver of the vehicle. The mobile computer has a screen and a frame surrounding the screen. The screen is an OLED screen. The screen is provided with orientation means. Additionally, an inertia measurement system for measuring vehicle motion, stillness, and position is provided. The inertia measurement system is affixed to the frame. Further provided is means for processing measurements from the inertia measurement system. These means for processing measurements are configured to determine the vehicle's motion, stillness, and position from the measurements from the inertia measurement system. The system communicatively links the mobile computer, the means for processing measurements, the inertia measurement system, and the orientation means. The system is configured to make the OLED screen transparent based upon the means for processing measurements determining that the vehicle is in motion. The system being further configured to turn on the OLED screen based upon the means for processing measurements determining that the vehicle is still. The system is further configured to adjust the orientation of the OLED screen based upon position measurements from the inertia measurement system.

0050In another exemplary embodiment, such a system may further comprise a motion sensor communicatively linked to the OLED screen. The motion sensor is configured to track hand and finger gestures of the driver of the vehicle and to translate the hand and finger gestures into actions on the OLED screen. The inertia measurement system is a three axis inertia measurement system, having three accelerometers corresponding to an x-axis, a y-axis, and a z-axis. The means for processing measurements is a central processing unit, which is communicatively linked and interactive with the three accelerometers. The central processing unit includes a sliding window discrete Fourier transform algorithm and a calibration system for the three axis inertia measurement system. The calibration system is configured to establish a frequency band of the vehicle vibrations, wherein motion vibrations of the vehicle are at least an order of magnitude greater than idle vibrations of the vehicle. The calibration system is further configured to align the three axis inertia measurement system so that the y-axis is aligned with forward motion of the vehicle, to determine sensor readings for motion patterns of the vehicle, to apply the sensor readings to determine vibration thresholds which determine the motion patterns of the vehicle, to apply the sliding window discrete Fourier transform algorithm to the sensor readings corresponding to motion patterns of the vehicle and to the frequency band, to characterize the system performance for the sliding window discrete Fourier transform algorithm, to recommend default parameters for the sliding window discrete Fourier transform algorithm, and to determine the three axis inertia measurement system orientation through readings of the accelerometers in the three axis inertia measurement system. The central processing unit is configured to capture an initial reference point of the vehicle information as to the vehicle's location from the three axis inertia measurement system. Further, the central processing unit is configured to sample inertia measurement readings while vehicle is in operation and to correct sampled inertia measurement readings based on the calibration system. The central processing unit is also configured to estimate a movement vector of the vehicle from corrected inertia measurement readings and to apply movement vector estimations to the sliding window discrete Fourier transform algorithm. This system may further include a motion detection logic. The motion detection logic is configured to estimate energy of signals issuing from the sliding window discrete Fourier transform algorithm and to determine if the vehicle is in motion and what direction the motion is occurring by comparing the energy of signals to the vibration thresholds in the frequency band.

0051In another aspect, the present invention embraces a process for displaying information from a mobile computer in a vehicle. The process generally utilizes the system described and depicted with respect to <figref idref="f0001">Figures 1</figref> and <figref idref="f0002">2</figref>. Referring now to <figref idref="f0003">Figure 3</figref>, the process (300) is schematically depicted.

0052The process (300) starts (305) and is comprised of the steps of: (307) projecting images from the computer onto a transparent screen in the vehicle, (309) sensing a driver of the vehicle's position with respect to the vehicle; and (311) orienting the images on the screen based upon the driver's position with respect to the vehicle.

0053In another exemplary embodiment, the process (300) further comprises the steps of (313) sensing if the vehicle is stopped or not, and making a decision (315) on projecting images onto the screen based on the sensor. If the vehicle is stopped, the step (307) of projecting images from the computer onto the screen is carried out. If the vehicle is not stopped the step (317) of not projecting images is carried out or continued.

0054In another exemplary embodiment of the process (300), the step (311) of orienting the images on the screen based on the driver's position with respect to the vehicle may include the step of a decision (319) on the position of the driver. If the driver is not in front of the vehicle, i.e. behind the vehicle, in the stopped vehicle, or on either side of the vehicle, then the step (321) orienting the images on the screen in a first orientation is carried out. If the driver is in front of the vehicle, the step (323) of orienting the images on the screen in a second orientation is carried out. The second orientation is the reverse or the mirror image of the first orientation. Thus the driver sees the same projected images in the orientation no matter where the driver is positioned with respect to the vehicle.

0055In another exemplary embodiment, the process (300) further comprises the step (329) of zooming in on the projected images on the screen to predetermined settings based upon the driver's position being predetermined distances from the vehicle. The predetermined settings correspond to the predetermined distances. Thus the driver's position and distance with respect to the vehicle automatically adjusts the orientation and size of the images on the screen.

0056In another exemplary embodiment of the process (300), a portable scanner with a position sensor is provided to the driver of the vehicle. The portable scanner is communicatively linked by wireless means to the computer. The step (309) of sensing a driver of the vehicle's position with respect to the vehicle includes the steps (325) of sensing the position of the driver when the driver exits the vehicle with the portable scanner, and (327) transmitting driver position information to the computer from the portable scanner when the driver is outside the vehicle. From step (327), the process (300) proceeds to the (311) orienting step.

0057The process (300) necessarily ends or repeats. For example, when the driver gets back in the vehicle and starts moving or when the mobile computer is shut down, the process (300) ends with step (330). The process (300) will continue or repeat all or part of the process (300) with step (330) as the driver moves around the vehicle and the images are reoriented on the screen based on the driver's position with respect to the vehicle, and as the driver zooms in or scrolls images on the screen in accordance with the driver's given tasks.