Remote display reproduction system and method

[0001] The invention relates generally to the field of communication, navigation and user-control of a motor vehicle. The invention relates in more detail to systems and methods for reproducing an image from a remote source to a vehicle display, as disclosed in EP 1 338 866A and EP 1 698 518A.

[0002] Vehicles typically include a number of electronic systems and subsystems such as an audio system, a cellular phone system, a navigation system, a built-in multimedia system, a motor control system that can be controlled by a user interface, an HVAC system, etc. One or more of these systems may include or be provided by a vehicle control system that may be located in the vehicle. The control system may include a control interface and an attached control system and may be configured to be coupled or interconnected with other electronic systems in the vehicle, such as a display system or audio system.

[0003] Standard vehicles having control systems are usually "autonomous" in that they do not communicate adequately with other vehicle systems or remote systems. Some conventional vehicles with control systems can communicate with remote sources such as cell phones to allow various audio functions such as hands-free cell communication. A typical vehicle control system may also include visual output images capable of providing images designed to make the in-vehicle control system more user-friendly, more useful or more pleasant. Some typical control systems in the vehicle allow the display of navigation information on the visual display. These systems typically generate display information from the embedded system. Such systems often have numerous disadvantages. For example, embedded systems with internally generated navigation information often require the use of stored navigation data(e.g., navigational DVD, etc.). Because the roads change, the user must buy updates to the navigation data, or must continue to drive with outdated data. Similarly, software and hardware generators can quickly become outdated. Thus, the usefulness of a conventional navigation system may decline over time.

[0004] Typical "embedded" or embedded systems may exhibit the same problems unrelated to navigational data and software. For example, media players, e-mail and text messaging communicators, home control systems, and any other control or entertainment systems that have visual elements may have the problem of data, software or hardware outdated. For example, the function of notifying the steering system in the vehicle may be at the beginning

- 2 work properly, but the notification protocol can change, which will make the vehicle control system obsolete. Similarly, popular media codecs (ie algorithms for compressing and decompressing music files, videos and other media files, etc.) can change over time, often quite quickly. For many reasons, including convenience and costs, neither users nor original equipment manufacturers (OEMs) often want to introduce software updates to vehicle control systems. In addition, because software and hardware functions are added to vehicle control systems, design and production costs for OEMs, vehicle manufacturers and possibly customers and drivers are increasing.

[0005] There is a need for a vehicle control system capable of displaying visual information from remote sources. In addition, there is a need for a vehicle control system capable of being displayed in real time; Live or frequently update images from a remote source. There is a need for a vehicle control system or a method capable of displaying information in the form of bitmaps generated by a remote source. In addition, there is a need for a vehicle control system that provides systems and methods for receiving bitmaps from remote sources and displaying them on the output display in the vehicle.

[0006] It would be desirable to provide a system and / or method that would meet one or more of these needs or provide other advantageous features. Other features and advantages of the invention will emerge from this specification. The disclosed recommendations include those embodiments that fall within the scope of the claims, regardless of whether they meet one or more of the above-mentioned needs.

Summary [0007] One embodiment example relates to a system according to claim 1.

[0008] The invention may have other embodiments or may be made or carried out in various ways. Alternative embodiments refer to other features and combinations of features that can generally be mentioned in the claims.

Brief description of the drawings [0009] The invention will be better understood from the following detailed description, taken into account with the accompanying drawings, on which like reference numerals refer to similar elements in which:

[0010] FIG. 1 is a perspective view of a motor vehicle that includes a number of vehicle systems, including a vehicle control system, in accordance with one embodiment;

[0011] FIG. 2 is a plan view of the user interface of the vehicle control system of FIG. 1, according to one embodiment;

[0012] FIG. 3 is a block diagram of a vehicle control system of FIG. 1, according to one embodiment;

- 3 [0013] FIG. 4 is a more detailed embodiment and a block diagram of the vehicle control system of FIG. 3, according to one embodiment;

[0014] FIG. 5 is a perspective view of a vehicle control system duplicating a remote source display, according to one embodiment;

[0015] FIG. 6A is a technology diagram that can be used to display images received from remote sources on a vehicle display, according to one embodiment;

[0016] FIG. 6B is a process diagram that can be used to display images received from remote sources on a vehicle display, according to another embodiment;

[0017] FIG. 7 is a process flow diagram that can be used to display bitmaps from remote sources on a vehicle display, according to another embodiment;

[0018] FIG. 8A is a block diagram illustrating a control system communicating with a remote source, the control system receiving picture information and meta-information, according to one embodiment;

[0019] FIG. 8A is a block diagram illustrating a control system communicating with a remote source, wherein the control system receives information regarding the image and sends and receives information from the user interface according to one embodiment;

[0020] FIG. 9 is a process diagram of a process that a vehicle control system can use for output metainformations regarding a received image, in accordance with one embodiment;

[0021] FIG. 10A is a process flow diagram that a vehicle control system may use to display an image received from a remote source, according to one embodiment;

[0022] FIG. 10B is a process flow diagram that a remote source may use to deliver an image to a vehicle control system to display, according to one embodiment;

[0023] FIG. 11A is a process flow diagram that a vehicle control system can use to interpret a signal received from a local user interface (UI) member and to provide a command and / or control signal to a remote source based on a signal, according to one embodiment;

[0024] FIG. 11B is a front view of a programmed desktop, according to one embodiment;

- [0025] FIG. 12 is a block diagram of a vehicle display reproducing a partial image displayed on the display of a mobile device, according to one embodiment;

[0026] FIG. 13 is a block diagram of a vehicle control system configured to map the function of a portable device to UI elements or a function of a vehicle control system in accordance with one embodiment;

[0027] FIG. 14 is a process flow diagram of a process that a vehicle control system can use to map the functions of a mobile device to a UI element or function, according to one embodiment;

[0028] FIG. 15 is a process flow diagram that a vehicle control system may use to send a command to a mobile device based on a mapped UI element, in accordance with one embodiment;

[0029] FIG. 16 is a process flow diagram that a vehicle control system can use to map multiple commands of remote sources to a UI element in a vehicle, according to one embodiment;

[0030] FIG. 17 is a process flow diagram that a vehicle control system may use to send commands to a mobile device based on a mapped UI element in a process such as the process depicted in FIG. 16, according to one embodiment;

[0031] FIG. 18 is a diagram of a plurality of devices that can be connected to a vehicle control system in accordance with one embodiment;

[0032] FIG. 19 is a block diagram of a vehicle control system connected to modules and subsystems in a vehicle via a data bus in a vehicle, according to one embodiment;

[0033] FIG. 20 is a block diagram of a vehicle control system connected to a plurality of remote sources, according to one embodiment;

[0034] FIG. 21 is a flow diagram of a process for facilitating the connection of multiple devices, according to one embodiment;

[0035] FIG. 22 is a flow diagram of the communication task completion process, according to one embodiment and [0036] FIG. 23 is a flow diagram of a process for providing remote source functions, according to one embodiment.

Detailed description of embodiments [0037] Before referring to figures that illustrate exemplary embodiments in detail, it should be understood that the application is not limited to the details or methodologies set forth in the following description or illustrated in the figures. Also it should be

- understand that the phraseology and terminology used in the present description is used for description purposes and should not be considered as limiting.

[0038] In general with reference to the figures, the vehicle control system is provided to reproduce or duplicate the displayed data generated and displayed on the remote source. The vehicle's control system establishes data transmission (wired or wireless) with a remote source. A remote source will use one or more applications. Images displayed on a remote source with these applications will be sent to the vehicle's steering system. After receipt by the control system in the vehicle, the images will be delivered to the display system in the vehicle. In addition to images, one or more user interface functions from a remote source will also be provided or made available to the in-vehicle control system.

[0039] With reference to FIG. 1, the vehicle 100 includes a number of subsystems for the convenience and entertainment of the user. Vehicle 100 generally includes a heating, ventilation and air conditioning (HCAV) system, sound system and control system in vehicle 106 (e.g., media system, navigation system, entertainment system, display system, communication systems, etc.) HCAC system, sound system and communication systems may be combined with a vehicle control system 106 that can control and control various systems, either automatically or through a manual user command. It is noted that in various embodiments, the vehicle 100, the HVAC system, the sound system and other systems in the vehicle can be any old, present or future design that can interact with the vehicle control system 106.

[0040] With reference to FIG. 2, an embodiment of a control system in a vehicle 106 is shown. The control system in a vehicle 106 generally includes an output display 108, one or more handwheels 110, one or more buttons 112 and one or more tactile inputs for a user or 114 buttons that make it easier to control various vehicle and media functions. In one embodiment, the display 108 may be a touch screen, while in other embodiments it may be any other non-touch display. In yet other embodiments, the output display 108 may be made in any technology (e.g., LCD, DLP, plasma, CRT), configuration (e.g., portrait or landscape) or shape (e.g., polygonal, rounded, curved). The output display 108 may be a factory-installed output display, an output display from the aftermarket, or an output display from any other source. The output display 108 may be a built-in display (e.g., a display built into the control system or other systems, vehicle parts or structures), a standalone display (e.g., a portable display, a display mounted on a movable arm) or a display of any other configuration. The output knobs 110 and buttons 112 and 114 may be configured: (i) to a display built into the control system or other systems, parts or structures of the vehicle), a standalone display (eg a portable display, a display mounted on a movable arm) or a display of any other configuration. The output knobs 110 and buttons 112 and 114 may be configured: (i) to a display built into the control system or other systems, parts or structures of the vehicle), a standalone display (eg a portable display, a display mounted on a movable arm) or a display of any other configuration. The output knobs 110 and buttons 112 and 114 may be configured: (i) to

- 6 control functions of the HVAC system such as fan speed, cabin temperature, to direct the air stream, (ii) to control the playback of multimedia files in the sound system, (iii) to control the search of information from the phone book, (iv) to control any other the desired vehicle puncture, or to (v) control the function of the connected remote source. The buttons 114 typically allow selection and display of various functions of the control and multimedia system in the vehicle 106 including HVAC system control, audio system control, multimedia system control, display system control, communication system control, handsfree system, telephone book management / address, modifying / viewing the calendar and recording vehicle data. The buttons 114 may also allow viewing and reconfiguration of image playback settings, device profiles and / or command and control mappings.

[0041] The handling of the media handling buttons 114 may display a media playback menu screen or carry out commands that allow the user to view, select, sort, search and / or play audio or video files by means of a tactile or voice command. Operating keys 114 for operating a hands-free telephone may display a menu screen or carry out commands that allow the user to connect the control system in the vehicle 106 with the mobile phone in such a way that it is possible to operate the mobile phone to the vehicle console in the vehicle control system 106. Operating buttons 114 for HVAC control can display a menu screen or carry out commands, which allow the user to control the temperature in the cabin and the airflow by means of a tactile or voice command. Operating the contact management buttons 114 may display a menu screen or carry out commands that allow the user to view, write, select, sort, search, edit and / or select one or more entries containing personal contact information by using a tactile or voice command. Operating buttons 114 for managing the calendar may display a menu screen or carry out commands that allow the user to view, write, select, sort, search, edit and / or create one or more entries containing personal information on the schedule, using a tactile or voice command. The operation of the vehicle register management buttons 114 may display a menu screen or carry out commands that allow the user to input, view, select and / or reset vehicle operation information (e.g., fuel consumption, engine temperature, residual fuel, etc.) by touch or a voice command. Operating buttons 114 to control communication may display a menu screen or carry out commands that allow the user to enter, view, select, reset, set or activate communication settings or communication modes by means of a tactile or voice command. Operating buttons 114 to control display playback can display a menu screen or carry out commands,

- 7 entering, reviewing, setting, selecting and / or changing the settings of the display profile or display settings such as color, resolution, size, language, inclination or any other setting or variable, by means of a tactile or voice command. Operating buttons 114 to control the device profile can display a menu screen or carry out commands that allow the user to enter, view, set, select and / or change profiles of remote devices that have been previously connected to the system, are connected to the system or can be connected to system. Operating buttons 114 to map commands and controls can display a menu screen or carry out commands that allow the user to enter, view, set, selecting and / or changing functions or commands related to any button, touch screen element, joystick, scroll wheel, steering wheel mounted lamp, voice command or other user interface element (UI) in the vehicle. For example, the menu interfaces for command and control mapping can be used to map the UIs in the vehicle to the functions or commands of the remote source [0042] Referring to FIG. 3, the control system in the vehicle 106 may have access to data files from the remote source 116 via the communication link 118. For example, the control system in the vehicle 106 may have access to multimedia files, data files from the telephone book, data regarding images or any other available data for use by the multimedia and control system in the vehicle 106.

The control system in the vehicle 106 generally comprises a communication device 120, a data processing system 122, a display controller 124, a user interface 126, an audio input device 128, an audio output device 130, an output display 108, and a memory device 132.

[0044] The communication device 120 is generally configured to establish a communication link 118 with a remote source 116. In one embodiment, the multimedia and control system on the vehicle 106 can establish a wireless communication link such as with a Bluetooth communication protocol, IEEE 802.11 protocol, IEEE protocol. 802.16, a cellular signal, the Shared Access Wireless Access Protocol (SWAP-CA) protocol, a wireless USB protocol or any other suitable wireless technology. In another embodiment, the multimedia and control system in the vehicle 106 may establish a wired communication link such as with USB technology, IEEE 1394 technology, optical technology, another technology for serial or parallel ports or any other suitable wired connection. The communication device 120 may receive one or more data files from a remote source 116. In various embodiments, the data files may include text, digital, audio, video data,

- 8 software, command data, information data, coordinating data, image data, streaming media or any combination of them.

[0045] The data processing system 122 is connected to the communication device 120 and is generally configured to control each function of the multimedia and control system in the vehicle 106. The data processing system 122 may support the speech recognition capability of the control system in the vehicle 106 for user convenience. The data processing system 122 may include digital or analogue processing components and / or any existing or present or future design that supports the control or functions of the control system in the vehicle 106. The data processing system 122 may be a single data processing device or multiple processing devices. data. The data processing system 122 may be a data processing device having sub-devices or data processing components. The data processing system 122 may include any combination of software program and hardware capable of providing control, display, communication, input and output functions to the vehicle. The data processing system 122 may coordinate various devices, components and functions of the vehicle control system (e.g., communication device 120, output display 108, display controller 124, memory device 132, audio system 104, user interface 126, audio input device 128, output device audio 130, etc.).

[0046] The device controller 124 is connected to the output display 108 and is typically configured to provide an electronic signal to the output display. In one embodiment, the electronic signal may include text and / or numeric data files, while in other embodiments, any other desired data may be included in the text and / or numeric data or may be included in the display electronic signal itself. output. In another embodiment, the display controller 124 may be configured to control an output display 108 with touch screen features, while in other embodiments the display controller 124 may be configured to control the display 108 without using the features of the touch screen.

[0047] The input audio device 128, e.g. a microphone, is configured to receive the speech of the user transmitted to the speech processing system 122 to recognize speech in such a way that the functions of the control system in the vehicle 106 can be operated by a voice command. The output audio device 130, e.g. a built-in loudspeaker, is configured to provide the user with audio prompts with various functions, such as user selection confirmation.

[0048] The memory device 132 is configured to store data to which the control system in the vehicle 106 has access. For example, the memory device 132 may store data input by the remote source 116, data generated by the data processing system 122 that can be used later, intermediate data used in current calculations or processes, or any other data used by the control system in the vehicle 106.

[0049] With reference to FIG. 4, the control system in the vehicle 106 and the remote source 116 are described in more detail. The data processing system 122 may generally comprise a text-in-grammar device 134, a speech recognition device 136 and a text-to-speech device 138. The data processing system 122 may include any number of additional hardware modules, software modules or processing devices (eg additional graphics processors, communication processors, etc.).

The text-w-grammar device 134 may be combined with the communication device 120 and is generally configured to generate phonemic mapping of text and / or numeric data of each of the data files received by the communication device 120 from remote source 116. Phonetic mapping of data the text and / or numeric data of each data file can be configured to facilitate the speech recognition of each data file. After converting the data file into a phonetic mapping, the data file can be accessed via an oral input command received by the speech recognition device 136 via the audio input device 128. According to one embodiment,

The speech recognition device 136 is typically configured to receive a verbally entered command from a user via the audio input device 128. The speech recognition device compares the received verbal input command with a set of predetermined input commands that may be configured by the device text In various embodiments, the input commands may be for playing multimedia files, selecting or storing from the phone book, writing or lists from the calendar or contact data, controlling the HVAC system or any other function performed on the data. The speech recognition device 136 may determine the corresponding response to an oral input command received from the user, e.g. whether the verbal input command is an important or invalid instruction, what command to do or any other answer. According to one embodiment, the speech recognition device 136 may be capable of triggering or activating the image reproduction mode when certain commands are recognized. Furthermore, the speech recognition device 136 may be capable of transmitting commands to the remote device 116 to facilitate interactive control of the remote source over the communication link.

[0052] The text-to-speech device 138 is generally configured to convert text and / or numerical data from the data with data received from the remote source 116 into audible

- speech reproduction. This function may allow the control system in the vehicle to be heard audibly by the user via the audio output device 130 or the audio system 104. For example, the control system in the vehicle 106 may repeat the user-selected function back to the user, provide the navigation information , announcing directions, announcing menu options, announcing information about a media file, providing information from a phone book or contacts or other information related to data stored in a memory device 132, remote source 116, remote server 154, etc. According to one embodiment, the text-speech device 138 may be capable of providing audible mapping of information received from a remote source.

[0053] The memory device 132 includes non-persistent memory 140 and persistent memory 142. The non-persistent memory 140 can be configured such that its contents can be erased during each power cycle of the control system 106 or the vehicle 100. The persistent memory 142 can be configured in such a way that the contents stored therein can be extracted during power cycles in such a way that after starting the control system 106, data from earlier system use are still available to the user. According to one embodiment, the persistent memory 142 may store one or more user profiles, display profiles, communication profiles, or any other types of files with user or system settings.

[0054] According to one embodiment, the remote source 116 includes a transceiver and is able to interact with the control system in the vehicle 106 via a communication link 118 (wireless or wired). According to the invention, the remote source 116 is a personal navigation device (PND) 150. The remote source 116 may have a storing device or one or more processing devices, and one or more communication devices. According to one embodiment, the remote source116 is a remote source that can be compatible with a global positioning system. According to various embodiments, remote sources 116 can connect to the Internet or any other remote source using the first communication device,

[0055] With reference to FIG. 5, according to one embodiment, a control system is provided in the vehicle 106 reproducing the remote source display 116 on the output display 108. The remote source 116 is shown as a PDA or PND resting on the support arm 502, wherein the control system in the vehicle 106 can be configured for communicating wirelessly with a remote source 116. The remote source 116 may be a remote GPS-compatible device configured to access the navigation data and to apply said beacon data to at least partially generate an image that may be depicted on the remote display 501. The vehicle control system 106 may establish a communication link with a remote source 116, initiate a map reproduction mode

- 11 bit, receive bitmaps from the remote source 116 and display the received bitmap on the output display 108. According to various embodiments, the remote source 116 is a remote source capable of generating (e.g., partially generating, fully generating or otherwise generating, etc) .) a graphic for presenting on its own display and communicating the image from the displayed graphic (e.g., just displayed, currently displayed or displayed in the future, etc.) to the control system 106. The image can be any image, graphics, raster graphics, bitmap, vector graphics, digital image, data file or any other structure that can image a generally rectangular grid of image pixels. Images can be compressed and / or can be images from any type of image file. E.g,

[0056] According to one embodiment, the remote source 116 may include any number of processes, software and / or hardware to record an image from its display system for transfer to a control system in the vehicle 106. For example, the remote source 116 may include a program, which extracts the image (eg screenshot, "screen print", screen record, etc.) from information currently or recently displayed on the remote display 501. This software can work in many different ways, including reading the remote source hardware devices for retrieving information (e.g., a memory device, display buffer, display driver buffer, display equipment, etc.) and / or the use of other software to extract information (e.g., display driver software,operating system software, application software, etc.).

[0057] According to one embodiment, the remote source 116 may also have communication software configured to facilitate the transfer of recorded images from the remote source 116 to the vehicle control system 106. The communication software configured to facilitate the transfer of stored images may be integrated with the image recording software. or it can be relatively separate software. Remote source software 116 and / or control system software 106 may include any number of variables that the processing system may use to determine the operation in the image record and the transfer functions. For example, software loaded into a remote source 116 may include software configured to use variable refresh rates (e.g., how often to save images, how often send images, etc.), write variables (eg how much of the screen should be recorded, with what resolution to perform the recording, etc.) and transfer variables (eg how often to perform the transfer, how often to carry out transfer attempts, what meta-information should be covered in the image transfer, or compress the image before transfer, etc.). These variables can be changed or edited using the user interface provided by the remote source 116 or with the user interface provided by the control system in the vehicle 106. For example, the user inside what metainformations to include in the image transfer, or compress the image before transfer, etc.). These variables can be changed or edited using the user interface provided by the remote source 116 or with the user interface provided by the control system in the vehicle 106. For example, the user inside what metainformations to include in the image transfer, or compress the image before transfer, etc.). These variables can be changed or edited using the user interface provided by the remote source 116 or with the user interface provided by the control system in the vehicle 106. For example, the user inside

- the vehicle 12 can edit relevant messages and display variables using input devices 112, 114, a display with a touch screen 108 and / or voice recognition. Information about the respective variable can be stored in the memory device at the remote source 116, in the control system in the vehicle 106, or in both of them. The variable information can be stored either in the remote source 116 or in the control system in the vehicle 106 as profile information (e.g. in the display profile, the communication profile, etc.). The profile information may be stored in non-volatile memory (e.g., persistent memory 142 of FIG. 4, etc.) and may be recalled each time the control system in the vehicle 106 enters operating mode in the form of image reproduction.

[0058] It is important to note that the communication software and / or image extraction software can be integrated or added to the application software running on the remote source. For example, a remote source navigation software package can be configured (via an added module or otherwise) to extract images and communicate images to a vehicle control system.

[0059] FIG. 5 further illustrates a support arm 502 in accordance with one embodiment. The support arm 502 is illustrated as supporting the remote source 116 via a flexible arm and a fork device. The support arm 502 and the attached forks may be a passive support arm with a fork (i.e. having only holding and supporting functions, etc.) or they may be active forks or a docking station (i.e., facilitating cable connection and / or charging a connection between remote source 116 a) control system 106, etc.). According to various other embodiments, the support arm 502 is not included or used with the system and the remote source 116 may be physically located at any other location inside or outside the vehicle 100. For example,

[0060] With reference to FIG. FIG. 6A illustrates a process 600 for displaying an image sent from a remote source to a display in a vehicle, according to one embodiment. After any number of commands or other processes, the vehicle control system may establish a communication link with a remote source (step 602). This communication link may be established (i.e., the process 600 may be triggered) due to any number of user activation actions in the control system (i.e., button operations, touch screen operations, voice commands, etc.). It is important to note that the communication link can be any communication link which the communication device of the control system and the remote source communication device can create (eg wireless, wired, IEEE 802.xx, BlueTooth, wireless USB, USB, cellular,

[0061] Further with reference to FIG. 6A, after establishing the communication link between the control system and the remote source, the control system may receive the device identifier (ID) from the remote source (step 604). This pickup can take place due to transfer

- 13 based on protocol or automatic transfer. According to one embodiment, the control system sends a request signal to the remote source and the remote source responds by sending the device ID.

[0062] After the device ID has been received by the control system, the vehicle control system may be configured to search for device information based on the received device ID (step 606). The device information may be stored in one or more storage devices, one or more tables, one or more databases, or another system for storing information. The device information may include, for example, a USB device class, a database of functions, a resolution of the images generated by the device, information about authentication schemes, communication protocols, and the like.

[0063] The device information, retrieved or received based on the device ID, can be used for any number of operations. According to one embodiment, device information is used to map a user interface element (e.g., a button, switch, touch screen area, etc.) to a function (such as a user interface function) of a remote device (step 608).

[0064] Further with reference to FIG. 6A, before, during or after the mapping of the user interface element (UI) in the vehicle to the remote UI function, the vehicle control system may start receiving images from the remote source (step 610). After receipt, the vehicle control system may perform a number of processing tasks of the received image. For example, the image may be scaled to a new size and / or resolution to be viewed on the vehicle display system (step 612). The image can be enlarged (step 614) (e.g., enlarged, reduced, stretched, distorted, etc.). The image can be amplified (e.g., sharpened, brightened, its contrast can be increased, underlined, etc.) (step 616) and / or trimmed (step 618). The image can then be displayed on the vehicle's display (step 620). After waiting some time (step 622), the new image can be picked up from the remote source and the display can be refreshed. It is important to note that any of the previous tasks (eg scaling, trimming, amplification, zooming, etc.) can be carried out on the whole image received from a remote source, part of the image received from a remote source, multiple images received from a remote source, image derivative received from a remote source or otherwise. Waiting for refresh includes sending an image request from the steering system in the vehicle to the remote source. Waiting for refreshing may include sending a refresh request at a regular interval from the vehicle's control system to the remote source. Loop waiting to receive the image,

It is important to note that images (e.g., bitmaps) can be images that have been stored in a remote source, images partially generated by a remote source, images entirely generated by a remote source, and / or images that were at least partially generated by third-party sources (e.g., web server, source

- 14 navigational, etc.). According to one embodiment, the images are partially or completely generated by a remote source and are currently displayed (or were just displayed) on the remote source display when image transmission to the vehicle control system has taken place.

[0066] Next, referring to FIG. 6B, a process 650 is shown for displaying images from a remote source on a vehicle display system, according to one embodiment. After establishing a communication link with a remote source (step 652), the process involves asking a remote source for UI features (step 654). A question may include sending a request to a remote source for information regarding all the remote source UI functions. The questioning may also include sending a request to the remote source regarding information regarding the UI function of interest, the set of UI functions, device class, or other. The process further comprises receiving information about the UI function from a remote source (step 656). Information about the UI function can be a function definition, function identifier,

[0067] Further with reference to FIG. 6B, using information from the UI function received from the remote source, the vehicle control system may be configured to map the UI to the remote UI function (step 658). The mapping may comprise combining the identifier of the UI element with a function identifier, a command identifier, a control signal identifier, a parameter providing a function, a parameter to send, or the like. Connections of UI elements with UI functions can be stored in a database, table, list, XML document or any other data structure or data file. The mapping can include adding a new record, updating the record, deleting the old record, adding an item or row, or performing any other action, which can be used to update the data structure or data file with the updated UI element to the UI function information. [0068] Before, during or after inquiring, receiving and / or mapping steps relating to a remote source UI function, the vehicle control system may also receive an image from a remote source (step 660), scaling the image to a display in the vehicle (step 662), enlarge the image (step 664), amplify the image (step 666), trim the image (step 668) and / or display the image on the vehicle's display (step 670). The system may wait some time (step 672) before returning to step 660 or other. the vehicle control system may also receive the image from the remote source (step 660), scale the image to the vehicle display (step 662), enlarge the image (step 664), amplify the image (step 666), crop the image (step 668) and / or display the image on the vehicle's display (step 670). The system may wait some time (step 672) before returning to step 660 or other. the vehicle control system may also receive the image from the remote source (step 660), scale the image to the vehicle display (step 662), enlarge the image (step 664), amplify the image (step 666), crop the image (step 668) and / or display the image on the vehicle's display (step 670). The system may wait some time (step 672) before returning to step 660 or other.

[0069] With reference to FIG. 7 shows a detailed process 700 for displaying an image sent from a remote source on a vehicle display, according to one embodiment. The "image duplication" or "image reproduction" operating mode can be activated by means of an activating user command that can be received by the control system (step 702). The activation command may be created by an input user device, a touch screen, a voice recognition device, or any other device capable of receiving user input.

According to various embodiments, an activation command (and accompanying control commands) may be sent from a remote source and not from a control system. Upon receipt of the activation command, the control system may encourage the user, for example asking the user to choose which display device the control system should recover (step 704). This step may or may not take place based on the presence or absence of more than one corresponding remote communication source. The control system may also encourage the user to choose a display profile (step 706). The user can choose a display profile or a default or standard profile can be chosen (eg after a period of time selected by the user, etc.). The communication link can be established between the control system and the remote source (step 708). After establishing the communication link, the control system may send the image request command to the remote source (step 710). The image request command may be implicit or associated with messages used to establish a communication link, or the image request may be a separate request sent via a communication link. The control system may then receive the image from a remote source (step 712). This received image can be stored in a memory device connected to the components of the control system (step 714). The control system can then process the received and stored image using a control system processing system (step 716). This processing may be based on image recovery profile settings, physical attributes of the output display, user input or may be automatic processing. Processing may include scaling, rotating, cropping, zooming, decompressing and / or any other image editing function. According to an alternative embodiment, some processing may take place on the remote source before transfer to the control system. After processing, the control system may then send the resulting image to the display controller of the control system to present it on the control system output screen (step 718). This transmission may cause the image to be displayed on the output display. After displaying the first image on the control system's output display, the system can provide the user with options that will allow the user to adjust the way in which the image is displayed on the output device (step 720). The control system can check if the user control requires updating remote source settings (step 722). If the regulation does not require updating the remote source settings, then the control system may update the local profile processing or display settings (step 724). If the regulation requires the remote source settings to be updated, then the control system may send the request command to a remote source (step 726) containing information about the update command. According to various alternative embodiments, separate messages may include updating remote source settings. A remote source can be instructed to update the display profile (or other profile) stored in the remote source. Regardless of whether the user chooses not to use the user option or choose options

- a user of the local updating or remote updating type, the control system may continue to send image requests and / or receive images from a remote source (step 712).

[0070] New images are required and sent when the vehicle reaches certain points along the beacon route. When the vehicle is stopped, for example, the control system may determine whether it is necessary to request new or updated images from a remote source. This determination can also be made on a remote source.

[0071] With reference to FIG. 8A, is a block diagram that illustrates a remote source 116 not only sending image or image data 804 to control system 106, but also sending meta information 806 to describe or complement an image. The control system 106 may use received meta information 806 to perform the output task in addition to displaying the received image. Metadata 806 may be stored in the storage device 132 upon receipt. Upon receipt, the data processing system 122 may process meta information 806 to perform an output job. The output task can be a variety of output tasks, including output tasks in the form of image and audio output tasks. Metaphors 806 can be graphic, text, audio or can be in the form of instructions, the coordinates of the image or bitmap, program code or instructions for parsing, functional input data, or any other form that can be processed, read, presented or stored to supplement the display with received bitmaps. For example, the meta information 806 may be an instruction to display assisting beacons, to assist navigation or to impose the graphic itself, computer information for generating audible navigation instructions, a code for generating direction indicators, etc. Meta information 806 can be any data or information capable of replenishing the bitmap. Meta information 806 may be sent separately (as illustrated in FIG. 8A) from bitmap data 804 or included or otherwise contained in a bitmap. The meta information 806 sent from the remote source 116 and received in the control system in the vehicle 106 may also be processed or converted into another type of information, data or output data. For example, speech information sent from a remote source 116 via a communication device 802 to a vehicle control system 106 may be converted into bitmap information, which may be presented on the display 108 of the control system in the vehicle 106. According to one embodiment The PND may be configured to connect to a vehicle control system 106 using bluetooth and to send bluetooth data including instructions in the form of a voice stream to a control system in a vehicle 106. The control system in the vehicle 106 (and its processing components) can be configured to convert these received instructions in the form of a voice stream into data in the form of a bitmap for display on the display. For example, the PND may send instructions in the form of a voice stream of the type "turn right on street 100" to the control system in the vehicle 106 and the steering system in the vehicle 106 may then be able to convert these instructions into an arrow indicating the right turn.

- 17 in 100-out street for loading and / or displaying in a different way on the output display 108 of the control system in the vehicle 106.

[0072] The output image task may be the task of superimposing the displayed object on top of the received bitmap when it is displayed on the output display 108. For example, the graphic in the form of a directional arrow may be superimposed on the map displayed on the output display 108. This function may allow the control system in the vehicle 106 to add, remove, change size, shape, color or any other arrow parameter. Such flexibility may be desirable rather to meet different preferences of users, and not to adopt icons or directional arrows that would otherwise be embedded in the transferred bitmap. In addition to the "user preferences" type option, applying graphics to a received bitmap may help reduce the need to refresh the bitmap itself. For example, instead of refreshing a bitmap displaying the map on a regular basis, the remote source 106 may send the coordinates of the updated bitmap (e.g., <x, y>, etc.) for the metaphor 806 arrow independently of the bitmap. In the case of such use, the arrow can be refreshed using a very small amount of communicated data (using a small portion of the bandwidth) many times before the bitmap itself needs to be refreshed. This can allow the user to experience a smooth display that can look and create the impression that the bitmap itself is faster to update. The output display task may also include sending a targeting text (e.g., turn left on the Main Street, etc.) to the display in the vehicle. According to various embodiments,

The audio output task may be a task that activates or uses an audio system 104 or audio output device 130 to communicate with vehicle occupants. For example, the meta information 806 sent with the bitmap may instruct the control system 106 to provide auditory output information such as "Turn left at the Brown Deer junction." It is important to note that the meta information 806 driving the output audio task can be of any type or in any form. E.g, metadata 806 may be the actual audio file of digital audio information or audio files or the sound generation mechanism may be based on the control system 106 and the meta information 806 may simply control the data processing system 122 of the control system 106 to generate specific audio output data or playback of some stored files audio. According to various embodiments, the control system 106 may have stored a plurality of audio files stored in the memory device 132. These audio files may be sufficiently general for a small amount of meta information 806 to be used to trigger stored audio files. For example, the simple "L, 500" command has been sent According to various embodiments, the control system 106 may have stored a plurality of audio files stored in the memory device 132. These audio files may be sufficiently general for a small amount of meta information 806 to be used to trigger stored audio files. For example, the simple "L, 500" command has been sent According to various embodiments, the control system 106 may have stored a plurality of audio files stored in the memory device 132. These audio files may be sufficiently general for a small amount of meta information 806 to be used to trigger stored audio files. For example, the simple "L, 500" command has been sent

- 18 as meta information 806 can be processed and used to trigger or generate the sound "Turn left for 500 feet." According to various other embodiments, parts of a single audio output task may be pre-generated or stored, while other parts are sent to be generated again or upon request.

[0074] With reference to FIG. 8B, the remote source 116 may be a cellular telephone having communication device 852. The remote source 116 and / or the communication device 852 may be configured to send image data 854 from the cellular telephone to the communication device 120. The remote source 116 and / or the communication device 852 may also be configured to send and / or receive information from telephone 856 (e.g., information from the telephone UI, information from the phone book, information from a text message, e-mail information, GPS information, GPS coordinates, dialing information, commands from the UI, etc.) to and / or from the control system 106. According to one embodiment, the communication devices 120 and 852 are Bluetooth® compatible devices, communication devices in the near range, communication devices with WiFi or any other wireless device. According to other embodiments, the communication devices 120 and 852 are wired communication interfaces (e.g., USB interfaces).

[0075] With reference to FIG. 9 shows the process 900 displaying navigation graphics on the vehicle output display. The in-vehicle control system may establish a communication link with a remote source (step 902) prior to receiving the image from the remote source (step 904). The in-vehicle control system may also receive supportive navigation data from a remote source (step 906). These assistance navigational data can be processed (step 908) by means of a data processing system of the vehicle control system. The processing of assistive navigation data may result in the output of assistive navigation data (step 910). The vehicle control system may then display the received image (step 912). After deriving supporting navigation data, the vehicle control system may wait some time (step 914) to refresh the assistive navigation data. After this time, the in-vehicle control system may receive additional supporting navigation data from the remote source (step 906). After the image is displayed, the vehicle control system may wait some time to refresh the image (step 916). After this time, the vehicle control system may receive an additional picture or images from the remote source (step 904). It is important to note that the refresh rates of the assisting navigation and image data may differ and / or the order of transmission may be reversed. In some situations, it may be desirable to refresh the image earlier or faster than supporting navigation data. In other situations, it may be desirable to refresh assistive navigation data earlier or faster than the image. For example, it may be desirable to update assistive navigation data (which may be data to update the overlaying of the navigation arrow) much faster than refreshing the image (e.g.

- It may be desirable to update the overlap of the direction indicator five times for each map image received below, etc.).

[0076] Next, referring to FIG. 10A, a process 1000 is shown for displaying images from a remote source on a vehicle control system, according to one embodiment. After establishing the connection to the remote source (step 1002), the in-vehicle control system may receive the attribute relating to the remote source (step 1004). Such reception can be part of the attribute exchange protocol, process or program algorithm. The attribute may or may represent the generated image size, image resolution, remote screen size, image ID, image descriptor, or the like. Based on the received attribute, the control system can be configured to adjust or configure the graphical output data provided to the connected display system (step 1006). When images are received from a remote source (step 1008) images can be processed based on the received attribute (step 1010). Received and / or processed images are delivered to the vehicle display system (or display system interface in the vehicle) (step 1012).

[0077] Next, referring to FIG. 10B, a process 1050 is disclosed for sending images received from a remote source to a vehicle control system, according to one embodiment. The remote source may receive a command or request signal from the vehicle control system (step 1052). The remote source may also (or alternatively) receive the display attribute from the vehicle control system (step 1054). By using the received command, request and / or attribute, the remote source may perform determination regarding the graphic abilities of the vehicle's steering system (step 1056). Such a term may refer to any resolution of the vehicle's control system, the screen size of the vehicle's steering system, the required image size, the use of the image and / or the required refresh rate of the display system in the vehicle. For example, a remote source may use the display attribute of the display size in a vehicle control system for trimming, resizing, rotating, shaping, eliminating intermodulation distortion, changing contrasts or the like for any images sent to the vehicle's control system.

[0078] Further with reference to FIG. 10B shows a process 1050 comprising a step of graphic adjustment of outgoing data based on a received display attribute (step 1058). Instead of merely adjusting any images after they have been generated by the remote source, the remote source may also (or alternatively) be configured to control the actual graphic data exiting the remote source based on the display attributes from the vehicle control system. The process 1050 may also (or alternatively) include a step of adjusting the graphical outgoing data based on certain graphical abilities of the vehicle control system (step 1060).

[0079] According to various embodiments, the adjustment of the output graphic data may include actually adjusting the output graphic data generated and

- 20 provided to the remote source display. For example, a "reduced complexity" display or "longer text" display can be generated and displayed using a remote source on the remote source display. After adjusting the graphical output data, the image (e.g., graphic output from a remote source) can be sent to the vehicle's control system (step 1062).

[0080] With reference to FIG. 11A is a process flow diagram of a process 1100 that a vehicle control system may use to send commands or controls to a remote source, according to one embodiment. The process 11000 is shown as including the reception of a signal from the UI element (step 1102). The vehicle control system may be configured to take a number of steps to recognize or relate a signal to a programmed control or control command. For example, a vehicle control system may use a UI map (e.g., a UI map generated in FIGs. 6A or 6B) to access, recall, or search a command and / or a control signal that relates to a received signal from a UI. The command and / or control signal can then be provided to a remote source (step 1104). The vehicle control system can be configured to wait for confirmation from a remote source (step 1106). If the acknowledgment is received (determining in step 1108), the vehicle control system may request and / or receive a new image from the remote source (or carry out another subsequent operation) (step 1112). If the acknowledgment is not received (or is refused), the vehicle control system may be configured to send a failure indication to the display or audio system (stage the vehicle control system may request and / or receive a new image from a remote source (or carry out another subsequent operation) (step 1112). If the acknowledgment is not received (or is refused), the vehicle control system may be configured to send a failure indication to the display or audio system (stage the vehicle control system may request and / or receive a new image from a remote source (or carry out another subsequent operation) (step 1112). If the acknowledgment is not received (or is refused), the vehicle control system may be configured to send a failure indication to the display or audio system (stage1110).

[0081] Next, referring to FIG. 11B is a front view of an exemplary programmable desktop 1150 that may include UI elements for mapping to a UI a remote source function, according to one embodiment. The table 1150 may be mounted to the inner element of the vehicle or incorporated into the inner element of the vehicle (e.g. a steering wheel). The dashboard is shown as covering the field of directions 1152, allowing the user to press the top, left, right and bottom parts of the field. The panel may also be configured to press the center of field 1154. One or more programmable buttons 1156-1162 may be provided at the corners of the direction fields. The 1156-1162 buttons may have different default settings. E.g, button 1156 (which may include a graphic representation of the left arrow) in the upper left corner may correspond to the "undo" command. The 1160 button in the upper right corner (which may contain the word "telephone") can be configured to correspond to the function or menu of the phone or speakerphone. Button 1162 (which may contain the word "menu") can be configured to correspond to a home or default menu. Button 1158 (which may contain the string "contacts") can be configured to call the contacts menu or display contacts. It should be noted that the button element 1156-1162 can be programmed for the functions or macros of the connected mobile device (e.g., via the mapped operations described in this application).

- mapping one or more of the 1150-1162 desktop elements 1152-1162 to the commands, functions or macros of the mobile device. The profile information in the memory device of the control system may be available to each connected mobile device, wherein the profile information is used by the control system in the vehicle to program one or more of the control elements. Accordingly, if the user brings the first portable device to the car and connects to the first portable device, the control system will configure the mapping elements 1152-1162 to the functions of the first portable device. If the user brings a second portable device to the car and connects to the second portable device, the control system will configure the mapping elements 1152-1162 to the functions of the second portable device. According to various embodiments, if a user connects more than one device to a vehicle control system and / or the functions of both devices have already been mapped to elements 1152-1162, the vehicle control system may ask the user to the function set of which devices to map elements 1152-1162 .

[0082] Next, referring to FIG. 12 is a block diagram of an image reproducing system 1200, according to one embodiment. Presented is a portable display device 1202 having a first portion of the display 1204 and a second display portion 1206. The portable device may generally be configured to send an image from one or more portions of the portable display to the vehicle control system and / or the display system 1208 for reproduction.

[0083] According to the embodiment shown in FIG. 12, the bottom or peripheral portion of the display 1210 is only sent to the display in the vehicle 1208 for reproduction. Even when only one part of the display is reproduced on the display in the vehicle 1208, the image representing the entire display 1202 shown on the portable device can be transmitted to the system in the vehicle. The control bit, command or other code sent along with the image to the vehicle system may indicate which part of the image is to be reproduced. According to other embodiments, only the part to be reproduced on the display in the vehicle 1208 may be sent from the display of the mobile device 1202 to the display in the vehicle 1208. The vehicle system may send to the portable device a display size indication in the vehicle, resolution,

[0084] According to an embodiment in which the navigation interface of the portable device is reproduced on a display in the vehicle 1208, the portable device's navigation software may operate with (or may be) software specifically configured to reproduce the image on the display in the vehicle 1208. This software may have " the 'brand' or otherwise similar appearance and sensitivity of vehicle interfaces. This software may include a definition of a part of the display that should be transmitted to the vehicle's system. The software can be configured to send only the most important part of the navigation image or

- The 22 GUI shown on the display of the mobile device 1202. Preferably, the software may be resident or interchangeable on a portable display device, thereby allowing the adoption of new software for the portable display device without requiring software changes associated with the vehicle. According to other embodiments, the in-vehicle or portable device may be configured to determine whether the image shown on the display of the portable device 1202 will not fit or be completely depicted on the display in the vehicle 1208 and to request and / or send a partial image based on this determination.

[0085] The display in the vehicle 1208 may be a vehicle display mounted, built-in or otherwise provided to the interior of the vehicle. According to one embodiment, a part of the display to be reproduced is provided to the main multimedia display of the car or the head-up display. According to one embodiment, the vehicle control system includes user interfaces and logic to enable the user to switch and / or adjust image playback settings. The control system may be configured to allow the user to set the playback conditions of the image and / or the playback frequency. For example, in a situation where the reproduced image is presented on a media player in a car or a transparent display, the user can choose to display the reproduced image or images before changing the direction, connection, twist or other. As a further example, the vehicle control system can play images when the mobile device announces the directions out loud. The restored image (s) can be displayed for some time (a few seconds, minutes, etc.) after the audio instructions are finished.

[0086] According to various embodiments, the vehicle control system and / or display system in the vehicle 1200 is configured to zoom, invert, sharpen, process, stretch, trim, overlap, process or otherwise reinforce any part of the image received from a portable device. . The reinforcing effect can be selected by the user and many enhancement actions can be provided at any given time and to any image. For example, the control system may be configured to receive the second portion of the display 1206 from a portable device, to invert the colors of the image for easier reading, to adjust the image contrast, to adjust the brightness of the image, to emphasize some elements of the image, to enlarge the image,

[0087] Next, referring to FIG. 13 is a block diagram of a control system in a vehicle 1300 for taking over the functions of a portable device 1302 and / or providing a function to a portable device 1302, according to one embodiment. The functionality of the mobile device 1302 and / or the control system in the vehicle 1300 may vary. Some features of the portable device 1302 may be

- 23 folded, for operation while driving. Other functions of the portable device 1302 may generate and / or display rapidly changing or detailed images that would not be operable when the vehicle is in motion. In addition, some functions of the portable device 1302 may be normally available on the control system in the vehicle 1300 and vice versa. The mobile device 1302 and / or the control system in the vehicle 1300 may be configured to use the functions of the second device.

The elements of the human-machine interface (HMI) 1304 of the portable device 1302 may be used by the control system in the vehicle 1300 by display reproduction, voice recognition and / or by data transfer between the portable device 1302 and the control system 1300.

[0089] Tactile controls 1306 associated with the vehicle control system 1300 may be used to control the functions of the mobile device and / or to select display elements 1307 to be played back on the display in the vehicle 1308.

[0090] The vehicle GPS receiver 1310 may send location and / or course information to the portable device 1302 for use in one or more applications or for transmission to a remote source.

[0091] The processing system 1312 of the control system in the vehicle 1300 may be used to process information, files or streams delivered to it by the mobile device 1302. Similarly, the mobile computing device 1302 may be configured to process information, files, streams or signals provided to it. through a control system in a vehicle 1300. In the case of such use, a processor more suitable and / or available for processing of some elements may be used.

[0092] The voice recognition system 1314 provided with the control system in the vehicle 1300 may be used to provide control of the portable device 1302.

[0093] A microphone in vehicle 1316 may be used to more accurately detect voice utterances, with the statements being sent from the control system to the mobile device 1302 for processing.

[0094] The audio system in vehicle 1318 may be used to represent audio signals provided to it by a portable device 1302.

[0095] The voice recognition system 1320 of the portable device 1302 may be used by the control system in the vehicle 1300 and / or by the voice recognition system in the vehicle 1314 to provide additional functions, additional processing capacity or other properties.

[0096] The touch screen in vehicle 1322 may be used to provide a touch screen function to displays reproduced from a mobile device 1302 or to send other control signals to a mobile device 1302.

[0097] World time information 1324 may be sent from the mobile device 1302 to the vehicle control system 1300 to display, use in the emergency system, update the clocks in the vehicle or for other purposes.

[0098] The navigational, database navigation and / or map information functions 1326 may be provided from the portable device 1302 to the vehicle control system 1300 for display and / or processing.

[0099] The media decoding elements 1328 provided on the mobile device 1302 may be used to decode audio files stored in the mobile device 1302 and / or in the control system in the vehicle 1300. The decoded audio data may be provided from the mobile device 1302 to the control system 1300 for presentation them through the audio system in a 1318 vehicle.

[0100] The connectivity applications 1330 of the portable device 1302 may be used by the control system on the vehicle 1300. For example, a TCP / IP stack, communication protocol element, security software, decryption algorithm, browser software or communication or attachment software may be used by the control system in a vehicle 1300 for carrying out communication tasks in a vehicle control system and / or for retrieving information to be transmitted to a control system in a vehicle 1300.

[0101] The calendar application 1332 of the portable device 1302 may be used by the vehicle control system 1300 to provide alarms, reminders, scheduler information, calendar display, mechanism for accepting or rejecting proposed meetings or other functions, to the vehicle control system 1300, which you may not have these features. According to various alternative embodiments, the control system in vehicle 1300 may include a calendar function and may be configured to synchronize data with a calendar application and / or a portable device database 1302.

[0102] The electronic mail function 1334 of the portable device 1302 may be used by the control system in the vehicle 1300 to receive text e-mails, to play the inbox view, to play voicemail in the e-mail inbox and / or to create and send e-mail lists (eg using the voice recognition function in a vehicle).

[0103] The text messaging function 1336 of the portable device 1302 may be used by the control system in the vehicle 1300 to receive text messages, to send text messages, to reproduce the inbox view and / or to create and send a text message (e.g. voice recognition in the vehicle).

[0104] The voice mail function 1338 of the portable device 1302 may be used by the vehicle control system 1300 to display or audibly provide an indication that a new message has arrived, the number of new messages, the number of deleted messages, the number of messages stored and / or content

- 25 voicemail (via audio and / or text and / or module, in the text provided in the vehicle, etc.).

[0105] The internet services 1340 of the portable device 1302 may be used by a vehicle control system 1300 to provide internet transmissions and / or receive information, to analyze information, display information, or for other purposes.

[0106] Video services 1342 of the portable device 1302 may be used by a control system in a vehicle 1300 to provide a decoding and / or video reproduction function to the vehicle. For example, the vehicle control system 1300 may include conditions for the reproduction of a standard MPEG file. The portable device 1302 may comprise a sole codec and / or application for decoding a media file stored in a portable device 1302 or in a control system in a vehicle 1300.

[0107] The flash memory element 1344 (or other memory element) of the portable device 1302 may be used by the control system in the vehicle 1300 to store media files, configuration flicks and / or other types of information.

[0108] Games 1346 provided on a transportable item may be delivered to a control system in vehicle 1300 and / or to display in vehicle 1308 or to its audio system in vehicle 1318. The control system in vehicle 1300 may be configured to communicate game information to the system. entertainment for the rear seats of wireless headphones via a transmitter mounted in the vehicle or otherwise.

[0109] The home status information 1348 available on the mobile device 1302 may be transmitted to the vehicle control system 1300 for processing, display and / or user warning. For example, the portable device 1302 may be configured to receive an alarm from a home security system. . The alarm may be transmitted from the mobile device 1302 to the control system in the vehicle 1300 for display, processing and / or audible indication.

[0110] Stock information 1350 or applications available on the portable device 1302 may be transmitted (or otherwise retrieved) from the mobile device 1302 to the control system in the vehicle 1300.

[0111] In situations in which the normal display mode and / or the menu of the portable device 1300 are not desired for image reproduction or otherwise, the portable device 1302 may be configured to switch from a normal operation mode to a vehicle mode of operation. The vehicle mode of operation may include a mode in which the remote source generates, displays and / or provides images more suitable for reproduction and / or enlargement on the vehicle's display than the images typically presented on the remote source. Human-machine interface (HMI) 1352 configuration system can generally be a hardware and / or software module that enables a user of a control system in a vehicle 1300 to configure the UI elements of a control system in

- 26 vehicles (e.g., elements 1306, 1322, 1316, etc.) for operation with the functions of a portable device. For example, the HMI configuration system 1352 may be used to control the program 1150 shown in FIG. 11B for operating with a portable device 1302 and / or one or more of its functions. The data input by the user received by the HMI configuration system 1352 may be stored in the memory unit, database, profile file or configuration of the control system in the vehicle 1300 for subsequent retrieval and / or use.

[0112] Next, referring to FIG. 14 is a flow diagram of a process 1400 for taking over the functions of a portable device, according to one embodiment. The process may include searching for a signal indicating whether the mobile device is connected (wirelessly or wired) or otherwise prepared for functional communication (step 1402). The vehicle control system may send a request to a connected mobile device to check compatibility with the function taking over the function (step 1404). When the control system in the vehicle receives a response from the mobile device (step 1406), the control system may be configured to perform compatibility determination (step 1408). Determining compatibility can determine which features the vehicle attempts to take from the portable device. The vehicle control system may then request information about a set of functions from the portable device (step 1410). Information about a set of functions may include one or more function tables, text files listing available functions, device type or device class identifiers, or other. The vehicle control system may be configured to receive and interpret information about the function set (step 1412) and to map the function of the portable device to the user interface element in the vehicle (step 1414). For example, if the portable device includes a speed dial function, a reverse call button, a N connection list or other available function, the in-vehicle control system may map the procedure or command to send to the mobile device to receive the signal from the programmable button on the steering wheel.

[0113] Next, referring to FIG. 15 is a flowchart of an activity 1500 of a vehicle control system based on a programmed / mapped user interface element, according to one embodiment. The process includes receiving a signal from a mapped user interface element (e.g., receiving a signal about which button on the steering wheel was pressed) (step 1502). In response to this signal, the vehicle control system may search or otherwise specify an appropriate command or control signal to send to the portable device, wherein the command or control signal is configured to trigger or request a desired function of the portable device (step 1504). The command or control signal is sent to the mobile device (step 1506).

[0114] Next, referring to FIG. 16 is a flow diagram of the vehicle operation process 1600 for taking over a multi-command function of a portable device,

27 according to one embodiment. The vehicle control system can be configured to take over the multi-command function of the portable device. The multi-command function may be a target user interface function that is desired by the user. For example, a person in the vehicle may wish to display a list of recently made calls in the vehicle display, but displaying a list of recently made calls may require two commands on the mobile device (eg first you need to enter the phone menu and then select the menu item of the phone). The vehicle control system may request information on a set of functions from a portable device (step 1602) and receive and interpret a set of functions (step 1604). Information about the functions stored in the mobile device may indicate that the target user interface function is available via multiple actions or a single command (steps 1606, 1610). The vehicle control system may analyze or otherwise interpret function information. If the target user interface function is available on the device via a single command, the user interface function can be mapped to the command (step 1608). If the target user interface function is available on the device only via multiple commands, the vehicle control system can be configured to build (or search for) a macro (e.g., a script, a table to parse, a text file to parse, etc.) based on any number of processes and / or information on a set of functions from a mobile device (step 1614). The user interface function in the vehicle can then be mapped to the macro (step 1616). Otherwise, the user may indicate a failure to establish the target user interface function (step 1612).

[0115] Next, referring to FIG. 17 shows a process of a vehicle 1700 to use a multi-command function, according to one embodiment. The process 1700 includes receiving a signal from a UI function mapped to a macro, analyzing or performing a macro (step 1702) and sending a plurality of commands to the mobile device based on the macro (step 1704). The vehicle control system may for some time wait for a response from the mobile device (e.g., before the retry or time) (step 1706). According to one embodiment, the control system in the vehicle will wait for a period of time in which the mobile device is expected to respond and then start playing the display of the mobile device (step 1708). This operation can help to ensure a smooth transition from pressing the button in the vehicle to display information about the button pressed. If information is sent to a vehicle control system based on a macro, the in-vehicle control system may send an audio signal to the vehicle's audio system and / or a signal displayed to the vehicle display system (step 1710).

[0116] With reference to FIG. 18, according to one embodiment, control system 106 is shown having data connection connections to different remote sources. For example, the control system 106 may establish a data connection with a cell phone 144, PDA 146, media player 148, PND 150, etc. The control system 016 can be configured to simultaneously establish connections

- 28 data transmission with a plurality of remote sources using the communication device 120 of FIG. 3. For example, the control system 106 may simultaneously establish a data connection with the mobile phone 144 and the media player 148. According to various embodiments, the control system 106 may establish simultaneous data connections with any combination and / or number of remote sources. The control system 106 may use a data processing system and / or a communication device to control communication between the control system in the vehicle 106 and a plurality of remote sources. The connected remote sources may transmit data directly to or from the control system in the vehicle 106.

[0117] With reference to FIG. 19, according to one embodiment, a control system 106 is provided having a connection to the data bus in the vehicle 1902. The connection to the data bus in the vehicle 1902 can be effected via the interface module of the control system. The data bus in the vehicle 1902 can be connected to a number of vehicle modules. These modules may include a GPS receiver module 1904, a 1906 motor control module, a 1908 gear control module, a 1910 body control module, a 1912 HVAC control module, a 1914 fuel system module, a 1916 compass module, a time control module, a non-locking brake module, etc. The data bus in the vehicle 1902 can be any electronic communication network that connects the vehicle components. Vehicle modules connected to the vehicle data bus may typically receive input data from sensors (e.g., speed sensors, temperature sensors, pressure sensors, etc.) that the vehicle module can use in calculations. Vehicle modules can also use actuators to perform module-controlled operations (eg turning on the cooling fan, changing gear, unlocking the door, etc.). The modules may be configured to exchange data among themselves via a data bus in a vehicle 1902. The control system 106 or processing system 122 (shown in FIG. 3) may be configured to route information to or from vehicle modules on a data bus in a vehicle to or from a vehicle. other components of the control system or to or from remote sources. According to various embodiments, the bus in vehicle 1902 can be the vehicle bus of any technology or any type. For example, the vehicle bus 1902 may be a local connecting network, a controller area network, a FlexRay bus, an MOST bus (from the Media Oriented System Transport, for exchanging information between multimedia systems in transit), a Keyword Protocol 2000 bus, a serial bus, a parallel bus , Network in the Vehicle Area, DCBUS bus, IDB-1394 bus, SMARTwireX bus, etc. According to various embodiments, the data bus in the vehicle 1902 may have any past, present or future design capable of providing an electronic communication network that links the vehicle hardware components within the vehicle. For example, the vehicle bus 1902 may be a local connecting network, a controller area network, a FlexRay bus, an MOST bus (from the Media Oriented System Transport, for exchanging information between multimedia systems in transit), a Keyword Protocol 2000 bus, a serial bus, a parallel bus , Network in the Vehicle Area, DCBUS bus, IDB-1394 bus, SMARTwireX bus, etc. According to various embodiments, the data bus in the vehicle 1902 may have any past, present or future design capable of providing an electronic communication network that links the vehicle hardware components within the vehicle. For example, the vehicle bus 1902 may be a local connecting network, a controller area network, a FlexRay bus, an MOST bus (from the Media Oriented System Transport, for exchanging information between multimedia systems in transit), a Keyword Protocol 2000 bus, a serial bus, a parallel bus , Network in the Vehicle Area, DCBUS bus, IDB-1394 bus, SMARTwireX bus, etc. According to various embodiments, the data bus in the vehicle 1902 may have any past, present or future design capable of providing an electronic communication network that links the vehicle hardware components within the vehicle. to exchange information between multimedia systems in transport), Keyword Protocol 2000, serial bus, parallel bus, Network in the Vehicle Area, DCBUS bus, IDB-1394 bus, SMARTwireX bus, etc. According to various embodiments, the data bus in the vehicle 1902 may have any past, present or future design capable of providing an electronic communication network that links the vehicle hardware components within the vehicle. to exchange information between multimedia systems in transport), Keyword Protocol 2000, serial bus, parallel bus, Network in the Vehicle Area, DCBUS bus, IDB-1394 bus, SMARTwireX bus, etc. According to various embodiments, the data bus in the vehicle 1902 may have any past, present or future design capable of providing an electronic communication network that links the vehicle hardware components within the vehicle.

[0118] Further with reference to FIG. 19, according to one embodiment, the control system 106 may access data from the bus in the vehicle 1902, and further from the vehicle hardware modules 1904-1916, to provide a function to the control system 106 and / or the remote sources 144-150. For example, the control system 106 may read the compass information from the compass module 1916 via the data bus in the vehicle 1902. The control system 106 may display this information on any of its built-in displays, but may also transfer this information to a remote source for further transmission , display or processing. E.g, remote source 150 (PND) can use information extracted from the compass module to more accurately generate navigational images for transmission to the output display in the vehicle. According to another embodiment, the fuel system module 1914 may send a warning or low fuel information to the control system 106. The control system 106 may then use a PDA with WiFi 146 or a mobile phone 144 to retrieve information about the nearest gas stations. This information can be forwarded to control system 106 for processing and display or routing by control system 106 to PND 150 for processing to PND. It is important to select

[0119] With reference to FIG. 20, according to one embodiment, a control system 106 having a communication device 120 (illustrated in FIG.

3), which can serve as a communication gate. The control system 106 may be simultaneously connected to devices on the data bus in the vehicle, with a plurality of remote sources 116, remote server 154 and / or any number of other vehicle systems or remote sources. The communication device can be a communication device that can serve as a wireless gateway. The communication device can be a communication device that can create a piconet. Numerous devices and / or remote sources can create communication links with the communication device. The communication device can serve as a managing node in a one-to-many data network, with any number of remote sources acting as slaves. According to one embodiment, a communication device is a Bluetooth communication device capable of operating as a management device or a device subordinated to a piconet or scatternet bluetooth network. The processing system 122 (from FIGURE 3) and the communications device may be configured to establish communication links, operations related to controlling data, and performing user interface functions necessary to provide gateway functions to the control system in the vehicle 106. According to various other embodiments, the device communication can be a communication device (or group of communication devices) of various types or of different past, present or future projects capable of establishing multiple wireless data transmissions and

- 30 serving as a gateway. The communication device can operate together with the data processing systems of the control system to perform various communication and data-related tasks.

[0120] Further with reference to FIG. 20, according to one embodiment, the control system 106 has a first range of wireless data transmission 2002. This first range of wireless data transmission may be based on a first wireless protocol or technology. The control system 106 may have a second range of wireless data transmission that allows it to be connected to remote sources outside its first range of wireless data transmission. For example, the control system 106 may include a second wireless protocol or technology that allows it to communicate with a remote server 154 located outside the first wireless data coverage range 2002. While a control system 106 is communicated with remote sources 116 in a star-like network topology or one to many, you can use any network topology. For example, the control system 106 and its communication device may serve as a node of a mesh network. It is important to note that each remote source 116 can also have multiple communication methods, devices and / or protocols. For example, the remote source 144 may be a cellular phone capable of maintaining simultaneous data transmission with the control system 106 and the cellular antenna 2004. Similarly, the PND 150 may be a GPS device capable of maintaining simultaneous data transmission with the control system 106 and the satellite 2006. Remote source 146 , e.g. PDA, may be able to maintain simultaneous data transmission with the control system 106 and the WiFi 2008 router. When used in this way, PDA 146 may have access to or communicate with devices on an external network (e.g., 2010 WiFi network computers created by a 2008 wireless router, etc.). Remote sources 116 may also be configured to communicate with each other. For example, the remote sources 150 and 144 may be able to communicate with each other while maintaining connection with the control system 106. This connection is shown as a communication link 2012.

[0121] Further with reference to FIG. 20, the control system 106 can be used as a wireless (or wired) access point or router for all remote sources connected to the control system. For example, remote source 144 (e.g., PDA) may be able to send information to computers 2010 from remote source 150 (e.g., a portable media player) using control system 106 to route data from remote source 150 to 144 to computers 2010. System Control device 106 may be capable of directing information from vehicle modules connected to the data bus on the vehicle to remote sources and / or possibly to the router network 2008 and computers 2010. According to various embodiments, control system 106 may direct information to and from any vehicle module, the system device or remote device to which it is connected. The control system 106, including its own processing system and communication device, may be configured to carry out all the network tasks necessary to facilitate the described data transmission tasks. For example, the control system 106 may control the device

Communication system for connecting remote sources 1116 to a control system in a vehicle 106. The control system 106 may provide a user interface urging the user through the process of creating a pair. After paired devices and their connection, the communication device can perform any number of digital and / or analogous communication tasks necessary to carry out the desired data or voice transmission. For example, a communication device (with or without assistance from a data processing system) can perform any number of encryption tasks, modulation tasks, distributed spectrum tasks, priority task tasks, frequency hopping tasks, etc.

[0122] With reference to FIG. 21, according to one embodiment, a process 2100 is illustrated which can be used to communicate with multiple remote devices via a vehicle control system. The vehicle control system may provide a communication user interface on the output display (step 2102) when the user indicates that he would like to establish a communication link or carry out a communication task. The control system then prompts the user to select the device to be connected (step 2104). When the user selects the devices to be connected, the control system can then determine if new pairing is necessary (step 2105). If new pairing is necessary, then the system will perform the pairing procedure (or device setup procedure) (step 2106). If new pairing is not necessary, or after pairing all necessary devices, the control system may then coordinate the establishment of communication links with the selected devices (step 2108). The control system may then provide the user interface for communication tasks via the output display (step 2110). The user interface for communication tasks can provide a menu of possible communication tasks that can be carried out with the control system and not with connected remote sources. For example, the user can select a communication task such as: "Send my contact item" using the output display of the control system and input devices (eg buttons, voice recognition, etc.). The control system can then determine whether to connect or establish communication links with additional devices (step 2112). If additional communication links need to be established, the control system will coordinate connections to additional devices, including pairing devices, if necessary (step 2114). When the user selects the communication task and the control system establishes all necessary communication links, the control system can then coordinate the communication tasks selected in a necessary manner (step 2116). For example, if the user has selected the communication task "Send my contact item", then the control system can determine whether it is necessary to engage and connect a mobile phone connection with data transmission and a GPS device. The control system may establish communication links with these devices and facilitate necessary transmissions. For example, the control system may request coordinates from the GPS device, temporarily store the coordinates in the memory device of the control system, transfer

- 32 coordinates for the mobile phone and recommend that the mobile phone sends the coordinates in a text message to the selected contact.

[0123] With reference to FIG. 22, according to one embodiment, illustrates process 2200 that can be used to provide functions to a control system. After completing a number of device configuration and / or pairing steps, the control system may retrieve information entered by the user about the action that the user wants to perform. The control system may create a communication task based on the instructions entered by the user (step 2202). A communication task can be a task that can be performed using a control system and remote devices to provide a result or output information. The system may prompt the user to take additional action (step 2204) to create a communication task. The control system may determine connection of which devices is necessary (step 2206), before establishing communication links (step 2208) with all necessary devices. In the case of such use, the user does not have to first communicate which devices should be connected, but the control system will determine these connections without unnecessary user involvement. After establishing the necessary communication link, the control system can use the connected remote devices to deliver functions to the control system (step 2210). The function provided to the control system may be a function related to data or a function related to the user interface. For example, a data-related function may be to provide data to a control system that would otherwise not be available if it were not for connecting remote sources. The function associated with the user interface may be to provide the user with a way to enter or output information that the system would otherwise not be able to obtain if it were not for connecting remote sources. According to various embodiments, the control system may use any number of remote sources to receive new data or interface functions. An example of a data function may be the following: A PDA supported by WiFi may be able to search for new media files from a server supported by WiFi, the control system may read information about the artist from a media file and use simultaneous data transmission with a mobile phone compatible with the data to be downloaded information about tickets for this artist. Be it receiving a multimedia file or receiving information about tickets can be a function related to data that the control system would otherwise not have been able to achieve. An example of a function related to the interface can be as follows: PND can receive GPS information and generate images to display on its own or attached PND display. The connection between the control system and the PND can be used to provide image transfer (or video transfer) from the PND to the output display of the control system. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve. which the control system would otherwise not have been able to achieve. An example of a function related to the interface can be as follows: PND can receive GPS information and generate images to display on its own or attached PND display. The connection between the control system and the PND can be used to provide image transfer (or video transfer) from the PND to the output display of the control system. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve. which the control system would otherwise not have been able to achieve. An example of a function related to the interface can be as follows: PND can receive GPS information and generate images to display on its own or attached PND display. The connection between the control system and the PND can be used to provide image transfer (or video transfer) from the PND to the output display of the control system. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve. PND can receive GPS information and generate images for display on its own or attached PND display. The connection between the control system and the PND can be used to provide image transfer (or video transfer) from the PND to the output display of the control system. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve. PND can receive GPS information and generate images for display on its own or attached PND display. The connection between the control system and the PND can be used to provide image transfer (or video transfer) from the PND to the output display of the control system. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve. The user can operate the PND interface functions to change the display of the control system. In the case of such use, the additional display function and / or the use of PND inputs may be a function associated with an interface that the control system would otherwise not have been able to achieve.

- [0124] With reference to FIG. 23, according to one embodiment, process 2300 is illustrated, for providing functions to remote sources. After an unlimited number of selection, pairing or determination steps as described in the previous paragraphs or otherwise, the control system may prompt the user to enter additional information to start providing the function to a remote source (step 2304). The control system may then establish communication links between the control system and the necessary components, modules or remote sources (step 2306). Once the communication link has been established, any connected device (e.g., control system, remote source, vehicle modules, etc.) may request, read and / or receive information from other sources or memory as needed (step 2308). Using a communication link and any other relevant data, the control system (or other sources connected to the control system) can provide a function to the remote source. A function may be a function that the remote source would not otherwise be able to obtain. The function may be a function related to data or a function related to the user interface. Data functions provided to remote sources may include data addressed to a specific remote source located or generated in other remote sources or data on the vehicle data bus. For example, a remote source may have access to functions such as compass data, stabilization control data, speed data, low fuel data, service data, etc. User interface functions can also be delivered to a remote source via a control system or other remote sources. For example, using data communication between a control system and a remote source, the processing used by the voice recognition system in a control system can be used to control and control a remote source. The internal switches, buttons or functions of the touch screen control system 106 may be used to provide an enhanced user interface function to connected remote sources 116. using the data transmission between the control system and the remote source, the processing used by the voice recognition system in the control system can be used to control and control the remote source. The internal switches, buttons or functions of the touch screen control system 106 may be used to provide an enhanced user interface function to connected remote sources 116. using the data transmission between the control system and the remote source, the processing used by the voice recognition system in the control system can be used to control and control the remote source. The internal switches, buttons or functions of the touch screen control system 106 may be used to provide an enhanced user interface function to connected remote sources 116.

[0125] While the embodiments illustrated in the figures and described above are currently preferred, it should be understood that these embodiments are given purely by way of example. Accordingly, the present invention is not limited to a particular embodiment, but includes various modifications that nevertheless fall within the scope of the appended claims. The order or sequence of any processes or method steps may be changed or repeated according to alternative embodiments.

[0126] According to any of the preferred embodiments, the control system 106 is a control system in a vehicle 106, such as generally illustrated by the figures. The control system 106 may comprise a memory device 132 having persistent memory 142 and non-persistent memory 140. The control system 106 may also include at least one communication device 120 configured to communicate with a plurality of different devices or remote sources. The communication device 120 may be a wireless communication device configured to communicate with multiple wireless remote sources (e.g., cellphone 144, PDA 146, media player 148, PND 150, pager 152, remote source 116, remote server 154, etc.). Communication device 120

The received images may be entirely generated by the remote source 116. The data processing system 122 may be configured to perform image processing tasks on the received image when the image is in a memory device 132 or somewhere else. The image processing task may include scaling the image to other sizes or changing the resolution. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source. The data processing system 122 may be configured to perform image processing tasks on the received image when the image is in a memory device 132 or somewhere else. The image processing task may include scaling the image to other sizes or changing the resolution. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source. The data processing system 122 may be configured to perform image processing tasks on the received image when the image is in a memory device 132 or somewhere else. The image processing task may include scaling the image to other sizes or changing the resolution. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source. when the image is in a memory device 132 or somewhere else. The image processing task may include scaling the image to other sizes or changing the resolution. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source. when the image is in a memory device 132 or somewhere else. The image processing task may include scaling the image to other sizes or changing the resolution. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source. The vehicle control system may also be capable of receiving meta information, assisting navigational data, information from the user interface or information from the telephone. This additional information may be processed and used for a variety of input and / or output tasks that may complement the video playback operation or otherwise enhance user interface functions for the vehicle or remote source.

[0127] The user may perform image reproduction control, including changing the bit rate or refreshing the bitmap on the display. The regulation can be transmitted to a remote source or performed via local processing. The adjustment settings may be stored in a permanent memory of the control system in the vehicle 106. According to various other embodiments, a control system is provided in the vehicle having components of any past, present or future design or type, capable of reproducing images displayed on the remote the source, using image information received via the communication link.

[0128] The description of the invention with the figures should not impose any limitations in the figures on the invention. The present invention includes methods, systems and software products on any machine-readable medium for carrying out its operations. Embodiments of the present invention may be implemented using existing computer processors or by means of a specialized computer processor for the respective vehicle system, incorporated in one or another purpose or by means of a hardware system.

[0129] It is important to note that the design and layout of the control system such as that illustrated in the various embodiments is illustrative only. Although only a few new embodiments of the invention have been described in detail in the present disclosure, a person skilled in the art who will review the present disclosure will appreciate that numerous modifications are possible (e.g., changes in sizes, dimensions, structures, shapes and proportions of different elements, parameter values) , assembly systems,

- 35 materials, colors, settings, etc. used) without any significant delays beyond the new recommendations and advantages of the essence cited in the claims. For example, elements presented as made integral can be made from a plurality of parts or elements (e.g., control system 106, storage device 132, communication device 120, data processing device 122, remote source 116, remote server 154, etc.), item positions it can be reversed or otherwise changed (e.g., components of the control system 106, etc.) and the type and number of individual elements or positions can be modified or changed (e.g., communication device 120, storage device 132, components of the control system 106, etc.). Accordingly, all such changes are intended to be included within the scope of the present invention as defined in the appended claims. The order or sequence of any process or method steps can be changed or repeated according to alternative embodiments. In the claims, all "fusion-function" clauses are intended to cover the structures described herein as performing said function, and not only structural equivalents, but also equivalent structures. Other substitutes, modifications, alterations and omissions may be incorporated into the design, operating conditions and system of the embodiments without departing from the scope of the present invention as defined in the appended claims. and not just structural equivalents, but also equivalent structures. Other substitutes, modifications, alterations and omissions may be incorporated into the design, operating conditions and system of the embodiments without departing from the scope of the present invention as defined in the appended claims. and not just structural equivalents, but also equivalent structures. Other substitutes, modifications, alterations and omissions may be incorporated into the design, operating conditions and system of the embodiments without departing from the scope of the present invention as defined in the appended claims.

[0130] As noted above, embodiments falling within the scope of the present invention include software products including machine-readable media for carrying out or concluding instructions implemented by the machine or stored data structures therein. Such machine-readable media can be any media that can be accessed using a universal computer or other processor machine. By way of example, such machine readable media may include RAM, ROM, EPROM, EEPROM, CD-ROM or other devices for storing optical disks, for storing magnetic disks or other magnetic storage devices, or any medium, which can be used to carry or store the desired program code in the form of instructions or data structures performed by the machine, and which can be accessed using a universal or specialized computer or other processor machine. When information is transferred or delivered over a network or other communication link (hardware, wireless or a combination of hardware and wireless) to the machine, the machine correctly sees the link as a machine-readable medium. In this way, each such link is correctly defined as a machine readable medium. Combinations of the above are also included in the scope of machine readable media. The instructions provided by the machine include, for example, instructions and data that make the universal computer,

[0131] It should be noted that although these schemes represent a specific order of method steps, it is understood that the order of these steps may differ from what is shown. Also, two or more steps can be carried out simultaneously or with partial application. Such a change will depend on the selected software and hardware systems and the choice of the designer. It is understandable that

All these changes are within the scope of the invention. Likewise, the implementations of the software according to the invention can be obtained by standard programming techniques with a logic-based system with a different logic circuit to perform various linking steps, processing steps, comparison steps and decision steps.

[0132] The foregoing description of embodiments of the invention has been illustrated for purposes of illustration and description. It is not exhaustive and does not limit the invention to its precise form, and modifications and variations are possible in the light of the foregoing recommendations or may be achieved by practicing the invention. The embodiments have been selected and described to explain the concept of the invention and its practical application to enable a person skilled in the art to use the invention in various embodiments and with various modifications tailored to the particular application being considered.

She prepared and verified

Grażyna Palka Patent attorney