Wirelessly controlling unmanned aircraft and accessing associated surveillance data

The present invention generally relates to systems and methods for wirelessly controlling unmanned aerial vehicles and accessing relevant reconnaissance data.

Unmanned aerial vehicles or unmanned aerial vehicles (UAVs) provide extremely effective and economical access to areas where manned air operations can be costly and / or extremely dangerous. For example, an unmanned aerial vehicle equipped with a remote-controlled camera can perform a wide range of reconnaissance missions, such as finding fish schools in the fishery, monitoring weather conditions, border monitoring in the case of the central government, and performing military operations. Includes pre-, running, and / or post-execution military reconnaissance.

<p num="0003"> Existing technologies for controlling unmanned aerial vehicle systems have various drawbacks. For example, existing drone systems (which can include the drone itself along with control devices, launch devices, recovery devices, and storage methods) are typically controlled using direct RF or satellite communications. To. Direct RF-based control is limited by the requirements of short range and high power. It also requires dedicated equipment for both UAVs and ground control stations.</p><p num="0004"> While satellite UAV control may take advantage of long-range communications when compared to direct RF-based control, satellite control is typically limited by low bandwidth and low data transfer rate limits. An embodiment of the satellite-based control technology previously used is iridium. Iridium is a low earth orbit satellite communication system that makes long-range data connections at transfer rates of ~ 2.4 kbits per second. Satellite control has the disadvantages of limited bandwidth and slow data transfer rates, as well as typically high power requirements, high cost, and dedicated equipment (eg, direct RF). It also comes with a relay station and a large satellite dish for transmission and reception.</p>

<p num="0005"> I. Overview Aspects of the invention generally cover systems and methods for wirelessly controlling unmanned aerial vehicles and accessing relevant reconnaissance and surveillance data. In one embodiment, a wireless communication network (eg, an existing mobile phone network) is used with a handheld device (cell phone or PDA) and, in some cases, with other supporting technologies, thereby command and control data. And / or monitor the signals and data transmitted by the UAV. For example, it controls the takeoff and / or landing of one or more UAVs, controls the aerial maneuvering of one or more UAVs that controls the weapon system of one or more UAVs, one. Or receive mission reconnaissance information from multiple UAVs (including border reconnaissance information, tracking moving or stationary objects, etc.), receive information on UAV tone and / or status monitoring, and one or more. It can include monitoring other aircraft within the territory of multiple UAVs, and so on. In this way, long-distance communication can be performed without designing and constructing a custom-made direct communication system and without relying on expensive and complicated satellite systems.</p><p num="0006"> In some embodiments, wireless communication networks and support devices are used to provide near unlimited communication distance in urban areas where direct RF communication is often hampered by obstacles such as buildings and other large structures. Can be used. Moreover, in general, urban areas are in high demand for mobile phone services and related services, so urban areas are equipped with dense existing wireless communication functions.</p><p num="0007"> The support device used to control the UAV over the wireless communication network may be a custom device, but existing devices can also be used. For example, many off-the-shelf wireless devices have a high degree of programming freedom (for example, some in programming languages such as Java®), support any user interface, and wireless devices via wireless links. Connect to other devices (eg, on the ground or on the plane) and including computer systems. Moreover, such wireless devices are typically small, portable, inexpensive, and require less power.</p><p num="0008"> In addition, wireless network bandwidth is typically an order of magnitude higher than satellite bandwidth, so controlling UAVs using wireless communication networks and supporting devices can accommodate higher bandwidths. As a result, the control is more responsive and the video quality and frame rate are improved (for example, when sending back a video image from the UAV). For example, current generation wireless systems can operate at speeds of up to 300 kbits per second-as opposed to existing satellite systems, which are up to 2.4 kbits per second.</p>

<figref num="1">Mobile radio devices and to access and monitor signals and data transmitted from one or more UAVs and / or transmitted from UAVs by communicating command and control data according to an embodiment of the present invention. FIG. 5 is a system diagram showing an example of an environment in which a wireless communication network is used together with other supporting technologies in some cases.</figref><figref num="2">In a block diagram showing an example of a mobile wireless device, such as the mobile wireless device of FIG. 1, which can be used as a ground control station to control a UAV via a wireless communication network according to an embodiment of the present invention. is there.</figref><figref num="3">FIG. 5 is a block diagram showing an example of a control component of a UAV, such as the UAV of FIG. 1, which can be used for communication via a wireless communication network according to an embodiment of the present invention.</figref><figref num="4">FIG. 5 is a block diagram showing an example of a computer, such as the support technology / computer of FIG. 1, which can also be used for communication via a wireless communication network according to an embodiment of the present invention.</figref><figref num="5">FIG. 5 is a flow chart showing an example of a routine executed by a mobile device used to control a UAV via a wireless communication network according to an embodiment of the present invention.</figref><figref num="6">FIG. 5 is a flow chart showing an example of a routine executed by an aggregate of one or a plurality of components mounted on a UAV, which enables the UAV to communicate via a wireless communication network according to an embodiment of the present invention.</figref><figref num="7">A wireless communication link can be established (via a wireless communication network) to control one or more UAVs according to an embodiment of the present invention, or separately via a wireless communication network. FIG. 5 is a flow diagram showing an example of a routine executed by a computer wirelessly connected to a mobile wireless communication device used next to communicate with one or more UAVs.</figref><figref num="8">Mounted on an airplane that can form a network bridge that allows the control device to communicate with other airplanes, such as UAVs, that are somehow outside the wireless communication network, according to one embodiment of the invention. It is a flow chart which shows an example of the routine which is executed.</figref>

II. System architecture 1 to 4 and the following description are brief descriptions of suitable environments in which some aspects of the invention can be practiced. Some aspects of the invention are as microcodes on computer readable media, including magnetic or optically readable computer disks, on semiconductor memory, nanotechnology memory, organic or optical memory, or other portable data storage media. , Can be stored or distributed. In fact, computer-implemented instructions, data structures, screen displays, and other data according to some aspects of the invention are placed over the Internet over a propagation signal over a propagation medium (eg, electromagnetic waves, sound waves, etc.) over a period of time. It can be distributed to, or over other networks (including wireless networks), or over analog or digital networks (packet switching, circuit switching, or other methods).

Some aspects of the invention are specifically programmed, configured, or configured to execute one or more of the computer executable instructions detailed herein. It can be embodied by a dedicated computer or data processor having a similar structure. Some aspects of the invention can also be implemented in a distributed computing environment in which tasks or modules are performed by remote processing devices linked through a communication network. In a distributed computing environment, program modules can be located in both local and remote memory storage devices.

FIG. 1 shows a radio communication network 102 (eg, for example) to communicate command and control data to one or more planes / UAV108 and / or to access and monitor signals and data transmitted from UAV108. An example of an environment in which an existing mobile phone network) is used with a mobile wireless device 104 (eg, a mobile phone and / or PDA) and possibly other supporting technologies 106 (eg, a personal computer (PC)). It is a system diagram which shows. The UAV108, handheld wireless device 104, and other supporting technologies 106 are combined with the wireless communication network 102 to form some sort of mesh network 110.

Illustrative implementations of wireless communication network 102 are UMTS (Universal Mobile Telecommunication System), GSM (Global System for Mobile Communications), GPRS (General Packet Radio Service), EDGE (Enhanced Data rates for GSM Evolution), CDMA (Code Division). Multiple access), IS-136 / TDMA (time division multiple access), EV-DO (evolution-data optimized), analog, 3GSM (third generation GSM), iDEN (integrated digital enhanced network), etc. including.

Although not illustrated in detail, wireless communication networks include one or more base stations 112, mobile exchanges 114, home location registers (not shown), visitor location registers (not shown), and wireless network databases (not shown). ) And other mobile phone networks can be equipped with typical components. An example of a frequency at which a channel in a mobile communications network can operate includes a typical US mobile phone frequency starting at 824 MHz and ending at 894 MHz.

The wireless communication network 102 can further include various wired or partially wired networks such as the Internet, a wired LAN (local area network), or even a public switched telephone network (PSTN). Although not all types of networks are described herein, some aspects of the invention can be implemented within the framework of many types of networks (eg, satellites). Since the spread of a typical wireless communication network 102 is extremely large, an extremely large effective communication distance of several thousand miles (thousands of kilometers) may be practical. In addition, most wireless communication networks are designed for low latency to support human voice conversations. This low latency allows for fast system reaction times, even when the nodes are located on the other side of the globe.

Although not shown in detail in FIG. 1, in some embodiments, these hybrids such as three basic classes of devices (UAV108, mobile device 104, computer / support device 106, or PDA with mobile phone). One or more of the organisms) can indirectly connect to the mobile phone network via the RF-network bridge. By using a network bridge configuration, the plane can operate outside the mobile phone service area, but can still be controlled by a mobile ground station or a PC directly connected to the network. Apart from that, the PC can be operated from outside the mobile network to control UAVs operating within the network.

Many communication patterns are possible within the mesh network 110. For example, mesh network 110 makes it easy to communicate between airplanes and mobile devices, and users of mobile device 104 (located on the ground and equipped with a ground control station) can issue commands to mobile device 104. To control the airplane / UAV108 or access the data collected by the system onboard the airplane / UAV108. In another embodiment, the mesh network 110 facilitates interair communication, resulting in the availability of scenarios such as target handoff, collision avoidance, spacing, and formation flight. In case small mobile devices require a more sophisticated user interface (UI) environment than is typically available, mesh network 110 can support airplane-computer communication, which is Can be run over wireless and / or wired networks, such as the Internet. For example, support technology 106, including a PC, allows direct or indirect access to a wireless communication network (via a network bridge) to act as an alternative to mobile wireless devices on the network.

There may also be scenarios in controlling the UAV when the first user of the first mobile device wants direct communication with the second user of the second mobile device (eg, with respect to a joint aircraft control strategy). To communicate). Therefore, the mesh network 110 can be used for inter-mobile communication, which can be text-based and even voice-based. Computer-to-computer communication can also be used in similar situations, but is used, for example, by a PC or other supporting technology 106 as an alternative to mobile devices on a wireless communication network 102, for example via an RF-network bridge. If it is done.

The mesh network 110 can be used to communicate from the mobile device 104 to the computer 106 in situations such as chat and target handoffs. Mobile device-computer-to-computer communication can also be used to exchange information between the mobile device 104 and the computer or other supporting device 106. For example, this communication pattern uses the mobile device 104 to establish a communication link with the UAV108, for example, inputting more complex control instructions or information rich in graphics transmitted from the UAV108. Can be used when the user interfaces with the computer / support device 106 when a more robust user interface is needed to display.

In some embodiments, the UAV 108 is outside the physical range of the communication network 102, for example by communicating with a ground station PC that is itself connected to the wireless communication network 102 (eg, via a dedicated communication system). Can be operated by. This configuration allows remote control of the UAV 108 by one or more mobile devices 104 within the wireless communication network, even if the UAV 108 itself is outside the physical communication network 102. In other embodiments, the UAV (eg, instead of a ground station) is used as a bridge to the network. Therefore, in this scenario, one airplane 108 operating within the range of the wireless communication network 102 allows the mobile device 104 to be used within the wireless communication network 102 to control an airplane outside that range. .. Similarly, the UAV 108 can act as a "cell tower" that dynamically expands the service area of the wireless communication network 102.

In some embodiments, multiple simultaneous (or near simultaneous) calls are used between the nodes in the mesh network 110. For example, multiple mobile devices can establish a communication link with a single UAV that can stream different aspects of information to each mobile device. These aspects of information can eventually be put together back into a single data stream (for example, for computer display). Such a multi-call configuration increases bandwidth (eg, as needed to pass full-size and full-frame rate digital video from UAV108 to support device 106). Other methods that allow multiple calls to be used simultaneously (or nearly simultaneously) increase compound link reliability. For these calls, the wireless communication network 102 can be routed through different base stations so that techniques for dynamically selecting the best quality links are used.

FIG. 2 is a block diagram showing an embodiment of a mobile wireless device such as the mobile wireless device 104 of FIG. Mobile phones are shown as mobile wireless devices 104 in FIGS. 1 and 2, but for those skilled in the art, the present invention is based on mobile internet appliances, handheld devices, wearable computers, multiprocessor systems, microprocessors. , Or you will understand that it can be implemented with other devices and configurations, including programmable home appliances, set-top boxes, PDAs, portable laptop computers, and so on. The term "mobile device" is intended to include all such devices.

The mobile device 104 has one or more internal or external antennas 202 for transmitting and receiving electromagnetic signals such as high frequency signals. Transceiver 204 is connected to one or more antennas 202 and typically modulates and demodulates transmit and receive signals, respectively. Transceiver 204 The connected processor unit 206 can include a signal processor, microprocessor, ASIC, or other control and processing logic circuit. Processor unit 206 is capable of performing signal coding, data processing, input / output processing, power control, and other functions required to implement mobile communication devices. A user (eg, an airplane control personnel) can send input to processor unit 206 via keypad 208, microphone 210, or display / touchpad 212. The processor unit 206 can then send information to the user via the display / touchpad 212 or the speaker 214.

Processor unit 206 can access information in non-removable memory 216 or removable memory 218 and store the information in those memories. The non-removable memory 216 may consist of RAM, ROM, a hard disk, or other well-known memory storage technology. The removable memory 218 may consist of a subscriber identification module (SIM) card, or other well-known memory storage technology such as a "smart card", which is well known in GSM communication systems. Common applications 220, such as wireless content browser applications and phonebook applications, can be implemented with either removable memory 218 or non-removable memory 216. Detachable memory 218 and / or non-removable memory 216 can also be configured or programmed to support complex user interfaces and full-color graphics (eg, using the mobile version of Java). Or in C / C ++ on the mobile version of Linux). Detachable memory 218 and / or non-removable memory 216 can also be equipped with features such as moving, magnifying maps, and other applications for controlling and visualizing airplanes and / or maximum loads (eg,). , Java program) can be configured or programmed to run. Apart from that, the mobile device 104 may be configured to passively display a relay image with only a limited input interface.

FIG. 3 is a block diagram showing an embodiment of a UAV control component, such as the UAV 108 of FIG. In particular, a UAV can have several onboard components that allow it to be controlled over a wireless communication network. The UAV can also have components related to supplying outgoing information. Outgoing information can include reconnaissance or airplane surveillance information that can be sent back to the control device via a wireless communication network. In some embodiments, some or all of these components are associated with consumer mobile devices such as camera phones and are very similar to the components described for mobile device 104 in Figure 2. It may be as if it were. One of these components is further integrated separately on the UAV (as opposed to being packaged in a typical mobile device) and then using technologies such as USB. Can be connected.

These components include transceivers and / or gateway components 304 that are connected to one or more antennas 302 and modulate and demodulate transmit and receive signals so that the UAV can communicate over the wireless communication network. Can be done. The processor unit 306 connected to the transceiver 304 may include a signal processor, microprocessor, ASIC, or other control and processing logic circuit. The processor unit 306 can perform signal coding, data processing, input / output processing, power control, and other functions necessary to implement the mobile communication functions mounted on the UAV. Whether provided on a mobile device or as an independent component, the processor unit 306 can serve more than just a "mere" communication processor. For example, it can be used as a flight computer, mission computer, navigation computer, or video processor / preprocessor. The processor unit 306 can access information in memory 310, which is non-removable memory or removable memory (eg, a SIM card), and can store the information in memory 310. Various general and dedicated applications 320 can be configured or programmed in memory as needed.

Cameras 312, including movie cameras and / or still cameras (now often included in aftermarket mobile devices such as camera phones), replace more traditional imaging sensors on UAVs. It can, and therefore an ultra-compact ISR (Intelligence, Surveillance and Reconnaissance) UAV is realized. For example, a movie camera or still camera on a mobile device can be used to "see and avoid" other airplanes or to image objects on the ground.

The microphone component 316, as found in typical cell phones, can be used to perform diagnostics such as monitoring the condition of the UAV's engine. Information about monitoring the condition of this engine can then be passed over the voice channel to the mobile device used to control the UAV, such as a ground station mobile device. In some embodiments, a standard cell phone microphone is replaced with another suitable transducer on the airplane, such as an accelerometer, to measure the vibration of the UAV body. This signal can also be passed to the control mobile device via a voice channel or even a data channel in a communication network. Microphone 316 can also be used to capture airplane remote measurements or sensor data and transmit it over wireless communication links.

The speaker component 314, as found in a typical mobile phone, is amplified and can be used like a public address system. In some scenarios, this allows a person at a distance, while safely away from the area, to talk to others within the field of view of the UAV camera. For military use situations, use the speaker component 314 (or other mobile device related component) on the UAV to safely explode an improvised explosive device (IED) by flying along the road and making a phone call. Can be made to. For example, a UAV can call a cell phone trigger on an enemy IED to safely detonate it.

If equipped with a mobile device component that enables assisted global positioning (AGPS), the AGPS function 318 can be used, for example, for navigation of UAVs via CDMA pilot tone measurements or actual GPS measurements. This improves interference elimination compared to stand-alone GPS receivers.

If the UAV has a mobile device component that allows the UAV to act as a "mobile phone base station," the UAV may be configured to selectively make or reject incoming calls (eg,). , For strategic purposes). UAVs can also be used to "eavesdrop" mobile phone calling activity to find out if an unauthorized call is being made within a controlled area such as a battle zone.

FIG. 4 is a block diagram illustrating an embodiment of a computer 400, such as the assistive technology / computer 106 of FIG. 1, which can also be used to control a UAV over a mobile communication network. Like most traditional computers, the computer 400 can include an arithmetic processor 402, system memory 404, and a system bus 406 that combines various system components with system memory into the arithmetic processor. The arithmetic processing unit 402 may be a logical operation processing unit such as one or more central processing units (CPU), a digital signal processor (DSP), and an integrated circuit for a specific application (AISC). Unless otherwise noted, the structure and operation of the various blocks shown in FIG. 4 is of conventional design. As such, such blocks will be readily understood by those skilled in the art and will not be described in more detail herein.

System bus 406 can use well-known bus structures or architectures, including memory controllers, peripheral buses, and memory buses with local buses. System memory 404 includes random access memory (RAM) 408 and read-only memory (ROM) 410. The basic input / output system (I / O) 412, which can form part of the ROM 410, includes basic routines that help transfer information between elements within the computer 400, such as at startup. The hardware elements of the I / O system 412 allow the user to use input devices such as keyboards, pointing devices such as mice, or other input devices including microphones, joysticks, gamepads, scanners, etc. (all shown in the figure). Commands and information can be entered into the computer 400 via (not necessarily). These input devices and other input devices are connected to the compute processor 402 through an interface such as the Syriaport interface that connects to bus 406, but other parallel ports, game ports, or other universal serial buses (USB). You can also use the interface. For example, other hardware devices such as a PCMCIA reader that accepts cards can be coupled to this interface. A monitor or other display device is coupled to bus 406 via a video interface such as a video adapter. The computer 400 can include other output devices such as speakers and printers.

The computer 400 further includes a hard disk drive 414 for reading and writing to a hard disk (not shown), and an optical disk drive 416 and a magnetic disk drive 418 for reading and writing to the removable optical disk 420 and magnetic disk 422, respectively. The optical disk 420 can be a CD-ROM, and the magnetic disk 422 can be a magnetic floppy (registered trademark) disk. The hard disk drive 414, the optical disk drive 416, and the magnetic disk drive 418 communicate with the arithmetic processing unit 402 via the bus 406. Hard disk drives 414, optical disk drives 416, and magnetic disk drives 418 can include interfaces or controllers (not shown) coupled between such drives and bus 406, as is well known to those skilled in the art. Drives 414, 416, and 418 and associated computer-readable media provide a non-volatile storage device for storing computer-readable instructions, data structures, program modules, and other data for the computer 400. The computer 400 uses a hard disk, an optical disk 420, and a magnetic disk 422, but a magnetic cassette, a flash memory card, or a digital video disk (which can store data accessible to the computer by a person skilled in the art). You will understand that other types of computer-readable media such as DVD), Bernoulli cartridges, RAM, ROM, smart cards, and nanotechnology memory can be used.

Program modules, such as operating system 424 and other application programs 426, can be stored in system memory 404s, allowing control of the UAV and making data received from the UAV easily accessible in traditional formats. it can. The system memory 404 can also accommodate a web browser 428 that allows the computer 400 to access and exchange data on websites within the World Wide Web on the Internet. Application program 426 can access one or more databases, which may be internal or external to the computer. For example, the computer has a map database 430 (stores a map of the area operated by the UAV), a combat planning database 432 (stores a UAV combat plan operating in a military situation), and several other input source databases 434. Can be accessed.

Computer 400 may operate in a networked environment using a logical connection to one or more remote computers, such as remote computer 450. For example, computer 400 may be involved in performing a first set of tasks in a workflow, and remote computer 450 may be involved in performing a second set of tasks in a workflow. In another embodiment, the remote computer 450 provides an input source for a workflow facility hosted on the computer 400. Similarly, computer 400 can be involved in designing workflows with tasks to be performed by remote computer 450. Like the computer 400, the remote computer 450 can be a personal computer, server, router, network PC, peer device, or other common network node, typically described above with respect to the computer 400. Contains many or all of the elements. Typically, the remote computer 450 comprises a memory storage device such as a disk drive 452. The remote computer 450 logically connects to the computer 400 via a well-known method that allows communication between computers, such as through a local area network (LAN) 454 or a wide area network (WAN) or the Internet 456. Can be done. Such networking environments are well known in offices, enterprise-wide computer networks, intranets, and the Internet.

In a LAN networking environment, computer 400 is connected to LAN454 through an adapter or network interface (coupled to bus 406). When used in a WAN networking environment, the computer 400 often includes a modem or other device for establishing communication over the WAN / Internet 456. In a networked environment, program modules, application programs, or data, or parts thereof, can be stored within a remote computer 450, such as disk drive 452. For those skilled in the art, the network connection shown in FIG. 4 is only a few examples of establishing communication links between computers, making it easy for others to use other links, including wireless links. You will understand. Generally, hardware platforms such as computer 400 and remote computer 450 are described herein, but some aspects of the invention are also such for nodes on the network that have corresponding resource locators. Can be applied equally to identify such nodes.

III. System flow Figures 5 to 8 are typical flow charts showing the processes that occur in the environment shown in Fig. 1. These flow diagrams do not show all the functions or exchanges of data, but instead make it possible to understand the commands and data exchanged under the system. Those skilled in the art will appreciate that some functions or exchanges of commands and data may be repeated, modified, omitted, or supplemented, and other aspects not shown can be easily implemented. You will understand. For example, although not described in detail, messages containing data can be sent by means such as message queues, HTTP, and so on.

FIG. 5 is a flow diagram showing an embodiment of Routine 500 executed on a mobile device used to control a UAV. For example, the mobile device may be a mobile phone configured as a ground control station, which sends control signals to the UAV and / or receives data sent back from the UAV, such as surveillance and reconnaissance data. Operated by the user.

At block 501, routine 500 sets up a wireless communication link with the UAV on the wireless communication network. For example, this can include communication with a mobile exchange associated with a wireless communication network (eg, via a control channel). As a result of this communication, both mobile devices and UAVs allow mobile exchanges to access one or more channels of wireless communication links, including one or more voice and / or data channels. Can receive channel allocation information. At block 502, routine 500 receives channel allocation information, thereby establishing an active communication link over one or more designated communication channels. At block 503, routine 500 sends a control signal to the UAV (for example, instructions that control the activity of the UAV, including direction and speed of movement, launch of weapons, etc.) and / or receives data sent back from the UAV. (For example, reconnaissance information, video information, information on UAV tone monitoring, etc.). The format and type of information communicated over established communication links includes audio (or other audio) data, image data, video data, binary data, text data, etc., depending on the system and network configuration. be able to. Assuming that the session with the UAV has ended at block 504 (eg, the UAV has landed safely), routine 500 terminates the communication link, thereby terminating the UAV session.

FIG. 6 is a flow diagram illustrating an embodiment of a routine 600 executed by a collection of one or more components mounted on a UAV that allows the UAV to communicate over a wireless communication network. For example, a collection of components can be packaged into a single mobile device, such as a mobile phone, that connects to other UAV control and / or reconnaissance systems (via a connection such as a USB bus).

At block 601, routine 600 receives channel allocation information for establishing a wireless communication link with a control device (such as a terrestrial mobile phone) over a wireless communication network. For example, it communicates with a mobile exchange associated with a wireless communication network to receive channel allocation information related to one or more voice and / or data channels (eg, via a control channel). ) May be accompanied. At block 602, routine 600 establishes an active communication link over one or more channels. At block 603, routine 600 receives control signals transmitted from the ground cell phone (eg, instructions that control UAV activity, including direction and speed of movement, weapon launch, and so on). Additionally, or alternatively the block 603, the routine 600, the data (e.g., reconnaissance information, video information, such as information about monitoring tone UAV) the earth can be sent back to the mobile control device. The format and type of information communicated over established communication links includes audio (or other audio) data, image data, video data, binary data, text data, etc., depending on the system and network configuration. be able to. Assuming that the session with the UAV has ended at block 604 (eg, the UAV has landed safely), routine 600 receives a termination signal to break the communication link, thereby terminating the communication session.

Figure 7 shows a computer that can establish a wireless communication link (via a wireless communication network) to control one or more UAVs, or separately, one or more over a wireless communication network. One of the routines 700 performed by a computer capable of establishing a connection (eg, wireless, wired, Bluetooth®, infrared, etc.) with a mobile wireless communication device that will be used next to communicate with the UAV. It is a flow chart which shows the Example. In either scenario, the computer makes it easy for the user to send control commands to the UAV, monitor the UAV, and / or receive data feeds from the UAV (eg, video reconnaissance, image, tone monitoring, etc.). It can support a robust user interface that can be done.

At block 701, routine 700 receives control input from a user who wants to control the UAV through the interface provided by the application running on the computer. At block 702, routine 700 establishes either an indirect or direct connection to the UAV. For example, a computer can establish a WAN connection with components of a wireless communication network (eg, base stations and mobile exchanges), which allows the computer to communicate in place of traditional wireless communication devices. It can, and the directness of the connection with the UAV can be adjusted via a partial wireless connection. In another arrangement, the routine 700 can establish a communication link (wired or wireless) between the UAV and the next mobile device that can communicate over the wireless connection as described with reference to FIG. At block 703, routine 700 sends control inputs to the UAV (or relaying mobile device), at least in part, over the wireless communication network. At block 704, routine 700 receives reconnaissance data and / or surveillance data from the UAV (or via a relaying mobile device), at least in part, over a wireless communication network. Routine 700 then ends.

Figure 8 is performed on an airplane that can form a network bridge that allows the control device to communicate with other airplanes, such as UAVs, that are somehow outside the mobile communications network. It is a flow chart which shows one Example of the routine 800. In another embodiment, an airplane is a lead unit for a group of planes, each configured to perform a joint aerial aircraft operation battle (eg, led by a lead unit).

At block 801 the routine 800 establishes a wireless connection to a ground control device (such as a wireless communication device in a ground station or PC) over a mobile communication network. Examples of establishing such a wireless connection have been described in more detail above with respect to FIGS. 5 and 7. In block 802, routine 800 is one or more UAVs (eg, UAVs that are outside the communications network, or UAVs that are part of a group of planes that are configured to conduct joint aerial vehicle operation battles). Establish a communication link with. This connection can be made via a mobile communication network or some other form of wireless communication (eg, direct RF, infrared, Bluetooth, etc.). At block 803, routine 800 receives a control signal from the ground control device. At block 804, based on this received control signal, routine 800 sends the appropriate control signal to one or more UAVs. Block 804 in Routine 800 can also be flipped so that the UAV receives data from one or more UAVs and returns it to the ground control station. Routine 800 then ends when the control session ends, or when the communication session is terminated in some other way.

IV. Conclusion From the above description, although specific embodiments of the present invention have been described herein for illustrative purposes, it will be appreciated that various modifications can be made without departing from the present invention. For example, although a particular communication network is described for various embodiments, some aspects of the invention may be implemented on various wireless networks. Other aspects, which may vary, include not only the UAV, but also the type and structure of the device used to control the system mounted on the UAV itself. Aspects of the invention described in the context of a particular embodiment may be combined or excluded in other embodiments. Moreover, while the advantages associated with some embodiments of the invention are described in the context of those embodiments, other embodiments can also exhibit such advantages, and all embodiments It is not always necessary to show such advantages that fall within the scope of the present invention. Therefore, the present invention is not limited except as provided by the claims.