Method of generating a representation of a structure

Low-power personal area networks such as ZigBee, Z-Wave, Insteon, JenNet-IP, and X10 are becoming more and more popular. Home appliances, lighting, heating and cooling, security, and monitoring systems, entertainment systems, communications, lawn sprinklers, etc. now include control microprocessors and wireless communication devices that enable wireless connectivity to home networks. This allows the controls on these devices to be located within a smartphone, PDA, laptop computer, desktop computer, or other device with a user-friendly software control interface, or the controls are in the network cloud. It may be located within and only the interface may be local.

There are several different ways to organize and configure these networks. Existing technologies are categorized based on their ability to communicate home devices using visible light, ultrasound, infrared, radio frequencies, and other communication technologies, and devices are defined within the space in which they are located. Allows you to organize into clusters based on the space you have, as well as the types of these devices. By integrating the microprocessor into a separate device, the device makes it possible to receive programming, which allows a high degree of freedom for the user. However, the typical user can be confused by the large number of available configurations.

<p num="0003"> Most of the network technologies used here are relatively complex and difficult for consumers to use. Adding and certifying new equipment and types may require the hiring of trained technicians to carry out the deployment. Reducing the cost of microprocessors, memory, displays, wireless transmitters and receivers, and line-of-sight communications makes it possible to add these features to cheap, disposable consumer products. This poses a set of challenges for consumers and networks.</p>

<figref num="1">An embodiment of a consumer product device is shown.</figref><figref num="2">The block diagram of the embodiment of the communication part of the network apparatus is shown.</figref><figref num="3">An embodiment of a lighting device is shown.</figref><figref num="4">Another embodiment of the luminaire is shown.</figref><figref num="5">FIG. 6 shows a diagram of an embodiment of a structure having a large number of potential nodes in an ad hoc wireless network.</figref><figref num="6">The flowchart of the embodiment of the method of forming a room list is shown.</figref><figref num="7">The flowchart of the embodiment of the method of assigning a function to a room is shown.</figref><figref num="8">A flowchart of an embodiment of a method of determining and executing a function based on the configuration of an ad hoc wireless network is shown.</figref><figref num="9">The flowchart of the embodiment of the method of constructing a three-dimensional representation is shown.</figref><figref num="10">An example of a three-dimensional representation of a node in a structure is shown.</figref>

Common nodes and non-lighting devices FIG. 1 shows an embodiment of a consumer product device having a network function. The device 10 has a receiver or adapter 12 including consumer products. Consumer products can be one of many. For example, consumer products consist of consumable product dispensers that distribute or deliver certain consumable products such as shaving creams, air cleaners, toothpastes, lotions, shampoos, cotton swabs, razor blades, and tissue. In some cases. Consumer products may consist of non-driven tools such as blades, toothbrushes, hairbrushes, dusters, brooms, mops, scrubbing brushes, and toilet cleaning tools. Consumer products include electrically driven devices, such as coffee makers, or other kitchen devices, such as toaster ovens. It may consist of over), TV, hair dryer, vacuum cleaner, air purifier, humidifier, etc. These are examples of both non-driven and driven products, and no restrictions on any particular product or configuration are intended and should not be determined as such. As defined herein, consumer products do not have any network communication capabilities. Communication in these devices takes only the form of local communication, such as user interfaces and warning lights.

The receiver 12 is snap-fitted to the consumer product device 10 or allows the consumer device to be otherwise mechanically and optionally electrically connected to it. In a driven device, the receiver 12 may include a standard bifurcated or tridented protruding receiver found in outlets.

The consumer product device also includes at least one communication module or hub 14. The communication hub may include one communication module or several communication modules, each using a different type of communication technology. For example, the communication module may consist of a communication module limited to a room. "Limited to a room" means that the communication medium of this device uses signals that generally do not pass through barriers such as walls, floors, and ceilings. Examples include in-line signals such as optical and acoustic signals. The communication module may also consist of or include a room transparent communication module. "Room transmission" means that the communication medium of the device is not restricted by walls and floors. These barriers can weaken the signal, but generally do not block it. The communication hub 14 may include one or both of these types of modules, and may include two or more of each type, such as two room limiting modules and one room transparent module, each of which is an ad hoc mesh. It has a unique function of connecting to other devices via a network.

The network function allows devices that do not originally have this capability to join and separate from the ad hoc mesh network and communicate with other devices that also do not have this capability in the first place. By giving these devices and products the ability to communicate and coordinate with other devices, users will be able to manage various aspects of their home.

The consumer product device may also include a power connector 16 that is electrically connected to the communication module. Power connectors can take many forms, but typically consist of standard bifurcated or trifurcated plugs. The power connector can power the communication module and also the consumer product part of the device.

Other variations and modifications of consumer product equipment are also possible. For example, the sensor 18 may allow the user to track the remaining amount of consumable product in the receiver 12. For example, if the consumer product consists of some kind of dispenser, the sensor may be an optical sensor. The light sensor may be positioned so that the light to the sensor is shielded by a consumable product. When the consumable product is used up, the light reaches the sensor, indicating that the dispenser is almost empty. Other types of sensors include thermal sensors, weight sensors, accelerators, diagnostic sensors, air quality sensors, VOC (volatile organic compound) sensors and the like. Using the network capabilities of the device, detection of the state of consumable products can trigger features described in more detail below.

FIG. 2 shows an embodiment of the communication module 14 that provides a network function. The module may include a room transparency module 26. The room transmission module may be a radio, in which case it may have an associated antenna 22. Radios may communicate by one of various types of protocols, but often use packet-based protocols such as the Internet Protocol. More specifically, the protocol may be, for example, one of IP version 6 (IPv6) (6LoWPAN) on a low power wireless personal area network, or one of the Neighborhood Exchange Protocols.

Figure 2 shows both room-transparent and room-restricted communication modules, and it is understood that only one is needed to provide networking capabilities. As mentioned above, room-restricted communication modules generally consist of line-of-sight communication modules such as infrared light, visible light, and ultrasonic waves, or other acoustic signals. When the receiver is not in the field of view of the transmitter, the receiver does not receive the signal. The line-of-sight communication module may have a radiating device such as 24 connected to it.

The communication module 14 typically receives power from an outlet or battery via the power connector 16. However, the power connector 16 may also consist of a wireless power receiver. In some cases, the base device sends a signal to the receiver, which can convert the signal into power for the receiver. Currently, these types of receivers are very limited in functionality due to the limited amount of power they receive and the limited range due to the loss of the signal carrying the power. However, future possible solutions to these problems can be conceived and the present embodiment is not limited to direct electrical connections. In addition, the device may include both of these types of electrical connections. The device may be configured such that the communication module has a wider range when connected to a power source.

Of course, any other component is also possible. For example, the memory 20 may be located in a communication hub, in each communication module, at another location in the device, or may be networked, or may be a remote memory as is common in cloud computers. May be good. There may also be a controller 20 separate from the communication module, each module having its own controller, with a separate central controller or network controller.

In addition to sensors configured to sense the state of consumable products, other types of sensors may be present on the device, or the sensors may be located on their own node. Sensors include security sensors, radio frequency identification tags, bar code readers, or environmental sensors, motion sensors, sound sensors, odor sensors, smoke alarms, aerial particulate sensors, pollen and dust sensors, air purification systems, metrology, aerial It can be a biological factor sensor, a microorganism and virus sensor, a surface contamination sensor, a hygiene sensor, a water quality sensor, a humidity sensor, and the like. Environmental sensors can sense air quality, light level, temperature and air flow. For example, a sensor that senses air quality can determine that a room needs ventilation and send a signal to an air purifier through a network to purify the air. In lighting applications, sensors may transmit information about lighting levels to turn on one or more lighting devices. The luminaire as a node is described in more detail below.

Returning to FIG. 1, the communication module may also have any direct connection communication port, such as USB or IEEE 1394 (Firewire) port 17. This gives the user the ability to connect the device to a computing device for firmware or software initialization, or programming, updating, and consumers who also have a similar port, such as a TV or music system. Allow direct connection to the device. Port 17 may also allow connectivity to network access points, or gateways, to provide connectivity with external networks such as the Internet.

Lighting products The statement in this regard is any type of luminaire that is screwed into a socket to receive power when switched on, including traditional incandescent lamps, LED bulbs, compact fluorescent lamps (CFLs), etc. We have focused on lighting products, including light bulbs, and consumer products other than other lighting products, such as lamps. There are new forms of light that can be powered by other means such as batteries, electrostatic induction, and sound waves. FIG. 3 shows an embodiment of the adapter 30 used with a lamp. The communication module 14 is part of a housing, which has a light emitting receptacle 32 configured to receive a lamp. This is typical of a light bulb that already has an expensive adapter inside, or a dedicated socket with a centrally controllable processor, and other adapters, referred to herein as fully integrated light bulbs. Enables the use of household light bulbs. A fully integrated light bulb with a room list and ID.

Alternatively, the light emitting receptacle 32 may take the form of an adapter plug similar to an outlet, as shown in FIG. In this embodiment, the back side of the adapter is similar to the back side of the adapter shown as 16 in FIG. The communication module 14 has one or both of the room-restricted communication module and the room-transparent communication module described in detail above. The luminescent receptacle can accept a light bulb, a light or lamp with a power cord, or a light with an integrated power connector found in emergency lighting.

Like the non-lighting adapter described above, the lighting device may also include a sensor. The sensor typically consists of an optical sensor, but may also consist of a temperature sensor, smoke detector, and the like. The sensor can communicate with a controller located within the adapter 30, which may communicate with a luminaire or non-illuminator over an ad hoc network. The controller may control the power connection and powers the light emitter at the direction of the sensor input (possibly combined with the user's input to the desired lighting level for a particular time or activity). Or switch off.

The luminaire may form an ad hoc mesh network, where the device is free to enter and exit the network, allowing all devices in the network to communicate with any and all devices within that range. .. A central controller may be present, but each device may also have its own controller. Instead of the central controller, one device may designate itself as a master node and supply control signals to other nodes. With known ad hoc mesh network protocols, a node designates itself as a master node, typically based on its ability to hang ad hoc mesh networks over other networks. In the absence of such a node, the node arbitrates which will be the master. The details of these processes are not the focus of discussion.

The discussion on this point focuses on giving consumer products the ability to form ad hoc wireless mesh networks. Consumer products are intelligent, ranging from relatively "dumb" products such as light bulbs, vacuum cleaners and air purifiers to high-performance products such as consumer electronics and computing devices. Can be. Having a network of devices with these functions may allow the user to segment the nodes of the network into rooms of a house or structure without prior knowledge of the floor plan.

Room list / room ID Figure 5 shows an example of the floor plan of a house. The technology used here can be applied to any structure such as an office building, a hospital, etc., which has one or more rooms. This description, which focuses on consumer products, uses the house as a typical structure. This choice is not intended or suggestive of limitation. The nodes of this network are located in the room, but the user does not need or have no floor plan. It should be noted that the users of the technology and embodiments are not necessarily human consumers. A "user" can be a computing device used by a human consumer to collect this information so that it does not have to be done by a human.

FIG. 6 shows a flowchart of an embodiment of a method of determining which node is located in a room. At 40, an ad hoc mesh network is formed. This may include deploying the nodes and then broadcasting these signals to notify any node in the area where they reside. The node can be a lighting product, such as those described above, or a consumer product. As part of network formation, a node can send its signal to determine the presence of another node.

At 42, the signals between the nodes are analyzed, where the analysis can occur at several locations, such as within the network, within the nodes, within the cloud, and so on. With reference to the floor plan in Figure 5, some nodes see nodes that others cannot "see", where "seeing" a node means detecting the presence of the node. For example, node I can see nodes J, A, and H. However, node J can also see node L and node K. Node K can see node M. By analyzing the signal, it is determined that node J cannot see node M, so there should be a wall between node J and M. Similarly, node I can see node H through the doorway, but node I cannot see G, but node I recognizes the existence of node G from the information from node H.

This analysis also allows the node to determine the distance between them. The receiving node can determine the transmission time from another node, thereby determining the distance between the nodes, but not necessarily the direction. For example, these two types of analysis can be used to determine a room in a structure. Nodes can be segmented into rooms based on line-of-sight data. In addition, the network may be able to determine the approximate size of the room based on the signal strength received. Nodes have a number of methods for detecting each other, eg, optically and electrically, using sensors and the like.

The above analysis assumes the use of room-restricted communication modules only. In some embodiments, the node may also use a room transparent communication module. In this example, the node may identify itself based on room-restricted communication. By combining this data with the line-of-sight data, the network can identify walls and openings between nodes and segment the nodes into rooms at 44. For example, with reference to FIG. 5, node I may recognize the existence of node C based on the room transparent communication module. However, looking at the room limiting signal, Node I cannot detect the presence of Node C, indicating that there is a wall or other barrier between them.

Once a node is segmented into a room, the node information is updated to associate this node with that room at 46. One of the nodes on the network may contain non-volatile memory, or the non-volatile memory may be located outside the network but may be communicating with one of the nodes. The room list and the nodes associated with the room can be stored in this memory. A node having non-volatile memory or having a link to non-volatile memory can be a master node as described above. This process is cyclically repeated to obtain updated information, as these nodes may be user-driven or attached to consumer products that may themselves be mobile, or include them. obtain.

The above process is aimed at segmenting nodes into rooms, but it is also possible to segment devices into other types of segments, for example by segmenting them by user, device type, etc. It should be noted that it is possible. Although this discussion focuses on segmentation by room, the use of other types of segments should also be considered within the scope of the embodiments presented herein.

The purpose of the room Once the nodes are segmented into rooms and the nodes are associated with these rooms, the network can determine the purpose of each room. FIG. 7 shows a flowchart of an embodiment of a method of assigning a purpose to a room. Processors 50-56 are similar to those in Figure 6 and segment nodes into rooms with similar signals, if not the same. At 50, the nodes form a network and the signals between the nodes are analyzed. As mentioned earlier, analysis can occur at each individual node, master node (if specified), network, cloud, and so on. When a node is segmented into a room, the network then acquires an identity as one of the nodes in the room at 58.

Acquiring the identity of one of the nodes in a room can take many forms. The node itself may have information to encode into the signal it transmits, such as device identifiers, names, and so on. When activating a node, the user may install this information on the node using the USB port or the node's resident interface. Nodes have this information referred to herein as "node data". Node data includes some information about a node, such as the type of device at the node, the state of the device, such as full or almost empty, its power state, and which other nodes it is connected to.

In one embodiment, the node data consists of at least the identifier of the device located at the node. This node, or another node on the network, accesses the database of identifiers and uses the device identifier as an index to the database. The information that arises provides the network with more information about the node. For example, the device may have a stock item identification number (SKU) number as an identifier. Accessing the database results identifies the SKU as a toothbrush. Other types of identifiers may also exist. The identifier can be a barcode, a network address, an identity assumed based on the analysis of peripheral devices, or information about the environment. Based on this information, the network can assign room functions to rooms at 60 (in this example, the room with the toothbrush is the bathroom).

Databases can also take various forms. It may be fully populated data, or simply a small look-up table, and any option that can be conceived as somewhere in between these two extremes. The database may be located in non-volatile memory on a node in the network, or it may be outside the network but accessible to the external network through a link.

Access to the database may also occur in layers. The first database identifies a particular device as a toothbrush, which results in access to the second database, which provides further information about the toothbrush, such as model number, or brand name. In one embodiment, the database being accessed may consist of a database populated by consumers with similar networks and may have a higher degree of insight into assigning functions to rooms.

Databases can be organized in many different ways. In one embodiment, a table of nodes, a table of rooms, and an association between a table of nodes and a table of rooms. Alternatively, a table of nodes in a wireless network, a table of rooms in a house, a table of room functions, and room functions, and the relationships between rooms and nodes.

In one embodiment, the information contained in the room list may be found to be useful in assigning functions to the room. If a room list is saved using this identity to assign a function to a room, this can be based on the current room list. Alternatively, the room function includes the previous room list or its history, the current node function list, the node function list history, the current node position data, the node position data history, the current sensor data, the sensor data history, and the user page. It can be assigned based on reference data, an external database of room functions, a blueprint for the house, and external data about the house.

motion Identifying the purpose of the room, the network may have the ability to operate on the purpose of the room and the nodes within the room. An embodiment of this process is shown in Figure 8. In one embodiment, in 62, the network has a node associated with a consumer product such as an air purifier dispenser, and the node may be associated with any consumer product device described in connection with FIG. Is understood. In addition, the network has nodes with computing devices such as node A and has links to either internal or external networks.

At 62, the consumer product node sends data to the computing device node. This data is the above-mentioned node data, and may include a node identifier, a consumer product state, a power state, and the like. The computing device then accesses the database at 64 to collect more information about the node and associate this data with the node data. The computing device can then make a determination of the action taken in relation to the device at the node at 66 and perform this action at 68. The operation can be inside or outside the network.

Internal operations can include changing the functionality of a node, such as shutting it down, slowing it down, reducing its use, and so on. This may include a partner device for the current node whose operating state has changed, for example activating another device when the amount of supplies in the device is low. This may also include updating the internal database or sending a message to the user within the network, such as providing the user with a shopping list that identifies the supplies needed at a particular node.

External actions include sending text messages to users via links to mobile network, sending emails through internet gateways, and email clients, and accessing electronic commerce gateways to order further supplies. It may include accessing information about the device located at the node from an external database.

For example, assume that the node has an air purifier dispenser. The node data includes an identifier that identifies the device as an air purifier and a state that indicates the amount of cleaner remaining in the reservoir. The node sends this data to the computing device. The computing device accesses the database (internal or external) and determines that the reservoir is nearly empty based on this amount. The database in this example can simply be a list stored in memory. The computing device then identifies different behaviors based on the nearly empty reservoir. The device can communicate with the user to notify the status. The device can access the e-commerce gateway to order more air purifiers. The device can also shut down the air purifier to avoid running out.

The choice of action to perform may include sensor input, user input, previous state set by the user, and so on. For example, a sensor may detect that the flow of air through an air filter has dropped below a certain threshold, indicating that the filter needs to be cleaned or replaced. This information helps the network choose what action to take.

In this way, the network obtains various information about the devices at the nodes of the network and allows the network to automatically service the user. The more tasks and services the network can handle, the easier it is for users to use the products and networks. Other benefits may also arise from having such a network existing within the structure.

Home discovery As mentioned earlier regarding the design of the structure, the user may not have a blueprint or floor plan to enter into the network. However, the nodes of the network can "see" the structure in different ways. One benefit of the network lies in its ability to compose a three-dimensional representation of the structure.

FIG. 9 shows an embodiment of a method in which a network of devices performs "home discovery" to generate a three-dimensional representation of a house. At 80, a network with at least 3 nodes is provided. The use of three nodes allows one node to be positioned in a triangle with respect to the other two nodes. Generally, the communication module in these nodes is a room transparent module. Having three nodes provides enough information for signal analysis, and if it can be located on one different floor of the node, the room restriction module will not allow another node to see this node.

Using the time of flight of the signal between the three nodes, as shown in Figure 10, signal analysis can generate a general design of the nodes in the structure. In addition to signal analysis, other information may exist. The type of node and whether the node is mobile can also be useful.

For example, one of the nodes may be attached to a floor vacuum cleaner, such as a Swiffer® dust mop. When used, the movement of the floor vacuum cleaner provides information on where the uncarpeted floor is, plus additional trigonometric data on the location of the other two nodes. In another example, the node may be attached to a robot vacuum, such as Roomba®. This makes it possible to identify information about the surface of the carpet and, in some cases, the location of furniture in the room. Of course, other mobile nodes are possible. Users may also use dusters or other types of "wand" structures to map the structure of the network. Yet another alternative involves attaching a node to a pet.

Further information yields a more accurate image of the house. The above description has focused on the use of room transparent communication modules as a means of arranging nodes. However, the above description also includes the possibility of using a room restriction module, as well as the previously identified room segmentation and room purpose. All of this information can be used to generate a three-dimensional representation of the house, as well as a signal analysis. Information is stored within or outside the network, but is accessible by at least one node.

The above embodiment provides a convenient, simple and easy way for the user to configure a network of consumer product nodes in the home. The network may collect information for the user and operate more autonomously. The end result is a network of devices that help users maintain and enjoy their home.

It is recognized that some of the above and other features and functions, or alternatives thereof, may optionally be combined with some other system or application. Also, unexpected or unexpected substitutions, modifications, variations, or improvements made herein may be made subsequently by one of ordinary skill in the art, which is also intended to be incorporated in the following claims.