Electronic Device Control Based on Gestures

FIELD OF THE DISCLOSURE

0001The present disclosure is generally related to a gesture controller capable of controlling one or more electronic devices based on gestures made by a user.

BACKGROUND

0002Remote control devices are prevalent and are commonly supplied with consumer electronic devices. Some remote control devices may be used to control devices throughout a residence when the devices are part of a home network supported by a residential gateway system. Some remote control devices may be able to convert spoken words into commands. A user typically needs to hold, touch, or be near (e.g. to speak a command) a remote control device to use the remote control device.

BRIEF DESCRIPTION OF THE DRAWINGS

0003<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of a first embodiment of a system including a gesture controller for device control based on gestures.

0004<figref idref="DRAWINGS">FIG. 2</figref> is a diagram that illustrates an embodiment of a menu sent to a display device by the gesture controller for device control based on gestures.

0005<figref idref="DRAWINGS">FIG. 3</figref> is a flow chart of a first particular embodiment of a method for device control based on gestures.

0006<figref idref="DRAWINGS">FIG. 4</figref> is a flow chart of a second particular embodiment of a method for device control based on gestures.

0007<figref idref="DRAWINGS">FIG. 5</figref> is a block diagram of an illustrative embodiment of a general computer system.

DETAILED DESCRIPTION

0008Electronic devices within a residence may be controlled based on gestures made by a user. The gestures may allow for user control of one or more devices without the need for the user to hold, wear, or be in contact with a sensor or a remote control device. Gestures of a user may be detected by a three dimensional (3D) image device. Data from the 3D image device may be analyzed by a gesture controller to determine whether gestures made by the user should be ignored, should result in sending a menu to a display device, should result in navigation of the menu, should result in selection of menu options, or should result in the gesture controller sending at least one command to one or more devices. The gesture controller may replace a remote control device, may be used when the user does not desire to use or cannot easily access the remote control device, or may be used when the user wants to control a device that is able to be controlled using the gesture controller but is not able to be controlled by the remote control device.

0009In a particular embodiment, a system includes a three dimensional (3D) image device configured to provide 3D image data of movements of a user. The system includes a display interface configured to send options of a menu to a display device. The system includes a processor configured to analyze the 3D image data to provide at least one of an instruction to change the menu and at least one command for one or more devices. The system also includes at least one interface to send the at least one command to the one or more device.

0010In a particular embodiment, a method includes sending a menu from a gesture controller to a display device. The menu includes selectable options to control at least one electronic device. The method includes detecting a first user gesture at the gesture controller in response to three dimensional (3D) image data obtained from a gesture camera. The method includes determining at least one command for one or more electronic devices at the gesture controller based on the first user gesture and based on the menu. The method also includes sending the at least one command from the gesture controller to the one or more electronic devices.

0011<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of a particular embodiment of a system <b>100</b> that includes a gesture controller <b>102</b> for device control based on gestures. The gesture controller <b>102</b> may be in a residence <b>104</b>. The gesture controller <b>102</b> may be coupled via a wired connection or a wireless connection to one or more devices <b>106</b>-<b>120</b> that are to be controlled. The devices <b>106</b>-<b>120</b> may include, but are not limited to, customer premises equipment (CPE) <b>106</b>, at least one media device <b>108</b>, at least one display device <b>110</b>, at least one computer system <b>112</b>, a security system <b>114</b>, one or more electronic devices <b>116</b> associated with the residence <b>104</b>, lighting <b>118</b> associated with the residence <b>104</b>, and at least one mobile communication device <b>120</b>.

0012The gesture controller <b>102</b> may receive three dimensional (3D) image data from a gesture camera <b>122</b>. The gesture camera <b>122</b> may be an integral component of the gesture controller <b>102</b>, or the gesture camera <b>122</b> may have a wired or wireless data connection with the gesture controller <b>102</b>. The gesture controller <b>102</b> may analyze the 3D image data from the gesture camera <b>122</b> to determine one or more gestures made by a person within range of the gesture camera <b>122</b>. Certain gestures detected by the gesture controller <b>102</b> may cause the gesture controller <b>102</b> to send information to the display device <b>110</b> (e.g., a menu), to change information sent to the display device <b>110</b> (change or update a menu sent to the display device <b>110</b>), or may cause the gesture controller <b>102</b> to send commands to one or more of the devices <b>106</b>-<b>120</b>. The information may be sent directly to the display device <b>110</b>, or the information may be sent to the display device <b>110</b> via another device (e.g., via the media device <b>108</b>).

0013The gesture camera <b>122</b> may be any type of camera able to provide 3D image data to the gesture controller <b>102</b>. For example, the gesture camera <b>122</b> may include two or more offset camera lens that allow combined 3D image data to be generated. In another example, the gesture camera <b>122</b> may include a lens, an emitter (e.g., an infrared emitter), and a receiver that allows 3D image data to be generated. Gesture cameras <b>122</b> may be available from Canesta, PrimeSense, and MicroSoft.

0014The CPE <b>106</b> may facilitate communications between one or more devices (e.g., the media device <b>108</b>) and one or more content providers <b>124</b> via a network <b>126</b>. The CPE <b>106</b> may include a router, a wireless router, a local area network device, a modem (e.g., a digital subscriber line (DSL) modem or a cable modem), a residential gateway, other communication facilitator, or combinations thereof.

0015The media device <b>108</b> may be a set-top box device or similar device that receives media content from the one or more content providers <b>124</b> via the network <b>126</b>. The media content may be provided to the display device <b>110</b> or to other electronic devices (e.g., the computer system <b>112</b>). The media content may be television programming, video-on-demand, internet content, or other types of media. The media device <b>108</b> may provide a user interface to the display device <b>110</b> that allows the person to change settings of the gesture controller <b>102</b>. A remote control device may be used to control at least the media device <b>108</b> and the display device <b>110</b>.

0016The computer system <b>112</b> may be a desk top computer, a lap top computer, or a tablet computer. The computer system <b>112</b> may be able to provide a user interface that allows the person to change settings of the gesture controller <b>102</b>.

0017The security system <b>114</b> may provide security services for the residence <b>104</b>. The services may include, but are not limited to, monitoring windows, doors, motion detectors, fire alarms, carbon monoxide alarms, other devices, and combinations thereof for alarm conditions; controlling electronic locks; controlling lighting; and combinations thereof. The security system <b>114</b> may inform (e.g., by an alarm, by display on the display device <b>110</b>, by phone, by email, by text messages, etc.) people in the residence <b>104</b>, specific individuals, authorities, or combinations thereof, when one or more alarm conditions occur at the residence <b>104</b>. The authorities may be personnel of a security company, local police, local firefighters, medical personnel, other service personnel, or combinations thereof

0018The electronic devices <b>116</b> may include, but are not limited to, audio equipment (e.g., stereo receivers, compact disc players, etc.), video equipment (e.g., digital video disc players, digital video recorders, etc.), thermostats associated with heating/cooling systems for the residence <b>104</b>, telephones, base stations for mobile telephones, kitchen appliances, or other devices that can be controlled via received signals. For example, the electronic devices <b>116</b> may be controlled to turn the electronic devices <b>116</b> on or off. In another example, the electronic devices <b>116</b> may be controlled to perform more complex functions, such as increment or decrement a channel; increase or decrease volume, temperature, light intensity, rewind speed, or fast forward speed; forward an incoming phone call to voice mail, or other electronic device function.

0019The lighting <b>118</b> in the residence <b>104</b> may include lights in various rooms in the residence <b>104</b>, lights outside of the residence <b>104</b>, or both. The lighting <b>118</b> may be turned on or turned off by commands from the gesture controller <b>102</b>. Additionally or in the alternative, intensity of the lighting <b>118</b> may be changed in response to commands from the gesture controller <b>102</b> (e.g., when particular lights are controlled by dimmer switches).

0020The mobile communication device <b>120</b> may be able to couple to a wireless communication network. The mobile communication device <b>120</b> may connect to the network <b>126</b> via the CPE <b>106</b>. The presence of the mobile communication device <b>120</b> in the residence <b>104</b> or in a particular area of the residence may <b>104</b> be detected by the CPE <b>106</b>, the media device <b>108</b>, the computer system <b>112</b>, a base station for the mobile communication device <b>120</b>, a femtocell coupled to the CPE <b>106</b> to provide strong signal for the mobile communication device, another electronic device, or combinations thereof. When the mobile communication device <b>120</b> is detected near the display device <b>110</b>, the gesture controller <b>102</b> may send to the display device <b>110</b> a notification of an incoming call to the mobile communication device <b>120</b> and may provide options regarding on how to handle the incoming call. The mobile communication device <b>120</b> may be near the display device <b>110</b> when the mobile communication device <b>120</b> is in the residence <b>104</b> or when the mobile communication device <b>120</b> is in the same room as the display device <b>110</b>.

0021The gesture controller <b>102</b> may include a processor <b>128</b>, one or more interfaces <b>130</b> coupled to the processor <b>128</b>, and a memory <b>132</b> coupled to the processor <b>128</b>. The one or more interfaces <b>130</b> may receive signals from, and transmit signals to, the devices <b>106</b>-<b>120</b>. The one or more interfaces <b>130</b> may include wired interfaces and wireless interfaces. For example, the interfaces <b>130</b> may include, but are not limited to, a network interface, a display interface, a structural wiring interface, an infrared interface, an X10 interface, and combinations thereof.

0022The memory <b>132</b> may include settings <b>134</b>, device information <b>136</b>, one or more drivers <b>138</b>, and instructions <b>140</b>. The settings <b>134</b> may specify which devices <b>106</b>-<b>120</b> in the residence <b>104</b> are to be controllable with the gesture controller <b>102</b>. The settings <b>134</b> may also allow user defined gestures to be stored and utilized, may define what gestures activate a control session, what gestures end a control session, what gestures navigate menus, what gestures select options, and what gestures specify particular commands for the devices <b>106</b>-<b>120</b>. A single gesture may be used to provide commands to different ones of the devices <b>106</b>-<b>120</b>. For example, the gesture of raising or lowering an arm may be specified in the settings <b>134</b> to raise or lower volume associated with the display device <b>110</b>, to raise or lower volume of one or more of the electronic devices <b>116</b> (e.g., a stereo system or a radio), and to dim or brighten lighting <b>118</b> that is coupled to a controllable dimmer switch.

0023The settings <b>134</b> may be accessed via a user interface displayed on the display device <b>110</b>. For example, the media device <b>108</b>, the computer system <b>112</b>, the gesture controller <b>102</b>, or another device may send the user interface to the display device <b>110</b>. The user interface to change the settings <b>134</b> may be accessible via the computer system <b>112</b> or via a device other than the display device <b>110</b>.

0024The device information <b>136</b> may include information regarding devices to be controlled (e.g., the devices <b>106</b>-<b>120</b> identified in the settings <b>134</b>). The device information <b>136</b> for a particular device may include, but is not limited to, an address or identifier used to communicate with the particular device, which particular interface of the interfaces <b>130</b> is to be used to communicate with the particular device, and which driver of the drivers <b>138</b> is to be used to provide instructions for particular commands to be implemented by the particular device. When a new device is added to the settings <b>134</b>, an address or identifier used to communicate with the new device may be added manually, or the gesture controller <b>102</b> may automatically determine the address or identifier for the new device.

0025The drivers <b>138</b> may provide instructions that are sent to the devices <b>106</b>-<b>120</b> to implement commands. When a new device is added to the settings <b>134</b>, the user interface may provide an option to provide or identify an existing driver for the new device, or the user interface may provide an option to obtain the driver from the content providers <b>124</b> via the network <b>126</b>. A particular driver of the drivers <b>138</b> may be specific to a single device (e.g., to the media device) or may be applicable to many devices (e.g., to individual lights of the lighting <b>118</b>). The gesture controller <b>102</b> may include instructions to periodically or occasionally search for and obtain updated drivers for the devices <b>106</b>-<b>120</b> that the gesture controller <b>102</b> is able to control via the network <b>126</b>.

0026The instructions <b>140</b> may include code executable by the processor <b>128</b> to perform particular tasks. To simplify the description, the instructions <b>140</b> are shown as separate functional modules with each functional module associated with particular tasks. For example, the instructions <b>140</b> may be separated into a determine module <b>142</b>, a menu module <b>144</b>, and a send module <b>146</b>.

0027The determine module <b>142</b> may be executed by the processor <b>128</b> to process 3D image data from the gesture camera <b>122</b>. When the determine module <b>142</b> is running, the processor <b>128</b> may analyze the received 3D image data to determine when a recognized gesture is made by a person within range of the gesture camera <b>122</b>. Recognized gestures may include, for example, an initiate gesture, an end gesture, a navigation gesture, and a select gesture. The initiate gesture may be used to begin a gesture session. For example, when the determine module <b>142</b> detects a person near the gesture camera <b>122</b> performing the initiate gesture, the gesture controller <b>102</b> may send a menu to the display device <b>110</b>. The gesture controller <b>102</b> may ignore gestures made by one or more people in range of the gesture camera <b>122</b> until the initiate gesture is detected. When more than one person is in range of the gesture camera <b>122</b>, the running determine module <b>142</b> may cause the processor to identify one or more characteristics of a person who made the initiate gesture so that gestures by people other than the person who performed the initiate gesture are ignored during the gesture session. The gesture session may last until the determine module <b>142</b> detects the end gesture from the person who performed the initiate gesture or until a preset inactivity time (e.g., an inactivity time specified in the settings <b>134</b>) has passed since a last command was received from the person. When the end gesture is detected or the preset inactivity time has passed, the gesture controller <b>102</b> may remove the menu from the display device <b>110</b> and wait for detection of a new occurrence of the initiate gesture.

0028The end gesture may be the same gesture as the initiate gesture or may be a different gesture than the initiate gesture. For example, the initiate gesture specified in the settings <b>134</b> may include the person moving one or both hands towards and away from the display device <b>110</b>. The end gesture specified in the settings <b>134</b> may include the person bowing towards and away from the display device with the persons arms folded. Other preset gestures or user defined gestures may be chosen as the initiate gesture or the end gesture.

0029The navigation gesture may be used to navigate a set of user selectable options, such as a menu. For example, in response to the navigation gesture, the gesture controller <b>102</b> may cause movement of an indication that shows which option of the menu is currently selected. An unselected option may be slightly transparent when not selected. An option that is highlighted and slightly transparent may indicate that the option can be selected by the person (e.g., by performing the selection gesture). An option that is highlighted and opaque may have been selected by the person performing the selection gesture. For example, the navigation gesture may be performed by the person moving one or both arms right to left to move the highlight from a first option to a second option to the left of the first option or to the rightmost option when the highlight is on the leftmost option. The navigation gesture may be performed by the person moving one or both arms left to right to move the highlight from a first option to a second option to the right of the first option or to the leftmost option when the highlight is on the rightmost option. As another example, the options of the menu may be presented in a circular pattern on the display device. The navigation gesture may be performed using a circular motion, either clockwise or counterclockwise, to move the highlight. Other preset gestures or user defined gestures may be chosen as the navigation gesture.

0030The selection gesture may be a gesture that indicates selection of a highlighted option. For example, the selection gesture indicated in the settings <b>134</b> may be performed by the person moving one or both open hands towards and away from the display device <b>110</b>. Other preset gestures or user defined gestures may be chosen as the selection gesture.

0031When the processor <b>128</b> running the determine module <b>142</b> detects the initiate gesture, the processor <b>128</b> may use the menu module <b>144</b> to present the menu to the display device <b>110</b>. The menu may include options selectable by the person. The options may include symbols, icons, text, video clips (i.e., animated icons), or combinations thereof. The video clips may be looped. An option may be presented in a manner that indicates to the person what the option does or represents. The menu option may also indicate a particular gesture that can be performed to select the option without using the navigate gestures to navigate the menu. For example, a particular option to present a submenu for devices other than the media device <b>108</b> and the display device <b>110</b> that are controllable via the gesture controller <b>102</b> may include a title of “Other Devices.” The particular menu option may also include a video clip of a person clapping, may include the text “clap to select,” or both to indicate that that a submenu for other devices will be displayed on the display device <b>110</b> when the option is selected using the navigation gesture and the selection gesture, or when the user performs the gesture of clapping.

0032When the person selects an option associated with a submenu (e.g., via a gesture), the processor <b>128</b> running the determine module <b>142</b> may use the menu module <b>144</b> to present the submenu. When the person selects an option associated with a command (e.g., via a gesture), the processor <b>128</b> may use the send module <b>146</b> to send a command or commands to an appropriate device or devices, such as one of the devices <b>106</b>-<b>120</b>. For each command that is to be sent in response to the selection gesture, the processor <b>128</b> executing the send module <b>146</b> may access the device information <b>136</b> to determine which interface of the interfaces <b>130</b> to use to communicate with the appropriate device and may access the drivers <b>138</b> to create the appropriate command for the appropriate device. The processor <b>128</b> may send the created command to the appropriate device via the appropriate interface of the interfaces <b>130</b>.

0033In some embodiments, the gesture controller <b>102</b> may be part of another device. For example, the gesture controller <b>102</b> may be a component of the media device <b>108</b>, the display device <b>110</b>, or the computer system <b>112</b>. In some embodiments, the functionality of the menu module <b>144</b> may be present in and performed by another device (e.g., the media device <b>108</b>, the display device <b>110</b>, or the computer system <b>112</b>). For example, when the processor <b>128</b> running the determine module <b>142</b> detects a particular gesture, an indication of the gesture may be sent to the media device <b>108</b>. A processor of the media device <b>108</b> may execute instructions similar to the instructions of the menu module <b>144</b> that utilize the indication of the gesture to send appropriate display information (e.g., a submenu) to the display device <b>110</b>.

0034<figref idref="DRAWINGS">FIG. 2</figref> depicts an embodiment of a menu <b>200</b> sent to a display device <b>110</b> for device control based on gestures. The menu <b>200</b> may be sent to the display device <b>110</b> by a gesture controller, such as the gesture controller <b>102</b> depicted in <figref idref="DRAWINGS">FIG. 1</figref>. The menu <b>200</b> may be a top menu that is presented in response to a person in range of a gesture camera (e.g., the gesture camera <b>122</b> of <figref idref="DRAWINGS">FIG. 1</figref>) performing an initiate gesture. The menu <b>200</b> may include a plurality of icons associated with user selectable options, such as a volume icon <b>202</b>, a mute icon <b>204</b>, a channel icon <b>206</b>, a play icon <b>208</b>, and a devices icon <b>210</b>. As depicted in <figref idref="DRAWINGS">FIG. 2</figref>, the channel icon <b>206</b> is highlighted, as indicated by a highlight box <b>212</b> around the channel icon <b>206</b>. A user may move the highlight box <b>212</b> to the left or right by performing an appropriate navigate gesture. The user may select one of the icons <b>202</b>-<b>210</b> by highlighting the icon using the appropriate navigation gesture and by performing a select gesture. Some or all of the icons <b>202</b>-<b>210</b> may be associated with gestures that enable the user to quickly select particular icons. For example, after performing the initiate gesture, the person may perform a gesture of placing the person's hands against the person's ears to select the volume icon <b>202</b> or perform a gesture of placing the person's hands in front of the person's mouth to select the mute icon <b>204</b>.

0035Selection of an icon <b>202</b>-<b>210</b> may result in presentation of a new menu. For example, when the person selects the volume icon <b>202</b>, a submenu may be presented that includes additional icons, indications of gestures, or both that enable the person to increase the volume associated with the display device <b>110</b>, decrease the volume associated with the display device <b>110</b>, or end the gesture session when the volume is at a desired level. Selection of the channel icon <b>206</b> may present a submenu that includes additional icons, indications of gestures, or both to that enable the person to increase the channel number, decrease the channel number, or end the gesture session. Selection of the play icon <b>208</b> may present a list of devices that are available to play media content and an option to end the gesture session. When the person selects a particular device capable of playing media content or the particular device is the only device capable of playing media content, a menu that includes additional icons, indications of gestures, or both that enables the person to control the particular device and end the gesture session may be displayed. For example, controls for the particular device may include, but are not limited to, functions such as play, pause, record, fast forward, and rewind. Selection of the devices icon <b>210</b> may present a list of available devices, a list of available applications (e.g., a photo application that presents a slide show of photographs to the display device <b>110</b>), an option to end the gesture session, or combinations thereof. Selection of a particular available device may present a submenu that includes additional icons, indications of gestures, or both that enable the person to control the particular available device and end the gesture session. Selection of a particular application may cause the application to run.

0036Selection of an icon <b>202</b>-<b>210</b> may result in at least one command being sent to one or more devices. For example, in response to selection of the mute icon <b>204</b> a gesture controller may send a command to an audio device associated with the display device <b>110</b> to mute the audio device when the audio device is not muted or to resume providing audio for the audio device when the device is muted.

0037Referring to <figref idref="DRAWINGS">FIG. 3</figref>, a flow chart of a first particular embodiment of a method for electronic device control based on gestures is shown. The method may be performed, for example, by the system depicted in <figref idref="DRAWINGS">FIG. 1</figref>.

0038At <b>302</b>, an initiate gesture may be detected at a gesture controller in response to initial three dimensional (3D) image data obtained from a gesture camera. The initiate gesture may be a general initiate gesture or a specific gesture for a particular electronic device. The general initiate gesture may result in presentation of a menu (e.g., the menu <b>200</b> of <figref idref="DRAWINGS">FIG. 2</figref>) that that has options that can be selected to present submenus, to send commands, or both. The specific gesture for the particular device may be selected to present submenus, commands, or both for the particular device.

0039A user of the gesture controller may define a specific gesture for a particular device using a set-up feature of the gesture controller. For example, the user may access the set-up feature and select a particular gesture that will be associated with activating a menu associated with a security system. The particular gesture may be chosen from a set of pre-defined gestures or the particular gesture may be performed by the user in front of the gesture camera to establish a new gesture. The user may define one or more other gestures for the security system or other devices, for the initiate gestures, for navigation gestures, for end gestures, for selection gestures, or other types of gestures. The set-up feature may be accessed by various ways. For example, the set-up feature may be accessed by using an activation sequence on the gesture controller (e.g., pressing a set-up button of the gesture controller), by using a remote control device, by using an access device coupled to the gesture controller (e.g., a computer system or a set-top box device), by using gestures to access the set-up feature through the gesture controller, or combinations thereof.

0040The gesture controller may identify one or more characteristics of a first person performing the initiate gesture from the initial 3D image data to allow the first person to be tracked, at <b>304</b>. The one or more characteristics may include, but are not limited to, distinct features of the first person (e.g., hair length, hair color, height, facial characteristics, visible tattoos, etc.), clothing or jewelry worn by the first person, location of the first person in a room, or combinations thereof The location characteristic may be updated when the first person changes location in the room.

0041At <b>306</b>, gestures of a second person within range of the gesture camera other than the first person may be ignored after detecting the initiate gesture. For example, gestures performed by the second person may be ignored until the gesture controller detects an end gesture from the first person. In another example, gestures performed by the second person may be ignored until passage of a preset inactivity time from a previous gesture of the first person detected by the gesture controller. The inactivity time may be a parameter that the user can set via the set-up feature of the gesture controller. The end gesture may be the same as the initiate gesture or the end gesture may be a different gesture. When the end gesture is received from the first person, or when passage of the preset inactivity time occurs, received gestures may be ignored until the gesture controller detects another initiate gesture from the person or from another person.

0042At <b>308</b>, a menu may be sent from the gesture controller to a display device. The menu may include selectable options to control at least one electronic device. The menu may be sent in response to detection of the initiate gesture by the first person. Selection of the selectable options may result in presentation of one or more submenus or may result in generation of one or more commands to one or more devices.

0043At <b>310</b>, a first user gesture may be detected at the gesture controller in response to 3D image data obtained from the gesture camera. The first user gesture may be a gesture made by the first person. A command for a particular device may be determined at the gesture controller based on the first user gesture and based on the menu, at <b>312</b>.

0044At <b>314</b>, the gesture controller may determine that the first person is authorized to implement the at least one command for the particular device. Some commands (e.g., increasing or decreasing volume, muting an electronic device, adjusting lighting, etc.) may be made by any person. Other commands (e.g., changing channels, controlling a telephone, responding to an alarm condition of a security system, etc.) may be limited to a selected person or selected people. Restrictions for certain devices may be time dependent. For example, changing channels of a television may be unrestricted during a particular time slot (e.g., from 8:00 am to 6:00 pm) and may be restricted to one or more particular adults at other times. The authorization may be based on the one or more identified characteristics of the first person, the first person may be prompted to supply additional information, or both. The additional information may include, but is not limited to, a username, a password, a voice sample, fingerprint input, other identification credentials, or combinations thereof. Time dependencies and types of additional information needed for identification may be specified using the set-up feature of the gesture controller.

0045A decision based on the determination of whether the first person is authorized to implement the at least one command may be made, at <b>316</b>. When the determination is that the first person is not authorized to implement the command, a message may be sent to the display device, at <b>318</b>. The message may inform the first person that control of the particular device by the first person has been denied.

0046In a particular embodiment, other actions may be taken when the determination is that the first person is not authorized to implement the command. For example, user specified settings (entered via the set-up feature of the gesture controller) may determine what happens when an attempt to command an electronic device fails. The settings may include, but are not limited to, a number of attempts to access a device before access to the device is locked out for a user specified time, sending a message (e.g., a text message, an e-mail, or a phone message) to a designated person or people when a specified number of attempts fail, specific content of messages sent to the display device when attempts fail, and combinations thereof.

0047When the determination is that the first person is authorized to implement the command, the command may be sent from the gesture controller to the particular device, at <b>320</b>. The method may end, at <b>322</b>.

0048Referring to <figref idref="DRAWINGS">FIG. 4</figref>, a flow chart of a second particular embodiment of a method for electronic device control based on gestures is shown. The method may be performed, for example, by the system depicted in <figref idref="DRAWINGS">FIG. 1</figref>.

0049At <b>402</b>, an indication of activation of a particular electronic device may be received by a gesture controller. The gesture controller may send a menu to a display device, at <b>404</b>. The menu may include selectable options to control at least the particular electronic device. The menu may also include selectable options to control other electronic devices. For example, the menu may include an option to mute, pause, or stop one or more other electronic devices that are currently active and may include options to control the particular electronic device.

0050The menu may be specific to the particular electronic device. For example, the particular electronic device may be a telephone that is activated in response to the telephone receiving an incoming call. When the telephone is a mobile communication device, the gesture controller may receive an activation notice regarding the incoming call from a computer system, a set-top box device, a telephone base station, or other device that detects the presence of the mobile communication device near to the display device (e.g., within the same room as the display device). The gesture controller may receive caller identification information for the incoming call. The menu provided by the gesture controller may include the caller identification information and may provide several options. For example, the options may include, but are not limited to, an option to send the incoming call to voicemail, an option to pause or mute one or more other devices that are currently active and allow the call to ring to the telephone, an option to allow the call to ring to the telephone without changing a status of other active devices, and an option to terminate the call. The options may be presented as icons on the display device. A person using the menu may navigate the menu using navigation gestures (e.g., by moving an arm left or right to move a selection indicator from one icon to another icon) and may select a particular icon by performing a selection gesture (e.g., moving a hand or both hands towards and away from the display device). The icons may be animated or may show still images that suggest one or more gestures. The icons may represent specific gestures that the person can perform to activate particular icons. For example, the icon for terminating the call may show a representation of a user passing a hand in front of the user's throat. In this example, when the person passes a hand in front of his or her throat, the call may be terminated without the person having to navigate to the icon for terminating the call.

0051As another example, the particular electronic device may be a controller of a security system that is activated (e.g., because a window or a door has been opened). The controller of the security system may send information regarding an alarm to the gesture controller. The gesture controller may send a menu to the display device that presents the information regarding the alarm and options. The options may include, but are not limited to, an option to immediately notify one or more authorities (e.g., a security company, the police, or both) and an option to delay notifying the one or more authorities for a period of time (e.g., 5 minutes). When the person chooses the option to delay, the display screen may show a countdown timer for remaining time, the option to immediately notify the one or more authorities, and an option to resume normal operation of the security system. Should the countdown time reach zero, the one or more authorities may be automatically notified of a potential problem. An attempt by a person other than an authorized individual to select the option to delay or the option to resume normal operation of the security system may result in automatic notification of the one or more authorities of a potential problem.

0052At <b>406</b>, a first user gesture from a first person may be detected at the gesture controller in response to three dimensional (3D) image data obtained from a gesture camera. At least one command for the particular device may be determined at the gesture controller based on the first user gesture and the based on the menu, at <b>408</b>.

0053At <b>410</b>, the gesture controller may determine that the first person is authorized to implement the command for the particular device. The authorization may be based on the 3D image data, additional information provided by the first person, or both. The additional information may include, but is not limited to, a username, a password, a voice sample, fingerprint input, other identification credentials, or combinations thereof.

0054A decision based on the determination of whether the first person is authorized to implement the command may be made, at <b>412</b>. When the determination is that the first person is not authorized to implement the command, a message may be sent to the display device, at <b>414</b>. The message may inform the first person that control of the particular device by the first person has been denied. When the determination is that the first person is authorized to implement the command, the command may be sent from the gesture controller to the particular device, at <b>416</b>. The method may end, at <b>418</b>.

0055Various embodiments disclosed herein enable electronic devices within a residence to be controlled based on gestures made by a user. The gestures may enable control of one or more devices without the need for the user to hold, wear, or be in contact with a sensor or a remote control device. Gestures of a user may be detected by a three dimensional (3D) image device. Data from the 3D image device may be analyzed by a gesture controller to determine whether gestures made by the user should be ignored, should result in sending a menu to a display device, should result in navigation of the menu, should result in selection of menu options, or should result in the gesture controller sending at least one command to one or more devices. The gesture controller may replace a remote control device, may be used when the user does not desire to use or cannot easily access the remote control device, or may be used when the user wants to control a device that is able to be controlled using the gesture controller but not the remote control device.

0056Referring to <figref idref="DRAWINGS">FIG. 5</figref>, an illustrative embodiment of a general computer system is shown and is designated <b>500</b>. The computer system <b>500</b> may include a set of instructions that can be executed to cause the computer system <b>500</b> to perform any one or more of the methods or computer based functions disclosed herein. The computer system <b>500</b> may operate as a standalone device or may be connected, e.g., using a network, to other computer systems or peripheral devices. For example, the computer system <b>500</b> may include or be included within any one or more of the gesture controller <b>102</b>, the CPE <b>106</b>, the media device <b>108</b>, the display device <b>110</b>, the computer system <b>112</b>, the security system <b>114</b>, one or more of the electronic devices <b>116</b>, the lighting <b>118</b>, the mobile communication device <b>120</b>, and the gesture camera <b>122</b> described with reference to <figref idref="DRAWINGS">FIG. 1</figref>.

0057In a networked deployment, the computer system <b>500</b> may operate in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system <b>500</b> may also be implemented as or incorporated into various devices, such as a personal computer (PC), a tablet PC, a set-top box (STB), a personal digital assistant (PDA), a mobile device, a palmtop computer, a laptop computer, a desktop computer, a communications device, a wireless telephone, a land-line telephone, a control system, a web appliance, or any other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. In a particular embodiment, the computer system <b>500</b> may be implemented using electronic devices that provide video, audio, or data communication. Further, while a single computer system <b>500</b> is illustrated, the term “system” shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.

0058As illustrated in <figref idref="DRAWINGS">FIG. 5</figref>, the computer system <b>500</b> may include a processor <b>502</b>, e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both. Moreover, the computer system <b>500</b> may include a main memory <b>504</b> and a static memory <b>506</b>, which can communicate with each other via a bus <b>508</b>. As shown, the computer system <b>500</b> may further include a video display unit <b>510</b>, such as a liquid crystal display (LCD), a projection television system, a flat panel display, or a solid state display. Additionally, the computer system <b>500</b> may include an input device <b>512</b>, such as a keyboard, and a cursor control device <b>514</b>, such as a mouse. The computer system <b>500</b> may also include a disk drive unit <b>516</b>, a signal generation device <b>518</b>, such as a speaker or remote control, and a network interface device <b>520</b>. Some computer systems <b>500</b> may not include an input device (e.g., a server may not include an input device).

0059In a particular embodiment, as depicted in <figref idref="DRAWINGS">FIG. 5</figref>, the disk drive unit <b>516</b> may include a computer-readable non-transitory storage medium <b>522</b> in which one or more sets of instructions <b>524</b>, e.g. software, can be embedded. Further, the instructions <b>524</b> may embody one or more of the methods or logic as described herein. In a particular embodiment, the instructions <b>524</b> may reside completely, or at least partially, within the main memory <b>504</b>, the static memory <b>506</b>, and/or within the processor <b>502</b> during execution by the computer system <b>500</b>. The main memory <b>504</b> and the processor <b>502</b> also may include computer-readable non-transitory storage media.

0060In an alternative embodiment, dedicated hardware implementations, such as application specific integrated circuits, programmable logic arrays and other hardware devices, may be constructed to implement one or more of the methods described herein. Applications that may include the apparatus and systems of various embodiments may broadly include a variety of electronic and computer systems. One or more embodiments described herein may implement functions using two or more specific interconnected hardware modules or devices with related control and data signals that can be communicated between and through the modules, or as portions of an application-specific integrated circuit. Accordingly, the present system encompasses software, firmware, and hardware implementations.

0061In accordance with various embodiments of the present disclosure, the methods described herein may be implemented by software programs executable by a computer system. Further, in an exemplary, non-limited embodiment, implementations may include distributed processing, component/object distributed processing, and parallel processing. Alternatively, virtual computer system processing may be constructed to implement one or more of the methods or functionality as described herein.

0062The present disclosure contemplates a computer-readable non-transitory storage medium <b>522</b> that stores instructions <b>524</b> or receives, stores and executes instructions <b>524</b>, so that a device connected to a network <b>526</b> may communicate voice, video or data over the network <b>526</b>. Further, the instructions <b>524</b> may be transmitted or received over the network <b>526</b> via the network interface device <b>520</b>.

0063While the computer-readable non-transitory storage medium is shown to be a single medium, the term “computer-readable non-transitory medium” includes a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The term “computer-readable non-transitory medium” shall also include any medium that is capable of storing or encoding a set of instructions for execution by a processor or that cause a computer system to perform any one or more of the methods or operations disclosed herein.

0064In a particular non-limiting, exemplary embodiment, the computer-readable non-transitory storage medium may include a solid-state memory such as a memory card or other package that houses one or more non-volatile read-only memories. Further, the computer-readable non-transitory storage medium may be a random access memory or other volatile re-writable memory. Additionally, the computer-readable non-transitory storage medium may include a magneto-optical or optical medium, such as a disk or tapes or other storage device. Accordingly, the disclosure is considered to include any one or more of a computer-readable non-transitory storage medium and other equivalents and successor media, in which data or instructions may be stored.

0065Although the present specification describes components and functions that may be implemented in particular embodiments with reference to particular standards and protocols, the disclosed embodiments are not limited to such standards and protocols. For example, standards for Internet and other packet switched network transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP, IEEE 802.x) represent examples of the state of the art. Such standards are periodically superseded by faster or more efficient equivalents having essentially the same functions. Accordingly, replacement standards and protocols having the same or similar functions as those disclosed herein are considered equivalents thereof.

0066The illustrations of the embodiments described herein are intended to provide a general understanding of the structure of the various embodiments. The illustrations are not intended to serve as a complete description of all of the elements and features of apparatus and systems that utilize the structures or methods described herein. Many other embodiments may be apparent to those of skill in the art upon reviewing the disclosure. Other embodiments may be utilized and derived from the disclosure, such that structural and logical substitutions and changes may be made without departing from the scope of the disclosure. Accordingly, the disclosure and the figures are to be regarded as illustrative rather than restrictive.

0067One or more embodiments of the disclosure may be referred to herein, individually and/or collectively, by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any particular invention or inventive concept. Moreover, although specific embodiments have been illustrated and described herein, it should be appreciated that any subsequent arrangement designed to achieve the same or similar purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all subsequent adaptations or variations of various embodiments.

0068The Abstract of the Disclosure is provided with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, various features may be grouped together or described in a single embodiment for the purpose of streamlining the disclosure. This disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter may be directed to less than all of the features of any of the disclosed embodiments. Thus, the following claims are incorporated into the Detailed Description, with each claim standing on its own as defining separately claimed subject matter.

0069The above-disclosed subject matter is to be considered illustrative, and not restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments, which fall within the scope of the present disclosure. Thus, to the maximum extent allowed by law, the scope of the present disclosure is to be determined by the broadest permissible interpretation of the following claims and their equivalents, and shall not be restricted or limited by the foregoing detailed description.